If you use code found here in a publication or presentation, I would appreciate it if you would acknowledge the source.

Menu

• Robust kernel density estimation
• Surrogate losses for label dependent costs: Figures.
• Cluster nearest neighbor algorithm for file matching, and associated EM algorithm for fitting a mixture of PPCA model with missing attributes.
• TCEM: EM algorithm for fitting a multivariate Gaussian mixture model with truncated and censored data.
• Nested support vector machines for cost-sensitive and one-class classification
• SVM path algorithms for cost-sensitive and one-class classification
• $L_2$ kernel classification, optimizing the integrated squared error of the difference of densities
• MN-SCAnn: Nonparametric annotation of multivariate, contaminated data
• Weighted L2E for partial mixture estimation
• 2$\nu$-SVM, a cost-sensitive extension of the $\nu$-SVM
• Dyadic decision trees with free-splits, for classification and other set estimation problems
• COPAP: Cyclic order preserving assigment problem for shape matching

Details

• Robust kernel density estimation.

  J. Kim and C. Scott, ``Robust kernel density estimation, 2011.

  J. Kim and C. Scott, "On the Robustness of Kernel Density M-Estimators," Proceedings of the Twenty-Eighth International Conference on Machine Learning (ICML), 2011.

  J. Kim and C. Scott, "Robust kernel density estimation," Proc. Int. Conf. on Acoustics, Speech, and Signal Processing (ICASSP), 3381-3384, 2008.

• Surrogate losses for label-dependent costs. Generates the figures in this paper:

  C. Scott, "Calibrated Surrogate Losses for Classification with Label-Dependent Costs," [pdf]

• Cluster nearest neighbor algorithm for file matching, and associated EM algorithm for fitting a mixture of PPCA model with missing attributes.

  G. Lee, W. Finn, and C. Scott, "Statistical file matching of flow cytometry data." [pdf]

• TCEM: EM algorithm for fitting a multivariate Gaussian mixture model with truncated and censored data.

  G. Lee and C. Scott, ``EM algorithms for multivariate Gaussian mixture models with truncated and censored data."

• Nested support vector machines: Matlab code to generate cost-sensitive and one-class SVMs that are properly nested (unlike standard SVMS) as the cost-asymmetry or density level parameter is varied. The solution paths are piecewise linear with a user-selected number of breakpoints.

  G. Lee and C. Scott, ``Nested support vector machines," to be published in IEEE Trans. Signal Processing. [pdf]

  G. Lee and C. Scott, ``Nested support vector machines," Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2008), 1985-1988, Las Vegas, 2008. [pdf]

• SVM path algorithms: Matlab code to generate solution paths for the cost-sensitive SVM with varying cost-asymmetry, and the one-class SVM with varying density level parameter. The algorithms were inspired by the path algorithm of Hastie et al., which varies a regularization parameter, and were implemented for comparison with the nested SVM code above. The CS-SVM algorithm is different from the one developed by Bach et al. in that we capture the cost asymmetry in a single parameter. The OC-SVM path algorithm was detailed here:

  G. Lee and C. Scott, ``The one class support vector machine solution path," Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2007), vol. 2, II-521--II-524, Honolulu, USA, April 2007. [ pdf]

• L_2 kernel classification: Matlab code to implement a method of classification based on the $L_2$ distance or integrated squared error, and detailed in

  J. Kim and C. Scott, ``$L_2$ kernel classification," accepted, IEEE Trans. Pattern Analysis and Machine Intelligence. [pdf]

  J. Kim and C. Scott, ``Performance analysis for L2 kernel classification," Advances in Neural Information Processing Systems 21 (NIPS 2008), D. Koller, D. Schuurmans, Y. Bengio and L. Bottou, Eds., pp. 833-840, 2009. [pdf]

• MN-SCAnn: Matlab code for for nonparametric annotation of multivariate, contaminated data, detailed here:

  C. Scott and E. Kolaczyk, ``Nonparametric assessment of contamination in multivariate data using generalized quantile sets and FDR," to appear J. Computational and Graphical Statistics. [pdf]

  C. Scott and E. Kolaczyk, ``Annotated minimum volume sets for nonparametric anomaly discovery," IEEE Workshop on Statistical Signal Processing, 234-238, Madison, WI, August 2007 [pdf]

• Partial mixture estimation: R code and documentation for semi-parametric partial mixture estimation using a weighted L2 distance, applied to microarray differential expression analysis and detailed in

  D. Rossell, R. Guerra and C. Scott, ``Semi-parametric differential expression analysis via partial mixture estimation," Statistical Applications in Genetics and Molecular Biology, vol. 7, no. 1, article 15, 2008. [pdf]

• 2nu-SVM: An implementation of the 2$\nu$-SVM, a cost-sensitive extension of the $\nu$-SVM, based on the LIBSVM package and described in this paper:

  M. Davenport, R. Baraniuk, and C. Scott, ``Tuning support vector machines for minimax and Neyman-Pearson classification," Rice University Technical Report TREE0804, 2008, to appear, IEEE Trans. Pattern Analysis and Machine Intelligence. [pdf]

• Dyadic decision trees: Matlab/mex code for solving several set estimation problems, including traditional binary and multi-class classification, Neyman-Pearson classification, minimum volume set estimation, and density level set estimation. Estimates are based on free-split recursive dyadic partitions. Practical for problems of dimension less than 10. Thanks to Gilles Blanchard for helpful discussions regarding the implementation of the dyadic binning algorithm.

  C. Scott and R. Nowak, ``Minimax-optimal classification with dyadic decision trees," IEEE Transactions on Information Theory, vol. 52, no. 4, pp. 1335--1353, April 2006. [pdf]

  C. Scott and R. Nowak, ``Learning minimum volume sets," Journal of Machine Learning Research, vol. 7, pp. 665--704, April 2006. [pdf]

• Cyclic contour matching: Matlab code for aligning two point sets obtained by sampling cyclic contours. Implements the algorithms and reproduces the examples found in this paper:

  C. Scott and R. Nowak, ``Robust contour matching via the order preserving assignment problem," IEEE Transactions on Image Processing, vol. 15, no. 7, pp. 1831-1838, July 2006. [pdf]

This work was supported in part by NSF Awards 0830490 and 0953135.