Type: Journal Publication
Abstract: Error estimation must be used to find the accuracy of a designed classifier, an issue that is critical in biomarker discovery for disease diagnosis and prognosis in genomics and proteomics. This paper presents, for what is believed to be the first time, the analytical formulation for the joint sampling distribution of the actual and estimated errors of a classification rule. The analysis presented here concerns the linear discriminant analysis (LDA) classification rule and the resubstitution and leave-one-out error estimators, under a general parametric Gaussian assumption. Exact results are provided in the univariate case, and a simple method is suggested to obtain an accurate approximation in the multivariate case. It is also shown how these results can be applied in the computation of condition bounds and the regression of the actual error, given the observed error estimate. In contrast to asymptotic results, the analysis presented here is applicable to finite training data. In particular, it applies in the small-sample settings commonly found in genomics and proteomics applications. Numerical examples, which include parameters estimated from actual microarray data, illustrate the analysis throughout.
Cited as: Zollanvari, A, Braga-Neto and Dougherty, E.R., "Joint Sampling Distribution Between Actual and Estimated Classification Errors for Linear Discriminant Analysis", Published in: Information Theory, IEEE Transactions on (Volume:56 , Issue: 2 ) Date of Publication: Feb. 2010 Page(s): 784 - 804 ISSN : 0018-9448 INSPEC Accession Number: 11152615 Digital Object Identifier : 10.1109/TIT.2009.2037034 Date of Current Version : 25 febrero 2010 Issue Date : Feb. 2010 Sponsored by : IEEE Information Theory Society