Nonparametric estimation of the rediscovery rate |
| |
| Authors: | Donghwan Lee Andrea Ganna Yudi Pawitan Woojoo Lee |
| |
| Institution: | 1. Department of Statistics, Ewha Womans University, Seoul, Korea;2. Department of Medical Epidemiology and Biostatistics, Karolinska Institutet, Stockholm, Sweden;3. Program in Medical and Population Genetics, Broad Institute of MIT and Harvard, Cambridge, MA, U.S.A.;4. Analytical and Translational Genetics Unit, Department of Medicine, Massachusetts General Hospital and Harvard Medical School, Boston, MA, U.S.A.;5. Department of Statistics, Inha University, Incheon, Korea |
| |
| Abstract: | Validation studies have been used to increase the reliability of the statistical conclusions for scientific discoveries; such studies improve the reproducibility of the findings and reduce the possibility of false positives. Here, one of the important roles of statistics is to quantify reproducibility rigorously. Two concepts were recently defined for this purpose: (i) rediscovery rate (RDR), which is the expected proportion of statistically significant findings in a study that can be replicated in the validation study and (ii) false discovery rate in the validation study (vFDR). In this paper, we aim to develop a nonparametric approach to estimate the RDR and vFDR and show an explicit link between the RDR and the FDR. Among other things, the link explains why reproducing statistically significant results even with low FDR level may be difficult. Two metabolomics datasets are considered to illustrate the application of the RDR and vFDR concepts in high‐throughput data analysis. Copyright © 2016 John Wiley & Sons, Ltd. |
| |
| Keywords: | rediscovery rate multiple testing false discovery rate validation study |
|
|
