| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
|
|
|
|||||||
|
|||||||||
Departments of Preventive Medicine and Biometrics and of Physiology and Biophysics, School of Medicine, University of Colorado Health Sciences Center, Denver, Colorado 80262
Statistical procedures underpin the process of scientific discovery. As
researchers, one way we use these procedures is to test the validity of
a null hypothesis. Often, we test the validity of more than one null
hypothesis. If we fail to use an appropriate procedure to account for
this multiplicity, then we are more likely to reach a wrong scientific
conclusion
we are more likely to make a mistake. In physiology,
experiments that involve multiple comparisons are common: of the
original articles published in 1997 by the American Physiological
Society, ~40% cite a multiple comparison procedure. In this review,
I demonstrate the statistical issue embedded in multiple comparisons,
and I summarize the philosophies of handling this issue. I also
illustrate the three proceduresNewman-Keuls, Bonferroni, least
significant differencecited most often in my literature review; each
of these procedures is of limited practical value. Last, I demonstrate
the false discovery rate procedure, a promising development in multiple
comparisons. The false discovery rate procedure may be the best
practical solution to the problems of multiple comparisons that exist
within physiology and other scientific disciplines.
Bonferroni inequality, false discovery rate, least significant difference, Newman-Keuls, statistics
This article has been cited by other articles:
|
|
 |
|
  I. B. Hogue, S. H. Bajaria, B. A. Fallert, S. Qin, T. A. Reinhart, and D. E. Kirschner The dual role of dendritic cells in the immune response to human immunodeficiency virus type 1 infection J. Gen. Virol., September 1, 2008; 89(9): 2228 - 2239. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 R. Gentner, K. Wankerl, C. Reinsberger, D. Zeller, and J. Classen Depression of Human Corticospinal Excitability Induced by Magnetic Theta-burst Stimulation: Evidence of Rapid Polarity-Reversing Metaplasticity Cereb Cortex, September 1, 2008; 18(9): 2046 - 2053. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 H. J. Green, E. Bombardier, M. Burnett, S. Iqbal, C. L. D'Arsigny, D. E. O'Donnell, J. Ouyang, and K. A. Webb Organization of metabolic pathways in vastus lateralis of patients with chronic obstructive pulmonary disease Am J Physiol Regulatory Integrative Comp Physiol, September 1, 2008; 295(3): R935 - R941. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 N. Mallet, A. Pogosyan, A. Sharott, J. Csicsvari, J. P. Bolam, P. Brown, and P. J. Magill Disrupted Dopamine Transmission and the Emergence of Exaggerated Beta Oscillations in Subthalamic Nucleus and Cerebral Cortex J. Neurosci., April 30, 2008; 28(18): 4795 - 4806. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 J. Zhang, Z.-J. Yang, J. A. Klaus, R. C. Koehler, and J. Huang Delayed Tolerance With Repetitive Transient Focal Ischemic Preconditioning in the Mouse Stroke, March 1, 2008; 39(3): 967 - 974. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
S. Vollenweider, A. Wirz-Justice, J. Flammer, S. Orgul, and K. Krauchi Chronobiological characterization of women with primary vasospastic syndrome: body heat loss capacity in relation to sleep initiation and phase of entrainment Am J Physiol Regulatory Integrative Comp Physiol, February 1, 2008; 294(2): R630 - R638. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 P. K. Rangachari Statistics: not a confidence trick. A commentary on "Guidelines for reporting statistics in journals published by the American Physiological Society: the sequel" Advan Physiol Educ, December 1, 2007; 31(4): 300 - 301. [Full Text] [PDF]
|
|
|
|
|
|
D. Curran-Everett and D. J. Benos Last Word on Perspectives "Guidelines for reporting statistics in journals published by the American Physiological Society: the sequel" Advan Physiol Educ, December 1, 2007; 31(4): 306 - 307. [Full Text] [PDF]
|
|
|
|
|
|
P. Boily, B. B. Rees, and L. A. C. Williamson Vertebrate osmoregulation: a student laboratory exercise using teleost fish Advan Physiol Educ, December 1, 2007; 31(4): 352 - 357. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 H. Xu, W. Tian, Y. Fu, T. T. Oyama, S. Anderson, and D. M. Cohen Functional effects of nonsynonymous polymorphisms in the human TRPV1 gene Am J Physiol Renal Physiol, December 1, 2007; 293(6): F1865 - F1876. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 D. S. Ward, W. A. Voter, and S. Karan The effects of hypo- and hyperglycaemia on the hypoxic ventilatory response in humans J. Physiol., July 15, 2007; 582(2): 859 - 869. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 J. Portnoy, K. L. Veraldi, M. I. Schwarz, C. D. Cool, D. Curran-Everett, R. M. Cherniack, T. E. King Jr, and K. K. Brown Respiratory Bronchiolitis-Interstitial Lung Disease: Long-term Outcome Chest, March 1, 2007; 131(3): 664 - 671. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 P. Rabbah and F. Nadim Distinct Synaptic Dynamics of Heterogeneous Pacemaker Neurons in an Oscillatory Network J Neurophysiol, March 1, 2007; 97(3): 2239 - 2253. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M. M. Wurfel Microarray-based Analysis of Ventilator-induced Lung Injury Proceedings of the ATS, January 1, 2007; 4(1): 77 - 84. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M. R. DeBaun and J. J. Field Limitations of Clinical Trials in Sickle Cell Disease: A Case Study of the Multi-center Study of Hydroxyurea (MSH) Trial and the Stroke Prevention (STOP) Trial Hematology, January 1, 2007; 2007(1): 482 - 488. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 J. C. Cohen Genetic Approaches to Coronary Heart Disease J. Am. Coll. Cardiol., October 27, 2006; 48(9_Suppl_A): A10 - A14. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 L. B. Signorello, S. S. Cohen, C. Bosetti, M. Stovall, C. E. Kasper, R. E. Weathers, J. A. Whitton, D. M. Green, S. S. Donaldson, A. C. Mertens, et al. Female survivors of childhood cancer: preterm birth and low birth weight among their children. J Natl Cancer Inst, October 18, 2006; 98(20): 1453 - 1461. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 N. Messina and C. Grella Childhood Trauma and Women's Health Outcomes in a California Prison Population Am J Public Health, October 1, 2006; 96(10): 1842 - 1848. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 D. Weise, A. Schramm, K. Stefan, A. Wolters, K. Reiners, M. Naumann, and J. Classen The two sides of associative plasticity in writer's cramp Brain, October 1, 2006; 129(10): 2709 - 2721. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 S Hoffmann and T Hartung Toward an evidence-based toxicology Human and Experimental Toxicology, September 1, 2006; 25(9): 497 - 513. [Abstract] [PDF]
|
|
|
|
 |
|
 R. Kawati, L. Vimlati, J. Guttmann, G. Hedenstierna, U. Sjostrand, S. Schumann, and M. Lichtwarck-Aschoff Change in expiratory flow detects partial endotracheal tube obstruction in pressure-controlled ventilation. Anesth. Analg., September 1, 2006; 103(3): 650 - 657. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
H. Ohata, S. Cao, and R. C. Koehler Contribution of adenosine A2A and A2B receptors and heme oxygenase to AMPA-induced dilation of pial arterioles in rats Am J Physiol Regulatory Integrative Comp Physiol, September 1, 2006; 291(3): R728 - R735. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
C. Schmidt, P. Peigneux, V. Muto, M. Schenkel, V. Knoblauch, M. Munch, D. J.-F. de Quervain, A. Wirz-Justice, and C. Cajochen Encoding Difficulty Promotes Postlearning Changes in Sleep Spindle Activity during Napping. J. Neurosci., August 30, 2006; 26(35): 8976 - 8982. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 C. Keller, R. Hoffmann, R. Lang, S. Brandau, C. Hermann, and S. Ehlers Genetically Determined Susceptibility to Tuberculosis in Mice Causally Involves Accelerated and Enhanced Recruitment of Granulocytes Infect. Immun., July 1, 2006; 74(7): 4295 - 4309. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
P. J. Magill, A. Pogosyan, A. Sharott, J. Csicsvari, J. P. Bolam, and P. Brown Changes in functional connectivity within the rat striatopallidal axis during global brain activation in vivo. J. Neurosci., June 7, 2006; 26(23): 6318 - 6329. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
Y. Fu, A. Subramanya, D. Rozansky, and D. M. Cohen WNK kinases influence TRPV4 channel function and localization Am J Physiol Renal Physiol, June 1, 2006; 290(6): F1305 - F1314. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 C. P. Hersh, D. L. DeMeo, R. Lazarus, J. C. Celedon, B. A. Raby, J. O. Benditt, G. Criner, B. Make, F. J. Martinez, P. D. Scanlon, et al. Genetic Association Analysis of Functional Impairment in Chronic Obstructive Pulmonary Disease Am. J. Respir. Crit. Care Med., May 1, 2006; 173(9): 977 - 984. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. Munch, S. Kobialka, R. Steiner, P. Oelhafen, A. Wirz-Justice, and C. Cajochen Wavelength-dependent effects of evening light exposure on sleep architecture and sleep EEG power density in men Am J Physiol Regulatory Integrative Comp Physiol, May 1, 2006; 290(5): R1421 - R1428. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
K. Krauchi, V. Knoblauch, A. Wirz-Justice, and C. Cajochen Challenging the sleep homeostat does not influence the thermoregulatory system in men: evidence from a nap vs. sleep-deprivation study Am J Physiol Regulatory Integrative Comp Physiol, April 1, 2006; 290(4): R1052 - R1061. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
H. Ye, D. W. Morton, and H. J. Chiel Neuromechanics of Coordination during Swallowing in Aplysia californica J. Neurosci., February 1, 2006; 26(5): 1470 - 1485. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 C. A. McMullen and F. H. Andrade Contractile dysfunction and altered metabolic profile of the aging rat thyroarytenoid muscle J Appl Physiol, February 1, 2006; 100(2): 602 - 608. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
D. A. Syme, K. Evashuk, B. Grintuch, E. L. Rezende, and T. Garland Jr. Contractile abilities of normal and "mini" triceps surae muscles from mice (Mus domesticus) selectively bred for high voluntary wheel running J Appl Physiol, October 1, 2005; 99(4): 1308 - 1316. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 E. Salcedo, C. Zhang, E. Kronberg, and D. Restrepo Analysis of Training-Induced Changes in Ethyl Acetate Odor Maps Using a New Computational Tool to Map the Glomerular Layer of the Olfactory Bulb Chem Senses, September 1, 2005; 30(7): 615 - 626. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
Z. Zhang, J. D. Ferraris, C. E. Irarrazabal, N. I. Dmitrieva, J.-H. Park, and M. B. Burg Ataxia telangiectasia-mutated, a DNA damage-inducible kinase, contributes to high NaCl-induced nuclear localization of transcription factor TonEBP/OREBP Am J Physiol Renal Physiol, September 1, 2005; 289(3): F506 - F511. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. Fluck, C. Dapp, S. Schmutz, E. Wit, and H. Hoppeler Transcriptional profiling of tissue plasticity: role of shifts in gene expression and technical limitations J Appl Physiol, August 1, 2005; 99(2): 397 - 413. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
C. R. Levy, E. W. Ely, K. Payne, R. A. Engelberg, D. L. Patrick, and J. R. Curtis Quality of Dying and Death in Two Medical ICUs: Perceptions of Family and Clinicians Chest, May 1, 2005; 127(5): 1775 - 1783. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
H. Xu, W. Tian, J. N. Lindsley, T. T. Oyama, J. M. Capasso, C. J. Rivard, H. T. Cohen, S. M. Bagnasco, S. Anderson, and D. M. Cohen EphA2: expression in the renal medulla and regulation by hypertonicity and urea stress in vitro and in vivo Am J Physiol Renal Physiol, April 1, 2005; 288(4): F855 - F866. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
D. Curran-Everett and D. J. Benos Guidelines for reporting statistics in journals published by the American Physiological Society Advan Physiol Educ, September 1, 2004; 28(3): 85 - 87. [Full Text] [PDF]
|
|
|
|
 |
|
 D. Curran-Everett and D. J. Benos Guidelines for reporting statistics in journals published by the American Physiological Society Physiol Genomics, August 11, 2004; 18(3): 249 - 251. [Full Text] [PDF]
|
|
|
|
|
|
D. Curran-Everett and D. J. Benos Guidelines for reporting statistics in journals published by the American Physiological Society J Neurophysiol, August 1, 2004; 92(2): 669 - 671. [Full Text] [PDF]
|
|
|
|
|
|
D. Curran-Everett and D. J. Benos Guidelines for reporting statistics in journals published by the American Physiological Society J Appl Physiol, August 1, 2004; 97(2): 457 - 459. [Full Text] [PDF]
|
|
|
|
 |
|
 D. Curran-Everett and D. J. Benos Guidelines for reporting statistics in journals published by the American Physiological Society Am J Physiol Gastrointest Liver Physiol, August 1, 2004; 287(2): G307 - G309. [Full Text] [PDF]
|
|
|
|
 |
|
 D. Curran-Everett and D. J. Benos Guidelines for reporting statistics in journals published by the American Physiological Society Am J Physiol Cell Physiol, August 1, 2004; 287(2): C243 - C245. [Full Text] [PDF]
|
|
|
|
 |
|
 D. Curran-Everett and D. J. Benos Guidelines for reporting statistics in journals published by the American Physiological Society Am J Physiol Endocrinol Metab, August 1, 2004; 287(2): E189 - E191. [Full Text] [PDF]
|
|
|
|
 |
|
 D. Curran-Everett and D. J. Benos Guidelines for reporting statistics in journals published by the American Physiological Society Am J Physiol Lung Cell Mol Physiol, August 1, 2004; 287(2): L259 - L261. [Full Text] [PDF]
|
|
|
|
|
|
D. Curran-Everett and D. J. Benos Guidelines for reporting statistics in journals published by the American Physiological Society Am J Physiol Regulatory Integrative Comp Physiol, August 1, 2004; 287(2): R247 - R249. [Full Text] [PDF]
|
|
|
|
 |
|
 D. Curran-Everett and D. J. Benos Guidelines for reporting statistics in journals published by the American Physiological Society Am J Physiol Heart Circ Physiol, August 1, 2004; 287(2): H447 - H449. [Full Text] [PDF]
|
|
|
|
|
|
D. Curran-Everett and D. J. Benos Guidelines for reporting statistics in journals published by the American Physiological Society Am J Physiol Renal Physiol, August 1, 2004; 287(2): F169 - F171. [Full Text] [PDF]
|
|
|
|
|
|
G. Thabut, M. Fournier, H. R. Collard, and K. K. Brown Prognosis in Idiopathic Pulmonary Fibrosis Am. J. Respir. Crit. Care Med., May 1, 2004; 169(9): 1075 - 1076. [Full Text] [PDF]
|
|
|
|
|
|
V. Knoblauch, K. Krauchi, C. Renz, A. Wirz-Justice, and C. Cajochen Homeostatic Control of Slow-wave and Spindle Frequency Activity during Human Sleep: Effect of Differential Sleep Pressure and Brain Topography Cereb Cortex, October 1, 2002; 12(10): 1092 - 1100. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 L. D. Clifford and D. J. Anderson Clutch size variation in the Nazca booby: a test of the egg quality hypothesis Behav. Ecol., March 1, 2002; 13(2): 274 - 279. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
C. Linster, B. A. Johnson, E. Yue, A. Morse, Z. Xu, E. E. Hingco, Y. Choi, M. Choi, A. Messiha, and M. Leon Perceptual Correlates of Neural Representations Evoked by Odorant Enantiomers J. Neurosci., December 15, 2001; 21(24): 9837 - 9843. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
A. Rebel, J. A. Ulatowski, K. Joung, E. Bucci, R. J. Traystman, and R. C. Koehler Regional cerebral blood flow in cats with cross-linked hemoglobin transfusion during focal cerebral ischemia Am J Physiol Heart Circ Physiol, March 1, 2002; 282(3): H832 - H841. [Abstract] [Full Text] [PDF]
|
|
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| Visit Other APS Journals Online |
