medigraphic.com
Federación Mexicana de Ginecología y Obstetricia, A.C.

2020, Number 08

<< Back Next >>

Ginecol Obstet Mex 2020; 88 (08)

The fallacies of P and statical significance

Niz-Ramos J

Language: Spanish
References: 25
Page: 536-541
PDF size: 222.76 Kb.


ABSTRACT

Background: The P value is the most widely used method of estimating the statistical significance of any finding, however, in recent years the debate over the P value has been increasingly intensified due to the low credibility and reproducibility of many studies.
Objective: To describe the current state of the concept of the value of P and the statistical significance (Null Hypothesis Significance Testing (NHST), specify the most important problems and point out the solutions proposed in the literature for their best use.
Methodology: Search in MEDLINE and Google Scholar, with the terms: “NHST”, “Statistical significance; P value ”in English and Spanish, carried out from 2018-2019, limited to articles published from 2005 to 2019, and a narrative-type review with manual search. Articles on methodology were preferably selected.
Results: The global search yielded 1411 articles, 875 from PubMed and 536 from Google Scholar. 817 were excluded by duplication, 155 without full access, 414 from clinical trials, without statistical methodology. The 25 selected articles were the reason for the analysis.
Conclusions: The concept of the value of P is not simple, and it has several fallacies and misinterpretations that must be taken into account to avoid them as much as possible. Recommendations: Do not use "statistically significant" or "significant", replace the threshold of 0.05 with 0.005, report accurate P values with 95% CI, relative risk, odds ratio, effect size or power, and Bayesian methods.


REFERENCES

  1. Gigerenzer, G.,et al. Surrogate science: The idol of a universal method for scientific inference. Journal of Management, 2015;41:421-440. doi: 10.1177/0149206314547522

  2. Molina Arias M. ¿Qué significa realmente el valor de p?. Rev Pediatr Aten Primaria. 2017 Dic; 19( 76 ): 377-381. Disponible en: http://scielo.isciii.es/scielo.php?script=sci_ arttext&pid=S1139-76322017000500014&lng=es

  3. Bertolaccini L, et al. Are the fallacies of the P value finally ended? J Thorac Dis. 2016 Jun;8(6):1067-8. DOI:10.21037/ jtd.2016.04.48

  4. Nuzzo R. Scientific method: statistical errors. Nature. 2014;506:150-2. http://ns.leg.ufpr.br/lib/exe/fetch.php/ disciplinas:ce008:506150a.pdf

  5. Trafimow, D, et al. Editorial, Basic and Applied Social Psychology, 2015;37:1, 1-2, DOI: 10.1080/01973533.2015.1012991

  6. Wasserstein,R. et al. The ASA Statement on p-Values: Context, Process, and Purpose, The American Statistician, 2016;70:2, 129-133, https://doi.org/10.1080/00031305 .2016.1154108

  7. Lambdin C. Significance tests as sorcery: Science is empirical significance tests are not. Theory & Psychology, 2012; 22(1):67–90.http://psychology.okstate.edu/faculty/jgrice/ psyc5314/SignificanceSorceryLambdin2012.pdf

  8. Jiroutek MJ, Turner JR. Buying a significant result:Do we need to reconsider the role of the P value. Clin Hypertens. 2017;19:919–921. https://onlinelibrary.wiley.com/doi/ epdf/10.1111/jch.13021

  9. Badenes-Ribera L, et al. Errores de interpretación de los valores p entre psicólogos profesionales españoles. International Journal of Developmental and Educational Psychology, 2017;2:551-559. https://www.redalyc.org/ pdf/3498/349853220053.pdf

  10. Kühberger A. et all. The significance fallacy in inferential statistics. BMC Res Notes. 2015;17;8:84. https://doi. org/10.1186/s13104-015-1020-4.

  11. Goodman S. A. Dirty Dozen: Twelve P-Value Misconceptions. Semin Hematol 2008;45:135-140. doi:10.1053/j. seminhematol.2008.04.003

  12. Greenland S, et al, Statistical tests, P values, confidence intervals, and power: a guide to misinterpretations. Eur J Epidemiol 2016;31:337–350. DOI 10.1007/s10654-016-0149-3

  13. Ioannidis JP. Contradicted and Initially Stronger Effects in Highly Cited Clinical Research. JAMA. 2005;294(2):218-228. doi:10.1001/jama.294.2.218

  14. Palmer, A., et al. Recommendations for the use of statistics in clinical and health psychology. Clínica y Salud, 2013;24:47-54. http:// dx.doi.org/10.5093/cl2013a6

  15. Lytsy P, P in the right place: Revisiting the evidential value of P-values. J Evid Based Med. 2018 Nov;11(4):288-291. doi: 10.1111/jebm.12319.

  16. Baker, M.1,500 scientists lift the lid on reproducibility. Nature, 2016;533(7604), 452–454. doi:10.1038/533452ª

  17. Wasserstein, R L et al. Moving to a World Beyond “p < 0.05” The American Statistician, 2019;73:sup1, 1-19, DOI: 10.1080/00031305.2019.1583913

  18. Molina Arias, M. El significado de los intervalos de confianza. Pediatría Atención Primaria, 2013;15(57), 91-94. https:// dx.doi.org/10.4321/S1139-76322013000100016

  19. Morey, R.D., et al. The fallacy of placing confidence in confidence intervals. Psychon Bull Rev 2016;23, 103–123. https://doi.org/10.3758/s13423-015-0947-8.

  20. Esarey, J. Lowering the threshold of statistical significance to p< 0.005 to encourage enriched theories of politics. The Political Methodologist, 2017, https://thepoliticalmethodologist. com/2017/08/07/in-support-of-enrichedtheories- of-politics-a-case-for-lowering-the-threshold-ofstatistical- significance-to-p-0-005/

  21. Benjamin, D. J., et al. Redefine Statistical Significance, Nature Human Behaviour, 2018,2, 6–10. https://doi. org/10.1038/s41562-017-0189-z

  22. Hurlbert, S., et al. “Coup de Grâce for a Tough Old Bull: ‘Statistically Significant’ Expires,” The American Statistician, 2019;73. https://doi.org/10.1080/00031305.2018 .1543616

  23. Blakeley B. et al. Abandon Statistical Significance, The American Statistician, 2019;73: sup1, 235-245, DOI: 10.1080 / 00031305.2018.1527253

  24. Harrington D. New Guidelines for Statistical Reporting in the Journal. N Engl J Med 2019; 381:285-286 DOI: 10.1056/ NEJMe1906559

  25. Davidson, A. Embracing uncertainty: The days of statistical significance are numbered. Pediatr Anaesth, 2019;29: 978- 980. doi:10.1111/pan.13721




2020     |     www.medigraphic.com