Response to Comment on Jakob, Dechamps, & Maier: How to Read a Paper

Authors

DOI:

https://doi.org/10.31156/jaex.25782

Keywords:

multiplicity control in Bayesian testing, false positive error rate, deviation from preregistration, control group treatment

Abstract

We thank Peter Bancel for highlighting the potential strengths and weaknesses of our study and for the intensive examination of the applied methods in order to improve our understanding of the reported effect and support future attempts to scientifically study micro-PK effects. Many arguments put forward in the Comment deserve a deeper examination and we appreciate the discussion raised by Bancel, but we do not agree with the main points of his criticism. In the following, we briefly address the central arguments provided against our analysis strategy and our interpretation of the data and present our view on this matter.

References

Bayarri, M. J., & Berger, J. O. (2004). The interplay of Bayesian and frequentist analysis. Statistical Science, 19(1), 58-80. https://doi.org/10.1214/088342304000000116

de Jong, T. (2019). A Bayesian approach to the correction for multiplicity. https://doi.org/10.31234/osf.io/s56mk

Morey, R. D., & Rouder, J. N. (2011). Bayes factor approaches for testing interval null hypotheses. Psychological Methods, 16, 406-419. https://doi.org/10.1037/a0024377

Rouder, J. N. (2014). Optional stopping: No problem for Bayesians. Psychonomic Bulletin & Review, 21, 301- 308. https://doi.org/10.3758/s13423-014-0595-4

Schönbrodt, F. D., & Wagenmakers, E. J. (2018). Bayes factor design analysis: Planning for compelling evidence. Psychon Bull Rev, 25, 128-142. https://doi.org/10.3758/s13423-017-1230-y

Schönbrodt, F. D., Wagenmakers, E. J., Zehetleitner, M., & Perugini, M. (2017). Sequential hypothesis testing with Bayes factors: Efficiently testing mean differences. Psychological methods, 22(2), 322. https://doi.org/10.1037/met000006

Sjölander, A., & Vansteelandt, S. (2019). Frequentist versus Bayesian approaches to multiple testing. European Journal of Epidemiology, 34(9), 809-821. https://doi.org/10.1007/s10654-019-00517-2

Westfall, P. H., Johnson, W. O., & Utts, J. M. (1997). A Bayesian perspective on the Bonferroni adjustment. Biometrika, 84(2), 419-427. https://doi.org/10.1093/biomet/84.2.419

Williams, P., Heathcote, A., Nesbitt, K., & Eidels, A. (2016). Post-error recklessness and the hot hand. Judgment and Decision Making, 11(2), 174-184. https://doi.org/10.1017/S1930297500007282

Downloads

Published

2024-06-05

How to Cite

Jakob, M.-J., Dechamps, M., & Maier, M. (2024). Response to Comment on Jakob, Dechamps, & Maier: How to Read a Paper. Journal of Anomalous Experience and Cognition, 4(1), 79–87. https://doi.org/10.31156/jaex.25782

Issue

Vol. 4 No. 1 (2024)

Section

Empirical Papers

License

Copyright (c) 2024 Marissa-Julia Jakob, Dr. Moritz C. Dechamps, Prof. Markus A. Maier

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

All articles published in JAEX are open access, freely and universally accessible online, and archived in the open journal’s Lund University website (https://journals.lub.lu.se). Articles in JAEX can be distributed under the terms of the Creative Commons Attribution 4.0 International License CCBY (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, with appropriate credit to the original author(s) and the source, a link to the Creative Commons license, and an indication if changes were made.