A5068514222- Meta-analysis and systematic reviews
- Mental Health Research Topics
- Advanced Statistical Methods and Models
- Behavioral Health and Interventions
- Forecasting Techniques and Applications
- Statistical Methods and Bayesian Inference
- Academic Publishing and Open Access
- Sensory Analysis and Statistical Methods
- Advanced Image and Video Retrieval Techniques
- Cell Image Analysis Techniques
- Religion, Spirituality, and Psychology
- COVID-19 epidemiological studies
- Social and Intergroup Psychology
- Cognitive Abilities and Testing
- Cultural Differences and Values
- Data Analysis with R
- Media Influence and Health
- Data-Driven Disease Surveillance
- Religion and Society Interactions
- scientometrics and bibliometrics research
- Psychometric Methodologies and Testing
- COVID-19 Clinical Research Studies
- Statistical Methods in Clinical Trials
Tilburg University
2017-2023
We examined the percentage of p values (.05 < ≤ .10) reported as marginally significant in 44,200 articles, across nine psychology disciplines, published 70 journals belonging to American Psychological Association between 1985 and 2016. Using regular expressions, we extracted 42,504 .05 .10. Almost 40% this range were significant, although there considerable differences disciplines. The practice is most common organizational (45.4%) least clinical (30.1%). Contrary what was by previous...
To determine the reproducibility of psychological meta-analyses, we investigated whether could reproduce 500 primary study effect sizes drawn from 33 published meta-analyses based on information given in and recomputations altered overall results meta-analysis. Results showed that almost half (k = 224) all sampled not be reproduced reported meta-analysis, mostly because incomplete or missing how studies were selected computed. Overall, this led to small discrepancies computation mean sizes,...
We examined the evidence for heterogeneity (of effect sizes) when only minor changes to sample population and settings were made between studies explored association average size in a of 68 meta-analyses from 13 preregistered multilab direct replication projects social cognitive psychology. Among many effects, examples include Stroop effect, "verbal overshadowing" various priming effects such as "anchoring" effects. found limited heterogeneity; 48/68 (71%) had nonsignificant heterogeneity,...
There have been considerable methodological developments of Bayes factors for hypothesis testing in the social and behavioral sciences, related fields. This development is due to flexibility factor multiple hypotheses simultaneously, ability test complex involving equality as well order constraints on parameters interest, interpretability outcome weight evidence provided by data support competing scientific theories. The available software tools Bayesian are still limited however. In this...
Researcher degrees of freedom refer to arbitrary decisions in the execution and reporting hypothesis-testing research that allow for many possible outcomes from a single study.Selective results ( p-hacking) this "multiverse" can inflate effect size estimates false positive rates.We studied effects researcher selective using empirical data extensive multistudy projects psychology (Registered Replication Reports) featuring 211 samples 14 dependent variables.We used counterfactual design...
There has been a tremendous methodological development of Bayes factors for hypothesis testing in the social and behavioral sciences, related fields. This is due to flexibility factor multiple hypotheses simultaneously, ability test complex involving equality as well order constraints on parameters interest, interpretability outcome weight evidence provided by data support competing scientific theories. The available software tools Bayesian are still limited however. In this paper we present...
Scientific theories can often be formulated using equality and order constraints on the relative effects in a linear regression model. For example, it may expected that effect of first predictor is larger than second predictor, to third predictor. The goal then test such expectations against competing scientific or theories. In this paper simple default Bayes factor proposed for testing multiple hypotheses with interest. criterion computed without requiring external prior information about...
The COVID-19 outbreak has led to an exponential increase of publications and preprints about the virus, its causes, consequences, possible cures. research been conducted under high time pressure subject financial societal interests. Doing such may influence scrutiny with which researchers perform write up their studies. Either become more diligent, because high-stakes nature research, or lead cutting corners lower quality output. In this study, we a natural experiment compare prevalence...
To determine the reproducibility of psychological meta-analyses, we investigated whether could reproduce 500 primary study effect sizes drawn from 33 published meta-analyses based on information given in and recomputations altered overall results meta-analysis.
The meta-plot is a descriptive visual tool for meta-analysis that provides information on the primary studies in and results of meta-analysis. More precisely, portrays (i) precision statistical power meta-analysis, (ii) estimate confidence interval random-effects (iii) cumulative yielding robustness check meta-analytic effect size with respect to studies’ precision, (iv) evidence publication bias. After explaining underlying logic theory, applied two cherry-picked meta-analyses appear be...
Abstract. The meta-plot is a descriptive visual tool for meta-analysis that provides information on the primary studies in and results of meta-analysis. More precisely, portrays (1) precision statistical power meta-analysis, (2) estimate confidence interval random-effects (3) cumulative yielding robustness check meta-analytic effect size with respect to studies’ precision, (4) evidence publication bias. After explaining underlying logic theory, applied two cherry-picked meta-analyses appear...
Measurement error (imperfect reliability) is present in any empirical effect size estimate and systematically attenuates observed sizes compared to true underlying sizes. Yet there exist broad concerns that proper measurement tends be neglected much of psychological research. We examined how primary studies affects meta-analytic heterogeneity estimates using Monte-Carlo simulations. Our results indicate although can both inflate suppress heterogeneity, under most circumstances leads a severe...
Researcher degrees of freedom refer to arbitrary decisions in the execution and reporting hypothesis-testing research that allow for many possible outcomes from a single study. Selective results (p-hacking) this ‘multiverse’ can inflate effect size estimates false positive rates. We studied effects researcher selective using empirical data extensive multi-study projects psychology (Registered Replication Reports) featuring 211 samples 14 dependent variables. used counter-factual design...
The COVID-19 outbreak has led to an exponential increase of publications and preprints about the virus, its causes, consequences, possible cures. research been conducted under high time pressure subject financial societal interests. Doing such may influence scrutiny with which researchers perform write up their studies. Either become more diligent, because high-stakes nature research, or lead cutting corners lower quality output. In this study, we a natural experiment compare prevalence...
We examined the proportion of p-values (.05&lt;𝑝≤.1) reported as marginally significant in 44,200 articles across 9 psychology disciplines, published 70 journals belonging to American Psychological Association (APA) between 1985 and 2016. Using regular expressions we extracted 42,504 .05 .1. Almost 40% .1 were significant, though there considerable differences disciplines. The practice is most common organizational (45.4%) least clinical (30.1%). Contrary what was by Pritschet, Powell,...
We examined the evidence for heterogeneity (of effect sizes) when only minor changes to sample population and settings were made between studies explored association average size in a of 68 meta-analyses from thirteen pre-registered multi-lab direct replication projects social cognitive psychology. Amongst many effects, examples include Stroop effect, “verbal overshadowing” various priming effects such as “anchoring” effects. found limited heterogeneity; 48/68 (71%) had non-significant...