A5013441677- Meta-analysis and systematic reviews
- Behavioral Health and Interventions
- Statistical Methods in Clinical Trials
- Mental Health Research Topics
- Economic and Environmental Valuation
- scientometrics and bibliometrics research
- Statistical Methods and Bayesian Inference
- Social and Intergroup Psychology
- Reliability and Agreement in Measurement
- Advanced Statistical Methods and Models
- Advanced Causal Inference Techniques
- Data Analysis with R
- Health Systems, Economic Evaluations, Quality of Life
- Delphi Technique in Research
- Diverse Approaches in Healthcare and Education Studies
- Forest ecology and management
- Social Capital and Networks
- Data-Driven Disease Surveillance
- Simulation Techniques and Applications
- Health Sciences Research and Education
- Ecology and Vegetation Dynamics Studies
- Academic Publishing and Open Access
- Cultural Differences and Values
- Intergenerational and Educational Inequality Studies
- Traumatic Brain Injury Research
Tilburg University
2016-2025
Macquarie University
2021
University of Amsterdam
2021
Hologic (Germany)
2020
Freie Universität Berlin
2020
Charité - Universitätsmedizin Berlin
2020
Publication bias threatens the validity of meta-analytic results and leads to overestimation effect size in traditional meta-analysis. This particularly applies meta-analyses that feature small studies, which are ubiquitous psychology. Here we develop a new method for meta-analysis deals with publication bias. method, p-uniform, enables (a) testing bias, (b) estimation, (c) null-hypothesis no effect. No current possesses all 3 qualities. Application p-uniform is straightforward because...
Because of overwhelming evidence publication bias in psychology, techniques to correct meta-analytic estimates for such are greatly needed. The methodology on which the p-uniform and p-curve methods based has great promise providing accurate presence bias. However, this article, we show that some situations, behaves erratically, whereas may yield implausible negative effect size. Moreover, (and explain why) result overestimation size under moderate-to-large heterogeneity unpredictable when...
Abstract Meta‐analysis has become the conventional approach to synthesizing results of empirical economics research. To further improve transparency and replicability reported raise quality meta‐analyses, Meta‐Analysis Economics Research Network updated reporting guidelines that were published by this Journal in 2013. Future meta‐analyses will be expected follow these or give valid reasons why a meta‐analysis should deviate from them.
Background De Winter and Happee [1] examined whether science based on selective publishing of significant results may be effective in accurate estimation population effects, this is even more than a which all are published (i.e., without publication bias). Based their simulation study they concluded that "selective yields meta-analytic the true effect everything, (and that) nonreplicable while placing null file drawer can beneficial for scientific collective" (p.4). Methods Findings Using...
In this crowdsourced initiative, independent analysts used the same dataset to test two hypotheses regarding effects of scientists' gender and professional status on verbosity during group meetings. Not only analytic approach but also operationalizations key variables were left unconstrained up individual analysts. For instance, could choose operationalize as job title, institutional ranking, citation counts, or some combination. To maximize transparency process by which choices are made, a...
Publication bias is a major threat to the validity of meta-analysis resulting in overestimated effect sizes. We propose an extension and improvement publication method p-uniform called p-uniform*. P-uniform* improves upon three ways, as it (i) entails more efficient estimator, (ii) eliminates overestimation size caused by between-study variance true sizes, (iii) enables estimating testing for presence variance. compared statistical properties p-uniform* with p-uniform, two implementations...
The Hartung‐Knapp method for random‐effects meta‐analysis, that was also independently proposed by Sidik and Jonkman, is becoming advocated general use. This has previously been justified taking all estimated variances as known using a different pivotal quantity to the more conventional one when making inferences about average effect. We provide new conceptual framework for, justification of, method. Specifically, we show from fitted models, both method, are equivalent those closely related...
A preregistered meta-analysis, including 244 effect sizes from 85 field audits and 361,645 individual job applications, tested for gender bias in hiring practices female-stereotypical gender-balanced as well male-stereotypical jobs 1976 to 2020. "red team" of independent experts was recruited increase the rigor robustness our meta-analytic approach. forecasting survey further examined whether laypeople (n = 499 nationally representative adults) scientists 312) could predict results....
Previous studies provided mixed findings on pecularities in p -value distributions psychology. This paper examined 258,050 test results across 30,710 articles from eight high impact journals to investigate the existence of a peculiar prevalence -values just below .05 (i.e., bump) psychological literature, and potential increase thereof over time. We indeed found evidence for bump distribution exactly reported Developmental Psychology, Journal Applied Personality Social but did not years...
One of the main goals meta-analysis is to test for and estimate heterogeneity effect sizes. We examined publication bias on Q assessments as a function true heterogeneity, bias, size, number studies, variation sample The present study has two contributions relevant all researchers conducting meta-analysis. First, we show when how affects assessment heterogeneity. expected values measures H² I² were analytically derived, power Type I error rate in Monte Carlo simulation study. Our results...
Robust scientific knowledge is contingent upon replication of original findings. However, replicating researchers are constrained by resources, and will almost always have to choose one effort focus on from a set potential candidates. To select candidate efficiently in these cases, we need methods for deciding which out all candidates considered would be the most useful replicate, given some overall goal wish achieve. In this article assume that achieve maximize utility gained conducting...
The partial correlation coefficient (PCC) is used to quantify the linear relationship between two variables while taking into account/controlling for other variables. Researchers frequently synthesize PCCs in a meta-analysis, but of assumptions common equal-effect and random-effects meta-analysis model are by definition violated. First, sampling variance PCC cannot assumed be known, because function PCC. Second, distribution each primary study's not normal since bounded -1 1. I advocate...
The vast majority of published results in the literature is statistically significant, which raises concerns about their reliability. Reproducibility Project Psychology (RPP) and Experimental Economics Replication (EE-RP) both replicated a large number studies psychology economics. original study replication were significant 36.1% RPP 68.8% EE-RP suggesting many null effects among studies. However, evidence favor hypothesis cannot be examined with significance testing. We developed Bayesian...
Preregistration is gaining ground in psychology, and a consequence of this that preregistered studies are more often included meta-analyses. Preregistered likely mitigate the effect publication bias meta-analysis, because can be located registries they were registered even if do not get published. However, current meta-analysis methods take into account less susceptible to bias. Traditional treat all as equivalent while meta-analytic conclusions improved by taking advantage studies. The goal...
ABSTRACT Surrogate endpoints are used when the primary outcome is difficult to measure accurately. Determining if a suitable use as surrogate endpoint challenging task and variety of meta‐analysis models have been proposed for this purpose. The Daniels Hughes bivariate model trial‐level evaluation gaining traction but presents difficulties frequentist estimation hitherto only Bayesian solutions available. This because marginal not conventional linear number unknown parameters increases at...
Researcher degrees of freedom refer to arbitrary decisions in the execution and reporting hypothesis-testing research that allow for many possible outcomes from a single study.Selective results ( p-hacking) this "multiverse" can inflate effect size estimates false positive rates.We studied effects researcher selective using empirical data extensive multistudy projects psychology (Registered Replication Reports) featuring 211 samples 14 dependent variables.We used counterfactual design...
A wide variety of estimators the between-study variance are available in random-effects meta-analysis. Many, but not all, these based on method moments. The DerSimonian-Laird estimator is widely used applications, Paule-Mandel an alternative that now recommended. Recently, DerSimonian and Kacker have developed two-step moment-based variance. We extend so multiple (more than two) steps used. establish surprising result multistep tends towards as number becomes large. Hence, iterative scheme...
ABSTRACT Objective Acute exercise elicits various biobehavioral and psychological responses, but results are mixed with regard to the magnitude of exercise-induced affective reactions. This meta-analysis examines general mood state, anxiety, depressive symptom responses acute while exploring protocol characteristics background health behaviors that may play a role in response. Methods A total 2770 articles were identified from MEDLINE/PubMed search an additional 133 reviews reference...