From the "Replicability Crisis" to Open Science Practices
50 questions available
Questions
According to the 'Reproducibility Project' mentioned in the text, out of 100 previously published psychological experiments, how many of the replications found statistically significant effects?
View answer and explanationWhat was the average effect size of the replications in the 'Reproducibility Project' compared to the original studies?
View answer and explanationHow many psychologists were involved in coordinating their efforts for the 'Reproducibility Project'?
View answer and explanationWhich questionable research practice is defined as the selective deletion of outliers to influence statistical relationships?
View answer and explanationWhat is the term for mining data without an a priori hypothesis and then claiming a significant result was predicted from the start?
View answer and explanationWhat is the practice colloquially known as 'p-hacking'?
View answer and explanationWhich of the following is NOT listed as a way to enhance scientific rigor and address the replicability crisis?
View answer and explanationThe 'Replication Index' is described as a statistical 'doping test' developed by Ulrich Schimmack in 2014 for what purpose?
View answer and explanationWhat is the primary goal of open science practices as described in the chapter?
View answer and explanationWhich journal, identified as the flagship journal of the Association for Psychological Science, now issues digital badges to researchers for open science practices?
View answer and explanationWhat does a 'Preregistered' digital badge from the Center for Open Science indicate?
View answer and explanationThe 'Transparency and Openness Promotion (TOP) guidelines' have been formally adopted by how many journals and organizations?
View answer and explanationWhich of the following is an example of the questionable practice of 'cherry-picking' results?
View answer and explanationAccording to the text, a failure to replicate a result by itself does not necessarily discredit the original study. Which of the following is NOT listed as a potential explanation for the different results?
View answer and explanationThe text suggests that low replicability in psychology may be evidence of systematic problems, including a publication bias that favors what kind of findings?
View answer and explanationWhat does the open science digital badge 'Open Materials' signify?
View answer and explanationThe case of Diederik Stapel, mentioned at the start of Chapter 3, is used as an example of which questionable practice?
View answer and explanationWhat is one of the key purposes of publishing both null and significant findings?
View answer and explanationThe phrase 'replicability crisis' refers to what phenomenon in psychology?
View answer and explanationWhich organization is mentioned as having spearheaded initiatives like the 'Transparency and Openness Promotion guidelines'?
View answer and explanationThe 'Many Labs Replication Project' is mentioned as an illustration of a failed replication of a finding by which researcher(s)?
View answer and explanationWhat is meant by the 'file drawer problem' in the context of scientific rigor?
View answer and explanationBesides the flagship journal of the Association for Psychological Science, what other entities now issue digital badges for open science practices?
View answer and explanationThe text states that in addition to highlighting what not to do, the 'crisis' has also highlighted the importance of what?
View answer and explanationWhich federal funding agencies in the US and Canada are mentioned as having imposed requirements concerning the publication of publicly-funded research?
View answer and explanationWhat is the second questionable research practice listed in the chapter, also known as cherry-picking?
View answer and explanationWhat does the text say is the risk of a researcher performing inferential statistical calculations to see if a result was significant before deciding to recruit additional participants?
View answer and explanationWhich of the listed solutions to the replicability crisis directly addresses the 'file drawer problem'?
View answer and explanationThe text suggests that one promising response to the replicability crisis is the emergence of open science practices. What future for science and psychology does the author predict?
View answer and explanationAccording to the summary of the Results of the Reproducibility Project (Figure 13.5), how many of the 100 psychology findings were considered non-replications?
View answer and explanationThe text identifies the 'selective deletion of outliers' as a questionable research practice because it usually has what effect?
View answer and explanationWhy does the text argue that data fabrication is worse than a 'research practice' like p-hacking?
View answer and explanationAccording to the text, what is a key benefit of designing studies with sufficient statistical power?
View answer and explanationWhat is the fourth point listed as a way to enhance scientific rigor?
View answer and explanationThe finding that 'washing one's hands leads people to view moral transgressions as less wrong' was the subject of which replication effort?
View answer and explanationBased on the information in the chapter, how is the selective reporting of results (cherry-picking) different from HARKing?
View answer and explanationWhich of the following practices is NOT a type of open science practice encouraged with a digital badge by journals like Psychological Science?
View answer and explanationThe text suggests that others have interpreted the failure to replicate research results as evidence of what?
View answer and explanationWhat does the text identify as a consequence of the widespread use of questionable research practices by psychological researchers?
View answer and explanationIn the Reproducibility Project, what percentage of the original studies had found statistically significant effects?
View answer and explanationWhat is the third questionable research practice listed in the chapter, also known as HARKing?
View answer and explanationThe text argues that the 'duller (but incredibly vital) process' is often unfavored by publication bias. What is this process?
View answer and explanationWhy is it important to describe one's research design in sufficient detail, according to the chapter's list of ways to enhance scientific rigor?
View answer and explanationWhat does the text imply is the relationship between p-hacking and the number of participants in a study?
View answer and explanationThe author of the book cites Brandt et al. (2014) in support of which recommendation for enhancing scientific rigor?
View answer and explanationWhat is the key feature of HARKing (Hypothesizing After the Results are Known) that makes it a questionable practice?
View answer and explanationIn the summary of the Reproducibility Project (Figure 13.5), it is noted that some of the 61 non-replications had what characteristic?
View answer and explanationThe text suggests that the 'replicability crisis' has prompted federal funding agencies to impose requirements regarding what practice?
View answer and explanationWhich questionable research practice is most closely related to the 'file drawer problem'?
View answer and explanationThe movement towards open science practices, as described in the chapter, is presented as a response to what central issue?
View answer and explanation