Reliability and Validity of Measurement
50 questions available
Questions
What is the primary definition of reliability in the context of psychological measurement?
View answer and explanationWhich term describes the extent to which scores from a measure represent the variable they are intended to measure?
View answer and explanationWhat is the name for the type of reliability that assesses the consistency of a measure over time?
View answer and explanationAccording to the text, what is the generally accepted minimum test-retest correlation coefficient to indicate good reliability?
View answer and explanationWhat does internal consistency reliability refer to?
View answer and explanationWhat is the most common measure of internal consistency used by researchers in psychology?
View answer and explanationA split-half correlation of which value is generally considered to indicate good internal consistency?
View answer and explanationInterrater reliability is defined as the extent to which:
View answer and explanationWhich statement accurately describes the relationship between reliability and validity?
View answer and explanationWhat is face validity?
View answer and explanationContent validity is best described as the extent to which a measure:
View answer and explanationWhat type of validity is concerned with the extent to which people's scores on a measure are correlated with other variables they are expected to be correlated with?
View answer and explanationWhen a criterion is measured at the same time as the construct, what is this form of criterion validity called?
View answer and explanationWhen a criterion is measured at some point in the future after the construct has been measured, this is known as:
View answer and explanationWhat type of validity is established when a new measure of a construct is positively correlated with existing established measures of the same construct?
View answer and explanationDiscriminant validity is the extent to which scores on a measure are:
View answer and explanationThe text provides an example of discriminant validity by arguing that a new measure of self-esteem should not be highly correlated with a measure of what other construct?
View answer and explanationIn Bandura's Bobo doll study, the observers' ratings of how many acts of aggression a child committed would need to have high levels of which type of reliability?
View answer and explanationWhat does a split-half correlation involve?
View answer and explanationTo illustrate that a measure can be reliable but not valid, the text uses an absurd example of measuring self-esteem by what method?
View answer and explanationWhich of the following is a key reason why face validity is considered a weak form of evidence for a measure's validity?
View answer and explanationThe Minnesota Multiphasic Personality Inventory-2 (MMPI-2) is used as an example of a measure that works well despite lacking what?
View answer and explanationIf a researcher defines test anxiety as involving both sympathetic nervous system activation and negative thoughts, a measure with good content validity should include items about what?
View answer and explanationHow is content validity typically assessed?
View answer and explanationA researcher develops a new measure of physical risk-taking. According to the principle of criterion validity, scores on this measure should be correlated with which of the following?
View answer and explanationWhat type of validity did Cacioppo and Petty demonstrate for their Need for Cognition Scale by showing that scores were positively correlated with scores on a standardized academic achievement test?
View answer and explanationCacioppo and Petty provided evidence of discriminant validity for their Need for Cognition Scale by showing that scores were not correlated with what other variable?
View answer and explanationWhat statistic, analogous to Cronbach's alpha, is often used to assess interrater reliability when the judgments are categorical?
View answer and explanationA measure of mood that produced a low test-retest correlation over a period of a month would be considered:
View answer and explanationIf a self-esteem scale has good internal consistency, what would you expect from people's responses?
View answer and explanationConceptually, Cronbach's alpha is the mean of what?
View answer and explanationAssessing test-retest reliability requires using a measure on a group of people at one time, and then what is the next step?
View answer and explanationWhich of the three basic kinds of validity is usually assessed informally rather than quantitatively?
View answer and explanationIf a measure of test anxiety is negatively correlated with performance on an important school exam, this provides evidence for the measure's:
View answer and explanationA measure is considered to have high test-retest reliability if it produces roughly the same scores for an individual when the construct is what?
View answer and explanationWhy would it no longer make sense to claim that all items on a scale are measuring the same underlying construct?
View answer and explanationIf you wanted to measure the social skills of university students by having two observers rate video recordings of their interactions, what would be essential for your measurement?
View answer and explanationWhat are the three basic kinds of validity evidence discussed in the chapter, in addition to reliability?
View answer and explanationThe example of measuring attitudes toward exercise, defined as involving thoughts, feelings, and actions, illustrates the need for which type of validity?
View answer and explanationIn the text, what is the term for a variable that is expected to be correlated with the construct being measured and is used to establish criterion validity?
View answer and explanationIf a researcher finds that people's scores on a new measure of self-esteem are highly correlated with their current mood, what problem might this indicate?
View answer and explanationHow many split-half correlations are possible for a set of 10 items?
View answer and explanationWhich type of reliability is relevant for both behavioral and physiological measures, as well as self-report measures?
View answer and explanationWhat does a test-retest correlation of plus .95, as seen in the example for the Rosenberg Self-Esteem Scale, indicate?
View answer and explanationA split-half correlation for the Rosenberg Self-Esteem Scale was found to be plus .88. This value indicates what?
View answer and explanationWhy must researchers consider more than just reliability when evaluating a measure?
View answer and explanationThe text states that in addition to reliability, what other kinds of evidence should be taken into account when judging the validity of a measure?
View answer and explanationAccording to the text, a criterion can be any variable that one has reason to think should be what?
View answer and explanationIf a new measure of test anxiety failed to correlate with an existing, established measure of test anxiety, this would be a failure of which specific type of validity?
View answer and explanationAssessing convergent validity requires what action on the part of the researcher?
View answer and explanation