TY - JOUR
T1 - Addressing common method variance and endogeneity in vocational behavior research
T2 - a review of the literature and suggestions for future research
AU - Cooper, Brian
AU - Eva, Nathan
AU - Zarea Fazlelahi, Forough
AU - Newman, Alexander
AU - Lee, Allan
AU - Obschonka, Martin
PY - 2020/9
Y1 - 2020/9
N2 - For various reasons, research on vocational behavior often has to rely on self-report measures. Although it is well known that the exclusive use of self-report measures in a given study can pose major threats to the validity of that study, for example via common method variance (CMV) or endogeneity, we still have to witness a systematic literature review of study designs particularly prone to CMV and endogeneity, and of procedural and statistical remedies used in the field of vocational behavior. To determine the vulnerability for CMV and endogeneity, and the extent to which researchers have already taken action and eased concerns over CMV and endogeneity in vocational behavior research through their research design/data collection (procedural remedies) and data analysis (statistical remedies), we review articles published from 2015 to 2018 in the Journal of Vocational Behavior. We found that 81% of all quantitative studies in this period relied exclusively on self-report measures gathered from the same respondent. Of these studies, the majority used procedural remedies to ease concerns of CMV (68%), mainly through the temporal separation of the focal variables (53%). However, statistical tests to detect and/or control for CMV (13%) are still rarely used, and we found no examples of techniques such as instrumental variable estimation to address potential endogeneity. To encourage and guide vocational behavior researchers to further minimize concerns over CMV and endogeneity arising from the exclusive use of self-report measures in future research, we summarize existing recommendations from the methodological literature and provide an updated discussion, specific to vocational behavior, on how to design and conduct impactful vocational behavior research.
AB - For various reasons, research on vocational behavior often has to rely on self-report measures. Although it is well known that the exclusive use of self-report measures in a given study can pose major threats to the validity of that study, for example via common method variance (CMV) or endogeneity, we still have to witness a systematic literature review of study designs particularly prone to CMV and endogeneity, and of procedural and statistical remedies used in the field of vocational behavior. To determine the vulnerability for CMV and endogeneity, and the extent to which researchers have already taken action and eased concerns over CMV and endogeneity in vocational behavior research through their research design/data collection (procedural remedies) and data analysis (statistical remedies), we review articles published from 2015 to 2018 in the Journal of Vocational Behavior. We found that 81% of all quantitative studies in this period relied exclusively on self-report measures gathered from the same respondent. Of these studies, the majority used procedural remedies to ease concerns of CMV (68%), mainly through the temporal separation of the focal variables (53%). However, statistical tests to detect and/or control for CMV (13%) are still rarely used, and we found no examples of techniques such as instrumental variable estimation to address potential endogeneity. To encourage and guide vocational behavior researchers to further minimize concerns over CMV and endogeneity arising from the exclusive use of self-report measures in future research, we summarize existing recommendations from the methodological literature and provide an updated discussion, specific to vocational behavior, on how to design and conduct impactful vocational behavior research.
KW - Common method variance
KW - Endogeneity
KW - Research design
KW - Research methods
KW - Self-report
UR - http://www.scopus.com/inward/record.url?scp=85088648173&partnerID=8YFLogxK
U2 - 10.1016/j.jvb.2020.103472
DO - 10.1016/j.jvb.2020.103472
M3 - Review Article
AN - SCOPUS:85088648173
VL - 121
JO - Journal of Vocational Behavior
JF - Journal of Vocational Behavior
SN - 0001-8791
M1 - 103472
ER -