Match!

A Tale of Two Sample Sources: Do Results from Online Panel Data and Conventional Data Converge?

Published on Jul 21, 2018in Journal of Business and Psychology2.58
· DOI :10.1007/s10869-018-9552-y
Sheryl Walter2
Estimated H-index: 2
(IU: Indiana University),
Scott E. Seibert2
Estimated H-index: 2
(UO: University of Oregon)
+ 1 AuthorsErnest H. O’Boyle8
Estimated H-index: 8
(IU: Indiana University)
Cite
Abstract
Samples drawn from commercial online panel data (OPD) are becoming more prevalent in applied psychology research, but they remain controversial due to concerns with data quality. In order to examine the validity of OPD, we conduct meta-analyses of online panel samples and compare internal reliability estimates for scales and effect size estimates for IV–DV relations commonly found in the field with those based on conventionally sourced data. Results based on 90 independent samples and 32,121 participants show OPD has similar psychometric properties and produces criterion validities that generally fall within the credibility intervals of existing meta-analytic results from conventionally sourced data. We suggest that, with appropriate caution, OPD are suitable for many exploratory research questions in the field of applied psychology.
  • References (112)
  • Citations (14)
Cite
References112
Newest
Published on Sep 1, 2017in Journal of Management9.06
Ryan M. Vogel5
Estimated H-index: 5
(PSU: Pennsylvania State University),
Marie S. Mitchell13
Estimated H-index: 13
(UGA: University of Georgia)
This research considers two theoretical perspectives on employees’ motivation associated with diminished self-esteem from abusive supervision. The self-defense view of diminished self-esteem suggests that abusive supervision motivates destructive behavior in an attempt to reassert personal control and protect victims’ self-image. The self-presentational view of diminished self-esteem suggests abusive supervision motivates behavior that attempts to signal fit with and value to the workgroup and o...
Published on Jul 1, 2017in Journal of Management9.06
Jeremy D. Mackey10
Estimated H-index: 10
(AU: Auburn University),
Rachel E. Frieder6
Estimated H-index: 6
(ODU: Old Dominion University)
+ 1 AuthorsMark J. Martinko8
Estimated H-index: 8
(FAMU: Florida A&M University)
We conducted a meta-analysis and empirical review of abusive supervision research in order to derive meta-analytic population estimates for the relationships between perceptions of abusive supervision and numerous demographic, justice, individual difference, leadership, and outcome variables. The use of psychometric correction enabled us to provide weighted mean correlations and population correlation estimates that accounted for attenuation due to measurement error and sampling error variance. ...
Published on Jun 1, 2017in Journal of Consumer Research4.70
Kathryn Sharpe Wessling1
Estimated H-index: 1
(UPenn: University of Pennsylvania),
Joel Huber40
Estimated H-index: 40
(Duke University),
Oded Netzer14
Estimated H-index: 14
(Columbia University)
This tutorial provides evidence that character misrepresentation in survey screeners by Amazon Mechanical Turk Workers (“Turkers”) can substantially and significantly distort research findings. Using five studies, we demonstrate that a large proportion of respondents in paid MTurk studies claim a false identity, ownership, or activity in order to qualify for a study. The extent of misrepresentation can be unacceptably high, and the responses to subsequent questions can have little correspondence...
Published on Jun 1, 2017in Journal of Consumer Research4.70
Joseph Goodman11
Estimated H-index: 11
(Max M. Fisher College of Business),
Gabriele Paolacci11
Estimated H-index: 11
(EUR: Erasmus University Rotterdam)
Published on Dec 1, 2016in Journal of Business and Psychology2.58
Jan-Willem van Prooijen20
Estimated H-index: 20
(VU: VU University Amsterdam),
Reinout E. de Vries26
Estimated H-index: 26
(UT: University of Twente)
Purpose Belief in conspiracy theories about societal events is widespread among citizens. The extent to which conspiracy beliefs about managers and supervisors matter in the micro-level setting of organizations has not yet been examined, however. We investigated if leadership styles predict conspiracy beliefs among employees in the context of organizations. Furthermore, we examined if such organizational conspiracy beliefs have implications for organizational commitment and turnover intentions. ...
Published on Apr 1, 2016in Stress and Health1.88
Jade S. Jenkins4
Estimated H-index: 4
(NIU: Northern Illinois University),
Camille J. Heneghan1
Estimated H-index: 1
(NIU: Northern Illinois University)
+ 1 AuthorsLarissa K. Barber16
Estimated H-index: 16
(NIU: Northern Illinois University)
In this investigation, we draw from the job demands–resource model and conservation of resources theory to examine the relationship between job demands, the work–family interface and worker behaviours. Data collected from an online survey of workers revealed that hindrance demands indirectly increase interpersonal and organizational deviance through work interference with family and family interference with work. Challenge demands indirectly predict interpersonal and organizational deviance thro...
Published on Mar 1, 2016in Industrial and Organizational Psychology5.25
Mindy E. Bergman19
Estimated H-index: 19
(A&M: Texas A&M University),
Vanessa A. Jean3
Estimated H-index: 3
(A&M: Texas A&M University)
In this article, we demonstrate that samples in the industrial and organizational (I-O) psychology literature do not reflect the labor market, overrepresenting core, salaried, managerial, professional, and executive employees while underrepresenting wage earners, low- and medium-skill first-line personnel, and contract workers. We describe how overrepresenting managers, professionals, and executives causes research about these other workers to be suspect. We describe several ways that this under...
Published on Mar 1, 2016in Journal of Business and Psychology2.58
Jesse S. Michel14
Estimated H-index: 14
(AU: Auburn University),
Kerry Newness3
Estimated H-index: 3
(Florida Southern College),
Kris Duniewicz2
Estimated H-index: 2
(FIU: Florida International University)
Purpose This research examines the linking mechanisms and conditional processes underlying the abusive supervision and workplace deviance relationship. Based primarily on Affective Events Theory, it was hypothesized that work-related negative affect would mediate the relationship between abusive supervision and workplace deviance, and that this indirect effect would be moderated by employee-based and organization-based aggressiveness.
Published on Mar 1, 2016in Industrial and Organizational Psychology5.25
Michael A. Gillespie9
Estimated H-index: 9
(University of South Florida Sarasota–Manatee),
Jennifer Z. Gillespie3
Estimated H-index: 3
(University of South Florida Sarasota–Manatee)
+ 1 AuthorsWilliam K. Balzer19
Estimated H-index: 19
(BGSU: Bowling Green State University)
Published on Feb 1, 2016in Journal of Career Assessment1.71
Caitlin Porter6
Estimated H-index: 6
(Purdue University),
Sang Eun Woo14
Estimated H-index: 14
(Purdue University),
Jinkook Tak8
Estimated H-index: 8
(Kwangwoon University)
The Protean and Boundaryless Career Attitudes scales developed by Briscoe and colleagues have facilitated research on career attitudes and mindsets, but they are unnecessarily lengthy and somewhat redundant in their content. To address these concerns, this article presents three studies that develop and validate short forms of the Protean and Boundaryless Career Attitudes scales (i.e., PCA-SF and BCA-SF). Study findings suggest that the PCA-SF and BCA-SF provide a more efficient assessment of th...
Cited By14
Newest
Published on Dec 1, 2019in Body Image3.12
Alexandra D. Convertino (UCSD: University of California, San Diego), Manuel Gonzales1
Estimated H-index: 1
(SDSU: San Diego State University)
+ 1 AuthorsAaron J. Blashill17
Estimated H-index: 17
(SDSU: San Diego State University)
Abstract The Sociocultural Attitudes Towards Appearance Questionnaire-4 Revised (SATAQ-4R) is a measure of internalization (or belief and acceptance) of muscular, thin/low body fat, and general attractiveness ideals; and of sociocultural pressures experienced from family, peers, media, and significant others to achieve the ideal body. The current study examined the psychometric properties of the SATAQ-4R scores in a sample of sexual minority (non-heterosexual) men and women. Confirmatory factor ...
Published on Oct 1, 2019in Addictive Behaviors2.96
Michael J. Zvolensky63
Estimated H-index: 63
,
Kara Manning6
Estimated H-index: 6
+ 2 AuthorsNatalia Peraza2
Estimated H-index: 2
Abstract Electronic cigarette (e-cigarette) use has risen dramatically in the United States. Clinically significant fatigue may represent one previously unexplored individual difference factor related to e-cigarette use patterns and e-cigarette specific cognitive processes. Fatigue reflects the experience of being tired, lacking energy, and feeling exhausted. Although fatigue is a normal bodily response, severe or chronic fatigue is maladaptive. Thus, the current study sought to evaluate clinica...
Published on Sep 1, 2019in Addictive Behaviors2.96
Michael J. Zvolensky63
Estimated H-index: 63
,
Justin M. Shepherd1
Estimated H-index: 1
+ 3 AuthorsNatalia Peraza2
Estimated H-index: 2
Abstract Latinx smokers in the United States (U.S.) represent an understudied health disparities group in terms of tobacco use. Despite scientific interest to elucidate individual difference risk factors for smoking, there is limited understanding of how emotional dysregulation relates to smoking outcomes among Spanish-speaking Latinx smokers. The purpose of the present investigation was therefore to explore emotion dysregulation in relation to cigarette dependence, perceived barriers for quitti...
Published on Jul 17, 2019in PLOS ONE2.78
Ksenia Keplinger (CU: University of Colorado Boulder), Stefanie K. Johnson17
Estimated H-index: 17
(CU: University of Colorado Boulder)
+ 1 AuthorsLiza Y. Barnes (CU: University of Colorado Boulder)
Over the last two years, awareness about the sexual mistreatment of women has stunned the world. According to analysis by the New York Times, the defeat of Hilary Clinton and election of Donald Trump spurred a women’s movement in the US that began in November of 2016 and resulted in protests across the country, including the largest single-day protest in history on January 21, 2017. Later that year, the #MeToo movement (starting in October 2017) and subsequent #TimesUp movement (starting in Janu...
Carlin A. Nguyen (CSU: California State University), Andrew B. Artis6
Estimated H-index: 6
(USF: University of South Florida)
+ 1 AuthorsPaul J. Solomon9
Estimated H-index: 9
(USF: University of South Florida)
Martijn Keizer2
Estimated H-index: 2
(UG: University of Groningen),
Rebecca J. Sargisson (UG: University of Groningen)+ 1 AuthorsLinda Steg57
Estimated H-index: 57
(UG: University of Groningen)
Abstract Policymakers may be reluctant to implement pro-environmental policies that the public find unacceptable, such as policies intended to reduce car use. It is, therefore, essential to understand factors that influence acceptability of such measures. We aimed to study to what extent policy acceptability of car-reduction policies is related to personal norms to do the “right thing” and perceived costs associated with the policies. We hypothesized, in line with the A-B-C model, that personal ...
Published on Jun 24, 2019in Journal of Business and Psychology2.58
Reeshad S. Dalal25
Estimated H-index: 25
(GMU: George Mason University),
Balca Alaybek (GMU: George Mason University)+ 2 AuthorsAlan J. Tomassetti2
Estimated H-index: 2
The current paper was motivated by previous results (Meyer et al. Journal of Management, 40, 1010–1041, 2014) that appeared to contradict the popular idea that “strong” situations weaken the impact of personality on job performance. We extend situational strength theory by contending that, when a strong situation blocks one outlet for poor performance (e.g., low task performance), employees predisposed toward such behavior experience negative affect. They then displace their negative behavior to...
Published on Jun 15, 2019in Journal of Business Ethics3.80
Will Bryant (UMSL: University of Missouri–St. Louis), Stephanie M. Merritt8
Estimated H-index: 8
(UMSL: University of Missouri–St. Louis)
Unethical pro-organizational behaviors (UPB) are unethical, but prosocially-motivated, acts intended to benefit one’s organization. This study examines the extent to which employees are willing to perform UPB to benefit a liked leader. Based on social exchange theory, we hypothesized that LMX would mediate the association of interpersonal justice with UPB willingness. Moral identity and positive reciprocity beliefs were examined as moderators. Higher LMX was significantly and positively related ...
Published on Jun 13, 2019in Journal of Business Ethics3.80
Jeremy D. Mackey10
Estimated H-index: 10
(AU: Auburn University),
Charn P. McAllister6
Estimated H-index: 6
(NU: Northeastern University),
Katherine C. Alexander (AU: Auburn University)
Research that examines unethical interpersonal treatment has received a great deal of attention from scholars and practitioners in recent years due to the remarkable impact of mistreatment in the workplace. However, the literature is incomplete because we have an inadequate understanding of insubordination, which we define as “subordinates’ disobedient behaviors that intentionally exhibit a defiant refusal of their supervisors’ authority.” In our study, we integrate social exchange theory and th...
Published on Jun 1, 2019in Addictive Behaviors2.96
Meghan E. Morean18
Estimated H-index: 18
(Oberlin College),
Izzy R. Lederman (Oberlin College)
Abstract Background Rates of legal medical cannabis (MC) use are increasing, but little is known about the prevalence and correlates of recreational cannabis (RC) use among medical users (MC/R). Methods 348 MC users who resided in a state in which MC is legal and had medical authorization to use MC legally completed an anonymous survey in Spring 2017 (64.1% female, 82.8% White, mean age 33.03[±10.37] years). Rates of endorsing MC/R and the following potential correlates of MC/R were examined: th...
View next paperCommon method biases in behavioral research: A critical review of the literature and recommended remedies.