Treffer: A Systematic Evaluation of Wording Effects Modeling Under the Exploratory Structural Equation Modeling Framework.

Title:
A Systematic Evaluation of Wording Effects Modeling Under the Exploratory Structural Equation Modeling Framework.
Authors:
Garrido LE; School of Psychology, Pontificia Universidad Catolica Madre y Maestra, Santo Domingo, Dominican Republic., Christensen AP; Department of Psychology and Human Development, Vanderbilt University, Nashville, TN, USA., Golino H; Department of Psychology, University of Virginia, Charlottesville, VA, USA., Martínez-Molina A; Department of Social Psychology and Methodology, Universidad Autonoma de Madrid, Madrid, Spain., Arias VB; Department of Personality, Assessment and Psychological Treatment, Faculty of Psychology, Universidad de Salamanca, Salamanca, Spain., Guerra-Peña K; School of Psychology, Pontificia Universidad Catolica Madre y Maestra, Santo Domingo, Dominican Republic., Nieto-Cañaveras MD; Department of Social Psychology and Methodology, Universidad Autonoma de Madrid, Madrid, Spain., Azevedo F; Interdisciplinary Social Science, Utrecht University, Utrecht, the Netherlands., Abad FJ; Department of Social Psychology and Methodology, Universidad Autonoma de Madrid, Madrid, Spain.
Source:
Multivariate behavioral research [Multivariate Behav Res] 2025 Nov-Dec; Vol. 60 (6), pp. 1169-1198. Date of Electronic Publication: 2025 Sep 08.
Publication Type:
Journal Article
Language:
English
Journal Info:
Publisher: Taylor & Francis Group Country of Publication: United States NLM ID: 0046052 Publication Model: Print-Electronic Cited Medium: Internet ISSN: 1532-7906 (Electronic) Linking ISSN: 00273171 NLM ISO Abbreviation: Multivariate Behav Res Subsets: MEDLINE
Imprint Name(s):
Publication: <2009- > : Philadelphia, PA : Taylor & Francis Group
Original Publication: Fort Worth, Tex. : Society of Multivariate Experimental Psychology
Contributed Indexing:
Keywords: ESEM; Item wording; method factor; negatively worded; response bias
Entry Date(s):
Date Created: 20250908 Date Completed: 20251212 Latest Revision: 20251212
Update Code:
20251213
DOI:
10.1080/00273171.2025.2545362
PMID:
40920037
Database:
MEDLINE

Weitere Informationen

Wording effects, the systematic method variance arising from the inconsistent responding to positively and negatively worded items of the same construct, are pervasive in the behavioral and health sciences. Although several factor modeling strategies have been proposed to mitigate their adverse effects, there is limited systematic research assessing their performance with exploratory structural equation models (ESEM). The present study evaluated the impact of different types of response bias related to wording effects (random and straight-line carelessness, acquiescence, item difficulty, and mixed) on ESEM models incorporating two popular method modeling strategies, the correlated traits-correlated methods minus one (CTC[M-1]) model and random intercept item factor analysis (RIIFA), as well as the "do nothing" approach. Five variables were manipulated using Monte Carlo methods: the type and magnitude of response bias, factor loadings, factor correlations, and sample size. Overall, the results showed that ignoring wording effects leads to poor model fit and serious distortions of the ESEM estimates. The RIIFA approach generally performed best at countering these adverse impacts and recovering unbiased factor structures, whereas the CTC(M-1) models struggled when biases affected both positively and negatively worded items. Our findings also indicated that method factors can sometimes reflect or absorb substantive variance, which may blur their associations with external variables and complicate their interpretation when embedded in broader structural models. A straightforward guide is offered to applied researchers who wish to use ESEM with mixed-worded scales.