| Sign In to gain access to subscriptions and/or personal tools. |
DOI: 10.1177/0146621607301094 Effects of Semantic Incompatibility on Rating ResponseOntario Institute for Studies in Education of the University of Toronto, tlam{at}oise.utoronto.ca
Ontario Institute for Studies in Education of the University of Toronto Semantic incompatibility, an error in constructing measuring instruments for rating oneself, others, or objects, refers to the extent to which item wordings are incongruent with, and hence inappropriate for, scale labels and vice versa. This study examines the effects of semantic incompatibility on rating responses. Using a 2 x 2 factorial design with semantic compatibility and scale packedness as the between-subjects factors, 160 university students were randomly assigned to four treatment conditions. Analysis of their responses to a 10-item academic ability self-assessment rating scale shows a significant difference in means between positive-packed and equal-interval conditions when item wordings and scale labels are semantically compatible. The semantically compatible conditions also show smaller variability and a slightly higher internal consistency of responses than the semantically incompatible conditions. The authors conclude that when rating scales are semantically incompatible, respondents tend to ignore the scale labels, use a greater variety of strategies to generate responses, and produce less reliable responses.
Key Words: rating scale construction attitude scaling survey research self-reporting bias in rating
|