RESPONSE OPTIONS FOR SCALES: DOES IT MATTER WHAT WORDS YOU USE?

Narissra Maria Punyanunt-Carter

Abstract


Scales are a commonly used method for measuring variables in media and communication research. As researchers use scales designed in previous studies, they may find it necessary to alter the scale to fit the subjects or research conditions. The current study sought to explore the effects of these alterations by comparing scores on two scales when response options were changed. When response options were changed, significant differences occurred in the way subjects scored on the scales. This suggests that such alterations need to be carefully considered when designing a study. Findings from this study are especially beneficial for researchers collecting data for online instruments and organizational advancements.


Keywords


media, measurement, scale

Full Text:

PDF

References


Abelman, R. (1988). Motivations for viewing “The 700 Club.” Journalism Quarterly, 65, 112-118.

Anderson, T. L. (2005). Relationships among Internet attitudes, internet use, romantic beliefs, and perceptions of online romantic relationships. CyberPsychology & Behavior, 8(6), 521-531.

Babbie, E. (1995). The practice of social research. (7th ed.). Belmont, CA: Wadsworth Publishing.

Bishop, G. F. (2004). The illusion of public opinion. Lanham, MD: Rowman & Littlefield.

Bishop, G.F. (1987). Experiments with the middle response alternative in survey questions. Public Opinion Quarterly, 51, 220-232.

Boster, F. J., & Hale, J. L. (1989). Response scale ambiguity as a moderator of the choice shift. Communication Research, 16, 532-548.

Chan, J. C. (1991). Response-order effects in Likert-type scales. Educational and Psychological Measurement, 51, 531-542.

Clark, L. A. & Watson, D. (1995). Constructing validity: Basic issues in objective scale development. Psychological Assessment, 7(3), 309-319.

Cogliser, C. C., & Schriesheim, C. A. (1994). Development and application of a new approach to testing the bipolarity of semantic differential items. Educational and Psychological Measurement, 54, 594-606.

Conway, J. C., & Rubin, A. M. (1991). Psychological predictors of television viewing motivation. Communication Research, 18, 443-463.

Converse, P. (1964). The nature of belief systems in mass publics. In D Apter (Ed.), Ideology and discontent (pp. 206-261). New York: Free Press.

Converse, P. (1970). Attitudes and non-attitudes: Continuation of a dialogue. In E Tufte (Ed.), The quantitative analysis of social problems (pp. 168-189). Reading, MA: Addison-Welsley.

Cronbach, L. J. & Meehl, P. E. (1955). Construct validity in psychological test. Psychological Bulletin, 52, 281-302.

Dawis, R. V. (1987). Scale construction. Journal of Counseling Psychology, 34, 481-494.

DeCoster, J. (2005). Scale Construction Notes. Retrieved June 18, 2007 from http://www.stat-help.com/notes.html

Devellis, R. F. (2007). Scale development: Theory and Applications (2nd. Edition). Newbury Park, CA: Sage Publications.

Fowler, F. J., Jr. (1995). Improving survey questions: Design and evaluation. Thousand Oaks, CA: Sage.

Greenberg, B. S. (1974). Gratifications of television viewing and their correlates for British children. In J. G. Blumler & E. Katz (Eds.), The uses of mass communication: Current perspectives on gratifications research (pp. 71-92). Beverly Hills, CA: Sage.

Hale, J. L., Boster, F. J., & Mongeau, P. A. (1991). The validity of choice dilemma response scales. Communication Reports, 4, 30-34.

Horan, P. M., DiStefano, C., & Motl, Robert, R. W. (2003). Wording effects in self-esteem scales: Methodological artifact or response style? Structural Equation Modeling, 10(3), 435-455.

Hurd, M. D. (1999): Anchoring and acquiescence bias in measuring assets in household surveys. Journal of Risk and Uncertainty, 19, 111−136.

Hurd, M. D., D. L. McFadden, H. Chand, L. Gan, A. Merrill, and M. Roberts (1998): Consumption and savings balances of the elderly: Experimental evidence on survey response bias. In D. Wise(ed.), Frontiers in the Economics of Aging, 353−387. Chicago, IL: University of Chicago Press.

Hurd, M. D., D. L. McFadden, and L. Gan (1998): Subjective survival curves and life-cycle behav-ior. In D. A. Wise (ed.), Inquiries in the Economics of Aging, 259−305. Chicago, IL: University of Chicago Press.

Hurd, M. D., D. L. McFadden, and A. Merrill (2001): Predictors of mortality among the elderly. Forthcoming in D. A. Wise (ed.), Themes in the Economics of Aging. Chicago, IL: University of Chicago Press.

Kerlinger, F. N. (1992). Foundations of behavioral research. (3rd Ed.). New York: Harcourt Brace.

Krosnick, J. A. (1991). Response strategies for coping with the cognitive demands of attitude measures in surveys. Applied Cognitive Psychology, 5, 213-126.

Loevinger, J. (1954). The attenuation paradox in test theory. Psychological Bulletin, 51, 493-504.

Meng, X., Rosenthal, R., & Rubin, D. B. (1992). Comparing correlated correlation coefficients. Psychological Bulletin, 111, 172-175.

McFadden, D., & Winter, J. (2001). Experimental analysis of survey response bias over the internet : Some results from the Returement Perspectives Survey. Retrieved June 18, 2009 from http://74.125.95.132/search?q=cache%3AwrIFpkc0maAJ%3Ahrsonline.isr.umich.edu%2Fsitedocs%2Fconference%2F200111%2Fpaper8.pdf+constructing+Internet+survey&hl=en&gl=us

Papacharissi, Z., & Rubin, A. M. (2000). Predictors of internet use. Journal of Broadcasting and Electronic Media, 44(2), 175-196.

Rubin, A. M. (1979). Television use by children and adolescents. Human Communication Research, 5, 109-120.

Rubin, A. M. (1981). An examination of television viewing motivations. Communication Research, 8, 141-165.

Rubin, A. M., & Perse, E. M. (1987). Audience activity and soap opera involvement: A uses and effects investigation. Human Communication Research, 14, 246-268.

Rubin, A. M., & Rubin, R. B. (1982). Contextual age and television use. Human Communication Research, 8, 228-244.

Rubin, R. B., Palmgreen, P., & Sypher, H. E. (1994). Communication research measures: A sourcebook. New York: Guilford Press.

Sheatsley, P. F. (1983). Questionnaire construction and item writing. In P. H. Rossi, J. D. Wright, & A. B. Anderson (Eds.) Handbook of survey research (pp. 195-230). New York: Academic Press.

Trochim, W. M. K. (2006). Research Methods Knowledge Base. Retrieved June 18, 2009 from :

http://www.socialresearchmethods.net/kb/survtype.php

Tourangeau, R., Rips, L. J., & Rasinski, K. (2000). The psychology of survey response. Cambridge: Cambridge University Press.

Weisberg, H. F. (2005). The total survey error approach: A guide to the new science of survey research. Chicago: University of Chicago.

Woodruff, D. J., & Feldt, L. S. (1986). Tests for equality of several alpha coefficients when their sample estimates are dependent. Psychometrika, 51, 393-413.




DOI: http://dx.doi.org/10.17349/jmc117103

Refbacks

  • There are currently no refbacks.




Copyright (c) 2017 Journal of Media Critiques [JMC]

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.