This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Carey, L. M. Articles by Kushner, S. N. Search for Related Content Social Bookmarking                         What's this?

Procedures for Designing Course Evaluation Instruments: Masked Personality Format Versus Transparent Achievement Format

University of South Florida

Robert F. Dedrick,

University of South Florida

James O. Carey

University of South Florida

Susan N. Kushner

University of South Florida

One important consideration in designing instruments to measure students' attitudes about a course or an instructor is the influence of the format of the instrument on students' responses. This study contrasted the effects of randomly distributing the items throughout the questionnaire (personality format) versus grouping the items together from the same dimension (achievement format) on students' end-of-term course evaluations. On the last day of class, 376 undergraduate students were randomly assigned to complete anonymously the Academic Motivation Profile (AMP) constructed using either a personality or achievement format. A 2 (Format) x 10 (Class Section) MANOVA of the 12 scales of the course evaluation instrument demonstrated a statistically significant Format effect (Wilks's lambda = .85, p < .001), a statistically significant Section effect (Wilks's lambda =.37, p < .001), and no significant Format x Section interaction (Wilks's lambda = .70, p >.05). Examination of the factor structures using confirmatory factor analysis indicated that the measurement model underlying the AMP fit the data reasonably well for both the achievement and personality formats; however, the achievement format provided a better fit. Based on the statistical results and the fact that the achievement format may be more straightforward, produce less suspicion from the student, and be more time efficient, it should be considered when designing course evaluation instruments.

Educational and Psychological Measurement, Vol. 54, No. 1, 134-145 (1994)
DOI: 10.1177/0013164494054001018


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?