Loading

Header Image Header Image

Computer Adaptive Testing Project

The computer adaptive testing (CAT) research project at the Center for Advanced Research on Language Acquisition (CARLA) was funded by the U.S. Department of Education's International Studies and Research Program. The goal of the project was to develop a cost-effective, accurate, and flexible means to assess students' reading proficiency in French, German, and Spanish using a computer adaptive approach.

>> Frequently Asked Questions about computer adaptive testing...

 

To fulfill the goals of this grant the Second Language Assessment Team:

  • constructed a reading proficiency model that guided item development. This model construction process involved consideration of how different language ability models, such as the ACTFL Proficiency Guidelines and Bachman's (1990) communicative language ability model, inform our test design.
     
  • hosted an international seminar entitled "Issues in Computer Adaptive Testing and Reading Proficiency" under the direction of Dr. Micheline Chalhoub-Deville, on March 20 - 22, 1996. The seminar featured leading experts in the fields of computer adaptive testing, technology, second language reading proficiency, and second language assessment.
     
  • assembled large proficiency-oriented item banks. For this activity, the CAT team invited teachers and language professionals to submit items and authentic materials.
     
  • engaged in the pilot testing and calibration of items. Pilot testing was conducted in both traditional pencil-and-paper format and by computer. Items were administered to students to determine their quality and to obtain the necessary psychometric indices and qualitative information. Items were revised as needed to assure their quality and discriminative power. Items were incorporated into the Minnesota Language Proficiency Assessments.
     
  • determined the CAT algorithm. This step involved estimating entrance and exit points and the various proficiency cut scores. Item response theory and a modified Angoff method were used to verify a priori hypothesized proficiency cut scores.
     
  • assessed test takers' perceptions of the test via questionnaire. This information helped us to improve the quality of the test and enhance its user-friendliness.
     
  • Published "An Operational Framework for Constructing a Computer Adaptive Test of L2 Reading Ability: Theoretical and Practical Issues -- Available as a PDF.
RESEARCH AND PROGRAMS

Articulation of Language Instruction
Assessment of Second Language
Content-Based Language Instruction
Culture and Language Learning
Immersion Education
Learner Language
Less Commonly Taught Languages
Maximizing Study Abroad
Pragmatics/Speech Acts
Strategies for Language Learning
Technology and Language Learning
PROFESSIONAL DEVELOPMENT

Summer Institutes
Conferences
Presentations, Workshops, and Events
Advanced Practices Certificate

ABOUT CARLA

Mission
CARLA Update Newsletter
CARLA Staff and Faculty
Get on the Mailing List
RESOURCES

CARLA Publications
CARLA Bibliography
Content-Based Lessons/Units
LCTL Database
Learner Language Activities
Immersion Education Archives
Pragmatics Bibliography
Proficiency Handbook/Lessons
Spanish Grammar Strategies
Virtual Assessment Center
Virtual Item Bank

LRC Portal
YouTube Facebook
Center for Advanced Research on Language Acquisition (CARLA) • 140 University International Center • 331 - 17th Ave SE • Minneapolis, MN 55414 | Contact CARLA
© Regents of the University of Minnesota. All rights reserved.
The University of Minnesota is an equal opportunity educator and employer
Last Modified: February 14, 2014 at 12:09