skip to main content skip to footer

Descriptive Analyses of Data from the NCARB National Field Test NCARB

Author(s):
Bejar, Isaac I.; Miller, Susan; Friedman, Debra E.; Whalen, Sean J.; Oltman, Philip K.; Bridgeman, Brent; Wilder, Gita Z.; Cline, Frederick
Publication Year:
1999
Report Number:
RM-99-03
Source:
ETS Research Memorandum
Document Type:
Report
Page Count:
39
Subject/Key Words:
Performance Assessment, Licensing, Simulation, Architect Registration Exam, National Council of Architectural Registration Boards (NCARB), Computer Assisted Testing, Test Construction, Field Tests

Abstract

A national field test was conducted as part of the research and development leading to the Architect Registration Exam (ARE 97) (Kenney, 1997), a computer-based licensing exam for architects. The purposes of the national field test were to a) evaluate an approach to item pool development that rely on the construction of isomorphic vignettes; b) collect human scores as a means of evaluating the accuracy of automated scoring; c) evaluate the functioning of test delivery software specific to ARE 97 in an operational context; and d) gather candidate reaction to different aspects of the exam. In this report we describe in detail the data collection procedures that were used to carry out the national field test. A separate report (Chauncey Group International, 1996) covers other operational aspects of the national field test. In this report we present results regarding isomorphicity, timing and speededness, reliability, and candidate reaction.

Read More