skip to main content skip to footer

Descriptive Analyses of Data from the NCARB National Field Test NCARB

Bejar, Isaac I.; Miller, Susan; Friedman, Debra E.; Whalen, Sean J.; Oltman, Philip K.; Bridgeman, Brent; Wilder, Gita Z.; Cline, Frederick
Publication Year:
Report Number:
ETS Research Memorandum
Document Type:
Page Count:
Subject/Key Words:
Performance Assessment, Licensing, Simulation, Architect Registration Exam, National Council of Architectural Registration Boards (NCARB), Computer Assisted Testing, Test Construction, Field Tests


A national field test was conducted as part of the research and development leading to the Architect Registration Exam (ARE 97) (Kenney, 1997), a computer-based licensing exam for architects. The purposes of the national field test were to a) evaluate an approach to item pool development that rely on the construction of isomorphic vignettes; b) collect human scores as a means of evaluating the accuracy of automated scoring; c) evaluate the functioning of test delivery software specific to ARE 97 in an operational context; and d) gather candidate reaction to different aspects of the exam. In this report we describe in detail the data collection procedures that were used to carry out the national field test. A separate report (Chauncey Group International, 1996) covers other operational aspects of the national field test. In this report we present results regarding isomorphicity, timing and speededness, reliability, and candidate reaction.

Read More