Delimiting the Verbal Domain GMAT GRE SAT
- Author(s):
- Adams, Richard; DeMauro, Gerald E.; Merritt, Ave
- Publication Year:
- 1994
- Report Number:
- RR-94-34
- Source:
- ETS Research Report
- Document Type:
- Report
- Page Count:
- 113
- Subject/Key Words:
- Graduate Management Admission Test (GMAT), Graduate Record Examinations (GRE), Job Analysis, Scholastic Aptitude Test (SAT), Test Construction, Verbal Tests
Abstract
A functional analysis was made of the verbal domain as it is defined by the test development process at Educational Testing Service (ETS). The thesis of the study is that the verbal domain consists of semantic relations that examinees must interpret. Test developers use a system of rules to sample stimulus materials from among infinite possibilities that elicit an interpretive response. Many of these rules are codified in a body of memoranda and corporate publications, and others are in different stages of formation, beginning in the use by individual test development professionals, and eventually becoming part of generally accepted practice. Because the process of test development is central to the formation of the verbal domain, a job analysis approach was used to examine how rules are employed to present the desired semantic relations to the examinees for their interpretation. This approach explains the process of delimiting the verbal domain through a comprehensive review of the uses of the rule system that defines when the items are functioning properly and when they are not. Test developers from two major divisions of ETS were observed and interviewed. They also rated the importance of each of the rules, suggested rules that they use in their work that were not listed, and delineated the professional activities for which these rules are most important. The study indicates that the rule system for sampling semantic relations is an evolving body, both for the individual test developer and for test development as an institution. (113pp.)
Read More
- Request Copy (specify title and report number, if any)
- http://dx.doi.org/10.1002/j.2333-8504.1994.tb01607.x