angle-up angle-right angle-down angle-left close user menu open menu closed search globe bars phone store

NCME — Saturday, April 6, 2019

Below is a list of NCME-related events involving ETS staff. All NCME sessions take place at the Fairmont Royal York Hotel.

2019 NCME Awards Session

When: Saturday, April 6, 8–10 a.m.
Where: Fairmont Royal York Hotel, NCME – Salon A
Session Type: Invited Speaker Session

Awards
Jason Millman Promising Measurement Scholar Award — Qiwei He, ETS
Annual Award — Robert J. Mislevy, ETS
Bradley Hanson Award for Contributions to Educational Measurement — Hongwen Guo, ETS; Mo Zhang, ETS; Paul Deane, ETS; Randy Bennett, ETS

Advances in the Evaluation of Item Response Theory Models

When: Sat, April 6, 8:00–10:00 a.m.
Where: Fairmont Royal York Hotel, Mezzanine Level, Quebec
Session Type: Paper Session

Paper
Power Divergence Family of Tests for Person Parameter in Item Response Theory Models
Authors: Xiang Liu, ETS; James Yang, EdLab group; Hui Soo Chae, Teachers College, Columbia University; Gary J. Natriello, Teachers College, Columbia University

Emerging Research in Multistage Testing

When: Saturday, April 6, 8–10 a.m.
Where: Fairmont Royal York Hotel, Convention Floor, NCME – Salon B
Session Type: Paper Session

Papers
Ignorability of Missing Data in Multidimensional Multistage Tests
Authors: Paul A. Jewsbury, ETS; Peter van Rijn, ETS

A New Approach to Find Optimal Design of Multistage Tests
Authors: Hwanggyu Lim, University of Massachusetts; Tim Davey, ETS

Discussant
Duanli Yan, ETS

Pioneering Work in AIG

When: Saturday, April 6, 8–10 a.m.
Where: Fairmont Royal York Hotel, Mezzanine, NCME – Territories
Session Type: Paper Session

Papers
Measuring In-context Vocabulary: Implications for automated item generation (AIG)
Authors: Isaac I. Bejar, ETS; Michael Flor, ETS; Paul Deane, ETS; Steven L. Holtzman, ETS; James Bruno, ETS

Discussant
Andreas H. Oranje, ETS

Practical Applications of Validity Research

When: Saturday, April 6, 8–10 a.m.
Where: Fairmont Royal York Hotel, Mezzanine, NCME – Manitoba
Session Type: Paper Session

Papers
Examining Construct Shift in Reading Development
Authors: John P. Sabatini, ETS; Jonathan P. Weeks, ETS; Tenaha P. O'Reilly, ETS; Zuowei Wang, ETS

Identifying Core Competencies of 21st Century Learning Outcomes: A Webscraping Approach
Authors: Joseph Rios, University of Minnesota; Guangming Ling, ETS; Robert Pugh, ETS; David Becker, ETS

Technology-Enhanced Items: Lessons Learned and Future Directions

When: Saturday, April 6, 8–10 a.m.
Where: Fairmont Royal York Hotel, Mezzanine, NCME – British Columbia
Session Type: Coordinated Session

Chair
Yue Jia, ETS

Papers
Technology Enhanced Items and Model-Data Misfit
Authors: Carol Eckerly, ETS; Yue Jia, ETS

Using Asymmetric IRT Models to Accommodate Item Complexity
Authors: Daniel Bolt, University of Wisconsin-Madison; Sora Lee, University of Wisconsin-Madison; James Wollack, University of Wisconsin-Madison; Carol Eckerly, ETS; John Sowles, Ericsson

Women in Measurement: Their Unique Contributions

When: Saturday, April 6, 8–10 a.m.
Where: Fairmont Royal York Hotel, Mezzanine, NCME – Alberta
Session Type: Invited Speaker Session

Chair
Linda L. Cook, ETS, retired

Papers
Academic Institutions
Authors: Kadriye Ercikan, ETS; Han-Hui Por, ETS

Test Publishing Organizations
Authors: Ida M. Lawrence, ETS; Edward Shea, ETS

Discussant
Mary Pitoniak, ETS

Communicating Your Research to the Media

When: Saturday, April 6, 10:25–11:55 a.m.
Where: Fairmont Royal York Hotel, Mezzanine, NCME – Quebec
Session Type: Invited Speaker Session

Chair
Rebecca Zwick, ETS

Electronic Board Session 1

When: Saturday, April 6, 10:25–11:55 a.m.
Where: Fairmont Royal York Hotel, Main Floor, NCME – Imperial Room
Session Type: Electronic Board Session

Papers
Detecting Different Rater Effects Using Trend Scoring Statistics
Authors: Widad Abdalla, The University of Iowa; John R. Donoghue, ETS; Deborah Harris, University of Iowa

The Identification of Latent Class Membership in the Mixture Rasch Model
Authors: Tongyun Li, ETS; Ming Li, Georgetown University; George Macready, University of Maryland

Understanding Repeater Subgroup Differences in Retesting Score and Time Improvement
Authors: Jiawen Zhou, ETS; Yi Cao, ETS; Morgan James, ETS

NCME ITEMS (Invited Electronic Board 1)
Author: Andre A. Rupp, ETS

Emerging Research in Linking and Equating

When: Saturday, April 6, 10:25–11:55 a.m.
Where: Fairmont Royal York Hotel, Convention Floor, NCME – Salon B
Session Type: Paper Session

Papers
Evaluating Weighting Methods for Linking Assessment with No Anchor Items
Authors: Shuhong Li, ETS; Jiahe Qian, ETS

Research on Test-Taking Motivation: Implications for Test Development and Educational Policy

When: Saturday, April 6, 10:25–11:55 a.m.
Where: Fairmont Royal York Hotel, Mezzanine, NCME – Alberta
Session Type: Coordinated Session

Papers
Is There Differential Noneffortful Responding Between Countries on an International Assessment?
Authors: Joseph Rios, University of Minnesota; Hongwen Guo, ETS

Understanding the Motivated Test-Taking Experience to Develop More Engaging Assessments

Authors: Blair Lehman, ETS; Tanner Jackson, ETS

The Assessment of English Writing Skills in Secondary Education in Europe

When: Saturday, April 6, 12:20–1:50 p.m.
Where: Fairmont Royal York Hotel, Mezzanine, NCME – Territories
Session Type: Coordinated Session

Discussant
Andre A. Rupp, ETS

Automated Assessment of Scientific Reasoning: Developments in the Field

When: Saturday, April 6, 12:20–1:50 p.m.
Where: Fairmont Royal York Hotel, Convention Floor, NCME – Ballroom
Session Type: Coordinated Session

Paper
Formative Assessment of Scientific Argumentation Practice Enabled by Automated Text Scoring
Authors: Margarita Olivera Aguilar, ETS; Hee-Sun Lee, Concord Consortium; Ou Lydia Liu, ETS; Amy R. Pallant, Concord Consortium

Classroom Assessment and Educational Measurement

When: Saturday, April 6, 12:20–1:50 p.m.
Where: Fairmont Royal York Hotel, Mezzanine, NCME – Alberta
Session Type: Invited Speaker Session

Paper
Fairness in Classroom Assessment
Authors: Joan L. Herman, University of California-Los Angeles; Linda L. Cook, ETS, retired

Perspectives on the Validity of Classroom Assessments
Authors: Michael T. Kane, ETS; Saskia Woods, Cito

Communicating/Depicting Results in Easily Accessible Ways, Across Broad Audiences

When: Saturday, April 6, 12:20–1:50 p.m.
Where: Fairmont Royal York Hotel, Mezzanine, NCME – Quebec
Session Type: Invited Speaker Session

Chair
Brent Bridgeman, ETS

Presenters
Brent Bridgeman, ETS
Richard Feinberg, NBME
Lorrie Shepard, University of Colorado

Paper
Beyond Correlations: Making Predictive Validity Results Understandable
Author: Brent Bridgeman, ETS

Fairness Issues in Test Construction

When: Saturday, April 6, 12:20–1:50 p.m.
Where: Fairmont Royal York Hotel, Mezzanine, NCME – Manitoba
Session Type: Paper Session

Discussant
Melissa L. Gholson, ETS

GSIC Graduate Student Poster Session 1

When: Saturday, April 6, 12:20–1:50 p.m.
Where: Fairmont Royal York Hotel, Main Floor, NCME – Imperial Room
Session Type: Graduate Student Poster Session

Papers
DIF Detection Procedure for Multistage Computer Adaptive Tests
Authors: Christiana Aikenosi Akande, University of Florida; Meng Wu, ETS; Xueli Xu, ETS

Improving Item Pool Utilization for Shadow CAT in Variable-Length
Authors: Hwanggyu Lim, University of Massachusetts; Qi Diao, ETS

Advanced Psychometrics for Process Data Analysis in Large-Scale Assessments

When: Saturday, April 6, 2:15–3:45 p.m.
Where: Fairmont Royal York Hotel, Convention Floor, NCME – Ballroom
Session Type: Coordinated Session

Chairs
Frank Goldhammer, DIPF/Leibniz Institute for Research and Information in Education
Qiwei He, ETS

Papers
Using Process Data to Identify Generalized Patterns Across Problem-Solving Items
Authors: Qiwei He, ETS; Francesca Borgonovi, OECD; Marco Paccagnella, OECD

Mapping Background Variables With Sequential Patterns in Problem-Solving Tasks
Authors: Dandan Liao, American Institutes for Research (AIR); Qiwei He, ETS; Hong Jiao, University of Maryland-College Park

Incorporating Response Times into Population Modeling in Large-scale Assessments
Authors: Hyo Jeong Shin, ETS; Kentaro Yamamoto, ETS; Lale Khorramdel, National Board of Examiners; Frederic Robin, ETS; Matthias von Davier, National Board of Medical Examiners; Harrison Gamble, ETS; Wei Zhao, ETS

Challenges in Standard Setting

When: Saturday, April 6, 2:15–3:45 p.m.
Where: Fairmont Royal York Hotel, Convention Floor, NCME – Salon B
Session Type: Paper Session

Papers
Evaluating Panelists’ Understanding of Standard Setting Data
Authors: Patricia Baron, ETS; Sharon Cadman Slater, ETS; Stephen G. Sireci, University of Massachusetts-Amherst

Electronic Board Session 2

When: Saturday, April 6, 2:15–3:45 p.m.
Where: Fairmont Royal York Hotel, Main Floor, NCME – Imperial Room
Session Type: Electronic Board Session

Papers
Fitting Models for Accuracy and Speed for Classification into Learning Progression Levels
Authors: Peter Van Rijn, ETS Global; Edith Aurora Graf, ETS

Patterns of Response Times for Different Student Strategies: Implications for Psychometric Modeling
Authors: Edith Aurora Graf, ETS; Peter Van Rijn, ETS

Evaluating Robustness of Reliability of Test Scores from Populations of Different Abilities
Authors: Lin Wang, ETS; Tsung-Han Ho, ETS

A Three-factor Model That Unifies Response, Time, and Missing
Authors: Ru Lu, ETS; Hongwen Guo, ETS

NCME ITEMS (Invited Electronic Board 2)
Author: Andre A. Rupp, ETS

Communicating Performance Results to Various Audiences

When: Saturday, April 6, 4:10–6:10 p.m.
Where: Fairmont Royal York Hotel, NCME – Salon A
Session Type: Paper Session

Papers
An Argument for Reporting the Likelihood Function in Large-Scale Survey Assessments
Author: John R. Lockwood, ETS

Communicating Process Data to Teachers for Conversation-based Assessment
Authors: Stephanie Peters, ETS; Carol McGregor Forsyth, ETS; Diego Zapata-Rivera, ETS

Using Finite Mixture Models to Communicate Results Across Multiple Assessments
Authors: Margarita Olivera Aguilar, ETS; Samuel Rikoon, ETS

NCME Session on Excellence in Public Communications

When: Saturday, April 6, 4:10–6:10 p.m.
Where: Fairmont Royal York Hotel, Mezzanine, NCME – Alberta
Session Type: Invited Speaker Session

Panelists
Amy Burkhardt, University of Colorado-Boulder
Ellen E. Forte, edCount, LLC
Min Li, University of Washington
W. James Popham, University of California-Los Angeles
Javarro Antoine Russell, ETS
William Skorupski, ACT®
Catherine Gewertz, Education Week

Back to Home