Assessment Specialist I, ELA NAEP

Educational Testing Service (ETS), with headquarters in Princeton, NJ, is a global not for profit organization whose mission is to advance quality and equity in education. With more than 3,400 global employees, we develop, administer and score more than 50 million tests annually in more than 180 countries at more than 9,000 locations worldwide.

The NAEP Assessment Specialist I's primary responsibility is to develop NAEP digitally-based reading comprehension assessment items and innovative tasks based on authentic paper- and digitally-based texts and other sources (e.g., video) for students at grades 4, 8, and 12, aligned with the current NAEP Reading Framework.

This role applies experience with and/or knowledge of reading content that may be commonly read by students at grades 4, 8, and 12, current educational standards, and educational trends, such as digitally-based reading to reading assessment development. Experience with assessment development is of value, but not required. Experience with and/or knowledge of elementary reading curricula and language and reading skills of students at grades 4 and 5 is of special interest, though not required.

The Assessment Specialist I works both independently and as part of a team alongside internal and external reading assessment experts and should be prepared to meet NAEP program needs and quality requirements, and to receive ongoing reviews and feedback from colleagues and clients.

Responsibilities:

• Locate and select high-quality passages, both text and multimedia, from a variety of sources, both print and digital, that are diverse, suitable for a digital assessment, align with the NAEP reading framework, and can support reading comprehension items and interactive tasks at grades 4, 8, and 12.
• Develop and review reading comprehension items (selected response, constructed response, and technology enhanced) and interactive tasks that align with the NAEP reading framework and are suitable for a digitally-based assessment. Collect, synthesize, and resolve feedback from a variety of internal and external sources.
• Support the reading team and client by assembling, maintaining, and QCing detailed documentation of, and memos about, development work. Collect, synthesize, and resolve feedback from a variety of internal and external sources related to these documents.
• Work with psychometricians and research staff to understand psychometric and other data and use it to evaluate items and tasks at key points in the development process, including during pre-pilot and pilot testing in preparation for operational use.
• Participate in constructed-response scoring activities, including assembling and reviewing scoring training sets and travelling to scoring sites for one to two week-long periods (alternating with teammates) to train scorers and provide content oversight. Work with other NAEP contractors and ETS staff with psychometric and operational expertise to ensure quality scoring.
• Present passages, items, tasks, student responses to constructed response items, and basic item analysis data to external expert review committees at key points in the development process. Travel to external expert review committee meetings several times during the development cycle. Collect and synthesize feedback from these panels and resolve it with the client.
• Assist the NAEP reporting team in the production of public reports (including the Nation's Report Card) describing student performance on the assessment. Identify items suitable for public release and annotate them for a public audience.

Requirements:

• Master's degree in an ELA-related field of specialty is required.
• Minimum of 3 years of increasingly responsible professional experience, including teaching at the primary, secondary or college level is desirable.
• Interest in reading and language arts, strong writing skills, well-developed organizational skills, and a willingness/adeptness with regards to learning new technology are required.
• Knowledge of reading/language arts in order to develop tests in subject area and to serve as resource person for peers, committees, and clients is also required. Ability to work effectively, collaboratively, and flexibly with clients and external committees is required.
• Ability to quickly learn new software programs is desirable.

We offer a competitive salary, comprehensive benefits, possible relocation assistance and excellent opportunities for professional and personal growth. For a full list of position responsibilities and to apply please visit the following link: Assessment Specialist I, ELA NAEP

EDUCATIONAL TESTING SERVICE is an Equal Opportunity and Affirmative Action Employer of Women and Minorities.

EDUCATIONAL TESTING SERVICE is an Equal Opportunity and Affirmative Action Employer of protected Veterans and Individuals with Disabilities.

EDUCATIONAL TESTING SERVICE is a Drug-free workplace.

PI121945901