Center for Applied Linguistics
4646 40th Street, N.W.
Washington, DC 20016
VACANCY NOTICE
10-05
Job Title: Psychometrician
CAL Classification: Research/Program Associate II
Division/Program: Language Testing Division/WIDA ACCESS for ELLs®
Hours per week: Full time (35 hours/week)
Position Available: Immediately
Salary: Commensurate with experience
The Center for Applied Linguistics (CAL) is recruiting for an experienced psychometrician to work as a member of various multi-disciplinary teams to create and maintain large datasets; conduct psychometric and statistical analyses on data from a variety of language assessments and other instruments; and conduct research on psychometric issues related to language testing.
While CAL maintains several language testing programs of its own, it also works in partnership with other organizations to develop language tests and conduct research in language testing. Current projects include collaboration with the WIDA Consortium on the WIDA ACCESS for ELLs®, an English Language Proficiency Test administered to over 700,000 K-12 children in the 22 states of the WIDA Consortium. In this project, CAL is responsible for test development and psychometric analysis of test performance. Other major projects include CAL’s adult ESL tests, BEST Plus and BEST Literacy, and the VIAS project, in which CAL conducts research on the development of English language literacy in Spanish-speaking students.
The Psychometrician reports to the Associate Manager for Psychometrics/Research on the WIDA ACCESS for ELLs® project and works closely with a team of data analysts, as well as with test developers. The Psychometrician will also provide quantitative guidance to other researchers at CAL and coordinate external quantitative resources on behalf of the organization.
Description of Duties:
As part of a multidisciplinary team, the Psychometrician is responsible for designing psychometric analyses of test performances; conducting psychometric analyses related to test construction, validity, reliability, equating, and scoring; preparing technical reports; developing, maintaining, and applying quality control procedures; providing quantitative guidance to professional research staff at CAL; and coordinating external quantitative resources on behalf of the organization.
Primary Responsibilities:
Plan, conduct, document and present psychometric and statistical analyses using classical test theory and the Rasch model with Winsteps and Facets software, including analyses related to item quality, rater performance, DIF, reliability and classification consistency, standard setting, equating, scoring, and reporting
Investigate and evaluate new approaches to conducting psychometric analyses
Establish and monitor quality control procedures related to quantitative analyses, from data cleaning to the final report, ensuring the reliability and integrity of results
Build and maintain large databases in an SQL environment
Provide guidance to professional researchers on proposal design and quantitative analytical approaches upon request, and participate in writing quantitatively-oriented portions of proposals as required
Maintain contacts with individuals with specific quantitative expertise outside the organization who may be called on as needed for specific tasks
Qualifications:
Education and Experience:
Ph.D. required in educational measurement, psychometrics, quantitative methods, or a related discipline. A minimum of three to five years relevant experience performing a variety of tasks as a psychometrician in an operational testing program is required. Experience in coordinating projects is also required. Experience supervising project employees is helpful.
Skills:
Strong demonstrated experience in conducting statistical and psychometric analyses.
Strong demonstrated experience in applying the Rasch model to a variety of psychometric issues.
Demonstrated proficiency in using SPSS, Winsteps, Facets, and other statistical and psychometric software.
Demonstrated proficiency building and maintaining databases in an SQL environment.
Ability to use technology to automate repetitive tasks and processes.
Demonstrated knowledge and application of quality control procedures in creating and maintaining databases, conducting statistical and psychometric analyses, conducting other quantitative research, and producing technical reports.
Demonstrated proficiency with Microsoft Office products (Excel, Word, Powerpoint, Outlook).
Ability to work with a diverse, multi-disciplinary professional team of researchers and scholars.
Ability to communicate both orally and in writing with a wide variety of audiences, including researchers, test developers, and educators.
Demonstrated ability to prepare clear technical documentation intended for a wide audience.
Excellent organizational skills and ability to prioritize tasks.
Project management skills strongly desired.
NOTE: The Center for Applied Linguistics is an E.E.O. employer and does not discriminate in hiring or employment based upon race, color, religion, national origin, sex, age, marital status, handicap, or any other reason not related to employment.
CAL offers a pleasant working environment with an excellent benefit package. We are located in upper Northwest D.C., 2 blocks from the Tenleytown-A.U. Metro station on the Red Line.
In accordance with INS regulations, all successful applicants will be required to show proof of their legal right to accept employment in the United States.
IF INTERESTED, SEND RESUME AND COVER LETTER TO THE ABOVE ADDRESS, ATTN: Phyllis Pointer-Tate, Recruitment 10-05, or respond by e-mail to jobs@cal.org.
