National Board of Medical Examiners
Philadelphia, PA
Position: Psychometrician (Open Rank)
The NBME is a premier not-for-profit organization that develops licensure
and educational achievement examinations for the health professions. In
addition to producing credentialing examinations, the NBME also has a
major commitment to research and development in evaluation and
measurement. With approximately 20 doctoral level graduates of
psychometrics or statistics programs it provides a rich and collaborative
environment for professionals with applied or theoretical interests in
measurement. Located in Philadelphia adjacent to the campus of the
University of Pennsylvania, the NBME has a stimulating professional
environment and state-of-the art facilities.
The Scoring Services Unit of the NBME is currently seeking a
Psychometrician or Senior Psychometrician to join its team. Scoring
Services is a group of doctoral and masters-level professionals and
support staff with primary responsibility for planning and conducting
psychometric analyses supporting operational examination programs at the
NBME. Psychometricians are also responsible for leading or contributing to
developmental and research projects.
The Psychometrician will supervise the scoring, equating, standard setting
and other psychometric analyses for various operational examination
programs at the NBME, including client examinations, medical school
subject examinations and the United States Medical Licensing Examination
(USMLE).
Responsibilities of the Psychometrician include evaluating the accuracy of
exam results, assessing existing procedures and developing and
implementing new procedures to increase accuracy and efficiency of exam
processing, providing technical supervision and direction for analysts and
support staff, and conducting research to support operational exam
programs. In addition, the Psychometrician will communicate analytic
results and provide policy and practice recommendations to staff,
committees, and client organizations.
Successful candidates will possess a Doctorate in
Educational/Psychological Measurement, Statistics, or a related field. A
minimum of one year of experience in applying principles of measurement to
practical testing problems is required.
The Psychometrician must have a strong background in psychometric theory
and application, including knowledge of item response theory, classical
test theory, statistics, test development, evaluation and research
design. He or she will have an advanced knowledge of measurement topics
such as calibrating, scaling, equating and standard setting. Excellent
computer skills and a working knowledge of statistical software is a
necessity, including Winsteps, BILOG, SPSS, or SAS.
Successful candidates will have excellent oral and written communication
skills and excellent interpersonal skills, including the ability to work
closely and successfully with individuals from a variety of professional
backgrounds.
Excellent critical thinking and creative problem solving abilities are
also required.
The NBME offers a rewarding work environment, competitive salaries, and
outstanding benefits. Please apply online by submitting your resume, cover
letter, and salary requirements to: humanresources@nbme.org with
Psychometrician in the subject line.
Please visit nbme.org/careers to learn more.
