Psychometrician

Company: American Board of Pediatrics (ABP)
Location: Chapel Hill
Posted on: March 17, 2020

Job Description:

Position Summary:This position reports to the Director of Psychometrics and will be involved in psychometric activities including but not limited to (1) scoring, (2) score reporting, (3) item analysis/calibration, (4) job analysis, (5) standard setting, (6) psychometric research and data analysis, and (7) documentation and improvement of psychometric policies and procedures.
Education:A PhD in educational measurement or a closely related field (e.g., industrial/organizational psychology, educational psychology) is required. Preference will be given to candidates already possessing a PhD, but candidates who anticipate completing their doctoral degree in 2020 will also be considered.
Preferred Skills and Experience:Required:

• A minimum of two years of experience working with one or more certification organizations
• The knowledge and skills necessary to perform core psychometric tasks, including scoring and score reporting, item analysis and calibration, test equating and scaling, job analysis, standard setting, and data analysis
• Strong knowledge of both classical test theory (CTT) and item response theory (IRT)
• Ability to develop and execute Winsteps control files for IRT calibration, equating, and scoring
• Strong meeting facilitation skills
• Experience with planning and facilitating psychometric meetings (e.g., job analysis, standard setting, item development)
• Strong communication skills, both written and verbal, including the ability to explain complex, technical, or quantitative information to non-technical audiences
• Ability to write technical reports summarizing psychometric activities
• Time management skills, including the ability to set priorities and a strong commitment to meeting deadlines
• Ability to work independently and collaboratively
• High attention to detailPreferred:
  • SAS and R programming skills and experience
  • Database management skills, including knowledge of relational tables and SQL language
  • Data visualization and presentation skills
  • Knowledge, skills, and experience with assessment engineering, augmented/automatic item generation, advanced statistical modeling (especially predictive modeling used in machine learning applications), and/or advanced test security analysis

Keywords: American Board of Pediatrics (ABP), Chapel Hill , Psychometrician, Other , Chapel Hill, North Carolina