Psychometrician - 22619BR


Achievement & Assessment Inst
University of Kansas Lawrence Campus
Work Location Assignment: 
Employee Class: 
U-Unclassified Professional Staff

Position Overview

Accessible Teaching, Learning and Assessment Systems (ATLAS) promotes learning and improved outcomes for all students and their educators. Our primary focus is supporting students with disabilities and struggling learners. We create technology-based learning and assessment systems that are accessible and academically rigorous.

We specialize in map-based learning systems, informed by research on skill development, assessment design, and teacher professional development. Every program and project in our diverse portfolio of operational and grant-funded research strategically aligns with our student- and educator-focused mission. Our work is also supported by multiple strategic partnerships with organizations that share our focus and commitment to quality learning experiences for all students.

In addition to grant-funded research projects, ATLAS develops and delivers state assessments. Our largest assessment system is the Dynamic Learning Maps® (DLM®) Alternate Assessment System. DLM alternate assessments are designed to assess students with the most significant cognitive disabilities in English language arts, mathematics, and science. We also offer custom social studies alternate assessments. Our broader state assessments include the Kansas Assessment Program and the Kansas English Language Proficiency Assessment.

As an organization, ATLAS is committed to creating policies and practices that foster a diverse, equitable, and inclusive work environment in which all employees feel they belong and can succeed.

ATLAS is seeking a Psychometrician to support the operational psychometric work for a K-12 large scale assessment program, including a statewide general education summative assessment, interim assessment, and an English language proficiency assessment, as well as assessments to support high school STEM courses. Responsibilities include statistical tasks such as cleaning data, managing data sets, and running descriptive and inferential statistics; psychometric tasks such as item and test analysis, calibration, equating and scaling, differential item functioning, and standard setting; using classical and IRT psychometric models to analyze large-scale assessment data; performing quality assurance checks on analysis and reports; collecting reliability and validity evidence; preparing technical documents; presenting to the Technical Advisory Committees and other duties as assigned.

At least one year of full-time equivalent experience working on a large-scale operational assessment is required.

KU offers great benefits to employees with up to 176 hours of paid vacation per year, 72 hours of sick leave earned per year, nine paid holidays plus one discretionary day, a retirement program, medical & dental insurance, life and disability insurance, other benefit plan options and State of Kansas discounts offered by various vendors. KU also offers employees educational and professional development opportunities. KU is a great place to work! See for more details.

Job Description

50%:Use various types of psychometric models to analyze large-scale assessment data. Conducts all aspects of operational work related to scoring and reporting including data cleaning, key validation, calibration, equating, scoring, quality control, and reporting. Produces item and test analyses and summary data tables for use in technical documentation. Performs other psychometric tasks including differential item function and data analysis for standard setting.

30%:Prepare technical documents, reports, and manuals

10%:Present to various audiences, including state education agency partners, technical advisory committees, and at professional conferences.

5%:Propose detailed research designs and psychometric analyses for new projects. Conduct research under the supervision of senior staff.

5%:Other duties to support the research and psychometrics team

Position Requirements

  • This position will require attendance at regularly scheduled meetings, onsite or through telecommunication platforms.
  • This position allows for a telework or hybrid work location for well-qualified candidates. A telework position may be required to travel up to four times per year.

Required Qualifications

  • Doctoral degree in educational measurement, psychometrics, or other closely related field
  • At least one year of full-time equivalent experience working on a large-scale operational assessment program (e.g., state large-scale or district-level assessments)
  • Experience with quantitative analysis and coding in R
  • Experience applying classical and IRT psychometric models such as item and test analysis, calibration, equating, scoring, and scaling.
  • Experience writing technical reports including results of quantitative analyses.
  • Effective oral and written communication skills for technical audiences, as evidenced in written application materials and interview
  • Experience managing multiple priorities and deadlines, including adapting in response to changes in work priorities and processes, as evidenced in application
  • Detail oriented with strong organizational skills, as evidenced by application materials

Preferred Qualifications

  • Experience with quantitative analysis in multiple IRT and other statistical software (e.g., IRTPro, flexMIRT, ConQuest, R, SPSS, SAS)
  • Extensive experience writing scripts in R as evidenced in application materials and interview (e.g., building packages, vignettes, etc.)
  • Excellent technical writing skills
  • Experience communicating quantitative information to non-technical audiences
  • Strong problem-solving skills as evidenced by application materials and interview

Additional Candidate Instructions

A complete application includes:
  • Online application
  • Résumé
  • Letter detailing your professional experiences that align with the required and preferred qualifications
  • Names and contact information for three professional references.

Only complete applications will be considered.

Review of applications begins on 7/20/22 and continues as needed to collect a pool of qualified applicants. To ensure consideration, apply before the application review date.

Contact Information to Applicants

Cynthia Perez

Advertised Salary Range

Minimum $90,000, commensurate with experience

Work Schedule

M-F; 8-5

Application Review Begins


Anticipated Start Date


Search Jobs
Posting Information
Posting ID:
Achievement & Assessment Inst
Primary Campus:
University of Kansas Lawrence Campus
Work Location Assignment:
Employee Class:
U-Unclassified Professional Staff
Application Review Begins: