AI Psychometrician

Certiverse

Certiverse

Software Engineering, Data Science

United States

Posted 6+ months ago

About Us:

Certiverse is a leading exam development and delivery platform that leverages advanced technology to transform the way exams are created and administered. With our powerful features and robust security measures, we enable organizations across industries to streamline the exam process and deliver an exceptional experience to test creators and test-takers, empowering high-quality exams to go from concept to candidate in weeks, not months. We are expanding our team and seeking an experienced, skilled, and motivated psychometrician to contribute to both operational and research aspects of our work at the intersection of psychometrics, AI, and automation, maintaining a strong foundation in applied measurement practices.

Role Overview:

The ideal candidate will have deep expertise in operational psychometrics, experience researching AI applications in measurement, and the ability to develop proof-of-concept software solutions in Python or similar languages. This position requires a balance between rigorous scientific research, practical application, and the implementation of innovative solutions to enhance our assessment systems.

Key Responsibilities:

· Conduct and support psychometric analyses related to test development, calibration, scaling, equating, and validation studies.

· Research AI-related applications in psychometrics, including machine learning techniques and automated assessment models.

· Develop and implement proof-of-concept software solutions in Python or other relevant programming languages.

· Collaborate with cross-functional teams, including data scientists, engineers, and exam development specialists, to integrate psychometric models into operational processes.

· Ensure the delivery of high-quality outcomes through rigorous methodology, innovative thinking, and attention to detail.

· Adapt to evolving research and business priorities while maintaining a flexible and goal-oriented approach.

Required Qualifications:

· Master’s or PhD in psychometrics, I/O psychology, educational measurement, statistics, or an aligned field.

· Strong programming skills in Python or similar languages.

· Strong analytical skills in R.

· Experience with AI-related research in measurement, such as machine learning applications in assessment.

· Proficiency in psychometric methodologies such as classical test theory (CTT), item response theory (IRT), equating, test form assembly, standard setting, item/form analysis, automated item generation, test security analysis, report writing, and bias and fairness analysis.

· Demonstrated ability to work both independently and collaboratively in a distributed, dynamic team environment.

· Strong problem-solving skills, attention to detail, customer-focus, and commitment to high-quality outcomes.

Preferred Qualifications:

· A strong desire to make a better future where assessments are high-quality and unbiased while also being hyper efficient and accessible.

· At least 2-5 years of experience in applied psychometrics, preferably in an operational testing environment.

· Experience in researching and/or implementing AI-driven innovations in assessment.

· Familiarity with large-scale assessment programs and operational constraints.

· Experience implementing automated scoring algorithms or adaptive testing models.

Why Join Us?

· Help shape the assessments of the future.

· Work on cutting-edge research at the intersection of psychometrics, AI, and automation.

· Enjoy flexibility in a results-oriented work environment.

If you are passionate about psychometrics, AI-driven research, and developing innovative solutions, we encourage you to apply!

Certiverse is an equal opportunity employer. We are committed to creating an inclusive meritocracy, regardless of race, color, religion, gender, sexual orientation, national origin, disability, age, or veteran status.