Develop and validate diverse assessment tools while collaborating with cross-functional teams to ensure scientific robustness and practical relevance in measurement.
Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, WeloData leverages over 25 years of experience in partnering with the world’s most innovative companies and brings together a curated global community of over 500,000 AI training and domain experts to offer services that span:
ANNOTATION & LABELLING: Transcription, summarization, image and video classification and labeling.
ENHANCING LLMs: Prompt engineering, SFT, RLHF, red teaming and adversarial model training, model output ranking.
DATA COLLECTION & GENERATION: From institutional languages to remote field audio collection.
RELEVANCE & INTENT: Culturally nuanced and aware, ranking, relevance, and evaluation to train models for search, ads, and LLM output.
Want to join our Welo Data team? We bring practical, applied AI expertise to projects. We have both strong academic experience and a deep working knowledge of state-of-the-art AI tools, frameworks, and best practices. Help us elevate our clients' Data at Welo Data.
Role Overview
We are seeking a detail-oriented and motivated Assessment Associate to join our team. In this role, you will support the development and maintenance of high-quality assessments that measure knowledge, skills, abilities, and other characteristics across various domains. You will work closely with cross-functional teams to ensure that our assessments are both scientifically robust and practically relevant.
Key Responsibilities
Develop and validate a variety of assessment tools, including skill-based assessments, personality inventories, situational judgment tests, and other selection instruments.
Conduct job analyses to identify key competencies and requirements for various roles.
Collaborate with subject matter experts to gather input and ensure assessments are aligned with job requirements and organizational goals.
Analyze assessment data and provide insights and recommendations based on findings.
Stay current with research and best practices in the field of industrial-organizational psychology and assessment development.
Provide training and support to colleagues and internal stakeholders on the use and interpretation of assessment tools.
Ensure compliance with legal and ethical standards in assessment development and implementation.
Qualifications
Bachelor’s degree in Industrial-Organizational Psychology, Psychometrics, or a related field.
Understanding of psychometric principles and 2+ years experience developing assessments.
Familiarity with statistical tools (SPSS, SAS, R, etc) and data analysis methods & platforms (PowerBI, Tableau, etc)
Excellent written and verbal communication skills.
Ability to work independently and as part of a team.
Strong analytical and problem-solving skills.
Strong attention to detail and commitment to quality.
Native or near-native fluency in Englis
Preferred Qualifications
Experience with computerized adaptive testing and item response theory.
Knowledge of legal and professional guidelines related to employee selection and assessment.
Previous experience in a consulting or client-facing role
Welocalize delivers content solutions for translation, localization, adaptation, and machine automation to enable global brands and companies to reach, grow, and engage with international audiences.
Please mention you found this job on AI Jobs. It helps us get more startups to hire on our site. Thanks and good luck!
Ace your job interview
Understand the required skills and qualifications, anticipate the questions you may be asked, and study well-prepared answers using our sample responses.
