Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, WeloData leverages over 25 years of experience in partnering with the world’s most innovative companies and brings together a curated global community of over 500,000 AI training and domain experts to offer services that span:
ANNOTATION & LABELLING: Transcription, summarization, image and video classification and labeling.
ENHANCING LLMs: Prompt engineering, SFT, RLHF, red teaming and adversarial model training, model output ranking.
DATA COLLECTION & GENERATION: From institutional languages to remote field audio collection.
RELEVANCE & INTENT: Culturally nuanced and aware, ranking, relevance, and evaluation to train models for search, ads, and LLM output.
Want to join our Welo Data team? We bring practical, applied AI expertise to projects. We have both strong academic experience and a deep working knowledge of state-of-the-art AI tools, frameworks, and best practices. Help us elevate our clients' Data at Welo Data.
Overview
In this role, you will lead WeloData's Assessment Program, driving the strategic development and implementation of the testing and skill verification processes we use to assess our workforce. You will manage a growing team dedicated to ensuring the accuracy and effectiveness of assessments, while championing the development of operationalized, repeatable process. Additionally, you will serve as the ATS (Applicant Tracking System) product owner for Assessments, overseeing and optimizing ATS processes to ensure consistency and efficiency across the organization.
Main Duties
- Build and expand testing governance frameworks and processes in partnership with growth and training teams.
- Develop the Assessment Team into a knowledge center that utilizes data analysis tools like PowerBI to accurately measure and report on the cost, quantity, quality, and effectiveness of testing practices.
- Monitor and achieve current testing KPIs, with an aim to achieve best-in-class standards of efficiency and accuracy.
- Maintain and improve candidate assessments for our workforce through detailed evaluation, screening, and interviewing processes, ensuring the highest standards of selection.
- Govern ATS policies and guidelines to ensure company-wide consistency, driving improvements in recruiting metrics by developing, updating, and streamlining processes within the ATS.
- Collaborate with management to identify and integrate new platforms and technologies that enhance the assessment process and maintain Welocalize’s competitive edge.
- Mentor and support Assessment Team members, setting individual and team KPIs and fostering a culture of continuous learning and professional growth.
Requirements
- Experience in learning and development, technical writing, or education is essential, particularly valuable if you have experience in philosophy, process engineering, or other fields that involve abstract reasoning.
- Strong organizational skills with a focus on simplifying and optimizing complex systems.
- Demonstrated leadership skills with the ability to adapt and thrive in fast-paced environments, managing teams to achieve strategic objectives.
- Previous experience in team management or leadership is a plus, indicating your ability to guide and develop a team effectively.
- Excellent written and oral communication skills, with the ability to negotiate and influence effectively.
- Strong computer and technological skills, with experience in utilizing ATS and data analysis tools.
- Strong critical thinking and data analysis skills, with the ability to interpret data and make informed decisions.
- Ability to view situations from multiple perspectives and develop innovative solutions to complex challenges.
- Minimum of 3 years of experience in talent acquisition, with a proven track record of establishing company processes and guidelines.
- Bachelor’s degree (B.A.) from a four-year college, or an equivalent combination of education and experience.
- Deep understanding of various languages and cultures will be advantageous, with a strong passion for the AI Data Services and Localization field.