Job Title: Red Teaming Specialist Team Lead- English and Chinese

Location: Fully Remote within the U.S. (excluding California, Washington, Alaska, Colorado, Montana, New York, Puerto Rico, Nevada, Nebraska, Pennsylvania)

Employment Type: Full Time, (40 hours per week.)

Who we are:

Innodata (NASDAQ: INOD) is a leading data engineering company. With more than 2,000 customers and operations in 13 cities around the world, we are an AI technology solutions provider-of-choice for 4 out of 5 of the world’s biggest technology companies, as well as leading companies across financial services, insurance, technology, law, and medicine.

By combining advanced machine learning and artificial intelligence (ML/AI) technologies, a global workforce of subject matter experts, and a high-security infrastructure, we’re helping usher in the promise of AI. Innodata offers a powerful combination of both digital data solutions and easy-to-use, high-quality platforms.

Our global workforce includes over 5,000 employees in the United States, Canada, United Kingdom, the Philippines, India, Sri Lanka, Israel and Germany. We’re poised for a period of explosive growth over the next few years.

About the Role:

Are you passionate about ensuring data is accurate, comprehensive, and usable? If so, this is the position for you.

In this position, you’ll be a leader on the team. You’ll train and support a team of Gen AI Red Teaming Specialists. As a steward of data excellence and quality audit compliance, you’ll handle quality assurance and provide performance feedback to the team. You’ll be responsible for every aspect of internal audit quality, from audit planning, implementation, and feedback to re-auditing as required.

You will be an integral member of a global team, tasked with shaping a high-quality, user-centric AI knowledge model that will be the foundation for an entire next generation of technology user experiences.

What You’ll Be Doing:

As part of the Quality Assurance SME Team on our GenAI team, you will be joining a team of subject matter experts across a wide variety of disciplines and will be entrusted with a range of responsibilities. This will include:

Leading and inspiring a team of Gen AI Red Teaming Specialists to product their best work
Collaborating closely with colleagues and the Program Manager to drive success across all tasks and languages
Reviewing project guidelines to ensure alignment between client expectations and team performance / outputs
Leading the development of training programs that are comprehensive, relevant, and aligned with the latest industry standards and best practices; regularly review and update training content to ensure it remains current and effective
Observing red teaming specialists and providing feedback 1:1 or to the team, as needed
Overseeing the lifecycle of an internal audit, from planning, implementation, and feedback to re-auditing as required; driving all audits in the required timeframe and providing feedback to teammates, as needed
Ensuring achievement of performance metrics; directing Root Cause Analyses documentation for any potential quality and audit deficiencies that resulted in missed KPIs; reporting on inefficiencies and error trends in process/systems/tools/policy
Synthesizing data, discovering trends in accuracy, and translating quality assurance recommendations to the team
Moving across projects to fill in and supplement audits as and when needed
Determining what additional quality assurance processes and metrics are needed to support the team
Creating process documentation; noting guideline changes and cascading changes to the entire project team
Shadowing red teaming specialists to ensure quality and compliance, as necessary.

Requirements

Minimum Qualifications:

Advanced degree in humanities/social sciences (Master’s or Ph.D.) preferred, but exceptional candidates with Bachelor’s degrees or alternatively 3 years of data analysis and personnel leadership experience
Possesses exceptional writing and editing skills
Incredible attention to detail
2+ years’ experience in a quality control environment
Strong practical experience with Excel (PivotTable, Charts, Statistical functions) is essential
Experience with Tableau/Power BI or other similar tools is a plus
Experience with Python as a tool for automation is a plus
Exceptional attention to detail and nuance

Please note: As a Red Teaming Specialist, you’ll push the boundaries of large language models and seek to expose their vulnerabilities. In this work, you may be dealing with material that is toxic or NSFW. Innodata is committed to the health of its workforce and so provides wellness resources and mental health support.

Salary Range: $55k-$57k USD

Hourly rates at Innodata vary depending on a wide array of factors, which may include but are not limited to the role, skill set, educational background and geographic location.

We are an equal opportunity employer committed to fostering an inclusive, respectful, and diverse workplace. We welcome and encourage applications from individuals of all backgrounds and are dedicated to employment equity and building a team that reflects the diverse communities in which we live and operate.

In accordance with the Accessibility for Ontarians with Disabilities Act (AODA), we are committed to providing accommodations throughout the recruitment and selection process. If you require an accommodation, please let us know, and we will work with you to meet your needs.

Please be aware of recruitment scams involving individuals or organizations falsely claiming to represent employers. Innodata will never ask for payment, banking details, or sensitive personal information during the application process. To learn more on how to recognize job scams, please visit the Federal Trade Commission’s guide at https://consumer.ftc.gov/articles/job-scams.

If you believe you’ve been targeted by a recruitment scam, please report it to Innodata at [email protected] and consider reporting it to the FTC at ReportFraud.ftc.gov.