Associate Manager, Data Annotation

At Qualtrics, we create software the world’s best brands use to deliver exceptional frontline experiences, build high-performing teams, and design products people love. But we are more than a platform—we are the creators and stewards of the Experience Management category serving over 18K clients globally. Building a category takes grit, determination, and a disdain for convention—but most of all it requires close-knit, high-functioning teams with an unwavering dedication to serving our customers.

When you join one of our teams, you’ll be part of a nimble group that’s empowered to set aggressive goals and move fast to achieve them. Strategic risks are encouraged and complex problems are solved together, by passing the microphone and iterating until the best solution comes to light. You won’t have to look to find growth opportunities—ready or not, they’ll find you. From retail to government to healthcare, we’re on a mission to bring humanity, connection, and empathy back to business. Join over 5,000 people across the globe who think that’s work worth doing. 

Associate Manager, AI Data Annotation

Why We Have This Role

We are looking for a talented and innovative AI Data Annotation and Transcription Manager to bring our multi-lingual data collection, annotation, transcription, and audit capabilities to the next level.  You are passionate about building processes and tools for curating large scale datasets that are used to train, audit, and maintain cutting-edge machine learning models.

How You’ll Find Success

The annotation team that you will lead is crucial to the success of the AI initiatives at Qualtrics in a number of ways. First, you will work directly with product managers, engineers and applied scientists/data scientists to plan and scope projects. Second, you will oversee and manage the entire annotation process from guideline creation all the way through annotation completion and delivery. Third, you will continuously evaluate opportunities and challenges for data annotation in the ever-changing AI landscape by staying on top of new annotation and transcription regulations, tools, and technologies. Fourth, you will be a key contributor to the leadership team and take a direct part in shaping the culture of this highly dynamic and versatile organization.

How You’ll Grow

• Set the vision and expectations for the Language Engineering (LE) team
• Design objectives and key results to help the LE team scale its efforts to support more ML projects
• Help define processes to improve speed to delivery of the various annotation projects
• Focus on your career development by taking advantage of Qualtrics’ weekly allotted time to take courses on LinkedIn and other similar platforms
• Collaborate across teams to ensure continuity of projects and drive consensus 

Things You’ll Do

• Work as part of a multidisciplinary team to research/define requirements and develop processes for curating new datasets, data labeling,ƒdata and transcription pipelines
• Lead a multi-lingual team of linguists, language experts, and transcriptionists that are building various knowledge and data assets for Qualtrics by defining new data annotation tasks, writing annotation guidelines, and developing audit metrics.
• Define and promote best practices for new data labeling efforts in accordance with product needs, including measuring and ensuring annotation quality
• Build a pragmatic understanding of the life cycle of machine learning systems and behaviors
• Contribute to process improvements to improve efficiency and quality of portfolio of predictive models by facilitating collaborations with scientists to build, test, and debug machine learning models
• Manage various annotation workflows for language experts (internal and external), ensuring timely completion of multiple concurrent projects
• Oversee your team as they work closely with, incorporate feedback from, and audit work of data labeling specialists and external vendors 
• Be able to deal with ambiguity, multi-task, and adapt to changing priorities in a fast paced, highly collaborative, dynamic work environment
• Work with operational teams to investigate and resolve bugs related to models and data issues
• Advise and coach team members to develop their skills and work towards their career goals
• Set the standard for your team for collaborating with peers, prioritizing features, and working with a sense of urgency to deliver value to customers 

What We’re Looking For On Your Resume

• BA/BS or above in linguistics, or another relevant field
• 5+ years of professional experience
• 2+ years managing data annotation or related projects
• 2+ years of people management or team lead experience
• Strong understanding of data annotation and evaluation workflows for ML use cases
• Ability to quickly grasp technical concepts and learn custom built tools
• Excellent organizational, written, and verbal communication skills
• Ability to deliver high quality results under tight deadlines
• Comfortable working in a fast paced, collaborative work environment
• Team player with exceptional interpersonal skills and a solution-oriented attitude
• Strong analytical, problem-solving, and critical-thinking skills
• Independent, proactive, and self-motivated

What You Should Know About This Team

The goal of the Data Intelligence Center of Excellence (DICE) organization is to personalize the Qualtrics experience for our customers (aka brands) by extracting actionable insights and personalizing the Qualtrics experience using powerful machine learning capabilities. We are a team of engineers, researchers, program managers and product managers working on the innovation charter to build intelligent algorithms that power the DICE suite of products and services.

Our Team’s Favorite Perks and Benefits

• Wellness Reimbursement for $300 per quarter for wellness activities including gym memberships, spa massages, workout equipment, meditation apps, and much more.
• $1800 Experience bonus to be used for an “Experience” of your choosing
• QMentorship Program matches you with a mentor inside Qualtrics to get meaningful coaching from someone outside your team. 
• Amazing QGroup Communities; MOSAIQ, Green Team, Qualtrics Pride, Q&Able, Qualtrics Salute, and Women’s Leadership Development, which exist as places for support, allyship, and advocacy.

The Qualtrics Hybrid Work Model: Our hybrid work model is elegantly simple: we all gather in the office three days a week; Mondays and Thursdays, plus one day selected by your organizational leader. These purposeful in-person days in thoughtfully designed offices help us do our best work and harness the power of collaboration and innovation. For the rest of the week, work where you want, owning the integration of work and life.

Qualtrics is an equal opportunity employer meaning that all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other protected characteristic.

Applicants in the United States of America have rights under Federal Employment Laws: Family & Medical Leave Act, Equal Opportunity Employment, Employee Polygraph Protection Act

Qualtrics is committed to the inclusion of all qualified individuals. As part of this commitment, Qualtrics will ensure that persons with disabilities are provided with reasonable accommodations. If reasonable accommodation is needed to participate in the job application or interview process, to perform essential job functions, and/or to receive other benefits and privileges of employment, please let your Qualtrics contact/recruiter know.

Not finding a role that’s the right fit for now? Qualtrics Insiders is the one-stop shop for all things Qualtrics Life. Sign up for exclusive access to content created with you in mind and get the scoop on what we have going on at Qualtrics - upcoming events, behind the behind the scenes stories from the team, interview tips, hot jobs, and more. No spam - we promise! You'll hear from us two times a month max with fresh, totally tailored info - so be sure to stay connected as you explore your best role and company fit.