Senior Machine Learning Quality Engineer

What you get in this role:

 You will be working with the   Applied AI Science & Quality Assurance engineering team.  We help build out our Machine learning models and AI functions.  Design and review test automation frameworks for machine learning models

• Work with ML engineers to make sure that functional & non-functional requirements are addressed
•  Establish and improve metrics collection and reporting
•  Establish test effectiveness and efficiencies throughout the team
•  Incorporate research of industry trends and apply best practices in quality engineering practices used in
• evolving machine learning techniques
• Work in a team oriented environment and work with technical and non-technical team members equally
• well
•  Create test plans, test cases and other testing artifacts 
• Maintain existing automation test frameworks
• Collect and report quality metrics from test execution
• Work with developers to design specific testing strategies for features being developed and automate them
• Create comprehensive test plans; execute and automate them
• Enable engineering organizations in troubleshooting or addressing issues with applications and dev/test environments
   

To be successful in this role you have:

• Bachelors or Masters in Computer Science or related subjects with 5 to 8 years of work experience
• Strong test automation skills in Java / Python
• Hands-on experience testing large-scale, production systems in Python  or Java
• Excellent communication, collaboration, reporting, analytical and problem-solving skills
• Ability to take a project from scoping the requirements and building the test cases
• Familiarity with AI/ML modeling approaches such as supervised and unsupervised techniques
• Familiarity with testing AI/ML models and evaluation of the model quality
• Ability to analyze results from the test set and create defects based on result patterns
• 5 to 8 years Experience in quality assurance and/or application development
• Knowledge  of machine learning techniques, data structures, algorithms, statistics
• Expertise in developing automation pipelines & frameworks for verification of machine learning models
•  Experience in collecting and maintaining data according to test plans / cases.
• Experience setting up automated test systems using continuous build environments (e.g. Jenkins) and ML
• Content management systems to build full stack testing workflows
• Experience in designing scalable and maintainable automated testing solutions for large-scale ML systems
•  Experience in an agile environment and in standard software testing methodology, e.g. integration testing, code reviews, design documentation

For positions in the Bay Area, we offer a base pay of $137,000 - $233,000, plus equity (when applicable), variable/incentive compensation and benefits. Sales positions generally offer a competitive On Target Earnings (OTE) incentive compensation structure. Please note that the base pay shown is a guideline, and individual total compensation will vary based on factors such as qualifications, skill level, competencies and work location. We also offer health plans, including flexible spending accounts, a 401(k) Plan with company match, ESPP, matching donations, a flexible time away plan and family leave programs (subject to eligibility requirements). Compensation is based on the geographic location in which the role is located, and is subject to change based on work location.

ServiceNow is an Equal Employment Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, national origin or nationality, ancestry, age, disability, gender identity or expression, marital status, veteran status or any other category protected by law.

At ServiceNow, we lead with flexibility and trust in our distributed world of work. Click here to learn about our work personas: flexible, remote and required-in-office.

If you require a reasonable accommodation to complete any part of the application process, or are limited in the ability or unable to access or use this online application process and need an alternative method for applying, you may contact us at [email protected] for assistance.

For positions requiring access to technical data subject to export control regulations, including Export Administration Regulations (EAR), ServiceNow may have to obtain export licensing approval from the U.S. Government for certain individuals. All employment is contingent upon ServiceNow obtaining any export license or other approval that may be required by the U.S. Government.

Please Note: Fraudulent job postings/job scams are increasingly common. Click here to learn what to watch out for and how to protect yourself. All genuine ServiceNow job postings can be found through the ServiceNow Careers site.

From Fortune. © 2022 Fortune Media IP Limited All rights reserved. Used under license.

Fortune and Fortune Media IP Limited are not affiliated with, and do not endorse products or services of, ServiceNow.