Senior Machine Learning Developer

ServiceNow Research carries out fundamental research to push the limits of what AI can do for the enterprise.  In turn, those learning are passed along to our engineering and product teams through our innovation pipeline. Here is a chance to be part of the Emerging Capabilities Lab, a team that bridges the gap between fundamental research and product, by doing applied research at the forefront of modern AI, ML, and LLM research. 

ServiceNow Research is a key player in developing NowLLMs, large language models built explicitly for our enterprise use cases at ServiceNow. It is our Applied Labs that are getting their hands dirty in the difficult but exciting work of training and evaluating these NowLLMs, and of incorporating best practices and innovations from this fast paced field. As a member of the Emerging Capabilities Lab, you will be contributing directly to our efforts to make ServiceNow the defining enterprise software company of the 21st century. 

What will do in this Role? 

Research developers supercharge fundamental and applied research. In this role, you will be an AI applied research expert who will work mainly on the efficiency of large language models and inference time optimization. As models scale, questions of how to extract the best performance at inference time become crucial in the enterprise context. As an expert in this field, you will experiment with various state of the art techniques for improving inference time, memory, and performance.  This means having a strong understanding of and keeping up with the literature in distillation, quantization, sparsification, speculative decoding techniques, and everything that comes along with how we make efficient use of our NowLLMs. 

We are looking for someone with strong coding skills who is an expert at operationalizing AI innovations and developing robust and reliable AI systems. You need to be able to analyze problems and requirements with a critical eye, identify and apply appropriate tools and techniques in a quickly changing tech space, and quickly validate your approaches and ideas. 

You will thrive in this role by being self-directed, staying on top of the latest research in the area, weighing the value of an approach, and quickly executing on experiments to validate your ideas. As part of the Emerging Capabilities Lab, good communication skills are a must to bridge the gap from fundamental research to early production work. 

• Build the best cloud-based AI/ML solutions to power intelligent enterprise services
• Collaborate daily with a team of like-minded developers, product managers and quality engineers to produce quality software
• Work with product owners to understand detailed requirements and own your code from design, implementation, testing and delivery of high-quality solutions to our users

To be successful in this role you have:

• 5+ years of related experience with a Bachelor's degree; or 3 years and a Master's degree; or a PhD without experience; or equivalent work experience .
• Familiarity with PyTorch, Tensorflow or equivalent tools used for running computations on GPUs. 
• Familiarity with DeepSpeed, accelerate, and other tools for running multi-GPU computation. 
• Experience in training large models that requires the use of dozens of GPUs across multiple nodes. 
• Familiarity with optimization techniques such as quantization, LoRA, various types of parallelism, and others.  
• Familiarity with doing a literature research and implementing (sometimes from scratch) the best solution found.  
• Familiarity with the state-of-the-art foundation model literature, scaling laws, and training an asset. 
• Experience in the development of AI prototypes and the ability to quickly validate whether a certain avenue is worth pursuing.  
• Proficiency in producing prototype-level source code that balances correctness with efficiency.  
• Experience using CUDA, nvprof, and other low-level tools to optimize the usage of compute resources is an asset.  
• A proven track record of dealing well with ambiguity, prioritizing needs, and delivering results in a dynamic environment;  
• A “getting things done” mindset. 

ServiceNow is an Equal Employment Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, national origin or nationality, ancestry, age, disability, gender identity or expression, marital status, veteran status or any other category protected by law.

At ServiceNow, we lead with flexibility and trust in our distributed world of work. Click here to learn about our work personas: flexible, remote and required-in-office.

If you require a reasonable accommodation to complete any part of the application process, or are limited in the ability or unable to access or use this online application process and need an alternative method for applying, you may contact us at [email protected] for assistance.

For positions requiring access to technical data subject to export control regulations, including Export Administration Regulations (EAR), ServiceNow may have to obtain export licensing approval from the U.S. Government for certain individuals. All employment is contingent upon ServiceNow obtaining any export license or other approval that may be required by the U.S. Government.

Please Note: Fraudulent job postings/job scams are increasingly common. Click here to learn what to watch out for and how to protect yourself. All genuine ServiceNow job postings can be found through the ServiceNow Careers site.

From Fortune. © 2022 Fortune Media IP Limited All rights reserved. Used under license.

Fortune and Fortune Media IP Limited are not affiliated with, and do not endorse products or services of, ServiceNow.