Machine Learning Infrastructure Engineer

We are looking for a Machine Learning Infrastructure Engineer to help build cutting edge ML infrastructure at Moveworks. This role will be critical in building, optimizing and scaling end-to-end machine learning systems. The ML infra team covers a variety of responsibilities including distributed training and inference pipeline for large language models(LLM), model evaluation and monitoring framework, LLM & ML micro-services optimization, data annotation infrastructure, etc. These frameworks serve as a strong foundation for our hundreds of ML and NLP models in production serving hundreds of millions of enterprise employees. We are solving many challenges on scalability of services as well as optimization of core algorithms. 

In this role you will work closely with our machine learning team, data infrastructure team and every core skill. Above all, your work will impact the way our customers experience AI. Put another way, this role is absolutely critical to the long term scalability of our core AI product and ultimately the company. You will be responsible for building and productionizing ML infrastructure that runs state of the art models. If you are looking for a high-impact, fast-moving role to take your work to the next level, we should have a conversation.  

Who we are

Moveworks is on a mission to make language the universal UI. We give enterprises a conversational interface that works across every system — from Microsoft to Workday to Salesforce. Powered by GPT-class machine learning models, the Moveworks platform learns the unique language of each organization to solve thousands of use cases. Brands like Databricks, Broadcom, DocuSign, and Palo Alto Networks leverage Moveworks’ proprietary enterprise data, out-of-the-box solutions, and intuitive developer tools to bring conversational automation to all aspects of their business.

Founded in 2016, Moveworks has raised $315 million in funding, at a valuation of $2.1 billion. We’ve been named to the Forbes AI 50 list for three consecutive years, while earning recognition as the winner of the 2023 Edison Awards for AI Optimized Productivity, and as the Best Bot Solution at the 2022 AI Breakthrough Awards. 

Moveworks has over 500 employees in six offices around the world, and is backed by some of the world's most prominent investors, including Kleiner Perkins, Lightspeed, Bain Capital Ventures, Sapphire Ventures, Iconiq, and more.

Come join one of the fastest growing teams on the planet!

What you will do

• Design, build and optimize scalable machine learning infrastructure to support training, evaluation, and deployment of large language models.
• Build abstractions to automate various steps in different ML workflows
• Collaborate with cross functional teams of engineers, data analytics, machine learning experts, and product to build new features
• Leverage your experience to drive best practices in ML and data engineering

What you bring to the table 

• 2+ years of industry experience in Machine Learning, Infrastructure or related fields
• Experience with building end-to-end machine learning systems
• Experience building scalable micro services and ETL pipelines
• Expertise in Python and experience with performant language such as C++ or GoLang
• Experience with deep learning framework such as Pytorch or Huggingface
• Bachelor's in Computer Science, Computer Engineering, Mathematics, or equivalent field.
• A love of research publications in the machine learning and software engineering communities
• Effective communicator with experience collaborating cross-functionally with other teams

Nice to have

• Experience with ML Inference framework such as FastTransformers or Nvidia Triton
• Experience with distributed training  frameworks such as Deepspeed

Compensation Range: $180,000 - $221,000

*Our compensation package includes a market competitive salary, equity for all full time roles, exceptional benefits, and, for applicable roles, commissions or bonus plans.
Ultimately, in determining pay, final offers may vary from the amount listed based on geography, the role’s scope and complexity, the candidate’s experience and expertise, and other factors.

Moveworks Is An Equal Opportunity Employer
*Moveworks is proud to be an equal opportunity employer. We provide employment opportunities without regard to age, race, color, ancestry, national origin, religion, disability, sex, gender identity or expression, sexual orientation, veteran status, or any other characteristics protected by law.