Merlyn Mind is a "Remote First" VC-backed AI EdTech startup that brings the latest advances in AI to Education to help improve the lives of teachers and ultimately the learning outcomes of their students. Our leadership team includes talents from IBM, Amazon, Facebook, Roku, Broadcom, HP, Allen Institute for AI, and more. We have come together to build on a unified product experience for an extremely urgent mission – building a digital assistant for teachers, to untether teachers from the desk and help them with managing classroom technologies.
We're currently looking for a ML Ops Engineer that has industrial experience with productionizing and scaling models to join our Research/Engineering team. In this role, you will be responsible for delivering models which help improve the lives of teachers and students.
If you enjoy solving problems in a dynamic environment and influencing business and technical leaders with your creative solutions, we want to talk to you. Join our team and help us create AI solutions for the people building a better future! While this role is posted for New York, we are a remote first company and open to hiring this talent anywhere in the world!
#LI-Remote
Responsibilities:
- Design, architect, and develop inference infrastructure for models which are scalable and can handle a large number of simultaneous requests
- Apply Engineering best practices – Automation, code reviews, integration tests, performance load tests, and CI/CD
- Collaborate with cross-functional teams (product, engineering, research) to solve complex engineering challenges
Requirements:
- 3+ years of industry experience in hosting and optimizing large neural net models for production systems
- Operational experience on a production system
- Strong experience with Python and/or Java/Kotlin/Rust/Go
- Strong experience with neural net libraries such as PyTorch, TensorFlow or Jax.
- Production experience and deep knowledge with one or more of: ONNX, ONNX Runtime, DeepSpeed, Torchserve, torchscript, torchrun, Tensorflow-serving, XLA Optimizations, Nvidia Triton, Nvidia TensorRT, Nvidia Apex, CUDA optimizations
- Experience with software engineering and CI/CD best practices and deployment of AI models in production
Preferred Qualifications:
- Knowledge of model parallelization strategies/quantization/batching
- Preferred, you have worked with models which require multiple GPUs for inference of a single model
- Knowledge of LLMs, state-of-art neural net algorithms and NLP a plus
- Knowledge of CUDA and exposure to GPU/TPU profiling tools
- Experience with AWS (using Sagemaker, ECS etc) and you are comfortable deploying infra using CDK/boto as well CI/CD pipelines
Merlyn Mind is an equal opportunity employer that is committed to diversity and inclusion in the workplace. We prohibit discrimination and harassment of any kind based on race, color, sex, religion, sexual orientation, national origin, disability, genetic information, pregnancy, or any other protected characteristic as outlined by federal, state, or local laws. This applies to all employment practices within our organization, including hiring, recruiting, promotion, termination, layoff, recall, leave of absence, compensation, benefits, and training. We make hiring decisions based solely on qualifications, merit, and business needs at the time.
Benefits:
Every last Friday of the month Paid Time off for everyone.
After your second year anniversary you get one month off!
401(k) matching
Dental insurance
Flexible schedule
Flexible spending account
Health insurance
Health savings account
Life insurance
Unlimited Paid time off
Parental leave
Vision insurance
Merlyn Mind is an equal opportunity employer that is committed to diversity and inclusion in the workplace. We prohibit discrimination and harassment of any kind based on race, color, sex, religion, sexual orientation, national origin, disability, genetic information, pregnancy, or any other protected characteristic as outlined by federal, state, or local laws. This applies to all employment practices within our organization, including hiring, recruiting, promotion, termination, layoff, recall, leave of absence, compensation, benefits, and training. We make hiring decisions based solely on qualifications, merit, and business needs at the time.
Benefits:
Every last Friday of the month Paid Time off for everyone.
After your second year anniversary you get one month off!
401(k) matching
Dental insurance
Flexible schedule
Flexible spending account
Health insurance
Health savings account
Life insurance
Unlimited Paid time off
Parental leave
Vision insurance
