About Neural Magic
Based in Somerville, Massachusetts, Neural Magic is a series A startup backed by leading investors including Andreessen Horowitz, NEA, NEA, Pillar, VMware, Verizon Ventures, Comcast Ventures, and Amdocs. At Neural Magic we believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and VLLM to every enterprise on the planet. Neural Magic accelerates AI for the enterprise and brings operational simplicity to GenAI deployments. As a leading developer and maintainer of the vLLM project and inventor of state-of-the-art techniques for model quantization and sparsification, Neural Magic provides a stable platform for enterprises to build, optimize and scale LLM deployments.
Our Mission
Neural Magic is on a mission to bring the power of open-source LLMs and vLLM to every enterprise on the planet.
Your Role
As a Full Stack Engineer Team Lead, you'll play a pivotal role in shaping the next generation of tools and platforms for AI inference serving. You'll work closely with our product and UX teams to create intuitive monitoring dashboards, insightful analyzers, and other critical components that empower users to understand and optimize their LLM deployments.
Join us in shaping the future of AI!
Responsibilities
- Lead and Collaborate: Guide a small team of front-end, full-stack, and back-end engineers, fostering a collaborative and high-performing environment.
- Drive the Roadmap: Partner with product management to translate business needs into technical solutions and actively contribute to our engineering and product roadmap.
- Build for the Future: Develop and maintain core features for our inference server platform, built upon technologies like vLLM and other cutting-edge solutions.
- Focus on Backend Excellence: Apply your deep expertise in Python-based backend development to build scalable, reliable, and performant systems.
- Full Stack Agility: Contribute to the front end using your proficiency in React, ensuring a seamless user experience.
- Data Expertise: Design and implement database solutions (SQL and NoSQL) that meet the unique demands of LLM-based applications.
- DevOps Advocate: Embrace DevOps principles and technologies (Kubernetes, CI/CD) to ensure smooth and efficient deployments.
Requirements
- Experience: 5 or more years of experience in full-stack development.
- Proven Leadership: Experience leading engineering teams and projects to successful outcomes.
- Cloud Savvy: Demonstrated ability to build and maintain cloud-based applications.
- Python Pro: Strong proficiency in Python and related backend technologies.
- Front-End Skills: Comfort with React and modern single-page application (SPA) development.
- Database Know-How: Experience with SQL and NoSQL databases, with an understanding of their trade-offs.
- DevOps Experience: Familiarity with Kubernetes, CI/CD pipelines, and other DevOps best practices.
- Strong Collaboration: Ability to work effectively with cross-functional teams, including product and UX.
Benefits
- Competitive compensation and stock option plan
- Comprehensive health care (medical, dental, vision)
- Retirement plan (401k, IRA)
- Generous paid time off (vacation, sick leave, holidays)
- Family leave (maternity, paternity)
- Disability coverage
- Professional development opportunities
- Flexible work arrangements (remote options)
- Wellness resources
- Free food and snacks (in the office)
Neural Magic is an equal-opportunity employer committed to fostering a diverse and inclusive workplace. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.
