Senior AI Platform Engineer

How You’ll Make An Impact

As a Senior Platform Engineer at Boomi, you will architect the "paved road" for our AI initiatives. You will transition our "Customer Zero" prototypes from experimental code into robust, secure, and observable. You will be the bridge between cutting-edge AI research and enterprise-grade reliability, enabling the entire engineering organization to ship intelligent features faster and safer.

What You’ll Do

• Architect the AI Control Plane: Design and manage the Kubernetes-based compute layer and cloud infrastructure (AWS/Azure) that orchestrates model serving, agent runtimes, and vector search engines.
• Define & Build LLMOps: Establish CI/CD pipelines specifically for AI—automating prompt evaluation, model versioning, and regression testing to ensure zero-breaking changes.
• Scale Data & Retrieval: Manage the lifecycle and sharding of production Vector Databases (e.g., Pinecone, Weaviate) and optimize high-throughput RAG pipelines.
• Observability & Governance: Implement full-stack tracing (LangSmith, Arize, Honeycomb) to monitor token latency and costs. Translate AI ethics into code-based guardrails (PII redaction, RBAC).
• Developer Enablement: Build SDKs, CLI tools, and templates that standardize how internal teams spin up agents, reducing "time-to-first-token" and enforcing best practices.

The Experience You Bring

• Infrastructure & Compute: Expert mastery of Kubernetes (K8s), Docker, and Infrastructure as Code (Terraform, Ansible, Helm).
• Languages: Strong proficiency in Python (for AI tooling) and Go/Java (for platform services).
• Cloud Architecture: Deep experience with AWS or Azure (Networking, IAM, Serverless, VPC).
• AI/ML Infrastructure: Experience deploying LLM frameworks (LangChain, LlamaIndex) and Vector Databases in a production environment.
• DevOps/MLOps: Strong background in building CI/CD pipelines (GitHub Actions, Jenkins) and familiarity with Model Serving (vLLM, Triton).
• You are a System Thinker: You don't just write code; you visualize complex distributed systems and identify bottlenecks before they happen.
• You Value "The Paved Road": You are passionate about building tools that make other developers' lives easier.
• You Bridge the Gap: You can speak the language of Data Scientists (Recall/Precision) and the language of SREs (Latency/Uptime).

Aren’t sure if you’re a match? We know that impostor syndrome and the confidence gap can prevent us from meeting spectacular candidates — so don’t hesitate to apply; you could be the perfect fit!

Location

US Remote

Compensation and Benefits 

Boomi is committed to fair and equitable compensation practices. Base compensation for this position in the US ranges between $138,862 - $173,578. This position is remote-friendly and, as such, final compensation will be determined by various factors including the candidate’s knowledge, skills, experience, and geographic location. An overview of our benefits can be found here. 

#LI-ES1

#LI-REMOTE