Senior Staff Systems Engineer

At ASAPP, our mission is simple: deliver the best AI-powered customer experience—faster than anyone else. We are guided by principles that shape how we think, build, and execute, including deep customer obsession, purposeful speed, ownership, and a relentless focus on outcomes. We work in small, highly skilled teams, prioritize clarity over complexity, and continuously evolve through curiosity, data, and craftsmanship. We’re building a globally diverse team of technologists and problem solvers who thrive in fast-paced environments, value collaboration, and approach every challenge with a Day 1 mindset. With hubs in New York City, Mountain View, Latin America, and India. If you’re driven by continuous learning, rapid iteration, and the challenge of building in a high-growth startup, this is more than a role—it’s a journey. We are seeking a Senior Staff Systems Engineer to drive the architectural vision for our GenerativeAgent product. In this role, you will design and build a highly scalable, multi-agent platform that powers real-time voice and text customer service experiences across a wide range of industries. As a Senior Staff Engineer, you will set long-term system direction, tackle the organization’s most complex technical challenges, and partner closely with engineering, product, security, and operations leaders. You will ensure our systems are resilient, scalable, and tightly aligned with both customer needs and business goals, while maintaining a strong hands-on presence and broad organizational impact. What you'll do
Technical Leadership & Influence
  • Act as a technical authority and advisor across multiple engineering teams
  • Develop and drive alignment on system design, technical roadmaps, and best practices
  • Design and implement a scalable, multi-tenant deployment architecture that supports easy configuration of agents and business workflows for various customers
  • Define the communication, state management, and orchestration patterns for multi-agent systems
  • Mentor senior engineers and help raise the bar on systems thinking across the organization
  • Reliability, Scalability & Security
  • Own and define system-level SLOs/SLIs for high-traffic, real-time voice and text services, focusing on latency, cost-efficiency, and fault tolerance across the ecosystem
  • Identify systemic risks and proactively design mitigation strategies
  • Partner with Security and Compliance teams to ensure systems meet regulatory and security requirements
  • Lead post-incident analysis and drive systemic improvements
  • Cross-Functional Collaboration
  • Partner with Product, Customer Engineering, SRE, and TPMs to translate business requirements into system designs
  • Work with Research to evaluate and productionize cutting-edge ideas in the ML space
  • Drive complex initiatives that span multiple quarters and involve multiple teams
  • Communicate complex technical concepts clearly to both technical and non-technical stakeholders
  • What you'll need
  • 10+ years of experience building large-scale production systems
  • Mastery in at least one cloud platform (AWS, GCP, Azure)
  • Expertise with container orchestration (Kubernetes)
  • Expertise with Python and/or Golang
  • Excellent communication, consensus-building, strategic thinking, and mentorship abilities
  • Deep understanding of:
  • Distributed systems design patterns (e.g., service mesh, event-driven architecture, microservices)
  • Reliability engineering principles
  • System performance and capacity planning
  • Ability to lead through influence rather than authority
  • What we'd like to see
  • Expertise with the LLM development lifecycle (e.g. fine-tuning, RAG, deployment, evaluation, monitoring & feedback)
  • Strong track record of building multi-agent systems at scale
  • Experience with security, compliance, and data privacy requirements (e.g. HIPAA, SOC 2)
  • ASAPP is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, disability, age, or veteran status. If you have a disability and need assistance with our employment application process, please email us at [email protected] to obtain assistance. #LI-AG1 #LI-Hybrid

    Improve customer experience and radically increase agent productivity at the same time. Make every agent your best agent using ASAPP. This AI-native software platform augments agents, guiding them on what to say, what to do, throughout each interaction.

    View all jobs
    Ace your job interview

    Understand the required skills and qualifications, anticipate the questions you may be asked, and study well-prepared answers using our sample responses.

    Staff Systems Engineer Q&A's
    Report this job
    Apply for this job