Senior Staff Engineer, AI Platform and Infrastructure
TLDR
Lead the design and development of large-scale AI infrastructure that optimizes machine learning and generative AI workloads, while mentoring senior engineers and setting technical direction.
Who We Are
About the opportunity
What You’ll Be Doing
- Architect and build large-scale AI infrastructure supporting training, fine-tuning, and deployment of AI models
- Define platform standards and reference architectures for distributed training, inference, and model lifecycle management
- Lead the design of scalable systems across compute, storage, networking, and orchestration layers (e.g. GPU/accelerator clusters, schedulers, data pipelines)
- Drive performance, reliability, and cost optimization for AI workloads at scale
- Partner with the AI Science team, and relevant business units to translate requirements into robust platform capabilities
- Set technical direction and best practices for AI platform development, including scalability, reliability, observability, security, and operational excellence
- Evaluate and integrate emerging technologies in AI infrastructure (frameworks, accelerators, serving stacks, tooling)
- Mentor senior engineers and act as a subject-matter-expert, influencing architecture beyond your immediate scope
What We Look For In You
-
Bachelors Degree in Computer Science, Information Technology, Engineering, Mathematics or equivalent, with at least 7+ years of relevant experience in the industry
-
Experience in AI Agent / RAG engineering solutions
-
Experience in Microservices / API development with Java/SpringBoot/SpringCloud/Python/Langchain
-
Knowledgeable in multi-threading and distributed architecture
-
Understanding of mainstream messaging frameworks including Kafka etc.
-
Knowledge of different databases solutions including vector DB
Good to Have
-
Experience with AI models or multi-agentic AI systems
-
Experience in high-frequency trading, fintech, Web3, or crypto platforms is a strong advantage
Perks & Benefits
-
Competitive total compensation package
-
L&D programs and Education subsidy for employees' growth and development
-
Various team building programs and company events
-
Wellness and meal allowances
-
Comprehensive healthcare schemes for employees and dependants
-
More that we love to tell you along the process!
Benefits
Health Insurance
Comprehensive healthcare schemes for employees and dependants
Learning Budget
L&D programs and Education subsidy for employees' growth and development
Team building programs
Various team building programs and company events
Wellness Stipend
Wellness and meal allowances
OKX operates as a prominent cryptocurrency exchange, enabling users to buy, sell, and trade a wide range of digital assets, including Bitcoin and Ethereum. In addition to facilitating crypto trading, they've developed OKX Wallet, a widely-used platform for accessing decentralized applications and exploring the Web3 landscape.
- Founded
- Founded 2017
- Employees
- 500+ employees
- Industry
- Diversified Financial Services