About the Role
The Site Reliability Engineering team at iCapital is fundamental to ensuring our platform delivers consistent, reliable service to our client base. As a Site Reliability Engineer, you'll work at the intersection of software engineering and operations, applying engineering principles to infrastructure challenges. You'll be responsible for designing and implementing systems that scale efficiently, architecting observability solutions that provide actionable insights, and building automation that enhances our platform's reliability. This role requires someone who thinks systematically about reliability, can translate business requirements into technical implementations, and thrives on making complex systems more robust.
Responsibilities:
- Define, implement, and iterate service level objectives (SLOs) and service level indicators (SLIs) that reflect customer and business expectations.
- Lead monitoring and alerting standardization through “monitors as code” (Terraform preferred), including quality gates such as severity, ownership, and runbook links.
- Develop observability standards across metrics, logs, and traces, including instrumentation and dependency mapping patterns (OpenTelemetry where applicable).
- Lead technical evaluations and PoCs for observability platforms and integrations; define success criteria and migration approach for adoption.
- Define and implement reliability and operability standards for Kubernetes-based services, including scaling patterns, resource constraints, rollout safety, and baseline dashboards and alerts as part of service onboarding.
- Drive automation to eliminate toil, improve repeatability, and accelerate recovery (incident workflows, runbooks, and remediation where appropriate).
- Serve as Incident Commander for high-severity incidents, lead postmortems, and drive systemic improvements through action items and measurable follow-through using established tooling workflows.
- Participate in on-call rotations with a focus on improving reliability, reducing alert noise, and increasing signal quality over time.
Qualifications:
- 7+ years in SRE or related roles, with evidence of technical seniority across multiple services and teams.
- Strong experience with AWS and container orchestration (Kubernetes) in production environments.
- Demonstrated experience defining SLOs/SLIs and using them to drive operational and engineering decisions.
- Proven ability to design and implement observability solutions that produce actionable insights while reducing alert fatigue and operational noise.
- Strong IaC skills (Terraform preferred) and the ability to build reusable automation and standards (monitoring as code, configuration patterns).
- Familiarity with common data stores and managed services (e.g., Postgres, MongoDB, DynamoDB) and how they fail in distributed systems.
- Experience with at least two observability stacks (Prometheus/Grafana, New Relic, Splunk, CloudWatch, ELK, etc.) and driving standardization across them.
- Strong incident response skills, including leading retrospectives/postmortems and improving reliability through systematic follow-up.
- Strong debugging skills across distributed systems and production environments, including performance and reliability investigations.
- Clear written and verbal communication skills with the ability to influence engineering teams through standards, tooling, and practical guidance.
Employees in this role will work fully remote. Every department has different needs, and some positions will be designated in-office jobs, based on their function.
Benefits
iCapital offers a comprehensive benefits package that includes a total compensation program consisting of competitive salary, annual performance bonus, and equity for all full-time employees; healthcare with 100% employer-paid health and dental insurance; and generous paid time off (PTO).
For additional information on iCapital Network, please visit https://www.icapitalnetwork.com/about-us Twitter: @icapitalnetwork | LinkedIn: https://www.linkedin.com/company/icapital-network-inc
