Senior Cloud Operations Engineer - PyTorch

The Senior Cloud Operations Engineer will play a crucial role in managing and optimizing our multi-cloud infrastructure and DevOps practices. This position is essential for maintaining and scaling our cloud operations across multiple cloud provider platforms and accelerator technologies. The ideal candidate will combine deep expertise in cloud technologies, hardware accelerators, and DevOps methodologies to ensure our infrastructure remains robust, efficient, and future-proof.

Responsibilities:

Cloud Infrastructure Management

  • Design and manage multi-cloud environments across AWS, GCP, and Azure
  • Optimize instance selection and utilization across various compute types including AMD and Intel CPU-based instances
  • Configure and manage GPU-accelerated instances (AMD and NVIDIA) and specialized accelerators (TPUs, NPUs)
  • Implement and maintain infrastructure-as-code using Terraform and other IaC tools
  • Optimize cloud resource utilization and implement FinOps practices for cost management
  • Design and implement high-availability solutions across multiple cloud providers

CI/CD and DevOps

  • Design, implement, and maintain CI/CD pipelines using GitHub Actions
  • Configure and manage both github-hosted and self-hosted runners
  • Implement and maintain non-blocking and out-of-tree CI jobs
  • Design and implement matrix testing strategies across different hardware configurations
  • Develop and maintain automated testing frameworks for various testing types (unit, integration, performance)
  • Implement best practices for version control management and branching strategies
  • Experience with agile methodologies and scrum practices

Performance Optimization and Testing

  • Develop and implement performance testing frameworks for various hardware accelerators
  • Optimize workload distribution across different types of compute instances
  • Implement automated performance regression testing
  • Design and maintain benchmarking systems for various hardware configurations

Infrastructure Security and Monitoring

  • Implement security best practices across multi-cloud environments
  • Develop comprehensive monitoring solutions using cloud-native tools
  • Participate in on-call rotations supporting operations and incident response
  • Establish and maintain escalation procedures and resolution processes
  • Manage access control and security policies across cloud platforms

Required:

  • Bachelor's degree in Computer Science, Engineering, or related field
  • 7+ years of experience in cloud operations with extensive multi-cloud expertise (AWS, GCP, Azure)
  • Demonstrated experience with GPU computing (AMD and NVIDIA) and specialized accelerators (TPUs, NPUs)
  • Strong knowledge of CPU architectures and instance type optimization (AMD, Intel)
  • Advanced experience with GitHub Actions, including custom runner configuration and management
  • Expertise in implementing non-blocking and out-of-tree CI jobs
  • Strong background in version control systems and branching strategies
  • Experience with agile methodologies and scrum practices
  • Proficiency in infrastructure-as-code tools, particularly Terraform
  • Strong scripting abilities (Python, Bash, PowerShell, Typescript)
  • Experience with containerization and orchestration (Docker, Kubernetes)
  • Demonstrated experience in implementing automated testing frameworks

Preferred:

  • Experience optimizing workloads across different hardware accelerators
  • Background in performance testing and optimization
  • Contributions to open-source projects
  • Experience mentoring other engineers
  • Background in machine learning infrastructure
  • Experience with Datadog is a plus

Benefits:

  • Competitive salary
  • Comprehensive health, dental, and vision insurance
  • Flexible PTO policy
  • Remote work environment
  • Professional development opportunities
  • 401(k) matching
  • Home office stipend

Open to US-based employees only. Preference for West Coast candidates.

Salary $125,000 - $165,000 USD

About Us:

We maintain a predominantly remote workforce and are committed to hiring top-notch talent. We are passionate about providing a flexible and supportive work culture. Our team values collaboration, innovation, and continuous learning. We embrace diversity and believe in creating an inclusive environment where all team members can thrive.

The Linux Foundation is an Equal Opportunity Employer.

The FinOps Foundation is a program of The Linux Foundation that includes 12,000+ individual members, representing more than 1500 companies. You’ll be joining our fast moving team who support the FinOps community. Our mission is to advance every individual who manages the value of cloud wherever they are by creating connections, inspiring growth, and empowering best practices for cloud billing and operations.

View all jobs
Get hired quicker

Be the first to apply. Receive an email whenever similar jobs are posted.

Ace your job interview

Understand the required skills and qualifications, anticipate the questions you may be asked, and study well-prepared answers using our sample responses.

Cloud Operations Engineer Q&A's
Report this job

This job is no longer available

Enter your email address below to get notified whenever we find a similar job post.

Unsubscribe at any time.