Are you an experienced Azure DevOps Engineer with a passion for automating data engineering processes? If you're passionate about DevOps and data engineering and have the skills to drive innovation in a dynamic environment, we'd love to hear from you!
Responsibilities:
-
CI/CD Pipeline Development & Maintenance: Design, implement, and maintain robust Azure DevOps pipelines to automate and streamline data engineering processes.
-
Infrastructure as Code (IaC): Leverage Terraform, Python, and other tools to define, manage, and optimize cloud infrastructure.
-
Platform Enablement: Optimize development platforms and tools to enable DevOps best practices for data engineering teams.
-
Project Ownership: Take charge of brownfield implementations, ensuring seamless integration and modernization of existing systems.
-
Collaboration & Support: Partner with cross-functional teams to troubleshoot issues, enhance efficiency, and support the transition to mesh architecture.
-
Monitoring & Optimization: Continuously monitor pipelines and infrastructure for performance, scalability, and security, implementing improvements as needed.
-
Azure DevOps: Strong expertise in managing and optimizing Azure-based CI/CD pipelines.
-
Terraform: Strong proficiency in Infrastructure as Code (IaC) for defining and managing cloud infrastructure.
-
Snowflake: Experience with data warehousing and Snowflake integration.
-
DWHA Tooling: Familiarity with tools like DBT, DVB, or similar.
-
Data Mesh Architecture: Exposure to decentralized data infrastructure and domain-oriented data ownership.
