Senior Data Engineer - Azure Databricks (AI-Ready)

AI overview

Leverage expert Azure Databricks skills to design, optimize, and govern scalable data pipelines while supporting AI-driven analytics in a dynamic environment.

Requirements

Strong hands-on experience with Microsoft Azure in enterprise-scale deployments
Expert-level experience with Azure Databricks in production environments
Advanced SQL skills and experience with modern data warehouses
Proven experience designing and supporting large-scale batch and streaming pipelines
Deep hands-on experience with ETL/ELT architectures using Spark, Azure Data Factory
Strong proficiency in Python for distributed data processing
Experience working with Azure Data Lake, Blob Storage, Azure Synapse, Snowflake, Cosmos DB

AI & Advanced Analytics Enablement

Familiarity with Databricks MosaicAI and supporting ML / Generative AI data pipelines
Experience preparing, optimizing, and governing data for AI model training, inference, and RAG-style workloads

Preferred

Streaming experience (Spark Structured Streaming, Kafka)
CI/CD experience for Databricks (Azure DevOps, GitHub Actions)
Azure Data Engineering certifications
Databricks certifications