Startup Jobs
Post a Job
Blend360

Data Engineering Manager - AWS Databricks

Hyderabad , India
full-time

AI overview

Lead engineering initiatives to build and maintain scalable data pipelines using AWS and Databricks, while ensuring data quality and mentoring junior engineers.

We are looking for an experienced Data Engineering Manager with a strong foundation in Python, SQL, and Spark, and hands-on expertise in AWS, Databricks. In this role, you will build and maintain scalable data pipelines and architecture to support analytics, data science, and business intelligence initiatives. You’ll work closely with cross-functional teams to drive data reliability, quality, and performance.

Responsibilities:

  • Design, develop, and optimize scalable data pipelines using Databricks in AWS such as Glue, S3, Lambda, EMR, Databricks notebooks, workflows and jobs.
  • Building data lake in WS Databricks.
  • Build and maintain robust ETL/ELT workflows using Python and SQL to handle structured and semi-structured data.
  • Develop distributed data processing solutions using Apache Spark or PySpark.
  • Partner with data scientists and analysts to provide high-quality, accessible, and well-structured data.
  • Ensure data quality, governance, security, and compliance across pipelines and data stores.
  • Monitor, troubleshoot, and improve the performance of data systems and pipelines.
  • Participate in code reviews and help establish engineering best practices.
  • Mentor junior data engineers and support their technical development.

Requirements

  • Bachelor's or master's degree in computer science, Engineering, or a related field.
  • 8+ years of hands-on experience in data engineering, with at least 3 years working with AWS Databricks.
  • Strong programming skills in Python for data processing and automation.
  • Advanced proficiency in SQL for querying and transforming large datasets.
  • Deep experience with Apache Spark/PySpark in a distributed computing environment.
  • Solid understanding of data modelling, warehousing, and performance optimization techniques.
  • Proficiency with AWS services such as Glue, S3, Lambda and EMR.
  • Experience with version control Git or Code commit
  • Experience in any workflow orchestration like Airflow, AWS Step functions is a plus.
  • Excellent communication and stakeholder management skills with a strategic mindset.
Blend360

 BLEND360 is an award-winning, new breed Data Science Consultancy focused on powering exceptional results for our Fortune 500/1000 clients and other major organizations. We are a growing company—born at the intersection of advanced analytics, data, and technology.Who we are:People are everything here at BLEND360.  We are inspired by advancing our Client’s most critical initiatives, products and projects by matching our clients with the right talent. BLEND360 has been among the Inc. 5000 fastest growing companies 8 years in a row, and we’re very proud of our World Class NPS score. Our success is a direct result of our passion for advancing the careers of the talented people we work with every day. When you work at BLEND360, you will:Collaborate with a smart, passionate group of people who are invested in your success.Partner with an impressive list of clients, who value Blend360’s services and the world class experience we deliver with every engagement. Thrive with a company and leadership team who are committed to growth.

View all jobs
Get hired quicker

Be the first to apply. Receive an email whenever similar jobs are posted.

Ace your job interview

Understand the required skills and qualifications, anticipate the questions you may be asked, and study well-prepared answers using our sample responses.

Data Engineering Manager Q&A's
Report this job
Apply for this job