Data Engineer - Bangalore

AI overview

Collaborate with experts to design and build data pipelines that transform data into insights to support advanced analytics and AI use cases.

ProArch is seeking talented Data Engineer to join our dynamic Data & Analytics team. As a Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines that power analytics, intelligence layers, and AI use cases within the Zero Touch CSP and MSP AI-native platform. You will work closely with architects, AI engineers, and product teams to ensure data is reliable, governed, and ready for advanced intelligence and automation.

About ProArch:

At ProArch, we partner with businesses around the world to turn big ideas into better outcomes through IT services that span cybersecurity, cloud, data, AI, and app development. We’re 400+ team members strong across 3 countries (we call ourselves ProArchians)—and here’s what connects us all:

  • A love for solving real business problems
  • A belief in doing what’s right

What’s it like to work here?

  • You’ll keep growing. You’ll work alongside domain experts who love to share what they know.
  • You’ll be supported, heard, and trusted to make an impact.
  • You’ll take on projects that touch industries, communities, and lives.
  • You’ll have the time to focus on what matters most in your life outside of work.

At ProArch, you’ll be part of teams that design and deliver technology solutions solving real business challenges for our clients. With services spanning AI, Data, Application Development, Cybersecurity, Cloud & Infrastructure, and Industry Solutions, your work may involve building intelligent applications, securing business‑critical systems, or supporting cloud migrations and infrastructure modernization. 

Every role here contributes to shaping outcomes for global clients and driving meaningful impact. You’ll collaborate with experts across data, AI, engineering, cloud, cybersecurity, and infrastructure—solving complex problems with creativity, precision, and purpose. You’ll join a culture rooted in technology, curiosity, and continuous learning. A place where we move fast, trust you to make an impact, encourage innovation, and support your growth.

Key Responsibilities:

  • Design, develop, and maintain end-to-end data pipelines using Microsoft Fabric, Spark notebooks, and Python
  • Implement ingestion patterns for structured and semi-structured data from APIs, databases, and files
  • Build scalable transformations following medallion architecture (Bronze, Silver, Gold)
  • Optimize Spark jobs for performance, cost, and reliability
  • Work with Fabric Lakehouse, Dataflows Gen2, and Notebooks
  • Prepare datasets for AI/ML and LLM-based use cases
  • Implement logging, monitoring, and error handling
  • Follow data governance, naming standards, and documentation practices

Requirements

Preferred Skills:

  • 4–5 years of experience in Data Engineering
  • Strong proficiency in Python
  • Hands-on experience with Apache Spark and Spark Notebooks
  • Experience with Microsoft Fabric (or Synapse / Databricks)
  • Strong SQL skills and data modeling knowledge
  • Understanding of cloud data architectures (Azure preferred)

Good to have:

  • Experience with Power BI (datasets, semantic models, reports)
  • Exposure to AI/ML data preparation
  • Familiarity with CI/CD for data pipelines

Soft Skills:

  • Comfortable working with ambiguity
  • Strong problem-solving mindset
  • Good communication and collaboration skills

Life @ ProArch:

  • At ProArch, we believe our people are the key to our success. That’s why we foster an environment where every employee—known proudly as a ProArchian—can grow, thrive, and make a meaningful impact.
  • We empower employees to develop at their own pace through Career Pathways, a clear and supportive guide to professional progression.
  • Our culture is one of positivity, inclusivity, and respect. Titles don’t define how we treat each other—every ProArchian is valued equally, and collaboration across roles and teams is the norm.
  • We understand that great work starts with balance. That’s why we prioritize work-life harmony, offering flexible work schedules and encouraging time for what matters most.
  • Beyond the workplace, ProArchians actively give back—organizing volunteer efforts and charitable initiatives that empower the communities we call home.
  • And because we know that extraordinary efforts deserve recognition, we celebrate those who go above and beyond with appreciation programs.
  • At ProArch, we’re not just using technology to transform businesses—we’re using it to create a better experience for our people, our clients, and our communities.

We are a value-driven consulting and engineering partner, helping companies to design and execute their most challenging digital transformations in the Cloud.Moving to the Cloud is merely the foundation of your digital transformation. Once migration is complete, we integrate cutting-edge technologies into all areas of your organization to redefine the way you do business. Our aim is to take you on a Cloud-centric journey to unlock the value hidden in your data and compete in an increasingly competitive and connected world. We take an evidence-based approach to setting up your transformation, leveraging ProArch’s solution set to accelerate your time to value.

View all jobs
Ace your job interview

Understand the required skills and qualifications, anticipate the questions you may be asked, and study well-prepared answers using our sample responses.

Data Engineer Q&A's
Report this job
Apply for this job