Nagarro is hiring a

Big Data Engineer (Azure)

Full-Time
Remote

In this role, you will work with our Business Analytics & Insights (BAI) team, collaborating with cross-functional teams to deliver high-quality data solutions in areas such as Supply Chain, Finance, Operations, Customer Experience, HR, Risk Management, and Global IT.

Responsibilities:

  • Lead the technical planning for data migration, including data ingestion, transformation, storage, and access control within Azure Data Factory and Azure Data Lake.
  •  Design and implement scalable, efficient data pipelines to ensure smooth data movement from multiple sources using Azure Databricks.
  •  Develop reusable frameworks for the ingestion of large datasets.
  •  Ensure data quality and integrity by implementing robust validation and cleansing mechanisms throughout the data pipeline.
  •  Work with event-based/streaming technologies to ingest and process data in real-time.
  •  Provide technical support to the team, resolving challenges during the migration and post-migration phases.
  •  Stay current with the latest advancements in cloud computing, data engineering, and analytics technologies; recommend best practices and industry standards for data lake solutions.
  • 6+ years of IT experience.
  •  Minimum of 4 years working with Azure Databricks.
  • Experience with Python for data engineering purposes.
  •  Proficiency in Data Modeling and Source System Analysis.
  •  Strong knowledge of PySpark and SQL.
  •  Experience with Azure components: Data Factory, Data Lake, SQL Data Warehouse (DW), and Azure SQL.
  •  Ability to conduct data profiling, cataloging, and mapping for technical design and construction of data flows.
  • Familiarity with data visualization/exploration tools.
Apply for this job

Please mention you found this job on AI Jobs. It helps us get more startups to hire on our site. Thanks and good luck!

Get hired quicker

Be the first to apply. Receive an email whenever similar jobs are posted.

Ace your job interview

Understand the required skills and qualifications, anticipate the questions you may be asked, and study well-prepared answers using our sample responses.

Data Engineer Q&A's
Report this job
Apply for this job