Primary responsibilities:
- Design and implement ETL pipelines using Azure Data Factory to meet business requirements. This includes creating data flows, handling complex transformations, and automating data ingestion from various sources such as SQL databases, flat files, and cloud storage.
- Manage structured and unstructured data by utilizing Azure Data Lake Storage and Azure SQL Database. Ensure data integrity and optimize data models based on business logic.
- Monitor and optimize the performance of ETL processes. Implement best practices for data processing and storage to enhance efficiency.
- Work closely with business stakeholders to gather requirements and translate them into technical specifications. Participate in design discussions and ensure timely delivery of solutions.
Primary Skills:
- 4–6 years of experience in building data warehousing applications using Microsoft BI
- 2–3 years of experience building ETL applications using Azure Data Factory and Data Lake
- Strong knowledge of SQL for writing complex queries, stored procedures, and triggers
- Good communication skills and the ability to give demos to the stakeholders
Secondary Responsibilities:
- Developing cubes using SSAS models and querying data using Excel and Power View
- Report and Dashboard Development (Microsoft Power BI)
- Hands-on administrative experience with SQL Server 2016
- Good understanding of Azure cloud services
BE/BTECH in Information Technology, Computer Science, or a related field