JD Title : Data Engineer
Experience level : 3 ~ 8 years
Position : Consultant / Senior Consultant / Specialist
Requirements:
- 3 - 8 years of full-time experience as an Azure Data Engineer, with extensive knowledge of ADF, ADLS, Databricks, and Synapse
- Experience using Power BI Desktop, with good knowledge of Power Query, Power Pivot, and Power View
- Able to quickly write SQL for database querying and DAX for creating custom calculations
- Able to develop Extraction pipelines to load the data using ADF or comparable technologies and Transformation and Load pipelines using ADF and Databricks
- Able to design a storage solution on ADLS utilizing Parquet and Delta table formats
- Able to design star-schema data models in ADLS, Azure SQL, and Synapse databases
- Understand data modeling concepts and be able to create effective data models to support reporting needs
- Perform data ETL processes to ensure that data sets are clean, accurate, and ready for analysis
- Improve the scalability, efficiency, and cost-effectiveness of data pipelines
- Monitor and resolve data pipeline problems to ensure consistency and availability of the data
- Unwavering ability to quickly propose solutions by recalling the latest best practices learned from MVP & Product Team articles, MSFT documentation, whitepapers, and community publications
- Work closely with stakeholders to understand requirements, deliver solutions that meet those needs, and bridge the gap between technical and non-technical sides
- Excellent communication, presentation, influencing, and reasoning skills
Primary Skills:
-
Data Engineering: Extensive knowledge in Azure SQL, T-SQL, Azure Data Factory, Azure Data Lake, Azure Databricks, Azure Synapse/Data Warehouse, SSIS, Key Vaults, Azure Functions, Azure Logic Apps, etc
-
Reporting: Power BI Desktop, PBI Service, DAX functions, SSRS, SSAS (OLAP and Tabular)
-
Data Modeling: Design data models for ETL and reporting needs based on the requirements gathered and data discovery conducted in the source systems
- Experience working in Agile environments with continuous integration and continuous deployment and application lifecycle management – experience in DevOps CI/CD repos and pipelines, and GitHub or Bitbucket
Secondary Skills:
- Experience in detailed design aspects in Azure, including design patterns and principles
- Experience with performance tuning of data processing pipelines and cloud-based applications
- Experience in setting up and administering DevOps and GitHub or other automation tools like Jenkins/Puppet/ Ansible/Terraform
- Possess good knowledge of M, Vertipaq Analyzer, and Power BI Service architecture design and administration
- Certifications in Microsoft Azure, Data Analytics, and Power BI
Beware of scams
Our recruiting team may communicate with candidates via our @hitachisolutions.com domain email address and/or via our SmartRecruiters (Applicant Tracking System) [email protected] domain email address regarding your application and interview requests.
All offers will originate from our @hitachisolutions.com domain email address. If you receive an offer or information from someone purporting to be an employee of Hitachi Solutions from any other domain, it may not be legitimate.
