Data Engineer

Petaling Jaya , Malaysia
full-time

AI overview

This role involves designing and optimizing ETL pipelines on the Azure platform to ensure data quality and support data-driven decision-making across various business functions.

As our Data Engineer you’ll be responsible for designing, building, and maintaining robust data pipelines and data marts within the Azure ecosystem. This role ensures the accuracy, consistency, and accessibility of data, enabling the organisation to make data-driven decisions. Here you’ll collaborate with various stakeholders to understand data requirements, optimise data processing, and implement best practices for data management. This position is crucial for leveraging Azure technologies to enhance data quality and support the organisation's analytical and operational needs.

Within this position, your scope will cover:

  • Data Pipeline Development: Design, build, and maintain ETL (Extract, Transform, Load) pipelines to move data from various sources to data marts using Azure Fabric.
  • Data Quality Management: Ensure the accuracy, consistency, and reliability of data within the data marts, implementing data validation and cleansing processes.
  • Database Design: Develop and optimize the structure of data marts to support efficient data retrieval and analysis, leveraging Azure SQL Database and other Azure data services.
  • Performance Tuning: Optimize data processing and storage to improve performance and reduce costs, utilizing Azure Data Factory, Azure Databricks, and other relevant tools.
  • Collaboration: Work closely with data analysts, BI developers, and other stakeholders to understand data requirements and deliver solutions that meet business needs.
  • Documentation: Maintain comprehensive documentation of data pipelines, data marts, and related processes to support knowledge sharing and continuity.
  • Security and Compliance: Ensure that data solutions adhere to security policies and compliance standards, implementing best practices for data protection and access control.

 

  • Minimum of 5 years of experience in data engineering, with a strong focus on Azure Fabric and Data Marts.
  • Relevant Azure certifications (e.g., Microsoft Certified: Azure Data Engineer Associate) are highly desirable.
  • Bachelor’s degree in Computer Science, Information Technology, or a related field
  • Excellent problem-solving skills and attention to detail.
  • Fluency in English – excellent verbal and written communication.  
  • Excellent communication and interpersonal skills, with the ability to articulate concepts and ideas clearly to stakeholders at all levels.
  • Flexibility and adaptability to meet deadlines and work in a growing team

Your technical capability

  • Proficiency in Azure data services, including Azure Data Factory, Azure SQL Database, Azure Databricks, and Azure Synapse Analytics. Experience with ETL tools and processes.
  • Experience with version control systems and CI/CD processes

 

  • Be part of ‘factories of the future’ as we build the infrastructure to support the digital economy, AI and cloud.  
  • Inclusive, diverse and values-driven working culture 
  • Hybrid working practices 
  • Awesome employee benefits (gifted share options, NEXTDC days, volunteer days, professional development, holistic wellbeing and mental health programs and more) 
  • Great opportunities to progress within our company (grow as we grow) 

 

Our mission is to continue building a diverse and inclusive workforce which represents the communities in which we operate.

Make NEXTDC your next move. 

Perks & Benefits Extracted with AI

  • Equity Compensation: Gifted share options
  • Employee benefits and wellbeing programs: NEXTDC days, volunteer days, holistic wellbeing and mental health programs and more

At NEXTDC we are building the heart of Australia’s high-tech future. We design, build and operate world class, next generation data centres, using cutting edge, environmentally efficient infrastructure to service the broad requirements of local and international companies.  We are an exciting ASX 100-listed technology company, operating 13 data centres across 7 major cities in Australia, with future national and international expansions in planning.  Here at NEXTDC, we know that our success depends on the talents of our people, and we foster a culture of continued learning and development. Our culture is built on collaboration and innovation, we are passionate about what we do, and we are committed to our mission to be the leading customer-centric data centre services company.  

View all jobs
Get hired quicker

Be the first to apply. Receive an email whenever similar jobs are posted.

Ace your job interview

Understand the required skills and qualifications, anticipate the questions you may be asked, and study well-prepared answers using our sample responses.

Data Engineer Q&A's
Report this job
Apply for this job