Lead Data Engineer

AI overview

Lead a small team of engineers while hands-on developing data solutions and managing delivery outcomes that enhance user experience across SEEK Group.

The Team

The AI & Analytics Data Products team builds high-quality data assets that empower teams across SEEK Group to gain valuable insights and enhance experiences for both individuals and organisations.

This position will report to the Engineering Manager and be part of a team made up of senior and mid-level data engineers. The team collaborates closely with internal peers, including staff, senior, and mid-level data engineers; analytics engineers; data solution designers; and data tracking specialists.

About the role 

A Lead Data Engineer is a hands-on technical role, contributing to the build and operation of technical solutions, but has additional leadership responsibility for people management and delivery outcomes.

Responsibilities 

Technology

  • Hands-on development and operational support duties alongside other data engineers.
  • Ongoing ownership of solutions you build to ensure they remain fit for purpose, meet customer needs, meet technology health metrics, and align with architectural guidelines.

Delivery

  • Driving customer focus and engagement to ensure we are delivering outcomes for our customers.
  • Setting goals, prioritising, planning, as well as contributing to budgeting and resourcing
  • Lead delivery and operation of data products, along with the data processing pipelines and orchestration to deliver them.

People

  • Direct line management of a small team of engineers
    • Performance review and management of individuals.
    • Professional growth via coaching and mentoring.

Skills and experience 

  • Proven years of experience in Data Engineering, delivering scalable, reliable, and production-grade data solutions on cloud platforms
  • Deep expertise in big data processing frameworks, ideally Apache Spark on Databricks or AWS EMR. Solid experience of both batch and streaming data pipelines
  • Strong software engineering background, with solid practices in CI/CD, automated testing, and version control
  • Advanced proficiency in SQL and database design, with a strong focus on performance optimisation and data modelling
  • Proven track record in infrastructure ownership, including deployment, system administration, monitoring, and operations (with a DevOps mindset)
  • Strong experience in coding with Python. Good experience with Scala is a bonus.
  • Solid experience with Cloud Data Warehouse like Databricks, Snowflake or Big Query
  • Deep understanding of cloud technology, preferably AWS with a focus on Big Data technologies such as EMR, Athena, Glue, and S3, as well as experience with IAM, Cloudformation, CDK, Lambda, SNS, SQS, SSM
  • Extensive background in supporting BI, Analytics, Data Science, and AI/ML initiatives
  • With at least 3+ years of experience in leading and mentoring team members, contributing to their technical growth and fostering a collaborative team culture
  • Demonstrated ability to own and deliver end-to-end solutions using Agile methodologies —driving initiative planning, iterative solution design, and stakeholder engagement to ensure alignment and value delivery

Permanent Perks
At SEEK we offer:

  • Annual Performance Bonus Plan
  • Support of flexible working, including a mix of office and work from home days depending on your role.
  • Paid and unpaid leave benefits including Personal Flexi Days and Volunteer Days, as well as the opportunity to purchase additional leave
  • Support for parents with 14 weeks paid primary carers leave and 2 weeks paid leave for partners
  • SEEK is committed to operating sustainably and is preparing for the impacts of climate change and the transition to a low-carbon future, and is working to minimise its environmental impacts which includes a long-term emissions reduction target of net zero by FY2050
  • The opportunity to work from anywhere for up to 4 weeks per financial year

At SEEK, we are passionate about fostering a culture of inclusion and wellbeing that embraces and values the diversity of our people. We are a purpose driven business that works with heart.

We know teams with diverse ideas, experiences and perspectives are more creative and are critical to ensuring effective delivery and innovating to enable our future success. As such, we welcome applications from people with diverse backgrounds and life experiences, especially as they relate to gender, sexual identity, culture, faith, disability and life stages. If you have the skills, curiosity and an adaptable mindset but don't meet every responsibility or qualification listed in this advertisement, please still get in touch with us.

Should you require any specific support or adjustments throughout the recruitment process and beyond, please advise us and we will be happy to assist.

For this role, only those candidates with the eligible right to work will be considered.

SEEK kindly requests no unsolicited resumes or approaches from recruitment agencies and will not be responsible for any associated fees.

Perks & Benefits Extracted with AI

  • Flexible Work Hours: Support of flexible working, including a mix of office and work from home days depending on your role.
  • Work from anywhere for up to 4 weeks: The opportunity to work from anywhere for up to 4 weeks per financial year
  • Paid Parental Leave: Support for parents with 14 weeks paid primary carers leave and 2 weeks paid leave for partners
  • Paid Time Off: Paid and unpaid leave benefits including Personal Flexi Days and Volunteer Days, as well as the opportunity to purchase additional leave

About SEEKSEEK’s portfolio of diverse businesses, which includes Jobstreet and JobsDB in Asia, make a positive impact on a truly global scale. Our purpose is to help people live more fulfilling and productive working lives and help organisations succeed. We create world-class technology solutions to connect more people to relevant employment, education, small business and volunteer opportunities. We have a culture of high-performance in our workplaces and celebrate the diversity of our employees who contribute to the success of our organisation.​Life at SEEKSEEK’s purpose is at the centre of everything we do. Our SEEK, which defines the way we work, is all about what makes us unique and a little bit different. Passion, Team, Delivery and Future are our principles that drive innovation and creativity. SEEK strives to support employee wellbeing by providing an amazing experience at work which led us to being named AFR BOSS Top 10 Best Place to Work 2023 In Tech (third year in a row). In Malaysia, where SEEK’s Asia HQ is located, we received four accolades at the TalentCorp Life at Work Awards 2023, including first runner-up for Best International Organisation and champion for Best CHRO. We are proud to work in an environment that's inclusive where everyone's unique ideas, experiences and perspectives are valued.​

View all jobs
Get hired quicker

Be the first to apply. Receive an email whenever similar jobs are posted.

Ace your job interview

Understand the required skills and qualifications, anticipate the questions you may be asked, and study well-prepared answers using our sample responses.

Lead Data Engineer Q&A's
Report this job
Apply for this job