Data Engineering Team Lead

As a Data Engineering Team Lead at Trainline you will... 🚄 

• A committed lead and coach to an agile team of polyglot Data Platform Engineers, building a cutting-edge data lakehouse platform on AWS using Kafka and cloud-native streaming technologies, Iceberg, Trinio, DataHub and Airflow. 
• Be a brilliant people manager for the Data Engineering function that motivates and engages their team to develop their skills and increase their impact. 
• Deliver the platform to enable deliver world class data products, including the latest in LLM and other AI technologies.  
• Lead the technical direction of the cross-functional team, making good choices on technologies and approach to get the biggest impact for the least risk. 
• Foster an obsession with quality and engineering excellence through automated, repeatable processes using CI/CD, TDD, BDD. 
• Drive incremental growth in dev ops maturity, building tools and practices that allow repeatable and efficient delivery of models to production, with strong governance in the workflow and continuous monitoring of models in production. 
• Own the operation of the products built by your team and continuously improve operation performance. 
• Lead and coach a self-organised Agile team and continuously improve agile maturity and delivery predictability. 

We'd love to hear from you if you... 🔍 

• Thrive in a diverse, open and collaborative environment. 
• Expert in JVM technologies (primarily Scala but ideally with a working knowledge of Clojure or Java) and a familiarity with other key languages (especially Python). 
• Expert in key data engineering platforms such as Kafka or other streaming technologies, data lakes (AWS S3, Iceberg, Parquet), analytics technologies (Trinio, Spark), automation technologies (Airflow, ML Flow) and data governance (DataHub). 
• People management and technical leadership experience. 
• Are passionate about agile software delivery with a track record of leading effective agile and lean software teams. 
• A consistent background in software development in high volume environments 
• Have a strong background in Dev Ops, deploying, managing and maintaining services using Docker, Terraform and AWS CLI tools to achieve infrastructure-as-code and automated deployments. 
• Have an excellent working knowledge of AWS services (EMR, ECS, IAM, EC2, S3, DynamoDB, MSK). 

Our Technology Stack 💻 

• Scala and Python 
• Kafka, Spark, Kafka Streams, Kinesis, Akka and KSQL 
• AWS, S3, Iceberg, Parquet, Glue and Spark/EMR for our Data Lake 
• Elasticsearch, Dynamodb and Redis 
• Starburst and Athena 
• Airflow and ML Flow 

Why should you jump on board?

We pay special attention to learning and development and organise quarterly company learning days as well as offering a learning budget that can be put towards resources of your choice. We will cover the costs of your professional subscriptions and give you access to our very own learning platform.

At Trainline, we care about the wellness of our employees. We host puppy therapy sessions, in-office yoga and run Mental Health First Aider training courses as well as having an Employee Assistance Program as one of our many company benefits.

We regularly throw fun social events such pub quizzes, karaoke nights and our large-scale Summer and Winter Festivals every year. Additionally, we love hosting meetups in our amazing event spaces and having the opportunity to support internal and external community groups.

We also hold companywide hackathons and our annual Trainline Tech Summit, which provides Trainliners with an opportunity to stand up and share their story, learnings, or new skills with their colleagues in a safe environment.

Our flexi-first approach

We believe in the importance of a healthy work-life balance and the value of a flexible workforce. Our flexi-first approach outlines our commitment to a hybrid way of working and our expectations of Trainliners. A key part of what makes Trainline special is our people and the value we get from the buzz and energy of our workplaces, and that’s why we’re proud to offer the best of both worlds. In practice this means in–office attendance at least 40% of the time over a 12-week period for all Trainliners. These in-office days are typically team led to help us connect, collaborate and create together.

Our Values 

• Think Big - We're building the future of rail 
• Own It - We care about every customer, partner and journey 
• Do Good - We make a positive impact 
• Travel Together - We're one team 

Interested in finding out more about what it's like to work at Trainline? Why not check out what our employees say about us on Glassdoor? You can also find out more information by following us on LinkedIn or our 'Life at Trainline' Instagram account.  

We value open expression at Trainline, we believe it’s the diversity of experience, backgrounds and perspectives of our employees that makes us who we are. We encourage everybody to play a part in changing the way people travel across the world.