Data Engineer

The role:

We are looking for a Data Engineer to establish our internal data engineering capability and play a key role in designing and developing the data infrastructure and systems, ensuring that our data pipelines are reliable, scalable, and efficient.

Reporting into the Software Team Lead, you will be responsible for designing data infrastructure to support modelling and data analytics, with strong competence in Python, and work with stakeholders to understand their data needs and help design data solutions.

The Technology team within Prevail underpins all of our mission focused teams. No two days are the same and the real-world problems we seek to solve are complicated. You will get the opportunity to interact with a wide range of datasets and support both the wider tech team and mission teams turning this data into insights to drive our customers decision making. The team structure is flat with a network centric approach to leadership. A small team, we rely on strong communication and the ability to mutually support each other whilst working at pace.

Requirements

Responsibilities/ deliverables:

These are the key things that you are responsible for delivering within your role. There will be activities and tasks in addition to this list that are expected from you but the majority of your time will be:

·       Receiving large datasets and transforming them to enable our mission teams to rapidly exploit the data.

·       Identifying improvements to our current data processes and implementing solutions.

·       Implementing data flows to connect operational systems, data for analytics, and business intelligence systems

·       Creation and development of data pipelines

·       Documenting source-to-target mappings

·       Re-engineering manual data flows to enable scaling and repeatable use

·       Support the build of data streaming systems

·       Build and maintain ETL scripts and pipelines and code to ensure the ETL process performs optimally and ensures data is accurate and easy to use

·       Develop business intelligence reports that can be used for multiple audiences

·       Build accessible data for analysis

·       Automate data processing tasks and workflows

·       Collaborate with cross functional teams to advocate for high-quality data solutions

You:

You will have previous proven experience:

·       Building, modelling, and maintaining data pipelines

·       With a range of Amazon Web Service products and technologies such as EC2, S3, Lambda, ECS and Redshift

·       Designing data infrastructure to support modelling and data analytics

·       As an AWS Solutions Architect or Lead, or similar

·       Strong Python experience or other object oriented or a functional programming language such as Java, Scala, C#, or R

·       Data warehousing – building operation ETL data pipelines across several sources, and constructing relation and dimensional data models

·       Built and maintained scalable infrastructure through IaC frameworks (e.g., Terraform, CloudFormation) and CI/CD workflows

·       If you have previous exposure to geospatial data, that would be advantageous but is not a requirement for the position.

·       Familiarity with Apache Spark or Databricks

·       Excellent communication and collaboration skills

Benefits

About Prevail Partners

Prevail Partners delivers strategic advice, intelligence, specialist capabilities, and managed services to clients ranging from governments and multinational corporations to non-governmental organisations. Our services span Europe, the Middle East, and Africa.

We are united by a shared mission: to deliver Unrelenting Excellence in everything we do. That means operating with integrity, curiosity, accountability, and care.

What We Offer

At Prevail, we believe in recognising and rewarding our people. Our benefits are designed to support your wellbeing, development, and life beyond work:

• Gym Access & Wellness Discounts: Access to discounted memberships and gym facilities for London-based employees
• Cycle to Work Scheme: Tax-efficient savings on bikes and accessories, available post-probation
• Season Ticket Loans: Interest-free loans for annual commuting costs
• Private Medical Insurance: Fully funded cover through Vitality Health after two years’ service
• Employee Assistance Programme (EAP): Confidential mental health, legal, financial and wellbeing support via Health Hero
• Enhanced Leave Entitlements: Supporting you through important life moments with flexibility
• Professional Development Days: Dedicated time off to focus on your personal and professional growth through training, courses, or self-directed learning
• Pension Scheme: Access to a flexible defined contribution pension through NatWest Cushon, with a salary exchange option. Contributions start at 5% employee and 3% employer, with the potential to adjust based on your preferences and financial goals.
• Culture & Development: A values-led culture with regular social events, collaborative initiatives, and meaningful opportunities for personal and professional development