Data Engineer

We are looking for a data engineer with technical abilities in data modelling, transformation and visualisation with proficient skills on data processing technologies and methods. Ideally people will possess experience in event-driven architecture and analytics modelling

Main responsibilities

Create data pipelines that combine internal and external data, across several APIs and databases (relational and non-relational) preparing and refining data for analysis.

• Ensure accuracy and integrity of data at all times. This includes testing and validating data pipelines.
• Data Analysis, Visualisation and Dashboards: Creating clear, compelling, and accurate visualisations and dashboards that make complex data easily understandable.
• Database Architecture and Optimisation: Developing database structures that are both efficient and scalable,
• Engaging with business stakeholders to assess their requirements, suggest outcomes, and translate business objectives into effective data visualisation solutions.

Requirements

• Python and SQL or related coding experience
• Proficiency with Git and CI/CD & DevOps tools
• Experience with scripting languages (Bash, shell scripting),
• Proficiency on ETL processes and data modelling
• Proficiency in visualisation tools such as Tableau and Power BI.
• Skilled with relational databases (SQL Server, Oracle or PostgreSQL).

Person Specification:

• Strong communication skills, written and verbal
• Effective problem-solving and critical-thinking abilities to tackle data-related challenges.
• Able to multitask, switch focus and prioritise tasks
• Can take ownership of any issues that come up and facilitates their resolution quickly using their own initiative

Beneficial Requirements:

• Commodities industry experience
• Experience with Docker and containers desirable
• Broad experience with cloud computing (e.g. Microsoft Azure or AWS) beneficial
• Experience of working in the commodities market or prior knowledge of a trading environment