Data Engineer Tech Lead | IT Payments

Natixis in Portugal is currently seeking a Data Engineer Tech Lead to join its Payments team, within the IT (Information Technologies) department. 

The project is being developed by a team that is present in Paris and Porto and is mainly responsible for the evolution and support of the product. Designing, developing, and implementing scalable and efficient data solutions for the payments domain.

Main responsibilities:

• Participate as a technical referent in developing code for processing and analyzing large amounts of data (e.g. unstructured tracking data, large full-text data sets, graph data, etc.).
• Design and implement highly scalable batch or real-time data processing workflows/components and products that make smart use of data to provide data-driven functionality (e.g. search services, recommender services, classification services, etc.), leveraging machine learning, Big Data technology, and distributed systems.
• Build, monitor and operate services delivery within the Natixis infrastructure, while enhancing data quality/utility and automating processes.
• Deploy solutions on cloud technologies, mainly GCP (Google Cloud Platform).
• Work in a cross-functional team and collaborate closely with Data Scientists and Analysts to support the (technical) design, implementation and evaluation of new algorithms, machine learning models and other data-driven features and services.
• Guide and support team members through technical issues and challenges related to data engineering and the uses tech stack.

Hard Skills:

• Degree in Information Technology or Computer Engineering, Computer Science or a related field.
• Between 3 to 9 years of experience in designing and implementing scalable software and data-driven services using Big Data technologies, data storages (e.g. relational databases, key-value stores), data warehouses, data lakes, data lakehouses and related data processing technologies, as well as programming languages such as Spark / Python / Java / Scala (for real-time and batch processing).
• Experience in building and optimizing data pipelines that process large datasets using Spark and cloud computing environment.
• Experience with working on cloud environments especially with data related services, for example BigQuery, BigTable, Dataproc, GCS, Composer, GKE on Google Cloud Platform and low-code/no-code (e.g YAML) approaches for ETL tools.
• Experience in Business Intelligence and SQL utilization on analyzing large datasets.
• Experience with workflow management platforms (like Airflow) and collaborative platforms (like Jupyter).
• Some experience in the domain of information retrieval, information extraction or machine learning/AI concepts and technologies is a plus.
• Good knowledge of Agile methodologies (SAFe / Scrum).
• In-depth understanding of software development processes, CI/CD methodologies, Devops overview and quality assurance practices (e.g. XLRelease/XLDeploy, Terraform, Jenkins, GIT, Bitbucket, etc.).
• Microsoft Azure and PowerBI is a plus.
• Familiarity with AI concepts and technologies is a plus but not a primary focus of the role.

Our workplace reflects the vibrant spirit of our locations, with initiatives such as a Green Transportation Budget, electric bikes and a flexible Hybrid Work Policy. We promote wellbeing through the Honolulu Wellness Club, a Prayer Room, a Lactation Room, and themed Villages that inspire creativity and collaboration. Through our ESG and DEI strategies, we are committed to being inclusive, caring, and fair, ensuring every voice is heard and valued.