- Serverless Infrastructure: Collaborate on AWS serverless design, development, and optimization for energy data pipelines; Tune components for performance, scalability, security and data privacy;
- Smart Device Integration: Integrate smart devices using AWS IoT Core with secure protocols; Troubleshoot and ensure perfect device connectivity;
- External Data Integration: Extract, standardize and enrich data from external partners through APIs; Ensure robust error handling and data validation;
- Database Management: Manage SQL and NoSQL databases, ensuring configuration and optimization; Implement data retention, backups and collaborate with analysts;
- Data Pipeline Design: Design end-to-end data pipelines with quality checks and monitoring; Improve pipelines to meet changing business needs;
- Data Lake Management: Architect scalable data lakes with partitioning, indexing and access controls; Maintain data lake integrity with data architects;
- Continuous Improvement: Stay up to date on data engineering trends and technologies; Optimize processes, improve performance and innovate in the platform architecture.
- Advanced programming skills in Python (preferably) and NodeJS;
- Experience in implementing AWS technologies;
- Experience in data engineering (e.g. AWS Glue, Amazon Athena, DBT, Spark);
- Experience in SQL databases (e.g. Amazon RDS and Amazon Aurora) and noSQL (e.g. Amazon DynamoDB);
- Knowledge of English;
- Flexibility in the learning process and strong critical sense;
- Understanding of networks, systems architecture and microservices architecture;
- Experience in developing RestFul APIs;
- Proven experience in Agile Scrum and/or Kanban projects.
The Devoteam Group works for equal opportunities, promoting its employees based on merit and actively fights against all forms of discrimination. We are convinced that diversity contributes to the creativity, dynamism and excellence of our organization. All of our vacancies are open to people with disabilities.
