Role Summary:
We are seeking a highly skilled and experienced Data Developer to join our Data Engineering Team. The successful candidate will be responsible for managing data operations, designing and implementing web crawling, ETL processes and API connections. They will work closely with other team members to develop efficient and scalable solutions to support our data-driven business.
Key Responsibilities:
- Design and implement web crawling and API connection solutions
- Develop and maintain ETL processes for large datasets
- Collaborate with cross-functional teams to identify and resolve data-related issues
- Build and maintain data pipelines and data storage systems
- Monitor and optimize data performance and reliability
- Ensure data quality and integrity across all systems
- Stay up-to-date with emerging trends and technologies in data engineering
Desired Skills and Experience:
- Experience in Python programming language
- Background in PostgreSQL database management system
- Proficiency in Docker containerization technology
- Familiarity with cloud components and services such as AWS, Azure or Google Cloud Platform
- Knowledge of data modeling and database design principles
- Ability to write efficient SQL queries and optimize database performance
- Excellent problem-solving skills and attention to detail
- Strong communication and collaboration skills
Additional Details:
The Data Developer will work with Docker, Dev Containers, Cloud Components and Services to develop scalable and efficient data solutions. They will report to the Data Engineering Team Lead and collaborate with other developers, data analysts, and stakeholders across the organization. The ideal candidate will have a passion for data engineering and a desire to continuously learn and improve their skills.
