We are looking for an experienced and talented Senior Data Engineer to join our partner's dynamic team. As a Senior Data Engineer, you will play a key role in designing, implementing, and maintaining our data architecture and infrastructure.
Responsibilities
- Design, implement, and maintain scalable and efficient data architectures to support the company's data needs.
- Develop and implement data models, ensuring data accuracy, consistency, and reliability.
- Create and optimize ETL processes to extract, transform, and load data from various sources into our data warehouse.
- Implement and enforce data quality standards, ensuring the accuracy and completeness of the data.
- Monitor and optimize the performance of data pipelines and queries.
- Create and maintain comprehensive documentation for data engineering processes, data models, and systems.
- Work closely with data analysts, data product man
Requirements
- 4+ years of proven professional data engineering experience.
- Proficient in SQL and experience with relational and column databases (e.g., PostgreSQL, Redshift respectively).
- Strong programming skills in Python.
- Experience with cloud platforms (AWS).
- Experience with data modeling, ETL processes, and data warehousing concepts.
- Strong problem-solving and analytical skills.
- Excellent communication and collaboration skills.
- Ability to work independently and as part of a team in a fast-paced environment.
Preferred Qualifications:
- Experience in the use of AWS Lambda, EKS, API Gateway, S3, CDK, Airflow, dbt, Git
- Familiarity with data governance and compliance standards.
- Knowledge of machine learning
