Description:
We are looking for a Data Engineer who is adept at building and maintaining data engineering frameworks such as DBT, SQLMesh, and Coalesce within AWS EMR/Glue environments. This role involves hands-on development and optimization of data pipelines, ensuring they are efficient and aligned with the bank's data strategy.
Key Responsibilities:
· Experience with AWS data services, including AWS EMR, Glue, S3, Redshift, and other related technologies.
· Proven experience in building advanced data engineering frameworks on AWS EMR/Glue, Apache Spark and other AWS Data services technology.
· Strong understanding of writing efficient, reliable, and maintainable code to manage data workflows.
· Solid foundation in software engineering, including Object-Oriented Design (OOD) and design patterns.
· Optimize data processing pipelines for performance and scalability.
· Collaborate with data architects to implement best practices and improve data framework capabilities.
· Assist in resolving technical challenges and provide support to the data engineering team.
Minimum Qualifications:
· Bachelor’s degree in Computer Science, Engineering, or a related technical field.
· 3+ years of hands-on experience with AWS services, specifically EMR and Glue.
· Proficiency in building data engineering frameworks like DBT, SQLMesh, or Coalesce.
· Solid understanding of SQL, data modeling, and ETL processes. Preferred Qualifications:
· Experience with version control systems and CI/CD pipelines.
· Familiarity with additional AWS services and data analytics tools.
