Data Engineer (Data Competency Center)

AI overview

Join a talented team to deliver advanced data solutions across industries, utilizing cloud technologies and big data platforms for real-time data processing and analytics.

Collaborate with clients and internal teams to clarify technical requirements and expectations
Implement architectures using Azure or AWS cloud platforms
Design, develop, optimize, and maintain squad-specific data architectures and pipelines
Discover, analyze, and organize disparate data sources into clean, understandable data models
Evaluate new tools for analytical data engineering or data science
Suggest and contribute to training and improvement plans for analytical data engineering skills, standards, and processes

3+ years of experience in data engineering
Hands-on experience with cloud computing services in data and analytics (AWS and/or Azure)
Experience with data modeling, reporting tools, data governance, and data warehousing
Proficiency in Python and PySpark for large-scale, distributed data processing
Advanced SQL skills and knowledge of big data databases (Snowflake, Redshift, etc.)
Strong knowledge of Databricks for big data analysis, transformations, and orchestration
Understanding of streaming approaches (Kafka, Spark Structured Streaming)
Familiarity with CI/CD and DevOps processes
Upper-Intermediate+ English

PERSONAL PROFILE:

Passion for data processing and continuous learning
Strong problem-solving skills and analytical thinking
Ability to mentor and guide team members
Effective communication and collaboration skills