Lead Data Engineer
Important Information
Experience: more than 6 years
Job Mode: Full-time
Work Mode: Hybrid
Job Summary
-
Lead the design, development and optimization of scalable data pipelines and cloud-based data platforms.
-
Lead end-to-end data engineering initiatives leveraging Snowflake, Python and modern cloud platforms to build reliable and scalable data solutions.
-
Provide technical leadership within the Data Engineering team and ensure best practices across architecture, development, testing and deployment.
Responsibilities and Duties
-
Design, build and maintain scalable data pipelines and cloud-native analytics solutions using Snowflake and Azure services.
-
Develop and optimize data ingestion, transformation and processing workflows using Python and SQL.
-
Work with business stakeholders to understand high-value problems and translate them into data engineering tasks.
-
Partner with data scientists and analysts to ensure data availability, quality and usability.
-
Conduct code reviews and enforce engineering standards to maintain high-quality deliverables.
-
Monitor and improve the performance, reliability and cost efficiency of data systems.
-
Prototype data solutions and progress them from proof-of-concept to production.
-
Ensure effective collaboration across agile ceremonies, including planning, backlog refinement and feature workshops.
Qualifications and Skills
-
Bachelor’s/Master’s degree in Computer Science, Information Technology, or a related field.
-
6+ years of hands-on experience in data engineering, with exposure to cloud-based data solutions.
-
Strong proficiency in Python and SQL, including advanced development for ETL/ELT workloads.
-
Proven experience with Snowflake and cloud platforms, preferably Azure.
-
In-depth understanding of data modeling, structured and unstructured data, data quality and distributed data processing.
-
Ability to contribute to all stages of the solution lifecycle: design, infrastructure, development, testing, deployment and maintenance.
-
Solid understanding of cloud-native engineering principles and modern data architecture practices.
-
Excellent communication, collaboration and presentation skills for engaging with both technical and non-technical stakeholders.
Role-specific Requirements
-
Experience with modern data stack components, orchestration and CI/CD pipelines.
-
Experience working in agile environments and participating in collaborative engineering rituals.
-
Demonstrated ability to mentor, guide and influence engineering team members.
Technologies
-
Must have: Snowflake, Python, SQL, experience with modern cloud platforms
-
Nice to have: dbt, Apache Airflow, Prefect, CI/CD tools, automated testing frameworks
Skillset Competencies
-
Designing and maintaining scalable cloud-based data architectures
-
Building and optimizing ELT/ETL pipelines
-
Performance tuning for large-scale data processing
-
Orchestrating pipelines using modern workflow tools
-
Effective collaboration within international and virtual team environments
About Encora
Encora is a global company that offers Software and Digital Engineering solutions. Our practices include Cloud Services, Product Engineering & Application Modernization, Data & Analytics, Digital Experience & Design Services, DevSecOps, Cybersecurity, Quality Engineering, AI & LLM Engineering, among others.
At Encora, we hire professionals based solely on their skills and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.
