Kyivstar Big Data team is looking for talented Data Engineer- specialist in the field of developing software solutions, with practical skills in working with Cloud stack (AWS preferred), Open Source tools of the Hadoop ecosystem, understanding of ETL processes and specialties of implementing data pipelines, which include machine learning.
Necessary skills:
2+ years of experience in software development
Strong knowledge of Python
Strong knowledge of SQL
Strong knowledge of CI/CD principles
Experience in process design and developing ETL processes for ML pipelines
Experience with programming in Python or Scala for Apache Spark
Experience in test-driven development and integration testing
Would be a plus:
Experience with Spark ML and Python ML libraries
Experience with Apache NiFi, Airflow
Experience with Cloud Technologies
Experience with Docker and Kubernetes
Familiarity with Hortonworks or Cloudera distributions
Experience with performance testing and tuning
Responsibilities
Develop ETL processes for ML pipelines
Creation of automated tooling and models deployment
Automate processes of model quality monitoring
Develop automatic model refresh procedures to avoid “staleness”
Optimize pipelines and review Python/Spark code
We offer:
Working with huge amounts of data at the largest operator in Ukraine
Hands on experience with Big Data technologies and tools
Great diversity of tasks and projects to utilize your knowledge and skills; flexibility in tools and approaches
Opportunity to grow within the team of talented data engineers
