Senior Data Engineer (Enterprise and Game Solution Unit)

AI overview

Contribute to developing an integrated platform that processes critical data for public sector analytics, utilizing modern big data technologies and ensuring secure data environments.
  • Design and implement data ingestion pipelines for batch and streaming data
  • Configure and maintain data orchestration workflows (Airflow, NiFi) and CI/CD automation for data processes
  • Design and organize data layers within Data Lake architecture (HDFS, Iceberg, S3)
  • Build and maintain secure and governed data environments using Apache Ranger, Atlas, and SDX
  • Develop SQL queries and optimize performance for analytical workloads in Hive/Impala
  • Collaborate on data modeling for analytics and BI, ensuring clean schemas and dimensional models
  • Support machine learning workflows using Spark MLlib or Cloudera Machine Learning (CML)
  • Proven experience in building and maintaining large-scale data pipelines (batch and streaming)
  • Strong knowledge of data engineering fundamentals: ETL/ELT, data governance, data warehousing, Medallion architecture
  • Strong SQL skills for Data Warehouse data serving
  • Minimum 3 years of experience in Python or Scala for data processing
  • Hands-on experience with Apache Spark, Kafka, Airflow, and distributed systems optimization
  • Experience with Apache Ranger and Atlas for security and metadata management
  • Upper-Intermediate English proficiency

WILL BE A PLUS

  • Experience with Cloudera Data Platform (CDP)
  • Advanced SQL skills and Hive/Impala query optimization
  • BS in Computer Science or related field
  • Exposure to ML frameworks and predictive modeling

PERSONAL PROFILE

  • Ownership mindset and proactive approach
  • Ability to drive initiatives forward and suggest improvements
  • Team player with shared responsibility for delivery speed, efficiency, and quality
  • Excellent written and verbal communication skills

Build stunning career with Sigma Software! Find your dream job, send your CV and become one of us!

View all jobs
Ace your job interview

Understand the required skills and qualifications, anticipate the questions you may be asked, and study well-prepared answers using our sample responses.

Senior Data Engineer Q&A's
Report this job
Apply for this job