Senior Data Engineer

AI overview

Design and maintain scalable data pipelines using modern technologies like Spark and Apache Iceberg while ensuring data quality and collaborating with various stakeholders.

Responsibilities:

  • Design and maintain scalable data pipelines with Spark Structured Streaming.
  • Implement Lakehouse architecture with Apache Iceberg.
  • Develop ETL processes for data transformation.
  • Ensure data integrity, quality, and governance.
  • Collaborate with stakeholders and IT teams for seamless solution integration.
  • Optimize data processing workflows and performance.

Requirements:

  • 5+ years in data engineering.
  • Expertise in Apache Spark and Spark Structured Streaming.
  • Hands-on experience with Apache Iceberg or similar data lakes.
  • Proficiency in Scala, Java, or Python.
  • Knowledge of big data technologies (Hadoop, Hive, Presto).
  • Experience with cloud platforms (AWS, Azure, GCP) and SQL.
  • Strong problem-solving, communication, and collaboration skills.

Location: Ra'anana

 Start Date: Immediate

 

Careers at TLVTech. Find Great Talent with Career Pages. | powered by SmartRecruiters | Find Great Talent with a Career Page.

View all jobs
Ace your job interview

Understand the required skills and qualifications, anticipate the questions you may be asked, and study well-prepared answers using our sample responses.

Senior Data Engineer Q&A's
Report this job
Apply for this job