Position: Senior Data Engineer
Location: Gurgaon(Work from office 5days/week) / Bangalore(Hybrid)
Accepted Notice Period: Immediate – 30 Days
Years of Experience: 3 - 6 Years
Opportunity Type: Full time
**Note: This position is with one of our hiring partners
Skills Required
- Proficiency in Hadoop ecosystem technologies such as Hadoop, Hive, and Pyspark/Spark
- Strong understanding of data engineering concepts and practices
- Experience in designing, developing, and maintaining data pipelines and ETL processes
- Ability to optimize and tune data processing workflows for performance and scalability
- Knowledge of data modeling and schema design
- Familiarity with cloud platforms like AWS/GCP/Azure is a plus
- Excellent problem-solving skills and ability to work independently or in a team environment
Responsibilities
- Design, build, and maintain scalable and reliable data pipelines and systems
- Collaborate with cross-functional teams to gather and analyze requirements for data projects
- Develop and implement data processing solutions using Hadoop, Hive, and Spark
- Optimize and tune data workflows for performance, reliability, and efficiency
- Ensure data quality, integrity, and security throughout the data lifecycle
- Stay updated with the latest trends and technologies in the field of data engineering
- Provide technical guidance and mentorship to junior team members when required
About Pesto Tech:
Pesto is where software developers go to build their career path for the next 5 years. We don't just offer jobs; we provide unparalleled opportunities for your growth and success in the dynamic landscape of Tech Jobs.
