Title: Data Engineer
Type: Full Time
Location: Hyderabad
Salary: Open (INR)
Requirements
Job Description
Apply strong expertise in developing, maintaining, and testing infrastructures, transforming data into a format that can be easily analyzed, and architecting solutions for data scientists that enable them to do their jobs.
▪Develop, construct, test and maintain architectures, such as databases and large-scale processing systems
▪Ensure architecture will support the requirements of the data scientists, the stakeholders, and the business.
▪Discover opportunities to acquire new data from other systems
▪Develop and improve data set processes for data modeling, mining, and production.
▪Employ a variety of languages and tools to marry systems together
▪Recommend and implement ways to improve data reliability, efficiency, and quality.
▪Collaborate with stakeholders including the Product owner, data science, and design teams to assist with data-related technical issues and support their data infrastructure needs.
▪Create data tools for analytics and data scientist team members that assist them in building and optimizing the products that help business achieving their goals.
▪Work with data and analytics experts to strive for greater functionality in data systems.
Technical expertise
▪BSc/MSc in Computer Science, Computer Science, Information Systems or related Technical Discipline
▪1-4 years’ experience in Data Engineer role (5-10 years for senior data engineer)
▪Deep knowledge of Python, SQL, and PySparkis required.
▪Experience working with data pipelines, architecture principles, batch and stream processing systems, and DataOps.
▪Experience working with large data sets, Azure cloud services including Azure Data Lake, Data factory, Databricks, Azure DevOps.
▪Background in programming in Python, Scala, C, C++, Java is beneficial.
Agile experience
▪Experience working in AI startup environment or organisationswith an agile culture
▪Professional attitude and service orientation; superb team player
Individual skills
▪Good written and verbal communication skillsalong with strong desire to work in cross-functional teams
Mindset & behaviours
▪Able to build a sense of trust and rapport that creates a comfortable & effective workplace; collaborative
▪Attitude to thrive in a fun, fast-paced, startup-like environment
▪Open minded to new approaches and learning
Key Skills:
- Deep knowledge of Python, SQL, and PySparkis required.
- Azure, ADB, ADF
Benefits
Note: If interested please send your updated resume to [email protected] and include your salary requirement along with your contact details with a suitable time when we can reach you. If you know of anyone in your sphere of contacts, who would be a perfect match for this job then, we would appreciate if you can forward this posting to them with a copy to us.
We look forward to hearing from you at the earliest!
