Senior/Lead Data Engineer - DataBricks

Senior/ Lead Data Engineer - Databricks+pyspark+SQL

About us

We turn customer challenges into growth opportunities.

Material is a global strategy partner to the world’s most recognizable brands and innovative companies. Our people around the globe thrive by helping organizations design and deliver rewarding customer experiences.

We use deep human insights, design innovation and data to create experiences powered by modern technology. Our approaches speed engagement and growth for the companies we work with and transform relationships between businesses and the people they serve.

Srijan, a Material company, is a renowned global digital engineering firm with a reputation for solving complex technology problems using their deep technology expertise and leveraging strategic partnerships with top-tier technology partners. Be a part of an Awesome Tribe

About the Sr Data Engineer/Technical Lead - Databricks role

As a Databricks Technical Lead you have the opportunity to build best in class data ingestion, processing and consumption patterns for business users operational and analytical needs. Working on this project you will gain the domain knowledge.

As a Sr Data Engineer/ Technical Lead – Databricks, you will do

• Plan, configure, deploy, and optimize Microsoft Azure based Data solutions.
• Collaborate with other team members to develop and enhance deliverables.
• Continuously improve team processes to ensure information is of the highest quality, contributing to the overall effectiveness of the team.
• Seast of industry changes, especially in the areas of cloud data and analytics technologies.
• Ability to simultaneously work and deliver on more than one project on Individual contributor role.
• Ability to work on multiple areas like Data pipeline ETL, Data modelling & design, writing complex SQL queries etc.
• Capable of planning and executing on both short-term and long-term goals individually and with the team.
• Provides best practices, direction for data engineering and design across multiple projects and functional areas.
• Partner with Data Engineers, Data architects, domain experts, data analysts and other teams to build foundational data sets that are trusted, well understood, aligned with business strategy and enable self-service.

About you

• 4+ years of experience Developing, deploying data solutions using Data Bricks, Azure platform and pyspark.
• Experience on designing Data pipelines (ETL/ELT), Datawarehouse and Data marts
• Hands-on expert with real-time data processing and analytics, data ingestion (batched and streamed), and data storage solutions
• Hands on Azure Analysis Services & Power BI and good to have experience on other tools
• Hands on experience with Data Factory, Data Lake Storage, Databricks, Data Explorer, Machine Learning, and Azure Synapse Analytics is good to have.
• Expert at creating data dissemination diagrams, data flow diagrams, data lifecycle diagrams, data migration diagrams, and data security diagrams etc.
• Demonstrated strength in data management, orchestration, access control, etc
• A proven expert in writing optimized SQL to deal with large data volumes.
• Hands on knowledge on Python along its main data libraries like Pandas, Numpy, Beautiful soup etc.

Why work for Material?

In addition to fulfilling, high-impact work, company culture and benefits are integral to determining if a job is a right fit for you. Here’s a bit about who we are and highlights around what we offer.

Who We Are & What We Care About

·       Material is a global company and we work with best-of-class brands worldwide. We also create and launch new brands and products, putting innovation and value creation at the center of our practice. Our clients are in the top of their class, across industry sectors from technology to retail, transportation, finance and healthcare.

·       Material employees join a peer group of exceptionally talented colleagues across the company, the country, and even the world. We develop capabilities, craft and leading-edge market offerings across seven global practices including strategy and insights, design, data & analytics, technology and tracking. Our engagement management team makes it all hum for clients.

·       We prize inclusion and interconnectedness. We amplify our impact through the people, perspectives, and expertise we engage in our work. Our commitment to deep human understanding combined with a science & systems approach uniquely equips us to bring a rich frame of reference to our work.

·       A community focused on learning and making an impact. Material is an outcomes focused company. We create experiences that matter, create new value and make a difference in people's lives.

 What We Offer

 ·       Professional Development and Mentorship.

·       Hybrid work mode with remote friendly workplace. (6 times in a row Great Place To Work Certified).

·       Health and Family Insurance.

·       40+ Leaves per year along with maternity & paternity leaves.

·       Wellness, meditation and Counselling sessions.