We are looking for a talented Technical Lead - Data Engineering with expertise in Databricks to lead our data team. In this role, you will oversee the design, development, and implementation of scalable data pipelines and analytics solutions using Databricks. You will collaborate closely with data scientists, analysts, and other stakeholders to deliver high-quality data solutions and drive data-driven decision-making processes.
You will collaborate closely with data scientists, analysts, and other stakeholders across the United States, Vietnam, and Mexico to deliver high-quality data solutions and drive data-driven decision-making processes.
Key Responsibilities:
Lead the design and architecture of data solutions using Databricks, ensuring scalability, reliability, and performance.
Mentor and guide a team of data engineers, providing technical leadership and fostering a culture of innovation and excellence.
Design and implement robust ETL processes and data pipelines on the Databricks platform.
Collaborate with cross-functional teams to define data requirements and translate them into technical solutions.
Optimize Databricks jobs and clusters for efficiency and cost-effectiveness, monitoring performance and troubleshooting issues as needed.
Ensure data quality and integrity across various data sources and platforms.
Stay updated with industry trends and advancements in Databricks and related technologies, recommending and implementing best practices.
Lead technical discussions and present solutions to stakeholders, including senior management.
Warehouse Management: Experience with warehouse operations and management systems, integrating warehouse data into broader analytics frameworks.
Work closely with warehouse teams to optimize data flows and ensure seamless integration with Databricks-based analytics solutions.
Provide guidance on warehouse data integration strategies, ensuring alignment with overall data architecture goals.
Experience: Minimum of 8 years in data engineering roles, with significant hands-on experience in Databricks and warehouse management systems.
Bachelor’s degree in Computer Science, Engineering, or a related field. Advanced degrees or certifications in data engineering or warehouse management are a plus.
Proficiency in designing and implementing scalable data pipelines and ETL processes using Databricks.
Strong leadership and mentoring skills, with a proven track record of leading successful data engineering teams.
Familiarity with warehouse management systems and their integration with analytical platforms.
Proven experience in data warehouse projects, with successful track record
Excellent problem-solving abilities and the capacity to manage multiple projects simultaneously.
