Senior Machine Learning Engineer (Databricks)

Responsibilities

• Deliver independently Machine Learning Engineering projects using Databricks, leveraging its Unified Analytics Platform
• Engage directly with clients to understand their business objectives and translate them into technical requirements.
• Collaborate with cross-functional teams to integrate AI/ML solutions into the company's product offerings.
• Provide thought leadership within the team, fostering a culture of continuous learning and innovation.
• Stay abreast of industry trends and advancements in AI/ML to ensure our solutions remain cutting-edge.

General qualifications

• 7+ years relevant data science / machine learning engineering experience.
• Hands-on experience in Databricks, Python, Spark, SQL.
• Fluent English speaker with excellent communication skills, comfortable in client-facing roles.
• Bachelor's or Master's degree preferably in Computer Science, Software Engineering, Data Science, Information Technology or a related field.
• Hands-on experience with generative AI/LLM projects.
• Affinity to building product / product-oriented vision

Technical requirements

• Strong Python and SQL skills
• Databricks Platform knowledge: Delta Lake, Notebooks, Workflows, Connect, MLFlow
• Knowledge of at least one of the cloud platforms (Azure / AWS / GCP), with a preference for experience in Azure Databricks.
• Knowledge of data modeling, schema design, data warehousing concepts.
• Strong understanding of machine learning algorithms and techniques.
• Relevant knowledge about data pipelines using a variety of source and target platforms (eg: Databricks, SQL databases, big data stores, NoSQL)
• Manage and optimize Databricks clusters for performance and cost efficiency
• Version control: Github / BitBucket / Azure DevOps

Nice to have

• Knowledge of stream processing, API handling, message queuing
• ML Lifecycle management (e.g.: MLFlow / wandb)
• Python based web frameworks (e.g.: Streamlit / FastAPI / Flask)
• Automatization pipelines on cloud (e.g.: Azure Functions, AWS Lambda, Databricks notebook jobs)

Why us?

• Diverse projects: In each assignment there is always something new either on the technical or on the business side that helps you grow.
• Cutting edge technology: You will work with many of the most up-to-date technologies and tools.
• Strong and motivating team: We stress the importance of working together in tight-knit, cohesive teams in which members help each other to reach the common goal.
• Work-life balance: We help you to feel good individually as well, and coordinate work so as it should align with your leisure activities.
• Professional development: There are team gatherings on a regular schedule where colleagues can share their knowledge, and have deep technical discussions.
• Focus on company culture: In addition to our business and professional achievements we are proud of the social bonding in the company, which is based on mutual respect and helping one another.
• Personal mentoring: You will have your own mentor (just like everybody at Hiflylabs) who you can turn to with professional issues as well as with personal ones.