Senior Solution Engineer

TLDR

Utilize cutting-edge NLP techniques within Haystack to transform enterprise data into actionable intelligence while collaborating with clients and teams.

TL;DR

As a Solution Engineer at deepset, you will apply cutting-edge NLP techniques to real-world enterprise problems. You will develop deep expertise across the full spectrum of NLP methods within Haystack including dense retrieval, Question Answering, generative QA, Summarization, RAG pipelines, and more and use deepset Cloud, our SaaS platform, to streamline workflows and transform customer data into actionable intelligence.


You will collaborate closely with our open-source and product teams to shape the best solutions for each engagement. This role sits at the intersection of professional services consultant, senior AI/NLP engineer, and trusted technical advisor.


Exemplary engagement: You will partner with data scientists from a leading aerospace corporation to enhance search functionality across pilot manuals. This means understanding their data and domain, evaluating methods (DPR, QA, TableQA) against their requirements, designing annotation workflows for expert labellers, continuously analysing incoming labels, training and iterating models, and driving step-by-step performance improvements until production targets are met.

Why deepset

deepset is the company behind Haystack, the leading open-source framework for building production-ready LLM applications, and deepset Cloud, the enterprise platform that brings AI-powered search and retrieval to the world's most demanding organisations. We sit at the intersection of cutting-edge AI research and real-world enterprise deployment — and we're growing fast.


Our Solution Engineers are the bridge between deepset's powerful AI technology and the customers who need it most. This is not a traditional sales-support role: you will be a trusted technical advisor, a hands-on builder, and a strategic partner to enterprise clients across the DACH region and beyond.

What you will do

Customer Delivery & Solution Design

  • Show customers how to search for and extract information using Haystack and deepset Cloud, growing NLP awareness within their organisation

  • Understand each customer's domain data, use case, needs, and processes to craft the optimal solution and drive improvements to Haystack/deepset Cloud

  • Be the outward face to the customer: communicate to define goals and timelines, and report results throughout the engagement

  • Rapidly prototype cutting-edge NLP methods — dense retrieval (DPR), Question Answering, generative QA, TableQA, Summarization — and evaluate them against real customer data


Model Development & Data Engineering

  • Lead end-to-end technical delivery of AI solutions using Haystack, PEFT, Hugging Face Transformers, and deepset Cloud

  • Design annotation workflows for expert labellers and continuously analyse incoming labels to drive model improvement

  • Train and fine-tune large language models through large-scale data curation and optimisation to meet production performance targets

  • Contribute NLP/RAG-related improvements upstream to Haystack and other open-source libraries


Customer Success & Enablement

  • Partner directly with customer data scientists and engineering teams, guiding them from prototype through to production

  • Run technical workshops and enablement sessions; help customers build internal capabilities around Haystack and NLP best practices

  • Act as the internal voice of the customer, feeding domain knowledge and product feedback to our open-source and product teams

  • Track performance metrics and communicate progress clearly to both technical and non-technical stakeholders


Growth & Community

  • Define and pursue the skills needed to grow into an expert or team lead role as deepset scales

  • Contribute to deepset's technical blog, conference talks, and Haystack community presence

  • Work with Account Executives and the Product team to translate customer insights into roadmap decisions

Requirements

  • Fluency in German (C1/C2 or native) and strong professional English — you will operate in both languages daily

  • 5+ years of industry experience applying data science or NLP methods to real-world data

  • University degree in Computer Science or a comparable qualification

  • Proficiency in Python and strong working knowledge of ML/DL/NLP methods and recent model architectures (Transformers, LLMs, retrieval models)

  • Hands-on experience with Haystack, Hugging Face Transformers, PEFT, or comparable NLP frameworks

  • Experience managing customer-facing projects: defining scope, setting timelines, communicating results

  • Excellent communication skills with both technical (data scientist, ML engineer) and non-technical (business, C-suite) stakeholders

  • An intense desire to learn and a track record of rapidly acquiring new skills

Nice to have

  • Data science consulting experience and/or hands-on experience with data annotation workflows

  • Experience with deepset Cloud or other enterprise NLP/search platforms

  • Familiarity with dense retrieval (DPR), Question Answering, generative QA, TableQA, and Summarization methods

  • Understanding of RAG architectures and vector databases (e.g. Weaviate, Pinecone, OpenSearch)

  • Experience with model fine-tuning via PEFT (LoRA, QLoRA) and large-scale data curation

  • Contributions to open-source NLP libraries or a public technical profile (blog, talks, GitHub)

  • Aspiration to grow into a senior expert or team lead position as the Solutions team scales

Benefits

Compensation

Competitive salary + equity (ESOP). We benchmark against above  European AI companies.

Flexibility

Remote-first culture with optional access to Munich and Berlin offices. Flexible working hours.

Impact

Work on the frontier of enterprise AI. Your solutions will go into production at household-name companies.

Growth

Learning budget, conference attendance, access to the best minds in open-source NLP and LLMs.

Culture

Transparent, low-ego team. English as the working language, diverse and international colleagues.

Benefits

30 days PTO, company offsites, home office setup budget, and more.

Benefits

Flexible Work Hours

Remote-first culture with optional access to Munich and Berlin offices. Flexible working hours.

Learning Budget

Learning budget, conference attendance, access to the best minds in open-source NLP and LLMs.

Paid Time Off

30 days PTO, company offsites, home office setup budget, and more.

deepset builds the Haystack framework and the deepset Cloud platform, enabling businesses to create and deploy advanced NLP and LLM applications. Our solutions make it easy for organizations of all sizes to harness the power of large language models, turning complex AI capabilities into real business impact. We empower developers by providing the tools they need to innovate and integrate AI solutions seamlessly.

View all jobs
Ace your job interview

Understand the required skills and qualifications, anticipate the questions you may be asked, and study well-prepared answers using our sample responses.

Solution Engineer Q&A's
Report this job
Apply for this job