Utilize cutting-edge NLP techniques within Haystack to transform enterprise data into actionable intelligence while collaborating with clients and teams.
As a Solution Engineer at deepset, you will apply cutting-edge NLP techniques to real-world enterprise problems. You will develop deep expertise across the full spectrum of NLP methods within Haystack including dense retrieval, Question Answering, generative QA, Summarization, RAG pipelines, and more and use deepset Cloud, our SaaS platform, to streamline workflows and transform customer data into actionable intelligence.
You will collaborate closely with our open-source and product teams to shape the best solutions for each engagement. This role sits at the intersection of professional services consultant, senior AI/NLP engineer, and trusted technical advisor.
Exemplary engagement: You will partner with data scientists from a leading aerospace corporation to enhance search functionality across pilot manuals. This means understanding their data and domain, evaluating methods (DPR, QA, TableQA) against their requirements, designing annotation workflows for expert labellers, continuously analysing incoming labels, training and iterating models, and driving step-by-step performance improvements until production targets are met.
deepset is the company behind Haystack, the leading open-source framework for building production-ready LLM applications, and deepset Cloud, the enterprise platform that brings AI-powered search and retrieval to the world's most demanding organisations. We sit at the intersection of cutting-edge AI research and real-world enterprise deployment — and we're growing fast.
Our Solution Engineers are the bridge between deepset's powerful AI technology and the customers who need it most. This is not a traditional sales-support role: you will be a trusted technical advisor, a hands-on builder, and a strategic partner to enterprise clients across the DACH region and beyond.
Customer Delivery & Solution Design
Show customers how to search for and extract information using Haystack and deepset Cloud, growing NLP awareness within their organisation
Understand each customer's domain data, use case, needs, and processes to craft the optimal solution and drive improvements to Haystack/deepset Cloud
Be the outward face to the customer: communicate to define goals and timelines, and report results throughout the engagement
Rapidly prototype cutting-edge NLP methods — dense retrieval (DPR), Question Answering, generative QA, TableQA, Summarization — and evaluate them against real customer data
Model Development & Data Engineering
Lead end-to-end technical delivery of AI solutions using Haystack, PEFT, Hugging Face Transformers, and deepset Cloud
Design annotation workflows for expert labellers and continuously analyse incoming labels to drive model improvement
Train and fine-tune large language models through large-scale data curation and optimisation to meet production performance targets
Contribute NLP/RAG-related improvements upstream to Haystack and other open-source libraries
Customer Success & Enablement
Partner directly with customer data scientists and engineering teams, guiding them from prototype through to production
Run technical workshops and enablement sessions; help customers build internal capabilities around Haystack and NLP best practices
Act as the internal voice of the customer, feeding domain knowledge and product feedback to our open-source and product teams
Track performance metrics and communicate progress clearly to both technical and non-technical stakeholders
Growth & Community
Define and pursue the skills needed to grow into an expert or team lead role as deepset scales
Contribute to deepset's technical blog, conference talks, and Haystack community presence
Work with Account Executives and the Product team to translate customer insights into roadmap decisions
Fluency in German (C1/C2 or native) and strong professional English — you will operate in both languages daily
5+ years of industry experience applying data science or NLP methods to real-world data
University degree in Computer Science or a comparable qualification
Proficiency in Python and strong working knowledge of ML/DL/NLP methods and recent model architectures (Transformers, LLMs, retrieval models)
Hands-on experience with Haystack, Hugging Face Transformers, PEFT, or comparable NLP frameworks
Experience managing customer-facing projects: defining scope, setting timelines, communicating results
Excellent communication skills with both technical (data scientist, ML engineer) and non-technical (business, C-suite) stakeholders
An intense desire to learn and a track record of rapidly acquiring new skills
Data science consulting experience and/or hands-on experience with data annotation workflows
Experience with deepset Cloud or other enterprise NLP/search platforms
Familiarity with dense retrieval (DPR), Question Answering, generative QA, TableQA, and Summarization methods
Understanding of RAG architectures and vector databases (e.g. Weaviate, Pinecone, OpenSearch)
Experience with model fine-tuning via PEFT (LoRA, QLoRA) and large-scale data curation
Contributions to open-source NLP libraries or a public technical profile (blog, talks, GitHub)
Aspiration to grow into a senior expert or team lead position as the Solutions team scales
Compensation
Competitive salary + equity (ESOP). We benchmark against above European AI companies.
Flexibility
Remote-first culture with optional access to Munich and Berlin offices. Flexible working hours.
Impact
Work on the frontier of enterprise AI. Your solutions will go into production at household-name companies.
Growth
Learning budget, conference attendance, access to the best minds in open-source NLP and LLMs.
Culture
Transparent, low-ego team. English as the working language, diverse and international colleagues.
Benefits
30 days PTO, company offsites, home office setup budget, and more.
Flexible Work Hours
Remote-first culture with optional access to Munich and Berlin offices. Flexible working hours.
Learning Budget
Learning budget, conference attendance, access to the best minds in open-source NLP and LLMs.
Paid Time Off
30 days PTO, company offsites, home office setup budget, and more.
deepset builds the Haystack framework and the deepset Cloud platform, enabling businesses to create and deploy advanced NLP and LLM applications. Our solutions make it easy for organizations of all sizes to harness the power of large language models, turning complex AI capabilities into real business impact. We empower developers by providing the tools they need to innovate and integrate AI solutions seamlessly.
Please mention you found this job on AI Jobs. It helps us get more startups to hire on our site. Thanks and good luck!
Understand the required skills and qualifications, anticipate the questions you may be asked, and study well-prepared answers using our sample responses.
Solution Engineer Q&A's