Own the quality and intelligence of AI Agents in healthcare, impacting hundreds of thousands of patient conversations and pushing the boundaries of LLM technology.
About us
Talkie builds AI Agents for healthcare. Our technology handles patient-clinic communication end-to-end — across voice, web chat, and SMS — so that patients get access to care 24/7 and busy practices never miss a conversation.
Who uses Talkie?
Every month our AI Agents engage in over half a million conversations with real patients across US and Poland — over voice, web chat, and SMS. Our technology is trusted by primary and acute care, specialty practices, as well as private and public hospitals.
Who are we hiring?
We’re looking for a Conversational AI Specialist for our US product — someone who will own the quality and intelligence of our AI Agents from prompt to production. This is a role at the intersection of language, technology, and healthcare, where your work directly impacts hundreds of thousands of real patient conversations every month.
As a Conversational AI Specialist, you will:
Design, write, and continuously optimise prompts that power our AI Agents — making them natural, accurate, and reliable.
Analyse real patient–agent conversations end-to-end, identifying failure patterns, edge cases, and opportunities to improve agent behaviour.
Propose and implement technical solutions around function calling, tool use, context caching, and other LLM capabilities that make our agents smarter.
Build and run evaluation frameworks to test agent performance before and after changes — because every conversation is with a real patient and there is zero margin for error.
Create clear, structured documentation and customisation instructions so that agents can be tailored to each client’s specific workflows and needs.
Stay on top of the rapidly evolving LLM landscape — new models, techniques, and conventions — and bring the best ideas back to the team.
Work closely with the Product Manager (US market), engineering, and client teams to ensure agent quality across all deployments.
What will you achieve with us?
Shape the experience that hundreds of thousands of patients have when they reach out to their doctor — across every channel — and make it better every single day.
Push the boundaries of what LLM-powered AI agents can do in a highly regulated, real-world, multi-channel environment.
Build evaluation and quality systems for conversational AI that don’t exist yet — you’ll be creating the playbook.
Have a direct, measurable impact on patient access to healthcare in both the US.
This is a young and fast-moving field. We care less about years of experience and more about how you think, learn, and work.
Must have
LLM Fluency — You understand how LLMs work and have hands-on experience writing and iterating on prompts for production systems. More importantly, you learn fast — this field changes weekly and you keep up. You know the difference between a clever hack and a robust, reliable solution.
Analytical Rigour — You can review hundreds of conversations and extract patterns, failure modes, and actionable insights. But you don’t stop at the data — you validate your findings on calls with clients and the implementation team, and turn them into concrete improvements.
Communication & Collaboration — This is not a “sit in a cave and prompt all day” role. You’ll be on calls with clients, supporting the implementation team, explaining agent behaviour, and iterating with product and engineering. You communicate clearly, listen well, and can translate between technical and non-technical worlds.
Multitasking & Proactivity — You juggle multiple clients, agents, and improvement threads at once without dropping the ball. You don’t wait to be told what needs fixing — you spot issues, flag them, and propose solutions. You serve multiple stakeholders: the implementations team, clients, and ultimately the patients themselves.
Zero-Error Mindset — Our agents talk to real patients. You understand the weight of that responsibility and bring the precision and care it demands.
Human-Like Perfection — You obsess over making AI conversations indistinguishable from talking to the best human receptionist — or even better. You notice the tiny details that make a response feel natural: phrasing, pacing, empathy, context. You’re never “good enough” and always looking for that one small tweak that makes a real difference.
Drive & Curiosity — This field changes weekly. You’re the kind of person who reads release notes, experiments with new models on weekends, and brings fresh ideas to Monday’s standup.
English — You are fluent in English (at least C1), with strong written skills. Knowledge of another language is a plus, but not a must.
Shifted Hours — You are available to work 12:00–20:00 CET at least 3 days per week (optimally 5) to overlap with US Eastern Time business hours.
Great to have
Function Calling & Tool Use — Experience designing or working with LLM tool-use patterns, structured outputs, and API integrations.
Evaluation Frameworks — Familiarity with tools and approaches for testing conversational AI (e.g. Braintrust, DeepEval, LangSmith, or custom eval pipelines).
Multi-Channel AI Experience — Understanding of the nuances of AI across different channels: voice (latency, turn-taking, TTS/ASR), web chat (UX patterns, async flows), and SMS (brevity, compliance).
Documentation Skills — You can write clear, structured instructions that other team members and clients can follow without hand-holding.
Nice to have
Healthcare — Prior experience in healthcare, health-tech, or other regulated industries where accuracy and compliance matter.
Your goals as a Conversational AI Specialist
Short term — first 3 months
Develop a deep understanding of our AI Agent architecture, prompt patterns, client configurations, for our US market product.
Audit existing agent conversations, identify the top quality issues, and implement prompt improvements with measurable impact.
Take ownership of the agent testing and evaluation process — establish baselines and a repeatable QA workflow.
Get up to speed on our tooling (Langfuse, ClickUp, internal platforms) and the team’s ways of working.
Longer term — first 12 months
Own the end-to-end prompt and agent quality lifecycle across our US deployments.
Build and maintain a structured evaluation framework that catches regressions before they reach patients.
Develop comprehensive customisation documentation that enables scalable client onboarding.
Become the team’s go-to expert on LLM capabilities, staying ahead of model releases and new techniques.
Contribute to shaping our product roadmap with insights from conversation analysis and agent performance data.
What we offer
Competitive pay with benefits: employment contract or B2B contract.
A role with real purpose — we’re changing how patients access healthcare in the US.
Flexible working arrangements — remote, office, or hybrid.
Work equipment — Mac laptop, monitors, keyboard, mouse, and a setup for both office and home (including a comfy chair).
Benefits: private medical care, Multisport card, annual offsite, training budget.
Unique company culture based on mutual trust, honest feedback, and autonomy.
Working with cutting-edge AI technology on a product that’s genuinely useful to real people.
A structured onboarding process to help you find your feet.
What are we like as a company?
We are friendly, direct, and driven by curiosity and ambition. We value a growth mindset and see failure as a learning opportunity. Our culture is built on inquiry and critical thinking — asking questions is encouraged and thorough investigation is standard. We’re proactive problem-solvers who don’t shy away from challenges. When something’s broken, we acknowledge it, propose solutions, and fix it. And yes — we love to have fun too. Dancing till early hours, karaoke nights... we’ve got a long tradition of good times at Talkie!
Our recruitment process
Reflecting our culture, our recruitment process is respectful and collaborative. We aim to create a welcoming environment where you can be yourself and get to know us better. The entire process typically takes 2–3 weeks.
What to expect
Initial Contact — If your application meets our criteria, we’ll reach out via email or phone to schedule an interview.
First Interview (online) — 1 hour to assess your fit for the role and get to know each other.
Second Interview (online) — 1.5–2 hours including a practical, hands-on task.
Reference Check — We’ll ask for references and verify them.
Offer — We’ll make an offer or share detailed feedback.
Flexible Work Hours
Flexible working arrangements — remote, office, or hybrid.
Health Insurance
Benefits: private medical care, Multisport card, annual offsite, training budget.
Please mention you found this job on AI Jobs. It helps us get more startups to hire on our site. Thanks and good luck!
Understand the required skills and qualifications, anticipate the questions you may be asked, and study well-prepared answers using our sample responses.
Specialist Q&A's