LLM / SLM Full‑Stack Developer

AI overview

Design and implement production AI applications using ensemble strategies across LLMs and SLMs, with a focus on Agentic AI workflows and robust integration.
Our Company
 
We’re Hitachi Digital, a company at the forefront of digital transformation and the fastest growing division of Hitachi Group. We’re crucial to the company’s strategy and ambition to become a premier global player in the massive and fast-moving digital transformation market.
 
Our group companies, including GlobalLogic, Hitachi Digital Services, Hitachi Vantara and more, offer comprehensive services that span the entire digital lifecycle, from initial idea to full-scale operation and the infrastructure to run it on. Hitachi Digital represents One Hitachi, integrating domain knowledge and digital capabilities, and harnessing the power of the entire portfolio of services, technologies, and partnerships, to accelerate synergy creation and make real-world impact for our customers and society as a whole.
 
Imagine the sheer breadth of talent it takes to unleash a digital future. We don’t expect you to ‘fit’ every requirement – your life experience, character, perspective, and passion for achieving great things in the world are equally as important to us.
 

About Us

Hitachi Digital builds secure, scalable AI applications for global OpCos, with a focus on Agentic AI and enterprise governance. We leverage GCP services (Vertex AI, Agent Workspace), robust data foundations, and model guardrails to deliver business outcomes at scale.

Role Overview

We’re seeking a LLM Full‑Stack Developer who can design, build, and operate production AI applications that combine front‑end product craftsmanship with backend/LLMOps rigor. You will implement ensemble strategies across LLMs and SLMs (small language models), develop Agentic AI workflows, and integrate RAG, evaluation, and guardrails into full‑stack experiences. Gemini Enterprise experience is nice to have; strong GCP/Vertex AI skills are expected.

Key Responsibilities

  • Product & Front-End
  • Build responsive, accessible web UIs for AI features (chat, copilot sidebars, inline recommendations).
  • Implement human-in-the-loop UX and telemetry hooks.
  • Backend, LLM Integration & RAG
  • Implement ensemble LLM/SLM pipelines with fallback/guarded execution.
  • Build RAG flows: ingestion, embeddings, vector search, grounding, attribution.
  • Expose secure APIs and integrate with enterprise systems.
  • Agentic AI & Orchestration
  • Design multi-agent workflows with tool-use policies and memory strategies.
  • Use Vertex AI Agent Builder/Workspace for orchestration.
  • Quality, Safety & Observability
  • Instrument LLMOps evaluation harnesses, monitoring, red-teaming.
  • Implement guardrails, explainability, and audit logs.
  • Performance & Cost
  • Optimize prompts, retrieval, caching, batching, autoscaling.

Required Qualifications

  • Bachelor’s/Master’s in CS, AI/ML, or related field.
  • 6+ years full-stack development; 3+ years building LLM applications.
  • Experience with ensemble LLM/SLM approaches.
  • Hands-on with Agentic AI patterns.
  • Strong GCP/Vertex AI skills.
  • Proficiency in Python and TypeScript/Node.js.
  • Expertise with vector DBs, embeddings, RAG.
  • UI experience with React or similar.

Preferred Qualifications

  • Experience with Gemini Enterprise / Agent Workspace.
  • Familiarity with LangChain/Graph and knowledge graphs.
  • Exposure to SLM distillation/fine-tuning.
  • Google Cloud certifications.

Key Competencies

  • Product mindset with strong UX quality bar.
  • Systems thinking across data/models/agents.
  • Security & compliance awareness.
  • Strong communication across global teams.

Success Metrics (first 6–12 months)

  • Launch 2+ LLM features with measurable impact.
  • Achieve >20–30% response quality or latency improvements.
  • Establish evaluation dashboards and telemetry.
  • Document guardrails and explainability to governance standards.

What You’ll Work With

  • GCP: Vertex AI, Agent Builder/Workspace, Vector Search, Cloud Run/GKE, IAM.
  • Vector DBs, embeddings, RAG, optional knowledge graphs.
  • Python, Node.js/TypeScript, React, CI/CD, observability tools.
#LI-MS3
 
About us
 
We’re a global, 1000-stong, diverse team of professional experts, promoting and delivering Social Innovation through our One Hitachi initiative (OT x IT x Product) and working on projects that have a real-world impact. We’re curious, passionate and empowered, blending our legacy of 110 years of innovation with our shaping our future. Here you’re not just another employee; you’re part of a tradition of excellence and a community working towards creating a digital future.
 

 

Fostering innovation through diverse perspectives

Hitachi is a global company operating across a wide range of industries and regions. One of the things that sets Hitachi apart is the diversity of our business and people, which drives our innovation and growth.

We are committed to building an inclusive culture based on mutual respect and merit-based systems. We believe that when people feel valued, heard, and safe to express themselves, they do their best work.

How we look after you

We help take care of your today and tomorrow with industry-leading benefits, support, and services that look after your holistic health and wellbeing. We’re also champions of life balance and offer flexible arrangements that work for you (role and location dependent). We’re always looking for new ways of working that bring out our best, which leads to unexpected ideas. So here, you’ll experience a sense of belonging, and discover autonomy, freedom, and ownership as you work alongside talented people you enjoy sharing knowledge with.

We’re proud to say we’re an equal opportunity employer and welcome all applicants for employment without attention to race, colour, religion, sex, sexual orientation, gender identity, national origin, veteran, age, disability status or any other protected characteristic. Should you need reasonable accommodations during the recruitment process, please let us know so that we can do our best to set you up for success.

Hitachi drives Social Innovation Business, creating a sustainable society with data and technology. We will solve customers' and society's challenges with Lumada solutions leveraging IT, OT (Operational Technology) and products. Hitachi is becoming a C...

View all jobs
Ace your job interview

Understand the required skills and qualifications, anticipate the questions you may be asked, and study well-prepared answers using our sample responses.

Full-Stack Engineer Q&A's
Report this job
Apply for this job