Senior Machine Learning Engineer - LLM Post-training

Employment Type: 6 Month Contract

We are seeking a highly skilled LLM Training Engineer to join our team, with a focus on developing and refining content for post-training phases of large language models (LLMs). The ideal candidate will play a crucial role in curating, generating, and managing high-quality datasets, prompts, and scenarios used for fine-tuning and optimizing LLM performance after the initial pre-training stages. You will collaborate closely with machine learning engineers, data scientists, and domain experts to ensure that LLMs continue to improve in their specific tasks and domains.

Key Responsibilities:

• Content Creation and Curation: Develop, refine, and curate high-quality content (code, text, prompts, dialogues, scenarios) for use in the post-training of large language models optimized for code generation.
• Fine-tuning Data: Design datasets for tasks such as instruction following, question answering, reasoning, conversational models, etc., to improve model accuracy, robustness, and generalization.
• Post-training Optimization: Collaborate with ML engineers to integrate the curated content into fine-tuning pipelines, ensuring that models are tailored to specific use cases.
• Evaluation and Benchmarking: Create scenarios to evaluate LLM performance and establish benchmarks for targeted improvements in different areas such as comprehension, creativity, factuality, and bias reduction.
• Feedback Loop Development: Set up human-in-the-loop feedback systems for continuous model improvement, and work closely with annotators or SMEs to enhance dataset quality.
• Data Quality Control: Monitor data quality, diversity, and relevance; identify and resolve gaps or biases in the training data.
• Collaboration: Work with cross-functional teams including product managers, data scientists, and engineers to align post-training content with business goals and technical requirements.
• Documentation: Write and maintain clear and detailed documentation on content curation methodologies, dataset specifications, and post-training processes.

Required Qualifications:

• Educational Background: Bachelor’s or Master’s degree in Computer Science, Data Science, Computational Linguistics, or a related field.
• Experience: 3+ years of experience working with large language models or machine learning frameworks, with a focus on post-training or fine-tuning.
• Programming Skills: Proficiency in Python and experience with ML frameworks such as PyTorch or TensorFlow.
• Data Handling: Experience in curating, cleaning, and managing large datasets for machine learning applications.
• Collaborative Mindset: Strong communication skills and the ability to work effectively in a cross-functional team.
• Problem Solving: Strong analytical and problem-solving abilities with a focus on improving model performance through targeted post-training interventions.

Preferred Qualifications:

• Experience working with LLM architectures such as GPT, BERT, T5, or similar.
• Knowledge of reinforcement learning from human feedback (RLHF).
• Knowledge of fine-tuning techniques such as Low-Rank Adaptation
• Familiarity with tools for annotation, labeling, and dataset management.
• Understanding of bias and fairness issues in AI, and experience in mitigating these through training.