AI Software Engineer - Evaluation Platform

AI overview

Develop a full-stack platform for evaluating AI model outputs, enhancing productivity for researchers and engineers through innovative tools and systems.

Perplexity is an AI-powered answer engine founded in December 2022 and growing rapidly as one of the world’s leading AI platforms. Perplexity has raised over $1B in venture investment from some of the world’s most visionary and successful leaders, including Elad Gil, Daniel Gross, Jeff Bezos, Accel, IVP, NEA, NVIDIA, Samsung, and many more. Our objective is to build accurate, trustworthy AI that powers decision-making for people and assistive AI wherever decisions are being made. Throughout human history, change and innovation have always been driven by curious people. Today, curious people use Perplexity to answer more than 780 million queries every month–a number that’s growing rapidly for one simple reason: everyone can be curious. 

At Perplexity, evaluation is one of the hardest and most critical parts of building state-of-the-art AI. Each trained model and agentic workflow is matched by a rigorous effort to evaluate its performance in the real world, ensuring dependable and measurable impact.

We’re building a dedicated team to design the frameworks, interfaces, and systems that will become the backbone of how Perplexity measures and improves AI quality.  This team creates tools that directly multiply the productivity of our researchers and ML engineers. You’ll work hand-in-hand cross-functionally with AI researchers, ML engineers, and product managers to understand their workflows and deliver solutions that power every stage of our AI development pipeline.

Tech Stack: NextJS | TypeScript | Python | Postgres | Docker | AWS

Responsibilities

  • Building new 0-1 full-stack platform for debugging and evaluating LLM outputs.
  • Design intuitive front-end interfaces and robust back-end systems for monitoring the performance of AI product and AI systems.
  • Collaborate with researchers and engineers to understand their needs and deliver effective full-stack solutions.
  • Continuously improve existing tools and develop new features to meet evolving requirements.
  • Work closely with Engineers, Product, Design, and Data to ensure deep insights into Perplexity’s performance.

Qualifications

  • Strong experience in full-stack software development, with the ability to work across the full-stack necessary to build scientific research platform or production tools.
  • Self-motivated with a willingness to take ownership of tasks
  • Good quantitative understanding of data and visualization
  • Strong communication skills and the ability to work collaboratively in a team environment.
  • 3+ years of industry experience

Bonus

  • Bonus: Experience working with generative AI tools or LLMs.

The cash compensation range for this role is $200,000 - $270,000.

Final offer amounts are determined by multiple factors, including, experience and expertise, and may vary from the amounts listed above.

Equity: In addition to the base salary, equity may be part of the total compensation package.
Benefits: Comprehensive health, dental, and vision insurance for you and your dependents. Includes a 401(k) plan.

Perks & Benefits Extracted with AI

  • Health Insurance: Comprehensive health, dental, and vision insurance for you and your dependents.
  • 401(k) plan: Includes a 401(k) plan.

At Perplexity, we've experienced tremendous growth and adoption since publicly launching the world's first fully functional conversational answer engine just over a year ago. Our AI-powered search assistant has amassed 10 million monthly active users as of early 2024, with our mobile apps installed over 1 million times across iOS and Android devices. In 2023 alone, we served over 500 million queries from users around the globe. To support our rapid expansion, we've raised significant funding from some of the most respected investors in technology. In January 2024, we raised $73.6 million in a Series B round led by IVP, with participation from NVIDIA, Jeff Bezos' investment fund, NEA, Databricks, and other prominent firms. We followed that up with a $62.7 million Series B1 round in April 2024 led by Daniel Gross, valuing Perplexity at over $1 billion.Our prominent investor base includes IVP, NEA, Jeff Bezos, NVIDIA, Databricks, Bessemer Venture Partners, Elad Gil, Nat Friedman, Naval Ravikant, Tobi Lutke, and many other visionary individuals.    

View all jobs
Salary
$200,000 – $270,000 per year
Ace your job interview

Understand the required skills and qualifications, anticipate the questions you may be asked, and study well-prepared answers using our sample responses.

Software Engineer Q&A's
Report this job

This job is no longer available