AI Kernel Engineer

Burlingame , United States
full-time

AI overview

Enable efficient AI kernel development and optimization on Quadric's unique GPNPU architecture, tackling performance profiling challenges and enhancing toolchain capabilities.

Quadric has created an innovative general purpose neural processing unit (GPNPU) architecture. Quadric's co-optimized software and hardware is targeted to run neural network (NN) inference workloads in a wide variety of edge and endpoint devices, ranging from battery operated smart-sensor systems to high-performance automotive or autonomous vehicle systems. Unlike other NPUs or neural network accelerators in the industry today that can only accelerate a portion of a machine learning graph, the Quadric GPNPU executes both NN graph code and conventional C++ DSP and control code.

Role:

The AI Kernel Engineer in Quadric plays the key role to enable a large number of AI kernels/operators to run efficiently on the Quadric platform. The AI Kernel Engineer at Quadric will [1] develop a highly efficient Quadric kernel library for a variety of AI/LLM models; [2] analyze the performance and optimize the kernel for different hardware configurations; This senior technical role demands deep knowledge of hardware architecture, compiler toolchain and optimization techniques.


Responsibilities:

  • Develop AI/LLM kernels/operators on Quadric platform for efficient inference
  • Optimize the kernel performance for different hardware configurations and workloads
  • Profile and analyze kernel performance in terms of compute, data and parallelism; identify micro-architecture and software bottlenecks and provide optimization solutions
  • Optimize kernel C/C++ codes, maximize hardware utilization
  • Make Improvement to Quadric toolchain, compiler and runtime
  • Provide technical support and documents to customers and developer community

Requirements

  • Bachelor’s or Master’s in Computer Science and/or Electric Engineering.
  • 5+ years of experience in AI kernel development and optimization
  • experience with model and kernel inference performance profiling
  • experience with at least one of the following compute development: CUDA, DSP, NEON, Triton-lang
  • Proficiency in C/C++ and Python, experience with assembly language a plus
  • Demonstrate good capability in problem solving, debug and communication

Benefits

  • Health Care Plan (Medical, Dental & Vision)
  • Retirement Plan (401k, IRA)
  • Life Insurance (Basic, Voluntary & AD&D)
  • Paid Time Off (Vacation, Sick & Public Holidays)
  • Family Leave (Maternity, Paternity)
  • Short Term & Long Term Disability
  • Training & Development
  • Work From Home
  • Free Food & Snacks
  • Stock Option Plan

Perks & Benefits Extracted with AI

  • Free Meals & Snacks: Free Food & Snacks
  • Health Insurance: Health Care Plan (Medical, Dental & Vision)
  • Other Benefit: Training & Development
  • Paid Parental Leave: Family Leave (Maternity, Paternity)
  • Paid Time Off: Paid Time Off (Vacation, Sick & Public Holidays)

Quadric is building the next generation of Computing Architecture for the Edge.Our team is as thoughtfully architected as our product; in fact, the two go hand-in-hand. We are looking for technical ninjas, who are ready for the adventure of a lifetime. What do we mean by ninjas? We mean people with deep domain expertise who are driven by the desire to do something BIG in the company of good people.Our team is built upon mutual respect for what everyone brings to our end-to-end system. Without each part, there would be no whole. As such, our team is collaborative and focused.What We Value: Integrity, Humility, HappinessWhat We Expect: Initiative, Collaboration, CompletionOur Goal: For employees to look back on this chapter of building the company with amazing memories -- remembering it as a time that was challenging and exciting as we worked together to build something extraordinary.LCA Notice

View all jobs
Get hired quicker

Be the first to apply. Receive an email whenever similar jobs are posted.

Ace your job interview

Understand the required skills and qualifications, anticipate the questions you may be asked, and study well-prepared answers using our sample responses.

Engineer Q&A's
Report this job
Apply for this job