5V Tech | Principle AI Compiler Engineer
July 03, 2026

Principle AI Compiler Engineer

Hybrid, United States
$240,000–$320,000 (DOE)
Permanent
Job Reference: Principle AI Compiler Engineer

Principle AI Compiler Engineer

  • Location: California / Texas (Hybrid-Remote)
  • Full-Time Permanent Contract
  • Salary: $240,000–$320,000 (DOE)
  • Total Comp: Equity, Bonus, Insurance, 401(k), etc.

A global semiconductor leader is building the next generation of embedded AI, powering everything from automotive systems and industrial automation to IoT and consumer devices. Their platform combines custom SoC silicon with a tightly integrated AI software stack, enabling neural networks to run with maximum performance and energy efficiency directly on-device.

They are looking to expand their compiler team with a Senior AI Compiler Engineer who can architect and scale a production-class AI compiler toolchain that leverages AI agents to automate, optimize, and accelerate the deployment of neural networks onto their SoC platforms.

Key responsibilities:

  • Owning the design, implementation, and evolution of an AI compiler toolchain that maps neural networks onto custom SoC platforms
  • Pioneering new graph transformations, lowering, scheduling, and codegen strategies for CPUs and custom accelerators
  • Building deep integrations with leading AI frameworks (PyTorch, TensorFlow, ONNX) and rapidly onboarding new model architectures and operators
  • Driving state-of-the-art results in quantization, operator fusion, memory planning, and layout transformations
  • Partnering with hardware and software architects to co-design next-generation compiler and accelerator features
  • Diagnosing and resolving performance bottlenecks using AI-enabled profiling and diagnostics, tuning for latency, throughput, and power efficiency
  • Strengthening validation, benchmarking, and regression pipelines through AI-assisted automation
  • Improving developer experience through better usability, diagnostics, and documentation

Ideal Profile:

  • MS/PhD in Computer Science, Electrical Engineering, or a related field (or equivalent industry experience)

  • Deep experience building AI compilers, accelerator backends, or graph optimization frameworks
  • Strong expertise in graph and performance optimization for NPUs or custom accelerators
  • Hands-on experience with MLIR, LLVM, TVM, or similar compiler IRs
  • Excellent C/C++ and Python skills
  • Solid understanding of AI inference workloads (CNNs, transformers, perception or generative models)
  • Strong communication skills and experience working in agile/Scrum environments (Product Owner or Scrum Master experience a plus)

This is an opportunity to work at the intersection of hardware and software, building compiler technologies that directly shape the performance of next-generation embedded AI systems at global scale.

APPLY NOW to discuss further details.

5V Tech are acting as an Employment Agency for the purposes of this position. We offer a reward scheme if you can recommend someone for this role. $250 for you and $250 to a charity of your choice. 5V Tech are recognised talent solutions experts within IoT and Deep Tech, working across Europe, the UK, and North America.

Let's Talk

We're always available. Email us at: letstalk@weare5vtech.com