Compiler Engineer

GW499
  • $275,000-$300,000
  • San Francisco, CA
  • Permanent

About the job


Compiler Engineer


We’re partnered with an AI infrastructure company building next-generation systems for large-scale AI workloads.


Their platform is rethinking how AI execution runs across heterogeneous hardware — dynamically partitioning workloads, optimizing execution paths, and orchestrating inference across multiple accelerator types to unlock major gains in performance and efficiency.


What You’ll Work On

  • Building compiler pipelines for large-scale AI inference workloads
  • Designing and evolving multi-level IRs across graph, tensor, and kernel representations
  • Implementing lowering and partitioning strategies across heterogeneous hardware
  • Optimizing execution for latency, throughput, and memory efficiency
  • Improving scheduling, kernel orchestration, and runtime behavior
  • Working on compiler infrastructure spanning execution systems, runtime optimization, and memory movement
  • Integrating new model architectures and inference execution patterns into the stack
  • Collaborating closely with runtime, systems, and kernel engineers to drive end-to-end performance improvements


What They’re Looking For

  • Strong systems and performance engineering fundamentals
  • Experience building compiler systems or compiler-adjacent infrastructure
  • Deep understanding of execution behavior, memory systems, and hardware efficiency
  • Experience with MLIR, LLVM, XLA, TVM, Triton, or similar compiler/runtime infrastructure
  • Familiarity with IR transformations, compiler passes, lowering systems, or runtime optimization
  • Experience working with GPUs, AI accelerators, or heterogeneous compute environments
  • Strong C++ and/or Python engineering skills


Why Join

  • Work on cutting-edge compiler infrastructure for modern AI systems
  • Solve hard problems across inference, runtimes, scheduling, and heterogeneous execution
  • Build foundational infrastructure for next-generation AI workloads
  • Small, deeply technical engineering team
  • Significant ownership and technical impact from day one


Anna Heneghan Senior ML Research & Engineering Recruiter

Apply for this role