Compiler Engineer
GW499
Posted: 27/05/2026
- $275,000-$300,000
- San Francisco, CA
- Permanent
About the job
Compiler Engineer
We’re partnered with an AI infrastructure company building next-generation systems for large-scale AI workloads.
Their platform is rethinking how AI execution runs across heterogeneous hardware — dynamically partitioning workloads, optimizing execution paths, and orchestrating inference across multiple accelerator types to unlock major gains in performance and efficiency.
What You’ll Work On
- Building compiler pipelines for large-scale AI inference workloads
- Designing and evolving multi-level IRs across graph, tensor, and kernel representations
- Implementing lowering and partitioning strategies across heterogeneous hardware
- Optimizing execution for latency, throughput, and memory efficiency
- Improving scheduling, kernel orchestration, and runtime behavior
- Working on compiler infrastructure spanning execution systems, runtime optimization, and memory movement
- Integrating new model architectures and inference execution patterns into the stack
- Collaborating closely with runtime, systems, and kernel engineers to drive end-to-end performance improvements
What They’re Looking For
- Strong systems and performance engineering fundamentals
- Experience building compiler systems or compiler-adjacent infrastructure
- Deep understanding of execution behavior, memory systems, and hardware efficiency
- Experience with MLIR, LLVM, XLA, TVM, Triton, or similar compiler/runtime infrastructure
- Familiarity with IR transformations, compiler passes, lowering systems, or runtime optimization
- Experience working with GPUs, AI accelerators, or heterogeneous compute environments
- Strong C++ and/or Python engineering skills
Why Join
- Work on cutting-edge compiler infrastructure for modern AI systems
- Solve hard problems across inference, runtimes, scheduling, and heterogeneous execution
- Build foundational infrastructure for next-generation AI workloads
- Small, deeply technical engineering team
- Significant ownership and technical impact from day one
Anna Heneghan
Senior ML Research & Engineering Recruiter