Director of System Software

GW69
  • $400,000-$600,000
  • Mountain View, CA
  • Permanent

About the job


Director of System Software – Datacenter AI Hardware


Acceler8 Talent is exclusively partnered with a well-funded AI hardware startup, backed by world-class investors, to help them find a Director of System Software.


Founded by engineers that were instrumental in Google's AI capabilities, this team is building the next-generation compute platform for companies building and running GenAI models.


As the Director of Software, you’ll join a highly skilled engineering group at the forefront of silicon and system design, leading the development of compilers, kernels, and runtime software that bring cutting-edge hardware to life.


What You’ll Do

  • Lead the whole system software organization, overseeing compiler, kernel, and runtime teams supporting next-generation datacenter-scale AI hardware.
  • Define and execute the roadmap for software enablement, from low-level drivers and kernels to domain-specific compilers that unlock performance across large-scale GenAI models.
  • Partner closely with hardware architects and RTL engineers to co-design hardware/software interfaces, ensuring optimal performance, efficiency, and developer usability.
  • Build and mentor a world-class software engineering team, fostering a culture of technical excellence and execution.
  • Drive integration of system software into emulation, bring-up, and production flows, enabling robust silicon validation and customer deployment.
  • Represent the software strategy in executive planning, product roadmaps, and customer engagements.


What We’re Looking For

  • Proven leadership experience building and scaling system software teams, ideally in datacenter, AI/ML, or high-performance compute domains.
  • Deep expertise in compiler design, kernel development, or runtime systems for accelerators, CPUs, GPUs, or NPUs.
  • Strong background in C/C++ and Python, with hands-on understanding of modern compiler toolchains (LLVM, MLIR, GCC) and kernel development (Linux, custom RTOS, or similar).
  • Track record of delivering production software that integrates tightly with silicon, from bring-up through customer deployment.
  • Excellent cross-functional collaboration skills, with the ability to bridge between hardware, architecture, and end-user software needs.


Why Join?

  • Join a well-funded, fast-growing startup shaping the future of GenAI compute.
  • Work alongside industry-leading architects, engineers, and system builders.
  • Hybrid role based in Mountain View, CA (3 days on-site).
  • Immediate start available.


If you’re interested, apply here or reach out directly to Luke at ltomaszko@acceler8talent.com to learn more.


Luke Tomaszko Senior Semiconductor & Chip Design Recruiter

Apply for this role