Software Architect
- $250,000 - $350,000
- Palo Alto, CA
- Permanent
Software Architect | AI Accelerators | Palo Alto
Own the software behind a new AI chip with an ex-NVIDIA co-founder, $10M+ raised and first-generation tape-out complete.
This seven-person startup is building a purpose-built AI processor to reduce inference cost and power consumption. You’ll work directly with the founders and hardware team, shaping the software as the silicon evolves.
The remit spans accelerator runtime, host-device interfaces, memory management and scheduling from pre-silicon validation through bring-up and production readiness.
The opportunity
Own how AI models execute on this new hardware. You’ll connect compiler output, runtime and serving software into a production stack, with influence over the hardware/software interfaces that make it possible.
Your scope will include:
- Accelerator runtime architecture and hands-on implementation.
- Host-device APIs, command submission, asynchronous execution and recovery.
- Memory allocation, data movement, weight residency and inference scheduling.
- Pre-silicon validation, FPGA testing and first-silicon bring-up.
- Co-design of instruction sets, compiler interfaces and runtime behaviour with the hardware team.
Key requirements
- Strong engineering background through a leading engineering university or a technically demanding semiconductor, GPU, accelerator or systems company.
- Hands-on ownership of substantial GPU, accelerator or HPC runtime software - you’ve personally designed and built it.
- Experience with evolving hardware, including pre-silicon development, simulation, FPGA validation or silicon bring-up.
- Deep C/C++ and Linux systems skills, covering device interfaces, memory movement, asynchronous execution and debugging.
- AI inference understanding, particularly execution, memory constraints and scheduling.
A chance to make foundational architecture decisions, stay close to the code and take meaningful equity in an early team. Strong engineers stepping into broader architectural ownership are welcome.
Full-time | Palo Alto | Base + bonus + equity
If this sounds like your next move, apply - we’d love to hear what you’ve built!