Software Architect
LB319
Posted: 10/11/2026
- $250,000 - $350,000
- Palo Alto, CA
- Permanent
🚀 Hiring: Software Architect | AI Accelerators & Next-Gen Compute | Palo Alto, CA
I'm working with an early-stage semiconductor startup building a completely new AI compute architecture, designed to dramatically improve the cost and efficiency of AI inference.
They're developing both custom silicon and the software stack needed to run next-generation AI workloads, with a particular focus on LLMs, agentic AI and physical AI.
With their first-generation chip already taped out, they're looking for a hands-on Software Architect to take ownership of the accelerator runtime and help bring the platform from pre-silicon development through to real hardware execution.
What you'll be working on:
→ Architect and build an accelerator runtime from the ground up
→ Own host-device interfaces, memory management, scheduling and asynchronous execution
→ Work directly with hardware engineers on pre-silicon validation and silicon bring-up
→ Optimize LLM inference, including prefill/decode, KV caching and batching
→ Build the software foundation for an entirely new AI compute platform
What they're looking for:
- Strong C/C++ and Linux systems engineering experience
- Background in GPU, AI accelerator or HPC runtime development
- Experience with pre-silicon development, validation or silicon bring-up
- Deep understanding of hardware/software interaction, memory systems and execution runtimes
- 4+ years of experience
This is a rare opportunity to join a small, highly technical founding team, work directly alongside the hardware architects and take genuine ownership of a new computing platform.
💰 $250k–$350k base + bonus + equity
Onsite in Palo Alto, CA
If you've worked on GPU runtimes, AI accelerators or low-level systems software and want to help build the next generation of AI hardware, I'd love to speak. Apply here
Kirstie Horsley
Researcher