Software Engineer (Distributed Systems)

GW161
  • $150,000-$300,000
  • San Francisco, CA
  • Permanent

About the job


🚀 Software Engineer | Next-Gen AI Infrastructure | San Francisco


A fast-growing startup is reimagining AI inference - building the foundation for the next generation of AI applications. As generative AI scales, inference efficiency has become the biggest challenge. This team is solving it with a hardware software platform that delivers breakthroughs in speed, efficiency, and model performance.


Their stack lets developers deploy, manage, and monitor large-scale AI workloads from frameworks e.g. PyTorch and LangChain in seconds.


💡 The Role:

They’re hiring a Software Engineer to help build and scale the core platform for AI inference. You’ll work across distributed systems, compilation frameworks, and developer tools - shaping the backbone of modern AI infrastructure.

• Design and implement systems for distributed AI workloads

• Apply the latest AI research to improve real-world performance

• Write clean, maintainable, and well-tested code


🎓 You bring:

• Experience in AI/ML or distributed systems

• Proficiency in Python (C++ a bonus)


If you want to build the tech powering the next wave of AI, this is your opportunity.


Nick Bell ML Research & Engineering Recruiter

Apply for this role