Inference Systems Performance Architect
SambaNova, San Jose, California +1
About the job
SambaNova is a leader in next-generation AI infrastructure, delivering a full-stack inference platform for customers worldwide. At the core of SambaNova's technology is the RDU (Reconfigurable Dataflow Unit) — a chip built on a dataflow architecture rather than the traditional GPU model. Its decode performance is especially strong for agentic workloads like multi-turn agents, code generation, and long-running applications. RDUs are packaged into SambaRack, rack-scale hardware that lets customers deploy state-of-the-art models with better performance, greater energy efficiency, and faster time to value.
About the Team
The Inference Systems Performance team answers how fast SambaNova's systems can serve large language models and what it takes to get there. We capture real production traffic, benchmark it faithfully, model and simulate configurations that do not exist yet, and profile the distributed serving pipeline across host, accelerator, and fabric. Our work feeds serving optimization today and hardware and capacity planning for the next generation. We sit close to model optimization, systems, hardware, and product, and the whole company depends on our numbers.