Wait…
About the job
Sciforium is an AI infrastructure company developing next-generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar funding and direct sponsorship from AMD with hands-on support from AMD engineers the team is scaling rapidly to build the full stack powering frontier AI models and real-time applications.
About the role
We are seeking a Senior HPC & GPU Infrastructure Engineer to take full ownership of the health, reliability, and performance of our GPU compute cluster. You will be the primary custodian of our high-density accelerator environment and the linchpin between hardware operations, distributed systems, and machine learning workflows. This role spans everything from hands-on Linux systems engineering and GPU driver bring-up to maintaining the ML software stack (CUDA/ROCm, PyTorch, JAX, vLLM). If you love squeezing every bit of performance out of hardware, enjoy debugging GPUs at scale, and want to build world-class AI infrastructure, this role is for you.
What you'll do
- System Health & Reliability (SRE)
- On-Call Response: Act as the primary responder for system outages, GPU failures, node crashes, and cluster-wide incidents. Minimize downtime by resolving issues rapidly.
Ideal candidate profile
- 5+ years of experience in HPC, GPU cluster operations, Linux systems engineering, or similar roles.
- Bachelor’s or Master’s degree in Computer Science, Computer Engineering, Electrical Engineering, or a related technical field.
- Strong expertise with NVIDIA (H100/B200) or AMD (MI325x/MI355x) GPUs, including driver and kernel-level debugging.
- Deep understanding of Linux internals, kernel modules, hardware bring-up, and systems performance tuning.
- Experience with network security, including VPNs, iptables/firewalld, SSH, and identity management (LDAP/FreeIPA/AD).
- Proficiency in Bash and Python for scripting, automation, and workflow tooling.
- Familiarity with ML software stacks: CUDA toolkit, cuDNN, NCCL, ROCm, JAX/PyTorch runtime behavior.
- Deep debugging experience with NVLink/NVSwitch fabrics and RDMA networking.
Nice-to-have
- Experience with job schedulers such as Slurm, Kubernetes, or Run:AI.
- Exposure to vLLM, model serving optimizations, or inference systems.
- Hands-on experience with configuration management tools (Ansible, SaltStack, Terraform).
- Previous experience supporting ML research teams in a startup or research-heavy environment.
Benefits include
- Medical, dental, and vision insurance
- 401k plan
- Daily lunch, snacks, and beverages
- Flexible time off
- Competitive salary and equity
Equal opportunity
Sciforium is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.
Similar jobs at other companies
Pay not posted
Posted 12 days ago
checked 2 days ago
$180K–$250K / yr
Posted Jul 21, 2025
NVIDIAUS, CA, Santa Clara +1
Pay not posted
Posted 10 days ago
checked 2 days ago
Hippocratic AIGurugram, India
Pay not posted
Posted 5 days ago
Hippocratic AIMenlo Park, CA
Pay not posted
Posted Sep 17, 2026
NebiusAmsterdam, Netherlands +3
Pay not posted
Posted Aug 27, 2024
Source: the Sciforium Ashby job board. We last checked this job 1 h ago. We first saw it 2 days ago. A job on a job board does not always mean that the team interviews people now. We found this job board in a public list. We did not yet compare it with the careers page of the company.
- Open tech jobs
- 12
- With posted pay
- 100%
- Median posted base
- $165K–$223K