---
title: 'GPU Cluster Engineer, Systems & Platform at Sciforium'
canonical: 'https://feeny.ai/job/gpu-cluster-engineer-systems-platform-sciforium-san-francisco-ma6a8rs3139z'
type: 'job'
last_seen: '2026-09-06'
---

# GPU Cluster Engineer, Systems & Platform at Sciforium

- **Company:** Sciforium
- **Location:** San Francisco, CA
- **Employment:** full-time
- **Work type:** onsite
- **Posted:** 2026-08-06
- **Last confirmed live:** 2026-09-06
- **Apply:** https://jobs.ashbyhq.com/sciforium/62d7ad5e-d00b-4e6d-b5be-b02ea9ef65ea

## Job description

Sciforium is an AI infrastructure company developing next-generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar funding and direct sponsorship from AMD with hands-on support from AMD engineers the team is scaling rapidly to build the full stack powering frontier AI models and real-time applications.

## ABOUT THE ROLE

We are looking for a GPU Cluster Engineer to own the entire software stack of our GPU clusters — from kernel tuning and GPU drivers up through schedulers, containers, and ML frameworks. While our Hardware Operations team keeps the physical machines healthy and connected, you define what a production-ready node looks like in software: you author the images, playbooks, and pipelines that take a freshly provisioned server to a fully validated GPU node, and you keep the fleet consistent, upgradable, and fast. You will serve two demanding customer groups — our foundation model training teams and our model serving/product teams — ensuring both run on correctly configured, well-managed, high-performance infrastructure.

## Key Responsibilities

- OS Bring-Up & Node Lifecycle Engineering
- Golden Images & Automated Bring-Up: Own the node software definition — versioned OS images, kernel tuning (NUMA, hugepages, IRQ affinity, cgroups), GPU/NIC driver stacks — and the automated pipeline that takes a node from base OS to production-ready.
- Validation & Burn-In: Build automated acceptance suites (DCGM diagnostics, nccl-tests/RCCL tests, bandwidth and topology checks, HPL) that gate every node before it enters a scheduler pool.
- Fleet Maintenance: Execute rolling kernel/driver/toolkit upgrades with minimal disruption to running workloads; enforce configuration consistency, detect drift, and maintain the driver ↔ CUDA/ROCm ↔ framework compatibility matrix across the fleet.
- Self-Healing Operations: Automate detection of unhealthy nodes (Xid/ECC errors, link flaps, thermal throttling), with cordon/drain/reboot/re-image workflows and clean handoff to Hardware Operations for physical repair or RMA.
- Configuration Management & Automation
- Infrastructure as Code: Manage all node and cluster configuration through Ansible/SaltStack playbooks in Git, with peer-reviewed changes, CI validation, and canary rollouts before fleet-wide deployment.
- Provisioning Pipelines: Build and maintain image/provisioning tooling (PXE, MaaS, Packer, or similar) so new or re-imaged nodes are reproducible, not hand-crafted.
- Operational Tooling: Develop Python/Bash tooling for cluster operations, health reporting, and workflow automation.
- Orchestration & Scheduling (Kubernetes & Slurm)
- Kubernetes for Serving: Deploy and operate GPU-enabled Kubernetes for inference workloads — NVIDIA GPU Operator, device plugins, node feature discovery, topology-aware scheduling, and MIG/MPS partitioning where appropriate.
- Training Schedulers: Operate Slurm (or Run:AI) for multi-node training — partitions, QoS, preemption, accounting, and container integration (enroot/pyxis).
- Container Platform: Maintain base images, registries, and the NVIDIA Container Toolkit / ROCm container stack; keep training and serving images lean, current, and reproducible.
- GPU Driver & ML Stack Engineering
- Driver & Runtime Lifecycle: Build, deploy, and debug the full accelerator stack — NVIDIA (CUDA toolkit, cuDNN, NCCL, Fabric Manager) and AMD (ROCm, RCCL) — including kernel modules (DKMS), GPUDirect RDMA/Storage, and the RDMA software stack (MOFED/DOCA).
- Framework Environments: Maintain curated, optimized PyTorch and JAX environments with sane dependency and version management for researchers and production services.
- Distributed Performance: Tune NCCL/RCCL across NVLink/NVSwitch and InfiniBand/RoCE fabrics, ensure topology-aware job placement, and run continuous communication/throughput benchmarks to catch regressions.
- Advanced Debugging & Observability
- Escalation Point: Own the hard problems — NCCL hangs and timeouts, CUDA memory leaks, ROCm kernel crashes, straggler nodes, and unexplained throughput drops.
- Observability: Own software-layer monitoring (DCGM exporter, Prometheus/Grafana, alerting) plus job-level GPU utilization and cluster efficiency reporting.

## Qualifications

- Must-Haves:
- 5+ years in systems/infrastructure engineering with significant GPU cluster, HPC, or large-scale ML infrastructure experience.
- Bachelor's or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or a related technical field.
- Deep Linux internals expertise: kernel modules/DKMS, systemd, cgroups, NUMA, and system performance tuning.
- Hands-on experience with NVIDIA (CUDA) and/or AMD (ROCm) driver and runtime stacks on modern accelerators (H200/B200, MI325x/MI355x class), including kernel-level debugging.
- Production Kubernetes experience with GPU workloads, plus working knowledge of HPC schedulers (Slurm/Run:AI) — or the reverse (deep Slurm, working K8s).
- Strong configuration management experience (Ansible or SaltStack) with Git-based, code-reviewed infrastructure workflows.
- Provisioning and image tooling experience (Packer, MaaS, Foreman, Terraform, or similar) for automated, reproducible node builds.
- Client-side experience with distributed filesystems (Lustre, GPFS, Weka) and checkpoint I/O optimization.
- Container fluency: Docker/containerd and the NVIDIA Container Toolkit or ROCm equivalent.
- Proficiency in Python and Bash for automation and tooling.
- Working knowledge of NCCL and RDMA networking (InfiniBand/RoCE, GPUDirect) and of PyTorch/JAX runtime behavior.
- Nice-to-Haves:
- Experience directly supporting foundation model training teams — multi-node job failure debugging, checkpoint pipeline tuning, and framework-level performance triage — ideally in a startup or research-heavy environment.
- Experience deploying and tuning inference/serving stacks (vLLM, Triton Inference Server, TensorRT-LLM) for latency and throughput targets.
- GPU/system profiling tools: Nsight Systems/Compute, rocprof, perf, eBPF.

## BENEFITS INCLUDE

- Medical, dental, and vision insurance
- 401k plan
- Daily lunch, snacks, and beverages
- Flexible time off
- Competitive salary and equity

## EQUAL OPPORTUNITY

Sciforium is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.

## About Sciforium

## Company Overview
- **One-liner**: Sciforium is building a vertically integrated AI infrastructure platform that owns its hardware (AMD GPUs) to deliver cost-effective, high-performance inference and foundation model training across text, image, video, and audio modalities.
- **Entity Type**: Private (Seed Stage)
- **Headquarters**: San Francisco, California, United States
- **Founded**: 2024
- **Founders**: Hassan Akbari

## Core Business
- **Primary Industry**: AI Infrastructure / Generative AI
- **Target Customers**: B2B; AI teams and enterprises that need scalable, multimodal AI inference and model serving without managing their own infrastructure.
- **Mission**: To rebuild AI serving infrastructure from the ground up—owning the hardware and optimizing the entire pipeline end to end—so that any team, regardless of size or budget, can access the best AI capabilities across every modality without compromise.

## Products & Services
- **AI Inference API**: A drop-in replacement for the OpenAI API format, supporting streaming, tool use, structured outputs, and async generation. Runs on Sciforium’s own AMD hardware for lower cost and stronger privacy.
- **Evaluation Platform**: Built-in pipelines to monitor model performance in real time, catch regressions, and benchmark across models.
- **Native Agents Infrastructure**: Serverless platform for running AI agents at scale without managing servers.
- **Model Library**: Access to state-of-the-art open-source models across text, image, video, and audio (e.g., DeepSeek, Wan2, speech models).

## Market Standing
- **Valuation/Market Cap**: Not disclosed
- **Key Metric**: Total Funding of $3.9M (Seed round closed June 2024)
- **Notable Investors/Partners**: Backed by AMD and SignalFire
- **Growth Signals**: Headcount grew 160% YoY to 8 employees; 10 active job postings as of mid-2025; 99.98% uptime claimed; N+1 power and N+2 cooling redundancy with liquid-cooled infrastructure.

## Competitive Advantages
- **Vertical Integration**: Owns its own AMD hardware and runs its own data centers, removing intermediaries and markups—leading to lower costs and predictable performance.
- **Multimodal Native**: Built from the ground up to handle text, image, video, and audio in a single API, unlike many competitors that focus on text-only.
- **Privacy & Control**: By running on dedicated infrastructure (not shared servers), customers get stronger data privacy guarantees.
- **High Ambition Culture**: Team includes alumni from Google DeepMind, Microsoft, Amazon, Snowflake, Qualcomm, and Columbia University.

## Strategic Focus
- **Infrastructure Ownership**: Continuing to invest in its own AMD GPU clusters and data center operations to maintain cost and performance advantages.
- **Multimodal Expansion**: Scaling support for all data types (text, image, video, audio) with a single API.
- **Agent Readiness**: Building native support for AI agents at scale.
- **Open-Source Ecosystem**: Supporting the latest open-source models on day one.

## Why Work Here
- **Culture**: Highly independent, self-motivated, and creative environment. Small enough that your work is visible from day one. Principles include relentless quality, outcome ownership, and high ambition.
- **Work Policy**: Hybrid and in-office roles available. Offices in San Francisco (HQ) and Los Altos, California.
- **Team**: Small, high-caliber team with deep experience from Google DeepMind, Snowflake, Amazon, Qualcomm, and other top AI/infra companies.
- **Perks**: Work on hard infrastructure problems that matter, at a company backed by AMD and SignalFire. Opportunity to shape the foundation of AI infrastructure from an early stage.

## Sources
1. [sciforium.com](https://sciforium.com/)
2. [sciforium.com/company](https://sciforium.com/company)
3. [linkedin.com/company/sciforium](https://www.linkedin.com/company/sciforium)
4. [builtin.com/company/sciforium](https://builtin.com/company/sciforium)
5. [jobs.ashbyhq.com/sciforium](https://jobs.ashbyhq.com/sciforium)

## Other roles at Sciforium

- [Pre-training Research Engineer](https://feeny.ai/job/pre-training-research-engineer-sciforium-san-francisco-qqxzt72sswez) — San Francisco, CA
- [Research Engineer - Model Evaluation & MLOps](https://feeny.ai/job/research-engineer-model-evaluation-mlops-sciforium-san-francisco-j6bk6vmfyth9) — San Francisco, CA
- [Growth Marketing Specialist](https://feeny.ai/job/growth-marketing-specialist-sciforium-san-francisco-j384x6r54x22) — San Francisco, CA
- [GPU Kernel Engineer](https://feeny.ai/job/gpu-kernel-engineer-sciforium-san-francisco-xm87qw2qrrt1) — San Francisco, CA
- [Distributed Training and Inference Engineer](https://feeny.ai/job/distributed-training-and-inference-engineer-sciforium-san-francisco-13qdzh34vrwv) — San Francisco, CA
- [Data Center Real Estate & Development Specialist](https://feeny.ai/job/data-center-real-estate-development-specialist-sciforium-san-francisco-vhap3ehmva96) — San Francisco, CA
- [Technical Recruiter](https://feeny.ai/job/technical-recruiter-sciforium-san-francisco-k4sc03ac3z5r) — San Francisco, CA
- [Lead Software Engineer, Model Serving Platform](https://feeny.ai/job/lead-software-engineer-model-serving-platform-sciforium-san-francisco-sbdhk82sxhx3) — San Francisco, CA
- [Software Engineer, Fullstack](https://feeny.ai/job/software-engineer-fullstack-sciforium-san-francisco-w1txtdc4f5gz) — San Francisco, CA
- [GPU Cluster Engineer, Networking](https://feeny.ai/job/gpu-cluster-engineer-networking-sciforium-san-francisco-594atsvfkbpv) — San Francisco, CA