--- title: 'Technical Program Manager at RadixArk' canonical: 'https://feeny.ai/job/technical-program-manager-radixark-palo-alto-dttqfvsvp6yv' type: 'job' last_seen: '2026-09-06' --- # Technical Program Manager at RadixArk - **Company:** RadixArk - **Location:** Palo Alto, CA - **Posted:** 2026-04-30 - **Last confirmed live:** 2026-09-06 - **Apply:** https://job-boards.greenhouse.io/radixark/jobs/4236243009 ## Job description ## About the Role As a Technical Program Manager at RadixArk, you'll drive the execution of complex, cross-functional programs across our inference and training infrastructure. You'll partner closely with Product Management, Research, and Engineering to turn ambitious technical roadmaps into shipped reality, coordinating across kernel teams, distributed systems engineers, and external partners to deliver infrastructure that serves billions of tokens daily and coordinates 10,000+ GPU training runs. This role is for someone who thrives at the intersection of deep technical understanding and rigorous program execution. You'll own the "how" and "when" of our most critical initiatives. ## Key Responsibilities Program Execution & Delivery - Drive end-to-end execution of large-scale, cross-functional programs spanning inference engines (e.g., SGLang), training frameworks (e.g., Miles), and hardware integration efforts. - Define program structure, including milestones, dependencies, critical paths, risks, and success criteria. Maintain a clear source of truth for status across all stakeholders. - Run design reviews, sprint planning, release readiness reviews, and post-mortems. Ensure decisions are documented and follow-ups are closed out. - Identify and unblock cross-team dependencies across kernel, runtime, scheduler, networking, and model teams before they become release blockers. - Drive release management for major versions, including changelog ownership, compatibility validation, partner rollout sequencing, and rollback planning. Technical Coordination - Partner with Product Management to translate roadmap priorities into executable program plans, with clear scope, staffing, and timelines. - Work shoulder-to-shoulder with engineering leads on technical trade-off decisions; understand the architecture deeply enough to ask the right questions and surface hidden risks. - Coordinate hardware enablement programs with partners like Nvidia, Google, and AWS, including new accelerator bring-up, kernel co-development, and benchmark validation. - Manage integration programs with frontier AI labs and early adopters, ensuring technical requirements, SLAs, and feedback loops are well-defined. Operational Excellence - Build and improve the engineering operating cadence, including standups, planning rituals, OKR tracking, dashboards, and reporting to leadership. - Establish metrics and instrumentation for program health such as velocity, defect rates, benchmark regressions, and customer-reported issues, and drive accountability against them. - Lead incident response coordination for production issues affecting partners; own root-cause review and corrective-action tracking. - Improve developer productivity by identifying and removing systemic friction in our build, test, and release pipelines. Stakeholder Communication - Serve as the connective tissue between engineering, product, GTM, and external partners, ensuring everyone has the right information at the right altitude. - Produce clear, concise written updates for leadership and partners. Translate engineering progress into business-relevant signals. - Represent program status honestly, including risks and slips, with concrete mitigation plans. ## Qualifications ## Minimum Requirements - Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field. - 4+ years of direct experience in Technical Program Management, Engineering Management, or a senior engineering role with significant program ownership, in a software or infrastructure company. - Strong technical fluency in systems software, distributed systems, or AI/ML infrastructure; able to read code, follow architecture discussions, and challenge technical assumptions productively. - Demonstrated track record shipping complex, multi-team programs on time, including managing dependencies, risks, and scope changes. - Excellent written and verbal communication skills; able to drive alignment across engineers, executives, and external partners. ## Preferred (Bonus) Qualifications - Direct experience shipping AI/ML infrastructure such as inference engines, training frameworks, GPU kernels, distributed schedulers, or model serving platforms. - Hands-on coding background (Python, C++, CUDA) and comfort working in engineering codebases, including reading PRs, running benchmarks, and reproducing issues. - Experience coordinating with hardware vendors (Nvidia, AMD, Google TPU, AWS Trainium/Inferentia) on enablement or co-engineering programs. - Experience driving open-source release programs or working in OSS communities, including issue triage, RFC processes, and contributor coordination. - Familiarity with release engineering, CI/CD systems, and observability tooling for large-scale distributed systems. - Experience supporting B2B or developer-facing products with enterprise SLAs. ## About RadixArk RadixArk is an infrastructure-first company built by engineers who've shipped production AI systems, created SGLang (30K+ GitHub stars, the fastest open LLM serving engine), and developed Miles (our large-scale RL framework). Founded by AI infrastructure veterans from xAI and NVIDIA, we're on a mission to democratize frontier-level AI infrastructure by building world-class open systems for inference and training. Our team has optimized kernels serving billions of tokens daily, designed distributed training systems coordinating 10,000+ GPUs, and contributed to infrastructure that powers leading AI companies and research labs. ## Compensation We offer competitive compensation with equity, comprehensive health benefits, and flexible work arrangements. Compensation is determined by location, level, and experience. ## Equal Opportunity RadixArk is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more. ## About RadixArk ## Company Overview - **One-liner**: RadixArk builds open, large-scale inference and training systems to democratize access to frontier AI infrastructure for the entire AI community. - **Entity Type**: Private (Seed stage) - **Headquarters**: San Francisco, California, United States - **Founded**: 2025 - **Founders**: Ying Sheng (CEO) and Banghua Zhu ## Core Business - **Primary industry/industries**: AI Infrastructure, Deep-Tech, Open Source Software - **Target customers**: Individual developers, startups, enterprises, and research labs building and deploying AI systems at scale. - **Mission or purpose statement**: "Make frontier-level AI infrastructure open and accessible to everyone." [radixark.com](https://radixark.com/) ## Products & Services - **[SGLang (Inference Engine)](https://radixark.com/)**: An open-source, high-performance serving engine for AI models. It has become a de facto standard, powering trillions of tokens daily for leaders like Google, Microsoft, NVIDIA, and xAI. RadixArk is the primary steward. **Type:** Open-Source Software / Managed Service - **[Miles (RL Framework)](https://radixark.com/blog/radixark-launches-100m-seed)**: An open-source framework for large-scale reinforcement learning and post-training. Designed for efficiency and stability, it has been adopted for large-scale MoE training. **Type:** Open-Source Software - **Managed Infrastructure & Tooling**: Built on top of SGLang and Miles, RadixArk offers managed services for the full lifecycle of AI development, from training to inference, for teams developing AI at scale. **Type:** Managed Service / Platform ## Market Standing - **Valuation/Market Cap**: $400 million post-money valuation (as of May 2026) [cbinsights.com](https://www.cbinsights.com/company/radixark) - **Key Metric**: $100 million total funding (Seed Round) - **Notable Investors/Partners**: Accel (lead), Spark Capital (co-lead), NVentures (NVIDIA's venture arm), and participation from Google, Microsoft, and other strategic partners. [radixark.com](https://www.radixark.com/blog/radixark-launches-100m-seed) - **Growth Signals**: The company has 19 employees as of mid-2026 but has seen a monthly headcount growth of +55.6%. Its open-source projects (SGLang and Miles) are already adopted by industry giants and research labs, indicating massive traction and developer mindshare. [linkedin.com](https://www.linkedin.com/company/radixark) ## Competitive Advantages - **Open-Source Moat**: Its core products, SGLang and Miles, are open-source community standards with deep adoption. This creates a network effect and developer loyalty that is hard for proprietary competitors to replicate. - **First-Principles Engineering Culture**: The company treats infrastructure engineering as a core creative discipline, not a support function, leading to deeper system-level innovations. - **Top-Tier Talent & Backing**: Founded by the creators of SGLang and backed by Accel, Spark Capital, and NVIDIA, giving it immediate credibility, capital, and access to frontier hardware. - **Clear Mission**: Focusing on making infrastructure "10x cheaper and 10x more accessible" directly addresses a massive pain point for the entire AI ecosystem. [radixark.com](https://www.radixark.com/) ## Strategic Focus - **Growing SGLang & Miles**: Using the $100M seed to accelerate support for new model architectures, hardware platforms, and community improvements. - **Building Managed Services**: Developing the managed infrastructure and tooling layer on top of its open-source cores to serve a wider range of customers. - **Hiring Deeply Technical Talent**: Actively recruiting top-tier engineers for kernels, compilers, training systems, and TPU systems to maintain its engineering edge. - **Expanding Global Reach**: With a Sales role based in Singapore, the company is signaling an intention to serve the APAC market. ## Why Work Here - **Impactful Mission**: Employees contribute directly to making frontier AI infrastructure a shared foundation, working on problems that affect the entire AI ecosystem. - **Engineering-Centric Culture**: The company explicitly states that "infrastructure engineering is not a support function," making it an ideal environment for deep-tech systems engineers who want to solve hard, first-principles problems. [radixark.com](https://www.radixark.com/blog/radixark-launches-100m-seed) - **Work with Open Source at Scale**: You will be contributing to and stewarding widely-used open-source projects (SGLang, Miles) that power trillions of tokens daily. - **Strong Backing & Early Stage**: Joining a well-funded seed-stage company with a $400M valuation offers significant upside and the chance to shape the company's culture and direction from an early stage. - **Location & Hybrid Policy**: The company is headquartered in Palo Alto and San Francisco, California, with most roles listed as in-office. They also have a role in Singapore. - **Notable Perks**: The company's blog emphasizes a culture of being "focused, humble, fearless, and meticulous," which appeals to mission-driven engineers. ## Sources 1. [RadixArk Official Website](https://radixark.com/) 2. [RadixArk Blog: $100M Seed Announcement](https://www.radixark.com/blog/radixark-launches-100m-seed) 3. [RadixArk Jobs on Greenhouse](https://job-boards.greenhouse.io/radixark) 4. [RadixArk LinkedIn Page](https://www.linkedin.com/company/radixark) 5. [CBInsights Company Profile](https://www.cbinsights.com/company/radixark) ## Other roles at RadixArk - [Talent Operations](https://feeny.ai/job/talent-operations-radixark-palo-alto-bt6t3qbk45qe) — Palo Alto, CA - [Member of Technical Staff — Inference-Multi-Hardware](https://feeny.ai/job/member-of-technical-staff-inference-multi-hardware-radixark-palo-alto-5mtbdk97kyhg) — Palo Alto, CA - [Member of Technical Staff — Developer Experience](https://feeny.ai/job/member-of-technical-staff-developer-experience-radixark-palo-alto-5a7wr087scr0) — Palo Alto, CA - [Member of Technical Staff — Developer Technology](https://feeny.ai/job/member-of-technical-staff-developer-technology-radixark-palo-alto-vgg40r7f304a) — Palo Alto, CA - [Visual Designer](https://feeny.ai/job/visual-designer-radixark-palo-alto-zs66af26bhhk) — Palo Alto, CA - [Product Marketing Manager](https://feeny.ai/job/product-marketing-manager-radixark-palo-alto-jw9xehpywsd4) — Palo Alto, CA - [Business Development](https://feeny.ai/job/business-development-radixark-palo-alto-c182fj5brh29) — Palo Alto, CA - [Member of Technical Staff — Performance](https://feeny.ai/job/member-of-technical-staff-performance-radixark-palo-alto-f19h4n3ewdzv) — Palo Alto, CA - [Member of Technical Staff — Product](https://feeny.ai/job/member-of-technical-staff-product-radixark-palo-alto-as44m8evvp3v) — Palo Alto, CA - [Member of Technical Staff — Reliability-CI Infrastructure](https://feeny.ai/job/member-of-technical-staff-reliability-ci-infrastructure-radixark-palo-alto-f6br2hsn8yzs) — Palo Alto, CA