--- title: 'Sr. Compiler Engineer at Tensordyne' canonical: 'https://feeny.ai/job/sr-compiler-engineer-tensordyne-munich-wgebfvc0rdwm' type: 'job' last_seen: '2026-11-06' --- # Sr. Compiler Engineer at Tensordyne - **Company:** Tensordyne - **Location:** Munich, Germany - **Posted:** 2026-10-16 - **Last confirmed live:** 2026-11-06 - **Apply:** https://job-boards.greenhouse.io/tensordyne/jobs/8818959002 ## Job description Role: Senior Compiler Engineer ## About Tensordyne Artificial intelligence (AI) is transforming our world. It can perform cognitive functions that previously only humans could do, such as perceiving interactions across different modalities and environments - with the ability to quickly learn and then solve complex problems. Tensordyne is an AI system solution company that builds very high-performance, low-power generative AI inference systems. Our mission, through the creation of custom silicon, hardware and software, is to enable multimodal Generative AI inference acceleration at scale, with safe, sustainable, high-performance systems for our hyperscaler and neocloud data center customers. We are at the leading edge of advancing the latest research and product improvements for generative Al inference solutions that will make Al even more advantageous for compelling new generative AI applications. Tensordyne is a well funded, fast-paced startup company with headquarters in both Sunnyvale, CA, and Munich, Germany. We also have many talented team members working remotely across North America and Europe. We take care of our people and their families with comprehensive benefits, competitive compensation, flexible spending options, and recognition programs, because building category-defining technology starts with a healthy, supported team. Come join us as we shape the future of multimodal generative artificial intelligence! ## About the Role The compiler decides whether our inference silicon runs at 30% utilization or 90% or more. That's the job. Together with our team, you'll build the backend that turns AI workloads into microcode for Tensordyne hardware - Napier today and the silicon that follows. This is a clean-slate compiler effort targeting a genuinely unusual architecture. You'll have the opportunity to work on fundamental parts of the compiler. The users are changing, too. Increasingly, model mapping and optimization will be done by agents as well as engineers. A compiler designed primarily for humans tends to optimize for escape hatches and manual control. A compiler designed to work effectively with agents needs transparent cost models, structured feedback, machine-readable diagnostics, and fast closed-loop iteration. We need both in the same stack and very few teams are building for this interaction today. ## What You'll Do - Contribute to backend compilation end to end: lowering, instruction scheduling, register and resource allocation, and microcode generation. - Consider the memory hierarchy: SRAM residency, HBM traffic, DMA orchestration, layout, rematerialization, and data movement. The goal is simple: keep the machine compute-bound rather than waiting on memory. - Develop tiling, fusion, and software-pipelining strategies that close the gap between theoretical and achieved throughput. - Design compiler interfaces that work for both agents and engineers: structured IR access, machine-readable diagnostics, searchable tuning spaces, and actionable performance feedback. - Solve problems conventional batch compilers often avoid: dynamic shapes, compile latency, KV-cache management, and the different optimization objectives of time-to-first-token (TTFT) versus steady-state throughput. - Build cost models that predict performance on silicon that doesn't exist yet, then continuously calibrate those models against real hardware. - Feed compiler learnings back into ISA and microarchitecture requirements for the next generation of silicon. ## What We're Looking For - Production compiler experience in code generation, optimization, or graph mapping. Tell us what you shipped and what it achieved, not how many years you've been doing it. - Experience with MLIR and/or LLVM, with meaningful contributions to an active compiler stack such as LLVM, MLIR, TVM, IREE, XLA, Triton, Inductor, or an equivalent internal system. - Strong modern C++ skills and a disciplined approach to testing and correctness. Rust experience is a plus. - Experience targeting custom accelerators or non-standard ISAs. You should be comfortable reading a microarchitecture specification, understanding its implications, and arguing with its assumptions when the compiler says they don't hold. - Strong performance intuition: memory hierarchy, data movement, parallelism, synchronization, occupancy, and the factors that determine whether theoretical hardware throughput becomes real throughput. - A co-design mindset. Compiler, kernels, runtime, ISA, and silicon are one system. You'll cross those boundaries whenever that's where the performance opportunity is. What Stands Out - Defensible opinions about what today's ML compilers get wrong and evidence behind them. - Work on autotuning, auto-scheduling, or polyhedral compilation. - Serious hands-on experience using agents in compiler, kernel-generation, or optimization loops. - CUDA/Triton expertise, particularly with the CUTLASS or NCCL ecosystems. - Experience with VLIW, systolic, dataflow, or other unconventional architectures. - Open-source compiler contributions we can read and discuss. Tensordyne is an equal opportunity employer. We believe that a diverse team is better at tackling complex problems and coming up with innovative solutions. All qualified applicants will receive consideration for employment without regard to age, color, gender identity or expression, marital status, national origin, disability, protected veteran status, race, religion, pregnancy, sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. A note to Recruitment Agencies: Please don’t reach out to Tensordyne employees or leaders about our roles -- we’ve got it covered. We don’t accept unsolicited agency resumes and we are not responsible for any fees related to unsolicited resumes. Thank you for your understanding. ## About Tensordyne ## Company Overview - **One-liner**: Tensordyne builds full-stack AI inference systems that use proprietary logarithmic math and custom 3nm silicon to dramatically reduce power, cost, and rack space for running large-scale generative AI models. - **Entity Type**: Private (Series C funded) - **Headquarters**: Sunnyvale, California, United States (co-headquarters also in Munich, Germany) - **Founded**: 2018 (based on first funding round in 2018) - **Founders**: Gilles Backhus (Co‑Founder, VP of AI & Product), RK Anand (Co‑founder & Chief Product Officer) ## Core Business - **Primary industry**: AI hardware and infrastructure (computer hardware manufacturing, deep learning silicon, systems engineering) - **Target customers**: Hyperscalers, Neo-Cloud data centers, and large enterprises running multimodal generative AI workloads - **Mission**: “Innovating at the zeroth layer – rewrite the numbers so intelligence flows with a fraction of today’s energy and cost.” ## Products & Services - **[Tensordyne Napier Inference System](https://www.tensordyne.ai/inference-system)**: An integrated rack‑scale AI inference platform combining custom logarithmic processors (3nm), HBM/SRAM memory, and a sub‑microsecond interconnect. Delivered as a TDN72 pod (72 chips) that scales into a full rack, supporting standard token serving and disaggregated inference. Fully air‑cooled and designed to fit into existing data center infrastructure. ## Market Standing - **Valuation**: Not publicly disclosed - **Key Metrics**: - Annual Revenue: $4.5M (estimated, per LinkedIn) - Total Funding: $211.05M across 5 rounds - **Notable Investors/Partners**: GreatPoint Ventures (led Series A), Celesta Capital (led Series B), Premji Invest (led Series C), HSBC Innovation Banking (debt financing) - **Growth Signals**: Acquired Recogni GmbH; 89 employees (growing ~1% monthly); 12 active job postings (up 20% month-over-month, 140% quarter-over-quarter); talent drawn from top AI teams (Argo AI, Intel, NVIDIA, BMW, Bosch AI Center) ## Competitive Advantages - **Logarithmic compute**: Replaces energy‑intensive multiplications with additions, cutting power consumption at the root. - **Custom 3nm silicon** with built‑in interconnect logic, eliminating traditional bottlenecks. - **Sub‑microsecond interconnect** (under 1,000 ns latency, 1 TB/s any‑to‑any bandwidth) enabling near‑linear scaling across 72 chips. - **9× better space efficiency, 2× faster speed, and 10× cost savings** versus the Nvidia+Groq standard (company claim). - **Fully air‑cooled** – no complex liquid cooling required, lowering deployment friction. ## Strategic Focus Tensordyne is focused on making GenAI inference “profitable at speed and scale” by delivering a drop‑in system that dramatically reduces the total cost of ownership for hyperscale and cloud data centers. Current priorities include scaling production of the Napier system, expanding go‑to‑market with enterprise sales, and deepening the logarithmic quantization ecosystem to support any framework or model. ## Why Work Here - **Culture**: “Build cool tech” – a band of engineers, mathematicians, and chip designers who thrive on solving hard, ambiguity‑rich problems. Values include one team, mission focus, innovate with passion, think like an owner, and act with integrity. - **Remote/Hybrid**: Remote‑friendly; output over location. In‑person gatherings happen when “magic needs to happen.” - **Engineering emphasis**: Deep technical challenges across math, silicon, systems, and software – with a fast‑moving, well‑funded environment. Team spans North America and Europe (offices in Sunnyvale, San Jose, Munich). - **Hiring process**: Mutual discovery – a few calls, possibly a challenge, then fast decisions. ## Sources 1. [tensordyne.ai – About](https://www.tensordyne.ai/about) 2. [tensordyne.ai – Careers](https://www.tensordyne.ai/careers) 3. [tensordyne.ai – Inference System](https://www.tensordyne.ai/inference-system) 4. [linkedin.com – Tensordyne Company Page](https://www.linkedin.com/company/tensordyne) ## Other roles at Tensordyne - [Working Student - LLM Inference Performance](https://feeny.ai/job/working-student-llm-inference-performance-tensordyne-munich-ep2f11b2p27s) — Munich, Germany - [Senior Software Engineer — ML Inference & Numerics](https://feeny.ai/job/senior-software-engineer-ml-inference-numerics-tensordyne-munich-qrmjnkcnqpkp) — Munich, Germany - [System Software / Embedded Engineer](https://feeny.ai/job/system-software-embedded-engineer-tensordyne-sunnyvale-1rwc6exvavsc) — Sunnyvale, CA - [System Software/Embedded Engineer (Munich)](https://feeny.ai/job/system-software-embedded-engineer-munich-tensordyne-munich-ch5fc1wh9yvj) — Munich, Germany - [Software Engineer – Cloud Services – Rust](https://feeny.ai/job/software-engineer-cloud-services-rust-tensordyne-munich-k2jksee9f5k3) — Munich, Germany - [Ops/Developer Platform Engineer](https://feeny.ai/job/ops-developer-platform-engineer-tensordyne-munich-whbc1e2asynv) — Munich, Germany - [Working Student - LLM Quantization & Inference Performance](https://feeny.ai/job/working-student-llm-quantization-inference-performance-tensordyne-munich-j7zc6yravggc) — Munich, Germany - [Staff ASIC STA Engineer](https://feeny.ai/job/staff-asic-sta-engineer-tensordyne-sunnyvale-9sppj4qyy64z) — Sunnyvale, CA - [Simulation & Modeling Engineer](https://feeny.ai/job/simulation-modeling-engineer-tensordyne-munich-4dhthzme0wv5) — Munich, Germany - [Director, AI Systems Solutions Engineering](https://feeny.ai/job/director-ai-systems-solutions-engineering-tensordyne-sunnyvale-2hqajfpnnvmb) — Sunnyvale, CA