--- title: 'AI Compute Engineer at Breakmark' canonical: 'https://feeny.ai/job/ai-compute-engineer-breakmark-colombia-6vn8cxg9zxe4' type: 'job' last_seen: '2026-10-16' --- # AI Compute Engineer at Breakmark - **Company:** Breakmark - **Location:** Colombia - **Employment:** full-time - **Work type:** hybrid - **Posted:** 2026-10-05 - **Last confirmed live:** 2026-10-16 - **Apply:** https://jobs.ashbyhq.com/breakmark/f07fd68b-abe2-4fb4-a4c7-d0e432ea9b98 ## Job description AI Compute Architect πŸ“ MedellΓ­n, Colombia ## About the Role We're building a next-generation AI infrastructure platform that delivers high-performance bare-metal GPU compute for large-scale AI training and inference. As our AI Compute Architect, you'll lead the architecture, qualification, and operational readiness of our GPU infrastructure across rapidly scaling data centers. You'll make the platform work as an integrated production system that connects GPU servers, firmware, OS, NVIDIA software, high-performance fabrics, storage, provisioning, scheduling, observability, and on-site operations. You won't replace our networking, storage, facilities, DevOps, or site-ops specialists, and you won't build every automation pipeline yourself. Your job is to provide the technical model that connects these domains. You'll define requirements, interpret the evidence, find where failures originate, and decide when infrastructure is ready for production. This is a hands-on architecture role, close to the hardware but with a platform-wide view. ## What You'll Do - Define the architecture: Set lifecycle standards for NVIDIA HGX platforms and validated baselines for firmware, BIOS, BMC, OS, drivers, CUDA, and NCCL. Own compatibility requirements and the model of GPU/CPU/memory/PCIe/NVLink/NVSwitch/NIC/storage relationships. Decide what testing each platform change requires before production. - Lead qualification and burn-in: Design the strategy for new clusters, new GPU platforms, repaired nodes, and major changes. That includes load profiles, duration, coverage, and pass criteria. Analyze fleet-wide distributions and outliers to separate isolated failures from systemic issues in hardware, firmware, software, topology, power, thermals, or test configuration. - Diagnose health and performance: Interpret NVIDIA diagnostics and telemetry, covering GPU, NVLink, NVSwitch, PCIe, memory, network, thermal, and power signals. Lead root-cause analysis for intermittent, multi-node, and fleet-wide issues, including collective and point-to-point communication problems. - Validate with real workloads: Define representative training and inference workloads, including dense, MoE, and different parallelism strategies. Set reproducible baselines for throughput, scaling, latency, and numerical behavior, and pinpoint whether degradation comes from compute, communication, storage, scheduling, or configuration. - Integrate across domains: Work with Network (topology, GPU-to-NIC locality, RDMA), Storage (access, checkpointing, recovery), Platform/DevOps (scheduler, containers, provisioning), and Facilities (power, thermal correlation). Route issues to the right specialists with solid evidence. - Own operational readiness and acceptance: Define health, readiness, quarantine, and return-to-service gates. Guide automation teams in building reproducible workflows and interpret their results. Translate customer requirements into validation strategies, rule platforms ready, degraded, conditional, or unsuitable, define remediation and re-test scope, and communicate risks to engineering, vendors, customers, and leadership. Required Qualifications - Strong hands-on experience with NVIDIA GPU infrastructure, including HGX or comparable large GPU server platforms. - Demonstrated experience designing, executing, or leading burn-in and qualification across multi-node GPU clusters on H100, H200, B200, B300, or a comparable platform (direct B300 experience not required). - Experience analyzing fleet-level qualification results, performance distributions, and hardware/software failures. - Strong Linux systems administration and troubleshooting. - Experience with NVIDIA drivers, CUDA, NCCL, DCGM, and GPU platform tooling. - Experience diagnosing GPU, NVLink, NVSwitch, PCIe, thermal, power, or firmware problems. - Experience validating intra-node and multi-node GPU communication, plus a working understanding of RDMA, GPUDirect RDMA, and high-performance AI fabrics. - Experience deploying, provisioning, or operationalizing GPU clusters. - Experience defining firmware, BIOS, OS, and software baselines, as well as health, quarantine, readiness, and return-to-service criteria. - Experience interpreting distributed training or inference workload behavior. - Ability to troubleshoot performance across GPU, host, network, storage, and software boundaries. - Ability to define requirements for automation teams and interpret the outputs of automated validation systems. - Strong root-cause analysis and problem-solving skills. - Clear communication of technical findings, risk, and remediation requirements. - Comfortable in fast-moving deployment, commissioning, and production environments. ## Preferred Qualifications - NVIDIA B200 or B300 infrastructure. - ConnectX adapters, NVIDIA Quantum, InfiniBand, UFM, RoCE, or comparable networking. - Large-scale NCCL and distributed workload qualification. - PyTorch, NeMo, Megatron, vLLM, or TensorRT-LLM. - GPU schedulers such as Slurm, Kubernetes, Run:ai, Base Command, or equivalent. - Validating shared storage and distributed checkpointing on high-performance platforms such as WEKA, VAST, or equivalent. - Infrastructure automation, observability, telemetry, or fleet-management platforms. - Formal customer acceptance testing. - Operating GPU infrastructure across multiple data centers. - Python, Bash, or equivalent scripting for troubleshooting infrastructure workflows. ## What We Value Engineers who have qualified and operated real GPU clusters and who understand what a test reveals, not just how to run it. We value evidence-based judgment, strong ownership of platform integrity, cross-domain leadership without overreach, disciplined and reproducible operations, clear communication of risk and uncertainty, and curiosity across GPU generations. ## About Breakmark ## Company Overview - **One-liner**: Breakmark is a People Architecture firm that partners with fast-growing startups to design scalable HR strategy, global hiring infrastructure, and talent acquisition processes. - **Entity Type**: Private (bootstrapped, no funding rounds disclosed) - **Headquarters**: New York, United States (with team presence in Argentina, Spain, and Ecuador) - **Founded**: 2025 - **Founders**: Angie Udry (Founder & CEO) ## Core Business - **Primary industry/industries**: Human Resources Services, HR Technology & Advisory - **Target customers**: B2B; early-stage to mid-growth startups and scaleups (primarily in technology, fintech, AI, SaaS, and marketplace sectors) - **Mission or purpose statement**: To help companies build the people systems they need to scale β€” from first hire to global expansion. ## Products & Services - **Fractional CHRO / HR Strategy & Advisory**: Senior-level HR thinking (organizational design, compensation frameworks, culture definition, performance management) delivered on a fractional basis. - **Employer of Record (EOR)**: Allows startups to hire employees internationally without setting up a legal entity; handles payroll, taxes, benefits, and compliance. - **Contractor of Record (COR)**: Compliant engagement of independent contractors across any jurisdiction, including contracts, payments, and risk mitigation. - **Talent Acquisition (RPO & Executive Search)**: Full-cycle recruitment, sourcing strategy, executive headhunting, interview frameworks, and offer management for technical and leadership roles. - **HR Compliance & Policy**: Labor law audits, policy design, and ongoing regulatory protection across jurisdictions. - **People Operations**: Day-to-day HR support – onboarding, performance management, employee experience. ## Market Standing - **Valuation/Market Cap**: Not disclosed (private, no reported funding) - **Key Metric**: Total funding β€” none public; estimated employee headcount of 4 (per LinkedIn) - **Notable Investors/Partners**: Not disclosed; clients are high-growth startups across LatAm, Europe, US, APAC, and MENA - **Growth Signals**: LinkedIn following of 6,276 (as of mid-2026); monthly employee growth of +25%; active job postings for roles such as Talent Acquisition Consultant, CEO Office Associate, Engineering Manager, and Financial Controller ## Competitive Advantages - **Startup-Native**: Built specifically for companies that are still figuring things out and moving fast, unlike traditional HR firms serving large enterprises. - **Senior-Level Expertise**: Clients work directly with experienced HR professionals (no junior consultants) who have built people programs at high-growth companies. - **Global Reach with Compliance**: EOR and COR services eliminate legal and administrative barriers to hiring globally, with fast setup (days, not weeks) and full misclassification risk protection. - **People-First Philosophy**: Recommendations grounded in what is genuinely best for the team, not cookie-cutter solutions. - **Agile & Scalable**: Adapts as fast as the startup pivots or scales headcount, offering flexible engagement models from fractional CHRO to full RPO. ## Strategic Focus - **Current priorities**: Expanding global EOR/COR capabilities; deepening talent acquisition offerings for technical and leadership roles; building a remote-first team across the Americas and Europe to serve a diverse international clientele. - **Direction for growth**: Scaling the People Architecture model to become the go-to HR partner for startups moving from first hire to hundreds of employees, with a particular focus on cross-border expansion. ## Why Work Here - **Culture highlights**: Collaborative, entrepreneurial, and high-performance culture; opportunity to work directly with founders and executive teams of fast-growing startups. - **Remote/hybrid/office policy**: Fully remote work environment (as stated in job postings for Talent Acquisition Consultant). - **Notable perks or engineering culture**: Exposure to some of the fastest-growing startups globally; international and diverse client portfolio; significant professional growth and development opportunities; a chance to shape the people foundations of emerging tech companies. ## Sources 1. [breakmarkhr.com](https://www.breakmarkhr.com/) – Company services, team, and value proposition. 2. [linkedin.com](https://www.linkedin.com/company/breakmarkhr) – Company details, employee count, growth, and recent updates. 3. [tealhq.com](https://www.tealhq.com/job/talent-acquisition-consultant_7ea1a74581f12858fc3a18fcc6b03244a91dc) – Job posting with benefits and role description. 4. [linkedin.com](https://linkedin.com/in/angieudry) – Founder profile and background. 5. [jobs.ashbyhq.com](https://jobs.ashbyhq.com/breakmark) – Active job postings. ## Other roles at Breakmark - [Head de Despliegue de Infraestructura de Data Center](https://feeny.ai/job/head-de-despliegue-de-infraestructura-de-data-center-breakmark-colombia-shaawww0ebf4) β€” Colombia - [Forward Deploy Engineer NYC](https://feeny.ai/job/forward-deploy-engineer-nyc-breakmark-new-york-c9a1gnwz8skj) β€” New York, NY - [Gerente de Operaciones CDMX](https://feeny.ai/job/gerente-de-operaciones-cdmx-breakmark-mexico-wnsbhnw537h2) β€” Mexico - [Head of Risk and Compliance](https://feeny.ai/job/head-of-risk-and-compliance-breakmark-brazil-ppb9ez82jh4s) β€” Brazil - [GM Vietnam](https://feeny.ai/job/gm-vietnam-breakmark-vietnam-htyyjm0vn2ds) β€” Vietnam - [Head of Network Engineering](https://feeny.ai/job/head-of-network-engineering-breakmark-colombia-js5rjjeszdvm) β€” Colombia - [CTO Vietnam](https://feeny.ai/job/cto-vietnam-breakmark-vietnam-mn50a7w053vd) β€” Vietnam - [CTO Thailand](https://feeny.ai/job/cto-thailand-breakmark-thailand-yckez25wn1q9) β€” Thailand - [CTO Japan](https://feeny.ai/job/cto-japan-breakmark-japan-qvyw6cnssh2e) β€” Japan - [Forward Deploy Engineer (SPG)](https://feeny.ai/job/forward-deploy-engineer-spg-breakmark-singapore-5z5g2rmv9s9n) β€” Singapore