---
title: 'Perception Engineer | Localisation, Sensor Fusion & World Building at Breaker'
canonical: 'https://feeny.ai/job/perception-engineer-localisation-sensor-fusion-world-building-breaker-sydney-rwwjwj1a54e6'
type: 'job'
last_seen: '2026-09-11'
---

# Perception Engineer | Localisation, Sensor Fusion & World Building at Breaker

- **Company:** Breaker
- **Location:** Sydney, Australia
- **Employment:** full-time
- **Work type:** onsite
- **Posted:** 2026-05-14
- **Last confirmed live:** 2026-09-11
- **Apply:** https://jobs.ashbyhq.com/breaker/8c8ff828-4406-48c2-9837-57d8dceeedaa

## Job description

Perception Engineer — Localisation & Sensor Fusion - Sydney

## TL;DR

- Own and evolve Breaker's 3D localisation pipeline — turning 2D detections into accurate real-world coordinates using passive sensors only
- Deep-stack work in camera-based localisation, sensor fusion, and real-time data processing on edge hardware
- Looking for a mid-to-senior engineer who has deployed production localisation systems on moving robotic platforms
- You'll build the metrics, tooling, and processes to continuously improve localisation accuracy across diverse hardware configurations
- Must have working rights in Australia and be willing to participate in regular field testing
- Join an exciting startup backed by globally recognised investors at the bleeding edge of physical AI

## About Breaker

The way humans use robots is broken. Modern problems demand more robots than we have operators. Every drone, ground vehicle, and maritime system requires dedicated training, manual control, and constant oversight. One operator per robot. One pilot per mission. Breaker's AI agent breaks this constraint. Our technology turns any robot into a truly autonomous, self-organizing teammate. Operators command and query teams of robots through natural language conversations over the push-to-talk radios they already carry, no laptops, no controllers, no additional gear. Instead of manually flying search patterns across three different screens, you say, "survey this area and flag anything unusual." The robot team figures out how to divide the task, coordinate their movements, and report back what matters. We're fundamentally changing the operator-to-robot ratio. Small teams become force multipliers. Our software deploys directly onboard each robot, enabling real-time, intent-driven control even in contested environments with limited bandwidth. We're solving problems most AI companies never touch: sub-second inference on edge hardware with strict latency, power, and connectivity constraints. We're backed by some of the best investors globally and growing our team across Austin, Texas, and Sydney, Australia. We're a small team of experienced engineers moving fast on technology that will define how humans and machines work together for decades to come. Join us if you want to help build the robots we were promised 🤖

## About the Role

One of the most critical outputs of Breaker's product is putting accurate points on a map — taking 2D detections from camera systems and resolving them into precise 3D world coordinates. This is a hard, fascinating problem: we do it without LIDAR or active ranging, using passive sensors on moving platforms in unpredictable environments. You'll own this pipeline end-to-end. This is a greenfield ownership opportunity. You'll take an existing localisation system and make it yours by building the measurement infrastructure to quantify performance, researching and implementing new techniques, and expanding existing capability into areas like tracking moving objects from moving platforms and generalising across diverse camera hardware. You'll define the contracts between your system and the teams that feed into it (computer vision, hardware, field operations) and build the data workflows that turn real-world testing into continuous improvement. You'll work at the deepest level of our software stack, where real-time sensor data meets geometric reasoning. If you're the kind of engineer who gets energy from digging into a dataset to find where localisation breaks, running experiments to prove a new approach works, and building the automation to measure it all.

## Key Responsibilities

- Own the accuracy and performance of Breaker's 3D localisation pipeline, from 2D bounding boxes in, lat/long/alt out
- Build metrics, ground truth collection processes, and automated evaluation tooling to measure and track localisation performance
- Research, prototype, and deploy new localisation and sensor fusion techniques to improve accuracy and robustness
- Extend the system to track moving objects from moving platforms
- Generalise the localisation pipeline to deploy reliably across different camera systems and hardware configurations
- Define interface contracts with adjacent systems like what the CV pipeline must deliver, what camera hardware must provide
- Process and analyse field data to identify failure modes, validate improvements, and feed findings back into the development loop
- Design and specify field test scenarios (CONOPs-style) to stress-test specific localisation behaviours
- Participate in regular field testing, including training field teams on data collection requirements
- Conduct software-in-the-loop and hardware-in-the-loop testing and experimentation

## About You

Required Skills & Experience

- Demonstrated experience with camera-based localisation on moving robotic platforms. Monocular or stereo, not LIDAR-dependent
- Strong sensor fusion fundamentals. You understand timing, calibration, and the realities of combining data from multiple real-time sensor streams
- Experience processing real-time data on constrained or edge-deployed hardware
- Proven ability to dig into robotic datasets, identify where systems fail, and systematically troubleshoot localisation problems
- Familiarity with optimisation backends (Ceres, GTSAM, or similar) for geometric inference
- Proficiency in Python and/or C++
- Comfortable working in Linux environments
- Have deployed a production system, not just research prototypes or thesis projects
- Must have working rights in Australia
- Willing to participate in regular field testing

Highly Valued Experience

- GPS-denied navigation or localisation work
- Photogrammetry or large-scale imagery processing pipelines
- Robotic manipulation with visual servoing or camera-based feedback
- Experience with gimbaling camera systems and their associated complexities
- Understanding of machine learning strengths and limitations as an input to geometric systems
- Multi-platform data fusion (combining data from multiple robotic platforms)
- ROS/ROS2 development experience
- Experience with drones or other UAV platforms
- Startup or scale-up environment experience
- Australian citizenship (preferred but not required)

Why Join Us? You'll be an owner, not a renter. We're at the stage where foundational decisions are still being made and entire systems need to be built from scratch. Your work won't be maintaining someone else's legacy — you'll be creating what comes next. The problems you solve and the systems you build will define how Breaker scales. You'll work with people who've done this before. Our team has shipped production robotics systems, scaled infrastructure, and solved the kind of hard integration problems that only come up when software meets the physical world. You won't be the only person in the room who's debugged a sensor fusion pipeline or optimized inference on a Jetson. You'll solve problems that don't exist anywhere else. Most companies are building incremental improvements on established technology. We're defining new categories — which means the work is harder, more ambiguous, and infinitely more interesting. You'll work hard, together. We're in the office every day, grinding on hard problems alongside great people. We've built a workspace where the best work happens — access to hardware, quick decisions, real collaboration. We're flexible when life requires it, but we're looking for people who want to show up, get stuck in, and build something significant with a team they respect. We're going global. Backed by globally recognised investors, we're growing teams across Sydney, Australia and Austin, Texas. If you want exposure to international expansion and the opportunity to help build across regions, that path exists here. You'll own what you build. Generous equity packages mean when Breaker wins, you win.

Location. Cicada Innovations, Eveleigh, Sydney, Australia (National Innovation Centre)

If you're excited about the opportunity to work at the bleeding edge of physical AI, we'd love to hear from you.

## About Breaker

## Company Overview
- **One-liner**: Breaker builds a platform-agnostic AI agent called Avalon that turns any robot into an autonomous teammate, enabling a single operator to orchestrate multi-domain robot teams via natural voice command.
- **Entity Type**: Private (Pre-seed stage)
- **Headquarters**: Sydney, NSW, Australia (with a US headquarters in Austin, Texas)
- **Founded**: Not publicly available (recently active; raised funding in March 2025)
- **Founders**: Matthew Buffa (Co-CEO & Co-Founder), Michael Irwin (Co-CEO & Co-Founder), Vanja Videnovic (CTO & Co-Founder)

## Core Business
- **Primary industry/industries**: Defense technology, autonomous systems, artificial intelligence, robotics
- **Target customers**: Defense departments and government agencies (initial focus), with potential for commercial applications (e.g., logistics, industrial inspection, agriculture)
- **Mission/purpose statement**: "To redefine what autonomy must deliver when it matters most" — breaking the 1:1 operator-to-robot ratio by enabling hands-free, voice-controlled coordination of multi-platform autonomous teams, especially in contested, connectivity-constrained environments.

## Products & Services
- **[Avalon (Orchestrator Agent)]**: The core product — a platform-agnostic AI agent deployed onto existing hardware (UAVs, ground rovers, surface vessels) that translates natural language voice commands into coordinated multi-platform actions. Runs 100% onboard with zero cloud dependency. Includes mission brief ingestion, contextual decision-making, perception and tracking, two-way voice command, auditable decision trails (plain-English "why" explanations), and after-action reports. Integrates via standard platform APIs — no stack modifications required.

## Market Standing
- **Valuation**: Not disclosed (private company)
- **Total Funding**: $2 million pre-seed (led by Main Sequence, closed March 2025)
- **Key Metric**: Seed-stage capital raised
- **Notable Investors/Partners**:
  - **Lead Investor**: Main Sequence (Australian deep-tech VC)
  - **Strategic Partner**: SensorOps (photorealistic simulation for AI training)
- **Growth Signals**: 
  - Opened US headquarters in Austin, Texas (April 2025)
  - Partnership with SensorOps for simulation-accelerated development (May 2025)
  - Attracting talent from leading defense/autonomy industries
  - Product (Avalon) is operational and being deployed via an Alpha Program
  - Addressing a well-identified DoD capability gap (the operator bottleneck), as noted by the CEO

## Competitive Advantages
- **Platform-agnostic**: Works across UAVs, ground rovers, and surface vessels — no vendor lock-in or hardware modification required.
- **Zero cloud dependency**: Runs entirely onboard existing compute, enabling operation in contested or disconnected environments.
- **Voice-first, hands-free**: Natural language command over PTT radios removes the need for screens, controllers, or specialized operator training.
- **Auditable AI**: Every decision is traceable to plain-English mission rules, with full "explainability" for operators and an after-action audit trail.
- **1:N control**: A single operator can command multiple heterogeneous platforms simultaneously, breaking the current bottleneck in scaling robot teams.

## Strategic Focus
- **Scaling the team**: Actively hiring in Sydney and Austin across engineering roles (robotics software, perception, platform/DevSecOps) and business operations.
- **Alpha Program deployment**: Expanding Avalon onto more partner platforms and proving capability in real-world defense use cases.
- **US market expansion**: Establishing a physical presence in Austin to engage with the US defense ecosystem and DoD customers.
- **Partnership development** (e.g., with SensorOps) to accelerate simulation-based validation and training.

## Why Work Here
- **Mission-driven work**: Tackling one of the hardest unsolved problems in modern defense — breaking the operator bottleneck in autonomous systems. The work has direct operational impact in high-stakes environments.
- **Deep-tech engineering culture**: Solving cutting-edge problems in autonomous navigation, sensor fusion, real-time edge computing, and AI safety. The stack spans perception, motion planning, NLP, and distributed systems.
- **Small, high-impact team**: ~15 employees (per Built In profile). Engineers own significant pieces of the stack and work alongside founders daily.
- **Global presence**: Offices in Sydney (Australia) and Austin (Texas, USA), offering a cross-continental work environment.
- **Physical field testing**: Robotics engineers validate their work through hands-on field testing — not just simulation.
- **On-site work**: Roles are listed as on-site in Sydney or Austin, signaling a hands-on, collaborative engineering culture essential for hardware/software integration.
- **Entry point for operations**: The Operations Coordinator role offers a clear path to growing the operations function, suitable for someone wanting to grow with the company.

## Sources
1. [breakerindustries.com - Homepage](https://www.breakerindustries.com/)
2. [breakerindustries.com - Company](https://www.breakerindustries.com/company)
3. [breakerindustries.com - Careers](https://breakerindustries.com/careers)
4. [Breaker on Built In](https://builtin.com/company/breaker)
5. [Breaker on LinkedIn](https://www.linkedin.com/company/breaker-industries)

## Other roles at Breaker

- [Field Operations Engineer](https://feeny.ai/job/field-operations-engineer-breaker-sydney-ss2s3cm26tm2) — Sydney, Australia
- [Robotic Software Engineer](https://feeny.ai/job/robotic-software-engineer-breaker-sydney-8wrstcfjhbdg) — Sydney, Australia