--- title: 'Perception Engineer at Lightspeed' canonical: 'https://feeny.ai/job/perception-engineer-lightspeed-northbrook-eq8c65rv5zn9' type: 'job' last_seen: '2026-10-15' --- # Perception Engineer at Lightspeed - **Company:** Lightspeed - **Location:** Northbrook, IL - **Employment:** full-time - **Work type:** onsite - **Posted:** 2026-10-02 - **Last confirmed live:** 2026-10-15 - **Apply:** https://jobs.ashbyhq.com/lightspeed/76140b3b-034f-4aab-8d9b-e304c1e138d3 ## Job description ## About LightSpeed LightSpeed Build Technologies is revolutionizing the construction industry through AI-powered robotics. Our flagship systems—BRUTE for automated wall panel manufacturing and DEX for on-site collaborative construction—are addressing the global housing crisis by delivering unprecedented speed, precision, and affordability in homebuilding. Position Overview As a Perception Engineer, you will own how LightSpeed's robots see. You will design, calibrate, and deploy the multi-camera systems on our robot cells and end-of-arm tooling, and build the perception that guides manipulation in real time. Your camera streams also feed our teleoperation and robot learning pipelines, so the quality of what you build directly shapes how well our robots learn. This role sits at the intersection of sensor hardware, 3D vision, and deep learning, all deployed on physical robots where reliability matters. ## What you'll work on Camera & Sensor Systems - Select, specify, and deploy multi-camera systems (RGB, stereo, depth) for robot cells, including wrist- and tool-mounted cameras on end-of-arm tooling and dexterous hands - Own intrinsic, extrinsic, and hand-eye calibration, and keep calibration reliable across tool changes and daily operation - Synchronize cameras with robot state and teleoperation streams - Work with mechanical engineers on camera placement for coverage, occlusion, and lighting Perception Development - Estimate and track robot and end-effector pose using vision systems to verify kinematics and identify drift - Compare 3D scans against CAD or BIM models to check part placement and as-built accuracy - Localize robots and tools in the workspace using fiducials (AprilTag or ChArUco) and multi-view fusion - Build object detection, segmentation, and 6-DoF pose estimation for parts, fasteners, and tools in cluttered, confined, and poorly lit workspaces - Build point cloud pipelines (filtering, segmentation, registration such as ICP, and meshing) for manipulation and scene understanding - Track hands and objects in egocentric video of human demonstrations - Build CUDA-optimized perception pipelines: GPU preprocessing, custom CUDA kernels where needed, TensorRT inference, and minimal host–device copies - Profile and optimize end-to-end latency, from photon to action, using tools like Nsight Systems Data & Robot Learning Support - Deliver calibrated, time-synchronized camera data in the formats our teleoperation recording and training pipelines consume - Partner with AI/ML engineers to define observation spaces for imitation learning and vision-language-action policies - Set perception accuracy targets tied to task success, and build benchmarks to measure them Integration & Deployment - Integrate perception with ROS2-based robot control - Harden systems for real-world conditions: lighting changes, reflective surfaces, occlusion, and vibration - Collaborate closely with robotics, mechanical, and controls engineers Required Qualifications Perception Expertise - 3+ years building and deploying perception systems on physical robots or real-time systems - Hands-on experience calibrating multi-camera systems (intrinsic, extrinsic, hand-eye) and synchronizing sensors - Experience with RGB-D and stereo cameras in real deployments - Strong computer vision fundamentals: camera geometry, multi-view geometry, and 3D reconstruction - Deep learning experience with detection, segmentation, or pose estimation using PyTorch Software Engineering - Strong Python and C++ - Experience with OpenCV and point cloud libraries such as Open3D or PCL - Experience with ROS or ROS2 - Proficiency with Linux, Docker, Git, and CI/CD workflows ## Preferred Qualifications - MS or PhD in Computer Vision, Robotics, Computer Science, or a related field - Perception for robotic manipulation, especially dexterous or tool-based manipulation - Experience with hardware video encoding (NVENC, Jetson Multimedia API), GStreamer, or WebRTC - Experience with NVIDIA Isaac ROS / NITROS, VPI, or CV-CUDA - Experience with point cloud registration and scan-to-CAD/BIM comparison - Experience with vision foundation models (for example SAM, DINOv2, FoundationPose) - Experience with egocentric video or hand pose estimation - Experience producing sensor data for robot learning datasets (e.g., rosbag or MCAP) - Edge deployment on NVIDIA Jetson with TensorRT - Simulation and synthetic data generation with Isaac Sim, MuJoCo, or similar - Background in manufacturing, industrial automation, or construction technology ## Why Join LightSpeed - Build the eyes of robots that are addressing the housing crisis - Own the full perception stack, from sensor selection to deployed models - Work on rare real-world challenges: confined-space manipulation, dexterous hands, learning from human demonstration - Hands-on culture with direct access to robots, sensors, and manufacturing environments - Competitive compensation and comprehensive benefits Employment Relationship This position is at-will, meaning either you or the Company may terminate employment at any time, with or without cause or notice. ## Equal Opportunity LightSpeed Build Technologies is an equal opportunity employer committed to building a diverse and inclusive workplace. We welcome candidates from all backgrounds and experiences. ## About Lightspeed ## Company Overview - **One-liner**: Lightspeed uses robotics and AI to manufacture precision-engineered panels and components for residential construction, aiming to build homes faster, smarter, and more affordably. - **Entity Type**: Private (Startup) - **Headquarters**: Northbrook, Illinois, United States - **Founded**: Not publicly available (likely 2023-2024 based on current operations) - **Founders**: Biju Kulathakal (serial entrepreneur behind Redbox and Halo Investing) ## Core Business - **Primary industry**: Construction Technology (Contech), Robotics, AI-Powered Manufacturing - **Target customers**: Homebuilders, real estate developers, construction firms (B2B) - **Mission or purpose statement**: "Housing for All" — building homes smarter, faster, and more affordable with robotics and AI. ## Products & Services - **BRUTE Robotic System**: A robotic system designed for heavy-duty construction tasks, targeting a 50% reduction in build time versus traditional methods. - **DEX Robotic System**: A precision robotic system for detailed assembly and finishing work. - **AI-Powered Design & Engineering**: Proprietary AI algorithms that analyze architectural drawings to automatically generate optimized construction sequences, material lists, and robotic instructions. - **Precision-Engineered Panels**: Prefabricated wall and floor panels manufactured to tight tolerances, enabling faster on-site assembly and reduced errors. ## Market Standing - **Valuation/Market Cap**: Not disclosed - **Key Metric**: Not publicly available (likely pre-revenue or early-stage; funding status unknown) - **Notable Investors/Partners**: Founder Biju Kulathakal previously founded Redbox and Halo Investing, suggesting strong investor connections, but no specific investors are named for Lightspeed. - **Growth Signals**: The company is actively hiring (careers page on Ashby), signaling growth. They claim to target 70% reduction in construction errors, 20-30% labor cost savings, and 25% reduction in material waste. ## Competitive Advantages - **Robotic Precision**: Claims tolerances "impossible with manual framing" — a significant differentiator in an industry where quality varies widely. - **Founder Credibility**: Biju Kulathakal has a proven track record building Redbox (a massive kiosk network) and Halo Investing (a fintech platform), suggesting ability to scale. - **Integrated AI-to-Robotics Pipeline**: Full vertical integration from architectural drawing analysis to robotic manufacturing, reducing human error and rework. - **Sustainability Angle**: Precision manufacturing reduces construction waste by ~25%, aligning with ESG trends in real estate. ## Strategic Focus - **Offsite Construction**: The company is riding the McKinsey-predicted trend that 20% of homes will be built offsite in the US by 2030. - **Speed & Labor Reduction**: Core value prop is cutting build time in half and reducing labor dependency — critical as construction labor shortages worsen. - **Scaling Manufacturing**: Likely focused on expanding production capacity at their Northbrook facility and proving the technology with initial clients. ## Why Work Here - **Mission-Driven**: "Housing for All" offers a tangible social impact — helping solve the housing affordability crisis through technology. - **Founder Led**: Working directly with a serial entrepreneur who has scaled companies to national prominence. - **Cutting-Edge Tech**: Hands-on work with robotics, computer vision, AI, and advanced manufacturing — appealing for engineers and operators. - **Early-Stage Impact**: As a likely early-stage company, employees can wear multiple hats and shape the product and culture from the ground up. - **Location**: Northbrook, IL (northern suburb of Chicago) offers a suburban office environment with access to Chicago's talent pool. - **Work Policy**: Not explicitly stated, but the nature of robotics manufacturing suggests a strong on-site presence for hardware roles. **Note**: There is a separate, publicly traded company called Lightspeed Commerce (NYSE: LSPD, TSX: LSPD) that provides POS and e-commerce software. This profile is for Lightspeed (lightspeed.build), the robotics construction startup. Do not confuse the two. ## Sources 1. [lightspeed.build](https://lightspeed.build/) 2. [lightspeed.build/about-us](https://lightspeed.build/about-us) 3. [lightspeed.build/contact-us](https://lightspeed.build/contact-us) 4. [jobs.ashbyhq.com/lightspeed](https://jobs.ashbyhq.com/lightspeed) ## Other roles at Lightspeed - [Residential Design & Preconstruction Specialist](https://feeny.ai/job/residential-design-preconstruction-specialist-lightspeed-northbrook-a8sy1bxmccqz) — Northbrook, IL - [Mechanical Engineer](https://feeny.ai/job/mechanical-engineer-lightspeed-northbrook-yqf4rprszy0s) — Northbrook, IL - [Robot Learning Engineer](https://feeny.ai/job/robot-learning-engineer-lightspeed-northbrook-ham4vyk6erde) — Northbrook, IL - [Robotics Technician](https://feeny.ai/job/robotics-technician-lightspeed-northbrook-5wf4e39h7kre) — Northbrook, IL - [Perception Engineer](https://feeny.ai/job/perception-engineer-applied-intuition-ann-arbor-0j798kp5msx2) — Ann Arbor, MI - [Perception Engineer](https://feeny.ai/job/perception-engineer-saildrone-alameda-76caeg49fzh6) — Alameda, CA - [Perception Engineer](https://feeny.ai/job/perception-engineer-fortastra-corporation-torrance-bvsrn4rbf589) — Torrance, CA - [Perception Engineer](https://feeny.ai/job/perception-engineer-aurelius-systems-san-francisco-xfb0j0b71s8c) — San Francisco, CA - [Perception Engineer](https://feeny.ai/job/perception-engineer-motional-boston-zv8qytdf6q2t) — Boston, MA / United States - [Perception Engineer](https://feeny.ai/job/perception-engineer-human-computer-lab-san-francisco-4cbh6w64pvp5) — San Francisco, CA