---
title: 'AI/ML Engineer (Mid-level to Principal) at Prophecy'
canonical: 'https://feeny.ai/job/ai-ml-engineer-mid-level-to-principal-prophecy-san-francisco-california-vghfgj8bs73t'
type: 'job'
last_seen: '2026-09-04'
---

# AI/ML Engineer (Mid-level to Principal) at Prophecy

- **Company:** Prophecy
- **Location:** San Francisco California, United States
- **Posted:** 2026-05-04
- **Last confirmed live:** 2026-09-04
- **Apply:** https://job-boards.greenhouse.io/prophecysimpledatalabs/jobs/5125696007

## Job description

## About Prophecy

The leader in AI-native data preparation and analysis, Prophecy is revolutionizing how the world’s top enterprises turn data chaos into reliable insights. We introduce the AI-native data lifecycle (generate, refine, deploy) where our industry leading AI agents and humans work hand-in-hand in visual and document interfaces to analyze, transform and prepare data, to ship trusted insights at enterprise scale. To learn more, visit us on [LinkedIn](https://www.linkedin.com/company/prophecy-ai/posts/?feedView=all).

## The Role

You'll own the intelligence layer at Prophecy: the AI systems that let our agents understand data schemas, generate correct transformations, and reason over enterprise knowledge. This isn't a role where you implement someone else's spec — you make the calls on agent architecture, model selection, quality evaluation, and build vs. buy. The scope scales with you; strong engineers have enormous leverage here regardless of title.

## What You'll Own

Agent design and quality. Architect multi-step AI agents end-to-end — problem decomposition, context retrieval, error recovery, output quality. Set the bar, build the evals, own the improvement loop.

Retrieval and knowledge systems. Own the RAG pipelines, vector and graph-based retrieval, and knowledge representations that let agents reason accurately over customer schemas, lineage, and semantics.

Code generation and data transformation. Own the AI layer behind Prophecy's core capability — natural language to production-grade transformations: prompt design, model selection, fine-tuning, output validation.

Production AI. Make AI that works in the lab work at scale — latency, throughput, observability, knowing when to optimize a model vs. restructure a system.

## Who You Are

You've built coding agents or AI systems in production and owned them when things break. You think in failure modes and evaluation strategy, not capability demos. You make architectural decisions under uncertainty and know when to move fast versus when to do it right.

You're a builder who loves picking up new technologies — in a field where last year's best practice may already be obsolete, that instinct matters. You have a strong perspective on how coding agents should work and bring it to design discussions, not just implementation.

Experience level is flexible; what matters is the track record. We'd expect 4–6+ years in software engineering with meaningful AI/ML depth.

Stack and Background We Value

Python is the primary language. Retrieval infrastructure spans vector databases and knowledge graphs (Neo4j), backed by AWS and Kubernetes. Scala and Go are meaningful plusses — our language compiler and orchestrator are built on them. Our platform integrates with Databricks, Snowflake, BigQuery, DuckDB, and Spark; experience with any of these, or with data processing and analytics broadly, is genuinely valuable.

Location: San Mateo office, 2–3 days/week

Compensation: $250,000–$350,000 base + equity, calibrated to level.

## Benefits and Perks

- Prophecy covers 99% of employee health insurance premiums and 75% for dependents
- We offer $200 per month towards remote work, wellness, gyms, massages, facials, and more!
- Flexible PTO
- Professional development allowance
- Company sponsored Long Term Disability and Life Insurance, FSA/HSA, dental, vision, and more
- Ability to have your fingerprint on an innovative platform
- End-to-end ownership of your projects.

*Benefits and perks may vary per country

Prophecy is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, colour, religion, sex, national origin, age, disability, or veteran status.

## About Prophecy

## Company Overview
- **One-liner**: Prophecy is an AI-powered data preparation and analysis platform that lets business teams describe data needs in natural language and automatically generates production-ready visual data workflows.
- **Entity Type**: Private (funding stage not publicly disclosed)
- **Headquarters**: Palo Alto, California, United States
- **Founded**: 2017
- **Founders**: Raj Bains (CEO), Vikas Marwaha, Maciej Szpakowski

## Core Business
- **Primary industry**: AI data preparation and analysis, cloud-native data engineering
- **Target customers**: B2B enterprise — Fortune 500 companies in finance, healthcare, retail, and technology; business data teams and analysts
- **Mission**: “Make insights faster, more reliable, and accessible to everyone” by uniting AI, simplicity, and powerful systems so every team can build, refine, and share data together.

## Products & Services
- **[Prophecy Platform – Agentic Data Prep & Analysis](https://www.prophecy.ai/)**: A SaaS platform that uses AI agents (powered by Claude Code) to automatically generate visual data workflows from plain‑English descriptions. Users inspect, refine, and validate the logic, then deploy as high‑performance code on Databricks, Snowflake, or BigQuery. Supports both standalone use and native deployment on existing cloud data platforms. Offers a free Professional tier and an Express tier with onboarding support.

## Market Standing
- **Valuation / Market Cap**: Not publicly available
- **Key Metric**: Total funding not disclosed; annual revenue not publicly available
- **Notable Investors / Partners**: Board members include Ilya Kirnos, George Mathew, Burke Norton, Kai Yang, Elena Zislin (specific investment firms not listed). Trusted by leading enterprises including HSBC, JP Morgan, Microsoft, Amgen, ClearWater, SAP, Ralph Lauren, Deutsche Telekom, Marks & Spencer, and Toyota.
- **Growth Signals**: 173 employees (LinkedIn, as of mid‑2026); 13 active job postings (+225% quarterly); 32,189 LinkedIn followers (+1.9% monthly). Offices in Palo Alto (HQ), Bengaluru, and Gurgaon.

## Competitive Advantages
- **AI‑first approach**: Specialized AI agents that understand data context and generate pipelines from natural language, reducing manual engineering from hours to minutes.
- **Cloud‑native, no vendor lock‑in**: Runs natively on Databricks, Snowflake, and BigQuery; produces open, production‑grade code that stays under the customer’s governance.
- **Human‑in‑the‑loop validation**: Visual workflows allow business users to inspect and refine every step, building trust and ensuring accuracy.
- **Enterprise‑grade**: Role‑based access control, audit logging, compliance certifications, and dedicated support.

## Strategic Focus
- **Democratizing data work**: Shifting data preparation and analysis from specialist engineers to business users, enabling self‑service analytics.
- **AI‑driven data lifecycle**: Expanding the “generate → refine → deploy” loop with multi‑modal collaboration (text, visual, code).
- **Deep platform integrations**: Continuing to build native support for major cloud data platforms and expanding enterprise partnerships.

## Why Work Here
- **Culture**: Described as “fast‑moving,” “curious builders and bold thinkers,” with values of respect, ownership, humility, and innovation. Emphasis on customer impact and growing together.
- **Work policy**: Hybrid in San Francisco (HQ); remote options for some roles (e.g., Senior Product Manager – Structured Finance, Director Strategic Partnerships). Engineering roles available in Bengaluru and Gurgaon.
- **Engineering culture**: Work on AI agents, distributed systems, and visual design tools. Opportunities to shape the future of data workflows and collaborate with a diverse, cross‑continental team.
- **Notable perks**: Not explicitly listed, but the company offers free Professional tier for individuals and a 90‑day onboarding program (Prophecy Express) for organizations.

## Sources
1. [Prophecy AI – Homepage](https://www.prophecy.ai/)
2. [Prophecy AI – About Page](https://www.prophecy.ai/about)
3. [Prophecy AI – Careers Page](https://www.prophecy.ai/careers)
4. [LinkedIn – Prophecy](https://www.linkedin.com/company/prophecy-ai)
5. [Greenhouse Job Board – Prophecy](https://job-boards.greenhouse.io/prophecysimpledatalabs/jobs/5118369007)

## Other roles at Prophecy

- [Senior AI Product Manager](https://feeny.ai/job/senior-ai-product-manager-prophecy-san-francisco-california-nnrambzvsnsa) — San Francisco California, United States
- [Operations Manager (Contract)](https://feeny.ai/job/operations-manager-contract-prophecy-san-mateo-dg1qfe2w1gks) — San Mateo, CA
- [Senior Director of Revenue Operations](https://feeny.ai/job/senior-director-of-revenue-operations-prophecy-united-states-ekzgh72nwdwq) — United States
- [Marketing SDR](https://feeny.ai/job/marketing-sdr-prophecy-united-states-3bwg739n85eq) — United States
- [Staff Software Engineer](https://feeny.ai/job/staff-software-engineer-prophecy-bengaluru-ajn5c1dz8kc0) — Bengaluru, India
- [Senior DevOps Engineer](https://feeny.ai/job/senior-devops-engineer-prophecy-bengaluru-dkghe8zj42rq) — Bengaluru, India
- [Director, Strategic Partnerships](https://feeny.ai/job/director-strategic-partnerships-prophecy-san-francisco-rj7zwqemztga) — San Francisco, CA