--- title: 'Staff Software Engineer at Prophecy' canonical: 'https://feeny.ai/job/staff-software-engineer-prophecy-bengaluru-ajn5c1dz8kc0' type: 'job' last_seen: '2026-09-04' --- # Staff Software Engineer at Prophecy - **Company:** Prophecy - **Location:** Bengaluru, India - **Posted:** 2026-07-20 - **Last confirmed live:** 2026-09-04 - **Apply:** https://job-boards.greenhouse.io/prophecysimpledatalabs/jobs/5188371007 ## Job description ## About Prophecy The leader in AI-native data preparation and analysis, Prophecy is revolutionizing how the world's top enterprises turn data chaos into reliable insights. We introduce the AI-native data lifecycle (generate, refine, deploy) where our industry leading AI agents and humans work hand-in-hand in visual and document interfaces to analyze, transform and prepare data, to ship trusted insights at enterprise scale. To learn more, visit us on LinkedIn. Position Summary This is an exceptional opportunity to be a technical leader on the team that powers the heart of Prophecy: the Runtime, our orchestration and execution service. Every data workflow , whether generated by our AI data agents or built by a human in the visual editor , is planned, scheduled, and run at enterprise scale by Runtime, directly against the customer's own platform (Databricks, Snowflake, BigQuery, and more). When a business user asks an agent a question and sees trusted results seconds later, Runtime is what made it happen. As a Staff Engineer, you will set the technical direction for this service: the distributed execution engine, the task coordinator, the multi-engine connectors, and the fast interactive previews that make the AI-native experience feel instant. You will own hard, ambiguous, high-leverage problems end-to-end , from architecture to production reliability , and raise the bar for the engineers around you. We're seeking A players to work with A players. We're a high-growth company on a once-in-a-lifetime journey to revolutionize the way data is prepared and analyzed. Be a part of it. The impact you will have Own the engine behind the product. Architect and evolve the runtime service that turns agent- and human-authored data workflows into high-performance jobs that run reliably in production and interactively during authoring. This is deep-tech at the center of the platform. Make it fast and make it scale. Design the distributed execution and task-coordination layer , scheduling, concurrency, resource management, streaming of sample data (interims) , so that pipelines run efficiently from a single interactive preview to large production workloads. Run everywhere the customer's data lives. Extend execution across multiple engines and warehouses , Databricks, Snowflake, BigQuery, Spark, dbt, Airflow , with first-class connectors, query pushdown, and consistent behavior across clouds. Power the AI data agents. Build the execution path that lets our agents generate, run, validate, and refine pipelines in a tight loop , the difference between a plausible answer and a trusted one. Own reliability and observability. Drive production robustness: fault tolerance, graceful degradation, recovery and restartability, monitoring, and the SLAs that enterprise customers depend on. Lead technically. Set architecture and standards, drive cross-team designs, and mentor engineers. Own features and initiatives end-to-end, as a founder would , from the requirement to delivery. We don't believe in hierarchy or years of experience for their own sake; we believe in ownership and impact. ## What You’ll Need - 5+ years of backend engineering experience building distributed systems or data-intensive services, with a track record of solving deep-tech problems - Deep expertise in distributed systems fundamentals: scheduling, task coordination, concurrency, resource management, and fault tolerance will help you succeed. - Strong proficiency in a systems language such as Go, Scala, or Java (our runtime is primarily Go and Python; functional-programming experience is a plus) - Hands-on experience running data at scale , with Spark and/or cloud data warehouses (Databricks, Snowflake, BigQuery) and query execution - A strong foundation in data structures, algorithms, and software design, with excellent analytical and debugging skills - Experience owning the reliability, performance, and observability of a production service - A demonstrated ability to lead technically , driving architecture, influencing across teams, and raising the quality bar for others - Comfort working in short, agile, iterative development cycles - Entrepreneurial spirit, priding yourself on getting things done with a high level of quality - Strong desire to work in a fast-moving startup environment with high ownership and attention to detail - You have been a top performer your entire career and hold yourself to very high standards - B Tech or above degree in CS or equivalent ## Preferred Qualifications - Experience integrating with multiple execution backends or building multi-cloud data connectors - You have built platforms or services that other engineers and products build on top of - Familiarity with AI/agent execution paths , running and validating LLM- or agent-generated code - Experience building an execution engine, orchestrator, or query engine (e.g. Airflow, Spark internals, query planners/optimizers such as Apache Calcite, or dbt) - You have shipped software over multiple releases, including systems where you drove the delivery of the first version - Ability to assess new technologies and make pragmatic choices that guide us toward a long-term vision ## What You’ll Have At Prophecy - Great company culture. - Competitive compensation. - Fair and Open Equity awards for everyone. - Amazing work. - Private medical insurance. - Manage your own growth and career. - Experience building a transformative product. - High learning opportunity. - End-to-end ownership of your project. ## About Prophecy ## Company Overview - **One-liner**: Prophecy is an AI-powered data preparation and analysis platform that lets business teams describe data needs in natural language and automatically generates production-ready visual data workflows. - **Entity Type**: Private (funding stage not publicly disclosed) - **Headquarters**: Palo Alto, California, United States - **Founded**: 2017 - **Founders**: Raj Bains (CEO), Vikas Marwaha, Maciej Szpakowski ## Core Business - **Primary industry**: AI data preparation and analysis, cloud-native data engineering - **Target customers**: B2B enterprise — Fortune 500 companies in finance, healthcare, retail, and technology; business data teams and analysts - **Mission**: “Make insights faster, more reliable, and accessible to everyone” by uniting AI, simplicity, and powerful systems so every team can build, refine, and share data together. ## Products & Services - **[Prophecy Platform – Agentic Data Prep & Analysis](https://www.prophecy.ai/)**: A SaaS platform that uses AI agents (powered by Claude Code) to automatically generate visual data workflows from plain‑English descriptions. Users inspect, refine, and validate the logic, then deploy as high‑performance code on Databricks, Snowflake, or BigQuery. Supports both standalone use and native deployment on existing cloud data platforms. Offers a free Professional tier and an Express tier with onboarding support. ## Market Standing - **Valuation / Market Cap**: Not publicly available - **Key Metric**: Total funding not disclosed; annual revenue not publicly available - **Notable Investors / Partners**: Board members include Ilya Kirnos, George Mathew, Burke Norton, Kai Yang, Elena Zislin (specific investment firms not listed). Trusted by leading enterprises including HSBC, JP Morgan, Microsoft, Amgen, ClearWater, SAP, Ralph Lauren, Deutsche Telekom, Marks & Spencer, and Toyota. - **Growth Signals**: 173 employees (LinkedIn, as of mid‑2026); 13 active job postings (+225% quarterly); 32,189 LinkedIn followers (+1.9% monthly). Offices in Palo Alto (HQ), Bengaluru, and Gurgaon. ## Competitive Advantages - **AI‑first approach**: Specialized AI agents that understand data context and generate pipelines from natural language, reducing manual engineering from hours to minutes. - **Cloud‑native, no vendor lock‑in**: Runs natively on Databricks, Snowflake, and BigQuery; produces open, production‑grade code that stays under the customer’s governance. - **Human‑in‑the‑loop validation**: Visual workflows allow business users to inspect and refine every step, building trust and ensuring accuracy. - **Enterprise‑grade**: Role‑based access control, audit logging, compliance certifications, and dedicated support. ## Strategic Focus - **Democratizing data work**: Shifting data preparation and analysis from specialist engineers to business users, enabling self‑service analytics. - **AI‑driven data lifecycle**: Expanding the “generate → refine → deploy” loop with multi‑modal collaboration (text, visual, code). - **Deep platform integrations**: Continuing to build native support for major cloud data platforms and expanding enterprise partnerships. ## Why Work Here - **Culture**: Described as “fast‑moving,” “curious builders and bold thinkers,” with values of respect, ownership, humility, and innovation. Emphasis on customer impact and growing together. - **Work policy**: Hybrid in San Francisco (HQ); remote options for some roles (e.g., Senior Product Manager – Structured Finance, Director Strategic Partnerships). Engineering roles available in Bengaluru and Gurgaon. - **Engineering culture**: Work on AI agents, distributed systems, and visual design tools. Opportunities to shape the future of data workflows and collaborate with a diverse, cross‑continental team. - **Notable perks**: Not explicitly listed, but the company offers free Professional tier for individuals and a 90‑day onboarding program (Prophecy Express) for organizations. ## Sources 1. [Prophecy AI – Homepage](https://www.prophecy.ai/) 2. [Prophecy AI – About Page](https://www.prophecy.ai/about) 3. [Prophecy AI – Careers Page](https://www.prophecy.ai/careers) 4. [LinkedIn – Prophecy](https://www.linkedin.com/company/prophecy-ai) 5. [Greenhouse Job Board – Prophecy](https://job-boards.greenhouse.io/prophecysimpledatalabs/jobs/5118369007) ## Other roles at Prophecy - [Senior AI Product Manager](https://feeny.ai/job/senior-ai-product-manager-prophecy-san-francisco-california-nnrambzvsnsa) — San Francisco California, United States - [Operations Manager (Contract)](https://feeny.ai/job/operations-manager-contract-prophecy-san-mateo-dg1qfe2w1gks) — San Mateo, CA - [Senior Director of Revenue Operations](https://feeny.ai/job/senior-director-of-revenue-operations-prophecy-united-states-ekzgh72nwdwq) — United States - [Marketing SDR](https://feeny.ai/job/marketing-sdr-prophecy-united-states-3bwg739n85eq) — United States - [Senior DevOps Engineer](https://feeny.ai/job/senior-devops-engineer-prophecy-bengaluru-dkghe8zj42rq) — Bengaluru, India - [AI/ML Engineer (Mid-level to Principal)](https://feeny.ai/job/ai-ml-engineer-mid-level-to-principal-prophecy-san-francisco-california-vghfgj8bs73t) — San Francisco California, United States - [Director, Strategic Partnerships](https://feeny.ai/job/director-strategic-partnerships-prophecy-san-francisco-rj7zwqemztga) — San Francisco, CA - [Staff Software Engineer](https://feeny.ai/job/staff-software-engineer-valon-tech-new-york-rn5aq8ctnem7) — New York, NY - [Staff Software Engineer](https://feeny.ai/job/staff-software-engineer-scopely-san-francisco-california-xwe2rq59zaa3) — San Francisco California, United States - [Staff Software Engineer](https://feeny.ai/job/staff-software-engineer-prompt-remote-sbpt39k1ycjt)