--- title: 'Big Data Engineer- Scala at Capco' canonical: 'https://feeny.ai/job/big-data-engineer-scala-capco-pune-10af1cjfagss' type: 'job' last_seen: '2026-11-09' --- # Big Data Engineer- Scala at Capco - **Company:** Capco - **Location:** Pune, India - **Posted:** 2026-11-03 - **Last confirmed live:** 2026-11-09 - **Apply:** https://job-boards.greenhouse.io/capco/jobs/8348883 ## Job description Job Title: Big Data Engineer - SCala ## About Us “Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the  British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by [Avtar & Seramount](https://avtarinc.com/what-we-do/enrich-diversity/best-companies-for-women/). With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery. WHY JOIN CAPCO? You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry. ## MAKE AN IMPACT Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services. ## #BEYOURSELFATWORK Capco has a tolerant, open culture that values diversity, inclusivity, and creativity. ## CAREER ADVANCEMENT With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands. ## DIVERSITY & INCLUSION We believe that diversity of people and perspective gives us a competitive advantage. ## MAKE AN IMPACT Job Description: Big Data Engineer – Scala We are looking for an experienced Big Data Engineer with strong expertise in Scala and Apache Spark to design, develop, and optimize scalable data-processing solutions. The ideal candidate should have hands-on experience with distributed data platforms, large-scale ETL/data pipelines, and big data technologies. ## Key Responsibilities - Design, develop, and maintain scalable Big Data applications and data pipelines. - Develop high-performance data-processing solutions using Scala and Apache Spark. - Build and optimize ETL/ELT pipelines for large volumes of structured and unstructured data. - Work with technologies such as Hadoop, HDFS, Hive, Kafka, and Spark SQL. - Perform Spark job performance tuning and optimization. - Develop reusable and maintainable data-processing frameworks. - Troubleshoot production issues related to data pipelines and distributed applications. - Implement data-quality checks, monitoring, and error-handling mechanisms. - Collaborate with data architects, analysts, business teams, and other engineering teams. - Follow software engineering best practices, including Git, code reviews, testing, and CI/CD. Required Skills - Strong hands-on programming experience in Scala. - Strong experience with Apache Spark / Spark SQL. - Good understanding of Big Data and distributed computing concepts. - Experience with Hadoop ecosystem technologies, including Hadoop/HDFS and Hive. - Experience building large-scale ETL/data engineering pipelines. - Strong SQL skills. - Experience working with Kafka or similar messaging/streaming technologies. - Understanding of data formats such as Parquet, Avro, and JSON. - Experience with performance optimization and troubleshooting of Spark applications. - Good understanding of software development lifecycle and version-control systems. Good to Have - Experience with AWS, Azure, or GCP. - Knowledge of Databricks. - Experience with Airflow or similar orchestration tools. - Exposure to Delta Lake or other modern lakehouse technologies. - Knowledge of Docker, Kubernetes, and CI/CD pipelines. - Experience working in Agile/Scrum environments. Core Skills Scala | Apache Spark | Spark SQL | SQL | Hadoop | HDFS | Hive | Kafka | ETL | Data Engineering | Big Data ## About Capco ## Company Overview - **One-liner**: Capco is a global management and technology consultancy specializing in the financial services and energy industries, known for its deep industry expertise and entrepreneurial culture. - **Entity Type**: Private (Wholly owned subsidiary of Wipro Limited since 2021) - **Headquarters**: London, England, United Kingdom - **Founded**: 1998 - **Founders**: Rob Heyvaert ## Core Business - **Primary industries**: Financial services (banking, payments, capital markets, wealth & asset management, insurance) and energy - **Target customers**: Large enterprises in highly regulated sectors (B2B/Enterprise) - **Mission/Purpose statement**: “Do something different by combining deep industry expertise, strong consulting fundamentals, real innovation, and a relentless focus on client impact.” [capco.com](https://www.capco.com/about-us) ## Products & Services Capco delivers consulting services rather than standalone products. Major service areas include: - **Banking & Payments**: Digital banking transformation, core modernization, payments advisory. - **Capital Markets**: Technology and data transformation, operational efficiency, regulatory compliance. - **Wealth & Asset Management**: Customer relationship enhancement, operational scalability, control environment strengthening. - **Insurance**: M&A support, technology innovation, profitability improvement. - **Energy**: Commodity trading and risk management, energy transition, utilities transformation. All services are delivered as **management and technology consulting** engagements. ## Market Standing - **Valuation/Market Cap**: Not publicly disclosed (acquired by Wipro in March 2021 for $1.45 billion) [linkedin.com](https://www.linkedin.com/company/capco) - **Key Metric (Private)**: Total headcount of ~5,930 (9.2% YoY growth); 670 active job postings [linkedin.com](https://www.linkedin.com/company/capco) - **Notable Investors/Partners**: **Wipro Limited** (parent company); earlier investor **Thomas Weisel Partners** (led $80M PE round in 2000) - **Growth Signals**: +9.2% headcount growth year-over-year; +30.5% LinkedIn follower growth (530,600 followers); recruitment volume up 10.4% quarterly [linkedin.com](https://www.linkedin.com/company/capco) ## Competitive Advantages - **Deep domain expertise** across financial services and energy – nearly three decades of focused experience. - **Expert-led, AI‑infused** delivery model that embeds technology and AI into every engagement. - **Strong brand and alumni network** (graduates of Capco work at UBS, Accenture, HSBC, etc.) – signals talent development and industry connections. - **Low bureaucracy, entrepreneurial culture** – flat hierarchies encourage ownership and client impact. ## Strategic Focus - Embedding AI and data as core enablers across all consulting work (“AI is not an add‑on – it is a core part of how we shape, build, and deliver value” [capco.com](https://www.capco.com/about-us)). - Continuing to expand in energy consulting alongside core financial services. - Driving measurable outcomes and lasting value for clients while maintaining a people‑first culture. ## Why Work Here - **Culture**: “Be Yourself at Work” (#BYAW) is a foundational value promoting inclusion, authenticity, and belonging. Minimal hierarchy and entrepreneurial freedom are emphasized. [capco.com](https://www.capco.com/about-us/our-culture-and-values) - **Learning & Development**: Structured programs from entry‑level Associate Talent Program (ATP) to experienced hire tracks; mentorship and hands‑on client exposure. - **Wellbeing**: Wellbeing@Capco program integrated into culture; benefits designed to support work‑life balance. [capco.com](https://www.capco.com/about-us/our-culture-and-values) - **Remote/Hybrid**: Not explicitly stated, but global offices in 43 countries suggest hybrid presence; role‑dependent. - **Notable perks**: Global mobility opportunities, comprehensive benefits, flat structure allowing early responsibility. ## Sources 1. [capco.com](https://www.capco.com/) – Company overview 2. [capco.com - About Us](https://www.capco.com/about-us) – History, leadership, vision 3. [capco.com - Careers](https://www.capco.com/careers) – Culture, learning, benefits 4. [capco.com - Culture & Values](https://www.capco.com/about-us/our-culture-and-values) – ESG, #BYAW, wellbeing 5. [linkedin.com/company/capco](https://www.linkedin.com/company/capco) – Headcount, funding, acquisitions, recruitment data ## Other roles at Capco - [Data Analytics Specialist](https://feeny.ai/job/data-analytics-specialist-capco-warsaw-8xk6gkayvb43) — Warsaw, Poland - [.NET - Fullstack](https://feeny.ai/job/net-fullstack-capco-bengaluru-v8mmkx9qgcpn) — Bengaluru, India - [Project Manager | TOM Delivery (CIB)](https://feeny.ai/job/project-manager-tom-delivery-cib-capco-hong-kong-d7n4ja6130wg) — Hong Kong, China - [Senior Manager/Director | Digital Assets & Tokenisation](https://feeny.ai/job/senior-manager-director-digital-assets-tokenisation-capco-hong-kong-2ccec1gk0g3t) — Hong Kong, China - [PM - Transaction Banking](https://feeny.ai/job/pm-transaction-banking-capco-india-cdpcx31dv901) — India - [PM- Channels](https://feeny.ai/job/pm-channels-capco-india-yhvyfysep6hj) — India - [PM - Business Banking](https://feeny.ai/job/pm-business-banking-capco-pune-9hze6gkz1sy6) — Pune, India - [BA Avaloq](https://feeny.ai/job/ba-avaloq-capco-pune-kdavjr562npj) — Pune, India - [AI Business Analyst](https://feeny.ai/job/ai-business-analyst-capco-india-za6014cb29dq) — India - [AI Business Analyst](https://feeny.ai/job/ai-business-analyst-capco-india-jyvcsy0xrz3w) — India