--- title: 'QA Architect - R01571456 at Brillio' canonical: 'https://feeny.ai/job/qa-architect-r01571456-brillio-bengaluru-hrsfyykcmd07' type: 'job' last_seen: '2026-10-18' --- # QA Architect - R01571456 at Brillio - **Company:** Brillio - **Location:** Bengaluru, India - **Posted:** 2026-10-06 - **Last confirmed live:** 2026-10-18 - **Apply:** https://jobs.lever.co/brillio-2/e717b34c-e4de-4ffe-bff0-b9df05bc7714 ## Job description QA Architect Job requirements Experience Range: With at least 7 years of quality assurance experience, including substantial hands-on work with data science and machine learning testing frameworks Key Responsibilities: - Design and implement automated testing strategies for AI and data science outputs, ensuring accuracy and reliability across models and pipelines - Develop and maintain robust evaluation and validation frameworks for backend and frontend components, leveraging statistical and machine learning techniques - Collaborate with data scientists and engineers to define test cases, hypotheses, and statistical metrics for model assessment and improvement - Integrate advanced statistical tests such as T-Test, Z-Test, and regression analyses into automated QA workflows to validate model performance - Utilize tools like Great Expectations, Evidently AI, and specific machine learning frameworks (TensorFlow, PyTorch, Sci-Kit Learn, CNTK, Keras, MXNet) to monitor, track, and report on model drift, anomalies, and forecast accuracy - Optimize testing processes for scalability and efficiency using Python, PySpark, R, and related technologies in large-scale data environments - Configure and manage testing infrastructure using platforms such as KubeFlow and BentoML to streamline deployment and evaluation cycles - Troubleshoot and resolve issues in automated testing pipelines, driving continuous improvement and high-quality deliverables Required Skills: - Advanced proficiency in Python and PySpark for test automation and statistical analysis - Expertise in statistical testing methods including Hypothesis Testing, T-Test, Z-Test, and Regression (Linear, Logistic) - Strong experience with machine learning frameworks such as TensorFlow, PyTorch, Sci-Kit Learn, CNTK, Keras, and MXNet - Hands-on knowledge of Great Expectations and Evidently AI for data validation and monitoring - Proficiency in SAS and SPSS for statistical computing and analysis - Deep understanding of probabilistic graph models and classification algorithms including Decision Trees and SVM - Experience with forecasting techniques including Exponential Smoothing, ARIMA, and ARIMAX - Familiarity with distance metrics such as Hamming, Euclidean, and Manhattan Distance - Advanced skills in R and R Studio for statistical modeling and QA scripting - Experience configuring testing platforms such as KubeFlow and BentoML Preferred Skills: - Experience automating evaluation pipelines for AI/ML in production environments - Expertise in integrating QA processes with CI/CD workflows and cloud-native architectures - Knowledge of emerging ML testing tools and frameworks beyond industry standards - Ability to develop custom statistical metrics for model evaluation - Experience with QA automation for distributed systems at scale Desired Qualifications: - Bachelor's degree in Computer Science, Data Science, Statistics, Mathematics, or a quantitative discipline - Certification in Quality Assurance, Data Science, or Machine Learning (e.g., ISTQB Advanced Test Analyst, TensorFlow Developer Certificate) - Certification in statistical analysis tools or platforms (e.g., SAS Certified Specialist, SPSS Certification) ## About Brillio ## Company Overview - **One-liner**: Brillio is a digital transformation consulting and technology services company that helps Fortune 1000 enterprises accelerate AI adoption and scale impact through its AI accelerator platform, ADAM. - **Entity Type**: Private (backed by Bain Capital Private Equity) - **Headquarters**: Dallas, Texas, United States - **Founded**: 2014 - **Founders**: Not publicly disclosed (CEO: Raj Mamodia) ## Core Business - **Primary industries**: IT Services and IT Consulting; Digital Transformation; AI and Data Engineering; Customer Experience Transformation; Digital Engineering; Infrastructure Engineering - **Target customers**: Fortune 1000 enterprises (B2B, Enterprise) - **Mission / purpose statement**: “The Enterprise AI Accelerator” – helping companies move from AI ambition to scaled impact, faster. ## Products & Services - **ADAM (Agentic Data and Application Management)**: A self-service LLM model garden and GenAI platform for building, testing, and deploying over a hundred GenAI use cases at scale. Core accelerator for Brillio’s delivery. - **Business-led transformation**: Strategy consulting and business process modernization. - **Customer experience transformation**: Design, digital product engineering, and omnichannel experience. - **AI and data engineering**: Predictive models, enterprise search, RAG systems, AI copilots, autonomous agents, multi-agent workflows. - **Digital engineering**: Application modernization, platform engineering, cloud-native development. - **Infrastructure engineering**: Cloud infrastructure, security, MLOps/LLMOps, and observability. ## Market Standing - **Valuation / Market Cap**: Not disclosed (privately held) - **Key Metric**: Annual revenue reported at **$1B** (latest available); total employees ~3,941 (+6.7% YoY) per LinkedIn, though company claims “over 6,000 customer-obsessed professionals” on its website. - **Notable Investors / Partners**: Bain Capital Private Equity (parent company); Great Place to Work® certified in the USA. - **Growth Signals**: +352 employees YoY; 14 delivery locations across North America, Europe, and Asia; expanding AI engineering roles; 616,797 LinkedIn followers (+24.4% yearly growth). ## Competitive Advantages - **Enterprise AI focus**: Industrializing AI across every layer of the business – not just building demos but shipping production systems. - **ADAM platform**: Proprietary accelerator that enables rapid deployment of GenAI use cases, shortening time-to-value for clients. - **End-to-end ownership**: Engineers design, build, evaluate, and run agentic and GenAI systems that reach live users. - **Scale and reach**: Global delivery footprint (USA, India, UK, Europe, Mexico, Canada, Romania) with deep Fortune 1000 client relationships. ## Strategic Focus - **AI engineering at scale**: Moving AI from pilots to production with a focus on agentic systems, LLMOps, evaluation, security, and governance. - **Continuous learning**: Brillio Academy, hackathons, mentoring, and certifications to keep skills current. - **Talent development**: Hiring based on demonstrated ability (not just degrees); clear career paths from engineer to AI architect or technical leadership. - **Diversity & inclusion**: Committed to a diverse, inclusive workplace; no discrimination based on protected characteristics. ## Why Work Here - **Culture**: Rated 4.0/5.0 on Glassdoor (2,264 reviews) and 4.0/5.0 on LinkedIn; 80% would recommend to a friend; Great Place to Work® certified in the USA. - **Work environment**: Engineers get meaningful ownership within clear guardrails – autonomy to make architecture and trade-off calls on their workstreams. - **Learning & growth**: Brillio Academy, hackathons, personalized career development framework; exposure to cutting-edge GenAI and agentic AI projects. - **Remote / hybrid / office**: Not explicitly stated, but global delivery locations suggest a mix of on-site and remote (roles posted across multiple countries). - **Benefits**: “BYou” wellness program built on four pillars of wellness – personal and professional well-being and development. - **Interview process**: Focus on software fundamentals, LLMs, RAG, agents, evaluation, and a design or debugging exercise; candidates should be ready to walk through a real system they shipped. ## Sources 1. [careers.brillio.com](https://careers.brillio.com/) 2. [brillio.com/about-us/who-we-are](https://www.brillio.com/about-us/who-we-are/) 3. [linkedin.com/company/brillio](https://linkedin.com/company/brillio) 4. [glassdoor.com/Reviews/Brillio-Reviews-E821879](https://www.glassdoor.com/Reviews/Brillio-Reviews-E821879.htm) 5. [wikipedia.org/wiki/Brillio](https://en.wikipedia.org/wiki/Brillio) ## Other roles at Brillio - [Senior Lead AI/ML Engineer - R01570774](https://feeny.ai/job/senior-lead-ai-ml-engineer-r01570774-brillio-bengaluru-8zzca7scmpg1) — Bengaluru, India - [Senior Tech Specialist, Automation Solutions - R01572511](https://feeny.ai/job/senior-tech-specialist-automation-solutions-r01572511-brillio-bengaluru-67enqxnfszgd) — Bengaluru, India - [Software Development Lead - R01572746](https://feeny.ai/job/software-development-lead-r01572746-brillio-bengaluru-9f7zr6q65tkr) — Bengaluru, India - [Sr. AI Engineer - R01572484](https://feeny.ai/job/sr-ai-engineer-r01572484-brillio-davie-5rj5e5z0dr2p) — Davie, FL - [Business Analyst - R01572558](https://feeny.ai/job/business-analyst-r01572558-brillio-bengaluru-tt2km7mjc5br) — Bengaluru, India - [Senior Software Development Engineer](https://feeny.ai/job/senior-software-development-engineer-brillio-guadalajara-jalisco-2srxks493zjn) — Guadalajara Jalisco, Mexico - [Senior Software Development Lead - R01572698](https://feeny.ai/job/senior-software-development-lead-r01572698-brillio-guadalajara-jalisco-a1j0a0sv82kt) — Guadalajara Jalisco, Mexico - [Consultant - R01572702](https://feeny.ai/job/consultant-r01572702-brillio-gurgaon-haryana-9nntc8qneqsf) — Gurgaon Haryana, India - [AI Engineer](https://feeny.ai/job/ai-engineer-brillio-dallas-m7rarwfmj6zx) — Dallas, TX - [Lead Quality Engineer - R01572680](https://feeny.ai/job/lead-quality-engineer-r01572680-brillio-bengaluru-cfh6e6zvw6yy) — Bengaluru, India