---
title: 'Sr. Staff AI Engineer - On-Prem AI Infrastructure & Agentic Systems at SK hynix memory solutions America Inc.'
canonical: 'https://feeny.ai/job/sr-staff-ai-engineer-on-prem-ai-infrastructure-agentic-systems-sk-hynix-memory-8fc7bzj8h6r8'
type: 'job'
last_seen: '2026-09-10'
---

# Sr. Staff AI Engineer - On-Prem AI Infrastructure & Agentic Systems at SK hynix memory solutions America Inc.

- **Company:** SK hynix memory solutions America Inc.
- **Location:** San Jose, CA
- **Posted:** 2026-06-24
- **Last confirmed live:** 2026-09-10
- **Apply:** https://job-boards.greenhouse.io/skhynixmemorysolutionsamericainc/jobs/4296165009

## Job description

About the Company:

At SK Hynix Memory Solution, we're at the forefront of semiconductor innovation, developing advanced memory solutions that power everything from smartphones to data centers. As a global leader in DRAM and NAND flash technologies, we drive the evolution of advancing mobile technology, empowering cloud computing, and pioneering future technologies. Our cutting-edge memory technologies are essential in today's most advanced electronic devices and IT infrastructure, enabling enhanced performance and user experiences across the digital landscape.

We're looking for innovative minds to join our mission of shaping the future of technology. At SK Hynix Memory, you'll be part of a team that's pioneering breakthrough memory solutions while maintaining a strong commitment to sustainability. We're not just adapting to technological change – we're driving it, with significant investments in artificial intelligence, machine learning, and eco-friendly solutions and operational practices. As we continue to expand our market presence and push the boundaries of what's possible in semiconductor technology, we invite you to be part of our journey to creating the next generation of memory solutions that will define the future of computing.

Why Join Us?

- Build foundational AI infrastructure that powers next-gen enterprise systems.
- Work on cutting-edge agentic AI — not just chatbots, but autonomous systems that reason, plan, and act.
- Opportunity to influence AI strategy, deployment, and governance in a high-impact environment.

About the Role:

We are seeking a hands-on AI Engineer to design, deploy, and maintain on-prem AI infrastructure and build agentic AI systems that drive real-world automation. You’ll be responsible for setting up scalable AI environments, implementing RAG pipelines, fine-tuning embedded models, and architecting AI agents that operate autonomously in enterprise settings. This role sits at the intersection of AI systems engineering and applied ML — you’ll bridge infrastructure, model deployment, and agent logic.

Responsibilities:

- Design and deploy on-prem AI infrastructure — including GPU clusters, model serving (e.g., vLLM, TGI, Triton), vector DBs (e.g., Milvus, Qdrant, FAISS), and orchestration (Kubernetes, Helm, Docker).
- Build and optimize RAG pipelines — including document chunking, retrieval strategies (hybrid, re-ranking), and evaluation of retrieval accuracy and latency.
- Develop agentic AI systems — design stateful agents with memory, tool use, and planning capabilities (e.g., using LangGraph, AutoGen, or custom frameworks).
- Fine-tune and deploy embedded models — work with LoRA, QLoRA, or full fine-tuning for domain-specific tasks; optimize for edge/on-device inference.
- Implement Model Control Protocols (MCP) — ensure model governance, versioning, access control, and monitoring for production AI systems.
- Collaborate with product and engineering teams to integrate AI capabilities into enterprise workflows — especially in storage, QA, or systems engineering contexts.
- Automate and monitor AI pipelines — build CI/CD for model deployment, logging, and performance tracking.

Minimum Qualifications:

- 2+ years of experience in AI/ML engineering, with hands-on deployment of AI systems on-prem or private cloud.
- Proven experience building agentic AI systems — including state management, tool integration, and multi-step reasoning.
- Strong working knowledge of RAG architectures — chunking, retrieval, re-ranking, evaluation metrics.
- Experience with model fine-tuning (LoRA, QLoRA, full fine-tuning) and embedding models for retrieval.
- Familiarity with Model Control Protocols (MCP) or similar governance frameworks (model versioning, access control, audit trails).
- Proficiency in Python, Linux, Docker/Kubernetes, and vector databases (e.g., Milvus, Qdrant, Pinecone).
- Experience with AI serving frameworks (vLLM, TGI, Triton, Ollama, etc.).

Preferred Qualifications:

- Experience deploying AI in enterprise storage or hardware-adjacent environments.
- Background in systems engineering or QA automation — bonus if you’ve used AI to automate testing or validation.
- Familiarity with embedded AI or edge inference (ONNX, TensorRT, GGUF, etc.).
- Experience with AI agent frameworks (LangGraph, AutoGen, BabyAGI, etc.).
- Knowledge of AI observability tools (LangSmith, Weights & Biases, Prometheus/Grafana for AI).
- As a Storage company, knowledge of storage area/NVMe is a PLUS.

Education Requirement:

- Bachelor of Science in CS, EE, ME, or other applicable Engineering field.

COMPENSATION: $140,000/yr - $165,000/yr

## REGARDING COMPENSATION:

SK hynix memory solutions America Inc. offers you the opportunity to apply your skills to exciting projects while working with innovative teams. Our compensation package is complimented by a generous benefits package including medical, dental, vision, life insurance and a company 401(k) match, as well as cafeteria, onsite gym and much more. If you are motivated by technical challenges, we offer a collaborative work environment that encourages career growth.

The salary offered to a selected candidate will be tailored based on several factors, including the location, job grade, relevant knowledge, skills, and experience. We also take into account the internal equity among our current team members to ensure fairness and competitiveness

## About SK hynix memory solutions America Inc.

## Company Overview
- **One-liner**: SK hynix memory solutions America Inc. (SKHMS America) is the San Jose‑based R&D subsidiary of SK hynix, specializing in custom NAND‑based storage solutions, SSD controllers, and system‑on‑chip (SoC) designs for enterprise and client markets.
- **Entity Type**: Private (wholly owned subsidiary of SK hynix, a publicly traded company under ticker 000660:KR)
- **Headquarters**: San Jose, California, United States
- **Founded**: 2004 (originally as Link_A_Media Devices Corporation; acquired by SK hynix in 2012, renamed to SK hynix memory solutions America Inc. in 2018)
- **Founders**: Not publicly disclosed (original LAMD founders); key executive: Tony Yoon (CEO)

## Core Business
- **Primary industry**: Semiconductor manufacturing / NAND flash storage solutions
- **Target customers**: B2B – enterprise data centers, hyperscale cloud operators, mobile device manufacturers
- **Mission statement**: “To be a trusted partner by delivering top-quality storage products and exceptional customer service, consistently meeting schedules to ensure complete customer satisfaction.” [skhms.com](https://www.skhms.com/index.html)

## Products & Services
- **Enterprise SSDs** – PCIe Gen3/Gen4/Gen5 NVMe drives (e.g., PE6011, PS11xx, PS10xx, PS1101) and SATA SSDs (SE3010, SE4010) designed for data centers and AI infrastructure.
- **Custom SSD Controllers** – In‑house SoCs with dedicated HW accelerators, AI/ML‑based error correction, and low‑power architectures.
- **Firmware & System Software** – Low‑level firmware that orchestrates controller features and ensures enterprise‑grade reliability.
- **NAND Media Management** – Algorithms to analyze NAND characteristics and optimize SSD performance and endurance.
- **Systems Engineering & Validation** – Replication of customer environments at scale; in‑house test tools for reliability qualification.

## Market Standing
- **Valuation / Market Cap**: Not disclosed (subsidiary of SK hynix, which had a market cap of ~$90B as of mid‑2025)
- **Key Metric**: Annual revenue ~$21M (estimated from LinkedIn data); total funding not applicable (captive R&D arm)
- **Notable Investors / Partners**: Parent company SK hynix; Intel NAND business acquisition (2020) led to the formation of Solidigm alongside SKHMS.
- **Growth Signals**: 191 employees (+19.9% YoY); 20 active job postings (+1900% YoY in postings); milestone launch of 245TB PS1101 SSD using world‑first 321‑layer QLC NAND in 2025, targeting AI data centers.

## Competitive Advantages
- **Full Vertical Integration** – In‑house NAND, DRAM, controller SoC, firmware, and high‑volume manufacturing – a rare combination in the industry.
- **Advanced Error Correction** – AI/ML‑based algorithms for robust data reliability.
- **Proven Track Record** – First in industry with LDPC error correction; multiple generations of enterprise PCIe/SATA controllers.
- **Parent Backing** – Access to SK hynix’s massive R&D budget and global manufacturing fabs.

## Strategic Focus
- **AI Infrastructure** – Ultra‑high‑capacity (245TB) SSDs optimized for AI/cloud workloads.
- **PCIe Gen5 Transition** – Continuing to innovate with Gen5 E3.S/U.2/U.3 form factors, improving performance and efficiency.
- **Eco‑Friendly Solutions** – Investment in sustainable operational practices and low‑power chip designs.

## Why Work Here
- **Culture & Impact** – Engineers work on cutting‑edge storage technology that powers global data centers and AI systems; collaborative, cross‑functional teams.
- **Location & Perks** – San Jose campus with on‑site cafeteria, fitness center reimbursement, comprehensive medical/dental/vision insurance, 401(k) match, life insurance.
- **Growth Opportunities** – Roles in firmware, SoC design, systems engineering, and validation; internships available; 20 open positions as of mid‑2025.
- **Remote / Hybrid** – Not explicitly stated; roles appear to be on‑site (San Jose).

## Sources
1. [skhms.com – Company Overview, Mission, Products, Milestones](https://www.skhms.com/index.html)
2. [linkedin.com – Company Page, Financials, Employee Data, Growth](https://www.linkedin.com/company/sk-hynix-memory-solutions-inc-)
3. [job-boards.greenhouse.io – Active Job Postings (24 roles as of July 2025)](https://job-boards.greenhouse.io/skhynixmemorysolutionsamericainc)
4. [greenhouse.io – Jobs detail (confirming open positions)](https://job-boards.greenhouse.io/skhynixmemorysolutionsamericainc/jobs/4130211009)

## Other roles at SK hynix memory solutions America Inc.

- [Sr./Staff/Sr. Staff - SI/PI Hardware Engineer](https://feeny.ai/job/sr-staff-sr-staff-si-pi-hardware-engineer-sk-hynix-memory-solutions-america-inc-94p67khz05y1) — San Jose, CA
- [Staff Security Firmware Test Developer](https://feeny.ai/job/staff-security-firmware-test-developer-sk-hynix-memory-solutions-america-inc-h8exzb1n1p41) — San Jose, CA
- [Manager / Sr. Manager - Leadership & Organization Development](https://feeny.ai/job/manager-sr-manager-leadership-organization-development-sk-hynix-memory-cp91kxfrrc3f) — San Jose, CA
- [Manager / Sr. Manager - Leadership & Organization Development - Bilingual in Korean](https://feeny.ai/job/manager-sr-manager-leadership-organization-development-bilingual-in-korean-sk-v45c2d033xgs) — San Jose, CA
- [TOP Design Verification Engineer Intern](https://feeny.ai/job/top-design-verification-engineer-intern-sk-hynix-memory-solutions-america-inc-wfps19bb678s) — San Jose, CA
- [ECC Design Engineering Intern](https://feeny.ai/job/ecc-design-engineering-intern-sk-hynix-memory-solutions-america-inc-san-jose-49h08nay11zr) — San Jose, CA
- [SSD Firmware Development Engineer Intern](https://feeny.ai/job/ssd-firmware-development-engineer-intern-sk-hynix-memory-solutions-america-inc-fmvhr47qbs1t) — San Jose, CA
- [Sr. / Staff / Sr. Staff Firmware Validation Engineer](https://feeny.ai/job/sr-staff-sr-staff-firmware-validation-engineer-sk-hynix-memory-solutions-gwjbvaqg901w) — San Jose, CA
- [Staff / Sr. Staff / Principal - eSSD Validation Engineer](https://feeny.ai/job/staff-sr-staff-principal-essd-validation-engineer-sk-hynix-memory-solutions-6jy4gnwsx35h) — San Jose, CA
- [Staff / Sr. Staff/ Principal - eSSD Validation Engineer](https://feeny.ai/job/staff-sr-staff-principal-essd-validation-engineer-sk-hynix-memory-solutions-ydncw9bk53cg) — San Jose, CA