Skip to main content

SRE, Staff AI Infrastructure Engineer

Job ID 2026-17408 Date posted 13/08/2026 Location Bengaluru, India Category IT
Apply

We are building a central AI control plane to support the safe, scalable, and efficient use of AI across Arm’s engineering teams.

This hands-on platform engineering role will help deliver and own the runtime platforms that make AI services reliable, secure, observable and supportable at Arm scale. You will work across Kubernetes, cloud, identity, secrets, networking, telemetry, incident management and automation to provide the production foundation for Arm’s AI platform.

You will initially contribute in three key areas:

Production AI runtime platforms:

  • Build/deploy and operate the infrastructure for centrally hosted AI platform services, including MCP server infrastructure, model gateway services and supporting control-plane components.
  • Design runtime patterns for isolation, scalability, secure execution, capacity management and cost-aware operation.
  • Automate provisioning, configuration, upgrades and lifecycle management using infrastructure-as-code and GitOps patterns.

Reliability, observability and support:

  • Define and implement service-level indicators, service-level objectives, alerting, dashboards, runbooks and support workflows.
  • Incident response, post-incident review and vendor outage handling for AI services embedded in engineering workflows.
  • Build telemetry that helps Arm understand AI platform health, usage, performance, cost and operational risk.

Secure operations by default:

  • Ensure platform components meet production readiness, security and compliance expectations.
  • Help make secure AI usage the default by providing reliable paved paths rather than manual or fragmented infrastructure.

Responsibilities:

  • Build, operate and continuously improve the production infrastructure for Arm’s AI platform services, using both custom and third party solutions.
  • Own reliability, scalability, monitoring, alerting, incident response, runbooks and operational readiness for AI platform components.
  • Develop automation for provisioning, deployment, configuration, backup, recovery, patching, upgrades and lifecycle management.
  • Implement secure runtime patterns, including workload isolation, secrets management, identity integration, network controls and auditability.
  • Participate in production support and our paid on-call rota for high impact incident response.

Required Skills and Experience:

  • Experience Required: Minimum 10 years, preferably up to 15 years
  • Familiarity with AI platform concepts such as model routing, MCP servers, agentic workflows, RAG systems or LLM observability.
  • Strong experience deploying and operating production infrastructure or platform services in a Linux-based environment using Kubernetes, containers, cloud or private-cloud platforms, infrastructure-as-code and CI/CD/GitOps tooling.
  • Strong automation and scripting skills, for example Terraform, Go, Python or similar.
  • Experience with incident management, problem management, demand forecasting, and production readiness practices.
  • Good understanding of security fundamentals for production platforms, including identity, secrets, access control, network segmentation, vulnerability management and audit logging.

“Nice To Have” Skills and Experience :

  • Experience operating internal developer platforms, AI platforms, model gateways, MCP infrastructure or other shared engineering platforms.
  • Experience with service mesh, policy-as-code, workload identity, sandboxing, secure runtime environments or multi-tenant platform designs.
  • Experience with regulated or security-sensitive engineering environments.
  • Solid understanding of Open AI tools, products and APIs!

In Return:

Joining Arm means being part of a world-class team that is high-reaching and determined to achieve outstanding results. You will collaborate with industry leaders and innovators, contributing to flawless service builds that improve our global operations. We provide an encouraging and inclusive environment that encourages continuous learning and professional growth. Your success is our success, and together we can build services that compete on the world stage!

#LI-AV1

Accommodations at Arm

At Arm, we want to build extraordinary teams. If you need an adjustment or an accommodation during the recruitment process, please email accommodations@arm.com. To note, by sending us the requested information, you consent to its use by Arm to arrange for appropriate accommodations. All accommodation or adjustment requests will be treated with confidentiality, and information concerning these requests will only be disclosed as necessary to provide the accommodation. Although this is not an exhaustive list, examples of support include breaks between interviews, having documents read aloud, or office accessibility. Please email us about anything we can do to accommodate you during the recruitment process.

Hybrid Working at Arm

Arm’s approach to hybrid working is designed to create a working environment that supports both high performance and personal wellbeing. We believe in bringing people together face to face to enable us to work at pace, whilst recognizing the value of flexibility. Within that framework, we empower groups/teams to determine their own hybrid working patterns, depending on the work and the team’s needs. Details of what this means for each role will be shared upon application. In some cases, the flexibility we can offer is limited by local legal, regulatory, tax, or other considerations, and where this is the case, we will collaborate with you to find the best solution. Please talk to us to find out more about what this could look like for you.

Equal Opportunities at Arm

Arm is an equal opportunity employer, committed to providing an environment of mutual respect where equal opportunities are available to all applicants and colleagues. We are a diverse organization of dedicated and innovative individuals, and don’t discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

Life at Arm

  • Culture at Arm
    Culture at Arm

    Make an Impact

    At Arm, collaboration drives progress. Our culture blends individual ownership with strong team alignment, where skilled people thrive in a fast-paced, supportive environment. Across our ecosystem, we value bold thinking and pushing boundaries because when teams are empowered and passionate, they deliver at scale.
    Read more

  • Diversity, Equity and Inclusion
    Diversity, Equity & Inclusion

    This is Collective Progress

    Arm drives progress by enabling bold ideas to emerge from a diverse, skilled, and inclusive workforce. We challenge convention and move fast, supported by active participation in ERGs, employee communities, DEI working groups, and the DEI Council, each built to fuel momentum and remove barriers.
    Read more

  • Benefits at Arm
    Benefits at Arm

    Benefits Designed for You

    Arm moves fast because our people do. That’s why we offer high-impact benefits tailored to support those driving the future of computing, benefits that reflect and reward the ambition, skill, and energy of extraordinary teams solving complex challenges.
    Read more

Jobs for You

  • Staff Verification Engineer - Media IP Specify and develop new hardware verification testbenches for future generation hardware IP as well as improving existing testbenches to increase performance, quality and efficiency. Manchester, United Kingdom, Cambridge, United Kingdom Verification
  • Staff Hardware AI Engineer Develop AI-powered hardware verification automation using RTL, EDA tools and Python to transform engineering productivity across Arm's verification teams. Cambridge, United Kingdom Hardware Engineering
  • Senior Principal AI Performance Engineer San Jose, California Hardware Engineering

No previously viewed jobs

No jobs have been saved

Get Job Alerts

Can’t find the job you’re seeking? Register to be notified as soon as new jobs become available. Enter your email, select your preferred job category and/or location, then click Add to set your preferences and Subscribe to create your job alert.

Interested InSelect a job category from the list of options. Search for a location and select one from the list of suggestions. Finally, click “Add” to create your job alert.

By submitting your information, you acknowledge that you have read our privacy policy, and consent to receive email communication from Arm.

Join our Talent Community, Unlock Opportunities

Subscribe to receive Arm communications directly to your inbox. Stay connected to be the first to hear about updates from our community and exciting roles that align with your skills.

Join Now