Arm technology is becoming the platform of choice for compute and AI. The Arm System Engineering team’s mission is to architect, design, and develop server and rack-level infrastructure for at-scale datacenter deployments. The team capabilities span across system hardware, software, system interconnect, system management storage, data center infrastructure and performance engineering. The team responsibilities include customer engagements, technology selection, system design, network architecture, performance, and datacenter deployment & operations. The Arm System Engineering team is developing industry-leading technology to deliver innovative and high-performing solutions to power the data centers of the future!
Job Overview:
Responsibilities:
As a Performance Engineer, you will lead benchmarking, performance analysis, and system optimization across AI and HPC workloads on Arm-based architectures. You will collaborate with hardware architects, software developers, and customer engineering teams to enhance system efficiency and scalability, ensuring Arm technology delivers industry-leading datacenter solutions.
- Design, implement, and analyze performance experiments for AI training, inference, and HPC applications across distributed clusters.
- Develop tools and workflows to monitor, measure, and validate system and workload scalability.
- Partner with system architects and software teams to identify bottlenecks and propose optimizations across the hardware/software stack.
- Lead performance bring-up and validation of new hardware platforms, interconnects, and accelerators.
- Collaborate with customers and Tier-1 partners to provide guidance on performance tuning and cluster-level deployment strategies.
- Drive innovation in performance methodology, including predictive modeling, profiling frameworks, and benchmark development.
- Present findings to engineering leadership, customers, and partners to influence architectural and design decisions.
Required Skills and Experience:
- Demonstrated ability in HPC and AI performance engineering, with proven hands-on expertise in distributed systems.
- Solid understanding of CPU/GPU/accelerator performance analysis, workload profiling, and scalability optimization.
- Proven experience with ARM64, x86, and GPU architectures in large-scale datacenter environments.
- Proficiency in performance tools such as VTune, Nsight, Rocprof, Pytorch profiler, MPI/OpenMP profilers, Cray/Allinea tools.
- Strong programming skills in Python, C/C++, Fortran, CUDA, and parallel frameworks (MPI, OpenMP, SYCL).
- Experience with large AI frameworks (PyTorch, TensorRT, Megatron-LM, vLLM, SGLang, TorchTitan).
- Familiarity with distributed training at scale (multi-node, multi-GPU clusters).
- Excellent communication skills and experience working with cross-functional engineering teams.
“Nice To Have” Skills and Experience :
- Experience with datacenter-scale benchmarking and system acceptance testing.
- Knowledge of interconnect fabrics (Infiniband, Slingshot, Omni-Path, RoCE, EFA) and distributed storage systems (Lustre, GPFS, Weka).
- Hands-on background with cloud HPC/AI deployments (AWS, Azure, GCP).
- Familiarity with containerization and orchestration (Docker, Kubernetes, SLURM, PBS).
- Background in exascale or pre-exascale performance co-design projects.
- Strong publication record in HPC/AI performance analysis.
- Experience leading small teams or cross-company performance projects.
In Return:
- Be part of a groundbreaking team influencing the next generation of data center systems.
- Collaborate with premier engineers and vendors to develop industry-leading AI hardware.
- Drive innovation in performance methodology with global impact.
- Access professional growth through sophisticated project involvement and multidisciplinary teamwork.
- Join a company committed to diversity and inclusion, where your work matters and drives global progress.
Our 10x mindset guides how we engineer, collaborate, and grow. Understand what it means and how to reflect 10x in your work:https://careers.arm.com/en/10x-mindset
Salary Range:
$241,100-$326,100 per yearWe value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.
Accommodations at Arm
At Arm, we want to build extraordinary teams. If you need an adjustment or an accommodation during the recruitment process, please email accommodations@arm.com. To note, by sending us the requested information, you consent to its use by Arm to arrange for appropriate accommodations. All accommodation or adjustment requests will be treated with confidentiality, and information concerning these requests will only be disclosed as necessary to provide the accommodation. Although this is not an exhaustive list, examples of support include breaks between interviews, having documents read aloud, or office accessibility. Please email us about anything we can do to accommodate you during the recruitment process.
Hybrid Working at Arm
Arm’s approach to hybrid working is designed to create a working environment that supports both high performance and personal wellbeing. We believe in bringing people together face to face to enable us to work at pace, whilst recognizing the value of flexibility. Within that framework, we empower groups/teams to determine their own hybrid working patterns, depending on the work and the team’s needs. Details of what this means for each role will be shared upon application. In some cases, the flexibility we can offer is limited by local legal, regulatory, tax, or other considerations, and where this is the case, we will collaborate with you to find the best solution. Please talk to us to find out more about what this could look like for you.
Equal Opportunities at Arm
Arm is an equal opportunity employer, committed to providing an environment of mutual respect where equal opportunities are available to all applicants and colleagues. We are a diverse organization of dedicated and innovative individuals, and don’t discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.