Lead HPC & AI Infrastructure Architect

ADVANCE YOUR CAREER. ADVANCE THE WORLD.

At AMD, we believe technology has the power to solve the world’s most important challenges. From advancing healthcare and scientific discovery to powering AI and the technologies people rely on every day, innovation at AMD is shaping the future.

Whether you’re designing next-gen processors, enabling AI breakthroughs, or bringing leading edge products to market, every role at AMD contributes to something bigger — technology that moves the world forward. Join us and, together, we’ll advance your career.

THE ROLE

We are seeking a Lead HPC & AI Infrastructure Architect to own the architecture and technical direction of large-scale CPU and GPU platforms across on-premises infrastructure, public cloud, and specialized GPU cloud providers. You will translate scientific computing, engineering, and AI requirements into secure, reliable, and cost-effective platforms for tightly coupled HPC workloads, distributed model training, and inference services.

This hands-on leadership role spans design, workload validation, deployment, and lifecycle management. You will guide infrastructure engineering and SRE teams and partner with researchers, AI engineers, cloud providers, and hardware vendors to deliver production-ready platforms.

THE PERSON

You combine deep systems expertise with practical architectural judgment. You take ownership of complex technical problems, validate decisions with measurable results, and communicate tradeoffs clearly. You collaborate across engineering, operations, security, and research teams; mentor engineers; and balance performance, reliability, security, delivery timelines, and cost. You can independently guide initiatives from requirements through production acceptance.

KEY RESPONSIBILITIES

- Own the HPC and AI infrastructure roadmap, reference architectures, and standards for CPU/GPU clusters. Define workload placement across bare metal, virtual machines, Slurm, and Kubernetes.
- Lead designs covering CPU/NUMA and GPU topology, accelerator interconnects, networking, storage, and identity. Establish validated hardware, firmware, driver, and runtime baselines.
- Architect RDMA-capable fabrics and storage tiers. Validate collective communication, parallel I/O, dataset delivery, and checkpoint performance at target scale.
- Design resource sharing through Slurm accounting, fair-share, quotas, QoS, preemption, and tenant isolation. Enable reproducible environments, self-service onboarding, and inference capacity planning.
- Standardize provisioning, configuration, and fleet upgrades through infrastructure as code, automation, and CI/CD; manage images, containers, and configuration drift.
- Define production acceptance criteria, service-level objectives, and fleet observability. Partner with SRE on fault isolation, job recovery, checkpoint/restart, incident analysis, and capacity planning.
- Benchmark HPC and distributed AI workloads; improve scaling efficiency, throughput, inference latency, GPU utilization, and cost efficiency through bottleneck analysis.
- Embed federated identity, least-privilege access, tenant and network isolation, secrets management, controlled container privileges, audit logging, and vulnerability management.
- Lead architecture reviews, proofs of concept, provider evaluations, and technical escalations. Document tradeoffs, mentor engineers, and align delivery with stakeholders and infrastructure partners.

PREFERRED EXPERIENCE

- Typically 10+ years in infrastructure, cloud engineering, or distributed systems, including 5+ years designing and delivering production HPC or GPU platforms; equivalent demonstrated experience is welcome.
- Ownership of large-scale cluster deployments involving hundreds of nodes or comparable complexity, with measurable improvements in workload performance, reliability, or cost.
- Deep expertise in a major cloud platform such as Azure, OCI, or AWS, with experience integrating cloud and on-premises systems. Familiarity with specialized GPU providers such as Crusoe or TensorWave.
- Strong Linux troubleshooting skills across CPU/NUMA topology, PCIe, GPU connectivity, drivers, virtualization, containers, and distributed runtime environments.
- Hands-on Slurm scheduling and resource governance, plus Kubernetes experience. Understanding of MPI, distributed training, collective communication, and AI inference infrastructure.
- AMD Instinct GPUs, ROCm, RCCL, and multi-node PyTorch workloads, including compatibility validation and performance troubleshooting.
- HPC networking and storage, including RDMA, RoCE or InfiniBand, topology and oversubscription tradeoffs, parallel I/O, data placement, checkpointing, and enterprise connectivity.
- Parallel and shared storage technologies such as Lustre, IBM Storage Scale, BeeGFS, NFS, or VAST, and object storage; network, storage, and collective benchmarks for cluster acceptance.
- Terraform or equivalent infrastructure as code, Ansible or comparable configuration management, Python or Bash, and Git-based CI/CD. Familiarity with Azure CycleCloud or AWS ParallelCluster.
- Observability and SRE practices using tools such as Prometheus and Grafana, including secure access, resource controls, fault recovery, and production readiness.
- Experience establishing observability and SRE practices using tools such as Prometheus and Grafana, and designing security boundaries and resource controls for shared infrastructure.
- Ability to lead cross-functional technical work independently, communicate architecture tradeoffs clearly, and guide projects from requirements through production acceptance.
- Coordination with hardware and data center teams on rack power, liquid cooling, facility capacity, and other constraints affecting GPU platform design.

Preferred qualifications

- Hands-on experience with AMD Instinct GPUs, ROCm, RCCL, and multi-node PyTorch workloads, including compatibility validation and performance troubleshooting.
- Experience with Azure, OCI, Crusoe, or TensorWave GPU environments, and cluster provisioning frameworks such as Azure CycleCloud or AWS ParallelCluster.
- Experience with Lustre, IBM Storage Scale, BeeGFS, or VAST, plus network, storage, and collective communication benchmarks used for cluster acceptance.
- Experience with LLM serving platforms such as vLLM or SGLang, model parallelism, inference capacity planning, and usage accounting or cost allocation.
- Understanding of rack power, liquid cooling, and facility capacity constraints, with experience coordinating platform requirements with hardware and data center teams.

ACADEMIC CREDENTIALS

Bachelor's degree in Computer Science, Computer Engineering, or a related technical field, or equivalent practical experience.

This role is not eligible for visa sponsorship.

#LI-RD1

Benefits offered are described:  AMD benefits at a glance .

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law.   We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.

AMD may use Artificial Intelligence to help screen, assess or select applicants for this position.  AMD’s “Responsible AI Policy” is available here.

This posting is for an existing vacancy.