Principal Software Engineer

<b>Overview</b><br><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">Microsoft’s AI infrastructure is evolving rapidly to support the next generation of large-scale AI training and inference. The AI Frameworks (AIFx) Networking &amp; Systems Tools (NeST) organisation develops foundational system software that enables Microsoft’s Maia accelerator platforms across pre-silicon development, hardware bring-up, cloud integration and production cloud infrastructure that enables AI accelerators to operate reliably and efficiently at cloud scale.</span></div><div> </div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">Within NeST, the India Development Centre is building end-to-end engineering competency across the Maia system software stack. Our work spans the boundary between distributed cloud systems and low-level accelerator software, including control-plane services, host and device management software, accelerator virtualisation, Kubernetes-based infrastructure, Developer/Debugger Infrastructure tools, hardware lifecycle management, reliability, telemetry and diagnostics.</span></div><div> </div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">We are looking for a Principal Software Engineer with deep expertise in systems software and distributed systems to help architect and build the software infrastructure for large-scale AI accelerator platforms.</span></div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">In this role, you will work across cloud services, operating systems, host agents, device interfaces and accelerator infrastructure. You will solve challenging problems involving hardware lifecycle management, orchestration, resource management, fault detection and recovery, virtualisation, observability and infrastructure reliability.</span></div><div> </div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">This is an opportunity to influence the architecture of foundational AI infrastructure and build systems that operate across a diverse and evolving ecosystem of GPUs and AI accelerators.</span></div><div><p><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.</span></p></div><div> </div><br><br><b>Responsibilities</b><br><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">• Architect and develop distributed control-plane services for provisioning, orchestration and lifecycle management of AI accelerator infrastructure.</span></div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">• Design scalable systems for state management, health monitoring, reconciliation and fault recovery.</span></div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">• Build host and device management software connecting cloud infrastructure with operating systems, drivers, firmware and accelerator devices.</span></div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">• Develop infrastructure supporting accelerator virtualisation, device assignment, isolation and resource management.</span></div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">• Integrate accelerator infrastructure with Kubernetes and cloud-native platforms.</span></div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">• Design robust APIs and abstractions across cloud services, host software and device interfaces.</span></div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">• Drive improvements in reliability, security, observability, diagnostics, testing and operational readiness.</span></div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">• Champion AI-assisted engineering practices across architecture, design, coding, testing, debugging, code reviews and documentation to improve engineering velocity and software quality.</span></div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">• Apply AI-assisted workflows to accelerate code comprehension, root-cause analysis, test development, design exploration and engineering automation.</span></div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">• Identify opportunities to integrate AI into engineering workflows to reduce repetitive work, shorten development feedback loops and improve developer effectiveness.</span></div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">• Use AI-assisted learning together with engineering fundamentals to accelerate development of systems, hardware and AI infrastructure domain competency.</span></div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">• Establish reusable engineering practices and mentor engineers on the responsible and effective application of AI throughout the software development lifecycle.</span></div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">• Diagnose complex system issues spanning distributed services, operating systems, host software, drivers, firmware and hardware.</span></div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">• Lead architecture and design reviews, solve complex cross-layer system issues and mentor engineers.</span></div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">• Collaborate across hardware, firmware, OS, cloud infrastructure and AI platform teams to deliver end-to-end solutions.</span></div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">• Partner with hardware, firmware, operating system, cloud infrastructure and AI platform teams to deliver end-to-end solutions.</span></div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">• Mentor engineers and contribute to raising the technical capabilities and engineering standards of the broader organisation.</span></div><div> </div><br><br><b>Qualifications</b><br><p><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;"><strong>Required Qualifications: </strong></span></p><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">• Bachelor’s Degree in Computer Science, Computer Engineering or related technical discipline, or equivalent experience with at least 12+ years of relevant industry experience.</span></div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">• Software engineering experience in C++, C, C#, Rust, Go or similar languages.</span></div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">• Experience designing and developing distributed systems, cloud infrastructure or systems software.</span></div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">• Understanding of concurrency, state management, asynchronous programming and failure recovery.</span></div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">• Experience building reliable production software with strong debugging and problem-solving skills.</span></div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">• Demonstrated technical leadership across complex, multi-team engineering projects.</span></div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">• Ability to leverage AI-assisted engineering tools and workflows, combined with strong engineering judgement, to improve software development effectiveness, quality and technical problem solving.</span></div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">• Ability to rapidly develop expertise in complex technical domains and help raise engineering competency across the team through mentoring, technical guidance and knowledge sharing.</span></div><div> </div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;"><strong>Preferred Qualifications:</strong></span></div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">• Experience with cloud control planes, resource orchestration or infrastructure management systems.</span></div><div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">• Experience with Kubernetes, containers and cloud-native infrastructure.</span></div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">• Experience with GPU, AI accelerator or heterogeneous compute infrastructure.</span></div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">• Knowledge of PCIe, SR-IOV, PF/VF, device virtualisation or device passthrough.</span></div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">• Experience with host/device agents, Linux systems software, device drivers or firmware interfaces.</span></div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">• Experience with hardware lifecycle management, health monitoring and fault recovery.</span></div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">• Experience with telemetry, observability and debugging large-scale production systems.</span></div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">• Experience applying AI-assisted software engineering to design, development, code comprehension, debugging, testing, documentation or engineering automation.</span></div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">• Experience identifying and developing AI-enabled engineering workflows that improve developer productivity and reduce repetitive engineering effort.</span></div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">• Experience using AI-assisted approaches to accelerate understanding of large and complex codebases, system architectures and cross-layer technical issues.</span></div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">• Experience establishing engineering practices that help teams adopt AI effectively while maintaining code quality, security, correctness and engineering accountability.</span></div><div> </div></div><div><span style="font-family: arial, helvetica, sans-serif; font-size: 10pt;">#AIINFRA</span></div> <br><p>This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.</p><br><hr><br><p>Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about <a href="https://careers.microsoft.com/v2/global/en/accessibility.html"><b><u>requesting accommodations.</u></b></a></p>