Industry not specified

Member of Technical Staff - Software Engineer (AI infra)- MAI Superintelligence Team

at Microsoft

Mid LevelNo visa sponsorshipData Science/AI/ML

Posted 4 hours ago

No clicks

Compensation: Not specified
City: Not specified
Country: Not specified

Microsoft AI is seeking a Member of Technical Staff - Software Engineer to help build the next wave of Copilot capabilities, contributing to AI model development, training and inference infrastructure, data curation, evaluation protocols, alignment and RLHF, and related topics at the cutting edge of AI. The role focuses on benchmarking, profiling, debugging, and tuning the training and inference of generative AI on production GPU clusters, maintaining reliability and performance across thousands of GPUs. You will collaborate with model scientists to instrument best-in-class tools and influence software and hardware roadmaps, delivering impact across a broad user base in a fast-paced, product-driven environment, and shaping the future of Copilot, Bing, Edge, and generative AI research.

Overview

Microsoft AI is looking for a Member of Technical Staff - Software Engineer to help build the next wave of capabilities of our personalized AI assistant, Copilot. We’re looking for someone who will bring an abundance of positive energy, empathy, and kindness to the team every day, in addition to being highly effective. The right candidate enjoys building world-class consumer experiences and products in a fast-paced environment. You will actively contribute to the development of AI models that are powering our innovative products. You will wear multiple hats and work on engineering, research, and everything in between. Your contributions will span model architecture, data curation, training and inference infrastructures, evaluation protocols, alignment and reinforcement learning from human feedback (RLHF), and many other exciting topics at the cutting edge of AI.

Microsoft AI is building foundational models to develop novel responsible and efficient artificial general intelligence. The foundational models require large compute-capacity, and as a Member of Technical Staff - Software Engineer you would be responsible to benchmark, profile, debug and tune the training and inference of generative AI running in the production Graphics Processing Unit (GPU) clusters. Sophisticated tools and techniques are needed to maintain the reliability, runtime performance, and health of the hundreds of nodes in a supercomputer consisting of thousands of GPUs. You must work closely with model scientists to instrument best known state-of-the-art and novel tools and techniques to achieve the smooth operation of the AI jobs. As a contributing member of the core group of engineers, you would also bring to the table best practices driving architectural changes and influence roadmap of relevant software and hardware components. Your work will directly impact the business goals of a wide range of users and facilitate the next wave of growth and innovation in AI.

Our newly formed organization, Microsoft AI, is dedicated to advancing Copilot and other consumer AI products and research. The team is responsible for Copilot, Bing, Edge, and generative AI research. Come be a part of the team shaping the future personal computing.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities

Develop and tune the pretraining scalable software for Nvidia GB200 72NVL CX8 and AMD MIxxx architectures.
Benchmark GB200 and AMD MIxxx GPU clusters.
Gather data and insights to develop the pretraining compute roadmap.
Care deeply about conversational AI and its deployment.
Actively contribute to the development of AI models that are powering our innovative products.
Find a path to get things done despite roadblocks to get your work into the hands of users quickly and iteratively.
Enjoy working in a fast-paced, design-driven, product development cycle.
Embody our Cultureand Values.

Qualifications

Required Qualifications:

Bachelor's Degree in Computer Science, or related technical discipline AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
OR equivalent experience.
Experience with generative AI.
Experience with distributed computing.

Preferred Qualifications:

Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
OR Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
OR equivalent experience.
Experience in leading technical projects and supporting architectural decisions with data.

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Back to all Data Science / AI / ML jobs

Apply now