LOG IN
SIGN UP
Tech Job Finder - Find Software, Technology Sales and Product Manager Jobs.
Sign In
OR continue with e-mail and password
E-mail address
Password
Don't have an account?
Reset password
Join Tech Job Finder
OR continue with e-mail and password
E-mail address
First name
Last name
Username
Password
Confirm Password
How did you hear about us?
By signing up, you agree to our Terms & Conditions and Privacy Policy.

Distinguished Software Architect - Deep Learning and HPC Communications

at Nvidia

Back to all C/C++ jobs
N
Industry not specified

Distinguished Software Architect - Deep Learning and HPC Communications

at Nvidia

Tech LeadNo visa sponsorshipC/C++/C#

Posted 12 hours ago

No clicks

Compensation
$320,000 – $488,750 USD

Currency: $ (USD)

City
Not specified
Country
United States

NVIDIA is seeking a Distinguished Software Architect to co-design the next generation data center platforms for DL and HPC communications libraries (NCCL, NVSHMEM, UCX). The role focuses on research and design of new communication technologies, collaborating with GPU, Networking, and software teams to deliver scalable interconnects across tens of thousands of GPUs. You will analyze data from proofs-of-concept, drive adoption of new technologies across application verticals, and stay current with DL research and standards. The position requires deep expertise in HPC, parallel programming, networking, and CUDA, with a 15+ year track record.

NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. Our work opens up new universes to explore, enables amazing creativity and discovery, and powers what were once science fiction inventions from artificial intelligence to autonomous cars.

We are the GPU Communications Libraries and Networking team at NVIDIA. We deliver communication libraries like NCCL, NVSHMEM, UCX for Deep Learning and HPC. We are looking for a Distinguished Software Architect to help co-design our next generation data center platforms. DL and HPC applications have a huge compute demand already and run on scales which go up to tens of thousands of GPUs. The GPUs are connected with high-speed interconnects (eg. NVLink, PCIe) within a node and with high-speed networking (eg. Infiniband, Ethernet) across the nodes. Communication performance between the GPUs has a direct impact on the end-to-end application performance; and the stakes are even higher at huge scales! This is an outstanding opportunity to push the limits on the state-of-the-art and deliver platforms the world has never seen before. Are you ready to contribute to the development of innovative technologies and help realize NVIDIA's vision?

What you will be doing:

  • Research new communication technologies (e.g. expand the GPUDirect technology portfolio) and design new features for our communication libraries

  • Propose innovative solutions in HW and SW for our next-gen platforms. You will co-design these solutions with the GPU, Networking, and SW architects and ensure seamless integration with the software stacks

  • Inspire changes based on quantitative data coming from proof-of-concepts or detailed technical analysis/modeling

  • Drive the adoption of new communication technologies across application verticals

  • Keep up with the latest DL research and collaborate with diverse teams (internal and external), including DL researchers, and customers

What we need to see:

  • PHD in Computer Science, Computer Engineering or related field or strong equivalent experience; 15+ years of relevant experience in academia or the industry

  • Expert in following areas: HPC, parallel programming models (MPI, SHMEM), at least one communication runtime (MPI, NCCL, NVSHMEM, OpenSHMEM, UCX, UCC), computer and system architecture, GPU architecture and CUDA

  • Deep understanding of various aspects of high performance networking from prior work experience: network technologies (Infiniband, Ethernet), network design, network topologies, network debug and performance analysis

  • Strong in at least a few of these areas: ML/DL fundamentals and how they tie to communications, parallel algorithms, fault tolerance and resiliency, competitive assessments, performance analysis and optimizations for parallel applications on large clusters, developing applications using DL Frameworks (PyTorch, TensorFlow)

  • Programming fluency with C or C++ for systems software development

  • Flexibility to work and communicate effectively across different HW/SW teams and timezones

Ways to stand out from the crowd:

  • Industry recognized leader in HPC/DL communications with history of patents, publications and conference talks and keynotes in areas relevant to this role

  • Influential role in industry standards (e.g. MPI, OpenSHMEM) and open source software (e.g. PyTorch, UCX, Open MPI)

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people on the planet working for us. If you're creative and autonomous, we want to hear from you!

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 320,000 USD - 488,750 USD.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until February 23, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Distinguished Software Architect - Deep Learning and HPC Communications

at Nvidia

Back to all C/C++ jobs
N
Industry not specified

Distinguished Software Architect - Deep Learning and HPC Communications

at Nvidia

Tech LeadNo visa sponsorshipC/C++/C#

Posted 12 hours ago

No clicks

Compensation
$320,000 – $488,750 USD

Currency: $ (USD)

City
Not specified
Country
United States

NVIDIA is seeking a Distinguished Software Architect to co-design the next generation data center platforms for DL and HPC communications libraries (NCCL, NVSHMEM, UCX). The role focuses on research and design of new communication technologies, collaborating with GPU, Networking, and software teams to deliver scalable interconnects across tens of thousands of GPUs. You will analyze data from proofs-of-concept, drive adoption of new technologies across application verticals, and stay current with DL research and standards. The position requires deep expertise in HPC, parallel programming, networking, and CUDA, with a 15+ year track record.

NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. Our work opens up new universes to explore, enables amazing creativity and discovery, and powers what were once science fiction inventions from artificial intelligence to autonomous cars.

We are the GPU Communications Libraries and Networking team at NVIDIA. We deliver communication libraries like NCCL, NVSHMEM, UCX for Deep Learning and HPC. We are looking for a Distinguished Software Architect to help co-design our next generation data center platforms. DL and HPC applications have a huge compute demand already and run on scales which go up to tens of thousands of GPUs. The GPUs are connected with high-speed interconnects (eg. NVLink, PCIe) within a node and with high-speed networking (eg. Infiniband, Ethernet) across the nodes. Communication performance between the GPUs has a direct impact on the end-to-end application performance; and the stakes are even higher at huge scales! This is an outstanding opportunity to push the limits on the state-of-the-art and deliver platforms the world has never seen before. Are you ready to contribute to the development of innovative technologies and help realize NVIDIA's vision?

What you will be doing:

  • Research new communication technologies (e.g. expand the GPUDirect technology portfolio) and design new features for our communication libraries

  • Propose innovative solutions in HW and SW for our next-gen platforms. You will co-design these solutions with the GPU, Networking, and SW architects and ensure seamless integration with the software stacks

  • Inspire changes based on quantitative data coming from proof-of-concepts or detailed technical analysis/modeling

  • Drive the adoption of new communication technologies across application verticals

  • Keep up with the latest DL research and collaborate with diverse teams (internal and external), including DL researchers, and customers

What we need to see:

  • PHD in Computer Science, Computer Engineering or related field or strong equivalent experience; 15+ years of relevant experience in academia or the industry

  • Expert in following areas: HPC, parallel programming models (MPI, SHMEM), at least one communication runtime (MPI, NCCL, NVSHMEM, OpenSHMEM, UCX, UCC), computer and system architecture, GPU architecture and CUDA

  • Deep understanding of various aspects of high performance networking from prior work experience: network technologies (Infiniband, Ethernet), network design, network topologies, network debug and performance analysis

  • Strong in at least a few of these areas: ML/DL fundamentals and how they tie to communications, parallel algorithms, fault tolerance and resiliency, competitive assessments, performance analysis and optimizations for parallel applications on large clusters, developing applications using DL Frameworks (PyTorch, TensorFlow)

  • Programming fluency with C or C++ for systems software development

  • Flexibility to work and communicate effectively across different HW/SW teams and timezones

Ways to stand out from the crowd:

  • Industry recognized leader in HPC/DL communications with history of patents, publications and conference talks and keynotes in areas relevant to this role

  • Influential role in industry standards (e.g. MPI, OpenSHMEM) and open source software (e.g. PyTorch, UCX, Open MPI)

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people on the planet working for us. If you're creative and autonomous, we want to hear from you!

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 320,000 USD - 488,750 USD.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until February 23, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

SIMILAR OPPORTUNITIES

No similar jobs available at the moment.