NVIDIA Logo

NVIDIA

Senior Software Architect, AI and HPC

Posted 18 Days Ago
Be an Early Applicant
Remote
5 Locations
184K-357K
Senior level
Remote
5 Locations
184K-357K
Senior level
Responsible for creating proofs-of-concept, researching and designing features for AI and HPC communication middleware, and enhancing compiler features while collaborating in a multi-national environment.
The summary above was generated by AI

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people.

Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. The software architecture group at NVIDIA has openings for software architects in the field of AI and high-performance networking and system software. We research, develop, and deploy solutions in networking hardware, programming environments, and system software to make current and future high-end computer systems more performant, scalable, and usable. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work. Come join the team and see how you can make a lasting impact on the world.

What you will be doing

  • Creating proofs-of-concept to evaluate and motivate extensions in AI Frameworks (PyTorch/NEMO), HPC programming models (MPI, OpenSHMEM, PGAS), new runtime designs, and new network hardware features.

  • Research, design and implement features for AI and HPC communication middleware (NCCL, Open MPI, UCX, UCC, NVSHMEM), and Deep Learning frameworks such as TensorFlow/Pytorch.

  • Review , design, and implement features to enhance compiler features to support the NVIDIA networking ecosystem.

  • Research, design and develop hardware features relevant to scientific, Deep learning, and data-intensive workloads.

What we need to see

  • Ph.D, Masters, or Bachelors in , in computer science, computer engineering, or a closely related field or equivalent experience.

  • 8+ years of experience in parallel programming models, and/or network architecture.

  • Background in algorithm design, system programming, and computer architecture

  • Strong programming and software development skills

  • Ability and flexibility to work and communicate effectively in a multi-national, multi-time-zone corporate environment

Ways to stand out from the crowd:

  • Deep understanding of technology and passion for what you do

  • Strong collaborative and interpersonal skills, specifically a proven ability to effectively guide and influence within a dynamic matrix environment

  • Background with designing communication middleware for high-performance computing systems, including InfiniBand, DPUs, Ethernet, and Shared Memory

  • Experience developing and implementing features for compilers, optimizations for compilers, particularly Clang/LLVM, and NVIDIA compilers and experience implementing communications libraries, particularly MPI, OpenSHMEM, NCCL, NVSHMEM, UCX, UCC, or PGAS

  • Background with CUDA programming and NVIDIA GPUs and programming models for emerging architectures including hierarchical heterogeneous memory systems and accelerators.

With competitive salaries and a generous benefits package, we are widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us and, due to unprecedented growth, our exclusive engineering teams are rapidly growing. If you're a creative and autonomous engineer with a real passion for technology, we want to hear from you.

The base salary range is 184,000 USD - 356,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Top Skills

Ai Frameworks (Pytorch
Clang/Llvm
Cuda
Hpc Programming Models (Mpi
Nccl
Nemo)
Nvidia Compilers
Nvshmem
Open Mpi
Openshmem
Pgas)
TensorFlow
Ucc
Ucx

Similar Jobs

An Hour Ago
Easy Apply
Remote
United States
Easy Apply
Internship
Internship
Beauty • Robotics • Design • Appliances • Manufacturing
As an SQA Engineering Co-op, you will review product requirements, write automated test scripts, and support manual testing in a lab environment.
Top Skills: JavaLinuxNode.jsPythonRest Apis
2 Hours Ago
Easy Apply
Remote
31 Locations
Easy Apply
Senior level
Senior level
Cloud • Security • Software • Cybersecurity • Automation
The Principal Engineer, Analytics leads technical direction for analytics initiatives, mentors teams, conducts high-complexity problem-solving, and engages with stakeholders to optimize performance and scalability.
Top Skills: Ci/CdClickhouseGoKafkaNatsPostgresRuby On Rails
2 Hours Ago
Remote
8 Locations
Mid level
Mid level
Blockchain • Internet of Things • Payments • Cryptocurrency • Web3
As a Software Engineer, you will automate node deployments, enhance platform scalability and security while collaborating with different teams to integrate products seamlessly.
Top Skills: BlockchainGoSolidityTypescriptWeb3

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account