Senior System Software Engineer, AI Solutions Engineering

NVIDIA is hiring senior system software engineers in its Infrastructure, Planning and Process Team (IPP), to accelerate AI adoption across various engineering workflows within the company. IPP is a global organization within NVIDIA. The group works with various other teams within NVIDIA such as Graphics Processors, Mobile Processors, Deep Learning, Artificial Intelligence and Driverless Cars to cater to their infrastructure needs. These cloud services provide almost half a million automated jobs per day on five thousand servers helping with the productivity of thousands of NVIDIA’s software developers worldwide. The cloud hosts a heterogeneous mix of machines and devices with various operating systems (Windows/Linux/Android), a multitude of hardware platforms both NVIDIA GPUs and Tegra processors. Are you passionate about infrastructure and looking for complex meaningful issues, ready to build the next generation of cloud services, design creative solutions, mine through data to uncover real problems and fix them? We are excited to have a fun-loving person like you join our team!
As a Senior Software Engineer, you will be responsible for building industry insights into AI tools and technologies, collaborating with AI product vendors, and evaluating AI based product features. You will accelerate the evaluation of tools by developing robust testing environments, with a strong focus on efficiency and quality metrics. Additionally, you will design and implement tools and software solutions that leverage Large Language Models and agentic AI to automate workflows and enhance the productivity of engineers across software development, DevOps, and Site Reliability Engineering (SRE) activities.

What you’ll be doing:

• Responsible for building industry insights into AI tools, collaborating with vendors, and evaluating AI based product features.

• To accelerate the evaluation of AI tools by developing robust testing environments, with a strong focus on functionality requirement coverage and efficiency.

• Responsible for implementing AI/ML use cases to improve efficiency in software development, DevOps and SRE workflows.

• Work with software architects and developers in internal and external development teams.

What we need to see:

• BS (MS preferred) or equivalent experience in EE/CS with 5+ years of work experience.

• Well versed with Large Language Mode (LLM), Machine Learning (ML), Agentic AI  techniques.

• Hands-on experience in leveraging large language models (LLMs) and implementing agentic AI for various workflows.

• Expert programming ability in Python, Go or Java.

• Experience in working with SQL/NoSQL database systems such as MySQL, MongoDB or Elasticsearch.

• Good understanding of distributed systems, understanding of microservice architecture and REST APIs.

• Excellent knowledge and working experience with Docker containers. Consistent track record in developing large scale distributed applications.

• Ability to effectively work across organizational boundaries to enhance alignment and productivity between teams.

• Open to take on SRE or program management responsibilities if the need arises. (aligned to the NVIDIA “The mission is the Boss” culture).

Ways to stand out from the crowd:

• Proactively track AI tool and technology trends, build insights, and collaborate with vendors early to address feature gaps before NVIDIA adoption.

• We have some of the most forward-thinking and versatile people in the world working for us and, due to unprecedented growth, our best-in-class engineering teams are rapidly growing. We are building a team that will truly change the world. If you are passionate about new technologies, care about software quality, and want to be part of the future of transportation and AI, I would love for you to join us.

• Expertise in leveraging large language models (LLMs) and Agentic AI to automate complex workflows, with knowledge of retrieval-augmented generation(RAG) and fine-tuning LLMs on enterprise data.

• Prior development of a large software project using service oriented architecture operating with real time constraints

We have some of the most forward-thinking and versatile people in the world working for us and, due to unprecedented growth, our best-in-class engineering teams are rapidly growing. We are building a team that will truly change the world. If you are passionate about new technologies, care about software quality, and want to be part of the future of transportation and AI, we would love for you to join us.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 148,000 USD - 235,750 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4.Applications for this job will be accepted at least until July 29, 2025.NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.