ServiceNow Logo

ServiceNow

Staff Machine Learning Engineer, Agentic App Platform

Posted 2 Hours Ago
Be an Early Applicant
Hybrid
Mountain View, CA
176K-308K Annually
Senior level
Hybrid
Mountain View, CA
176K-308K Annually
Senior level
Scale and optimize a generative conversational AI platform for enterprise use. Build product infrastructure and configurable interfaces, design scalable chat APIs (MS Teams, Slack, Web), optimize dialog engine for low latency and small memory footprint, enable real-time multilingual translation, implement logging/tracing/metrics and debugging tools, and collaborate with ML, product, and support teams to deliver robust, high-performance features at scale.
The summary above was generated by AI
Company Description

It all started when engineer Fred Luddy wrote code that automated a tedious task for his coworker, Phyllis. She cried tears of joy. That moment inspired Fred to build a company that could do that for everyone—freeing people from busywork so they could focus on meaningful work. Today, ServiceNow is the AI control tower for business reinvention. Our ServiceNow AI platform brings together any AI, any data, and any workflow— helping 85% of the Fortune 500® work smarter, faster, and better. We're building an AI-native culture where technology and talent are unstoppable together. And we're just getting started.

Join us to put AI to work for people.

 

Job Description

The Role

Are you up for an exciting challenge? Picture yourself scaling and optimizing a cutting-edge Generative AI product that offers instant assistance to enterprise users. Ever wondered how to apply abstraction, scalability, and optimization to a dynamic, probabilistic, and generative conversational system? If so, we invite you to join our Conversation Engine team. At our company, you'll have the unique opportunity to work at the core of Moveworks Generative AI product. Your main focus will be scaling and optimizing it to meet the growing demands of the enterprise solution space. Take a look at our recent posts (Moveworks Live, Creator Studio) on Moveworks’s groundbreaking solutions for enterprise AI. As pioneers in enterprise AI, we don't follow a set formula for building the next solution. Instead, we encourage you to bring your innovative ideas and imagination to solve unsolved problems. You'll collaborate closely with machine learning experts and cross-functional teams, rapidly iterating over new ideas, and leveraging user behavior data to make informed decisions. Your challenge will be to scale and optimize our conversation engine to support hundreds of millions of users, across multiple chat channels and use cases, and enhance our end-to-end product infrastructure with the utmost engineering quality and robustness.

What you get to do in this role:

 

  • Construct an extensive product infrastructure, complete with user-friendly interfaces that empower engineers and configurators to effortlessly customize and optimize generative AI models. This includes collecting data and feedback, adapting to diverse enterprise use cases and business contexts, and delivering domain-specific conversational experiences.
  • Design scalable API abstractions for our conversation platform, which supports all popular chat clients (for example, MSTeams, Slack, and Web) and offers a neutral API for developing other parts of the engineering system.
  • Optimize the dialog engine to accommodate a wide range of conversational features, leveraging private domain knowledge unique to each enterprise customer in the cloud, and enable real-time multilingual translation. You will achieve this with minimal memory footprint, low latency, and streamlined development process for application engineers.
  • Champion the best practices for coding patterns, API design, scalability, robustness, and optimization. Foster a culture of excellence and continuous improvements among fellow engineers.
  • Provide comprehensive insights and visibility into the performance of our conversational AI product. This involves implementing a robust logging and tracing framework, user-friendly debugging and triaging tools, and automated metrics for efficient monitoring and analysis.
  • Collaborate closely with ML engineers, application engineers, product teams, and customer support teams to drive the development of new features and scalability initiatives.

Qualifications

To be successful in this role you have:

 

  • A strong foundation in computer science and software engineering, coupled with expertise in building scalable systems.
  • A deep understanding of clean, modular, and scalable API design. You have the ability to champion best coding practices and influence fellow engineers to uphold high standards of code quality and craftsmanship.
  • A passion for optimizing systems and improving performance. You are well-versed in tracing, logging, and metrics frameworks, and possess a systematic approach to quickly identify and resolve latency bottlenecks, race conditions, and throughput limitations.
  • The ability to independently research new requirements and develop innovative solutions. You thrive in an environment of fast-paced coding and execution, embracing rapid iterations to deliver results.
  • Strong communication skills to effectively articulate rationales and design approaches. You have a cross-functional awareness that enables you to collaborate seamlessly with various teams.
  • A bachelor's degree or higher in computer science or a related field, demonstrating your academic foundation in the field.
  • 7+ years of professional development experience, specifically in building systems at scale.

For positions in this location, we offer a base pay of $176,100-308,200, plus equity (when applicable), variable/incentive compensation and benefits.  Sales positions generally offer a competitive On Target Earnings (OTE) incentive compensation structure.  Please note that the base pay shown is a guideline, and individual total compensation will vary based on factors such as qualifications, skill level, competencies and work location.  We also offer health plans, including flexible spending accounts, a 401(k) Plan with company match, ESPP, matching donations, a flexible time away plan and family leave programs.  

 

Compensation is based on the geographic location in which the role is located and is subject to change based on work location. 

Additional Information

Work Personas

We approach our distributed world of work with flexibility and trust. Work personas (flexible, remote, or required in office) are categories that are assigned to ServiceNow employees depending on the nature of their work and their assigned work location. Learn more here. To determine eligibility for a work persona, ServiceNow may confirm the distance between your primary residence and the closest ServiceNow office using a third-party service.

Equal Opportunity Employer

ServiceNow is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, national origin, age, disability, gender identity,  veteran status, or any other category protected by law. In addition, all qualified applicants with arrest or conviction records will be considered for employment in accordance with legal requirements.  

Accommodations

We strive to create an accessible and inclusive experience for all candidates. If you require a reasonable accommodation to complete any part of the application process, or are unable to use this online application and need an alternative method to apply, please contact [email protected] for assistance. 

Export Control Regulations

For positions requiring access to controlled technology subject to export control regulations, including the U.S. Export Administration Regulations (EAR), ServiceNow may be required to obtain export control approval from government authorities for certain individuals. All employment is contingent upon ServiceNow obtaining any export license or other approval that may be required by relevant export control authorities. 

From Fortune. ©2026 Fortune Media IP Limited. All rights reserved. Used under license.

Similar Jobs at ServiceNow

3 Hours Ago
Hybrid
176K-308K Annually
Senior level
176K-308K Annually
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Design, scale, and optimize a generative conversational AI platform and conversation engine for enterprise use. Build product infrastructure and APIs, improve performance and memory/latency, implement logging/tracing/metrics, enable domain-specific and multilingual experiences, and collaborate with ML, product, and support teams to deliver robust, scalable solutions.
Top Skills: Agentic AiGenerative AiLlmsLogging FrameworksMicrosoft Teams (Msteams)Multilingual TranslationSlackTracing FrameworksWeb Apis
3 Hours Ago
Hybrid
176K-308K Annually
Senior level
176K-308K Annually
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Scale and optimize a generative conversation engine for enterprise use: build product infrastructure and APIs, optimize dialog performance and memory, enable multilingual support, implement logging/tracing/metrics and debugging tools, and collaborate with ML, product, and support teams to deliver robust, scalable conversational AI.
Top Skills: APIsGenerative AiLlmsLogging FrameworksMetrics FrameworksMs TeamsReal-Time TranslationSlackTracing FrameworksWeb
6 Days Ago
Hybrid
Senior level
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Scale and optimize a generative, agentic conversation engine for enterprise use: build product infrastructure and neutral APIs for chat clients, minimize latency and memory, enable private-domain knowledge and multilingual translation, implement logging/tracing/metrics, provide debugging tools, and collaborate with ML, product, and support teams.
Top Skills: Agentic AiApi DesignConversation EngineGenerative AiLarge Language Models (Llms)Logging FrameworksMetrics/Monitoring FrameworksMicrosoft TeamsReal-Time Multilingual TranslationSlackTracing FrameworksWeb

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account