ServiceNow Logo

ServiceNow

Staff Machine Learning Engineer

Posted 10 Days Ago
Be an Early Applicant
Hybrid
Santa Clara, CA
176K-308K Annually
Senior level
Hybrid
Santa Clara, CA
176K-308K Annually
Senior level
Design, build, and operate production-grade agentic AI systems for ServiceNow. Responsibilities include multi-agent orchestration, tool use, planning, memory, failure recovery, enterprise-grounded reasoning, RAG and search pipelines, safety guardrails, observability, model integration, evaluation frameworks, and cost and latency optimization. The role also provides technical leadership through architecture decisions, code reviews, and coaching.
The summary above was generated by AI
Company Description

It all started when engineer Fred Luddy wrote code that automated a tedious task for his coworker, Phyllis. She cried tears of joy. That moment inspired Fred to build a company that could do that for everyone—freeing people from busywork so they could focus on meaningful work. Today, ServiceNow is the AI control tower for business reinvention. Our ServiceNow AI platform brings together any AI, any data, and any workflow— helping 85% of the Fortune 500® work smarter, faster, and better. We're building an AI-native culture where technology and talent are unstoppable together. And we're just getting started.

Join us to put AI to work for people.

 

Job Description

About the Team

The Agentic Engineering organization at ServiceNow is the customer-obsessed engineering group that builds a conversational AI experience that turns enterprise intent into completed work. We advance how enterprise AI reasons, remembers, and executes.

The Agent Orchestration team — the team you'll join — owns the execution core: the agent harness, orchestration runtime, multi-agent coordination, memory management, and the evaluation frameworks that ensure agents behave correctly in production. Every autonomous action Otto promises depends on what this team ships.

By joining our team, you’ll be at the forefront of our AI transformation journey, backed by the global scale of ServiceNow and the agility of a high-growth environment. We are looking for world-class talent to help us extend agentic AI to every employee across every corner of the business

You will design, build, and operate production-grade agentic AI systems embedded across ServiceNow's platform — autonomous agents that reason over real enterprise data, take action across workflows, and run safely at Fortune 500 scale. 

Your core focus areas: 

  • Agentic architecture. Design and ship multi-agent systems — orchestration, tool use, planning loops, memory, and failure recovery — that operate reliably in production, not in notebooks. 
  • Enterprise-grounded reasoning. Build agents that leverage ServiceNow's data layer — CMDB, Workflow Data Fabric, and Knowledge Graph — to make decisions with context no frontier model has on its own. 
  • Trust, safety, and governance. Own the guardrails: observability, human-in-the-loop controls, and compliance infrastructure that make autonomous systems safe to deploy at scale. 
  • Retrieval and grounding. Work closely with our search team to ensure agents are grounded in accurate, low-latency retrieval — RAG pipelines, hybrid search, re-ranking, and evaluation — as a critical dependency of agentic quality. 
  • Model integration and evaluation. Integrate frontier models (Anthropic, Google, OpenAI) into the Sense → Decide → Act → Govern architecture; evaluate trade-offs across cost, latency, and capability for production use cases. 
  • Engineering leadership. Raise the technical bar through architecture decisions, code reviews, and coaching — particularly on agentic design patterns and production AI discipline. 

Qualifications

To be successful in this role you have:

  • 6+ years building production software systems with a strong track record on reliability, performance, and scalability
  • Hands-on experience shipping generative AI products — not just integrating LLM APIs or building prototypes, but owning AI-powered features that production users depend on
  • Solid depth in how large language models work: failure modes, context constraints, and how prompt design shapes model behavior at scale
  • Practical prompt engineering experience: systematically designing, versioning, and evaluating prompts across model updates or A/B evaluation cycles
  • A real track record in eval engineering — not just familiarity, but a portfolio of evaluation suites designed, shipped, and used to drive quality decisions in production AI systems
  • Cost and efficiency awareness at the system level: experience reasoning about model routing, inference cost, and latency tradeoffs in production
  • Strong software engineering fundamentals: distributed systems, API design, and testing discipline
  • Comfort operating in fast-moving, ambiguous, startup-like AI product environments

Nice to Have

  • Exposure to AI services deployed in a micro services-based architecture (Kubernetes, OpenShift, etc.)
  • Experience tracing, debugging, identifying root causes, and resolving issues in AI codebases that span multiple services, multiple environments, and/or multiple tenants
  • Published work, patents, or open-source contributions in Machine Learning, AI, distributed systems, etc.

 

For positions in this location, we offer a base pay of $176,100 - $308,200, plus equity (when applicable), variable/incentive compensation and benefits. Sales positions generally offer a competitive On Target Earnings (OTE) incentive compensation structure. Please note that the base pay shown is a guideline, and individual total compensation will vary based on factors such as qualifications, skill level, competencies, and work location. We also offer health plans, including flexible spending accounts, a 401(k) Plan with company match, ESPP, matching donations, a flexible time away plan and family leave programs. Compensation is based on the geographic location in which the role is located and is subject to change based on work location.

Additional Information

Work Personas

We approach our distributed world of work with flexibility and trust. Work personas (flexible, remote, or required in office) are categories that are assigned to ServiceNow employees depending on the nature of their work and their assigned work location. Learn more here. To determine eligibility for a work persona, ServiceNow may confirm the distance between your primary residence and the closest ServiceNow office using a third-party service.

Equal Opportunity Employer

ServiceNow is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, national origin, age, disability, gender identity,  veteran status, or any other category protected by law. In addition, all qualified applicants with arrest or conviction records will be considered for employment in accordance with legal requirements.  

Accommodations

We strive to create an accessible and inclusive experience for all candidates. If you require a reasonable accommodation to complete any part of the application process, or are unable to use this online application and need an alternative method to apply, please contact [email protected] for assistance. 

Export Control Regulations

For positions requiring access to controlled technology subject to export control regulations, including the U.S. Export Administration Regulations (EAR), ServiceNow may be required to obtain export control approval from government authorities for certain individuals. All employment is contingent upon ServiceNow obtaining any export license or other approval that may be required by relevant export control authorities. 

From Fortune. ©2026 Fortune Media IP Limited. All rights reserved. Used under license.

Similar Jobs at ServiceNow

52 Minutes Ago
Hybrid
176K-308K Annually
Senior level
176K-308K Annually
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Design and lead production agentic AI systems for CPQ workflows, including multi-agent orchestration, async execution, streaming, state management, tool boundaries, MCP and A2A interoperability, RAG, and context engineering. Own the agent execution Harness, make architecture and performance decisions, support classical ML pipelines, and provide full-stack integration across Python, Java/Spring Boot, React, TypeScript, and Lit. Work directly with customers and product teams to deploy solutions and set technical direction.
Top Skills: A2A ProtocolAsyncioEmbeddingsFastapiGraph-Based RetrievalJavaLangchainLanggraphLitLlmsMcpPythonPyTorchRagReactScikit-LearnSpring BootTypescriptVector RetrievalWebsockets
5 Days Ago
Hybrid
Senior level
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Build and optimize scalable machine learning infrastructure for training, evaluating, deploying, and serving large language models. Develop workflow automation abstractions, distributed training and inference pipelines, monitoring and evaluation frameworks, and latency optimizations. Collaborate with machine learning, data infrastructure, analytics, engineering, and product teams while establishing ML and data engineering best practices for production systems.
Top Skills: C++Etl PipelinesGoHugging FaceLarge Language Models (Llms)MicroservicesPythonPyTorchTensorrt-LlmVllm
5 Days Ago
Hybrid
Senior level
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Build Moveworks’ agent evaluation and reward-modeling platform. Design configurable rubrics, deterministic validators, LLM judges, confidence scoring, and calibration against human-labeled trajectories. Analyze simulator-to-production divergence, maintain evaluation datasets, fine-tune smaller judge models, and develop process-level reward signals for optimizing prompts, tool selection, planning, retrieval, and routing. Establish versioned scenarios and reliable measurement standards for agent performance in stateful enterprise environments.
Top Skills: Knowledge DistillationLarge Language ModelsPreference TuningProcess Reward ModelsPythonRlaifRlhfSft

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account