ServiceNow Logo

ServiceNow

Software Engineer

Posted 2 Days Ago
Hybrid
Santa Clara, CA
126K-195K Annually
Junior
Hybrid
Santa Clara, CA
126K-195K Annually
Junior
Build evaluation infrastructure and observability for ServiceNow’s AI coding assistant. Responsibilities include scaling evaluation orchestration, designing benchmarks and scoring systems, analyzing model failures, benchmarking foundation models, and tracking agent telemetry such as token usage, cache efficiency, inference cost, and correctness.
The summary above was generated by AI
Company Description

It all started when engineer Fred Luddy wrote code that automated a tedious task for his coworker, Phyllis. She cried tears of joy. That moment inspired Fred to build a company that could do that for everyone—freeing people from busywork so they could focus on meaningful work. Today, ServiceNow is the AI control tower for business reinvention. Our ServiceNow AI platform brings together any AI, any data, and any workflow— helping 85% of the Fortune 500® work smarter, faster, and better. We're building an AI-native culture where technology and talent are unstoppable together. And we're just getting started.

Join us to put AI to work for people.

 

Job Description

The team

Build Agent is ServiceNow's AI coding assistant, purpose-built for the platform's metadata-driven substrate - operating natively across ServiceNow's scoped applications, tables, and metadata types. The framework is critical to Build Agent success — it's already driven measurable wins: recovering Build Agent correctness, cutting latency and inference cost ahead of a major release, and catching high-severity defects that manual testing missed before they reached production.

Key areas of focus include:

  • Evaluation Infrastructure: Golden prompt sets, Pass@1 and functional scoring, failure categorization (plumbing vs. metadata-creation failures), and coverage across ServiceNow metadata types and UI workflows.
  • Model Support & Benchmarking: Structured evaluation of candidate foundation models against the production default, with failure-consistency analysis to separate scaffold/tuning issues from genuine capability gaps.
  • Telemetry: Token usage, cache efficiency, and inference cost tracked alongside correctness as first-class release signals.

What you get to do in this role

  • Eval orchestration at scale
  • Agent observability and tracing

Qualifications

To be successful in this role you have:

  • Direct experience building evaluation systems for LLM-based products — scoring methodology, benchmark design, and failure analysis, not just prompt engineering.
  • A working understanding of coding agent architecture: tool use, agentic loops, context management, and the tradeoffs between generic and domain-specific scaffolding.
  • 2+ years of experience with technologies relevant to ServiceNow, including advanced coding skills and fluency in one or more of Java, C++, Shell, or JavaScript.
  • Experience critically evaluating foundation models — distinguishing real capability differences from tuning or scaffold artifacts.
  • Ability to execute against ambiguous priorities, weighing context, risk, and desired outcomes — particularly where eval data is incomplete or contested.

For positions in this location, we offer a base pay of $125,700 - $194,800, plus equity (when applicable), variable/incentive compensation and benefits. Sales positions generally offer a competitive On Target Earnings (OTE) incentive compensation structure. Please note that the base pay shown is a guideline, and individual total compensation will vary based on factors such as qualifications, skill level, competencies, and work location. We also offer health plans, including flexible spending accounts, a 401(k) Plan with company match, ESPP, matching donations, a flexible time away plan and family leave programs. Compensation is based on the geographic location in which the role is located and is subject to change based on work location.

Additional Information

Work Personas

We approach our distributed world of work with flexibility and trust. Work personas (flexible, remote, or required in office) are categories that are assigned to ServiceNow employees depending on the nature of their work and their assigned work location. Learn more here. To determine eligibility for a work persona, ServiceNow may confirm the distance between your primary residence and the closest ServiceNow office using a third-party service.

Equal Opportunity Employer

ServiceNow is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, national origin, age, disability, gender identity,  veteran status, or any other category protected by law. In addition, all qualified applicants with arrest or conviction records will be considered for employment in accordance with legal requirements.  

Accommodations

We strive to create an accessible and inclusive experience for all candidates. If you require a reasonable accommodation to complete any part of the application process, or are unable to use this online application and need an alternative method to apply, please contact [email protected] for assistance. 

Export Control Regulations

For positions requiring access to controlled technology subject to export control regulations, including the U.S. Export Administration Regulations (EAR), ServiceNow may be required to obtain export control approval from government authorities for certain individuals. All employment is contingent upon ServiceNow obtaining any export license or other approval that may be required by relevant export control authorities. 

From Fortune. ©2026 Fortune Media IP Limited. All rights reserved. Used under license.

Similar Jobs at ServiceNow

9 Days Ago
Hybrid
126K-195K Annually
Senior level
126K-195K Annually
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Build AI-powered agent builder features and scalable fullstack web applications for the Moveworks Agentic Assistant ecosystem. Design web technology stacks, authentication, event tracking, application platforms, design systems, and backend APIs. Collaborate with product, ML, and engineering teams to improve user experience and customer adoption while promoting modular, reliable engineering practices.
Top Skills: APIsAuthenticationDesign SystemsEvent TrackingGenerative AiMachine LearningReactWeb Applications
4 Days Ago
Hybrid
216K-378K Annually
Expert/Leader
216K-378K Annually
Expert/Leader
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Principal Engineer responsible for driving the technical direction of ServiceNow’s conversational analytics products. The role builds cloud-based AI/ML solutions, develops prototypes, owns software delivery, and collaborates with engineering, product, and leadership. Responsibilities include designing agentic analytics capabilities, integrating semantic layers and knowledge graphs, improving accuracy through evaluation frameworks, and coaching engineers. Strong communication, customer focus, and expertise in large-scale software systems, AI-native development, analytics platforms, and natural-language querying are required.
Top Skills: Agentic ArchitecturesAi/MlBi/Analytics PlatformsClaude CodeData CatalogsJavaJavaScriptKnowledge GraphsNatural Language Querying (Nlq)PythonSemantic LayersSQLTool ArchitecturesUniversal Context EnginesVector-Based Retrieval
10 Days Ago
Hybrid
167K-291K Annually
Expert/Leader
167K-291K Annually
Expert/Leader
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Lead full-stack engineering for an AI platform, designing scalable REST APIs, Java backend services, microservices, Kubernetes deployments, frontend integrations, and reusable UI frameworks. Establish architecture and engineering standards across Platform Engineering, translate design systems into accessible components, and mentor engineers across teams. The role requires extensive Java and JavaScript experience, modern frontend frameworks, relational databases, event-driven and stateless architectures, and integrating AI into engineering workflows and decision-making.
Top Skills: AjaxAngularJavaJavaScriptJSONKubernetesLit FrameworkMicroservicesReactRelational DatabasesRestSQL

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account