Kraken Digital Asset Exchange Logo

Kraken Digital Asset Exchange

Senior Software Engineer – AI Infrastructure

Posted 9 Days Ago
Remote
Hiring Remotely in United States
127K-254K Annually
Senior level
Remote
Hiring Remotely in United States
127K-254K Annually
Senior level
Design and operate production infrastructure for AI agent systems, including high-performance Rust services for model inference, orchestration, and execution. Build scalable distributed systems, MLOps capabilities, observability, guardrails, and failure recovery for millions of users. Optimize latency, throughput, reliability, and cost while partnering with agent systems and infrastructure teams to harden experimental prototypes for production.
The summary above was generated by AI
Building the Future of Open Finance

Payward - the parent company behind Kraken, NinjaTrader, Breakout, xStocks, Payward Services and CF Benchmarks - has spent the last 15 years building one of the most modern and globally accessible financial infrastructure platforms in the industry, built to advance an open, global financial system.

The team

Founded in 2011, Kraken is one of the world's longest-standing crypto platforms, trusted by over 10 million individuals and institutions across the globe. It offers spot trading, margin, futures, staking, and OTC services, with products built for both individual investors and institutional clients.

The AI Infrastructure team builds and operates the production systems that power intelligent agents at scale. This team sits at the foundation of the agent platform, ensuring that model inference, orchestration, and execution layers are reliable, observable, and performant under real-world load.

Working closely with the Agent Systems team and broader infrastructure partners, this group owns the core primitives that enable agents to safely operate across internal systems. The environment is high-scale and high-stakes — systems serve millions of users and must meet strict reliability, latency, and correctness standards.

This is a deeply production-oriented team. Engineers here combine strong systems thinking with applied ML infrastructure experience, building in Rust and operating services where performance and failure modes matter.

 
The opportunity
  • Design and build the infrastructure layer powering AI agent systems in production

  • Develop high-performance services that handle model inference, orchestration, and execution

  • Architect scalable systems capable of supporting millions of users and high request throughput

  • Build reliable ML infrastructure and MLOps patterns for model deployment, evaluation, and monitoring

  • Define guardrails, observability, and failure handling for agent-driven workflows

  • Optimize latency, throughput, and cost across inference and orchestration layers

  • Partner closely with the Agent Systems team to translate experimental prototypes into hardened production systems

  • Contribute to foundational infrastructure decisions in a high-scale, high-impact environment

 
What You Bring
  • 5+ years of experience building and operating high-scale production systems

  • Strong Python skills and the ability to reason about systems performance and reliability

  • Deep understanding of distributed systems, reliability engineering, and performance optimization

  • Experience operating services serving millions of users or high-throughput workloads

  • Familiarity with ML infrastructure, model serving, or MLOps in production environments

  • Experience designing observability, monitoring, and failure recovery systems

  • Strong collaboration skills working across infrastructure and applied engineering teams

  • High ownership mindset in high-stakes production environment

 
Nice to haves
  • Experience with Rust

  • Experience building infrastructure for agent-based or LLM-powered systems

  • Background in high-performance networking, async systems, or low-latency architectures

  • Experience with container orchestration and cloud-native infrastructure

  • Familiarity with evaluation frameworks and model performance monitoring at scale

  • Experience working in fast-moving 0→1 or platform-building teams

Unless a specific application deadline is stated in the job posting, applications are accepted on an ongoing basis.

Please note, applicants are permitted to redact or remove information on their resume that identifies age, date of birth, or dates of attendance at or graduation from an educational institution.

We consider qualified applicants with criminal histories for employment on our team, assessing candidates in a manner consistent with the requirements of the San Francisco Fair Chance Ordinance.

Our commitment

Payward is powered by people from around the world and we celebrate the diverse talents, backgrounds, contributions, and unique perspectives that everyone brings to the table. We hire based on merit, seeking out people with the right abilities, knowledge, and skills for the job. We encourage you to apply for roles where you don't fully meet the listed requirements, especially if you're passionate or knowledgeable about crypto.

We may ask candidates to complete job-related skills or work-style assessments as part of our hiring process. These assessments evaluate competencies relevant to the role and are applied consistently across candidates for similar positions. Results are considered alongside experience and interviews, and are not the sole basis for any employment decision.

As an equal opportunity employer, we don't tolerate discrimination or harassment of any kind, whether based on race, ethnicity, age, gender identity, citizenship, religion, sexual orientation, disability, pregnancy, veteran status, or any other protected characteristic as outlined by federal, state, or local laws.

Stay connected

Follow us on X

Learn on the Kraken Blog

Connect on LinkedIn


Candidate Privacy Notice

Similar Jobs

22 Days Ago
In-Office or Remote
North Carolina, USA
149K-282K Annually
Senior level
149K-282K Annually
Senior level
Cloud • Information Technology • Internet of Things • Professional Services • Software
Architect and operate Cisco’s AI Compute Platform, developing distributed control-plane services, Kubernetes platforms, GPU schedulers, APIs, controllers, and automated remediation systems. The role manages multi-cluster environments, tenant quotas, workload routing, GPU allocation, and reliability for large-scale training and inference workloads. It also leads architecture reviews, establishes engineering standards, mentors engineers, and drives Infrastructure as Code, GitOps, CI/CD, observability, incident response, and operational excellence.
Top Skills: Amd InstinctCgroupsCi/CdCustom Resource Definitions (Crds)EbpfGitopsGoGrafanaInfinibandKubernetesKubernetes ControllersKubernetes OperatorsKueueLinuxNcclNvidia B200Nvidia B300Nvidia H100Nvidia H200NvlinkOpenshiftPrometheusPythonSlurmSplunkTerraformVolcano
17 Days Ago
Remote
United States
Senior level
Senior level
Artificial Intelligence • Software
Build and operate infrastructure for evaluating coding agents and language models. Design end-to-end features spanning data models, APIs, background workers, and UI; run sandboxed trials; score and aggregate results; improve benchmark quality checks; integrate models and agents; and maintain performance, reliability, concurrency, migrations, tests, and code quality.
Top Skills: CeleryDaytonaDjangoDockerHarborInspectKubernetesMcpModalPostgresPythonReactSwe-BenchTerminal-BenchTypescript
13 Days Ago
In-Office or Remote
2 Locations
184K-357K Annually
Senior level
184K-357K Annually
Senior level
Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
Design, build, and maintain infrastructure software for large-scale AI training and inference. Improve efficiency, resiliency, availability, observability, and reliability across distributed AI systems. Develop APIs and tools, analyze failures from application through hardware levels, define reliability metrics, and support NVIDIA AI platforms. The role requires expertise in distributed systems, monitoring, debugging, software engineering practices, and AI infrastructure, with preferred experience in large clusters, RDMA stacks, telemetry, and deep learning frameworks.
Top Skills: CC++Continuous IntegrationElkInfiniband VerbsJaxLibfabricLokiNcclPrometheusPythonPyTorchRayRdmaTensorFlowUcx

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account