Salvo Software Logo

Salvo Software

AI Developer

Posted 17 Days Ago
Remote
Hiring Remotely in United States
Mid level
Remote
Hiring Remotely in United States
Mid level
Build and operate production LLM systems using Ollama and llama.cpp, develop RAG pipelines and MCP integrations, and create Python backend services for AI features. Deploy and maintain workloads across Azure and AWS using Docker and CI/CD. Automate operations, process structured data, support Kafka-based architectures, troubleshoot across the stack, and progressively develop expertise in model quantization, GPU tuning, and secure offline deployments.
The summary above was generated by AI

Salvo Software is a global technology company specializing in custom software development and advanced engineering solutions. With distributed teams across the US, LATAM, and India, we partner with clients to build high-performance, scalable systems that solve complex technical challenges. Our culture values innovation, ownership, and engineering excellence. We're growing our AI department and are looking for a hands-on AI Developer to help build it.

Role Overview

We are looking for an AI Developer to join and strengthen our AI department. Your core work will be building and operating LLM-powered systems: serving open-source models with Ollama and llama.cpp, building RAG pipelines, and developing MCP integrations that connect large language models to real tools and data. Solid DevOps fundamentals - Docker, CI/CD, Azure - support this work, but AI engineering is the heart of the role.

You don't need to be a deep ML researcher. What matters is production-grade Python, strong fundamentals, and the aptitude to learn fast. You'll work closely with our engineering and product teams to take LLM-powered features from prototype to reliably deployed systems, with mentorship available as you ramp up in areas like RAG architecture, Kafka, and advanced MCP work.

Key Responsibilities

AI / LLM Engineering (core focus)

  • Serve and operate open-source LLMs using Ollama and llama.cpp, locally and in on-prem environments.
  • Build and maintain RAG pipelines: embeddings, vector databases, chunking strategies, and retrieval quality.
  • Develop MCP (Model Context Protocol) integrations connecting LLMs to internal tools and data sources.
  • Build backend services in Python that power ML inference and AI-driven product features.
  • Parse and process structured and semi-structured data (XML/XSD, Office document formats) as pipeline inputs.
  • Grow into model optimization over time: quantization (GGUF), GPU/CUDA tuning, and offline/air-gapped deployments.

DevOps & Infrastructure (supporting)

  • Build and maintain CI/CD pipelines for AI services (Azure DevOps preferred; GitHub Actions / GitLab CI also used).
  • Deploy AI workloads to Microsoft Azure,AWS and containerize services with Docker.
  • Automate operational tasks with Python, Bash and/or PowerShell scripting.
  • Troubleshoot across the stack - dig into root causes rather than patching symptoms.
  • Support event-driven architectures using Apache Kafka (producers/consumers).

Requirements
  • 3–5+ years engineering experience with production-level Python for building real services, LLM inference, RAG pipelines, and automated tooling.
  • Hands-on LLM & AI integration serving models via Ollama/llama.cpp, implementing vector retrieval/RAG, and developing MCP integrations (GPU/CUDA tuning & model quantization nice to have).
  • Cloud & Infrastructure expertise covering Azure/AWS deployments, Docker containerization, Linux/Windows admin, and CI/CD automation (Azure DevOps, GitHub Actions, or GitLab CI), with Terraform, Kubernetes, Kafka, or systems languages (Go, Rust, C++) as a plus.
  • DevOps, Security & Operations awareness, including Git workflows, scripting (Python, Bash, PowerShell), observability tools (Prometheus/Grafana), DevSecOps, and compliance frameworks (SOC 2, ISO 27001, Zero Trust).
  • Strong problem-solving & communication with a root-cause troubleshooting mindset, self-directed learning, strong ownership, and seamless remote/distributed team collaboration.

Similar Jobs

18 Days Ago
Remote or Hybrid
562K-189M Annually
Senior level
562K-189M Annually
Senior level
Artificial Intelligence • Information Technology • Machine Learning • Natural Language Processing • Productivity • Software • Generative AI
Build and evolve Superhuman Mail’s Model Context Protocol platform, agentic workflows, personalization features, and LLM evaluation systems. Select and integrate models, develop AI building blocks for cross-functional teams, and help shape modeling approaches. The role focuses on backend engineering and applied AI, requiring production experience with LLM-powered features, strong ownership, and comfort with ambiguity and rapid change.
Top Skills: AnthropicAWSGoKubernetesMcpOpenaiPostgresPythonRedisTurbopufferTypescript
Yesterday
Remote
USA
Junior
Junior
Fintech • Information Technology
Own security controls for AI agents, automations, tools, and integrations, including identity, least privilege, secrets, guardrails, telemetry, logging, and incident response. Review AI application designs, support AI-powered security tooling, translate governance standards into technical controls, and partner with Engineering, DevOps, GRC, and Security Operations. Participate in the security on-call rotation and help ensure approved, secure AI usage across the organization.
Top Skills: Ai AgentsCi/CdCloud-Native DeploymentsIso 42001KubernetesLlm ApplicationsNist Ai Risk Management FrameworkOauthOwasp Top 10 For Llm ApplicationsPolicy-As-CodePythonSecrets ManagementService Accounts
Yesterday
Remote
Entry level
Entry level
Information Technology • Consulting
Build scalable, enterprise-grade full-stack applications integrating generative AI. Responsibilities include developing React or Angular frontends, backend services in C#, Java, or Python, and AI capabilities using LLMs, RAG, embeddings, vector search, and agentic systems. The role also involves API integration, prompt engineering, guardrails, automated AI evaluation, secure Azure solutions, CI/CD, testing, and enterprise data and identity integrations.
Top Skills: Agentic AiAi GuardrailsAngularAngular MaterialAPIsAzure Ai ServicesAzure DevopsAzure OpenaiC#Ci/CdEmbeddingsGitJavaLarge Language Models (Llms)Material UiAzureNext.JsNgrxOpenaiPrompt EngineeringPythonReactReduxRetrieval-Augmented Generation (Rag)TypescriptVector Search

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account