TinyFish Logo

TinyFish

MLOps Engineer

Reposted 5 Days Ago
Remote or Hybrid
Hiring Remotely in United States
Senior level
Remote or Hybrid
Hiring Remotely in United States
Senior level
Build and maintain reproducible data pipelines, experiment orchestration, CI/CD for models, Terraform-based ML infrastructure, observability, security controls, and automation to deploy and operate ML systems in production.
The summary above was generated by AI
Position Overview

As the first dedicated ML Ops Engineer, you’ll own the tooling and infrastructure that make our ml engineers wildly productive and ensure we are able to efficiently iterate on ML models, prompts, and datasets and deploy our AI systems into a predictable production environment. You’ll bridge the gap between research and DevOps—designing reproducible dataset pipelines, automated experiment workflows, and Terraform-based cloud deployments that scale.

Key Responsibilities

Dataset Management

• Design version-controlled data pipelines (feature stores, data registries) using tools such as Delta Lake, Apache Iceberg
• Implement systems for data validation, lineage tracking, and automated quality checks (e.g., Great Expectations).

Experiment Execution & Tracking

• Build and maintain experiment orchestration with platforms like MLflow, torchx, and Apache Airflow.
• Provide templated systems and tools to ML Engineers that easily launch training/evaluation data processing systems
• Automate hyper-parameter sweeps and A/B tests, exposing clear dashboards for results.

CI/CD

Models/Agents

• workflows that package, test, and promote models and agents through staging to production.
• Implement canary deployments and rollbacks for models/agents services

Terraform Infrastructure-as-Code

• Author and maintain Terraform modules for all ML infra—networking, GPU/TPU clusters, object storage, secrets, monitoring.
• Enforce best practices for state management, workspaces, and automated plan/apply stages via CI.

Observability & Reliability

• Integrate logging, tracing, and metric collection (Prometheus, Grafana, Datadog) across data pipelines and model endpoints.
• Set SLIs/SLOs for data freshness and model latency; implement alerts and runbooks.

Security & Compliance• Work with Security to implement IAM least-privilege, key rotation, and data-encryption policies.
• Support audit requirements (SOC 2, GDPR, HIPAA where applicable).

Minimum Qualifications
  • 5+ years combined experience in DevOps, Data Engineering, or ML Ops roles.

  • Strong Terraform skills; ability to craft reusable modules and navigate complex state.

  • Production experience with at least one cloud provider (AWS, GCP, or Azure).

  • Proficiency in Python and containerization (Docker); familiarity with Kubernetes or serverless batch systems.

  • Hands-on knowledge of ML experiment platforms (MLflow, Kubeflow, Weights & Biases, or similar).

  • Experience with workflow execution frameworks (Kubeflow, Apache Airflow)

  • Understanding of modern data-versioning/feature-store concepts and tools.

  • Solid grasp of CI/CD principles, Git workflows, and infrastructure testing.

  • Excellent communication skills—capable of partnering with Data Scientists, Software Engineers, and Security teams.

Preferred (Nice-to-Have)
  • Experience with GPU orchestration (NVIDIA DGX, Karpenter, or Ray).

  • Familiarity with IaC security scanning (Checkov, tfsec).

  • Exposure to policy-as-code (OPA/Gatekeeper).

  • Prior work in real-time streaming (Kafka, Flink) and online feature serving.

  • Contributions to open-source ML Ops projects.

Reporting Structure

Reports to: Director of Infra

Similar Jobs

3 Days Ago
Remote or Hybrid
United States
132K-132K Annually
Junior
132K-132K Annually
Junior
Artificial Intelligence • Automotive • Robotics • Software • Transportation
Provide on-call MLOps support for machine learning teams by triaging pipeline issues, debugging workflows, identifying root causes, and maintaining reliable model development operations. Collaborate with senior engineers to improve tooling, documentation, and processes, while communicating technical findings across teams. The role requires Python, foundational PyTorch and model pipeline experience, plus familiarity with CI/CD, monitoring, logging, and orchestration tools.
Top Skills: AnyscaleAws SagemakerCi/CdDaftLoggingMcapMlopsMonitoringPandasParquetPipeline OrchestrationPyarrowPythonPyTorchRayTerraform
9 Days Ago
In-Office or Remote
184K-357K Annually
Senior level
184K-357K Annually
Senior level
Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
Develop and deploy scalable AI solutions, distributed training and inference systems, and MLOps pipelines across cloud and NVIDIA platforms. Serve as a technical lead for customers and partners, optimize large-scale workloads for performance and cost, diagnose full-stack infrastructure problems, and create open-source tools and reference architectures. The role requires strong AI/ML lifecycle experience, systems expertise, programming skills, and communication abilities.
Top Skills: Advanced NetworkingBashBatch SchedulersC++Ci/CdContainerizationCudaDeep Learning FrameworksDgx CloudDistributed FilesystemsGitopsGoInfinibandKubernetesLinuxMachine Learning FrameworksNemoNeocloudNimNvidia Cloud PartnersNvlinkObservabilityPythonRapidsRoceRustTritonWorkflow Automation
9 Days Ago
Remote or Hybrid
United States
139K-167K Annually
Mid level
139K-167K Annually
Mid level
Artificial Intelligence • Automotive • Robotics • Software • Transportation
Build and maintain MLOps pipelines that convert, compile, benchmark, validate, and release machine learning models for autonomous truck edge hardware. Maintain model release registries, ensure version traceability and reproducibility, compare latency and accuracy across platforms, and collaborate with perception and safety teams to meet strict production requirements.
Top Skills: Bf16C++CudaFp16Fp4Fp8Int8Nvidia OrinOnnxPtqQatTensorrtTorch.Compile

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account