Featherless AI Logo

Featherless AI

Machine Learning Engineer — Inference Optimization

Reposted 3 Months Ago
In-Office or Remote
Hiring Remotely in World Golf Village, FL
Mid level
In-Office or Remote
Hiring Remotely in World Golf Village, FL
Mid level
Optimize inference latency and throughput for large-scale ML models, collaborating on performance tuning, and building inference-serving systems.
The summary above was generated by AI
About the Role

We’re looking for a Machine Learning Engineer to own and push the limits of model inference performance at scale. You’ll work at the intersection of research and production—turning cutting-edge models into fast, reliable, and cost-efficient systems that serve real users.

This role is ideal for someone who enjoys deep technical work, profiling systems down to the kernel/GPU level, and translating research ideas into production-grade performance gains.

What You’ll Do
  • Optimize inference latency, throughput, and cost for large-scale ML models in production

  • Profile and bottleneck GPU/CPU inference pipelines (memory, kernels, batching, IO)

  • Implement and tune techniques such as:

    • Quantization (fp16, bf16, int8, fp8)

    • KV-cache optimization & reuse

    • Speculative decoding, batching, and streaming

    • Model pruning or architectural simplifications for inference

  • Collaborate with research engineers to productionize new model architectures

  • Build and maintain inference-serving systems (e.g. Triton, custom runtimes, or bespoke stacks)

  • Benchmark performance across hardware (NVIDIA / AMD GPUs, CPUs) and cloud setups

  • Improve system reliability, observability, and cost efficiency under real workloads

What We’re Looking For
  • Strong experience in ML inference optimization or high-performance ML systems

  • Solid understanding of deep learning internals (attention, memory layout, compute graphs)

  • Hands-on experience with PyTorch (or similar) and model deployment

  • Familiarity with GPU performance tuning (CUDA, ROCm, Triton, or kernel-level optimizations)

  • Experience scaling inference for real users (not just research benchmarks)

  • Comfortable working in fast-moving startup environments with ownership and ambiguity

Nice to Have
  • Experience with LLM or long-context model inference

  • Knowledge of inference frameworks (TensorRT, ONNX Runtime, vLLM, Triton)

  • Experience optimizing across different hardware vendors

  • Open-source contributions in ML systems or inference tooling

  • Background in distributed systems or low-latency services

Why Join Us
  • Real ownership over performance-critical systems

  • Direct impact on product reliability and unit economics

  • Close collaboration with research, infra, and product

  • Competitive compensation + meaningful equity at Series A

  • A team that cares about engineering quality, not hype

Similar Jobs

3 Months Ago
Remote
US
Senior level
Senior level
Information Technology
Lead inference acceleration and GPU-parallelism optimizations (TP, SP, PP); implement high-performance CUDA/NCCL kernels; deploy videogen and LLM models to production; collaborate with researchers, conduct code reviews, mentor engineers, and optionally improve training efficiency and resource utilization.
Top Skills: Attention OptimizationCudaDeep Learning Compiler StacksGpuLarge Language ModelsNcclPipeline ParallelismQuantizationSequence ParallelismTensor ParallelismVideo Generation Models
8 Minutes Ago
Remote or Hybrid
United States
Junior
Junior
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Manages dealer relationships across a Phoenix-area territory to drive adoption of OnStar, GM connected services, loyalty programs, and subscription offerings. Coaches dealership leadership and sales teams, delivers product and customer-experience training, analyzes performance data, develops action plans, troubleshoots technology platforms, supports launches, and collaborates with GM teams. The role requires frequent territory travel, strong communication, valid driving credentials, and residence or relocation within the assigned territory.
Top Skills: Gm Mobile AppGoogle Built-InGoogle WorkspaceMS OfficeOnstarOver-The-Air UpdatesSuper Cruise
9 Minutes Ago
Remote or Hybrid
United States
Senior level
Senior level
Fintech • Software
Support the ActiveDisclosure sales team by leading discovery, aligning customer needs to the solution, demonstrating platform capabilities, advising on use cases, supporting webinars, and presenting at conferences. The role requires financial reporting and capital markets expertise, SEC reporting knowledge, advanced Excel skills, and experience presenting to financial and executive audiences.
Top Skills: ActivedisclosureExcelMS Office

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account