Pika Logo

Pika

ML Engineer, Inference & Optimization

Reposted 3 Months Ago
Remote
Hiring Remotely in US
Senior level
Remote
Hiring Remotely in US
Senior level
Lead inference acceleration and GPU-parallelism optimizations (TP, SP, PP); implement high-performance CUDA/NCCL kernels; deploy videogen and LLM models to production; collaborate with researchers, conduct code reviews, mentor engineers, and optionally improve training efficiency and resource utilization.
The summary above was generated by AI
About the Role

We are seeking Senior/Staff level Inference Engineers to accelerate the performance of Pika's AI-driven products. In this highly technical role, you will operate at the intersection of cutting-edge inference acceleration, GPU parallelism, advanced model deployment, and video generation technologies. Your expertise will drive significant improvements to model speed and efficiency, ensuring our creative AI systems deliver industry-leading user experiences at scale.

 

You will design and optimize inference pipelines, implement state-of-the-art acceleration techniques, and work closely with researchers and engineers across the team to push the boundaries of what’s possible in real-time AI deployment. Your efforts will play a foundational role in powering the next generation of Pika’s video and language models.

 
What You’ll Do
  • Accelerate Inference: Lead and implement advanced inference acceleration techniques, including attention optimization and quantization for efficient model serving.

  • Maximize GPU Parallelism: Engineer and optimize GPU strategies across tensor, sequence, and pipeline parallelism (TP, SP, PP) for maximal efficiency and scalability.

  • Programming for Performance: Develop and optimize high-performance computing kernels and distributed workloads using CUDA and NCCL.

  • Advance AI Deployment: Collaborate with research and engineering teams to bring state-of-the-art videogen and large language models into production.

  • Improve Training Efficiency: (Bonus) Contribute to improvements in model training speed, stability, and resource utilization as part of our deployment lifecycle.

  • Technical Excellence: Drive rigorous code reviews, participate in technical discussions, and mentor fellow engineers on best practices in inference and GPU programming.

 
What We’re Looking For
  • Experience: 5+ years engineering experience, with a strong track record in inference acceleration and model deployment at scale.

  • Inference Mastery: Proven expertise in inference optimization, including quantization, attention acceleration, and deep learning compiler stacks.

  • GPU & Parallelism: Deep knowledge of GPU programming (CUDA, NCCL) and experience with SP, TP, PP, and other forms of parallelism for distributed inference.

  • AI Domain Knowledge: Familiarity with video generation (videogen) models and large language models (LLMs).

  • Collaboration: Strong cross-discipline communication skills; able to drive shared goals across research and engineering functions.

  • Ownership Mindset: Self-driven, solutions-oriented, and capable of managing ambiguity in a fast-paced startup environment.

  • Bonus: Experience in enhancing training efficiency, stability, or resource optimization for large models.

 
Nice to Have
  • Experience with high-throughput video or real-time streaming model deployment

  • Familiarity with distributed training and optimization toolkits

  • Contributions to open source projects in AI infrastructure or deep learning compilers

  • Startup or rapid prototyping experience

 
What We Offer
  • Competitive salary in the AI industry

  • Equity in a fast-growing startup shaping the future of AI

  • Comprehensive health benefits, monthly stipends, company retreats

  • A supportive and collaborative office culture—we’re all building and launching together

 
About Pika

At Pika, we're crafting a future where video creation is seamless, intuitive, and universally accessible. Our mission is to empower creativity by breaking down technical barriers using the transformative power of AI. We’re a tight-knit, energetic team based in Palo Alto, CA, valuing efficiency, curiosity, and the ambition to make a meaningful impact on the world.

 

We work from our Palo Alto office 3–5 days a week and welcome applicants who are eager to contribute onsite.

Similar Jobs

3 Months Ago
In-Office or Remote
Mid level
Mid level
Artificial Intelligence • Information Technology • Software
Optimize inference latency and throughput for large-scale ML models, collaborating on performance tuning, and building inference-serving systems.
Top Skills: CudaMl Inference OptimizationOnnx RuntimePyTorchTensorrtTriton
12 Minutes Ago
Remote or Hybrid
140K-165K Annually
Mid level
140K-165K Annually
Mid level
Artificial Intelligence • Cloud • Payments • Software • Business Intelligence • Generative AI • Automation
Own a defined territory and achieve quota by selling insurance technology platforms to existing B2B customers. Responsibilities include consultative prospecting, discovery, solution selling, pipeline development, product demonstration collaboration, negotiation, closing, forecasting, CRM management, territory planning, and customer engagement. The role requires 3+ years of quota-carrying full-cycle sales experience, strong communication, business consulting skills, and proficiency with Microsoft Office. SaaS sales and Salesforce experience are preferred.
Top Skills: CRMExcelMicrosoft OutlookMicrosoft PowerpointMicrosoft WordSalesforce
An Hour Ago
Remote or Hybrid
MA, USA
64-87 Hourly
Mid level
64-87 Hourly
Mid level
Healthtech • Software • Analytics • Biotech • Pharmaceutical • Manufacturing
Drives demand for Takeda’s IBD specialty products by managing healthcare accounts, conducting clinical selling, supporting onboarding and infusion education, coordinating medical education programs, and achieving territory sales goals. Builds relationships with gastroenterologists, hospitals, clinics, infusion sites, pharmacists, and decision-makers while executing brand strategies, addressing reimbursement considerations, and managing allocated resources.
Top Skills: Biologic ProductsInfusion Procedures

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account