Mercor Logo

Mercor

Research Engineer - Environments, Data and Post-Training

Reposted One Month Ago
In-Office
San Francisco, CA
180K-500K Annually
Junior
In-Office
San Francisco, CA
180K-500K Annually
Junior
As a Research Engineer, you'll enhance AI models through post-training and evaluation pipelines, focusing on data quality and performance metrics.
The summary above was generated by AI
About Mercor

Mercor's mission is to organize human intelligence to power the AI economy. We're a leading AI data company, building the layer between human expertise and frontier models. Millions of domain experts on the platform are paid over $4 million per day to train frontier AI models. Mercor's APEX benchmark family measures AI's real-world impact on professional work. Mercor Enterprise brings this same infrastructure to Fortune 500 companies: helping companies capture how their best people actually work, translating that expertise directly back into agents.

 

Mercor is creating a new category of work where expertise powers AI advancement. Achieving this requires an ambitious, fast-paced and deeply committed team. You’ll work alongside researchers, operators, and AI companies at the forefront of shaping the systems that are redefining society. Mercor is a profitable Series C company valued at $10 billion. We work in-person five days a week in our San Francisco, NYC, or London offices.

About the Role

As a Research Engineer at Mercor, you’ll work at the intersection of engineering and applied AI research. You’ll contribute directly to post-training and RLVR, synthetic data generation, and large-scale evaluation workflows that meaningfully impact frontier language models.

Your work will be used to train large language models to master tool use, agentic behavior, and real-world reasoning in real-world production environments. You’ll shape rewards, run post-training experiments, and build scalable systems that improve model performance. You’ll help design and evaluate datasets, create scalable data augmentation pipelines, and build rubrics and evaluators that push the boundaries of what LLMs can learn.

What You’ll Do
  • Work on post-training and RLVR pipelines to understand how datasets, rewards, and training strategies impact model performance.

  • Design and run reward-shaping experiments and algorithmic improvements (e.g., GRPO, DAPO) to improve LLM tool-use, agentic behavior, and real-world reasoning.

  • Quantify data usability, quality, and performance uplift on key benchmarks.

  • Build and maintain data generation and augmentation pipelines that scale with training needs.

  • Create and refine rubrics, evaluators, and scoring frameworks that guide training and evaluation decisions.

  • Build and operate LLM evaluation systems, benchmarks, and metrics at scale.

  • Collaborate closely with AI researchers, applied AI teams, and experts producing training data.

  • Operate in a fast-paced, experimental research environment with rapid iteration cycles and high ownership.

What We’re Looking For
  • Strong applied research background, with a focus on post-training and/or model evaluation.

  • Strong coding proficiency and hands-on experience working with machine learning models.

  • Strong understanding of data structures, algorithms, backend systems, and core engineering fundamentals.

  • Familiarity with APIs, SQL/NoSQL databases, and cloud platforms.

  • Ability to reason deeply about model behavior, experimental results, and data quality.

  • Excitement to work in person in San Francisco, five days a week (with optional remote Saturdays), and thrive in a high-intensity, high-ownership environment.

Nice To Have
  • Real-world post-training team experience in industry (highest priority).

  • Publications at top-tier conferences (NeurIPS, ICML, ACL).

  • Experience training models or evaluating model performance.

  • Experience in synthetic data generation, LLM evaluations, or RL-style workflows.

  • Work samples, artifacts, or code repositories demonstrating relevant skills.

Benefits
  • Bi-annual performance bonus structure

  • Generous equity grant vested over 4 years

  • Up to $15k Relocation bonus

  • $10K housing bonus (if you live within 0.5 miles of our office)

  • $1.5K monthly stipend for meals

  • Free Equinox membership

  • $200 monthly laundry reimbursement

  • $200 monthly personal wellness reimbursement

  • Health, Dental, Vision insurance

Similar Jobs

14 Days Ago
In-Office
250K-500K Annually
Entry level
250K-500K Annually
Entry level
Artificial Intelligence • Software
Develop and implement frontier-model post-training methods, including reinforcement learning, verifiable rewards, evaluation, and data-centric optimization. Design rigorous experiments across datasets, rewards, environments, and training strategies; investigate model behavior and failure modes; build scalable data-generation and evaluation pipelines; and create benchmarks, rubrics, and scoring systems. Collaborate with researchers, engineers, AI teams, customers, and domain experts while contributing to open-source tools, technical reports, blog posts, and research papers.
Top Skills: APIsCloud InfrastructureDapoDatabasesDistributed SystemsGrpoMachine LearningReinforcement LearningRlvr
130K-190K Annually
Senior level
Aerospace • Artificial Intelligence • Machine Learning • Robotics • Software • Defense Technology
Leads U.S. defense market intelligence and Price-to-Win analysis for Shield AI’s X-BAT Family of Systems. Tracks defense budgets, congressional actions, acquisitions, competitors, pricing signals, and program developments. Builds competitor profiles, cost models, bid strategy assessments, and defensible price recommendations supporting captures, proposals, executive decisions, and go-to-market strategy. Maintains a structured, AI-enabled knowledge base and delivers recurring and rapid-turn intelligence products.
Top Skills: Ai-Enabled ToolsFpdsJ-BooksOmb ReportingP-1/R-1/O-1 ExhibitsParametric Cost EstimatingPpbeSam.GovTreasury ReportingUsaspending
39 Minutes Ago
In-Office or Remote
United States
133K-284K Annually
Senior level
133K-284K Annually
Senior level
Automotive
Design, develop, operate, and support mission-critical cloud-native software services for Ford’s connected vehicle platform. Lead architecture and delivery of distributed microservices, improve reliability, observability, performance, security, and scalability, and manage incident response. Provide technical leadership through design reviews, standards, mentoring, roadmap influence, and cross-functional collaboration with product, operations, and platform teams.
Top Skills: Amazon EksApache KafkaArgo CdAWSCi/CdConcourseDatadogDynatraceFossaGitGoogle Cloud PlatformGrafanaGrpcJavaJSONKubernetesOpenapiOpentelemetryPagerdutyPostgresPrometheusRestSonarqubeSpring BootSwaggerTest-Driven DevelopmentTykVictoriametrics

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account