Surge AI Logo

Surge AI

Research Scientist

Posted One Month Ago
Remote
Hiring Remotely in United States
Entry level
Remote
Hiring Remotely in United States
Entry level
Research data strategies for large language model development, including designing data slices to identify model failure modes, modeling annotator behavior, and optimizing instruction clarity and reward-signal reliability. Develop metrics and evaluation frameworks to assess dataset quality, diversity, alignment impact, and downstream model performance. Collaborate with AI research teams and test data-centric methodologies in production environments.
The summary above was generated by AI
About Us

Our mission is to raise AGI with the richness of human intelligence — curious, witty, imaginative, and full of unexpected brilliance.

Surge was founded by engineers and researchers who dreamed of building the next generation of AI. Our platform powers the most capable models in the world, in partnership with the AI models you use every day.

At Surge, we believe the path to AGI isn't just about scaling compute—it's about embracing the unlimited ceiling of human intelligence and creativity in the data that shapes these systems. Our platform combines elite human expertise with cutting-edge tools for scalable oversight, from building rich RL environments to conducting rigorous evaluations that go beyond benchmarks. We've run a profitable business from day one without raising venture funding.

The Role

As a Research Scientist focused on data, you’ll work at the cutting edge of LLM development by designing the datasets that shape how frontier models behave. You’ll partner directly with AI research teams to experiment with new data collection strategies, evaluate dataset quality, and uncover insights that improve alignment, safety, and model performance.

This is a research-driven, impact-heavy role: you’ll have the opportunity to test ideas quickly in live production environments, shape data-centric methodologies for some of the world’s top AI labs, and help define how high-quality data fuels the next generation of AI systems.

What We’re Looking for
  • Deep Curiosity About Data – Obsession with understanding how the structure, quality, and selection of data influence LLM performance

  • Bias Toward Insight and Iteration – You think critically but move fast, designing lightweight experiments to generate actionable results

  • Desire to Shape AI Development – Drive to build the foundational data layer that defines how the next generation of AI systems behave

What You'll Do
  • Research data collection strategies and designing high-impact data slices that uncover model failure modes

  • Model annotator behavior and designing experiments to optimize instruction clarity and reward signal reliability

  • Develop metrics and frameworks for evaluating dataset quality, diversity, and impact on downstream model alignment

Similar Jobs

49 Minutes Ago
In-Office or Remote
500K-850K Annually
Entry level
500K-850K Annually
Entry level
Artificial Intelligence • Natural Language Processing • Generative AI
Conduct research and engineering for large language model pre-training, including model architectures, algorithms, data processing, optimizers, experiments, and training infrastructure. Lead research projects, optimize large-scale GPU systems, improve developer tooling, and contribute across the stack. The role emphasizes reliable, interpretable, steerable, and safe AI systems, with collaboration across research and engineering teams.
Top Skills: Distributed TrainingETLGpusKubernetesLarge Language ModelsOperating System InternalsPythonPyTorchReinforcement LearningTransformer Architectures
3 Days Ago
Remote
USA
230K-340K Annually
Entry level
230K-340K Annually
Entry level
Artificial Intelligence • Legal Tech • Professional Services • Software
Own research and implementation of post-training methods for legal language models, including supervised fine-tuning, reinforcement learning, reward design, verifiers, preference modeling, evaluations, and distributed training. Lead experiments from research direction through production deployment, while debugging training instability, reward hacking, and divergence. Build rigorous evaluation systems and production-quality Python code for long-horizon legal reasoning and agentic workflows.
Top Skills: Distributed TrainingLarge Language Models (Llms)Machine LearningPreference OptimizationPythonReinforcement LearningReward ModelingSupervised Fine-Tuning (Sft)
3 Days Ago
Remote
USA
230K-340K Annually
Entry level
230K-340K Annually
Entry level
Artificial Intelligence • Legal Tech • Professional Services • Software
Build synthetic data pipelines, evaluation systems, benchmarks, verifiers, rubrics, and quality metrics for legal AI models and agentic workflows. Partner with researchers, legal experts, and customers to investigate model failures, validate metrics, maintain data quality and provenance, and convert expert feedback and product usage into training signals and improved evaluations.
Top Skills: Automated RatersExperimentation ToolingLarge Language ModelsMachine LearningMl Evaluation SystemsPreference DataPythonSynthetic Data

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account