Note: At the moment, this opportunity is not available to applicants from California and New York.
—
We'll cut to the chase: we're looking for the world's best experts to take on the world's smartest models.
In Humanity’s Last Exam, we introduced the most challenging reasoning benchmark for frontier AI models. So far, the highest-performing system—OpenAI’s Deep Research—has achieved only 26% accuracy. We are collaborating with leading AI labs to identify the most effective data to improve AI reasoning capabilities in expert domains, and we aim to publish a new paper presenting our findings.
To do this, we are assembling a team of elite individuals who are the utmost experts in their respective fields. Our shared goal is to create PhD+ level problems that current state-of-the-art LLMs cannot correctly solve. This team will work collaboratively to produce datasets that will be available to our partner research groups, the world’s most advanced AI laboratories.
We're looking for unicorns to help us write some of the hardest problems intelligence has ever seen — do you think you can do this?
Why Join?
- Have the opportunity to co-author a research paper analyzing how effectively this data enhances model reasoning.
- Get access to an exclusive community of world-class researchers in a variety of domains; Each task submission will be open to peer review.
- Receive up to $540 for each contributed problem and solution pair
What’s Next?
- Still unsure? Watch this quick video of what comes after you hit "Apply Now" below
- If you're up for the task, apply below!
PLEASE NOTE: We collect, retain and use personal data for our professional business purposes, including notifying you of opportunities that may be of interest and sharing with our affiliates. We limit the personal data we collect to that which we believe is appropriate and necessary to manage applicants’ needs, provide our services, and comply with applicable laws. Any information we collect in connection with your application will be treated in accordance with the Outlier Privacy Policy and our internal policies and programs designed to protect personal data.
This is a 1099 contract opportunity on the Outlier.ai platform. Because this is a freelance opportunity, we do not offer internships, sponsorship, or employment. You must be authorized to work in your country of residence. If you are an international student, you may be able to sign up for Outlier if you are on a visa. You should contact your tax and/or immigration advisor with specific questions regarding your circumstances.
Top Skills
Similar Jobs
What you need to know about the Los Angeles Tech Scene
Key Facts About Los Angeles Tech
- Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
- Key Industries: Artificial intelligence, adtech, media, software, game development
- Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
- Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering
