Builds a talent network of experienced data scientists for potential future AI evaluation projects. Responsibilities may include creating grading criteria, evaluating AI-generated or human-produced data science work, writing evidence-based justifications, applying consistent judgment, and incorporating reviewer feedback. Candidates should have professional data science experience, strong Python and SQL skills, expertise in statistical modeling, machine learning, experimentation, causal inference, and excellent technical communication.
This role is for one of our clients
Compensation: $100-$150 per hour
We are building a network of experienced data scientists for potential future projects with leading AI research organizations. These projects may focus on evaluating how effectively AI systems perform real-world data science work.
There is no immediate project opening, but qualified applicants may be contacted as relevant opportunities become available.
Requirements
Potential Responsibilities
Future projects may involve:
- Designing precise, task-specific grading criteria for data science deliverables, including exploratory data analyses, statistical modeling work, machine learning pipelines, experimentation and A/B test write-ups, feature engineering, and technical reports or notebooks
- Evaluating AI-generated or human-created work against established criteria
- Providing detailed written justifications for evaluations and scores
- Applying consistent, evidence-based judgment so that assessments are reproducible and defensible
- Incorporating structured feedback from senior reviewers and iterating on submitted work
Specific responsibilities will vary depending on the project.
Ideal Qualifications
- 1+ years of professional data science experience
- Experience at a leading technology, research, or quantitative firm (such as top FAANG, AI labs, top-tier quant funds, or equivalent)
- Strong command of Python, SQL, statistical modeling, machine learning, experimentation and causal inference, and translating messy real-world data into rigorous analyses
- Exceptional written communication skills, including the ability to convey technical findings clearly
- A detail-oriented and consistent approach to evaluating complex work
- Comfort receiving feedback and calibrating judgment against established standards
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
Similar Jobs
Fintech
Designs, administers, maintains, and supports hybrid cloud infrastructure across Azure, VMware, networks, operating systems, databases, and security appliances. Builds CI/CD pipelines and Infrastructure-as-Code deployments using Terraform or ARM templates, supports Kubernetes and AKS environments, configures Istio and Helm, and develops disaster recovery solutions. Troubleshoots infrastructure and SQL Server issues, improves reliability and cloud costs, maintains operational documentation, mentors engineers, supports tickets and critical incidents, and collaborates with development, client service, and business teams.
Top Skills:
Arm TemplatesAzure Api ManagementAzure BackupAzure DevopsAzure FunctionsAzure Kubernetes Service (Aks)Azure Logic AppsAzure Notification HubsAzure Private EndpointsAzure Route ServerAzure Service BusAzure Site RecoveryAzure Virtual NetworksAzure Vpn GatewayBashCi/CdCisco MerakiExchangeHelmInformation SecurityInfrastructure As CodeIntuneIstioItilItsmJavaScriptJSONKubernetesLinuxMicrosoft 365Microsoft Active DirectoryAzureMicrosoft TeamsPowershellPythonRest ApisSharepointSQL ServerTcp/IpTerraformVeeamVMwareVmware Site RecoveryWindows
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Owns Americas partner portfolio and co-sell execution, aligning partners with qualified opportunities and translating demand into capacity, allocation, and investment decisions. The role manages pipeline visibility, utilization, forecasting, partner readiness, business reviews, governance, and executive reporting. It coordinates sales, delivery, operations, finance, customer success, and partner stakeholders to remove blockers, improve portfolio processes, and ensure partner investments generate customer outcomes and measurable returns.
Top Skills:
CRMDashboardingForecastingPipeline AnalyticsServicenow
Fintech
Supports the reliability and operational excellence of health benefits systems involving HSA administration, banking integrations, compliance, and money movement. Responsibilities include independently resolving escalations, monitoring dashboards and logs, triaging incidents, executing data corrections, maintaining runbooks, analyzing recurring support issues, and collaborating with engineering, product, treasury, and operations teams. The role also mentors teammates, contributes to postmortems, improves troubleshooting processes, and uses AI tools for prototyping and debugging.
Top Skills:
ChatgptClaude CodeDatadogGitGithub CopilotGoogle BigqueryGoogle Cloud Platform (Gcp)GraphQLJavaScriptPlaidPostgresReactTypescript
What you need to know about the Los Angeles Tech Scene
Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.
Key Facts About Los Angeles Tech
- Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
- Key Industries: Artificial intelligence, adtech, media, software, game development
- Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
- Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering


