Evaluates AI-generated data science and quantitative reasoning outputs; develops prompts, datasets, reference solutions, and objective evaluation benchmarks. Identifies statistical errors, flawed methodologies, and unsupported conclusions while providing structured feedback to improve model accuracy. Responsibilities include dataset validation, statistical and quantitative assessment, quality assurance, technical documentation, and clear communication of analytical findings.
This role is for one of our clients
Pay: 150–200/hour
Role Type: Contractor
Location: Remote
We are seeking a detail-oriented Junior Data Scientist to contribute to the evaluation and improvement of advanced artificial intelligence systems. This opportunity is ideal for early-career data science professionals with strong analytical skills and a solid understanding of statistics, machine learning, experimentation, and quantitative reasoning.
In this role, you will evaluate AI-generated responses to data science and quantitative problems, develop expert-level prompts and datasets, and create reference solutions to assess the accuracy and reliability of AI models. You will identify statistical errors, flawed methodologies, and weaknesses in quantitative reasoning while providing structured feedback to improve model performance.
The ideal candidate combines practical data science knowledge with clear technical communication and a rigorous, evidence-based approach to problem-solving. Previous experience in AI development is not necessarily required.
Requirements
Key Responsibilities
- AI Model Evaluation: Evaluate AI-generated outputs on data science, statistics, machine learning, experimentation, and quantitative analysis tasks.
- Problem and Prompt Development: Create challenging, well-defined prompts and technical problems that assess analytical reasoning and practical data science skills.
- Dataset Preparation: Prepare and validate relevant datasets for testing AI models across statistical and machine learning use cases.
- Reference Solution Development: Develop accurate reference answers, calculations, and analytical solutions to establish reliable evaluation benchmarks.
- Statistical Validation: Identify statistical errors, incorrect assumptions, flawed methodologies, and inappropriate interpretations of data.
- Quantitative Reasoning Assessment: Assess whether AI-generated solutions demonstrate sound mathematical reasoning, appropriate analytical methods, and evidence-based conclusions.
- Structured Feedback: Provide clear, actionable feedback highlighting errors, missing steps, and opportunities to improve the accuracy and reliability of AI-generated outputs.
- Quality Assurance: Validate analytical results, review solution consistency, and ensure that evaluation criteria are objective and reproducible.
- Technical Documentation: Explain statistical concepts, analytical approaches, and evaluation findings in a clear and structured manner.
Required Qualifications
- At least one year of professional experience at a well-established company in technology, finance, research, or a related field.
- At least part of the relevant professional experience should have been gained within the past three years.
- Foundational knowledge of data science, statistics, machine learning, and quantitative analysis.
- Strong analytical and problem-solving skills, with the ability to evaluate data-driven conclusions critically.
- Understanding of statistical methods, experimental design, data interpretation, and model evaluation.
- Ability to identify incorrect calculations, methodological weaknesses, and unsupported conclusions.
- Strong written communication skills, particularly when explaining technical and statistical concepts.
- Ability to work independently, follow evaluation guidelines, and deliver accurate, high-quality assessments.
Must-Have Skills
- Data Science Fundamentals
- Statistics and Probability
- Machine Learning Fundamentals
- Quantitative Reasoning
- Data Analysis and Interpretation
- Statistical Methodology
- Analytical Problem-Solving
- Technical Writing and Documentation
Good-to-Have Skills
- Python Programming
- SQL and Data Manipulation
- Pandas, NumPy, and scikit-learn
- Experimental Design and Hypothesis Testing
- Predictive Modeling and Model Evaluation
- Dataset Creation and Validation
- AI Model Evaluation and Benchmarking
- Experience in Technology, Finance, or Research Organizations
Preferred Qualifications
- Experience working at a recognized technology company, financial institution, or research organization.
- Professional exposure to statistical analysis, machine learning projects, quantitative research, or data-driven decision-making.
- Familiarity with evaluating AI-generated answers or validating analytical solutions.
- Ability to communicate complex quantitative concepts in clear, concise English.
- Candidates based in English-speaking countries are preferred.
Similar Jobs
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
The Account Executive will prospect, build pipeline, and close mid-market sales of Samsara’s IoT solutions. Responsibilities include researching prospects, conducting high-volume cold outreach, managing proofs of concept and trials, coordinating multiple stakeholders, negotiating complex pricing, selling to executives, and consistently achieving quota. Typical deals range from $20,000 to $100,000, with approximately 25% travel required across the Midwest territory.
Top Skills:
Internet Of Things (Iot)Salesforce (Sfdc)
.jpeg)
Artificial Intelligence • Hardware • Information Technology • Machine Learning
Supports automation systems including AMHS, ASRS, AGVs, conveyors, robots, PLCs, and material tracking tools. Performs installation, commissioning, testing, troubleshooting, preventive maintenance, root cause analysis, and corrective actions. Participates in automation projects, FAT, SAT, UAT, system buyoffs, documentation, vendor coordination, and cross-functional deployment activities. Ensures compliance with safety and operating standards while developing technical expertise in semiconductor manufacturing automation.
Top Skills:
AgvsAmhsArvAsrsControllersConveyorsLiftsMaterial Tracking SystemsMechanical SystemsPlcsRobotsSensorsServo DrivesSpmVision Systems
Artificial Intelligence • Hardware • Information Technology • Machine Learning
Monitors and operates facility utility systems through FMCS, BMS, and SCADA platforms. Manages alarms, performs field verification and first-level troubleshooting, coordinates maintenance and emergency response, maintains operational logs, prepares shift reports, and conducts detailed handovers. Supports electrical, HVAC, cleanroom, water, gas, fire safety, wastewater, and other critical semiconductor facility systems while contributing to reliability, safety, and energy-saving initiatives.
Top Skills:
Agent BotsBmsCmmsFmcsGen Ai ToolsHmiIndustrial AutomationMicrosoft CopilotPlcScada
What you need to know about the Los Angeles Tech Scene
Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.
Key Facts About Los Angeles Tech
- Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
- Key Industries: Artificial intelligence, adtech, media, software, game development
- Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
- Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering
