Welo Global Logo

Welo Global

Project Perseus | Data Labeling Associate - Portuguese (Portugal) Speakers (Human-in-the-Loop AI)

Posted 4 Months Ago
Be an Early Applicant
In-Office or Remote
2 Locations
34-34 Hourly
Junior
In-Office or Remote
2 Locations
34-34 Hourly
Junior
Evaluate AI outputs, perform audit-based reviews, identify patterns and failure modes, apply and improve annotation/evaluation guidelines, document findings, and communicate insights to cross-functional teams to improve model performance and evaluation frameworks.
The summary above was generated by AI

Overview

Welo Data is looking for sharp, curious, and detail-oriented individuals to join our team as Data Labeling Associate.

This is not a traditional annotation role.

You’ll be working directly with cutting-edge AI systems — evaluating outputs, identifying gaps, and helping improve how these systems behave in real-world scenarios. The work sits at the intersection of data quality, model evaluation, and human judgment, where your ability to think critically matters just as much as following guidelines.

We’re looking for people who are naturally curious about AI, comfortable forming opinions, and confident in contributing to conversations with teammates, leads, and stakeholders.

Project Details

  • Job Title: Data Labeling Associate
  • Hiring in: Onsite (Bay Area, Seattle, NYC, or client-dependent) 
  • Hours: Full-time, 40 hours per week
  • Employment Type: W2 Full-Time Employee
  • Work Authorization: Must be authorized to work in the U.S. (no visa sponsorship)
  • Pay Rate: $34/hour

Important: This is a 100% onsite position — remote work is not available for this role. To be considered, candidates must be located in or able to commute to one of the following cities: NYC, Seattle, Bellevue, Redmond, San Francisco, Sunnyvale, Burlingame, Austin, Los Angeles, Washington DC, Chicago, Boston, Austin. Please only apply if you meet this location requirement.

 

What You’ll Do

  • Evaluate AI model outputs and provide structured, high-quality feedback
  • Perform audit-based reviews of data and model behavior — identifying patterns, edge cases, and failure modes
  • Apply guidelines thoughtfully — and flag when they don’t reflect real-world scenarios
  • Contribute to improving evaluation frameworks, not just executing them
  • Identify trends in model performance and communicate insights clearly
  • Participate in team discussions, calibrations, and stakeholder syncs
  • Partner with leads and cross-functional teams to refine quality standards
  • Document findings in a clear, concise, and actionable way

What We’re Looking For

  • Native-level Portuguese (Portugal) language proficiency and a university degree (Bachelor’s or higher).
  • B2 or superior level of English.  
  • 1–2 years of professional writing experience with strong, structured writing skills
  • Ability to apply complex writing rules and guidelines consistently
  • Strong understanding of safety considerations in GenAI data delivery, with 2+ years of relevant experience
  • Strong critical thinking and attention to detail
  • Ability to make sound judgment calls in ambiguous situations
  • Naturally curious about AI, technology, and how systems behave
  • Comfortable speaking up, asking questions, and contributing ideas
  • Strong written and verbal communication skills
  • Ability to stay consistent while working with evolving guidelines
  • Experience in data quality, QA, annotation, or analysis is helpful — but not required

Benefits

  • Paid Vacation: 6 days
  • Paid Company Holidays: 2 days (Memorial Day and Labor Day)
  • Paid Sick Leave: accrued per applicable state law and company policy
  • Medical, Dental, and Vision Insurance (eligibility applies)
  • Health Savings Account (HSA)
  • 401(k) Retirement Plan
  • Employee Assistance Program
  • Additional voluntary benefits (life, accident, critical illness, etc.)
  • Free Gourmet Food: Free breakfast, lunch, and dinner are provided, featuring a wide variety of cuisines in multiple cafes.
  • Micro-kitchens & Snacks: Offices are stocked with free snacks and beverages, including premium coffee and La Croix.
  • Unique Campus Features: Some locations include roof-top nature parks
  • Commuter Benefits: Free transport, shuttles, and sometimes bike-to-work perks.

Similar Jobs

28 Minutes Ago
In-Office or Remote
Irvine, CA, USA
92K-164K Annually
Senior level
92K-164K Annually
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Leads DMHC medical survey readiness across four California health plans. Coordinates regulatory reviews, documentation, mock audits, gap analyses, corrective actions, remediation, risk assessments, and regulator interactions. Establishes readiness programs, tracks findings and closure milestones, advises executives, monitors regulatory developments, maintains evidence repositories, and delivers training. Partners with clinical, operational, compliance, and executive stakeholders to ensure alignment with Knox-Keene requirements, DMHC regulations, and health plan commitments.
28 Minutes Ago
In-Office or Remote
Cypress, CA, USA
249K-373K Annually
Senior level
249K-373K Annually
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Reviews and adjudicates health plan appeals and grievances involving coverage, benefits, and clinical criteria. Provides regulatory responses to state insurance and CMS authorities, explains appeal rationales, collaborates with medical directors and network teams, and addresses access and quality issues. Participates in committees, process improvement, training, projects, and task forces while providing clinical and strategic guidance.
Top Skills: Internet Research ToolsManaged Care SystemsPresentation SoftwareSpreadsheet SoftwareWord Processing Software
28 Minutes Ago
In-Office or Remote
Cypress, CA, USA
249K-373K Annually
Senior level
249K-373K Annually
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Reviews and adjudicates health plan appeals and grievances, applying clinical criteria, benefit designs, and regulatory requirements. Provides regulatory responses, communicates decision rationales with medical directors and network teams, addresses access and quality issues, and contributes to committees, process improvement, training, projects, and task forces. The role requires an actively licensed, board-certified physician with clinical practice and quality management experience.
Top Skills: Internet Research ToolsPresentation SoftwareSpreadsheet SoftwareWord Processing Software

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account