Caterpillar Logo

Caterpillar

Lead Data Quality Assurance Engineer, Data Annotation Services

Posted 22 Hours Ago
Be an Early Applicant
Hybrid
Irving, TX
128K-209K Annually
Senior level
Hybrid
Irving, TX
128K-209K Annually
Senior level
Leads data quality strategy and a QA engineering team for annotation and captioning datasets supporting computer vision, robotics, autonomous systems, and Physical AI. Develops automated validation frameworks, quality metrics, dashboards, audits, and quality gates; evaluates human and AI-assisted labeling technologies; manages vendor quality; investigates multimodal camera and LiDAR data issues; and partners with ML, platform, product, and vendor teams to deliver trustworthy datasets.
The summary above was generated by AI
Career Area:
Technology, Digital and Data
Job Description:
Your Work Shapes the World at Caterpillar Inc.
When you join Caterpillar, you're joining a global team who cares not just about the work we do - but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here - we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.
Help Build the Future of Caterpillar
At Caterpillar, technology always has a purpose: solving our customers' toughest challenges. Through Cat Technology, we are building the intelligence layer that connects machines, data, and people to make jobsites safer, more productive, and more sustainable. With over 1.6 million connected assets generating real-world data daily, we are creating the foundation for AI, autonomy, edge computing, and intelligent machines that continuously learn and improve at global scale.
Be Part of What's Next in Autonomous Construction Sites
Construction autonomy is one of the most challenging applications of AI. As a Lead Data Quality Assurance Engineer, you will lead the quality strategy for training data powering robotics, computer vision, autonomous systems, Physical AI, and Vision-Language-Action (VLA) models. You will combine data quality engineering, test automation, and machine learning expertise to ensure the datasets used by Caterpillar's AI systems are accurate, scalable, and trustworthy while leading a small team of QA engineers and collaborating across engineering, annotation, and product teams.
Job Summary:
Lead the development and execution of quality assurance processes, standards, and automation frameworks for annotation and captioning datasets supporting robotics, autonomous driving, computer vision, and Physical AI initiatives. Drive continuous improvement of dataset quality by establishing metrics, evaluating AI-assisted labeling technologies, managing vendor quality, and implementing scalable validation solutions across the data lifecycle.
What You Will Do:
  • Lead the annotation quality strategy and roadmap, providing technical leadership and mentorship to a team of QA engineers while defining standards, guidelines, acceptance criteria, and governance processes for perception and VLA datasets.
  • Design and implement automated validation frameworks, testing methodologies, and quality gates that verify annotation accuracy, consistency, completeness, schema compliance, and sensor synchronization across multimodal datasets.
  • Define and monitor dataset quality metrics, dashboards, audits, and benchmarking processes to measure dataset health, identify root causes of labeling defects, and drive continuous quality improvements with internal teams and external annotation providers.
  • Evaluate and validate human, AI-assisted, and automated labeling solutions, including technologies such as NVIDIA Cosmos Curator and Cosmos Reason, while helping develop AI-driven QA capabilities and agentic workflows for scalable review and defect analysis.
  • Partner with machine learning, platform, product, and vendor teams to integrate quality processes into data pipelines, communicate risks and tradeoffs, and ensure trusted datasets are delivered to support AI model development.

What You Will Have:
  • Bachelor's degree in Computer Science, Software Engineering, Data Science, Artificial Intelligence, Robotics, or a related technical field.
  • 5+ years of experience in data quality engineering, annotation quality assurance, or test automation for computer vision, robotics, autonomous systems, Physical AI, or machine learning environments.
  • Experience leading small technical teams, providing mentorship, setting technical direction, and collaborating with external vendors or distributed teams.
  • Strong Python development skills with experience building automated validation frameworks, data quality tooling, and production-grade software using modern engineering practices and containerized environments.
  • Experience with annotation platforms (Labelbox, Supervisely, Roboflow, or similar), SQL, data analysis tools, and machine learning evaluation metrics such as precision, recall, IoU, F1, and mAP.
  • Experience validating perception datasets that include camera and LiDAR sensor data and investigating data quality issues across collection, annotation, and processing workflows.

Top Candidates Will Have:
  • Experience with computer vision, robotics, autonomous driving, multimodal AI, Physical AI, and 3D perception systems.
  • Experience evaluating AI-assisted annotation workflows, auto-labeling technologies, agentic AI systems, or LLM/VLM-based quality automation solutions.
  • Familiarity with ML frameworks and tooling such as PyTorch, TensorFlow, ONNX, MLflow, or Weights & Biases.
  • Experience with Vision-Language-Action (VLA) datasets, caption quality evaluation, sensor fusion, and autonomous machine data pipelines.
  • Experience building human-in-the-loop quality processes, managing annotation vendor performance, and working with cloud-based data platforms and MLOps environments.

Additional Details:
  • This position requires the candidate to work full-time onsite in Irving, TX (Dallas).
  • Domestic relocation assistance is available for this position.
  • Visa sponsorship is available for this position.

Summary Pay Range:
$128,470.00 - $208,770.00
Compensation and benefits offered may vary depending on multiple individualized factors, job level, market location, job-related knowledge, skills, individual performance and experience. Please note that salary is only one component of total compensation at Caterpillar.
Benefits:
Subject to plan eligibility, terms, and guidelines. This is a summary list of benefits.
  • Medical, dental, and vision benefits*
  • Paid time off plan (Vacation, Holidays, Volunteer, etc.)*
  • 401(k) savings plans*
  • Health Savings Account (HSA)*
  • Flexible Spending Accounts (FSAs)*
  • Health Lifestyle Programs*
  • Employee Assistance Program*
  • Voluntary Benefits and Employee Discounts*
  • Career Development*
  • Incentive bonus*
  • Disability benefits
  • Life Insurance
  • Parental leave
  • Adoption benefits
  • Tuition Reimbursement

* These benefits also apply to part-time employees
Posting Dates:
Any offer of employment is conditioned upon the successful completion of a drug screen.
Caterpillar is an Equal Opportunity Employer, Including Veterans and Individuals with Disabilities. Qualified applicants of any age are encouraged to apply.
Not ready to apply? Join our Talent Community.

Similar Jobs at Caterpillar

22 Hours Ago
Hybrid
128K-209K Annually
Entry level
128K-209K Annually
Entry level
Artificial Intelligence • Cloud • Internet of Things • Software • Cybersecurity • Industrial • Industrial Equipment
Leads the design, integration, validation, and deployment of Edge AI solutions across Caterpillar machine platforms. Defines system requirements, interfaces, functional specifications, and integration strategies; coordinates machine, hardware, software, electrical, and cybersecurity teams; plans system testing and supports lab, bench, vehicle, and field validation. Uses field data and customer feedback to improve feature integration, supports product adoption, provides technical leadership, and communicates program status.
Top Skills: CybersecurityEdge AiEmbedded SystemsMachine Software
22 Hours Ago
Hybrid
98K-158K Annually
Entry level
98K-158K Annually
Entry level
Artificial Intelligence • Cloud • Internet of Things • Software • Cybersecurity • Industrial • Industrial Equipment
Develop and maintain scalable data infrastructure supporting autonomy, robotics, and machine learning. Build ingestion, storage, processing, annotation, and log-processing workflows; manage cloud storage and distributed compute environments; improve data integrity, discoverability, and automation; and support model training, validation, simulation, and analytics platforms. Collaborate with software, AI/ML, autonomy, and platform teams to deliver reliable, maintainable data systems and development tools.
Top Skills: Autonomous SystemsC++Cloud ComputingData PipelinesDistributed ComputingETLMachine LearningPythonRobotics
22 Hours Ago
Hybrid
113K-183K Annually
Mid level
113K-183K Annually
Mid level
Artificial Intelligence • Cloud • Internet of Things • Software • Cybersecurity • Industrial • Industrial Equipment
Supports and enhances global treasury technology systems, including FIS Quantum, Trax, and eBAM. Responsibilities include user support, software upgrades, system maintenance, process improvement, technology implementations, AI and automation solutions, bank connectivity, documentation, and SOX and IT control activities. The role collaborates with treasury stakeholders, vendors, and enterprise partners to analyze requirements, configure and test solutions, resolve issues, and deliver secure, efficient treasury processes.
Top Skills: AchAPIsBai2CamtClaudeEbamFis QuantumGachGiroIso 20022 XmlMicrosoft CopilotMt940Power AutomatePower BIPythonServicenowSQLSwiftTrax

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account