About the company
Our client is a software company.
The role
Raydar is recruiting for this role on behalf of our client. Write code every day to build the systems that verify software and move it safely into production. The work centers on test infrastructure, automated evaluation and release controls, with a smaller portion devoted to deployment tooling and pre-production environments.
What you'll do
- Build and maintain automated test harnesses, including setups where AI agents run and assess tests.
- Develop evaluation logic and model-based graders so that test results can be trusted.
- Broaden regression coverage and close the gaps through which defects reach customers.
- Create automated release gates that stop unsafe releases and show readiness with clear evidence.
- Maintain the deployment pipeline, keep continuous integration reliable and manage how build artifacts are published.
- Keep demo and staging environments dependable.
- Make upgrades safer and incidents rarer and easier to diagnose.
- Join business-hours escalations alongside other senior engineers.
Requirements
What we're looking for
- Hands-on quality engineering work in the past year testing or evaluating AI-driven systems, as opposed to manual QA.
- Experience with software where autonomous AI agents carry out the tasks.
- Strong working knowledge of CI/CD automation on a Git-hosted platform, including container image builds.
- Background in a fast-paced early-stage company, or at a larger organization where you updated outdated QA or DevOps approaches.
- Proven record of independently owning a system or workflow end to end and making your own decisions.
- Working knowledge of at least one major cloud platform.
- Proficiency in Python.
Benefits
Compensation and benefits
- Base salary: USD 170,000 to 200,000 per year
- Equity
Location and work model
- Remote (US)
- Full-time
Similar Jobs
What you need to know about the Los Angeles Tech Scene
Key Facts About Los Angeles Tech
- Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
- Key Industries: Artificial intelligence, adtech, media, software, game development
- Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
- Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering



