Build and maintain automated test infrastructure for data-science microservices, design and run test strategies, troubleshoot automation across environments, validate fixes, and collaborate with engineers to ensure reliable, scalable data products and ML model testing.
Roadie, a UPS company, is a leading logistics and delivery platform that helps businesses tackle the complexities of modern retail with unmatched delivery coverage, flexibility and visibility. Reaching 97% of U.S. households across more than 30,000 zip codes — from urban hubs to rural communities — Roadie provides seamless, scalable solutions that meet a variety of delivery needs.
With a network of more than 310,000 independent drivers nationwide, Roadie offers flexible delivery solutions that make complex logistics challenges easy, including solutions for local same-day delivery, delivery of big and bulky items, ship-from-store and DC-to-door. For more information, visit www.roadie.com.
Roadie is seeking a Software Engineer in Test to join our talented team of developers. In this role, you’ll advance our data science testing and automation capabilities, tackle complex challenges across the software delivery pipeline, and help ensure our data products, models, and insights are accurate, reliable, and ready to scale.
What You’ll Do
- Build robust test infrastructure that powers automated regression testing for data science microservices
- Troubleshoot and resolve automation issues across multiple environments
- Improve the performance, reliability, and stability of automated test suites
- Develop and execute comprehensive test strategies and high-impact test cases
- Review product requirements to ensure alignment with established design and quality guidelines
- Partner with software engineers and fellow test engineers to conduct end-to-end system testing and post-deployment validation
- Identify, isolate, and clearly document product defects, then verify fixes through resolution
- Champion quality at every stage of the software development lifecycle
What You Bring
- 3+ years experience in a developer, SDET or QA automation role
- 3+ years coding experience in Python preferred; coding/scripting in other languages such as Ruby, Bash or Javascript, a plus!
- Experience with testing APIs and DBs
- Experience in testing frameworks - Pytest preferred
- Experience with monitoring tools like grafana, NewRelic or similar
- Experience in CI/CD tools such as CircleCI, github action or similar
- Be able to write and analyze SQL queries
- Experience with cloud solutions such as AWS
- Experience with tools such as github, JIRA, postman
- Demonstrated background of writing clean, stable, maintainable code
- Strong understanding of testing methodologies and automated testing approaches
- Excellent troubleshooting and communication skills
- Thrives in fast-paced environment, with ability to operate within short release-cycles
Bonus
- Familiarity with performance testing and related tools
- Familiarity with Data Science concepts
- Experience with testing ML models
- Experience with Kafka, groundcover, Sentry, MLFlow
- Understanding of the full application development lifecycle
Why Roadie?
- Competitive total rewards package
- 100% company-paid health insurance for yourself
- 401(k) with company match
- Tuition & student loan repayment assistance- yes, we’ll contribute directly to your student loans!
- Remote-first environment
- Unlimited PTO
- Inclusive family leave policy that supports all new parents
- Paid Wellness Days in addition to Company holidays
- Monthly WFH stipend
- Paid sabbatical leave- tenured Roadies are given extra time to unplug, rest, and explore
- The technology you need to get the job done
This role is not eligible for visa sponsorship. Applicants must be authorized to work for any employer in the U.S.
Similar Jobs
Artificial Intelligence • Cloud • Software • Infrastructure as a Service (IaaS)
Design and maintain automated testing frameworks for cloud-scale distributed systems. Build performance, load, stress, integration, API, end-to-end, chaos, security, and infrastructure tests. Integrate continuous testing into CI/CD pipelines, analyze observability data, validate Kubernetes and microservices environments, and collaborate with Engineering and SRE teams to improve reliability. The role also participates in on-call rotations and helps establish QA strategy and standards across GPU infrastructure, serverless endpoints, storage, billing, and event-driven systems.
Top Skills:
AWSAzureChaos MeshCi/CdDatadogGCPGoGrafanaGraphQLGremlinInfrastructure As Code (Iac)JmeterK6KafkaKubernetesLitmuschaosLocustOpentelemetryPrometheusPythonRabbitMQRedisTypescript
Aerospace • Hardware • Information Technology • Security • Software • Cybersecurity • Defense
Develop automated test software solutions for electronic warfare products across the product development lifecycle. Collaborate with systems, hardware, and software engineers while developing NI TestStand sequences and embedded or application software in C, C#, or C++. The role may involve RF test equipment drivers, RF measurement techniques, real-time embedded programming, and Agile development. The position is hybrid, requires U.S. citizenship, and requires the ability to obtain an active DoD Secret clearance.
Top Skills:
AgileBitbucketCC#C++ClearcaseConfluenceGitJIRANetwork AnalyzersNi TeststandPower MetersReal-Time Embedded ProgrammingRf SourcesRf Test EquipmentSpectrum Analyzers
Fintech • Payments • Real Estate • Software • Financial Services
Owns test automation and quality for major product areas, architecting frameworks and automated API, UI, and integration test suites. Leads test strategy, risk analysis, CI/CD integration, coverage improvements, debugging, root cause analysis, and release planning. Collaborates cross-functionally, mentors junior SDETs, reviews code and tests, maintains quality metrics, and drives adoption of engineering best practices.
Top Skills:
Ci/CdCypressDatadogNewrelicPlaywrightRestassuredSeleniumSQL
What you need to know about the Los Angeles Tech Scene
Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.
Key Facts About Los Angeles Tech
- Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
- Key Industries: Artificial intelligence, adtech, media, software, game development
- Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
- Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering
