Evaluates AI-generated software for correctness, quality, efficiency, security, and maintainability. Designs programming challenges, reference solutions, test cases, and evaluation criteria. Reviews technical reasoning related to debugging, architecture, and system design, then provides structured feedback and documentation. The role requires strong programming fundamentals, software testing and code review experience, analytical problem-solving ability, and clear technical communication.
This role is for one of our clients
Pay: 150–200/hour
Role Type: Contractor
Location: Remote
We are seeking a motivated and detail-oriented Junior Software Engineer to contribute to the evaluation and improvement of advanced artificial intelligence systems. This opportunity is ideal for early-career software engineers with strong programming fundamentals, analytical thinking, and practical experience developing and reviewing software applications.
In this role, you will evaluate AI-generated code for correctness, quality, efficiency, and design. You will create challenging programming problems, develop reference solutions and test cases, and assess AI models' ability to solve real-world software engineering challenges. You will also review technical reasoning related to debugging, architecture, and system design, providing structured feedback to improve the reliability and performance of AI-generated solutions.
The ideal candidate has professional software engineering experience, a solid understanding of programming principles, and the ability to explain technical decisions clearly. Prior experience in artificial intelligence is not required.
Requirements
Key Responsibilities
- AI-Generated Code Evaluation: Review AI-generated code for functional correctness, readability, maintainability, efficiency, and adherence to software engineering best practices.
- Coding Problem Development: Design challenging programming problems that assess algorithmic thinking, debugging skills, implementation quality, and practical engineering judgment.
- Reference Solution Creation: Develop accurate, well-structured reference solutions that demonstrate effective approaches to solving software engineering problems.
- Test Case Development: Create comprehensive test cases to validate functionality, identify edge cases, and detect incomplete or incorrect implementations.
- Technical Reasoning Assessment: Evaluate AI-generated explanations and decisions involving software architecture, system design, debugging, and implementation strategies.
- Code Quality Analysis: Identify bugs, inefficient algorithms, poor design choices, security concerns, and violations of established coding standards.
- Technical Feedback: Provide detailed, actionable feedback explaining errors, weaknesses, and opportunities to improve code quality and model performance.
- Documentation: Clearly document problem requirements, expected behavior, solution approaches, testing procedures, and technical evaluation findings.
- Quality Assurance: Ensure that coding tasks, reference solutions, and evaluation criteria are accurate, consistent, and reproducible.
Required Qualifications
- At least one year of professional experience as a software engineer at a well-established technology company.
- At least part of the relevant professional experience should have been gained within the past three years.
- Strong understanding of programming fundamentals, data structures, algorithms, and object-oriented programming.
- Practical experience writing, debugging, testing, and reviewing code.
- Familiarity with software development practices, including version control, code reviews, testing, and debugging.
- Ability to assess code for correctness, performance, readability, and maintainability.
- Foundational understanding of software architecture and system design principles.
- Strong analytical and problem-solving skills.
- Excellent written communication skills, with the ability to explain technical decisions and complex engineering concepts clearly.
- Ability to work independently and deliver accurate, high-quality technical assessments.
Must-Have Skills
- Software Engineering Fundamentals
- Programming and Coding
- Data Structures and Algorithms
- Code Review and Quality Assessment
- Debugging and Troubleshooting
- Automated Testing and Test Case Development
- Problem-Solving and Logical Reasoning
- Technical Documentation and Written Communication
Good-to-Have Skills
- Python, Java, C++, JavaScript, TypeScript, Go, or similar programming languages
- Object-Oriented Programming and Design Patterns
- API Development and Backend Engineering
- Software Architecture and System Design
- Performance Optimization and Profiling
- Git and Version Control
- Unit Testing and Integration Testing
- CI/CD and Software Development Workflows
- AI-Generated Code Evaluation
- Familiarity with AI coding assistants and model benchmarking
Preferred Qualifications
- Professional software engineering experience at a recognized technology company.
- Experience developing and maintaining production-quality applications, services, or APIs.
- Familiarity with reviewing complex codebases and identifying implementation weaknesses.
- Experience designing coding exercises, technical assessments, or automated evaluation tests.
- Candidates based in English-speaking countries are preferred.
- Ability to communicate technical findings in clear, structured, and concise English.
Similar Jobs
Digital Media • Fitness • Software • Cybersecurity • Digital Health & Therapeutics • Military Software • Facilities Maintenance
Entry-level software engineering opportunities for freshers and developers with up to two years of experience. Openings include Java, Python, frontend, MERN stack, full stack, and .NET development. Candidates should hold a BE, B.Tech, M.Tech, or MCA degree and have graduated in 2023 through 2026. The role is based in Pune, with Pune candidates preferred.
Top Skills:
.NetJavaMern StackPython
Cloud • Software
The Junior Ubuntu Software Engineer will design, build, and ship software, focusing on quality and resilience, while engaging with the open source community.
Top Skills:
C/C++FlutterGoPythonRust
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
The Account Executive will prospect, build pipeline, and close mid-market sales of Samsara’s IoT solutions. Responsibilities include researching prospects, conducting high-volume cold outreach, managing proofs of concept and trials, coordinating multiple stakeholders, negotiating complex pricing, selling to executives, and consistently achieving quota. Typical deals range from $20,000 to $100,000, with approximately 25% travel required across the Midwest territory.
Top Skills:
Internet Of Things (Iot)Salesforce (Sfdc)
What you need to know about the Los Angeles Tech Scene
Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.
Key Facts About Los Angeles Tech
- Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
- Key Industries: Artificial intelligence, adtech, media, software, game development
- Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
- Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering
