Part-Time Student Worker - AI Validation and Benchmarking Engineer

Role overview

Responsibilities

• check_circle Run and maintain the benchmark pipeline, analyzing results to identify routing errors and regressions across agent variants
• check_circle Build and expand ground truth datasets used to evaluate agent outputs against known-correct answers
• check_circle Identify and address gaps in benchmark validation and support building a more comprehensive evaluation infrastructure to improve validation prior to release
• check_circle Develop new evaluation dimensions such as label accuracy and structured output correctness beyond the existing team classification benchmarks
• check_circle Investigate failure modes in agent outputs and work with engineers to surface actionable improvements
• check_circle Write scripts and tooling to automate data collection, result parsing, and metric reporting
• check_circle Document findings, track benchmark trends over time, and present results to the team

Basic qualifications

• Currently enrolled in a B.S. or M.S. in Computer Science, Data Science, Engineering or a related field
• Available to commit to a minimum three-month assignment
• Able to commit to a minimum of 20 hours per week
• Able to work on-site at one of our office locations
• Must adhere with Zoox confidentiality requirements, including refraining from using or sharing proprietary company information outside of Zoox, such as in academic research, theses, publications, or presentations

Preferred qualifications

• Familiar with Cursor or Claude
• Familiar with Python
• Familiar with evaluation concepts: precision, recall, F1 score, and confusion matrices
• Comfortable working with structured data (CSV, JSON)
• Experience modifying or writing reproducible analysis scripts

Benefits

• check_circle Compensation for this role is $30/hour.
• check_circle This is a contract position; employment will be through a vendor contracted with Zoox. The hourly rate is as posted, and benefits eligibility is determined by the vendor.

About the company