Senior / Staff Machine Learning Research Scientist, Agents in San Francisco at Scale AI
Scale AI

Senior / Staff Machine Learning Research Scientist, Agents

Scale AI San Francisco, CA; Seattle, WA; New York, NY
Full-time $324k Posted 1 day ago

Role overview

This role is at the intersection of cutting-edge AI research and practical application, with a focus on studying the data types essential for building state-of-the-art agents, such as browser and SWE agents. The ideal candidate will explore the data landscape needed to advance intelligent, adaptable AI agents, guiding the data strategy at Scale to drive innovation. This position requires not only expertise in LLM agents and planning algorithms but also creativity in addressing novel challenges related to data, interaction, and evaluation. You will contribute to impactful research publications on agents, collaborate with customer researchers, and work alongside the engineering team to translate these advancements into real-world, scalable solutions.

Basic qualifications

  • Practical experience working with LLMs, with proficiency in frameworks like Pytorch, Jax, or Tensorflow. You should also be adept at interpreting research literature and quickly turning new ideas into prototypes.
  • A track record of published research in top ML venues (e.g., ACL, EMNLP, NAACL, NeurIPS, ICML, ICLR, COLM, etc.)
  • At least three years of experience addressing sophisticated ML problems, either in a research setting or product development.
  • Strong written and verbal communication skills and the ability to operate cross-functionally.

Preferred qualifications

  • Hands-on experience with open source LLM fine-tuning or involvement in bespoke LLM fine-tuning projects using Pytorch/Jax.
  • Hands-on experience and publications in building applications and evaluations related to AI agents such as tool-use, text2SQL, browser agents, coding agents and GUI agents.
  • Hands-on experience with agent frameworks such as OpenHands, Swarm, LangGraph, etc.
  • Familiarity with agentic reasoning methods such as STaR and PLANSEARCH
  • Experience working with cloud technology stack (eg. AWS or GCP) and developing machine learning models in a cloud environment.

Benefits

  • check_circle Comprehensive health, dental and vision coverage
  • check_circle Retirement benefits
  • check_circle A learning and development stipend
  • check_circle Generous PTO
  • check_circle This role may be eligible for additional benefits such as a commuter stipend.

About the company

At Scale AI, our mission is to accelerate the development of AI applications. For 8 years, Scale has been the leading AI data foundry, helping fuel the most exciting advancements in AI, including: generative AI, defense applications, and autonomous vehicles. With our recent Series F round, we’re accelerating the abundance of frontier data to pave the road to Artificial General Intelligence (AGI), and building upon our prior model evaluation work with enterprise customers and governments, to deepen our capabilities and offerings for both public and private evaluations.

We believe that everyone should be able to bring their whole selves to work, which is why we are proud to be an inclusive and equal opportunity workplace. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability status, gender identity or Veteran status.

Tags & Focus Areas

Ai Ai Engineer Machine Learning Robotics Generative Ai

Ready to Apply?

Join Scale AI and help shape the future of AI.

Save for later

About Scale AI

Industry Machine Learning
HQ New York, US

Ready to Join the Team?

Apply once with DevFound — we route your profile to Scale AI and keep you posted on matching AI roles.