C

AI Research Scientist

Colleague AI Kirkland, WA, US
Full-time $120k - $200k Posted 10 days ago

Responsibilities

  • check_circle Lead applied research on LLMs, AI agents, evaluation systems, and educational AI.
  • check_circle Develop research prototypes that apply frontier AI-agent methods to K–12 teaching and learning workflows.
  • check_circle Design rigorous evaluation frameworks for AI tutoring, grading, lesson generation, classroom agents, and other educational use cases.
  • check_circle Build benchmarks and datasets that measure long-horizon agent behavior, feedback-driven learning, reliability, safety, and instructional quality.
  • check_circle Study how agents perform in realistic educational environments involving rubrics, standards, student work, teacher feedback, classroom context, and multi-step workflows.
  • check_circle Design experiments to measure model behavior, diagnose failures, compare approaches, and improve system performance.
  • check_circle Collaborate with engineering and product teams to turn promising research into production-ready features.
  • check_circle Publish research papers, technical reports, benchmarks, datasets, or open-source tools that establish Colleague AI as a thought leader in AI for education.
  • check_circle Stay current with advances in LLMs, agentic AI, retrieval-augmented generation, evaluation methods, synthetic data, AI safety, and learning sciences.
  • check_circle Help establish internal best practices for model evaluation, experimentation, monitoring, and continuous improvement.
  • check_circle Ph.D. in Computer Science, Machine Learning, Artificial Intelligence, Natural Language Processing, Data Science, Learning Sciences, Educational Technology, or a related technical field.
  • check_circle Strong research background in machine learning, deep learning, NLP, large language models, AI agents, or human-AI interaction.
  • check_circle Experience optimizing model performance in production or production-like environments.
  • check_circle Strong programming skills in Python and experience with ML frameworks such as PyTorch, TensorFlow, JAX, or similar.
  • check_circle Experience designing experiments, evaluation frameworks, benchmarks, or datasets.
  • check_circle Strong understanding of model validation, statistical analysis, error analysis, and empirical research methods.
  • check_circle Ability to move between open-ended research questions and practical implementation.
  • check_circle Clear technical writing skills, with the ability to produce papers, reports, documentation, and research narratives.
  • check_circle Strong collaboration skills and interest in working with engineers, product teams, educators, and school partners.

Preferred qualifications

  • Publications in top-tier AI, ML, NLP, HCI, learning analytics, or education technology venues.
  • Experience with LLM agents, tool-using agents, multi-agent systems, autonomous workflows, or long-horizon agent evaluation.
  • Experience with educational AI, intelligent tutoring systems, automated feedback, grading, curriculum generation, or classroom technology.
  • Experience building benchmark environments, simulation environments, evaluation harnesses, or reproducible research systems.
  • Experience with retrieval-augmented generation, fine-tuning, synthetic data generation, data annotation, or model adaptation.
  • Experience evaluating AI systems for safety, reliability, fairness, privacy, or age-appropriate behavior.
  • Experience deploying research into production or working in a startup environment.
  • Familiarity with K–12 education standards, classroom workflows, LMS/SIS systems, or teacher-facing software is a plus.
  • A brief statement of interest describing your relevant research interests, technical experience, and motivation for joining Colleague AI.
  • Evidence of qualifications, such as a portfolio of prior work, selected publications, GitHub repositories, technical writing, demos, or deployed systems.
  • A current CV.

Benefits

  • check_circle 401(k)
  • check_circle Health insurance
  • check_circle Paid time off
  • check_circle Parental leave
  • check_circle Vision insurance

Tags & Focus Areas

Fulltime Ai Generative Ai

Ready to Apply?

Join Colleague AI and help shape the future of AI.

Save for later

About Colleague AI

Ready to Join the Team?

Apply once with DevFound — we route your profile to Colleague AI and keep you posted on matching AI roles.