figma · San Francisco, CA • New York, NY • United States
Skills: Figma
Figma is growing our team of passionate creatives and builders on a mission to make design accessible to all. Figma’s platform helps teams bring ideas to life—whether you're brainstorming, creating a prototype, translating designs into code, or iterating with AI. From idea to product, Figma empowers teams to streamline workflows, move faster, and work together in real time from anywhere in the world. If you're excited to shape the future of design and collaboration, join us! We’re hiring a Researcher, AI Evaluations to join AI Insights within Figma’s Research team. This is a senior individual contributor role with no direct reports, reporting to the AI Insights lead and working directly with AI Research within AI Platform. You’ll strengthen the team’s model, agent system, and evaluation work through hands-on studies, clear rubrics, and reliable measures of quality that reflect user needs, and your findings will guide model and product improvements. This is a full time role that can be held from one of our US hubs or remotely in the United States. What you’ll do at Figma: Own evaluation research for priority AI Research workstreams. Define quality criteria, design studies, analyze results, and recommend actions Build rubrics, representative evaluation datasets, benchmarks, and quality thresholds that reflect user needs and expert design judgment Work with AI Research and Modeling Platform engineers to integrate validated methods into repeatable evaluations and regression tests Explain quality, failure patterns, and uncertainty. Recommend actions that guide model selection, model improvements, product priorities, and release decisions Validate automated graders against human ratings, including LLM-as-judge methods that use a large language model to score outputs. Identify bias, gaps, and uncertainty Connect user research with AI Research’s model development work. Share reusable methods, review work, and mentor peers We’d love to hear from you if you have: 7+ years of…
Sign in to see the original posting
Browse more developer jobs on RoleBurst