TL;DR: FigmaTrace, a dataset of 3,469 Figma design trajectories spanning 200+ hours of human work, helps smaller open models match frontier systems on out-of-domain tasks and shows that phase-based trajectory curation outperforms maximum context-length sharding by 7.3 points on average, according to Patronus AI. The deeper lesson is that workflow structure, not just scale, is becoming a governance variable for agentic model training.
Editorial analysis by NHI Mgmt Group, based on content published by Patronus AI: “Introducing FigmaTrace: A comprehensive training dataset for Figma design workflows”.
By the numbers:
- FigmaTrace contains a total of 3,469 Figma design trajectories.
- Patronus AI says the fine-tuned Qwen3.8-27B outperforms Claude Opus 5 on GUI-Odyssey and AndroidControl by 6.4 and 11.8 absolute points.
Key questions
Q: How should teams evaluate agentic models trained on workflow data?
A: Evaluate them on the quality of the action sequence, not only the correctness of the output.
Q: Why does phase-based dataset curation matter for AI governance?
A: Because segmentation choices shape what the model learns as a meaningful unit of action.
Q: When can training data improve performance beyond the original use case?
A: When the dataset captures human judgement, sequencing, and tool interaction rather than just end-state examples.
Practitioner guidance
- Define workflow-level evaluation criteria Test agentic models against task sequences, not just final artefacts, so you can measure whether the model preserves intent across steps and corrections.
- Adopt phase-based dataset curation Segment long training recordings by meaningful task phases before fine-tuning, and reject arbitrary sharding that breaks causal continuity.
- Review transfer risk before reuse Assess whether a workflow dataset built for one interface could expand capability into adjacent tools or tasks that were not part of the original approval scope.
Bottom line: Intent-segmented workflow data can teach models behaviours that generalise beyond the domain where the traces were captured.
Explore further
View Full Forum → | NHI Foundation Course → | Our Services → | Read the full analysis →