About
July 2026 paper introducing a benchmark for checking whether Generative UI tools implement the design rationales they present to users. Across 120 interfaces from five tools and 24 structural, styling, and functional tasks, the study measures gaps between claimed design decisions and the generated result.
Summary
Why Design Theater Adds New Signal:
1. Rationale-to-interface evaluation: Tests whether generated design explanations are visible in the actual UI
2. Three requirement classes: Separates structural, styling, and functional implementation quality
3. Cross-tool benchmark: Evaluates 120 interfaces produced by five Generative UI tools
4. Concrete failure evidence: Finds more than 25% of stated rationales unimplemented on average, rising to 34% for functional requirements
5. UX principle coverage: Measures whether tools recognize and implement the design principles embedded in prompts
1. Rationale-to-interface evaluation: Tests whether generated design explanations are visible in the actual UI
2. Three requirement classes: Separates structural, styling, and functional implementation quality
3. Cross-tool benchmark: Evaluates 120 interfaces produced by five Generative UI tools
4. Concrete failure evidence: Finds more than 25% of stated rationales unimplemented on average, rising to 34% for functional requirements
5. UX principle coverage: Measures whether tools recognize and implement the design principles embedded in prompts
Tags
genuiui-evaluationdesign-rationaleux-principlesbenchmark