العودة إلى القائمة
📄الأبحاث

Learning to Detect UI Principle Violations via Reinforcement Learning

Mehta N. et al.
2026-07

حول

July 2026 paper on a lightweight vision-language critic for generated web interfaces. The authors unify 19 principles spanning WCAG 2.2 accessibility, deceptive design, and cognitive usability, then train on roughly 10,000 generated pages with verified synthetic violations.

الملخص

Why This Paper Adds New Signal:

1. Quality beyond correctness: Evaluates whether generated interfaces are usable and responsible, not only whether their code runs
2. Broad design coverage: Combines accessibility, deceptive-pattern, perception, cognition, and interaction principles
3. Reproducible data pipeline: Injects and verifies known violations in diverse LLM-generated Tailwind pages
4. Efficient critic: Improves a 4B vision-language model from 36% to 84% micro-F1 across the 19-principle benchmark
5. Generation-loop utility: Positions the critic as an audit gate, training-data filter, and reward signal for better UI generators

الوسوم

ui-evaluationaccessibilitydesign-qualityvision-language-modelreinforcement-learning

مقالات ذات صلة

📄الأبحاث

ControlAnything: Generative UI and On-Demand Device Integration in Mixed Reality

November 2026 preprint generating both spatial controls and the connector code for physical devices when a Quest 3 wearer requests them. A coding agent tests connections over hand-written MIDI, Bluetooth, and key-press transports, then returns AR widgets, a per-frame hand program, or both.

generative-uimixed-realitydevice-integration
بواسطة Bektur Ryskeldiev · 2026-11-05
اقرأ المزيد
📄الأبحاث

Interface Quilt: Modifying Applications with Computer Use Agents and Generative UI

November 2026 preprint from Autodesk Research combining computer-use agents and GenUI to build persistent interface patches over existing applications. It recovers controls from rendered pixels, generates new interaction surfaces, and synchronizes them with the underlying app without requiring source code, APIs, or accessibility data.

generative-uicomputer-use-agentsinterface-patches
بواسطة Qiu L. et al. · 2026-11-01
اقرأ المزيد
📄الأبحاث

ABRA: Agent-Bound UI for Human-Agent Communication beyond Chat with Reusable Views

October 2026 EMNLP system demonstration separating reusable graph, table, text, and display views from task-specific interaction meanings. ABRA publishes these bindings as shared canvas state so users and other agents can inspect and invoke task-specific actions.

generative-uishared-canvasesinteraction-semantics
بواسطة Kim S. G. and Kim H. · 2026-10-22
اقرأ المزيد

مجموعة منتقاة من مصادر Generative UI وIntelligent UI وGenUI وواجهات AI الديناميكية.

صُنع باستخدام ❤️ من قِبل المجتمع