العودة إلى القائمة
📄الأبحاث

LEGOUI: Designing with UI-DSL Bricks for Transparent, Controllable Generation

Zhou Y. et al.
2026-08

حول

August 2026 HCI paper introducing a staged Generative UI framework for early design ideation. LEGOUI records prompt-derived and model-inferred decisions in a provenance-aware UI DSL, lets users accept, reject, or add decisions across layout, interaction, relation, and style stages, and renders from the evolving specification.

الملخص

Why LEGOUI Adds New Signal:

1. Inspectable intermediate state: Makes design assumptions visible before they are embedded in a generated interface
2. Decision-level control: Lets users accept, reject, or add UI-DSL items instead of repeatedly rewriting the whole prompt
3. Persistent provenance: Tracks whether each decision came from the prompt, model inference, or user revision
4. Evidence-backed workflow: Evaluates requirement extraction on 40 real-world prompts and compares the system with one-shot tools in a 15-participant study
5. Explicit trade-off: Reports stronger transparency, control, and intent alignment while acknowledging the added cost of inspecting staged decisions

الوسوم

genuiui-dsldesign-timehuman-in-the-loopprovenance

مقالات ذات صلة

📄الأبحاث

ControlAnything: Generative UI and On-Demand Device Integration in Mixed Reality

November 2026 preprint generating both spatial controls and the connector code for physical devices when a Quest 3 wearer requests them. A coding agent tests connections over hand-written MIDI, Bluetooth, and key-press transports, then returns AR widgets, a per-frame hand program, or both.

generative-uimixed-realitydevice-integration
بواسطة Bektur Ryskeldiev · 2026-11-05
اقرأ المزيد
📄الأبحاث

Interface Quilt: Modifying Applications with Computer Use Agents and Generative UI

November 2026 preprint from Autodesk Research combining computer-use agents and GenUI to build persistent interface patches over existing applications. It recovers controls from rendered pixels, generates new interaction surfaces, and synchronizes them with the underlying app without requiring source code, APIs, or accessibility data.

generative-uicomputer-use-agentsinterface-patches
بواسطة Qiu L. et al. · 2026-11-01
اقرأ المزيد
📄الأبحاث

ABRA: Agent-Bound UI for Human-Agent Communication beyond Chat with Reusable Views

October 2026 EMNLP system demonstration separating reusable graph, table, text, and display views from task-specific interaction meanings. ABRA publishes these bindings as shared canvas state so users and other agents can inspect and invoke task-specific actions.

generative-uishared-canvasesinteraction-semantics
بواسطة Kim S. G. and Kim H. · 2026-10-22
اقرأ المزيد

مجموعة منتقاة من مصادر Generative UI وIntelligent UI وGenUI وواجهات AI الديناميكية.

صُنع باستخدام ❤️ من قِبل المجتمع