List рдкрд░ рд╡рд╛рдкрд╕ рдЬрд╛рдПрдБ
ЁЯУДPapers

Toward Frontier-Quality Declarative UI Generation at Small-Model Cost

Yang Y. et al.
2026-09

рдкрд░рд┐рдЪрдп

September 2026 Harness4GenUI paper studying whether small language models can generate production-oriented A2UI from approved component catalogs. Across task-management and cloud-console domains, the authors compare training-data strategies, model sizes, catalog sizes, cost, latency, binding correctness, and rendered quality.

рд╕рд╛рд░рд╛рдВрд╢

Why This Paper Adds New Signal:

1. Tests a deployable contract: Generates structured A2UI with catalog membership and resolvable data bindings instead of arbitrary frontend code
2. Quantifies the cost-quality trade-off: A fine-tuned 4B student recovers about 98% of teacher semantic quality and 97% of visual quality at over an order of magnitude lower API cost
3. Compares training recipes: Catalog perturbation improves overall quality, while constrained targets produce stronger data-binding reliability
4. Challenges catalog-size intuition: Models from 0.8B to 4B improve as the available catalog grows from roughly 10 to 86 components
5. Includes cross-domain evidence: Replicates the main strategy trade-offs with a different 3B base model and cloud-management interface catalog

Tags

a2uismall-language-modelssupervised-fine-tuningcomponent-catalogsdeployment-cost
рдореВрд▓ рд▓реЗрдЦ рдкрдврд╝реЗрдВ

рдорд┐рд▓рддреЗ-рдЬреБрд▓рддреЗ рд▓реЗрдЦ

ЁЯУДPapers

ControlAnything: Generative UI and On-Demand Device Integration in Mixed Reality

November 2026 preprint generating both spatial controls and the connector code for physical devices when a Quest 3 wearer requests them. A coding agent tests connections over hand-written MIDI, Bluetooth, and key-press transports, then returns AR widgets, a per-frame hand program, or both.

generative-uimixed-realitydevice-integration
рд▓реЗрдЦрдХ Bektur Ryskeldiev ┬╖ 2026-11-05
рдФрд░ рдкрдврд╝реЗрдВ
ЁЯУДPapers

Interface Quilt: Modifying Applications with Computer Use Agents and Generative UI

November 2026 preprint from Autodesk Research combining computer-use agents and GenUI to build persistent interface patches over existing applications. It recovers controls from rendered pixels, generates new interaction surfaces, and synchronizes them with the underlying app without requiring source code, APIs, or accessibility data.

generative-uicomputer-use-agentsinterface-patches
рд▓реЗрдЦрдХ Qiu L. et al. ┬╖ 2026-11-01
рдФрд░ рдкрдврд╝реЗрдВ
ЁЯУДPapers

ABRA: Agent-Bound UI for Human-Agent Communication beyond Chat with Reusable Views

October 2026 EMNLP system demonstration separating reusable graph, table, text, and display views from task-specific interaction meanings. ABRA publishes these bindings as shared canvas state so users and other agents can inspect and invoke task-specific actions.

generative-uishared-canvasesinteraction-semantics
рд▓реЗрдЦрдХ Kim S. G. and Kim H. ┬╖ 2026-10-22
рдФрд░ рдкрдврд╝реЗрдВ

Generative UI рдФрд░ Intelligent UI resources рдХрд╛ curated рд╕рдВрдЧреНрд░рд╣ред

рдмрдирд╛рдпрд╛ рдЧрдпрд╛ тЭдя╕П community рджреНрд╡рд╛рд░рд╛