العودة إلى القائمة
📄الأبحاث

ABRA: Agent-Bound UI for Human-Agent Communication beyond Chat with Reusable Views

Kim S. G. and Kim H.
2026-10-22

حول

October 2026 EMNLP system demonstration separating reusable graph, table, text, and display views from task-specific interaction meanings. ABRA publishes these bindings as shared canvas state so users and other agents can inspect and invoke task-specific actions.

الملخص

Why ABRA Adds New Signal:

1. Reusable interaction vocabulary: Adapts what an action means through explicit task bindings
2. Shared semantics: Other agents can inspect and invoke published actions; local view effects and owner-agent consequences follow separate paths
3. Reference implementation: React views, a Node.js canvas hub, and Python adapters support shared human-agent workspaces
4. Evaluation boundary: Four models are tested on isolated one-turn operations; exact view selection reaches only 33–53%, with user understanding and end-to-end task benefits untested

[Official prototype, setup instructions, and demo](https://github.com/megagonlabs/abra).

الوسوم

generative-uishared-canvasesinteraction-semanticsdirect-manipulationmulti-agent

مقالات ذات صلة

📄الأبحاث

ControlAnything: Generative UI and On-Demand Device Integration in Mixed Reality

November 2026 preprint generating both spatial controls and the connector code for physical devices when a Quest 3 wearer requests them. A coding agent tests connections over hand-written MIDI, Bluetooth, and key-press transports, then returns AR widgets, a per-frame hand program, or both.

generative-uimixed-realitydevice-integration
بواسطة Bektur Ryskeldiev · 2026-11-05
اقرأ المزيد
📄الأبحاث

Interface Quilt: Modifying Applications with Computer Use Agents and Generative UI

November 2026 preprint from Autodesk Research combining computer-use agents and GenUI to build persistent interface patches over existing applications. It recovers controls from rendered pixels, generates new interaction surfaces, and synchronizes them with the underlying app without requiring source code, APIs, or accessibility data.

generative-uicomputer-use-agentsinterface-patches
بواسطة Qiu L. et al. · 2026-11-01
اقرأ المزيد
📄الأبحاث

Inflak: A Unified Orchestration Architecture for Human-Agent Interaction

October 2026 paper separating runtime human-agent interaction into routing, planning, design, and rendering. Inflak implements these layers as composable agent skills, letting task state determine when to request input and which generated interface to present.

generative-uiinteraction-orchestrationagent-skills
بواسطة Gao L. et al. · 2026-10-15
اقرأ المزيد

مجموعة منتقاة من مصادر Generative UI وIntelligent UI وGenUI وواجهات AI الديناميكية.

صُنع باستخدام ❤️ من قِبل المجتمع