List पर वापस जाएँ
📄Papers

TaskLens: Generating Task-Conditioned Scaffolded Interfaces for Learning Professional Creative Software

Liu Y. et al.
2026-06

परिचय

DIS 2026 / arXiv paper, जो TaskLens नाम की LLM-based method पेश करता है। यह complex creative tools के लिए task-conditioned scaffolded UIs बनाती है। System workflow stages और domain concepts पहचानता है, संबंधित tools चुनता है, implementation code बनाता है और Blender जैसे software में advanced features को धीरे-धीरे दिखाने वाले interfaces तैयार करता है।

सारांश

TaskLens क्या नया संकेत देता है:

1. Domain-specific GenUI: Generated interfaces को generic chat surfaces की जगह professional creative software में लागू करता है
2. Scaffolded learning UI: Tools को workflow stage और concept के अनुसार व्यवस्थित करता है, ताकि beginners काम करते हुए सीखें
3. Executable generation path: Tools चुनने, implementation code बनाने और task-specific interfaces render करने के लिए LLMs इस्तेमाल करता है
4. Study-backed evidence: Blender beginner study में कम task load और बेहतर task performance रिपोर्ट करता है
5. Collection fit: Generative UI को केवल response rendering नहीं, adaptive in-product guidance की तरह दिखाने वाला मजबूत उदाहरण

Tags

scaffolded-uicreative-softwaregenuilearning
मूल लेख पढ़ें

मिलते-जुलते लेख

📄Papers

ControlAnything: Generative UI and On-Demand Device Integration in Mixed Reality

November 2026 preprint generating both spatial controls and the connector code for physical devices when a Quest 3 wearer requests them. A coding agent tests connections over hand-written MIDI, Bluetooth, and key-press transports, then returns AR widgets, a per-frame hand program, or both.

generative-uimixed-realitydevice-integration
लेखक Bektur Ryskeldiev · 2026-11-05
और पढ़ें
📄Papers

Interface Quilt: Modifying Applications with Computer Use Agents and Generative UI

November 2026 preprint from Autodesk Research combining computer-use agents and GenUI to build persistent interface patches over existing applications. It recovers controls from rendered pixels, generates new interaction surfaces, and synchronizes them with the underlying app without requiring source code, APIs, or accessibility data.

generative-uicomputer-use-agentsinterface-patches
लेखक Qiu L. et al. · 2026-11-01
और पढ़ें
📄Papers

ABRA: Agent-Bound UI for Human-Agent Communication beyond Chat with Reusable Views

October 2026 EMNLP system demonstration separating reusable graph, table, text, and display views from task-specific interaction meanings. ABRA publishes these bindings as shared canvas state so users and other agents can inspect and invoke task-specific actions.

generative-uishared-canvasesinteraction-semantics
लेखक Kim S. G. and Kim H. · 2026-10-22
और पढ़ें

Generative UI और Intelligent UI resources का curated संग्रह।

बनाया गया ❤️ community द्वारा