العودة إلى القائمة
📄الأبحاث

AI Prototyper: A Figma Plugin for Decomposition-Based GUI Prototyping with LLMs

Salangsingha T. et al.
2026-07

حول

July 2026 paper introducing AI Prototyper, an open-source Figma plugin that turns natural-language screen descriptions into fully editable prototypes. Its pipeline decomposes a request into reviewable features, retrieves components from a fixed 32-primitive library, generates schema-constrained instances, and renders native Figma layers with auto-layout.

الملخص

Why AI Prototyper Adds New Signal:

1. Editable design-time generation: Produces native Figma layers rather than flattened images or disposable code previews
2. Human checkpoint: Lets users review, delete, reorder, and extend decomposed features before rendering
3. Grounded component generation: Uses two-stage retrieval and schema validation over a fixed component catalog
4. Multilingual workflow: Demonstrates correctly labelled Thai, English, and Mandarin interfaces, with additional Malayalam testing
5. Preliminary evaluation: Reports higher prototype throughput and stronger expert ratings than manual Figma work, while acknowledging small student and evaluator samples

الوسوم

figmadesign-timegui-prototypinghuman-in-the-looprag

مقالات ذات صلة

📄الأبحاث

ControlAnything: Generative UI and On-Demand Device Integration in Mixed Reality

November 2026 preprint generating both spatial controls and the connector code for physical devices when a Quest 3 wearer requests them. A coding agent tests connections over hand-written MIDI, Bluetooth, and key-press transports, then returns AR widgets, a per-frame hand program, or both.

generative-uimixed-realitydevice-integration
بواسطة Bektur Ryskeldiev · 2026-11-05
اقرأ المزيد
📄الأبحاث

Interface Quilt: Modifying Applications with Computer Use Agents and Generative UI

November 2026 preprint from Autodesk Research combining computer-use agents and GenUI to build persistent interface patches over existing applications. It recovers controls from rendered pixels, generates new interaction surfaces, and synchronizes them with the underlying app without requiring source code, APIs, or accessibility data.

generative-uicomputer-use-agentsinterface-patches
بواسطة Qiu L. et al. · 2026-11-01
اقرأ المزيد
📄الأبحاث

ABRA: Agent-Bound UI for Human-Agent Communication beyond Chat with Reusable Views

October 2026 EMNLP system demonstration separating reusable graph, table, text, and display views from task-specific interaction meanings. ABRA publishes these bindings as shared canvas state so users and other agents can inspect and invoke task-specific actions.

generative-uishared-canvasesinteraction-semantics
بواسطة Kim S. G. and Kim H. · 2026-10-22
اقرأ المزيد

مجموعة منتقاة من مصادر Generative UI وIntelligent UI وGenUI وواجهات AI الديناميكية.

صُنع باستخدام ❤️ من قِبل المجتمع