📄

Generative UI 論文 - 生成AI UXとAI駆動UIの研究

Generative UI、GenUI、AI駆動UI、動的UI 生成AIに関する研究論文を整理。LLMによるUI生成、Human-AI Interaction、HCI、コンテキストを保つ動的インターフェース設計を追えます。

27 件
📄論文

LEGOUI: Designing with UI-DSL Bricks for Transparent, Controllable Generation

August 2026 HCI paper introducing a staged Generative UI framework for early design ideation. LEGOUI records prompt-derived and model-inferred decisions in a provenance-aware UI DSL, lets users accept, reject, or add decisions across layout, interaction, relation, and style stages, and renders from the evolving specification.

genuiui-dsldesign-time
by Zhou Y. et al. · 2026-08
続きを読む
📄論文

Beyond a Single Judge: Simulating Social Persona Panels for Generative UI Evaluation

July 2026 paper introducing ESPP, an evaluation method that replaces one LLM judge with a panel of evidence-grounded, psychologically diverse personas. Panelists independently rate generated-interface screenshots, exchange opinions through a bounded-confidence mechanism, and are combined with social weighting.

genuiui-evaluationhuman-preferences
by Wu Z. et al. · 2026-07
続きを読む
📄論文

Design Theater: A Benchmark for Generative UI

July 2026 paper introducing a benchmark for checking whether Generative UI tools implement the design rationales they present to users. Across 120 interfaces from five tools and 24 structural, styling, and functional tasks, the study measures gaps between claimed design decisions and the generated result.

genuiui-evaluationdesign-rationale
by Imteyaz K. et al. · 2026-07
続きを読む
📄論文

MV-Bench: Benchmarking MLLMs for Coordinated Multi-View Interface Construction

July 2026 benchmark for testing whether multimodal language models can generate executable multi-view visualization interfaces from visual designs. MV-Bench uses Tableau workbooks as structured ground truth and evaluates visual fidelity, data bindings, coordinated interactions, and code executability.

ui-generationmultimodal-modelsdata-visualization
by Zhao Y. et al. · 2026-07
続きを読む
📄論文

Learning to Detect UI Principle Violations via Reinforcement Learning

July 2026 paper on a lightweight vision-language critic for generated web interfaces. The authors unify 19 principles spanning WCAG 2.2 accessibility, deceptive design, and cognitive usability, then train on roughly 10,000 generated pages with verified synthetic violations.

ui-evaluationaccessibilitydesign-quality
by Mehta N. et al. · 2026-07
続きを読む
📄論文

TaskArtisan: Designing Composable Generative Widgets for LLM-Assisted Analysis

July 2026 HCI paper examining how Generative UI can make long, multi-step chatbot analysis workflows easier to revisit and reuse. TaskArtisan lets people create analysis widgets and compose them into sequential or fan-out workflows, then compares the approach with a conventional chatbot in a 12-participant study.

generative-widgetsanalysiscomposition
by Chen M. and Pavel A. · 2026-07
続きを読む
📄論文

AI Prototyper: A Figma Plugin for Decomposition-Based GUI Prototyping with LLMs

July 2026 paper introducing AI Prototyper, an open-source Figma plugin that turns natural-language screen descriptions into fully editable prototypes. Its pipeline decomposes a request into reviewable features, retrieves components from a fixed 32-primitive library, generates schema-constrained instances, and renders native Figma layers with auto-layout.

figmadesign-timegui-prototyping
by Salangsingha T. et al. · 2026-07
続きを読む
📄論文

Spatula: Exploring On-Demand In-Situ Interfaces and Interaction for Attribute Control

July 2026 HCI paper introducing Spatula, an LLM-powered system that generates context-aware controls directly on a motion-graphics canvas. Its elastic attribute control space supports progressive discovery, multiple levels of precision, semantic group editing, and new controls on demand.

on-demand-uicreative-toolsdirect-manipulation
by Li B. et al. · 2026-07
続きを読む
📄論文

Rethinking the UI of GenUI: A Tale of Two Designs

June 2026 HCI paper comparing the prompt-first, depth-first, high-fidelity pattern common in Generative UI tools with a structured, breadth-first, low-fidelity alternative. A study with 24 UX designers and product managers surfaces concrete trade-offs for early-stage design exploration.

ux-designdesign-explorationgenui
by Chen X. et al. · 2026-06
続きを読む
📄論文

The Missing Layer: Why EdTech Needs Design-Time Generative UI, Not Just Runtime Personalization

June 2026 arXiv paper accepted at the AIED NextGen Learning Interfaces Workshop. It argues that adaptive education should use Generative UI at authoring time, not only at learner runtime, so instructors can verify accessible, modality-specific representations before students encounter them.

educationdesign-timeaccessibility
by Neshaei S. P. et al. · 2026-06
続きを読む
📄論文

TaskLens: Generating Task-Conditioned Scaffolded Interfaces for Learning Professional Creative Software

DIS 2026 / arXivの論文です。TaskLensは、複雑なcreative software向けにtask-conditioned scaffolded UIを生成するLLMベースの方法です。workflow stageとdomain conceptを特定し、関連toolを選び、実装codeを生成して、Blenderのようなsoftware内で高度な機能を段階的に開示するinterfaceを作ります。

scaffolded-uicreative-softwaregenui
by Liu Y. et al. · 2026-06
続きを読む
📄論文

FlowEval: Reference-Based Evaluation of Generated User Interfaces

Apple-affiliated research on evaluating whether generated interfaces support realistic user journeys. FlowEval runs validated tasks on reference websites and generated analogs, compares their navigation traces with reference-based similarity metrics, and tests how well those scores align with expert UI judgments.

ui-evaluationinteraction-flowscomputer-use-agents
by Wu J. et al. · 2026-05
続きを読む
📄論文

Macaron-A2UI: A Model for Generative UI in Personal Agents

パーソナルAgentにおける実行時Generative UI(ジェネレーティブUI)を扱う、2026年の新しいarXiv論文です。通常のチャットだけでは複雑なAgentタスクのボトルネックになると捉え、大規模なGenerative UIコーパス、A2UI-Bench、自然言語と軽量な実行可能UI actionを同時に生成するモデルを提示し、生成AI UIデザインの研究基盤としても参照できます。

agentsa2uibenchmark
by Kong F. et al. · 2026-05
続きを読む
📄論文

Efficient Personalization of Generative User Interfaces

GenUIの未解決課題であるパーソナライズに焦点を当てたarXiv論文です。同じ600件の生成UIに対して訓練済みデザイナーのペアワイズ評価を集め、デザイン嗜好のばらつきを示したうえで、少ないサンプルで個人化できる preference model を提案します。

personalizationgenuiarxiv
by Peng Y.-H. et al. · 2026-04
続きを読む
📄論文

MAIC-UI: Making Interactive Courseware with Generative UI

教育向けcoursewareを対象にした、zero-code GenUIシステムのarXiv論文です。MAIC-UIは教科書、PPT、PDFをインタラクティブな学習ページへ変換し、generate-verify-optimizeパイプラインで教育内容の正確性を保ちながら、click-to-locateの差分編集を可能にします。

educationcoursewaregenui
by Tu S. et al. · 2026-04
続きを読む
📄論文

Generative UI as an Accessibility Bridge: C2C e-commerceからの教訓

user-generatedなmarketplace contentにおけるaccessibility gapを、runtime Generative UIがどう埋められるかを論じるarXiv / CHI 2026 workshop paperです。blind、low-vision、高齢ユーザーを対象にした6つの研究をもとに、adapted interface、audio guidance、regenerated HTMLをpolicy-drivenなaccessibility interventionとして位置づけます。

accessibilityruntime-adaptationecommerce
by Bektur Ryskeldiev · 2026-04
続きを読む
📄論文

What does Generative UI mean for HCI Practice?

CHI EA 2026 workshop paper from Microsoft Research and academic HCI researchers on how AI-generated interfaces may reshape design methods, workflows, and user experiences. It is useful because it frames GenUI as a practice-level shift for researchers, designers, developers, and product teams, not only a model-output technique.

chi-2026hci-practicedesign-workflows
by Lindley S. et al. · 2026-04
続きを読む
📄論文

Software as Content: Dynamic Applications as the Human-Agent Interaction Layer

構造化され状態を持つ人間とAgentの作業に、チャットだけでは不十分だと論じる2026年のarXiv論文です。Software as Contentという考え方のもと、動的に生成されるagentic applicationを主なインタラクション層として扱い、turnをまたいで持続する操作可能なUIを提案します。

agentic-appsgenuistateful-ui
by Xie M. and Xie Y. · 2026-03
続きを読む
📄論文

The Keyhole Effect: Why Chat Interfaces Fail at Data Analysis

複数ステップで状態を持つ分析作業に、チャットを標準UIとして使う危うさを論じる2026年のarXiv論文です。線形会話がどこで破綻するかを認知科学の観点から説明し、Generative UIやhybrid interaction patternが可視性、空間記憶、ユーザー制御を取り戻す方法だと位置づけます。

genuihybrid-uianalysis
by Mohan Reddy · 2026-02
続きを読む
📄論文

Gradual Generation of User Interfaces as a Design Method for Malleable Software

GenUIをmalleable softwareのデザイン手法として捉える、2026年のarXiv論文です。巨大なprompt boxや複雑なmenuに利用者を押し込めるのではなく、生成途中に中間的なUI layerを挿入し、カスタマイズ可能性を段階的に発見・制御できるようにします。

malleable-softwaregenuihci
by Min B. et al. · 2026-01
続きを読む
📄論文

AlignUI: A Method for Designing LLM-Generated UIs Aligned with User Preferences

2026 arXiv paper on aligning LLM-generated interfaces with user tasks and preferences. The authors collect 720 UI-control preferences from 50 users across image-editing tasks, use that dataset to guide model reasoning, and evaluate generated UIs with 72 additional users.

preference-alignmentllm-generated-uihci
by Liu Y. et al. · 2026-01
続きを読む
📄論文

Generative UI: LLMs are Effective UI Generators

Generative UIの概念を体系的に示したGoogle Researchの論文です。AI modelがcontentだけでなくuser experience全体を生成するという考え方を定義し、適切なpromptとtoolを使えば、LLMが高品質なcustom interactive interfaceを生成できることを実験で示します。生成UI評価用のPAGEN datasetも公開されています。

googlegenerative-uillm
by Leviathan et al. (Google) · 2025-11
続きを読む
📄論文

Improving User Interface Generation Models from Designer Feedback

Research paper on training LLM-based UI generators with feedback that matches professional design practice. The authors compare rankings, comments, sketches, and direct revisions from 21 designers, then use the resulting data to improve code models that generate rendered interfaces.

ui-generationdesigner-feedbackmodel-alignment
by Wu J. et al. · 2025-09
続きを読む
📄論文

Generative Interfaces for Language Models

LLMがテキストだけで返答するのではなく、タスク固有のinterfaceを能動的に生成するparadigmを提案するACL 2026 Findings論文です。interface向け表現と反復的なrefinementを組み合わせ、情報密度の高いタスクや探索タスクで、会話型UIよりgenerative interfacesが高く評価されたと報告しています。

acl-2026evaluationgenui
by Chen J. et al. · 2025-08
続きを読む
📄論文

Towards a Working Definition of Designing Generative User Interfaces

文献レビューとcase analysisを通じて、Generative UI(GenUI)のworking definitionを提案したDIS 2025論文です。設計時には人間とAIが協調してinterfaceを生成し、実行時にはユーザーがAI生成interfaceと対話するという新しいinterface creation paradigmとして整理しています。

dis-2025genuidefinition
by Lee K.-H. · 2025-05
続きを読む
📄論文

Generative and Malleable User Interfaces with Generative AI

ユーザーのタスクに応じてAIがmalleable user interfacesを生成する方法を提案したCHI 2025論文です。LLMがpromptからユーザー意図を解析し、UI specificationを生成して具体的なinterfaceへmappingするtask-driven data modelを設計しています。

chi-2025malleable-uitask-driven
by Cao Y. et al. · 2025-03
続きを読む
📄論文

BISCUIT: Scaffolding LLM-Generated Code with Ephemeral UIs in Computational Notebooks

Apple研究者によるVL/HCC 2024論文で、JupyterLab workflowに一時的なUI layerを挿入するBISCUITを紹介しています。promptからすぐsource codeへ飛ぶのではなく、生成されたtemporary controlsを先に操作し、選択肢を理解し、要求を洗練し、変数を探索してからcodeを生成します。

notebooksephemeral-uiprogramming
by Cheng R. et al. · 2024-08
続きを読む

Generative UI、GenUI、生成AI UIデザインの厳選リソース集。

Made with ❤️ community