This workshop integrates embodied interactions in augmented reality (AR) with the reasoning capabilities of large language models (LLMs) for interactive design and robotic fabrication. Participants worked with a HoloLens 2 AR headset and a UR10-e collaborative robot, adapting an agentic framework (MAVE) to craft custom workflows that connect AI agents, robots, and human interactions. 

Over seven days, participants learned how AR grounds LLMs in design and fabrication contexts, built custom agents on the MAVE framework, and applied these tools to human-robot collaborative scenarios. The workshop began with an introduction to robotic fabrication and the use of AR interfaces with LLM agents. Days two and three cover the MAVE software architecture and hands-on tutorials with the codebase. Students then developed concepts for interactive design and fabrication workflows, considering how agents with different domains of expertise can contribute towards novel outcomes. Days four through six were dedicated to system development, prototyping, and documentation. The workshop concluded on day seven with project presentations and an exhibition of the results throughout CDRF 2025.

© Video and photo credits: ICD/IntCDC University of Stuttgart  

Talk-Create-Build proposed a conversational assistant for furniture design. The Supervisor agent conducts an interview to gather user requirements on functional aspects (weight, load capacity, budget) and aesthetic preferences (complexity). These responses map to parameters controlling density, height, and twist of layered assemblies generated in Grasshopper. (with Yaqi Chen, Jiayi Liu, Ahmad Mansuri, Xiaoye Ren, Jingwen Song)

Sync-Point developed an assembly balancing game where human and robot collaborate to add elements to a structure without causing collapse. The human places a beam in AR, the Design agent computes a balancing solution, and both parties synchronise their placements. A new tool analyses beam dimensions and positions to determine valid configurations. (with Yichu Liu, Xuanyu Nick Lu, Han Nan, Haoyi Xu, Hanyu Xue, Yunfan Zhao)

Orchestrating Chaos implemented a workflow for designing with waste materials. A new Material agent catalogues as-found cardboard offcuts, capturing geometry through AR control points and qualitative notes on material condition. The Design agent uses this catalogue to run Kangaroo physics simulations that generate folded configurations. (with Ruoxi Li, Julian Tesche, Cheng Zeng, Chi Zhang, Zhiyuan Zhang)

Xiliu Yang, Samuel Slezak, Lasath Siriwardena, Felix Amtsberg, Prof. Achim Menges

Xingjie Xie (CAUP Tongji)

Yaqi Chen, Jiayi Liu, Ahmad Mansuri, Xiaoye Ren, Jingwen Song, Yichu Liu, Xuanyu Nick Lu, Han Nan, Haoyi Xu, Hanyu Xue, Yunfan Zhao, Ruoxi Li, Julian Tesche, Cheng Zeng, Chi Zhang, Zhiyuan Zhang

DigitalFUTURES