Human-Robot-Collaboration II

Flexibilization of (pre-)fabrication in timber construction through augmented reality supported human-robot cooperation with multiple machines and human craft

Timber construction is a pioneer in the use of technological developments and utilizes the latest fabrication machinery in prefabrication. In the course of this, prefabrication is currently evolving away from craftsmanship towards full automation of the factory. Steps that were the preserve of human workers just a few years ago are now carried out by machines. Initial studies are already testing completely human-free production systems. The quality and value of human craft is barely considered in this trend. On the other hand, developments in the field of robotic technologies and augmented reality (AR), enable new communication and fabrication managment strategies and thus a more direct interaction of these actors becomes feasible.

This research aims to incorporate high level of automation technology (i.e. heavy payload industrial robots) and human craft in cooperative timber construction prefabrication processes using AR. It investigates important aspects, such as workflow management, task sharing of several actors (>2) and safety strategies with the aim for higher flexibility in the manufacturing of low batch sizebuilding elements, typical for the AEC sector. Thus, the research offers an innovative contribution against the current trend and enables especially SMEs with little financial strength a flexible and competitive manufacturing strategy. Consequently, the workers continue to have a value-adding activity in the construction industry.

ICD Institute for Computational Design and Construction, University of Stuttgart

Xiliu Yang, Dr. Felix Amtsberg, Prof. Achim Menges

BEC GmbH

Matthias Buck

müllerblaustein HolzBauWerke GmbH

Johannes Groner

BBSR - Bundesinstitut für Bau- Stadt- und Raumforschung im Bundesamt für Bauwesen und Raumordnung. Innovationsprogramm Zukunft Bau

Yang, X., Amtsberg, F., Kaiser, B., Skoury, L., Stark, T., Treml, S., Opgenorth, N., Sousa Calepso, A., Sedlmair, M., Wortmann, T., Verl, A., & Menges, A. (2025). An implementation and evaluation of large-scale multi-user human–robot collaboration with head-mounted augmented reality. Advanced Engineering Informatics, 67, 103475. https://doi.org/10.1016/j.aei.2025.103475

Yang, X., Amtsberg, F., & Menges, A. (2025). Embracing failures: empowering user interventions in robotic prefabrication with augmented reality. Construction Robotics, 9, Article 2. https://doi.org/10.1007/s41693-025-00157-x

Yang, X., Sasikumar, P., Amtsberg, F., Menges, A., Sedlmair, M., & Nanayakkara, S. (2025). Who is in Control? Understanding User Agency in AR-assisted Construction Assembly. Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3706598.3713765

Yang, X., Pathmanathan, N., Zabel, S., Amtsberg, F., Otto, S., Kurzhals, K., Sedlmair, M., & Menges, A. (2025). Exploring the Use of Augmented Reality for Multi-human-robot Collaboration with Industry Users in Timber Construction. Proceedings of the Extended Abstracts of the CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3706599.3720104

Pittiglio, A., Yang, X., Kladeftira, M., Amstberg, F., Menges, A., & Parascho, S. (2025). Augmented Human-Robot Collaborative Bending: Human-robot collaboration for biogenic material bending-active assemblies. In D. Reinhardt, C. M. Herr, A. Globa, J. Chen, T. Narahara, & N. Rogeau (Eds.), ARCHITECTURAL INFORMATICS, Proceedings of the 30th International Conference of the Association for Computer-Aided Architectural Design Research in Asia (CAADRIA) 2025 (Vol. 2, pp. 315–324). https://papers.cumincad.org/data/works/att/caadria2025_753.pdf

Zabel, S., Neef, N. E., Yang, X., Heinze, C. F., & Otto, S. (2025). Assessing Attitude Towards Collaboration with Robots in the Workplace - One Element of Optimizing Robot Engagement. In C. Stephanidis, M. Antona, S. Ntoa, & G. Salvendy (Eds.), HCI International 2025 Posters (pp. 412–423). Springer Nature Switzerland. https://doi.org/10.1007/978-3-031-94156-6_42

Aygün, D., Calepso, A. S., Yang, X., Menges, A., & Sedlmair, M. (2025). Mixing and Matching: Instruction Conveyance for Collaborative Tasks Using Asymmetric Augmented Reality Setups. 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 1072–1078. https://doi.org/10.1109/VRW66409.2025.00215

Yang, X., Amtsberg, F., Sedlmair, M., & Menges, A. (2024). Challenges and potential for human–robot collaboration in timber prefabrication. Automation in Construction, 160, 105333. https://doi.org/10.1016/j.autcon.2024.105333

Yang, X., Sousa Calepso, A., Amtsberg, F., Menges, A., & Sedlmair, M. (2023). Usability Evaluation of an Augmented Reality System for Collaborative Fabrication between Multiple Humans and Industrial Robots. Proceedings of the 2023 ACM Symposium on Spatial User Interaction, 1–10. https://doi.org/10.1145/3607822.3614528

Amtsberg, F., Yang, X., Skoury, L., Sousa Calepso, A., Sedlmair, M., Wortmann, T., & Menges, A. (2023). Multi-Actor Fabrication for Digital Timber Construction. eCAADe Proceedings. https://doi.org/10.52842/conf.ecaade.2023.1.417

Yang, X., Amtsberg, F., Skoury, L., Wagner, H. J., & Menges, A. (2022). Vizor, Facilitating Cyber-physical Workflows in Prefabrication through Augmented Reality. In J. van Ameijde, N. Gardner, K. H. Hyun, L. Dan, & U. Sheth (Eds.), Post Carbon - Proceedings of the 27th International Conference on Computer-Aided Architectural Design Research in Asia. CAADRIA. https://doi.org/10.52842/conf.caadria.2022.2.141