Digital models and natural language – New perspectives for interpreting complexity

Authors

  • Anna Osello Politecnico di Torino (Italy)
  • Francesca Maria Ugliotti Politecnico di Torino (Italy)
  • Nicola Rimella Politecnico di Torino (Italy)
  • Francesco Loddo Politecnico di Torino (Italy)

DOI:

https://doi.org/10.19229/2464-9309/16182024

Keywords:

design 5.0, openbim, human-artificial intelligence interaction, large language model, chatbot

Abstract

New perspectives for interpreting complexity are now made possible by the collaboration between humans and artificial intelligence through large language models. This approach can enrich the narrative of construction and infrastructure works through tangible and comprehensible semantic representations that increase the accessibility of digital models to users in the field. The research explores using a chatbot as a possible cognitive interpretation tool to improve understanding and knowledge extraction from increasingly complex data systems. The study results describe and highlight the crucial role of the prototype in supporting the interrogation of graphical and alphanumeric information in OpenBIM format of critical infrastructure for management, maintenance and personnel training purposes.

 

Article info

Received: 10/09/2024; Revised: 11/10/2024; Accepted: 14/10/2024

Downloads

Download data is not yet available.

Article Metrics Graph

Author Biographies

Anna Osello, Politecnico di Torino (Italy)

Civil Engineer and PhD, she is a Full Professor of Drawing at the Department of Structural, Building and Geotechnical Engineering. She conducts theoretical and applied research on BIM and interoperability of data management software for the digital built environment.
E-mail: anna.osello@polito.it

Francesca Maria Ugliotti, Politecnico di Torino (Italy)

Building Engineer and PhD, she is a Researcher (RTDA) in Drawing at the Department of Structural, Construction and Geotechnical Engineering. She conducts research activities mainly on the intelligent digitisation of built heritage.
E-mail: francesca.ugliotti@polito.it

Nicola Rimella, Politecnico di Torino (Italy)

Building Engineer, he is a PhD Candidate in Civil Engineering at the Department of Structural, Building and Geotechnical Engineering. He carries out research activities mainly in the field of integration of machine learning algorithms and visual programming for linear infrastructures.
E-mail: nicola.rimella@polito.it

Francesco Loddo, Politecnico di Torino (Italy)

Civil Engineer, he is a PhD Candidate in Civil Engineering at the Department of Structural, Building and Geotechnical Engineering. He conducts research activities to digitalise linear infrastructures’ design and maintenance processes.
E-mail: francesco.loddo@polito.it

References

Adamopoulou, E. and Maglogiannis, L. (2020), “An Overview of Chatbot Technology”, in Maglogiannis, I., Iliadis, L. and Pimenidis, E. (eds), Artificial Intelligence Applications and Innovations – Proceedings of the 16th IFIP WG 12.5 International Conference, AIAI 2020, Neos Marmaras, Greece, June 5-7, 2020, IFIP Advances in Information and Communication Technology, vol. 584, part II, Springer, Cham, pp. 373-383. [Online] Available at: doi.org/10.1007/978-3-030-49186-4_31 [Accessed 19 September 2024].

Alhammadi, M. (2023), “Optimising Customer Service Delivery and Response Time through AI-Enhanced Chatbots in Facilities Management-A Mixed-Methods Research”, in American Journal of Smart Technology and Solutions, vol. 2, issue 2, pp. 43-54. [Online] Available at: doi.org/10.54536/ajsts.v2i2.2206 [Accessed 19 September 2024].

Amershi, S., Weld, D., Vorvoreanu, M., Fourney, A., Nushi, B., Collisson, P., Suh, J., Iqbal, S., Bennett, P. N., Inkpen, K., Teevan, J., Kikin-Gil, R. and Horvitz, E. (2019), “Guidelines for Human-AI Interaction”, in Brewster, S. and Fitzpatrick, G. (eds), CHI 2019 – Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, Glasgow, Scotland UK, May 4-9, 2019, Association for Computing Machinery, New York, pp.1-13. [Online] Available at: doi.org/10.1145/3290605.3300233 [Accessed 19 September 2024].

Arquilla, V. and Paracolli, A. (2023) “Design sull’esperienza dell’utente e sostenibilità degli oggetti con intelligenza artificiale | User experience design and sustainability of AI-infused objects”, in Agathón | International Journal of Architecture, Art and Design, vol. 13, pp. 259-268. [Online] Available at: doi.org/10.19229/2464-9309/13222023 [Accessed 19 September 2024].

Barricelli, B. R., Casiraghi, E. and Fogli, D. (2019), “A Survey on Digital Twin – Definitions, Characteristics, Applications, and Design Implications”, in IEEE Access, vol. 7, pp. 167653-167671. [Online] Available at: doi.org/10.1109/ACCESS.2019.2953499 [Accessed 19 September 2024].

Borrmann, A., Beetz, J., Koch, C., Liebich, T. and Muhic, S. (2018), “Industry Foundation Classes – A Standardized Data Model for the Vendor-Neutral Exchange of Digital Building Models”, in Borrmann, A., König, M., Koch, C. and Beetz, J. (eds), Building Information Modeling, Springer, Cham, pp. 81-126. [Online] Available at: doi.org/10.1007/978-3-319-92862-3_5 [Accessed 19 September 2024].

Chizhik, A. and Zherebtsova, Y. (2020), “Challenges of Building an Intelligent Chatbot”, in Bolgov, R. V., Chugunov, A. V. and Voiskounsky, A. E. (eds), Proceedings of the International Conference on Internet and Modern Society (IMS-2020), ITMO University, St. Petersburg (Russia), June 17-20, 2020, Intelligent Memory Systems, pp. 277-287. [Online] Available at: ceur-ws.org/Vol-2813/rpaper21.pdf [Accessed 19 September 2024].

Cho, J. and Lee, G. (2019), “A Chatbot System for Construction Daily Report Information Management”, in Al-Hussein, M. (ed.), Proceedings of the 36th International Symposium on Automation and Robotics in Construction, ISARC 2019, Banff, Canada, May 21-24, 2019, pp. 429-437. [Online] Available at: doi.org/10.22260/ISARC2019/0058 [Accessed 19 September 2024].

Dejaco, M. C., Scanagatta, C., Mannino, A. and Condotta, M. (2022), “Transizione digitale per il facility management – BIM, CMMS e manutenzione predittiva | Digital transition in facility management – BIM, CMMS and diagnostic maintenance”, in Agathón | International Journal of Architecture, Art and Design, vol. 12, pp. 168-177. [Online] Available at: doi.org/10.19229/2464-9309/12152022 [Accessed 19 September 2024].

Demirkan, H., Earley, S. and Harmon, R. R. (2017), “Cognitive Computing”, in IT Professional, vol. 19, issue 4, pp. 16-20. [Online] Available at: doi.org/10.1109/MITP.2017.3051332 [Accessed 19 September 2024].

Elghaish, F., Chauhan, J. K., Matarneh, S., Farzad, P. R. and Hosseini M. (2022), “Artificial intelligence-based voice assistant for BIM data management”, in Automation in Construction, vol. 140, article 104320, pp. 1-15. [Online] Available at: doi.org/10.1016/j.autcon.2022.104320 [Accessed 19 September 2024].

Espinosa Gispert, D., Yitmen, I., Sadri, H. and Taheri, A. (2023), “Development of an ontology-based asset information model for predictive maintenance in building facilities”, in Smart and Sustainable Built Environment, vol. ahead-of-print, issue ahead-of-print, pp. 1-18. [Online] Available at: doi.org/10.1108/SASBE-07-2023-0170 [Accessed 19 September 2024].

Fatta, F. (2020) “Le molte dimensioni del modello digitale | The many dimensions of the digital model”, in Agathón | International Journal of Architecture, Art and Design, vol. 7, pp. 16-25. [Online] Available at: doi.org/10.19229/2464-9309/722020 [Accessed 19 September 2024].

Fernandes, D., Garg, S., Nikkel, M. and Guven, G. (2024), “A GPT-Powered Assistant for Real-Time Interaction with Building Information Models”, in Buildings, vol. 14, issue 8, article 2499, pp. 1-30. [Online] Available at: doi.org/10.3390/buildings14082499 [Accessed 19 September 2024].

Fukuyama, M. (2018), “Society 5.0 – Aiming for a new human-centered society”, in Japan Spotlight, vol. 1, pp. 47-50. [Online] Available at: jef.or.jp/journal/pdf/220th_Special_Article_02.pdf [Accessed 3 September 2024].

Ko, J., Ennemoser, B., Yoo, W., Yan, W. and Clayton, M. J. (2023), “Architectural spatial layout planning using artificial intelligence”, in Automation in Construction, vol. 154, article 105019, pp. 1-18. [Online] Available at: doi.org/10.1016/j.autcon.2023.105019 [Accessed 19 September 2024].

Lin, T.-H., Huang, Y.-H. and Putranto, A. (2022), “Intelligent question and answer system for building information modeling and artificial intelligence of things based on the bidirectional encoder representations from transformers model”, in Automation in Construction, vol. 142, article 104483, pp. 1-12. [Online] Available at: doi.org/10.1016/j.autcon.2022.104483 [Accessed 19 September 2024].

Lin, W. Y. (2023), “Prototyping a Chatbot for Site Managers Using Building Information Modeling (BIM) and Natural Language Understanding (NLU) Techniques”, in Sensors, vol. 23, issue 6, article 2942, pp. 1-29. [Online] Available at: doi.org/10.3390/s23062942 [Accessed 19 September 2024].

Lo Turco, M., Giovannini, E. C. and Tomalini, A. (2021) “Fisico, Digitale, Virtuale, Immateriale – Esperienze di ricerca in ambito museale | Physical, Digital, Virtual, Intangible – Research experiences in Museums”, in Agathón | International Journal of Architecture, Art and Design, vol. 10, pp. 140-149. [Online] Available at: doi.org/10.19229/2464-9309/10122021 [Accessed 19 September 2024].

Loddo, F., Osello, A., Rimella, N., Polania Rodriguez, D., Ugliotti, F. M. and Ventura, G. V. (2024), “Approccio semantico alla rappresentazione – Verso una collaborazione Uomo-AI per la misura della dismisura | Semantic approach to representation – Toward a collaborative Human-AI for the measurement of the out-of-measure”, in Bergamo, F., Calandriello, A., Ciammaichella, M., Friso, I., Gay, F., Liva, G. and Monteleone, C. (eds), Misura / Dismisura – Atti del 45° Convegno Internazionale dei Docenti delle Discipline della Rappresentazione – Congresso della Unione Italiana per il Disegno | Measure / Out of Measure – Proceedings of the 45th International Conference of Representation Disciplines Teachers – Congress of Unione Italiana per il Disegno, Padova-Venezia, Settembre 12-14, 2024, FrancoAngeli, Milano, pp. 3135-3144. [Online] Available at: doi.org/10.3280/oa-1180-c630 [Accessed 19 September 2024].

Magliocco, A. and Canepa, M. (2022), “Cruscotti a servizio della governance – Monitoraggio di indicatori di prestazione e indicatori aggregati | Governance dashboards – Monitoring of key performance and aggregate indicators”, in Agathón | International Journal of Architecture, Art and Design, vol. 12, pp. 36-45. [Online] Available at: doi.org/10.19229/2464-9309/1232022 [Accessed 19 September 2024].

Manni, V. and Valzano, L. S. (2023) “Modularità e Architettura Adattiva – Una strategia per la gestione di sistemi d’involucro complessi | Modularity and adaptive architecture – A strategy for managing complex envelope systems”, in Agathón | International Journal of Architecture, Art and Design, vol. 14, pp. 134-151. [Online] Available at: doi.org/10.19229/2464-9309/14112023 [Accessed 19 September 2024].

Massari, G. A., Barbini, A., Bernardini, E. and Roman, O. (2022) “Riqualificazione energetica dell’edilizia esistente – Modellazione e gestione geometrico-informativa | Energy retrofitting of existing buildings – Geometric-informative modelling and management”, in Agathón | International Journal of Architecture, Art and Design, vol. 12, pp. 146-157. [Online] Available at: doi.org/10.19229/2464-9309/12132022 [Accessed 19 September 2024].

Mutis, I. and Ramachandran, A. (2021), “The Bimbot – Mediating technology for enacting coordination in teamwork collaboration”, in Journal of Information Technology in Construction, vol. 26, pp. 144-158. [Online] Available at: doi.org/10.36680/j.itcon.2021.009 [Accessed 19 September 2024].

Osello, A., Del Giudice, M., Donato, A. J. and Fratto, A. (2024) “Verso la neutralità climatica – Il ruolo chiave del Digital Twin nell’Industria 5.0 | Towards Climate Neutrality – The key role of the Digital Twin in Industry 5.0”, in Agathón | International Journal of Architecture, Art and Design, vol. 15, pp. 276-285. [Online] Available at: doi.org/10.19229/2464-9309/15222024 [Accessed 19 September 2024].

Pone, S. (2022) “Maker – Il ritorno dei costruttori – Una possibile transizione digitale per l’Architettura | Maker – The return of the builders – A possible digital transition for Architecture”, in Agathón | International Journal of Architecture, Art and Design, vol. 12, pp. 14-23. [Online] Available at: doi.org/10.19229/2464-9309/1212022 [Accessed 19 September 2024].

Rane, N., Choudhary, S. and Rane, J. (2023), “Integrating Building Information Modelling (BIM) With ChatGPT, Bard, and Similar Generative Artificial Intelligence in the Architecture, Engineering, and Construction Industry – Applications, a Novel Framework, Challenges, and Future Scope”, in SSRN, pp. 1-22. [Online] Available at doi.org/10.2139/ssrn.4645601 [Accessed 19 September 2024].

Ugliotti, F. M. (2024), Sostenibilità e digitalizzazione nella produzione idroelettrica – Una sfida moderna per una forma di generazione antica, Gangemi Editore, Roma.

Yousefzadeh, S., Spillane, J. P., Lamont, L., McFadden, J. and Lim, J. P. B. (2015), “Building information modelling (BIM) software interoperability – A review of the construction sector”, in Raidén, A. and Aboagye-Nimo, E. (eds), Proceeding of the 31st Annual ARCOM Conference 2015, Lincoln, England, September 7-9, 2015, ARCOM, pp. 711-720. [Online] Available at: hdl.handle.net/10344/7152 [Accessed 19 September 2024].

Zhang, C., Wang, W., Pangaro, P., Martelaro, N. and Byrne, D. (2023), “Generative Image AI Using Design Sketches as input – Opportunities and Challenges”, in C&C ’23 – Proceedings of the 15th Conference on Creativity and Cognition, New York, USA, Virtual Conference, June 19-21, 2023, Association for Computing Machinery, New York, pp. 254-259. [Online] Available at: doi.org/10.1145/3591196.3596820 [Accessed 19 September 2024].

Zheng, J. and Fischer, M. (2023), “Dynamic prompt-based virtual assistant framework for BIM information search”, in Automation in Construction, vol. 155, article 105067, pp. 1-24. [Online] Available at: doi.org/10.1016/j.autcon.2023.105067 [Accessed 19 September 2024].

Meano hydroelectric power station in Pomaretto (TO) used as a case study (credit: the Authors, 2024). AGATHÓN 16 | 2024

Downloads

Published

30-12-2024

How to Cite

Osello, A., Ugliotti, F. M., Rimella, N. and Loddo, F. (2024) “Digital models and natural language – New perspectives for interpreting complexity”, AGATHÓN | International Journal of Architecture, Art and Design, 16, pp. 212–219. doi: 10.19229/2464-9309/16182024.
No Related Submission Found