Bodies, minds, and design – An integrated approach to museum innovation
DOI:
https://doi.org/10.19229/2464-9309/16232024Keywords:
complex interactions, inclusive museum, interactive visual design, brain-computer interfaces, personalised mental representationsAbstract
This paper explores the impact of emerging technologies, with a particular focus on Brain-Computer Interfaces (BCI), within the museum experience. Analysing various case studies highlights the potential of BCIs in visual communication design to personalise the interaction between the visitor and artwork, making experiences more engaging and meaningful. To overcome the limitations of current approaches, the paper proposes a reflection on an integrated model that combines neuroscience, design, and the humanities, centred on the individual and their interaction with the environment. This interdisciplinary approach, which lacks established design traditions in Visual Communication for Cultural Heritage, aims to offer new research perspectives to enhance individual perceptions during multisensory experiences of cultural heritage.
Article info
Received: 10/09/2024; Revised: 10/10/2024; Accepted: 12/10/2024
Downloads
Article Metrics Graph
References
Abbattista, F., Carofiglio, V. and De Carolis, B. (2018), “BrainArt – A BCI-based Assessment of User’s Interests in a Museum Visit”, in De Carolis, B. N., Gena, C., Kuflik, T., Origlia, A. and Raptis, G. E. (eds), Proceedings of the AVI-CH 2018 Workshop on Advanced Visual Interfaces for Cultural Heritage co-located with 2018 International Conference on Advanced Visual Interfaces, Castiglione della Pescaia, Italy, May 29, 2018, vol. 2091, pp. 1-4. [Online] Available at: ceur-ws.org/Vol-2091/ [Accessed 9 September 2024].
Alarcão, S. M. and Fonseca, M. J. (2019), “Emotions Recognition Using EEG Signals – A Survey”, in IEEE Transactions on Affective Computing, vol. 10, issue 3, pp. 374-393. [Online] Available at: doi.org/10.1109/TAFFC.2017.2714671 [Accessed 9 September 2024].
Altieri, A., Ceccacci, S., Giraldi, L., Leopardi, A., Mengoni, M. and Talipu, A. (2021), “Affective Guide for Museum – A System to Suggest Museum Paths Based on Visitors’ Emotions”, in Antona, M. and Stephanidis, C. (eds), Universal Access in Human-Computer Interaction – Design Methods and User Experience – 15th International Conference, UAHCI 2021, Held as Part of the 23rd HCI International Conference, HCII 2021, Virtual Event, July 24-29, 2021, Proceedings, Part I, Lecture Notes in Computer Science, vol. 12768, Springer, Cham, pp 521-532. [Online] Available at: doi.org/10.1007/978-3-030-78092-0_35 [Accessed 9 September 2024].
Ardissono, L., Kuflik, T. and Petrelli, D. (2012), “Personalization in cultural heritage – The road travelled and the one ahead”, in User Modeling and User-Adapted Interaction, vol. 22, pp. 73-99. [Online] Available at: doi.org/10.1007/s11257-011-9104-x [Accessed 9 September 2024].
Banzi, A. (ed.) (2022), The Brain-Friendly Museum – Using Psychology and Neuroscience to Improve the Visitor Experience, Routledge, London. [Online] Available at: doi.org/10.4324/9781003304531 [Accessed 9 September 2024].
Barone, P. and Barbanti, C. V. (2020), “Nuovi media come dispositivi semiotecnici – Uno sguardo pedagogico”, in MeTis | Mondi Educativi – Temi, Indagini, Suggestioni, vol. 10, issue 1, pp. 104-120. [Online] Available at: doi.org/10.30557/mt00114 [Accessed 9 September 2024].
Bilotto, R. (2019), Le nuove tecnologie multimediali nel settore culturale – Il loro impatto sulla fruizione e sull’esperienza dei visitatori. [Online] Available at: archeomedia.net/wp-content/uploads/2019/11/Le-nuove-tecnologie-multimediali-nel-settore-culturale.pdf [Accessed 9 September 2024].
Bollini, L. and Borsotti, M. (2023), “Exhibitions as Hybrid Environments – Exploring Situated and Embodied Interaction in Cultural Heritage”, in Diid | Disegno Industriale Industrial Design, DSI 1, pp. 426-439. [Online] Available at: doi.org/10.30682/diiddsi23t3d [Accessed 9 September 2024].
Bonacini, E. (2023), “Dalla collezione alla connessione – Come si evolve empaticamente il museo del futuro”, in Casalino, M. and Marinucci, C. (eds), Cultura digitale relazione, empatia – Paradigmi della terza rivoluzione industriale, Stamen, Roma, pp. 128-170. [Online] Available at: iris.unive.it/retrieve/2e62689c-5647-4e59-8cb1-fe02dfadfc11/collettivo_INTERNO.pdf [Accessed 9 September 2024].
Brusaporci, S. and Maiezza, P. (2018), “Tra Storia e Memoria – Tecnologie avanzate per la (ri)definizione partecipativa del significato dei luoghi nella città storica”, in Luigini, A. and Panciroli, C. (eds), Ambienti digitali per l’educazione all’arte e al patrimonio, FrancoAngeli, Milano, pp. 51-63. [Online] Available at: series.francoangeli.it/index.php/oa/catalog/view/334/142/1578 [Accessed 9 September 2024].
Caldato, C., Benedetto, S., Bazzan, E., Rodighiero, L. and Mauri, M. (2018), “Emotional Impact played by Art Experience Measured by Means of Neuroscientific Techniques and Traditional Interviews”, in Grant, R., Allen, T., Spink, A. and Sullivan, M. (eds), Measuring Behavior 2018 – Conference Proceedings – 11th International Conference on Methods and Techniques in Behavioral Research, Manchester (UK), 5-8 June 2018, Manchester Metropolitan University, pp. 63-68. [Online] Available at: tsw.it/wp-content/uploads/Assessment_of_Storefront_Displays_with_a_ Multidisciplinary_Approach _based_on_Neuromarketing_and_ Antropological_Marketing-with-cover-page.pdf [Accessed 9 September 2024].
Casiddu, N., Burlando, F., Nevoso, I., Porfirione, C. and Vacanti, A. (2022), “Beyond Personas – Il Machine Learning per personalizzare il progetto | Beyond Personas – Machine Learning to personalise the project”, in Agathón | International Journal of Architecture, Art and Design, vol. 12, pp. 226-233. [Online] Available at: doi.org/10.19229/2464-9309/12202022 [Accessed 9 September 2024].
Cecchi, D. (2018), “Percezione enattiva e operare artistico – Osservazioni a partire da Alva Noë”, in Lebenswelt, vol. 12, pp. 65-72. [Online] Available at: doi.org/10.13130/2240-9599/10368 [Accessed 9 September 2024].
Chen, Z., Qing, J., Xiang, T., Yue, L. W. and Zhou, J. H. (2022), “Seeing Beyond the Brain – Conditional Diffusion Model with Sparse Masked Modeling for Vision Decoding”, in Computer Science | Computer Vision and Pattern Recognition. [Online] Available at: doi.org/10.48550/arXiv.2211.0695 [Accessed 5 October 2024].
Dal Falco, F. (2018), “Corpi, design, post umano – Modernità, ancora?”, in Diid | Disegno Industriale Industrial Design, vol. 64, pp. 134-141. [Online] Available at: researchgate.net/publication/333614279_N6418_Design_ after_Modernity_Editorial [Accessed 9 September 2024].
Dal Falco, F. and Bonomi, S. (2021), “Comunicare il museo tra analogico e digitale – Un’esperienza di progettazione multimediale interattiva | Communicating the Museum Between Analogue and Digital – Interactive Multimedia Design Experience”, in Agathón | International Journal of Architecture, Art and Design, vol. 10, pp. 200-209. [Online] Available at: doi.org/10.19229/2464-9309/10182021 [Accessed 9 September 2024].
Dal Falco, F., Veneziano, R. and Carlomagno, M. (2022), “Collaborazione tra natura e artificio – Processi simbiotici tra scienze, arti e design | Natural and Artificial Interaction – Symbiotic process between science, art and design”, in Agathón | International Journal of Architecture, Art and Design, vol. 11, pp. 274-287. [Online] Available at: doi.org/10.19229/2464-9309/11252022 [Accessed 9 September 2024].
Dall’Osso, G., D’Alessandro, M. and Melappioni, V. (2022), “Interattività spaziali – Sensorialità e Progetto del dato digitale nello spazio | Spatial Interactivity – Sensoriality and design of digital data in the space”, in Agathón | International Journal of Architecture, Art and Design, vol. 12, pp. 58-67. [Online] Available at: doi.org/10.19229/2464-9309/1252022 [Accessed 9 September 2024].
Deroy, O. and Spence, C. (2013), “Why we are not all synesthetes (not even weakly so)”, in Psychonomic Bulletin & Review, vol. 20, issue 1, pp. 643-664. [Online] Available at: doi.org/10.3758/s13423-013-0387-2 [Accessed 5 October 2024].
Desvallées, A. and Mairesse, M. (2010), Concetti Chiave di Museologia, Armand Colin, Parigi.
Di Benedetto, G. (2021), “Nuove Frontiere Museografiche – Immaterialità e multimedialità del museo narrativo | New museographic frontiers – Immateriality and multimediality of the narrative museum”, in Agathón | International Journal of Architecture, Art and Design, vol. 10, pp. 68-75. [Online] Available at: doi.org/10.19229/2464-9309/1062021 [Accessed 9 September 2024].
Diamantopoulou, S., Christidou, D. and Blunden, J. (2024), “Multimodality and museums – Innovative research methods and interpretive frameworks”, in Multimodality & Society, vol. 4, issue 3, pp. 249-258. [Online] Available at: doi.org/10.1177/26349795241270436 [Accessed 5 October 2024].
Dikker, S., Montgomery, S. and Tunca, S. (2019), “Using synchrony-based neurofeedback in search of human connectedness”, in Nijholt, A. (ed.), Brain Art – Brain-Computer Interfaces for Artistic Expression, Springer, Charm, pp. 161-206. [Online] Available at: doi.org/10.1007/978-3-030-14323-7_6 [Accessed 9 September 2024].
Dunne, A. and Raby, F. (2013), Speculative Everything – Design, fiction and social dreaming, The MIT Press, Cambridge-London.
Erioli, A. (2013), Design, controllo e creatività, Doppiozero. [Online] Available at: doppiozero.com/design-controllo-e-creativita [Accessed 8 September 2024].
Fernandes, J. V. M. R., de Alexandria, A. R., Marques, J. A. L., de Assis, D. F., Motta, P. C. and dos Santos Silva, B. R. (2024), “Emotion Detection from EEG Signals Using Machine Deep Learning Models”, in Bioengineering, vol. 11, issue 8, pp. 1-30. [Online] Available at: doi.org/10.3390/bioengineering11080782 [Accessed 9 September 2024].
Floridi, L. (2014), The Fourth Revolution – How the infophere is reshaping human reality, Oxford University Press, Oxford.
Gargano, A. (2020), “Personalizzazione e accessibilità dei beni culturali grazie alla realtà aumentata | Personalization and Accessibility of Cultural Heritage Thanks to Augmented Reality”, in Formazione & Insegnamento | European Journal of Research on Education and Teaching, vol. 18, issue 1, tome II, pp. 729-736. [Online] Available at: doi.org/10.7346/-fei-XVIII-01-20_64 [Accessed 9 September 2024].
Hooper-Greenhill, E. (2000), Museums and the Interpretation of Visual Culture, Routledge, London. [Online] Available at: doi.org/10.4324/9781003124450 [Accessed 9 September 2024].
Hu, L. and Shepley, M. M. (2022), “Design Meets Neuroscience – A Preliminary Review of Design Research Using Neuroscience Tools”, in Journal of Interior Design, vol. 47, issue 1, pp. 31-50. [Online] Available at: doi.org/10.1111/joid.12213 [Accessed 4 October 2024].
Iaconesi, S. and Persico, O. (2021), Cosmologie – Antitesi / Wisteria Furibonda e i rituali del Nuovo Abitare – Poemetto Post-umano a due voci fra Scienza e Poesia. [Online] Available at: he-r.it/wp-content/uploads/2021/08/Cosmologie.pdf [Accessed 9 September 2024].
ICOM – International Council of Museum (2022), Approvata a Praga la nuova definizione di Museo di ICOM. [Online] Available at: icom-italia.org/definizione-di-museo/ [Accessed 9 September 2024].
Jagošová, L. (2020), “Emotions in museum education – Potential for the development of a relationship to cultural and historical heritage”, in Museologica Brunensia, vol. 9, issue 2, pp. 10-16. [Online] Available at: doi.org/10.5817/MuB2020-2-2 [Accessed 9 September 2024].
Kansra, P., Oberoi, S., Lal Gupta, S. and Singh, N. (2022), “Factors limiting the application of consumer neuroscience – A systematic review”, in Journal of Consumer Behaviour, vol. 23, issue 1, pp. 32-42. [Online] Available at: doi.org/10.1002/cb.2131 [Accessed 4 October 2024].
Lo Turco, M., Giovannini, E. C. and Tomalini, A. (2021), “Fisico, Digitale, Virtuale, Immateriale – Esperienze di ricerca in ambito museale | Physical, Digital, Virtual, Intangible – Research Experiences in Museums”, in Agathón | International Journal of Architecture, Art and Design, vol. 10, pp. 140-149. [Online] Available at: doi.org/10.19229/2464-9309/10122021 [Accessed 9 September 2024].
Lucchiari, C., Vanutelli, M. E., Ferrara, V., Folgieri, R. and Banzi, A. (2024), “Promoting Well-Being in the Museum – The ASBA Project Research Protocol”, in The International Journal of Health, Wellness and Society, vol. 14, issue 4, pp. 73-88. [Online] Available at: doi.org/10.18848/2156-8960/cgp/v14i04/73-88 [Accessed 9 September 2024].
Luigini, A. and Pancirolli, C. (eds), Ambienti digitali per l’educazione all’arte e al patrimonio, FrancoAngeli, Milano, pp. 17-34. [Online] Available at: series.francoangeli.it/index.php/oa/catalog/view/334/142/1578 [Accessed 9 September 2024].
Luo, D., Doucé, L. and Nys, K. (2024), “Multisensory museum experience – An integrative view and future research directions”, in Museum Management and Curatorship, pp. 1-28. [Online] Available at: doi.org/10.1080/09647775.2024.2357071 [Accessed 5 October 2024].
Lupo, E. (2021), “Design e Innovazione del Patrimonio Culturale – Connessioni phygital per un Patrimonio di prossimità | Design and Innovation for the Cultural Heritage – Phygital connections for a Heritage of proximity”, in Agathón | International Journal of Architecture, Art and Design, vol. 10, pp. 186-199. [Online] Available at: doi.org/10.19229/2464-9309/10172021 [Accessed 9 September 2024].
Marconi, A. (2021), “Menti in (en)azione – Il fenomeno della cognizione da un punto di vista evolutivo ed ecologico”, in Nóema, vol. 12, pp. 14-44. [Online] Available at: doi.org/10.13130/2239-5474/16597 [Accessed 9 September 2024].
Marenko, B. and van Allen, P. (2016) “Animistic design – How to reimagine digital interaction between the human and the nonhuman”, in Digital Creativity, vol. 27, issue 1, pp. 52-70. [Online] Available at: doi.org/10.1080/14626268.2016.1145127 [Accessed 4 October 2024].
Merleau-Ponty, M. (1945), Phenomenology of Perception, Gallimard, Paris.
Mowla, R., Cano, R. I., Dhuyvetter, K. J. and Thompson, D. E. (2020), “Affective brain-computer interfaces – Choosing a meaningful performance measuring metric”, in Computers in Biology and Medicine, vol. 126, pp. 1-18. [Online] Available at: doi.org/10.1016/j.compbiomed.2020.104001 [Accessed 9 September 2024].
Neff, G., Jordan, T. and McVeigh-Schultz, J. (2012), “Affordances, technical agency, and the politics of technologies of cultural production”, in Culture Digitally, 23/01/2012. [Online] Available at: culturedigitally.org/2012/01/affordances-technical-agency-and-the-politics-of-technologies-of-cultural-production-2/#sthash.tZezjCJ8.dpuf [Accessed 4 October 2024].
Nijholt, A. (2019), Brain Art – Brain-Computer Interfaces for Artistic Expression, Springer, Cham. [Online] Available at: doi.org/10.1007/978-3-030-14323-7 [Accessed 9 September 2024].
Nikolaou, P. (2024), “Museums and the Post-Digital – Revisiting Challenges in the Digital Transformation of Museums”, in Heritage, vol. 7, issue 3, pp. 1784-1800. [Online] Available at: doi.org/10.3390/heritage7030084 [Accessed 9 September 2024].
Noë, A. (2006), Action in Perception, The MIT Press, Cambridge (MA).
O’Connor, C., Rees, G. and Joffe, H. (2012), “Neuroscience in the Public Sphere”, in Neuroview, vol. 74, issue 2, pp. 220-226. [Online] Available at: doi.org/10.1016/j.neuron.2012.04.004 [Accessed 4 October 2024].
Pavlidis, G. (2018), “The Role of Recommender Systems in Cultural Heritage”, in Panagopoulos, M., Papadopoulou, M. and Giannakoulopoulos, A. (eds), DCAC 2018 – Digital Culture & Audiovisual Challenges – Interdisciplinary Creativity in Arts and Technology – Proceedings of the International Conference on Digital Culture & AudioVisual Challenges, Corfu, Greece, June 1-2, 2018, vol. 2811, pp. 62-69. [Online] Available at: ceur-ws.org/Vol-2811/ [Accessed 9 September 2024].
Parisi, L. (2019), “Critical Computation – Digital Automata and General Artificial Thinking”, in Theory, Culture & Society, vol. 36, issue 2, pp. 89-121. [Online] Available at: doi.org/10.1177/0263276418818889 [Accessed 4 October 2024].
Pietrini, P., Lattanzi, N., Ricciardi, E., Patricelli Malizia, A., Bernardi, G. and Caldarelli, G. (2018), “Contributo Artech Gallerie d’Italia”, in Montagnese, M., Costantini, M., Colombo, M., D’Arcangelo, S., Borghi, D. and Milone, M. (eds), Neuroscience Impact – Brain and Business, Intesa San Paolo Innovation Center, pp. 212-219. [Online] Available at: group.intesasanpaolo.com/content/dam/portalgroup/repository-documenti/20181206_Neuroscience%20Impact%20ITA.pdf [Accessed 9 September 2024].
Ramadori, M. (2023), “Accessibilità museale e disabilità – Dall’abbattimento delle barriere architettoniche (1971) al PNRR – Next Generation EU (2022-2026)”, in BTA | Bollettino Telematico dell’Arte, vol. 935, pp. 1-13. [Online] Available at: bta.it/txt/a0/09/bta00935.html [Accessed 9 September 2024].
Ramoğlu, M. (2019), “Cyborg – Computer Interaction – Designing New Senses”, in The Design Journal, vol. 22, issue suppl. 1, pp. 1215-1225. [Online] Available at: doi.org/10.1080/14606925.2019.1594986 [Accessed 5 October 2024].
Sanders, E. B.-N. and Stappers, P. J. (2016), Convivial toolbox – Generative research for the front end of design, BIS Publishers, Amsterdam.
Schmorrow, D. D. and Kruse, A. A. (2002), “DARPA’s Augmented Cognition Program – Tomorrow’s human computer interaction from vision to reality – Building cognitively aware computational systems”, in Persensky, J. J., Hallbert, B. and Blackman H. S. (eds), Proceedings of the 2002 IEEE 7th Conference on Human Factors and Power Plants, Scottsdale, Arizona, USA, September 15-17-19, 2002, vol. 7, pp. 1-4. [Online] Available at: doi.org/10.1109/HFPP.2002.1042859 [Accessed 5 October 2024].
Shcattner, Y., Zamir, Y., Siton, N., Kimel, K., Zecharia, N. and Goldway, N. (2023), “Sync – Novel BCI design for neural synchrony, connectedness, and empathy”, in De Sainz Molestina, D., Galluzzo, L., Rizzo, F. and Spallazzo, D. (eds), IASDR 2023 – Life-Changing Design, 9-13 October, Milan (Italy), pp. 1-14. [Online] Available at: doi.org/10.21606/iasdr.2023.820 [Accessed 9 September 2024].
Shelly, F. (2020), “Decoding the Brain Goes Global with the International Brain Initiative”, in Singularity Hub, 28/01/2020. [Online] Available at: singularityhub.com/2020/01/28/decoding-the-brain-goes-global-with-the-international-brain-initiative/ [Accessed 5 October 2024].
Simon, N. (2010), The Participatory Museum, Museum 2.0, Santa Cruz. [Online] Available at: participatorymuseum.org/read/ [Accessed 9 September 2024].
Sobell, N. (2019), “Foreword”, in Nijholt, A. (ed.), Brain Art – Brain-Computer Interfaces for Artistic Expression, Springer, Cham, pp. V-VI. [Online] Available at: doi.org/10.1007/978-3-030-14323-7 [Accessed 9 September 2024].
Spence, C. (2019), “Neuroscience-Inspired Design – From Academic Neuromarketing to Commercially Relevant Research”, in Organizational Research Methods, vol. 22, issue 1, pp. 275-298. [Online] Available at: doi.org/10.1177/1094428116672003 [Accessed 5 October 2024].
Spence, C. (2011), “Crossmodal correspondences – A tutorial review”, in Attention, Perception, and Psychophysics, vol. 73, pp. 971-995. [Online] Available at: doi.org/10.3758/s13414-010-0073-7 [Accessed 5 October 2024].
Suchman, L. (2006), Human-Machine Reconfigurations – Plans and Situated Actions, Cambridge University Press, Cambridge.
Tang, J., LeBel, A., Jain, S. and Huth, A. G. (2023), “Semantic reconstruction of continuous language from non-invasive brain recordings”, in Nature Neuroscience, vol. 26, pp. 858-866. [Online] Available at: doi.org/10.1038/s41593-023-01304-9 [Accessed 5 October 2024].
Valenti, A., Scalisi, F., Sposito, C., Dellamotta, L. and Masserdotti, A. (2024), “Energia, Tecnologia emotiva e valore culturale dei dati – Creare consapevolezza nell’utente con lo storytelling | View of Energy, Emotional Technology and Cultural Value of Data – Creating User Awareness Through Storytelling”, in Agathón | International Journal of Architecture, Art and Design, vol. 15, pp. 70-83. [Online] Available at: doi.org/10.19229/2464-9309/1552024 [Accessed 9 September 2024].
Yang, L. and Huang, E. (2024), “Innovation in Marketing Strategies for Museum Cultural and Creative Products Under New Consumer Demand”, in Journal of Humanities, Arts and Social Science, vol. 8, issue 3, pp. 667-672. [Online] Available at: doi.org/10.26855/jhass.2024.03.019 [Accessed 9 September 2024].
Zannoni, M., Sicklinger, A. and Pezzi, M. (2021), “Human Body Interaction from the Imaginary to Contemporaneity – Anticipation Design Processes”, in Diid | Disegno Industriale Industrial Design, vol. 74, pp. 10-19. [Online] Available at: doi.org/10.30682/diid7421a [Accessed 9 September 2024].
Zitong, C., Jing, L., Jianqiao, C., Chuyi, Z., Fangbing, C., Yang, W. and Preben, H. (2021), “Paint with Your Mind – Designing EEG-based Interactive Installation for Traditional Chinese Artworks”, in Raphel, W. (ed.), TEI ‘21 – Proceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction, Salzburg, Austria, February 14-17, 2021, New York, Association for Computing Machinery, New York, article 49, pp. 1-6. [online] Available at: doi.org/10.1145/3430524.3442455 [Accessed 9 September 2024].
Downloads
Published
How to Cite
Issue
Section
Categories
License
Copyright (c) 2024 Antonella Rosmino
This work is licensed under a Creative Commons Attribution 4.0 International License.
This Journal is published under Creative Commons Attribution Licence 4.0 (CC-BY).
License scheme | Legal code
This License allows anyone to:
Share: copy and redistribute the material in any medium or format.
Adapt: remix, transform, and build upon the material for any purpose, even commercially.
Under the following terms
Attribution: Users must give appropriate credit, provide a link to the license, and indicate if changes were made; users may do so in any reasonable manner, but not in any way that suggests the licensor endorses them or their use.
No additional restrictions: Users may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
Notices
Users do not have to comply with the license for elements of the material in the public domain or where your use is permitted by an applicable exception or limitation.
No warranties are given. The license may not give users all of the permissions necessary for their intended use. For example, other rights such as publicity, privacy, or moral rights may limit how you use the material.
