Exploring immersive cultural heritage experiences: a user study of a VR application featuring ancient manuscripts
DOI:
https://doi.org/10.47989/ir31iConf64125Keywords:
Digital cultural heritage, Virtual reality, VR cultural heritage, Ancient manuscript preservation, VR user experienceAbstract
Introduction. This study aims to explore how general users interact with and perceive cultural heritage through VR applications that feature ancient manuscripts. Specifically, it examines how VR experiences influence users’ interests, knowledge acquisition, and engagement with cultural heritage, focusing on the effects of multiple information channels, plot structure, and VR device interactions.
Method. This study employs a mix-method user study design in which 37 participants were asked to explore the VR application featuring the Qing Dynasty manuscript, ‘Nan Huairen Ti Ben’. Data was collected through pre-task and post-task questionnaires, VR screen recordings, and interaction maps created by the participants.
Analysis. We conducted thematic analysis on the qualitative data and complemented with descriptive and inferential statistical analyses of quantitative data.
Results. The VR application effectively piques users’ interest in the cultural heritage, including its historical and social context, and current state. Key design suggestions include integrating narration with other information channels, allowing for a balance of guided and exploratory interactions, and optimizing device interfaces for cultural heritage contexts. The study also proposes a design framework applicable to the broader VR cultural heritage field.
Conclusion(s). This study proposes a design framework and suggestions for VR cultural heritage, highlighting user needs, information channels, plot structure, and device interactions.
References
Ali, D., Milleville, K., Verstockt, S., Van de Weghe, N., Chambers, S., & Birkholz, J. M. (2023). Computer vision and machine learning approaches for metadata enrichment to improve searchability of historical newspaper collections. Journal of Documentation, ahead-of-print(ahead-of-print). https://doi.org/10.1108/JD-01-2022-0029
Allport, D. A., Antonis, B., & Reynolds, P. (1972). On the division of attention: A disproof of the single channel hypothesis. Quarterly Journal of Experimental Psychology, 24(2), 225–235.
Antoniou, A., Lepouras, G., Bampatzia, S., & Almpanoudi, H. (2013). An approach for serious game development for cultural heritage: Case study for an archaeological site and museum. Journal on Computing and Cultural Heritage, 6(4), Article 4. https://doi.org/10.1145/2532630.2532633
Bekele, M. K., & Champion, E. (2019). A Comparison of Immersive Realities and Interaction Methods: Cultural Learning in Virtual Heritage. Frontiers in Robotics and AI, 6. https://www.frontiersin.org/articles/10.3389/frobt.2019.00091
Braun, V., Clarke, V., Hayfield, N., & Terry, G. (2019). Thematic Analysis. In P. Liamputtong (Ed.), Handbook of Research Methods in Health Social Sciences (pp. 843–860). Springer. https://doi.org/10.1007/978-981-10-5251-4_103
Ch’ng, E., Li, Y., Cai, S., & Leow, F.-T. (2020). The Effects of VR Environments on the Acceptance, Experience, and Expectations of Cultural Heritage Learning. Journal on Computing and Cultural Heritage, 13(1), 1–21. https://doi.org/10.1145/3352933
Cisternino, D., Corchia, L., Luca, V. D., Gatto, C., Liaci, S., Scrivano, L., Trono, A., & De Paolis, L. T. (2021). Augmented Reality Applications to Support the Promotion of Cultural Heritage: The Case of the Basilica of Saint Catherine of Alexandria in Galatina. Journal on Computing and Cultural Heritage, 14(4), 47:1-47:30. https://doi.org/10.1145/3460657
Claisse, C., Petrelli, D., Ciolfi, L., Dulake, N., Marshall, M. T., & Durrant, A. C. (2020). Crafting Critical Heritage Discourses into Interactive Exhibition Design. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, 1–13. https://doi.org/10.1145/3313831.3376689
Coenen, T., Mostmans, L., & Naessens, K. (2013). MuseUs: Case study of a pervasive cultural heritage serious game. Journal on Computing and Cultural Heritage, 6(2), Article 2. https://doi.org/10.1145/2460376.2460379
Davardoust, S., Osello, A., & Tamborrino, R. (2016). ‘Translation’ and Fruition of an Ancient Book Through Virtual Reality in the Case of Lost Cultural Heritage. In M. Ioannides, E. Fink, A. Moropoulou, M. Hagedorn-Saupe, A. Fresa, G. Liestøl, V. Rajcic, & P. Grussenmeyer (Eds.), Digital Heritage. Progress in Cultural Heritage: Documentation, Preservation, and Protection (pp. 727–736). Springer International Publishing. https://doi.org/10.1007/978-3-319-48496-9_58
Davidson, A., & Reid, P. H. (2021). Digital storytelling and participatory local heritage through the creation of an online moving image archive: A case-study of Fraserburgh on Film. Journal of Documentation, 78(2), 389–415. https://doi.org/10.1108/JD-09-2020-0157
Fazio, S., & Turner, J. (2020). Bringing Empty Rooms to Life for Casual Visitors Using an AR Adventure Game: Skullduggery at Old Government House. Journal on Computing and Cultural Heritage, 13(4), Article 4. https://doi.org/10.1145/3418037
Fu, X., Zhu, Y., Xiao, Z., Xu, Y., & Ma, X. (2020). RestoreVR: Generating Embodied Knowledge and Situated Experience of Dunhuang Mural Conservation via Interactive Virtual Reality. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, 1–13. https://doi.org/10.1145/3313831.3376673
Geng, Y., Huang, H.-Y., Chen, C.-H., & Lin, P.-H. (2024). Innovative use of virtual reality simulation technology for pet health care education: A hybrid system for cardiopulmonary resuscitation training. Library Hi Tech, ahead-of-print(ahead-of-print). https://doi.org/10.1108/LHT-12-2023-0636
Greene, D., & Groenendyk, M. (2021). An environmental scan of virtual and augmented reality services in academic libraries. Library Hi Tech, 39(1), 37–47. https://doi.org/10.1108/LHT-08-2019-0166
Hannaford, E. D., Schlegel, V., Lewis, R., Ramsden, S., Bunn, J., Moore, J., Alexander, M., Barker, H., Batista-Navarro, R., Hughes, L., & Nenadic, G. (2024). Our Heritage, Our Stories: Developing AI tools to link and support community-generated digital cultural heritage. Journal of Documentation, 80(5), 1133–1147. https://doi.org/10.1108/JD-03-2024-0057
Hsu, T.-Y., & Liang, H.-Y. (2022). Museum engagement visits with a universal game-based blended museum learning service for different age groups. Library Hi Tech, 40(5), 1226–1243. https://doi.org/10.1108/LHT-08-2020-0198
Hulusic, V., Gusia, L., Luci, N., & Smith, M. (2023). Tangible User Interfaces for Enhancing User Experience of Virtual Reality Cultural Heritage Applications for Utilization in Educational Environment. Journal on Computing and Cultural Heritage, 16(2), Article 2. https://doi.org/10.1145/3593429
Jin, Q., Liu, Y., Yarosh, S., Han, B., & Qian, F. (2022). How Will VR Enter University Classrooms? Multi-stakeholders Investigation of VR in Higher Education. Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, 1–17. https://doi.org/10.1145/3491102.3517542
Kelly, R. M., Cheng, Y., McKay, D., Wadley, G., & Buchanan, G. (2021). “It’s About Missing Much More Than the People”: How Students use Digital Technologies to Alleviate Homesickness. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, 1–17. https://doi.org/10.1145/3411764.3445362
Kumar, A., Kumar, A., Raja, L., & Singh, K. U. (2023). Rediscovering the Traditional UNESCO World Heritage Hawamahal through 3D Animation and Immersive Technology. Journal on Computing and Cultural Heritage, 15(4), Article 4. https://doi.org/10.1145/3524023
Kumpulainen, S., & Late, E. (2022). Struggling with digitized historical newspapers: Contextual barriers to information interaction in history research activities. Journal of the Association for Information Science and Technology, 73(7), 1012–1024. https://doi.org/10.1002/asi.24608
Lehto, A., Luostarinen, N., & Kostia, P. (2020). Augmented Reality Gaming as a Tool for Subjectivizing Visitor Experience at Cultural Heritage Locations—Case Lights On! Journal on Computing and Cultural Heritage, 13(4), Article 4. https://doi.org/10.1145/3415142
Liew, C. L., Yeates, J., & Lilley, S. C. (2021). Digitized indigenous knowledge collections: Impact on cultural knowledge transmission, social connections, and cultural identity. Journal of the Association for Information Science and Technology, 72(12), 1575–1592. https://doi.org/10.1002/asi.24536
Liu, Y., Lin, Y., Shi, R., Luo, Y., & Liang, H.-N. (2021). RelicVR: A Virtual Reality Game for Active Exploration of Archaeological Relics. Extended Abstracts of the 2021 Annual Symposium on Computer-Human Interaction in Play, 326–332. https://doi.org/10.1145/3450337.3483507
Liu, Z., Yan, S., Lu, Y., & Zhao, Y. (2022). Generating Embodied Storytelling and Interactive Experience of China Intangible Cultural Heritage “Hua’er” in Virtual Reality. Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems, 1–7. https://doi.org/10.1145/3491101.3519761
Lo, P., Chan, H. H. Y., Tang, A. W. M., Chiu, D. K. W., Cho, A., See-To, E. W. K., Ho, K. K. W., He, M., Kenderdine, S., & Shaw, J. (2019). Visualising and revitalising traditional Chinese martial arts. Library Hi Tech, 37(2), 269–288. https://doi.org/10.1108/LHT-05-2018-0071
Lu, Z., Annett, M., Fan, M., & Wigdor, D. (2019). “I feel it is my responsibility to stream”: Streaming and Engaging with Intangible Cultural Heritage through Livestreaming. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 1–14. https://doi.org/10.1145/3290605.3300459
Ma, S., Zhou, T., Nie, F., & Ma, X. (2022). Glancee: An Adaptable System for Instructors to Grasp Student Learning Status in Synchronous Online Classes. Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, 1–25. https://doi.org/10.1145/3491102.3517482
Münster, S. (2019). Digital Heritage as a Scholarly Field—Topics, Researchers, and Perspectives from a Bibliometric Point of View. Journal on Computing and Cultural Heritage, 12(3), Article 3. https://doi.org/10.1145/3310012
Nofal, E., Panagiotidou, G., Reffat, R. M., Hameeuw, H., Boschloos, V., & Moere, A. V. (2020). Situated Tangible Gamification of Heritage for Supporting Collaborative Learning of Young Museum Visitors. Journal on Computing and Cultural Heritage, 13(1), Article 1. https://doi.org/10.1145/3350427
Nugent, W. R. (1991). Virtual reality: Advanced imaging special effects let you roam in cyberspace. Journal of the American Society for Information Science, 42(8), 609–617. https://doi.org/10.1002/(SICI)1097-4571(199109)42:8%253C609::AID-ASI12%253E3.0.CO;2-I
Parhizkar, B., & Zaman, H. B. (2009). Development of an Augmented Reality Rare Book and Manuscript for Special Library Collection (AR Rare-BM). In H. B. Zaman, P. Robinson, M. Petrou, P. Olivier, H. Schröder, & T. K. Shih (Eds.), Visual Informatics: Bridging Research and Practice (pp. 344–355). Springer. https://doi.org/10.1007/978-3-642-05036-7_33
Petersen, G. B., Mottelson, A., & Makransky, G. (2021). Pedagogical Agents in Educational VR: An in the Wild Study. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, 1–12. https://doi.org/10.1145/3411764.3445760
Petrelli, D., Dulake, N., Marshall, M. T., Pisetti, A., & Not, E. (2016). Voices from the War: Design as a Means of Understanding the Experience of Visiting Heritage. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 1033–1044. https://doi.org/10.1145/2858036.2858287
Pirbazari, A. G., & Tabrizi, S. K. (2022). RecorDIM of Iran’s Cultural Heritage Using an Online Virtual Museum, Considering the Coronavirus Pandemic. Journal on Computing and Cultural Heritage, 15(2), Article 2. https://doi.org/10.1145/3500925
Pretto, N., Micheloni, E., Gasparotto, S., Fantozzi, C., Poli, G. D., & Canazza, S. (2020). Technology-Enhanced Interaction with Cultural Heritage: An Antique Pan Flute from Egypt. Journal on Computing and Cultural Heritage, 13(2), 8:1-8:20. https://doi.org/10.1145/3355395
Rasmussen, C. H. (2019). Is digitalization the only driver of convergence? Theorizing relations between libraries, archives, and museums. Journal of Documentation, 75(6), 1258–1273. https://doi.org/10.1108/JD-02-2019-0025
Reichherzer, C., Cunningham, A., Coleman, T., Cao, R., McManus, K., Sheppard, D., Kohler, M., Billinghurst, M., & Thomas, B. H. (2021). Bringing the Jury to the Scene of the Crime: Memory and Decision-Making in a Simulated Crime Scene. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, 1–12. https://doi.org/10.1145/3411764.3445464
Robinson, L. (2015). Multisensory, pervasive, immersive: Towards a new generation of documents. Journal of the Association for Information Science and Technology, 66(8), 1734–1737. https://doi.org/10.1002/asi.23328
Schofield, T., Foster Smith, D., Bozoglu, G., & Whitehead, C. (2019). Design and Plural Heritages: Composing Critical Futures. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 1–15. https://doi.org/10.1145/3290605.3300236
Selmanović, E., Rizvic, S., Harvey, C., Boskovic, D., Hulusic, V., Chahin, M., & Sljivo, S. (2020). Improving Accessibility to Intangible Cultural Heritage Preservation Using Virtual Reality. Journal on Computing and Cultural Heritage, 13(2), 1–19. https://doi.org/10.1145/3377143
Sobotkova, A., Kristensen-McLachlan, R. D., Mallon, O., & Ross, S. A. (2024). Validating predictions of burial mounds with field data: The promise and reality of machine learning. Journal of Documentation, ahead-of-print(ahead-of-print). https://doi.org/10.1108/JD-05-2022-0096
Sonnenwald, D. H., & McElligott, J. (2017a). Illuminating human-rare historic book interaction. Proceedings of the Association for Information Science and Technology, 54, Article 1. https://doi.org/10.1002/pra2.2017.14505401164
Sonnenwald, D. H., & McElligott, J. (2017b). Investigating Human-Rare Historic Book Interaction among Young Adults. Interaction Design and Architecture(s), 32, 126–149. https://doi.org/10.55612/s-5002-032-008
Stobo, V., Patterson, K., Erickson, K., & Deazley, R. (2018). “I should like you to see them some time”: An empirical study of copyright clearance costs in the digitisation of Edwin Morgan’s scrapbooks. Journal of Documentation, 74(3), 641–667. https://doi.org/10.1108/JD-04-2017-0061
Strousopoulos, P., Papakostas, C., Troussas, C., Krouska, A., Mylonas, P., & Sgouropoulou, C. (2023). SculptMate: Personalizing cultural heritage experience using fuzzy weights. Adjunct Proceedings of the 31st ACM Conference on User Modeling, Adaptation and Personalization, 397–407. https://doi.org/10.1145/3563359.3596667
Tan, P., Hills, D., Ji, Y., & Feng, K. (2020). Case Study: Creating Embodied Interaction with Learning Intangible Cultural Heritage through WebAR. Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, 1–6. https://doi.org/10.1145/3334480.3375199
Teras, M., Reiners, T., Coldham, G., & Wood, L. C. (2016). nDiVE: Gamified Virtual Reality Environment for Logistics and Supply Chain Management Training. Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, 738–744. https://doi.org/10.1145/2851581.2851596
Torsi, S., Ardito, C., & Rebek, C. (2020). An Interactive Narrative to Improve Cultural Heritage Experience in Elementary School Children. Journal on Computing and Cultural Heritage, 13(3), Article 3. https://doi.org/10.1145/3382771
Valeonti, F., Terras, M., & Hudson-Smith, A. (2019). How open is OpenGLAM? Identifying barriers to commercial and non-commercial reuse of digitised art images. Journal of Documentation, 76(1), 1–26. https://doi.org/10.1108/JD-06-2019-0109
Windhager, F., Federico, P., Schreder, G., Glinka, K., Dörk, M., Miksch, S., & Mayr, E. (2018). Visualization of cultural heritage collection data: State of the art and future challenges. IEEE Transactions on Visualization and Computer Graphics, 25(6), 2311–2330. https://doi.org/10.1109/TVCG.2018.2830759
Wu, Y., You, S., Guo, Z., Li, X., Zhou, G., & Gong, J. (2023). MR. Brick: Designing A Remote Mixed-reality Educational Game System for Promoting Children’s Social & Collaborative Skills. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, 1–18. https://doi.org/10.1145/3544548.3581041
Young, G. W., O’Dwyer, N. C., & Smolic, A. (2023). A Case Study on Student Experiences of Social VR in a Remote STEM Classroom. Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems, 1–8. https://doi.org/10.1145/3544549.3573852
Zhang, N., Nunes, M. B., Li, J., & Zhang, W. (2021). Designing a Virtual Reality Chinese Ancient Book System for Reading and Culture Promotion: A Theoretical Model Development and Implementation. Library and Information Service, 65(13), 12–24.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Wenqi Li, Zeyang Luo, Pengyi Zhang
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
