Information need in metaverse recordings - A field study
DOI:
https://doi.org/10.47989/ir31163020Keywords:
Metaverse, Multimedia Information Retrieval, information need, metaverse recordings, information seeking behaviourAbstract
Introduction. Metaverse Recordings (MVRs) represent an emerging and underexplored media type within the field of Multimedia Information Retrieval (MMIR). This paper presents findings from a field study aimed at understanding the user information needs and search behaviours specific to MVR retrieval.
Method. By conducting and analysing expert interviews, the study identifies application scenarios and retrieval challenges. from an MVR collection.
Analysis. The collected responses were analysed to reveal patterns in user needs and behaviours. Key focus areas included interest in time-series data generated during graphical rendering and data from related input-output devices, identified as crucial components for MVR retrieval.
Results. The findings outline existing application scenarios for MVRs, validate the need to capture specific data types in MVR retrieval, and emphasise the importance of user-tailored MVR retrieval systems. The study also identifies use cases, and requirements essential for the design of effective MVR retrieval systems.
Conclusions. This research contributes to a foundational understanding of MVR retrieval and supports future efforts in system design and research within MMIR, enhancing the comprehension of information search behaviours in the context of the emerging multimedia type MVR.
References
Adhanom, I.B., MacNeilage, P. & Folmer, E. (2023). Eye tracking in virtual reality: A broad review of applications and challenges. Virtual Reality, 27, 1481–1505. https://doi.org/10.1007/s10055-022-00738-z
Alsop, T. (2023, August 31). Virtual reality (VR)—Statistics & facts. Statista. https://www.statista.com/topics/2532/virtual-reality-vr/ (Archived at https://web.archive.org/web/20250920142626/https://www.statista.com/topics/2532/virtual-reality-vr/)
Anderson, J., & Rainie, L. (2022, June 30). The metaverse in 2040. Pew Research Center. https://www.pewresearch.org/internet/2022/06/30/the-metaverse-in-2040/ (Archived at https://web.archive.org/web/20250921093518/https://www.pewresearch.org/internet/2022/06/30/the-metaverse-in-2040/)
Austin, D. (2023, April 20). 2023 Internet minute infographic. eDiscovery Today by Doug Austin. https://ediscoverytoday.com/2023/04/20/2023-internet-minute-infographic-by-ediscovery-today-and-ltmg-ediscovery-trends/ (Archived at https://web.archive.org/web/20250823180818/https://ediscoverytoday.com/2023/04/20/2023-internet-minute-infographic-by-ediscovery-today-and-ltmg-ediscovery-trends/)
Belkin, N. J., Marchetti, P. G., & Cool, C. (1993). BRAQUE: Design of an interface to support user interaction in information retrieval. Information Processing & Management, 29(3), 325–344. https://doi.org/10.1016/0306-4573(93)90059-M
Bestie Let’s Play (Director). (2022, October 16). Wir verbringen einen Herbsttag mit der Großfamilie!!/Roblox Bloxburg Family Roleplay Deutsch [Video recording]. https://www.youtube.com/watch?v=sslXNBKeqf0
Gartner Inc. (2022, August 30). Metaverse, web3 and crypto: Separating blockchain hype from reality [Interview]. Gartner. https://www.gartner.com/en/newsroom/press-releases/2022-08-30-metaverse-web3-and-crypto-separating-blockchain-hype-from-reality (Archived at https://web.archive.org/web/20250806055732/https://www.gartner.com/en/newsroom/press-releases/2022-08-30-metaverse-web3-and-crypto-separating-blockchain-hype-from-reality)
Güngör, A. (2016, May 17). Video: NVIDIA Ansel architecture explained. Technopat Sosyal. https://www.technopat.net/sosyal/konu/video-nvidia-ansel-architecture-explained.329263/ (Archived at https://web.archive.org/web/20251104185726/https://www.technopat.net/sosyal/konu/video-nvidia-ansel-architecture-explained.329263/)
Gunkel, S., Stokking, H., Prins, M., Niamut, O., Siahaan, E., & Cesar, P. (2018). Experiencing virtual reality together: Social VR use case study. Proceedings of the 2018 ACM International Conference on Interactive Experiences for TV and Online Video, 233–238. https://doi.org/10.1145/3210825.3213566
Gurrin, C. (2021). Personal data matters: New opportunities from lifelogs. 2021 16th International Joint Symposium on Artificial Intelligence and Natural Language Processing (iSAI-NLP), 1–3. https://doi.org/10.1109/iSAI-NLP54397.2021.9678155
Gurrin, C., Zhou, L., Healy, G., Tran, A., Rossetto, L., Bailer, W., Dang-Nguyen, D., Hodges, S., Jónsson B, Tran, M., & Schöffmann, K. (2025, June). Introduction to the 8th Annual Lifelog Search Challenge, LSC'25. In Proceedings of the 2025 International Conference on Multimedia Retrieval (pp. 2143-2144). https://doi.org/10.1145/3731715.3734579
The International Criminal Police Organization (INTERPOL). (2024a). Metaverse—A law enforcement perspective [Whitepaper]. https://www.interpol.int/News-and-Events/News/2024/Grooming-radicalization-and-cyber-attacks-INTERPOL-warns-of-Metacrime (Archived at https://web.archive.org/web/20250611211724/https://www.interpol.int/News-and-Events/News/2024/Grooming-radicalization-and-cyber-attacks-INTERPOL-warns-of-Metacrime)
The International Criminal Police Organization (INTERPOL). (2024b, January 18). Grooming, radicalization and cyber-attacks: INTERPOL warns of ‘Metacrime’. https://www.interpol.int/en/News-and-Events/News/2024/Grooming-radicalization-and-cyber-attacks-INTERPOL-warns-of-Metacrime (Archived at https://web.archive.org/web/20250906030108/https://www.interpol.int/en/News-and-Events/News/2024/Grooming-radicalization-and-cyber-attacks-INTERPOL-warns-of-Metacrime)
Karlsson, B. (2018). RenderDoc. https://renderdoc.org/ (Archived at https://web.archive.org/web/20251010074022/https://renderdoc.org/)
KZero Worldwide. (2024, February 6). Exploring the Q1 24’ metaverse radar chart: Key findings unveiled - KZero Worldswide. https://kzero.io/2024/02/06/2633/ (Archived at https://web.archive.org/web/20240206134622/https://kzero.io/2024/02/06/2633/)
Meißner, M., Pfeiffer, J., Pfeiffer, T., & Oppewal, H. (2019). Combining virtual reality and mobile eye tracking to provide a naturalistic experimental environment for shopper research. Journal of Business Research, 100, 445-458. https://doi.org/10.1016/j.jbusres.2017.09.028
Mojang. (2023, January 31). Minecraft official website. Minecraft.net. https://www.minecraft.net/de-de (Archived at https://web.archive.org/web/20251103172205/https://www.minecraft.net/de-de)
Morris, T. (2022, May 3). Understanding just what’s happening with the metaverse? GWI. https://blog.gwi.com/chart-of-the-week/metaverse-predictions/ (Archived at https://web.archive.org/web/20250807010715/https://www.gwi.com/blog/metaverse-predictions)
Mystakidis, S. (2022). Metaverse. Encyclopedia, 2(1), 486–497. https://doi.org/10.3390/encyclopedia2010031
Rüger, S. (2010). What is multimedia information retrieval? In S. Rüger, Multimedia Information Retrieval (pp. 1–12). Springer International Publishing. https://doi.org/10.1007/978-3-031-02269-2_1
Steinert, P. Wagenpfeil, S., Frommholz, I., Hemmje, M. L., (2023). Towards the integration of metaverse and multimedia information retrieval, IEEE International Conference on Metrology for eXtended Reality, Milano, Italy, pp. 581-586. https://doi.org/10.1109/MetroXRAINE58569.2023.10405728
Steinert, P., Wagenpfeil, S., Frommholz, I., & Hemmje, M. L. (2024a, October). 256 metaverse records dataset. In Proceedings of the 32nd ACM International Conference on Multimedia (pp. 4256-4263). https://doi.org/10.1145/3664647.3681711
Steinert, P., Wagenpfeil, S., Frommholz, I., & Hemmje, M. L. (2024b, February). Integration of Metaverse Recordings in Multimedia Information Retrieval. In Proceedings of the 2024 13th International Conference on Software and Computer Applications (pp. 137-145). https://doi.org/10.1145/3651781.365180
Steinert, P., Wagenpfeil, S., Frommholz, I., & Hemmje, M. L. (2025). Uses of metaverse recordings in multimedia information retrieval. Multimedia, 1(1), 2. https://doi.org/10.3390/multimedia1010002
Stephenson, N. (1992). Snow crash. Bantam Books.
Stothard, P., Ryan, P., Kurata, T., & Stapleton, D. (2024). Towards a mining metaverse. Mining Technology: Transactions of the Institutions of Mining and Metallurgy, 25726668241242232. https://doi.org/10.1177/25726668241242232
Wikipedia. (2023a). Augmented reality. In Wikipedia. https://en.wikipedia.org/w/index.php?title=Augmented_reality&oldid=1142793928 (Archived at https://web.archive.org/web/20240903103104/https://en.wikipedia.org/w/index.php?title=Augmented_reality&oldid=1142793928)
Wikipedia. (2023b). Roblox. In Wikipedia. https://en.wikipedia.org/w/index.php?title=Roblox&oldid=1177660840 (Archived at https://web.archive.org/web/20241005054004/https://en.wikipedia.org/w/index.php?title=Roblox&oldid=1177660840)
Wikipedia. (2024). AltspaceVR. In Wikipedia. https://en.wikipedia.org/w/index.php?title=AltspaceVR&oldid=1248210194 (Archived at https://web.archive.org/web/20251104192245/https://en.wikipedia.org/w/index.php?title=AltspaceVR&oldid=1248210194)
Zheng, Z., Li, T., Li, B., Chai, X., Song, W., Chen, N., Zhou, Y., Lin, Y., & Li, R. (2022). Industrial metaverse: Connotation, features, technologies, applications and challenges. In W. Fan, L. Zhang, N. Li, & X. Song (Eds.), Methods and Applications for Modeling and Simulation of Complex Systems (pp. 239–263). Springer Nature Singapore. https://doi.org/10.1007/978-981-19-9198-1_19
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Patrick Steinert, Jan Mischkies, Stefan Wagenpfeil, Ingo Frommholz, Matthias L. Hemmje
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
