Immersive quality control for 3D data curation
DOI:
https://doi.org/10.47989/ir31iConf64136Keywords:
XR, 3D, Data curation, Augmented reality, Virtual realityAbstract
Introduction. We report quantitative findings from a multi‑site experiment evaluating the impact of immersive viewing (XR) on routine quality control (QC) tasks in academic labs regularly producing 3D content across the United States.
Method. 29 participants were recruited to complete orientation, error‑detection, and comparison tasks under two viewing conditions: Meta Quest 3 (XR) and iPad tablet computer (control). Time‑to‑completion (TTC) and accuracy performance were measured. Post-condition NASA‑TLX and SUS captured perceived cognitive load and system usability.
Analysis. We ran one‑tailed within‑subjects t‑tests for TTC, TLX, and SUS with Holm–Bonferroni correction; accuracy was modeled via logistic regression (participant as random effect); Cohen’s dz reported.
Results. XR demonstrated faster TTC (M = 11.90 s) than tablet (M = 20.42 s; Holm‑corrected p = .0129; dz = .56) and lower cognitive load (TLX) (14.6 vs. 18.92; Holm‑corrected p = .026; dz = .46). Accuracy (.76 vs .77) and usability (SUS) (83.9 vs. 80.2) did not differ significantly across conditions.
Conclusion. Immersive review of scholarly 3D assets shows promise as a tool for supporting 3D data curation workflows. Using the XR platform was found to reduce time and perceived effort for 3D creators on QC tasks without impacting accuracy or usability.
References
Acevedo, D., Vote, E., Laidlaw, D. H., & Joukowsky, M. S. (2001). Archaeological data visualization in VR: Analysis of lamp finds at the Great Temple of Petra, a case study. Proceedings Visualization. VIS'01., 493-597. https://doi.org/10.1109/VISUAL.2001.964560
Alliez, P., Bergerot, L., Bernard, J. F., Boust, C., Bruseker, G., Carboni, N., Chayani, M., Dellepiane, M., Dell’unto, N., Dutailly, B. and Gautier, H., Guidi, G., Guillem, A., Joffres, A., Laroche, F., Manuel, A., Manzetti, M. C., Michel, A. P., Pamart, A., … Tournon-Valiente, S. (2017). Digital 3D objects in art and humanities: Challenges of creation, interoperability and preservation. White Paper, 71 [Report, European Commission ; Horizon H2020 Projects]. https://inria.hal.science/hal-01526713
Amar, R., Eagan, J., & Stasko, J. (2005). Low-level components of analytic activity in information visualization. IEEE Symposium on Information Visualization, INFOVIS 2005, 111-117. https://doi.org/10.1109/INFOVIS.2005
Andersen, S. A. W., Mikkelsen, P. T., Konge, L., Cayé-Thomasen, P., & Sørensen, M. S. (2016). Cognitive load in mastoidectomy skills training: Virtual reality simulation and traditional dissection compared. Journal of Surgical Education, 73(1), 45-50. https://doi.org/10.1016/j.jsurg.2015.09.010
Andrews, C., Endert, A., & North, C. (2010). Space to think: Large high-resolution displays for sensemaking. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 55–64. https://doi.org/10.1145/1753326.1753336
Ayres, P., Lee, J.Y., Paas, F., & Van Merrienboer, J.J.G. (2021). The validity of physiological measures to identify differences in intrinsic cognitive load. Frontiers in Psychology, 12. https://doi.org/10.3389/fpsyg.2021.702538
Bangor, A., Kortum, P.T., & Miller, J.T. (2008). An empirical evaluation of the System Usability Scale. International Journal of Human‑Computer Interaction, 24(6), 574–594. https://doi.org/10.1080/10447310802205776
Batch, A., Cunningham, A., Cordeil, M., Elmqvist, N., Dwyer, T., Thomas, B. H., & Marriott, K. (2019). There is no spoon: Evaluating performance, space use, and presence with expert domain users in immersive analytics. IEEE Transactions on Visualization and Computer Graphics, 26(1), 536-546. https://doi.org/10.1109/TVCG.2019.2934803
Berger, M., Tagliasacchi, A., Seversky, L. M., Alliez, P., Guennebaud, G., Levine, J. A., Sharf, A., & Silva, C. T. (2017). A survey of surface reconstruction from point clouds. Computer Graphics Forum, 36(1), 301-329. https://doi.org/10.1111/cgf.12802
Biener, V., Kalamkar, S., Nouri, N., Ofek, E., Pahud, M., Dudley, J. J., Hu, J., Kristensson, P. O., Weerasinghe, M., Pucihar, K. Č., & Kljun, M. (2022). Quantifying the effects of working in VR for one week. IEEE Transactions on Visualization and Computer Graphics, 28(11), 3810-3820. https://doi.org/10.1109/TVCG.2022.3203103
Blackburn, D. C., Boyer, D. M., Gray, J. A., Winchester, J., Bates, J. M., Baumgart, S. L., Braker, E., Coldren, D., Conway, K. W., Rabosky, A. D., de la Sancha, N., Dillman, C. B., Dunnum, J. L., Early, C. M., Frable, B. W., Gage, M. W., Hanken, J., Maisano, J. A., Marks, B. D., … Stanley, E. L. (2024). Increasing the impact of vertebrate scientific collections through 3D imaging: The openVertebrate (oVert) Thematic Collections Network. BioScience, 74(3), 169-186. https://doi.org/10.1093/biosci/biad120
Bowman, D. A., & McMahan, R. P. (2007). Virtual reality: How much immersion is enough? Computer, 40(7), 36–43. https://doi.org/10.1109/MC.2007.257
Boyer, D. M., Gunnell, G. F., Kaufman, S., & McGeary, T. M. (2016). Morphosource: Archiving and sharing 3-D digital specimen data. The Paleontological Society Papers, 22, 157-181. doi:10.1017/scs.2017.13
Boyer, D. M. (2016, February 25). Virtual fossils revolutionize the study of human evolution. Aeon. https://aeon.co/ideas/virtual-fossils-revolutionise-the-study-of-human-evolution (Archived by the Internet Archive at https://web/20250915001832/https://aeon.co/ideas/virtual-fossils-revolutionise-the-study-of-human-evolution
Brooke, J. (1996). SUS: A “quick and dirty” usability scale. In P. Jordan, B. Thomas, & B. Weerdmeester (Eds.), Usability evaluation in industry (pp. 189–194). London, UK: Taylor & Francis.
Buckland, M. K. (1991). Information as thing. Journal of the American Society for Information Science, 42(5), 351-360. https://doi.org/10.1002/(SICI)1097-4571(199106)42:5<351::AID-ASI5>3.0.CO;2-3
Cook, M. (2024). The lifecycle of 3D data in academic libraries: A survey of methods and implications for information professionals. The Journal of Academic Librarianship, 50(5), 102933. https://doi.org/10.1016/j.acalib.2024.102933
Cook, M., & Lischer-Katz, Z. (2019). Integrating 3D and virtual reality into research and pedagogy in higher education. In K.J. Varnum (Ed.), Beyond reality: Augmented, virtual, and mixed reality in the library (pp. 69-85). ALA Editions.
Cook, M., Lischer-Katz, Z., Hall, N., Hardesty, J., Johnson, J., McDonald, R., & Carlisle, T. (2019). Challenges and strategies for educational virtual reality. Information Technology and Libraries, 38(4), 25-48. https://doi.org/10.6017/ital.v38i4.11075
Creswell J.W. (2014). Research design: Qualitative, quantitative, and mixed methods approaches. Los Angeles: Sage Publications.
Cutting, J. E., & Vishton, P. M. (1995). Perceiving layout and knowing distances: The integration, relative potency, and contextual use of different information about depth. In W. Epstein & S. Rogers (Eds.), Perception of space and motion (pp. 69–117). Academic Press. https://doi.org/10.1016/B978-012240530-3/50005-5
Dede, C. J., Jacobson, J., & Richards, J. (2017). Introduction: Virtual, augmented, and mixed realities in education. In Virtual, augmented, and mixed realities in education (pp. 1-16). Springer, Singapore.
Denard, H. (2012). A new introduction to the London Charter. In A. Bentkowska‑Kafel, D. Baker, & H. Denard (Eds.), Paradata and transparency in virtual heritage (pp. 57–71). Routledge. https://www.london-charter.org/media/files/ch6_denard.pdf (Archived by the Internet Archive at https://web.archive.org/web/20250915011142/https://www.london-charter.org/media/files/ch6_denard.pdf)
Donalek, C., Djorgovski, S. G., Cioc, A., Wang, A., Zhang, J., Lawler, E., Yeh, S., Mahabal, A., Graham, M., Drake, A., & Davidoff, S. (2014). Immersive and collaborative data visualization using virtual reality platforms. In Proceedings of 2014 IEEE International conference on big data (pp. 609-614). IEEE. https://doi.org/10.1109/BigData.2014.7004282
European Commission: Directorate-General for Communications Networks, Content and Technology. (2022). Study on quality in 3D digitisation of tangible cultural heritage: mapping parameters, formats, standards, benchmarks, methodologies, and guidelines: executive summary. Publications Office of the European Union. https://data.europa.eu/doi/10.2759/581678
Forsberg, A., Katzourin, M., Wharton, K., & Slater, M. (2008). A comparative study of desktop, fishtank, and cave systems for the exploration of volume rendered confocal data sets. IEEE Transactions on Visualization and Computer Graphics, 14(3), 551-563. https://doi.org/10.1109/tvcg.2007.70433
Foster, E. D. & Deardorff, A. (2017). Open science framework (OSF). Journal of the Medical Library Association, 105(2), 203. https://doi.org/10.5195/jmla.2017.88
Giacalone, G., Yamamoto, T., Belva, F., Hayashi, A., Dori, Y., Zviman, M. M., Gysen, M., Nam, H. H., Jolley, M. A., & Kato, M. (2019). The application of virtual reality for preoperative planning of lymphovenous anastomosis in a patient with a complex lymphatic malformation. Journal of Clinical Medicine, 8(3), 371. https://doi.org/10.3390/jcm8030371
Gibson, J.J. (2002). A theory of direct visual perception. In A. Noë & E. Thompson (Eds.), Vision and Mind: Selected Readings in the Philosophy of Perception (pp. 77–90). MIT Press. https://doi.org/10.7551/mitpress/7111.003.0007
Grayburn, J., Lischer-Katz, Z., Golubiewski-Davis, K., & Ikeshoji-Orlati, V. (2019). 3D/VR in the academic library: Emerging practices and trends. Council on Library and Information Resources. https://www.clir.org/wp-content/uploads/sites/6/2019/02/Pub-176.pdf (Archived by the Internet Archive at https://web.archive.org/save/https://www.clir.org/wp-content/uploads/sites/6/2019/02/Pub-176.pdf
Greene, D., & Groenendyk, M. (2021). An environmental scan of virtual and augmented reality services in academic libraries. Library Hi Tech, 39(1), 37-47. https://doi.org/10.1108/LHT-08-2019-0166
Hall, N., Hardesty, J., Lischer-Katz, Z., Cook, M., Xie, Z., Hardesty, J., Johnson, J., Ogier, A., & McDonald, R. (2019) Challenges and directions in 3D and VR data curation: Findings from a nominal group study. International Journal of Digital Curation, 14(1), 150-167. https://doi.org/10.2218/ijdc.v14i1.588
Harada, Y., & Ohyama, J. (2020). Evaluations of visual guidance effects for 360-degree directions around users: VR experimental psychology. Proceedings of the Annual Convention of the Japanese Psychological Association, Bunkyō, Japan, 84, PQ-019. https://doi.org/10.4992/pacjpa.84.0_PQ-019
Hardesty, J. L., Johnson, J., Wittenberg, J., Hall, N., Cook, M., Lischer-Katz, Z., Xie, Z., & McDonald, R. (2020). 3D Data repository features, best practices, and implications for preservation models: Findings from a national forum. College & Research Libraries, 81(5), 789. https://doi.org/10.5860/crl.81.5.789
Hart, S.G. (2006). NASA-Task Load Index (NASA-TLX); 20 Years Later. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 50(9), 904–908. https://doi.org/10.1177/154193120605000909
Hawks, C. A., & Williams, S. L. (1986). Arsenic in natural history collections. Leather Conservation News, 2(2), 1-4.
Helbig, C., Bauer, H.-S., Rink, K., Wulfmeyer, V., Frank, M., & Kolditz, O. (2014). Concept and workflow for 3D visualization of atmospheric data in a virtual reality environment for analytical approaches. Environmental Earth Sciences 72, 3767–3780. https://doi.org/10.1007/s12665-014-3136-6
Huvila, I. (2022). Improving the usefulness of research data with better paradata. Open Information Science, 6(1), 28-48. https://doi.org/10.1515/opis-2022-0129
Ijiri, T., Todo, H., Hirabayashi, A., Kohiyama, K., & Dobashi, Y. (2018). Digitization of natural objects with micro-CT and photographs. PLOS ONE, 13(4), e0195852. https://doi.org/10.1371/journal.pone.0195852
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Matt Cook, Hannah Hok Kim, Helen He, Zack Lischer-Katz
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
