Exploring search behaviour across expertise levels: Graphical vs. form-based interfaces
DOI:
https://doi.org/10.47989/ir31146729Keywords:
search systems, Information Retrieval, Query analysis, Graphical interfacesAbstract
Introduction. This study explores how graphical and form-based search interfaces influence query reformulation strategies and search performance across two user cohorts: search professionals and master’s students.
Method. Using a lab-based user study, participants completed controlled search tasks within the digital health domain, with their interactions analysed in terms of query construction, reformulation tactics, and alignment with expert-crafted gold standard queries.
Results. Results reveal distinct patterns between the cohorts, with professionals demonstrating greater precision and efficiency, particularly when using the form-based interface, while students engaged more extensively with the graphical interface, performing more frequent and substantial reformulations. Specification (SPE) and generalisation (GEN) emerged as the most common reformulation strategies, with the graphical interface encouraging broader exploration but also leading to higher occurrences of inappropriate keyword use, particularly among students. Query quality, measured by precision, recall, and F-measure, showed that while form-based systems yielded higher precision, graphical interfaces achieved better recall, offering a balanced trade-off between these metrics.
Conclusions. The findings highlight the importance of tailoring search interfaces to meet the needs of different user groups and suggest opportunities for adaptive interface designs that combine the strengths of both systems. Future research should investigate the role of user intentions in query reformulation and the potential for interfaces to provide context-sensitive support.
References
Boldi, P., Bonchi, F., Castillo, C., & Vigna, S. (2011). Query reformulation mining: Models, patterns, and applications. Information Retrieval, 14(3), 257–289. https://doi.org/10.1007/s10791-010-9155-3
Dahlen, S. P. C., & Hanson, K. (2023). In their words: Student reflections on information-seeking behaviors. The Journal of Academic Librarianship, 49(4), 102713. https://doi.org/10.1016/j.acalib.2023.102713
Dempsey, M., & Valenti, A. M. (2016). Student use of keywords and limiters in Web-scale discovery searching. The Journal of Academic Librarianship, 42(3), 200–206. https://doi.org/10.1016/j.acalib.2016.03.002
Elbedweihy, K., Wrigley, S. N., & Ciravegna, F. (2012). Evaluating semantic search query approaches with expert and casual users. in The Semantic Web: ISWC 2012 (Lecture Notes in Computer Science, vol. 7650; pp. 274–286). Springer. https://doi.org/10.1007/978-3-642-35173-0_18
He, J., Bron, M., & de Vries, A. P. (2013). Characterizing stages of a multi-session complex search task through direct and indirect query modifications. In Proceedings of the 36th International ACM SIGIR Conference on Research and Development in Information Retrieval, 897–900. New York, NY, USA: ACM. https://doi.org/10.1145/2484028.2484178
Hu, R., Lu, K., & Joo, S. (2013). Effects of topic familiarity and search skills on query reformulation behavior. Proceedings of the American Society for Information Science and Technology, 50(1), 1–9. https://doi.org/10.1002/meet.14505001062
Jansen, B. J., Booth, D. L., & Spink, A. (2009). Patterns of query reformulation during Web searching. Journal of the American Society for Information Science and Technology, 60(7), 1358–1371. https://doi.org/10.1002/asi.21071
Jansen, B. J., Spink, A., & Pedersen, J. (2005). A temporal comparison of AltaVista Web searching. Journal of the American Society for Information Science and Technology, 56(6), 559–570. https://doi.org/10.1002/asi.20145
Kelly, D. (2009). Methods for evaluating interactive information retrieval systems with users. Foundations and Trends in Information Retrieval, 3(1—2), 1–224. https://doi.org/10.1561/1500000012
Liu, Y.-H., & Wacholder, N. (2017). Evaluating the impact of MeSH (Medical Subject Headings) terms on different types of searchers. Information Processing & Management, 53(4), 851–870. https://doi.org/10.1016/j.ipm.2017.03.004
Lu, K., Joo, S., Lee, T., & Hu, R. (2017). Factors that influence query reformulations and search performance in health information retrieval: A multilevel modeling approach. Journal of the Association for Information Science and Technology, 68(8), 1886–1898.
https://doi.org/10.1002/asi.23872
Marchionini, G. (2006). Exploratory search. Communications of the ACM, 49(4), 41–46. https://doi.org/10.1145/1121949.1121979
Okhovati, M., Sharifpoor, E., Aazami, M., Zolala, F., & Hamzehzadeh, M. (2016). Novice and experienced users’ search performance and satisfaction with Web of Science and Scopus. Journal of Librarianship and Information Science, 49(4), 359–367. https://doi.org/10.1177/0961000616656234
Osborne, H. M., & Cox, A. (2015). An investigation into the perceptions of academic librarians and students towards next-generation OPACs and their features. Program, 49(1), 23–45. https://doi.org/10.1108/PROG-10-2013-0055
Rha, E. Y., Shi, W. & Belkin, N. (2017). An exploration of reasons for query reformulations. Proceedings of the Association for Information Science and Technology, 54(1), 337-346. https://doi-org/10.1002/pra2.2017.14505401037
Rieh, S. Y., & Xie, H. (Iris). (2006). Analysis of multiple query reformulations on the Web: The interactive information retrieval context. Information Processing & Management, 42(3), 751–768. https://doi.org/10.1016/j.ipm.2005.05.005
Ruotsalo, T., Jacucci, G. & Kaski, S. (2020). Interactive faceted query suggestion for exploratory search: Whole-session effectiveness and interaction engagement. Journal of the Association for Information Science and Technology, 71(7), 742-756. https://doi-org/10.1002/asi.24304
Russell-Rose, T. & MacFarlane, A. (2020). Towards explainability in professional search. In Proceedings of the 3rd International Workshop on Explainable Recommendation and Search (EARS 2020), Xi’an, China. https://research.gold.ac.uk/id/eprint/29134/
Russell-Rose, T. & Shokraneh, F. (2020). Designing the structured search experience: Rethinking the query-builder paradigm. Weave: Journal of Library User Experience, 3(1). https://doi.org/10.3998/weave.12535642.0003.102
Svarre, T. & Russell-Rose, T. (2024). An evaluation of a visual interface for supporting query formulation in scholarly searching. Journal of Librarianship and Information Science. https://doi-org/10.1177/09610006241291603
Svarre, T. & Russell-Rose, T. (2025). Think outside the search box: A comparative study of visual and form-based query builders. Journal of Information Science, 51(2), 354-367. https://doi-org/10.1177/01655515221138536
Tibau, M., Siqueira, S. W. M., Nunes, B. P., Nurmikko-Fuller, T., & Manrique, R. F. (2019). Using query reformulation to compare learning behaviors in Web search engines. Proceedings of the IEEE 19th International Conference on Advanced Learning Technologies (ICALT) (pp. 219-223). https://doi.org/10.1109/ICALT.2019.00054
Wu, D. & Bi, R. (2017). Impact of device on search pattern transitions: A comparative study based on large-scale library OPAC log data. The Electronic Library, 35(4), 650-666. https://doi-org/10.1108/EL-10-2016-0239
Yoo, I., & Mosa, A. S. M. (2015). Analysis of PubMed user sessions using a full-day PubMed query log: A comparison of experienced and nonexperienced PubMed users. JMIR Medical Informatics, 3(3), e25. https://doi.org/10.2196/medinform.3740
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Tony Russell-Rose, Tanja Svarre
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
