Push me, pull you: factors that drive information-seekers away from traditional environments and towards LLMs
DOI:
https://doi.org/10.47989/ir31ISIC65235Keywords:
Generative AI, Large language models, information seeking behaviourAbstract
Introduction. We report an investigation into the use of generative AI large language model (LLM) tools by information seekers. We elicit the reasons for their use of LLMs in preference to established tools such as social media, interactive search, and libraries.
Method. A mixture of critical-incident retrospective interviews and live observations were used to capture data. The observations were recorded via Zoom, and all sessions were audio-recorded. Transcripts of the interviews and records of the LLM prompts used were all included in the analysis.
Analysis. Thematic analysis was undertaken on the transcript and LLM prompt data. Analysis was done manually, following an iterative process.
Results. Respondent’s preferences for when to use LLMs reflected a range of push factors driving them away from traditional environments, and a set of pull factors drawing them to LLMs. This pattern reflects previous research on migrations.
Conclusions. Information seekers are drawn to the potentially personalised and easy-to-access outputs of LLMs such as ChatGPT, and by the bias and difficulty of use that they ascribe to search engines and social media.
References
Beall, S., Makri, S., & McKay, D. (2023). Stronger than yesterday: Investigating peoples' experiences of view strengthening on social media. Proceedings of the Association for Information Science and Technology, 60(1), 41-52. https://doi.org/10.1002/pra2.767
Bogue, D. J. (1969). Principles of demography. Wiley.
Bruns, A. (2019). Are filter bubbles real? John Wiley & Sons.
Buchanan, G., Farrant, S., Jones, M., Thimbleby, H., Marsden, G., & Pazzani, M. (2001). Improving mobile internet usability. Tenth International World Wide Web Conference, Hong Kong, Hong Kong.
Chowdhury, G., & Chowdhury, S. (in press). AI- and LLM-driven search tools: A paradigm shift in information access for education and research. Journal of Information Science. https://doi.org/10.1177/01655515241284046
Cialdini, R. B., & Goldstein, N. J. (2004). Social influence: Compliance and conformity. Annual Review of Psychology, 55(Volume 55, 2004), 591-621. https://doi.org/https://doi.org/10.1146/annurev.psych.55.090902.142015
Cui, Y., & Roto, V. (2008). How people use the web on mobile devices. Proceedings of the 17th international conference on World Wide Web, Beijing, China. https://doi.org/10.1145/1367497.1367619
Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 319-340.
Ekström, A. G., Madison, G., Olsson, E. J., & Tsapos, M. (2024). The search query filter bubble: Effect of user ideology on political leaning of search results through query selection. Information, Communication & Society, 27(5), 878-894. https://doi.org/10.1080/1369118X.2023.2230242
Flanagan, J. C. (1954). The critical incident technique. Psychological Bulletin, 51, 327-358. https://doi.org/10.1037/h0061470
Hearst, M. A. (2009). Search User Interfaces. Cambridge University Press.
Hertzum, M., & Frøkjær, E. (1996). Browsing and querying in online documentation: A study of user interfaces and the interaction process. ACM Transactions on Computer-Human Interaction., 3(2), 136–161. https://doi.org/10.1145/230562.230570
Jones, M., Buchanan, G., & Thimbleby, H. (2003). Improving web search on small screen devices. Interacting with Computers, 15(4), 479-495.
Jones, M., Buchanan, G., & Thimbleby, H. W. (2002). Sorting out searching on small screen devices. Fourth International Symposium on Mobile Human-Computer Interaction, Pisa, Italy.
Jones, M., Marsden, G., Mohd-Nasir, N., Boone, K., & Buchanan, G. (1999). Improving Web interaction on small displays. Computer Networks, 31(11-16), 1129-1137. https://doi.org/10.1016/s1389-1286(99)00013-4
Kim, K.-S., Sin, S.-C. J., & Tsai, T.-I. (2014). Individual differences in social media use for information seeking. The Journal of Academic Librarianship, 40(2), 171-178. https://doi.org/10.1016/j.acalib.2014.03.001
Malmqvist, L. (2025). Sycophancy in large language models: Causes and mitigations. In Intelligent Computing-Proceedings of the Computing Conference (pp. 61-74). Cham: Springer Nature Switzerland. https://arxiv.org/pdf/2411.15287?
Marchionini, G. (1995). Information seeking in electronic environments. Cambridge University Press.
McKay, D., & Buchanan, G. (2013). Boxing clever: How searchers use and adapt to a one-box library search. Proceedings of the 25th Australian Computer-Human Interaction Conference: Augmentation, Application, Innovation, Collaboration, Adelaide, Australia.
McKay, D., Makri, S., Gutierrez-Lopez, M., MacFarlane, A., Missaoui, S., Porlezza, C., & Cooper, G. (2020). We are the change that we seek: Information interactions during a change of viewpoint. Proceedings of the 2020 Conference on Human Information Interaction and Retrieval, 173-182. https://doi.org/10.1145/3343413.3377975
McKay, D., Makri, S., Gutierrez-Lopez, M., Porlezza, C., Macfarlane, A., Cooper, G., & Missaoui, S. (2024). I'm the same, I'm the same, I'm trying to change: Investigating the role of human information behavior in view change. Journal of the Association for Information Science and Technology, 75(7), 844-858. https://doi.org/https://doi.org/10.1002/asi.24885
Molem, A., Makri, S., & McKay, D. (2024). Keepin' it reel: Investigating how short videos on TikTok and Instagram reels influence view change. ACM SIGIR Conference on Human Information Interaction and Retrieval, 317-327. https://doi.org/10.1145/3627508.3638341
Moon, B. (1995). Paradigms in migration research: Exploring 'moorings' as a schema. Progress in Human Geography, 19(4), 504-524. https://doi.org/10.1177/030913259501900404
Nielsen, R. K., & Schrøder, K. C. (2014). The relative importance of social media for accessing, finding, and engaging with news. Digital Journalism, 2(4), 472-489. https://doi.org/10.1080/21670811.2013.872420
Pirolli, P. (1997). Computational models of information scent-following in a very large browsable text collection. ACM SIGCHI Conference on Human Factors in Computing Systems, 3-10. https://doi.org/10.1145/258549.258558
Ross Arguedas, A., Robertson, C., Fletcher, R., & Nielsen, R. (2022). Echo chambers, filter bubbles, and polarisation: A literature review. Reuters Institute for the Study of Journalism. https://ora.ox.ac.uk/objects/uuid:6e357e97-7b16-450a-a827-a92c93729a08/files/rzw12z639q
Savolainen, R. (1999). The role of the internet in information seeking: Putting the networked services in context. Information Processing & Management, 35(6), 765-782. https://doi.org/https://doi.org/10.1016/S0306-4573(99)00025-4
Tauscher, L., & Greenberg, S. (1997). How people revisit web pages: Empirical findings and implications for the design of history systems. International Journal of Human-Computer Studies, 47(1), 97-137. https://doi.org/https://doi.org/10.1006/ijhc.1997.0125
Topi, H., & Lucas, W. (2005). Searching the Web: Operator assistance required. Information Processing & Management, 41(2), 383-403. https://doi.org/http://dx.doi.org/10.1016/S0306-4573(02)00092-4
Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003). User acceptance of information technology: Toward a unified view. MIS Quarterly, 425-478.
Weeks, B. E., Ksiazek, T. B., & Holbert, R. L. (2016). Partisan enclaves or shared media experiences? A network approach to understanding citizens’ political news environments. Journal of Broadcasting & Electronic Media, 60(2), 248-268. https://doi.org/10.1080/08838151.2016.1164170
Zhou, T., & Li, S. (in press). Understanding user switch of information seeking: From search engines to generative AI. Journal of Librarianship and Information Science, 09610006241244800. https://doi.org/10.1177/09610006241244800
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Priti Shah, Stephann Makri, George Buchanan, Dana McKay
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
