<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.0 20120330//EN" "http://jats.nlm.nih.gov/publishing/1.0/JATS-journalpublishing1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" article-type="research-article" xml:lang="en">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">IR</journal-id>
<journal-title-group>
<journal-title>Information Research</journal-title>
</journal-title-group>
<issn pub-type="epub">1368-1613</issn>
<publisher>
<publisher-name>University of Bor&#x00E5;s</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">ir30357871</article-id>
<article-id pub-id-type="doi">10.47989/ir30357871</article-id>
<article-categories>
<subj-group xml:lang="en">
<subject>Research article</subject>
</subj-group>
</article-categories>
<title-group>
<article-title>From lockdown to limelight: unexpected gains in information seeking and scholarly communication research</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author"><name><surname>Deja</surname><given-names>Marek</given-names></name>
<xref ref-type="aff" rid="aff0001"/></contrib>
<aff id="aff0001"><bold>Marek Deja</bold> is an Assistant Professor at the Institute of Information Studies, Faculty of Management and Social Communication, Jagiellonian University. His research interests include academic information cultures, digital literacy, information management in higher education, and scientometrics. He can be contacted at <email xlink:href="marek.deja@uj.edu.pl">marek.deja@uj.edu.pl</email>.</aff>
</contrib-group>
<pub-date pub-type="epub"><day>25</day><month>10</month><year>2025</year></pub-date>
<pub-date pub-type="collection"><year>2025</year></pub-date>
<volume>30</volume>
<issue>3</issue>
<fpage>390</fpage>
<lpage>406</lpage>
<permissions>
<copyright-year>2025</copyright-year>
<copyright-holder>&#x00A9; 2025 The Author(s).</copyright-holder>
<license license-type="open-access" xlink:href="https://creativecommons.org/licenses/by-nc/4.0/">
<license-p>This is an Open Access article distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (<ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/licenses/by-nc/4.0/">http://creativecommons.org/licenses/by-nc/4.0/</ext-link>), permitting all non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
</license>
</permissions>
<abstract xml:lang="en">
<title>Abstract</title>
<p><bold>Introduction.</bold> This study investigates the impact of COVID-19 on the impact of research in information seeking and scholarly communication.</p>
<p><bold>Method.</bold> An analysis of bibliometric data was performed focusing on publications related to information seeking and scholarly communication, using the SciVal tool to extract documents related to the topic cluster published from 2015 to 2022. To establish causality, the C-ARIMA model was applied to allow a comparison between actual post-pandemic research metrics and counterfactual predictions.</p>
<p><bold>Analysis.</bold> Analysing key metrics such as the Field-weighted citation impact (FWCI), the study sought to quantify the causal relationship between the pandemic and changes in research output, while accounting for prior trends and seasonal publishing cycles.</p>
<p><bold>Results</bold>. The results showed a significant increase in FWCI after the pandemic. This growth was not a random event; the model also demonstrated that this was a time-dependent outcome of the pandemic&#x2019;s influence on research impact.</p>
<p><bold>Conclusion(s).</bold> The pandemic provided a substantial boost to the impact of research related to information seeking and scholarly communication. This may be largely driven by an increased need for accessible information, marking a significant shift in academic priorities after the global crisis.</p>
</abstract>
</article-meta>
</front>
<body>
<sec id="sec1">
<title>Introduction</title>
<p>The COVID-19 pandemic, while overwhelmingly negative in its impact on society, did highlight certain shifts, particularly in how we engage with digital environments (<xref ref-type="bibr" rid="R56">Shen et al., 2022</xref>). The accelerated digitisation of work and life processes stands out as one of the most pronounced changes, impacting both scholars and students (<xref ref-type="bibr" rid="R16">Fern&#x00E1;ndez et al., 2023</xref>; <xref ref-type="bibr" rid="R60">Trevisan et al., 2024</xref>), although often with mixed results regarding mental and emotional wellbeing (<xref ref-type="bibr" rid="R39">Newson et al., 2024</xref>). Research into human information behaviour has shed light on how these pandemic-induced shifts alter the ways individuals seek and process information, as the need for reliable information becomes critical during crises (<xref ref-type="bibr" rid="R37">Montesi, 2021</xref>). The increase in the health information seeking reflects this, especially as it pertains to adjustments in daily life and physical health concerns during the pandemic (<xref ref-type="bibr" rid="R28">Kelly &#x0026; Sharot, 2021</xref>; <xref ref-type="bibr" rid="R40">Ni et al., 2024</xref>). However, while seeking health information naturally aligns with pandemic-driven needs related to everyday life or physical condition (<xref ref-type="bibr" rid="R28">Kelly &#x0026; Sharot, 2021</xref>), it is not only health -related information that has changed focus. The growing reliance on digital platforms for academic communication and scholarly discourse has also become a prominent post-pandemic theme, with deeper implications for how we approach the dissemination and sharing of knowledge. The literature points to a significant increase in the importance of scholarly communication practices, particularly those that intersect with open access, open science, and other models of academic openness (<xref ref-type="bibr" rid="R18">Frank et al., 2023</xref>; <xref ref-type="bibr" rid="R52">Rowley, 2023</xref>; <xref ref-type="bibr" rid="R55">Seguya et al., 2023</xref>). The processes of information seeking is evolving with the academic community as issues around predatory publishing (<xref ref-type="bibr" rid="R13">Downes, 2023</xref>; <xref ref-type="bibr" rid="R41">Oermann et al., 2023</xref>), open science (<xref ref-type="bibr" rid="R6">Chakravorty et al., 2022</xref>; <xref ref-type="bibr" rid="R42">Okafor et al., 2022</xref>; <xref ref-type="bibr" rid="R51">Ross-Hellauer et al., 2022</xref>), open data initiatives (<xref ref-type="bibr" rid="R47">Prince, 2023</xref>), and the use of open educational resources (<xref ref-type="bibr" rid="R58">Sousa et al., 2023</xref>; <xref ref-type="bibr" rid="R59">Tlili et al., 2023</xref>) gain prominence.. Switching to open communication models is closely tied to the use of digital resources, the influences driving academic productivity, and broader transformations in higher education, management, and library and information science (<xref ref-type="bibr" rid="R17">Fitzgerald, 2020</xref>; <xref ref-type="bibr" rid="R32">Ma, 2023</xref>). This expanding focus on digital scholarly communication promises to shape the future of information seeking research, especially in the light of ongoing digital transformation across various academic disciplines.</p>
<p>However, it remains uncertain whether the COVID-19 pandemic and its restrictions had a causal effect on the observed rise of information seeking and scholarly communication as research topics, especially in terms of how the digital shifts arising from lockdowns might have influenced impact metrics. This paper seeks to provide empirical evidence supporting the idea that these research topics gained greater scientific prominence across various fields in the post-pandemic era. To address this uncertainty, it is essential to establish the causal role of the pandemic in amplifying the impact of research on these topics. This study proposes to illustrate this through a bibliometric analysis, employing a novel causal inference framework with the C-ARIMA model (<xref ref-type="bibr" rid="R35">Menchetti et al., 2023</xref>) to establish genuine causation, rather than association, based on bibliometric data drawn from the Scopus database.</p>
</sec>
<sec id="sec2">
<title>Literature review</title>
<p>The COVID-19 pandemic reshaped academic research, creating a complex landscape for academic work. As university buildings closed and researchers transitioned to remote work, a dichotomy emerged in academic publishing. <xref ref-type="bibr" rid="R30">Lee and Haupt (2021)</xref> documented a global influx of COVID-19 publications, reflecting the rapid mobilisation of the scientific community. However, <xref ref-type="bibr" rid="R48">P&#x00FC;ttmann and Thomsen (2024)</xref> revealed a simultaneous decline in non-COVID-related research output. However, this was a global trend that did not capture fluctuations in a specific field or research topic.</p>
<p>The review by <xref ref-type="bibr" rid="R24">Huvila and Gorichanaz (2024)</xref> partially supports the assumption of this paper: Information seeking has a strong position in information science studies after pandemics. Searching for health information leads to the importance of the topic. The short-and long-term effects of the pandemic on information seeking were analysed, indicating that information seeking should present a positive trend in field-specific importance (<xref ref-type="bibr" rid="R24">Huvila &#x0026; Gorichanaz, 2024</xref>). <xref ref-type="bibr" rid="R63">Wilson (2018)</xref> presented a similar assumption regarding the diffusion of information seeking behaviour research beyond library and information science just a few years before the global crisis related to the pandemic.</p>
<p>The impact of the pandemic on academic productivity varied. Some researchers found unexpected writing time during lockdowns, while others struggled with remote work constraints. <xref ref-type="bibr" rid="R27">Jackman et al. (2022)</xref> found that some UK doctoral students and early career researchers reported increased productivity and improved work-life balance. However, widespread disruptions to research activities were observed, particularly in laboratory-dependent disciplines, causing long term problems related to fewer submissions and low quality published articles (<xref ref-type="bibr" rid="R64">Yang &#x0026; Li, 2024</xref>). While we can presume that some topics related to information seeking might emerge and gain importance, there is a separate trend to such research output related to temporal decrease of academic productivity, which varies field-to-field.</p>
<p>Lowering the quantity of output does not necessarily indicate a decrease in the impact of research or the direction of further research, its pure quality, or a lesser importance of publications in some field or topics. <xref ref-type="bibr" rid="R38">Myers et al. (2020)</xref> found that scientists in experimental disciplines experienced severe declines in research time, with reductions of 30-40&#x0025; below pre-pandemic levels, but fields less dependent on physical infrastructure reported minimal disruptions, underscoring the pandemic&#x2019;s uneven impact on academia. <xref ref-type="bibr" rid="R10">Cui, Ding and Zhu (2022)</xref> also showed fluctuations in preprints published in different fields. Education saw an increase in scholarly output during the pandemic, while fields such as anthropology, cognitive sciences, and information systems showed a decline.</p>
<p>Another transformation lies in the disruption of international research collaborations. <xref ref-type="bibr" rid="R20">Gao et al. (2021)</xref> observed a significant decrease in new co-authorships of non-COVID-19 papers in 2020, suggesting a contraction of global scientific networks. However, in early 2021, scientists exhibited fewer declines in number of collaborations compared to the pre-pandemic state and observed a smaller workload, indicating time-related combat to work-life normality (<xref ref-type="bibr" rid="R20">Gao et al., 2021</xref>).</p>
<p>Although Library and Information Science (LIS) students, researchers, and library professionals experienced some initial barriers related to remote communication (<xref ref-type="bibr" rid="R3">Begum &#x0026; Habiba, 2023</xref>; <xref ref-type="bibr" rid="R12">de Wit &#x0026; Altbach, 2023</xref>), there is no indication that the quality of research in field-specific topics, such as information seeking or scholarly communication, was significantly affected. Moreover, the evolving role of digital forms of scholarly communication, like the popularisation of preprints (<xref ref-type="bibr" rid="R19">Fraser et al., 2021</xref>), dealing with misinformation, is also closely aligned to predatory publishing (<xref ref-type="bibr" rid="R43">Otike et al., 2022</xref>), and the emerging importance of information seeking (<xref ref-type="bibr" rid="R24">Huvila &#x0026; Gorichanaz, 2024</xref>), support the initial assumption that these processes has gained significant relevance as research topic and might gain impact across many fields of science.</p>
<p>While the pandemic&#x2019;s immediate shocks in academia are documented, the aftermath that emerged during the subsequent period of stabilization remain under-examined. This study aims to verify whether pandemic-related restrictions and the digitization of academic work exerted a causal influence on the growing prominence of research in information seeking and scholarly communication. These topics are situated within the context of Library and Information Science (LIS), and their impact is measured by the cross-disciplinary and field-normalized citation metric. Classical statistical inference alone is insufficient for capturing the complexities of this problem, as it primarily addresses correlations without fully exploring counterfactual scenarios (<xref ref-type="bibr" rid="R45">Pearl, 2010</xref>). Instead, a framework grounded in causal inference is necessary, one that surpasses simple association-based reasoning and traditional experimental designs. To investigate how pandemic-induced restrictions shaped information seeking research, a causal inference approach is employed to transcend these limitations. Causal learning integrates methodologies from causal inference and machine learning, extending beyond correlation-based approaches by incorporating intervention-based modelling (<xref ref-type="bibr" rid="R7">Cheng et al., 2022</xref>). Unlike standard machine learning, which primarily seeks predictive accuracy, causal learning emphasizes estimating intervention effects and modelling distributional shifts using both statistical assumptions and data-driven learning.</p>
<p>Causal autoregressive integrated moving average (Causal ARIMA), as applied in this study, exemplifies this causal inference approach. While ARIMA is traditionally a statistical forecasting method, Causal ARIMA extends it by embedding intervention modelling within the potential outcomes framework, allowing for counterfactual estimation by projecting the pre-intervention trend forward to construct a synthetic non-intervened scenario (<xref ref-type="bibr" rid="R35">Menchetti et al., 2023</xref>; <xref ref-type="bibr" rid="R65">Yao et al., 2021</xref>). Unlike traditional regression-based methods, which assume fixed relationships between variables, causal learning in time series explicitly models dynamic changes in dependencies induced by interventions. This enables counterfactual estimation, such as assessing the absence of the pandemic, while isolating treatment effects and accounting for shifts in publication trends or disciplinary emphasis. As causal inference increasingly integrates representation learning and confounder adjustments, it strengthens time-series causal estimation, mitigating spurious correlations and reinforcing causal learning as a distinct methodological paradigm (<xref ref-type="bibr" rid="R65">Yao et al., 2021</xref>). Counterfactual estimation is critical in this context because it allows to differentiate the true effects of the pandemic on research dissemination from general publication trends, thereby isolating the causal impact of pandemic-related disruptions on scholarly communication.</p>
</sec>
<sec id="sec3">
<title>Methodology</title>
<p>This study uses a causal inference framework to model counterfactual scenarios and estimate the effects of interventions, following the principles of potential outcome theory, also known as the Rubin causal model (<xref ref-type="bibr" rid="R26">Imbens &#x0026; Rubin, 2015</xref>). In this paradigm, our aim is to assess the impact of the COVID-19 pandemic on the outcome of research behaviour captured in bibliometric data related to our research topic, as defined by Scopus in the topic cluster: Information seeking; scholarly communication; adoption&#x2013;TC.905. To do this, the observed post-pandemic data was compared with counterfactual data, using a forecasting ARIMA model to predict paper impact metrics in a scenario where the pandemic did not occur. This process allows us to evaluate the causation through predictive modelling and comparison of real world and counterfactual outcomes (<xref ref-type="bibr" rid="R35">Menchetti et al., 2023</xref>).</p>
<p>In line with the causal nature of most social science research questions (<xref ref-type="bibr" rid="R45">Pearl, 2010</xref>), this study represents a shift from traditional statistical inference to causal reasoning. These new methods aim to uncover the mechanisms behind observed phenomena and address "what if?" questions (<xref ref-type="bibr" rid="R25">Imai, Kim &#x0026; Want, 2023</xref>), such as: &#x2018;What would have happened if COVID-19 restrictions had not occurred?&#x2019; <xref ref-type="bibr" rid="R45">Pearl&#x2019;s (2010)</xref> distinction between associational and causal concepts is key here: while associational concepts are derived from data distributions (e.g., the rise in information seeking publications post-2020), causality requires counterfactual thinking. For example, by comparing pre-pandemic data with machine learning models of bibliometric impact, we explore what impact trends might have been without the pandemic, an approach not possible thirty years ago (<xref ref-type="bibr" rid="R44">Pearl, 2000</xref>). Although other attempts have been made to bring causal inference methods into bibliometric research (for instance, Lars <xref ref-type="bibr" rid="R62">Wenaas (2021)</xref> used Bayesian structural time series to examine the readership effects of journals converting to open access, and, <xref ref-type="bibr" rid="R50">Riccaboni and Verginer (2022)</xref> employed a difference-in-differences model to detect shifts in life science research during the pandemic) the approach presented here advances that effort by focusing on field-normalized impact metrics and broader information seeking and scholarly communication topics.</p>
<sec id="sec3_1">
<title>Data collection</title>
<p>Data for this study were collected in September 2024 using the SciVal tool to extract relevant data from the Scopus database. The query focused on the topic Information seeking; scholarly communication; adoption&#x2013;TC.905, and was filtered for publications between 2015 and 2022. This search resulted in a data set of 13,576 publications, of which 5,682 were journal articles with at least one citation. The most frequent key phrases describing the data set are presented in <xref ref-type="fig" rid="F1">Figure 1</xref>. At the top of the list are open access (2281), related to open access publishing (577), open access journal (501); academic libraries (1466) related to academic library (622), digital libraries (270), library collection (353), open educational resources (1282), journals (850) and electronic resources (452). The next important set of key phrases is related to information seeking (519) with information seeking behaviour (251), information behaviour (583), information needs (413), information science (383), information literacy (267).</p>
<fig id="F1">
<label>Figure 1.</label>
<caption><p>Keywords in topic cluster 905 for publications between 2015 and 2022</p></caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="c17-fig1.jpg"><alt-text>none</alt-text></graphic>
</fig>
<p>The selected chronological frame from 2015 to 2022 is considered appropriate, as it captures publication trends before and after the onset of pandemic-related restrictions in March 2020. March 2020 marks the point of intervention for this study, as the COVID-19 pandemic began to affect mobility and introduced new demands for digital technologies and communication, particularly in higher education (<xref ref-type="bibr" rid="R8">Cohen et al., 2020</xref>; <xref ref-type="bibr" rid="R11">Cullinan et al., 2021</xref>; <xref ref-type="bibr" rid="R53">Ruhm, 2024</xref>), impacting scholarly communication and well-being (<xref ref-type="bibr" rid="R36">Mok, 2022</xref>), and led to substantial global reactions, such as stay-at-home regulations (<xref ref-type="bibr" rid="R1">Alex, 2022</xref>). To accommodate the structure of the C-ARIMA model, which allows for the setting of a specific timeframe to observe causal effects, the horizon for this study was set from June 2021 to February 2022. This period was chosen because it likely reflects the more sustained effects of the pandemic, by which time &#x2018;constant disruptions in the educational process imposed by repeated lockdowns&#x2019; were observed (<xref ref-type="bibr" rid="R2">Aristovnik et al., 2023, p. 4</xref>). Legal restrictions on social mixing varied slightly, but mostly prevalent between March 2020 and June 2021 and later lifted by February 2022, followed by a shift toward individuals managing their risk (<xref ref-type="bibr" rid="R22">Gr&#x00F8;sland et al., 2022</xref>; <xref ref-type="bibr" rid="R53">Ruhm, 2024</xref>; <xref ref-type="bibr" rid="R57">Smith et al., 2022</xref>). In general, arguing that the pandemic had an immediate effect on impact metrics will be challenging, given the need to account for the delay in academic research and publishing processes, further compounded by citation delays.</p>
<p>Given the nature of the dataset, with many publications sharing the same date and the irregularity of publication schedules, a temporal aggregation method was employed to aggregate the data into monthly time points (<xref ref-type="bibr" rid="R21">Granger, 1990</xref>). This transformation also benefits the forecasting of the trend of impact metrics after intervention, particularly with data starting from 2015, providing a broad context for analysis.</p>
<p>To measure the impact of the pandemic on scholarly output, relying solely on citation counts was deemed insufficient, as citations accumulate over time and are not specific to the publication field. Instead, the Field-weighted citation impact (FWCI) metric was used. FWCI is a field-normalised metric that is stable and reflective of the impact of publications within the first three years after publication (<xref ref-type="bibr" rid="R54">SciVal Support Centre, 2024</xref>). For accurate causal assessment in time series, additional unimpacted covariates were required to forecast counterfactual scenarios within the C-ARIMA model. These covariates included the number of publications during the period to capture the lack of long term shifts in research productivity, the average citation count as a measure of peer recognition, and the long term value of research, and the average source normalized impact per paper (SNIP) of journals, indicating the stable influence of journal prestige. Although these metrics are inherently quantitative, taken together they approximate factors beyond raw citation counts (such as disciplinary relevance, visibility, and peer reception),thereby providing a more holistic basis for modelling counterfactual scenarios and evaluating the pandemic&#x2019;s causal effects on research output.</p>
</sec>
<sec id="sec3_2">
<title>Data analysis</title>
<p>Causal inference in time series analysis integrates counterfactual reasoning with forecasting methodologies, extending the concept of potential outcomes into the temporal domain (<xref ref-type="bibr" rid="R4">Bojinov &#x0026; Shephard, 2019</xref>). This approach enables the estimation of causal effects over time by comparing observed outcomes with counterfactual scenarios, providing a dynamic view of the impacts of interventions (<xref ref-type="bibr" rid="R5">Brodersen et al., 2015</xref>). The C-ARIMA model (<xref ref-type="bibr" rid="R35">Menchetti et al., 2023</xref>) represents a significant advancement in this area by combining counterfactual outcomes with ARIMA models, creating a robust framework for assessing intervention impacts. Specifically, C-ARIMA is effective in disentangling the effects of interventions such as the COVID-19 pandemic from underlying trends and seasonal patterns, which are common in bibliometric data due to the periodic nature of journal publishing cycles.</p>
<p>In this study, causal inference methods allow for a more nuanced understanding of the impact of the pandemic on information seeking and scholarly communication. Rather than relying on simplistic before-and-after comparisons of publication metrics, this approach estimates the causal impact of pandemic-induced changes while accounting for preexisting trends in research output. This enables the development of a comprehensive overview of how the pandemic has shaped research priorities and influenced the impact of scholarly work across various disciplines.</p>
<fig id="F2">
<label>Figure 2.</label>
<caption><p>Monthly changes in citations, number of publications, SNIIP, and FWCI metrics in topic cluster TC.905</p></caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="c17-fig2.jpg"><alt-text>none</alt-text></graphic>
</fig>
<p>Regarding the software used, the causalARIMA R library (Menchetti, 2021/<xref ref-type="bibr" rid="R34">2024</xref>) was used for this analysis, using a manually selected autoregressive integrated moving average (ARIMA) model, specifically ARIMA (1,1,2). This model was chosen because of its similarity to the damped Holt model, incorporating an autoregressive damping parameter (<xref ref-type="bibr" rid="R33">McKenzie &#x0026; Gardner, 2010</xref>). Such a model is particularly suitable for nonstationary time series where a trend is expected to diminish over time, avoiding unrealistic long term predictions that assume a continued linear trend. This is particularly relevant in the context of citations, where external factors, such as saturation or a slowdown in journal impact factor growth, could decelerate trends.</p>
<p>To account for the characteristics of the time series data (<xref ref-type="fig" rid="F2">Figure 2</xref>), the ARIMA(1,1,2) model incorporates a first-order autoregressive component (AR(1)) to introduce dependency on the values of the previous period. First, differencing (I(1)) was applied to handle non-stationarity and a second order moving average component (MA(2)) was included to address short-term shocks or noise in the data. This component is especially important given the uneven publication periods resulting from periodicity of journals.</p>
</sec>
</sec>
<sec id="sec4">
<title>Results</title>
<sec id="sec4_1">
<title>Performance and fit of the model</title>
<p>The ARIMA(1,1,2) model performed well in forecasting and estimating causal effects. Significant coefficients AR (1) and MA (2) (<xref ref-type="table" rid="T1">Table 1</xref>), combined with the minimal bias reflected in the performance metrics (<xref ref-type="table" rid="T2">Table 2</xref>), indicate that the model effectively captured the temporal dynamics of the FWCI metric. Citations were a significant predictor (t = 8.756), while SNIP demonstrated a trend toward significance (t = 1.854), suggesting a potential contribution of journal quality, though its effect was less robust compared to citations. The model handled the non-stationary nature of the FWCI series with first-order differencing (<italic>d</italic>=1), removing trends while preserving meaningful fluctuations. The estimated coefficients (<xref ref-type="table" rid="T1">Table 1</xref>) show AR(1) at -0.862 (t = -4.635) and MA(2) at -0.931 (t = -5.920), both of whom play a key role in modelling the time structure. However, MA (1) was not significant at -0.069 (t = -0.434) and was not helpful for the model to take into account more complex patterns in the data, and ARIMA used information from two steps back (MA(2)) to handle short-term variations in the data.</p>
<table-wrap id="T1">
<label>Table 1.</label>
<caption><p>Estimated coefficients and significance levels for the ARIMA model.</p></caption>
<table>
<thead>
<tr>
<th align="left" valign="top">Coefficient</th>
<th align="left" valign="top">Estimate</th>
<th align="left" valign="top">Standard Error</th>
<th align="left" valign="top">t-value</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="top">AR(1)</td>
<td align="left" valign="top">-0.862</td>
<td align="left" valign="top">0.186</td>
<td align="left" valign="top">-4.635</td>
</tr>
<tr>
<td align="left" valign="top">MA(1)</td>
<td align="left" valign="top">-0.069</td>
<td align="left" valign="top">0.158</td>
<td align="left" valign="top">-0.434</td>
</tr>
<tr>
<td align="left" valign="top">MA(2)</td>
<td align="left" valign="top">-0.931</td>
<td align="left" valign="top">0.157</td>
<td align="left" valign="top">-5.920</td>
</tr>
<tr>
<td align="left" valign="top">Citations</td>
<td align="left" valign="top">0.056</td>
<td align="left" valign="top">0.006</td>
<td align="left" valign="top">8.756</td>
</tr>
<tr>
<td align="left" valign="top">N-publications</td>
<td align="left" valign="top">0.000</td>
<td align="left" valign="top">0.001</td>
<td align="left" valign="top">0.902</td>
</tr>
<tr>
<td align="left" valign="top">SNIP</td>
<td align="left" valign="top">0.291</td>
<td align="left" valign="top">0.157</td>
<td align="left" valign="top">1.854</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>Performance metrics confirmed the overall robustness of the forecast: the mean error between predicted and observed values was close to zero (-0.009), the RMSE was 0.231, and the MPE was -3.872&#x0025;, indicating a slight underestimate of the FWCI by around 3.87&#x0025;. A MAPE = 13.603, below 15&#x0025; further suggests strong predictive accuracy. The AIC (13.215), BIC (28.105), and AICC (15.289) all suggest a well-fitted model without overfitting. The Durbin-Watson statistic (1.9183, p=0.3305) indicated that there was no significant autocorrelation, validating the model.</p>
</sec>
<sec id="sec4_2">
<title>Causal effects of the COVID-19 pandemic</title>
<p>The results of the causal effects analysis, shown in <xref ref-type="fig" rid="F3">Figure 3</xref> and summarised in <xref ref-type="table" rid="T2">Tables 2</xref> and <xref ref-type="table" rid="T3">3</xref>, highlight the impact of the COVID-19 pandemic on the research impact of scholarly communication and information seeking behaviour journal articles related to the topic group TC.905. The analysis, which focused on the FWCI metric, compared observed versus forecasted values using C-ARIMA modelling over a horizon from mid-2021 to early 2022. The data reveal a clear cumulative increase in FWCI, with significant point and cumulative causal effects identified across the two key periods of analysis.</p>
<fig id="F3">
<label>Figure 3.</label>
<caption><p>Causal effect horizons.</p></caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="c17-fig3.jpg"><alt-text>none</alt-text></graphic>
</fig>
<p>As illustrated in <xref ref-type="table" rid="T2">Table 2</xref>, the point causal effects of FWCI increased by 1.764 in June 2021 and 1.400 in February 2022, both with standard errors of 0.34. These results suggest a significant positive impact on the topic cluster during these times, confirmed by right-sided p-values below 0.001. These point effects reflect short-term increases, likely corresponding to a greater focus on academic communication and information seeking as the academic community adapts to pandemic-driven changes. However, the absence of an immediate effect without horizon (0.536 p=0.118) supports the assumption that the impact of the pandemic on FWCI was not instantaneous but evolved over time.</p>
<table-wrap id="T2">
<label>Table 2.</label>
<caption><p>Causal effects summary.</p></caption>
<table>
<thead>
<tr>
<th align="left" valign="top">Estimates (Standard Error)</th>
<th align="left" valign="top">Without horizons</th>
<th align="left" valign="top">2021-06</th>
<th align="left" valign="top">2022-02</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="top">Point Causal Effect</td>
<td align="left" valign="top">0.536 (0.343)<xref ref-type="table-fn" rid="TFN1"><sup>1</sup></xref></td>
<td align="left" valign="top">1.764 (0.34)</td>
<td align="left" valign="top">1.400 (0.34)</td>
</tr>
<tr>
<td align="left" valign="top">Cumulative Causal Effect</td>
<td align="left" valign="top">10.943 (0.249)</td>
<td align="left" valign="top">3.482 (0.242)</td>
<td align="left" valign="top">6.281 (0.243)</td>
</tr>
<tr>
<td align="left" valign="top">Temporal Average Causal Effect</td>
<td align="left" valign="top">0.322 (0.007)</td>
<td align="left" valign="top">0.232 (0.16)</td>
<td align="left" valign="top">0.273 (0.11)</td>
</tr>
<tr>
<td align="left" valign="top">Left-sided p-value</td>
<td align="left" valign="top">1.000</td>
<td align="left" valign="top">1.000</td>
<td align="left" valign="top">1.000</td>
</tr>
<tr>
<td align="left" valign="top">Right-sided p-value</td>
<td align="left" valign="top">&#x003C; 0.001</td>
<td align="left" valign="top">&#x003C; 0.001</td>
<td align="left" valign="top">&#x003C; 0.001</td>
</tr>
<tr>
<td align="left" valign="top">Bidirectional p-value</td>
<td align="left" valign="top">&#x003C; 0.001</td>
<td align="left" valign="top">&#x003C; 0.001</td>
<td align="left" valign="top">&#x003C; 0.001</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn-group>
<fn id="TFN1"><label>1</label><p>Left-sided p-value 0.941; Bidirectional p-value 0.118; Right-sided p-value 0.059</p></fn>
</fn-group>
</table-wrap-foot>
</table-wrap>
<p>By June 2021, the cumulative total of the average monthly FWCI had increased by 3.482, rising to 6.281 by February 2022, with standard errors of 0.242 and 0.243, respectively. This sustained increase indicates a long-term shift in research productivity and impact within the topic cluster, reflecting the cumulative effect of the pandemic on scholarly communication and information-seeking topics. Accounting for the number of publications during these periods, the cumulative FWCI gain corresponds to a total increase of 145.99 by June 2021 and 219.203 by February 2022, representing the whole topic&#x2019;s impact accumulation over time.</p>
<table-wrap id="T3">
<label>Table 3.</label>
<caption><p>Observed and forecasted effects.</p></caption>
<table>
<thead>
<tr>
<th align="left" valign="top">Estimates</th>
<th align="left" valign="top">Without horizons</th>
<th align="left" valign="top">2021-06</th>
<th align="left" valign="top">2022-02</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="top">Observed Effect</td>
<td align="left" valign="top">1.082</td>
<td align="left" valign="top">1.123</td>
<td align="left" valign="top">1.090</td>
</tr>
<tr>
<td align="left" valign="top">Forecasted Effect</td>
<td align="left" valign="top">0.760 (95&#x0025; CI [0.685, 0.841], SD = 0.041)</td>
<td align="left" valign="top">0.891 (95&#x0025; CI [0.785, 1.036], SD = 0.063)</td>
<td align="left" valign="top">0.817 (95&#x0025; CI [0.722, 0.929], SD = 0.052)</td>
</tr>
<tr>
<td align="left" valign="top">Absolute Effect</td>
<td align="left" valign="top">0.322 (95&#x0025; CI [0.241, 0.397], SD = 0.041)</td>
<td align="left" valign="top">0.232 (95&#x0025; CI [0.087, 0.338], SD = 0.063)</td>
<td align="left" valign="top">0.273 (95&#x0025; CI [0.161, 0.368], SD = 0.052)</td>
</tr>
<tr>
<td align="left" valign="top">Observed Cumulative Effect</td>
<td align="left" valign="top">36.790</td>
<td align="left" valign="top">16.840</td>
<td align="left" valign="top">25.078</td>
</tr>
<tr>
<td align="left" valign="top">Forecasted Cumulative Effect</td>
<td align="left" valign="top">25.847 (95&#x0025; CI [23.295, 28.601], SD = 1.384)</td>
<td align="left" valign="top">13.358 (95&#x0025; CI [11.771, 15.539], SD = 0.950)</td>
<td align="left" valign="top">18.798 (95&#x0025; CI [16.613, 21.372], SD = 1.191)</td>
</tr>
<tr>
<td align="left" valign="top">Absolute Cumulative Effect</td>
<td align="left" valign="top">10.943 (95&#x0025; CI [8.189, 13.494], SD = 1.384)</td>
<td align="left" valign="top">3.482 (95&#x0025; CI [1.301, 5.070], SD = 0.950)</td>
<td align="left" valign="top">6.281 (95&#x0025; CI [3.707, 8.465], SD = 1.191)</td>
</tr>
<tr>
<td align="left" valign="top">Relative Cumulative Effect</td>
<td align="left" valign="top">0.423 (95&#x0025; CI [0.317, 0.522], SD = 0.054)</td>
<td align="left" valign="top">0.261 (95&#x0025; CI [0.097, 0.380], SD = 0.071)</td>
<td align="left" valign="top">0.334 (95&#x0025; CI [0.197, 0.450], SD = 0.063)</td>
</tr>
<tr>
<td align="left" valign="top">alpha = 0.05</td>
<td align="left" valign="top">p &#x003C; 0.001</td>
<td align="left" valign="top">p = 0.002</td>
<td align="left" valign="top">p &#x003C; 0.001</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>First, the observed and predicted effects at two key time points, June 2021 and February 2022, indicated that the observed FWCI values were consistently higher than the predicted values. In June 2021, the observed FWCI was 1.123, while the predicted value was 0.891 (95&#x0025; CI [0.785, 1.036], SD = 0.063). This yielded a temporal average effect of 0.232, with a confidence interval ranging from 0.087 to 0.338 and a small standard deviation of 0.063, suggesting a statistically significant increase in FWCI during this period. Similarly, by February 2022, the observed FWCI was 1.090, while the predicted value was 0.817 (95&#x0025; CI [0.722, 0.929], SD = 0.052), resulting in a temporal effect of 0.273 (95&#x0025; CI [0.161, 0.368], SD = 0.052). The statistical significance (p &#x003C; 0.05) of these effects indicates that the impact of the pandemic on research in these fields was both significant and sustained over the horizon period.</p>
<p>In terms of cumulative effects, by June 2021, the cumulative FWCI reached 16.840, compared to the expected cumulative FWCI of 13.358 (95&#x0025; CI [11.771, 15.539], SD = 0.950), resulting in an absolute cumulative effect of 3.482 (95&#x0025; CI [1.301, 5.070]). By February 2022, the cumulative observed FWCI increased to 25.078, while the cumulative forecast value remained lower at 18.798 (95&#x0025; CI [16.613, 21.372], SD = 1.191), resulting in an absolute cumulative effect of 6.281 (95&#x0025; CI [3.707, 8.465]). The relative cumulative effects were 26.1&#x0025; and 33.4&#x0025;, respectively, indicating that the cumulative impact of the pandemic on FWCI was significantly stronger than anticipated at both time points.</p>
<p>In the non-horizon analysis, covering the period from the intervention in March 2020 to the end of 2022, the cumulative observed FWCI reached 36.790, while the cumulative forecast value was 25.847 (95&#x0025; CI [23.295, 28.601], SD = 1.384). This resulted in an absolute cumulative effect of 10.943 (95&#x0025; CI [8.189, 13.494], SD = 1.384), demonstrating a substantial cumulative increase in FWCI since the critical period in academia, during which the rapid digitisation of academic work and communication reshaped the research landscape. The relative cumulative effect of 42.3&#x0025; (95&#x0025; CI [0.317, 0.522], SD = 0.054) reflects the considerable influence of the pandemic on the research impact of studies on information seeking and scholarly communication in related fields, far exceeding initial expectations, with effects lasting well beyond the anticipated horizon.</p>
</sec>
</sec>
<sec id="sec5">
<title>Discussion</title>
<p>The rapid digitisation of academic work and the urgent need for accessible research have reshaped the research landscape in ways that may persist beyond the immediate crisis. However, the present study does not directly confirm widespread changes to research practices or digital tool adoption. Rather, it focuses on whether the pandemic influenced the citation patterns of literature on information seeking and scholarly communication as a topic cluster by shifting research priorities toward digital transformations that address urgent concerns in these areas, thereby heightening scholarly attention. By examining how the pandemic caused the shifts in these research areas, the analysis supports the notion that the global crisis influenced scholarly attention to topics related to information seeking behaviours and scholarly communication, leading to unexpected increased field-specific impact (<xref ref-type="bibr" rid="R50">Riccaboni &#x0026; Verginer, 2022</xref>).</p>
<p>Using the C-ARIMA model, key causal effects were identified, indicating the role of the pandemic in reshaping some research topics&#x2019; focus. This methodology goes beyond simple correlations, establishing a direct causal link between the pandemic and changes in research impact, an underutilised approach in scientometric studies (<xref ref-type="bibr" rid="R31">Li et al., 2023</xref>). By applying causal inference, the study bridges the theory-driven sociology of science with data-driven bibliometrics and scientometrics. <xref ref-type="bibr" rid="R61">Waltman (2016)</xref> emphasises that normalised citation impact indicators are critical in research evaluation because they account for disciplinary differences. This perspective is crucial for assessing the impact of the pandemic on research behaviour and academic output in multiple fields.</p>
<p>The observed increase in impact within related areas may reflect growing academic interest in how scholarly communication and information seeking evolved during the pandemic, rather than a direct measure of adoption of digital tools alone. The rise in research impact underscores the importance of these fields in navigating post-pandemic academic discourse, where digital reliance, misinformation, and the demand for open data have increased the value of research (<xref ref-type="bibr" rid="R43">Otike et al., 2022</xref>; <xref ref-type="bibr" rid="R51">Ross-Hellauer et al., 2022</xref>).</p>
<p>In practical terms, the application of causal inference in scientometrics offers valuable information for both academic institutions and policy makers. Identifying causal relationships between global crises, technological breakthroughs, and academic performance provides essential knowledge for institutional preparedness and policy adjustments. Future research could extend this approach to more granular studies of specific fields, journals, and collaborative practices, further exploring how crises shape knowledge production and dissemination across disciplines (<xref ref-type="bibr" rid="R31">Li et al., 2023</xref>).</p>
<p>Empirical studies could involve surveys and interviews with faculty to investigate the social processes driving the observed causal effects on information seeking and scholarly communication post-pandemic. While the pandemic likely triggered a digital transformation in research, communication, and academic collaboration, the present findings mainly suggest increased scholarly interest in these topics (<xref ref-type="bibr" rid="R14">e Rodrigues &#x0026; Mandrekar, 2021</xref>; <xref ref-type="bibr" rid="R15">Elia, 2023</xref>). This trend aligns with the broader digitalisation of academia, where open access and efficient information retrieval as a research topic has increased. However, this change also raises ethical and policy concerns, such as data privacy, misinformation, and the commodification of scholarly output (<xref ref-type="bibr" rid="R51">Ross-Hellauer et al., 2022</xref>). Causal inference methods, which establish time-related causal links, are better suited to address these concerns than correlational studies, which can overlook the underlying drivers of these changes but still can impose some limitations (<xref ref-type="bibr" rid="R9">Cordero et al., 2018</xref>).</p>
</sec>
<sec id="sec6">
<title>Limitations of the study</title>
<p>While this research applies a novel causal inference approach to bibliometric data, several limitations warrant attention. First, although the C-ARIMA model was chosen for its capacity to address time-diminishing trend effects in nonstationary time series, it was not systematically compared to other configurations, such as ARIMA or SARIMA variants, exponential smoothing, or other causal models like Bayesian Structural Time Series (<xref ref-type="bibr" rid="R50">Riccaboni &#x0026; Verginer, 2022</xref>; <xref ref-type="bibr" rid="R62">Wenaas, 2021</xref>). Future methodological work could incorporate these alternative models to refine and validate the findings, given the complexities of bibliometric data. In this study, the pragmatic focus on achieving a reliable forecast with minimal errors remains crucial for effectively handling time-series challenges in bibliometric analysis.</p>
<p>Second, the study examines a single topic cluster (TC.905) from 2015&#x2013;2022 occurring only in Scopus database, aggregated at a monthly level to manage temporal detail and statistical stability. Although this choice reduces noise from publication timing, other aggregation windows (e.g., quarterly) might reveal different patterns or capture disciplinary nuances, but would also reduce data points and necessitate a longer timeframe for analysis. Future investigations could explore specialized clusters to see whether similar trends surface in different publishing contexts.</p>
<p>Third, even though unimpacted covariates were considered, unobserved confounders remain possible (<xref ref-type="bibr" rid="R44">Pearl, 2000</xref>). Institutional policies, funding shifts, or other external influences may shape citation trends in ways not fully accounted for here. Incorporating Principal Component Analysis (PCA) to derive latent variables from multiple covariates has proven effective in ARIMA models (<xref ref-type="bibr" rid="R23">Hajirahimi et al., 2023</xref>). Hence, while these findings suggest a causal link between the pandemic and shifts in research impact, they should be interpreted with caution considering these constraints.</p>
</sec>
<sec id="sec7">
<title>Conclusions</title>
<p>The adoption of causal inference methodologies in bibliometric analysis marks a significant leap forward in understanding the dynamics of scientific research and knowledge dissemination. These techniques allow for moving beyond descriptive analyses to make causal claims about the factors driving changes in research focus and impact (<xref ref-type="bibr" rid="R31">Li et al., 2023</xref>). This shift aligns with the growing recognition of the importance of causal reasoning in data science and machine learning (<xref ref-type="bibr" rid="R46">Pearl &#x0026; Mackenzie, 2018</xref>). Causal reasoning supports more informed decision-making. By understanding the reasons behind observed changes in research practices, rather than simply observing them, academia can develop more effective and ethically sound strategies to address emerging trends. Based on the growing significance of information seeking research in post-pandemic scholarly communication, this hypothesis is proposed for future studies in both bibliometric and empirical contexts. The increase in research impact related to information seeking behaviour and scholarly communication post-pandemic is driven by an expanding reliance on digital and open science models for knowledge dissemination. This shift, further amplified by the increasing demand for accessible information during global crises, has elevated the prominence and influence of research in these fields. This hypothesis promotes a deeper exploration into how digital transformations and the rise of open science will continue shaping research practices, collaborative networks, and the overall impact of academic work in a post-pandemic world.</p>
</sec>
<sec id="sec8">
<title>Copyright</title>
<p>Authors contributing to <italic>Information Research</italic> agree to publish their articles under a Creative Commons CC BY-NC 4.0 license, which gives third parties the right to copy and redistribute the material in any medium or format. It also gives third parties the right to remix, transform and build upon the material for any purpose, except commercial, on the condition that clear acknowledgment is given to the author(s) of the work, that a link to the license is provided and that it is made clear if changes have been made to the work. This must be done in a reasonable manner, and must not imply that the licensor endorses the use of the work by third parties. The author(s) retain copyright to the work. You can also read more at: <ext-link ext-link-type="uri" xlink:href="https://publicera.kb.se/ir/openaccess">https://publicera.kb.se/ir/openaccess</ext-link></p>
</sec>
</body>
<back>
<ref-list>
<title>References</title>
<ref id="R1"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Alex</surname><given-names>J. K.</given-names></name></person-group><year>2022</year><article-title>Impact of the Covid-19 pandemic on the academic life of higher education students: A rural South African perspective from a global study</article-title><source>South African Journal of Higher Education</source><volume>36</volume><issue>1</issue><fpage>20</fpage><lpage>40</lpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.20853/36-1-4303">https://doi.org/10.20853/36-1-4303</ext-link></element-citation></ref>
<ref id="R2"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Aristovnik</surname><given-names>A.</given-names></name><name><surname>Karampelas</surname><given-names>K.</given-names></name><name><surname>Umek</surname><given-names>L.</given-names></name><name><surname>Rav&#x0161;elj</surname><given-names>D.</given-names></name></person-group><year>2023</year><article-title>Impact of the COVID-19 pandemic on online learning in higher education: A bibliometric analysis</article-title><source>Frontiers in Education</source><volume>8</volume><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/feduc.2023.1225834">https://doi.org/10.3389/feduc.2023.1225834</ext-link></element-citation></ref>
<ref id="R3"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Begum</surname><given-names>S. M.</given-names></name><name><surname>Habiba</surname><given-names>U.</given-names></name></person-group><year>2023</year><article-title>Are library professionals overcoming the COVID-19 pandemic challenges in the current reality?</article-title><source>Digital Library Perspectives</source><volume>39</volume><issue>4</issue><fpage>420</fpage><lpage>443</lpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1108/DLP-01-2023-0009">https://doi.org/10.1108/DLP-01-2023-0009</ext-link></element-citation></ref>
<ref id="R4"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bojinov</surname><given-names>I.</given-names></name><name><surname>Shephard</surname><given-names>N.</given-names></name></person-group><year>2019</year><article-title>Time series experiments and causal estimands: Exact randomization tests and trading</article-title><source>Journal of the American Statistical Association</source><volume>114</volume><issue>528</issue><fpage>1665</fpage><lpage>1682</lpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1080/01621459.2018.1527225">https://doi.org/10.1080/01621459.2018.1527225</ext-link></element-citation></ref>
<ref id="R5"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Brodersen</surname><given-names>K. H.</given-names></name><name><surname>Gallusser</surname><given-names>F.</given-names></name><name><surname>Koehler</surname><given-names>J.</given-names></name><name><surname>Remy</surname><given-names>N.</given-names></name><name><surname>Scott</surname><given-names>S. L.</given-names></name></person-group><year>2015</year><article-title>Inferring causal impact using Bayesian structural time-series models</article-title><source>The Annals of Applied Statistics</source><volume>9</volume><issue>1</issue><fpage>247</fpage><lpage>274</lpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1214/14-AOAS788">https://doi.org/10.1214/14-AOAS788</ext-link></element-citation></ref>
<ref id="R6"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Chakravorty</surname><given-names>N.</given-names></name><name><surname>Sharma</surname><given-names>C. S.</given-names></name><name><surname>Molla</surname><given-names>K. A.</given-names></name><name><surname>Pattanaik</surname><given-names>J. K.</given-names></name></person-group><year>2022</year><article-title>Open science: Challenges, possible solutions and the way forward</article-title><source>Proceedings of the Indian National Science Academy</source><volume>88</volume><issue>3</issue><fpage>456</fpage><lpage>471</lpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/s43538-022-00104-2">https://doi.org/10.1007/s43538-022-00104-2</ext-link></element-citation></ref>
<ref id="R7"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Cheng</surname><given-names>L.</given-names></name><name><surname>Guo</surname><given-names>R.</given-names></name><name><surname>Moraffah</surname><given-names>R.</given-names></name><name><surname>Sheth</surname><given-names>P.</given-names></name><name><surname>Candan</surname><given-names>K. S.</given-names></name><name><surname>Liu</surname><given-names>H.</given-names></name></person-group><year>2022</year><article-title>Evaluation methods and measures for causal learning algorithms</article-title><source>IEEE Transactions on Artificial Intelligence</source><volume>3</volume><issue>6</issue><fpage>924</fpage><lpage>943</lpage><ext-link ext-link-type="uri" xlink:href="https://doi.ieeecomputersociety.org/10.1109/TAI.2022.3150264">https://doi.ieeecomputersociety.org/10.1109/TAI.2022.3150264</ext-link></element-citation></ref>
<ref id="R8"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Cohen</surname><given-names>A. K.</given-names></name><name><surname>Hoyt</surname><given-names>L. T.</given-names></name><name><surname>Dull</surname><given-names>B.</given-names></name></person-group><year>2020</year><article-title>A descriptive study of COVID-19&#x2013;related experiences and perspectives of a national sample of college students in spring 2020</article-title><source>Journal of Adolescent Health</source><volume>67</volume><issue>3</issue><fpage>369</fpage><lpage>375</lpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.jadohealth.2020.06.009">https://doi.org/10.1016/j.jadohealth.2020.06.009</ext-link></element-citation></ref>
<ref id="R9"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Cordero</surname><given-names>J. M.</given-names></name><name><surname>Crist&#x00F3;bal</surname><given-names>V.</given-names></name><name><surname>Sant&#x00ED;n</surname><given-names>D.</given-names></name></person-group><year>2018</year><article-title>Causal Inference on education policies: A survey of empirical studies using Pisa, Timss and Pirls</article-title><source>Journal of Economic Surveys</source><volume>32</volume><issue>3</issue><fpage>878</fpage><lpage>915</lpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1111/joes.12217">https://doi.org/10.1111/joes.12217</ext-link></element-citation></ref>
<ref id="R10"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Cui</surname><given-names>R.</given-names></name><name><surname>Ding</surname><given-names>H.</given-names></name><name><surname>Zhu</surname><given-names>F.</given-names></name></person-group><year>2022</year><article-title>Gender inequality in eesearch productivity during the COVID-19 pandemic</article-title><source>Manufacturing &#x0026; Service Operations Management</source><volume>24</volume><issue>2</issue><fpage>707</fpage><lpage>726</lpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1287/msom.2021.0991">https://doi.org/10.1287/msom.2021.0991</ext-link></element-citation></ref>
<ref id="R11"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Cullinan</surname><given-names>J.</given-names></name><name><surname>Flannery</surname><given-names>D.</given-names></name><name><surname>Harold</surname><given-names>J.</given-names></name><name><surname>Lyons</surname><given-names>S.</given-names></name><name><surname>Palcic</surname><given-names>D.</given-names></name></person-group><year>2021</year><article-title>The disconnected: COVID-19 and disparities in access to quality broadband for higher education students</article-title><source>International Journal of Educational Technology in Higher Education</source><volume>18</volume><issue>1</issue><fpage>26</fpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1186/s41239-021-00262-1">https://doi.org/10.1186/s41239-021-00262-1</ext-link></element-citation></ref>
<ref id="R12"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>de Wit</surname><given-names>H.</given-names></name><name><surname>Altbach</surname><given-names>P. G.</given-names></name></person-group><year>2023</year><article-title>International higher education for the future: Major crises and post-pandemic challenges</article-title><source>Change: The Magazine of Higher Learning</source><volume>55</volume><issue>1</issue><fpage>17</fpage><lpage>23</lpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1080/00091383.2023.2151799">https://doi.org/10.1080/00091383.2023.2151799</ext-link></element-citation></ref>
<ref id="R13"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Downes</surname><given-names>M.</given-names></name></person-group><year>2023</year><article-title>There is no such thing as a predatory journal</article-title><source>Learned Publishing</source><volume>36</volume><issue>4</issue><fpage>709</fpage><lpage>711</lpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1002/leap.1568">https://doi.org/10.1002/leap.1568</ext-link></element-citation></ref>
<ref id="R14"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>e Rodrigues</surname><given-names>M. C.</given-names></name><name><surname>Mandrekar</surname><given-names>B.</given-names></name></person-group><year>2021</year><article-title>Role of the libraries in providing information and changing information-seeking behaviour of students and faculties during the pandemic: A study</article-title><source>Library Philosophy and Practice</source><fpage>1</fpage><lpage>20</lpage><ext-link ext-link-type="uri" xlink:href="https://digitalcommons.unl.edu/libphilprac/6350/">https://digitalcommons.unl.edu/libphilprac/6350/</ext-link></element-citation></ref>
<ref id="R15"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Elia</surname><given-names>E. F.</given-names></name></person-group><year>2023</year><article-title>Information-seeking behaviour of Tanzanians in the time of COVID-19</article-title><source>Global Knowledge, Memory and Communication</source><volume>72</volume><issue>4/5</issue><fpage>356</fpage><lpage>375</lpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1108/GKMC-04-2021-0060">https://doi.org/10.1108/GKMC-04-2021-0060</ext-link></element-citation></ref>
<ref id="R16"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Fern&#x00E1;ndez</surname><given-names>A.</given-names></name><name><surname>G&#x00F3;mez</surname><given-names>B.</given-names></name><name><surname>Binjaku</surname><given-names>K.</given-names></name><name><surname>Me&#x00E7;e</surname><given-names>E. K.</given-names></name></person-group><year>2023</year><article-title>Digital transformation initiatives in higher education institutions: A multivocal literature review</article-title><source>Education and Information Technologies</source><volume>28</volume><issue>10</issue><fpage>12351</fpage><lpage>12382</lpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/s10639-022-11544-0">https://doi.org/10.1007/s10639-022-11544-0</ext-link></element-citation></ref>
<ref id="R17"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Fitzgerald</surname><given-names>S. R.</given-names></name></person-group><year>2020</year><article-title>Toward a conceptual framework for scholarly information seeking</article-title><source>The Journal of Academic Librarianship</source><volume>46</volume><issue>6</issue><fpage>102259</fpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.acalib.2020.102259">https://doi.org/10.1016/j.acalib.2020.102259</ext-link></element-citation></ref>
<ref id="R18"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Frank</surname><given-names>J.</given-names></name><name><surname>Foster</surname><given-names>R.</given-names></name><name><surname>Pagliari</surname><given-names>C.</given-names></name></person-group><year>2023</year><article-title>Open access publishing &#x2013; noble intention, flawed reality</article-title><source>Social Science and Medicine</source><volume>317</volume><fpage>115592</fpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.socscimed.2022.115592">https://doi.org/10.1016/j.socscimed.2022.115592</ext-link></element-citation></ref>
<ref id="R19"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Fraser</surname><given-names>N.</given-names></name><name><surname>Brierley</surname><given-names>L.</given-names></name><name><surname>Dey</surname><given-names>G.</given-names></name><name><surname>Polka</surname><given-names>J. K.</given-names></name><name><surname>P&#x00E1;lfy</surname><given-names>M.</given-names></name><name><surname>Nanni</surname><given-names>F.</given-names></name><name><surname>Coates</surname><given-names>J. A.</given-names></name></person-group><year>2021</year><article-title>The evolving role of preprints in the dissemination of COVID-19 research and their impact on the science communication landscape</article-title><source>PLOS Biology</source><volume>19</volume><issue>4</issue><fpage>e3000959</fpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1371/journal.pbio.3000959">https://doi.org/10.1371/journal.pbio.3000959</ext-link></element-citation></ref>
<ref id="R20"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gao</surname><given-names>J.</given-names></name><name><surname>Yin</surname><given-names>Y.</given-names></name><name><surname>Myers</surname><given-names>K. R.</given-names></name><name><surname>Lakhani</surname><given-names>K. R.</given-names></name><name><surname>Wang</surname><given-names>D.</given-names></name></person-group><year>2021</year><article-title>Potentially long-lasting effects of the pandemic on scientists</article-title><source>Nature Communications</source><volume>12</volume><issue>1</issue><fpage>6188</fpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1038/s41467-021-26428-z">https://doi.org/10.1038/s41467-021-26428-z</ext-link></element-citation></ref>
<ref id="R21"><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Granger</surname><given-names>C. W. J.</given-names></name></person-group><year>1990</year><chapter-title>Aggregation of time-series variables: A survey</chapter-title><person-group person-group-type="editor"><name><surname>Barker</surname><given-names>T.</given-names></name></person-group><source>Disaggregation in econometric modelling (Chapter 1)</source><publisher-name>Routledge</publisher-name><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.4324/9781315822549">https://doi.org/10.4324/9781315822549</ext-link></element-citation></ref>
<ref id="R22"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gr&#x00F8;sland</surname><given-names>M.</given-names></name><name><surname>Larsen</surname><given-names>V. B.</given-names></name><name><surname>Reneflot</surname><given-names>A.</given-names></name><name><surname>Hart</surname><given-names>R. K.</given-names></name></person-group><year>2022</year><article-title>The COVID-19 pandemic&#x2019;s impact on mental health care use among Norwegian students in higher education: A nation-wide register-based pre-post cohort study</article-title><source>BMC Health Services Research</source><volume>22</volume><issue>1</issue><fpage>1506</fpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1186/s12913-022-08816-3">https://doi.org/10.1186/s12913-022-08816-3</ext-link></element-citation></ref>
<ref id="R23"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hajirahimi</surname><given-names>Z.</given-names></name><name><surname>Khashei</surname><given-names>M.</given-names></name><name><surname>Hamadani</surname><given-names>A. Z.</given-names></name></person-group><year>2023</year><article-title>Principal component-based hybrid model for time series forecasting</article-title><source>International Journal of Information Technology</source><volume>15</volume><issue>6</issue><fpage>3045</fpage><lpage>3053</lpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/s41870-023-01343-2">https://doi.org/10.1007/s41870-023-01343-2</ext-link></element-citation></ref>
<ref id="R24"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Huvila</surname><given-names>I.</given-names></name><name><surname>Gorichanaz</surname><given-names>T.</given-names></name></person-group><year>2024</year><article-title>Trends in information behavior research, 2016&#x2013;2022: An Annual Review of Information Science and Technology paper</article-title><source>Journal of the Association for Information Science and Technology</source><volume>76</volume><issue>1</issue><fpage>216</fpage><lpage>237</lpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1002/asi.24943">https://doi.org/10.1002/asi.24943</ext-link></element-citation></ref>
<ref id="R25"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Imai</surname><given-names>K.</given-names></name><name><surname>Kim</surname><given-names>I. S.</given-names></name><name><surname>Wang</surname><given-names>E. H.</given-names></name></person-group><year>2023</year><article-title>Matching methods for causal inference with time-series cross-sectional data</article-title><source>American Journal of Political Science</source><volume>67</volume><issue>3</issue><fpage>587</fpage><lpage>605</lpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1111/ajps.12685">https://doi.org/10.1111/ajps.12685</ext-link></element-citation></ref>
<ref id="R26"><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Imbens</surname><given-names>G. W.</given-names></name><name><surname>Rubin</surname><given-names>D. B.</given-names></name></person-group><year>2015</year><source>Causal inference for statistics, social, and biomedical sciences</source><publisher-name>Cambridge University Press</publisher-name></element-citation></ref>
<ref id="R27"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Jackman</surname><given-names>P. C.</given-names></name><name><surname>Sanderson</surname><given-names>R.</given-names></name><name><surname>Haughey</surname><given-names>T. J.</given-names></name><name><surname>Brett</surname><given-names>C. E.</given-names></name><name><surname>White</surname><given-names>N.</given-names></name><name><surname>Zile</surname><given-names>A.</given-names></name><name><surname>Tyrrell</surname><given-names>K.</given-names></name><name><surname>Byrom</surname><given-names>N. C.</given-names></name></person-group><year>2022</year><article-title>The impact of the first COVID-19 lockdown in the UK for doctoral and early career researchers</article-title><source>Higher Education</source><volume>84</volume><issue>4</issue><fpage>705</fpage><lpage>722</lpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/s10734-021-00795-4">https://doi.org/10.1007/s10734-021-00795-4</ext-link></element-citation></ref>
<ref id="R28"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kelly</surname><given-names>C. A.</given-names></name><name><surname>Sharot</surname><given-names>T.</given-names></name></person-group><year>2021</year><article-title>Individual differences in information-seeking</article-title><source>Nature Communications</source><volume>12</volume><issue>1</issue><fpage>7062</fpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1038/s41467-021-27046-5">https://doi.org/10.1038/s41467-021-27046-5</ext-link></element-citation></ref>
<ref id="R29"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kiviaho</surname><given-names>A.</given-names></name><name><surname>Einolander</surname><given-names>J.</given-names></name></person-group><year>2023</year><article-title>Digital transformation, well-being and shrinking communities: Narrowing the divides between urban and rural</article-title><source>Heliyon</source><volume>9</volume><issue>8</issue><fpage>e18801</fpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.heliyon.2023.e18801">https://doi.org/10.1016/j.heliyon.2023.e18801</ext-link></element-citation></ref>
<ref id="R30"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Lee</surname><given-names>J. J.</given-names></name><name><surname>Haupt</surname><given-names>J. P.</given-names></name></person-group><year>2021</year><article-title>Scientific globalism during a global crisis: Research collaboration and open access publications on COVID-19</article-title><source>Higher Education</source><volume>81</volume><issue>5</issue><fpage>949</fpage><lpage>966</lpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/s10734-020-00589-0">https://doi.org/10.1007/s10734-020-00589-0</ext-link></element-citation></ref>
<ref id="R31"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Li</surname><given-names>J.</given-names></name><name><surname>Liu</surname><given-names>X.</given-names></name><name><surname>Wei</surname><given-names>C.</given-names></name></person-group><year>2023</year><article-title>Why do we need causal inference in scientometric research?</article-title><source>Data Science and Informetrics</source><volume>3</volume><issue>1</issue><fpage>101</fpage><lpage>110</lpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.59494/dsi.2023.1.7">https://doi.org/10.59494/dsi.2023.1.7</ext-link></element-citation></ref>
<ref id="R32"><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Ma</surname><given-names>L.</given-names></name></person-group><year>2023</year><source>The Scholarly communication handbook: From research dissemination to societal impact</source><publisher-name>Facet</publisher-name><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.29085/9781783306268">https://doi.org/10.29085/9781783306268</ext-link></element-citation></ref>
<ref id="R33"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>McKenzie</surname><given-names>E.</given-names></name><name><surname>Gardner</surname><given-names>E. S.</given-names></name></person-group><year>2010</year><article-title>Damped trend exponential smoothing: A modelling viewpoint</article-title><source>International Journal of Forecasting</source><volume>26</volume><issue>4</issue><fpage>661</fpage><lpage>665</lpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.ijforecast.2009.07.001">https://doi.org/10.1016/j.ijforecast.2009.07.001</ext-link></element-citation></ref>
<ref id="R34"><element-citation publication-type="web"><person-group person-group-type="author"><name><surname>Menchetti</surname><given-names>F.</given-names></name></person-group><year>2024</year><source>CausalArima [R]</source><ext-link ext-link-type="uri" xlink:href="https://github.com/FMenchetti/CausalArima">https://github.com/FMenchetti/CausalArima</ext-link><comment>Original work published 2021</comment></element-citation></ref>
<ref id="R35"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Menchetti</surname><given-names>F.</given-names></name><name><surname>Cipollini</surname><given-names>F.</given-names></name><name><surname>Mealli</surname><given-names>F.</given-names></name></person-group><year>2023</year><article-title>Combining counterfactual outcomes and ARIMA models for policy evaluation</article-title><source>The Econometrics Journal</source><volume>26</volume><issue>1</issue><fpage>1</fpage><lpage>24</lpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1093/ectj/utac024">https://doi.org/10.1093/ectj/utac024</ext-link></element-citation></ref>
<ref id="R36"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Mok</surname><given-names>K. H.</given-names></name></person-group><year>2022</year><article-title>Impact of COVID-19 on higher education: Critical reflections</article-title><source>Higher Education Policy</source><volume>35</volume><issue>3</issue><fpage>563</fpage><lpage>567</lpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1057/s41307-022-00285-x">https://doi.org/10.1057/s41307-022-00285-x</ext-link></element-citation></ref>
<ref id="R37"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Montesi</surname><given-names>M.</given-names></name></person-group><year>2021</year><article-title>Human information behavior during the Covid-19 health crisis. A literature review</article-title><source>Library &#x0026; Information Science Research</source><volume>43</volume><issue>4</issue><fpage>101122</fpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.lisr.2021.101122">https://doi.org/10.1016/j.lisr.2021.101122</ext-link></element-citation></ref>
<ref id="R38"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Myers</surname><given-names>K. R.</given-names></name><name><surname>Tham</surname><given-names>W. Y.</given-names></name><name><surname>Yin</surname><given-names>Y.</given-names></name><name><surname>Cohodes</surname><given-names>N.</given-names></name><name><surname>Thursby</surname><given-names>J. G.</given-names></name><name><surname>Thursby</surname><given-names>M. C.</given-names></name><name><surname>Schiffer</surname><given-names>P.</given-names></name><name><surname>Walsh</surname><given-names>J. T.</given-names></name><name><surname>Lakhani</surname><given-names>K. R.</given-names></name><name><surname>Wang</surname><given-names>D.</given-names></name></person-group><year>2020</year><article-title>Unequal effects of the COVID-19 pandemic on scientists</article-title><source>Nature Human Behaviour</source><volume>4</volume><issue>9</issue><fpage>880</fpage><lpage>883</lpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1038/s41562-020-0921-y">https://doi.org/10.1038/s41562-020-0921-y</ext-link></element-citation></ref>
<ref id="R39"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Newson</surname><given-names>M.</given-names></name><name><surname>Zhao</surname><given-names>Y.</given-names></name><name><surname>Zein</surname><given-names>M. E.</given-names></name><name><surname>Sulik</surname><given-names>J.</given-names></name><name><surname>Dezecache</surname><given-names>G.</given-names></name><name><surname>Deroy</surname><given-names>O.</given-names></name><name><surname>Tun&#x00E7;gen&#x00E7;</surname><given-names>B.</given-names></name></person-group><year>2024</year><article-title>Digital contact does not promote wellbeing, but face-to-face contact does: A cross-national survey during the COVID-19 pandemic</article-title><source>New Media &#x0026; Society</source><volume>26</volume><issue>1</issue><fpage>426</fpage><lpage>449</lpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1177/14614448211062164">https://doi.org/10.1177/14614448211062164</ext-link></element-citation></ref>
<ref id="R40"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ni</surname><given-names>Z.</given-names></name><name><surname>Zhu</surname><given-names>L.</given-names></name><name><surname>Li</surname><given-names>S.</given-names></name><name><surname>Zhang</surname><given-names>Y.</given-names></name><name><surname>Zhao</surname><given-names>R.</given-names></name></person-group><year>2024</year><article-title>Characteristics and associated factors of health information-seeking behaviour among patients with inflammatory bowel disease in the digital era: A scoping review</article-title><source>BMC Public Health</source><volume>24</volume><issue>1</issue><fpage>307</fpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1186/s12889-024-17758-w">https://doi.org/10.1186/s12889-024-17758-w</ext-link></element-citation></ref>
<ref id="R41"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Oermann</surname><given-names>M. H.</given-names></name><name><surname>Waldrop</surname><given-names>J.</given-names></name><name><surname>Nicoll</surname><given-names>L. H.</given-names></name><name><surname>Peterson</surname><given-names>G. M.</given-names></name><name><surname>Drabish</surname><given-names>K. S.</given-names></name><name><surname>Carter-Templeton</surname><given-names>H.</given-names></name><name><surname>Owens</surname><given-names>J. K.</given-names></name><name><surname>Moorman</surname><given-names>T.</given-names></name><name><surname>Webb</surname><given-names>B.</given-names></name><name><surname>Wrigley</surname><given-names>J.</given-names></name></person-group><year>2023</year><article-title>Research on predatory publishing in health care: a scoping review</article-title><source>Canadian Journal of Nursing Research</source><volume>55</volume><issue>4</issue><fpage>415</fpage><lpage>424</lpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1177/08445621231172621">https://doi.org/10.1177/08445621231172621</ext-link></element-citation></ref>
<ref id="R42"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Okafor</surname><given-names>I. A.</given-names></name><name><surname>Mbagwu</surname><given-names>S. I.</given-names></name><name><surname>Chia</surname><given-names>T.</given-names></name><name><surname>Hasim</surname><given-names>Z.</given-names></name><name><surname>Udokanma</surname><given-names>E. E.</given-names></name><name><surname>Chandran</surname><given-names>K.</given-names></name></person-group><year>2022</year><article-title>Institutionalizing open science in Africa: limitations and prospects</article-title><source>Frontiers in Research Metrics and Analytics</source><volume>7</volume><fpage>855198</fpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/frma.2022.855198">https://doi.org/10.3389/frma.2022.855198</ext-link></element-citation></ref>
<ref id="R43"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Otike</surname><given-names>F.</given-names></name><name><surname>Bouaamri</surname><given-names>A.</given-names></name><name><surname>Hajdu Bar&#x00E1;t</surname><given-names>&#x00C1;.</given-names></name></person-group><year>2022</year><article-title>Predatory publishing: A catalyst of misinformation and disinformation amongst academicians and learners in developing countries</article-title><source>The Serials Librarian</source><volume>83</volume><issue>1</issue><fpage>81</fpage><lpage>98</lpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1080/0361526X.2022.2078924">https://doi.org/10.1080/0361526X.2022.2078924</ext-link></element-citation></ref>
<ref id="R44"><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Pearl</surname><given-names>J.</given-names></name></person-group><year>2000</year><source>Causality: Models, reasoning, and inference</source><publisher-name>Cambridge University Press</publisher-name></element-citation></ref>
<ref id="R45"><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Pearl</surname><given-names>J.</given-names></name></person-group><year>2010</year><chapter-title>Causal inference</chapter-title><person-group person-group-type="editor"><name><surname>Guyon</surname><given-names>I.</given-names></name><name><surname>Janzing</surname><given-names>D.</given-names></name><name><surname>Sch&#x00F6;lkopf</surname><given-names>B.</given-names></name></person-group><source>Proceedings of Workshop on Causality: Objectives and Assessment at NIPS 2008</source><volume>6</volume><fpage>39</fpage><lpage>58</lpage><publisher-name>PMLR</publisher-name><ext-link ext-link-type="uri" xlink:href="https://proceedings.mlr.press/v6/pearl10a.html">https://proceedings.mlr.press/v6/pearl10a.html</ext-link></element-citation></ref>
<ref id="R46"><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Pearl</surname><given-names>J.</given-names></name><name><surname>Mackenzie</surname><given-names>D.</given-names></name></person-group><year>2018</year><source>The book of why: The new science of cause and effect</source><publisher-name>Basic Books</publisher-name></element-citation></ref>
<ref id="R47"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Prince</surname><given-names>N.</given-names></name></person-group><year>2023</year><article-title>Continuing education and data training initiatives are needed to positively impact academic librarians providing data services</article-title><source>Evidence Based Library and Information Practice</source><volume>18</volume><issue>3</issue><fpage>81</fpage><lpage>83</lpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.18438/eblip30382">https://doi.org/10.18438/eblip30382</ext-link></element-citation></ref>
<ref id="R48"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>P&#x00FC;ttmann</surname><given-names>V.</given-names></name><name><surname>Thomsen</surname><given-names>S. L.</given-names></name></person-group><year>2024</year><article-title>Academics&#x2019; susceptibility to disruptions of their research productivity: empirical insights from the COVID-19 pandemic</article-title><source>Higher Education</source><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/s10734-024-01266-2">https://doi.org/10.1007/s10734-024-01266-2</ext-link></element-citation></ref>
<ref id="R49"><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Renz</surname><given-names>A.</given-names></name><name><surname>Hilbig</surname><given-names>R.</given-names></name></person-group><year>2023</year><chapter-title>Digital transformation of educational institutions accelerated by COVID-19: A digital dynamic capabilities approach</chapter-title><person-group person-group-type="editor"><name><surname>Whalley</surname><given-names>J.</given-names></name><name><surname>Stocker</surname><given-names>V.</given-names></name><name><surname>Lehr</surname><given-names>W.</given-names></name></person-group><source>Beyond the pandemic? Exploring the impact of COVID-19 on telecommunications and the Internet</source><fpage>103</fpage><lpage>119</lpage><publisher-name>Emerald Publishing Limited</publisher-name><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1108/978-1-80262-049-820231004">https://doi.org/10.1108/978-1-80262-049-820231004</ext-link></element-citation></ref>
<ref id="R50"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Riccaboni</surname><given-names>M.</given-names></name><name><surname>Verginer</surname><given-names>L.</given-names></name></person-group><year>2022</year><article-title>The impact of the COVID-19 pandemic on scientific research in the life sciences</article-title><source>PLOS ONE</source><volume>17</volume><issue>2</issue><fpage>e0263001</fpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1371/journal.pone.0263001">https://doi.org/10.1371/journal.pone.0263001</ext-link></element-citation></ref>
<ref id="R51"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ross-Hellauer</surname><given-names>T.</given-names></name><name><surname>Reichmann</surname><given-names>S.</given-names></name><name><surname>Cole</surname><given-names>N. L.</given-names></name><name><surname>Fessl</surname><given-names>A.</given-names></name><name><surname>Klebel</surname><given-names>T.</given-names></name><name><surname>Pontika</surname><given-names>N.</given-names></name></person-group><year>2022</year><article-title>Dynamics of cumulative advantage and threats to equity in open science: A scoping review</article-title><source>Royal Society Open Science</source><volume>9</volume><issue>1</issue><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1098/rsos.211032">https://doi.org/10.1098/rsos.211032</ext-link></element-citation></ref>
<ref id="R52"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Rowley</surname><given-names>J.</given-names></name></person-group><year>2023</year><article-title>Getting published in peer reviewed academic journals in business and management: perspectives for doctoral and early career researchers</article-title><source>Management Research Review</source><volume>46</volume><issue>2</issue><fpage>306</fpage><lpage>319</lpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1108/MRR-04-2021-0258">https://doi.org/10.1108/MRR-04-2021-0258</ext-link></element-citation></ref>
<ref id="R53"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ruhm</surname><given-names>C. J.</given-names></name></person-group><year>2024</year><article-title>US state restrictions and excess COVID-19 pandemic deaths</article-title><source>JAMA Health Forum</source><volume>5</volume><issue>7</issue><fpage>e242006</fpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1001/jamahealthforum.2024.2006">https://doi.org/10.1001/jamahealthforum.2024.2006</ext-link></element-citation></ref>
<ref id="R54"><element-citation publication-type="web"><collab>SciVal Support Center</collab><year>2024</year><month>January</month><day>15</day><source>SciVal metric: Field-weighted citation impact (FWCI)</source><ext-link ext-link-type="uri" xlink:href="https://service.elsevier.com/app/answers/detail/a_id/28192/supporthub/scival/p/10961/">https://service.elsevier.com/app/answers/detail/a_id/28192/supporthub/scival/p/10961/</ext-link></element-citation></ref>
<ref id="R55"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Seguya</surname><given-names>A.</given-names></name><name><surname>Salano</surname><given-names>V.</given-names></name><name><surname>Okerosi</surname><given-names>S.</given-names></name><name><surname>Kim</surname><given-names>E. K.</given-names></name><name><surname>Shrime</surname><given-names>M. G.</given-names></name><name><surname>Viljoen</surname><given-names>G.</given-names></name><name><surname>Fagan</surname><given-names>J. J.</given-names></name></person-group><year>2023</year><article-title>Are open access article processing charges affordable for otolaryngologists in low-income and middle-income countries?</article-title><source>Current Opinion in Otolaryngology and Head and Neck Surgery</source><volume>31</volume><issue>3</issue><fpage>202</fpage><lpage>207</lpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1097/MOO.0000000000000892">https://doi.org/10.1097/MOO.0000000000000892</ext-link></element-citation></ref>
<ref id="R56"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Shen</surname><given-names>Z.</given-names></name><name><surname>Zhong</surname><given-names>Z.</given-names></name><name><surname>Xie</surname><given-names>J.</given-names></name><name><surname>Zhang</surname><given-names>Q.</given-names></name><name><surname>Li</surname><given-names>S.</given-names></name></person-group><year>2022</year><article-title>The effects of information-seeking behaviors on risk perception during the COVID-19 pandemic: A cross-sectional correlational survey</article-title><source>Psychology Research and Behavior Management</source><volume>15</volume><fpage>1707</fpage><lpage>1719</lpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.2147/PRBM.S368537">https://doi.org/10.2147/PRBM.S368537</ext-link></element-citation></ref>
<ref id="R57"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Smith</surname><given-names>L. E.</given-names></name><name><surname>Potts</surname><given-names>H. W. W.</given-names></name><name><surname>Aml&#x020F;t</surname><given-names>R.</given-names></name><name><surname>Fear</surname><given-names>N. T.</given-names></name><name><surname>Michie</surname><given-names>S.</given-names></name><name><surname>Rubin</surname><given-names>G. J.</given-names></name></person-group><year>2022</year><article-title>Patterns of social mixing in England changed in line with restrictions during the COVID-19 pandemic (September 2020 to April 2022)</article-title><source>Scientific Reports</source><volume>12</volume><issue>1</issue><fpage>10436</fpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1038/s41598-022-14431-3">https://doi.org/10.1038/s41598-022-14431-3</ext-link></element-citation></ref>
<ref id="R58"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Sousa</surname><given-names>L.</given-names></name><name><surname>Pedro</surname><given-names>L.</given-names></name><name><surname>Santos</surname><given-names>C.</given-names></name></person-group><year>2023</year><article-title>A systematic review of systematic reviews on open educational resources: An analysis of the legal and technical openness</article-title><source>International Review of Research in Open and Distributed Learning</source><volume>24</volume><issue>3</issue><fpage>18</fpage><lpage>33</lpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.19173/irrodl.v24i3.7196">https://doi.org/10.19173/irrodl.v24i3.7196</ext-link></element-citation></ref>
<ref id="R59"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Tlili</surname><given-names>A.</given-names></name><name><surname>Garz&#x00F3;n</surname><given-names>J.</given-names></name><name><surname>Salha</surname><given-names>S.</given-names></name><name><surname>Huang</surname><given-names>R.</given-names></name><name><surname>Xu</surname><given-names>L.</given-names></name><name><surname>Burgos</surname><given-names>D.</given-names></name><name><surname>Denden</surname><given-names>M.</given-names></name><name><surname>Farrell</surname><given-names>O.</given-names></name><name><surname>Farrow</surname><given-names>R.</given-names></name><name><surname>Bozkurt</surname><given-names>A.</given-names></name><name><surname>Amiel</surname><given-names>T.</given-names></name><name><surname>McGreal</surname><given-names>R.</given-names></name><name><surname>L&#x00F3;pez-Serrano</surname><given-names>A.</given-names></name><name><surname>Wiley</surname><given-names>D.</given-names></name></person-group><year>2023</year><article-title>Are open educational resources (OER) and practices (OEP) effective in improving learning achievement? A metaanalysis and research synthesis</article-title><source>International Journal of Educational Technology in Higher Education</source><volume>20</volume><issue>1</issue><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1186/s41239-023-00424-3">https://doi.org/10.1186/s41239-023-00424-3</ext-link></element-citation></ref>
<ref id="R60"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Trevisan</surname><given-names>L. V.</given-names></name><name><surname>Eustachio</surname><given-names>J. H. P. P.</given-names></name><name><surname>Dias</surname><given-names>B. G.</given-names></name><name><surname>Filho</surname><given-names>W. L.</given-names></name><name><surname>Pedrozo</surname><given-names>E. &#x00C1;.</given-names></name></person-group><year>2024</year><article-title>Digital transformation towards sustainability in higher education: State-of-the-art and future research insights</article-title><source>Environment, Development and Sustainability</source><volume>26</volume><issue>2</issue><fpage>2789</fpage><lpage>2810</lpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/s10668-022-02874-7">https://doi.org/10.1007/s10668-022-02874-7</ext-link></element-citation></ref>
<ref id="R61"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Waltman</surname><given-names>L.</given-names></name></person-group><year>2016</year><article-title>A review of the literature on citation impact indicators</article-title><source>Journal of Informetrics</source><volume>10</volume><issue>2</issue><fpage>365</fpage><lpage>391</lpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.joi.2016.02.007">https://doi.org/10.1016/j.joi.2016.02.007</ext-link></element-citation></ref>
<ref id="R62"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Wenaas</surname><given-names>L.</given-names></name></person-group><year>2021</year><article-title>Attracting new users or business as usual? A case study of converting academic subscription-based journals to open access</article-title><source>Quantitative Science Studies</source><volume>2</volume><issue>2</issue><fpage>474</fpage><lpage>495</lpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1162/qss_a_00126">https://doi.org/10.1162/qss_a_00126</ext-link></element-citation></ref>
<ref id="R63"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Wilson</surname><given-names>T.D.</given-names></name></person-group><year>2018</year><article-title>The diffusion of information behaviour research across disciplines</article-title><source>Proceedings of ISIC, the Information Behaviour Conference, Krakow, Poland, 9-11 October: Part 1. Information Research</source><volume>23</volume><issue>4</issue><fpage>isic1801</fpage><ext-link ext-link-type="uri" xlink:href="http://InformationR.net/ir/23-4/isic2018/isic1801.html">http://InformationR.net/ir/23-4/isic2018/isic1801.html</ext-link><comment>Archived by WebCite&#x00AE; at http://www.webcitation.org/74IAnQkY8</comment></element-citation></ref>
<ref id="R64"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Yang</surname><given-names>X.</given-names></name><name><surname>Li</surname><given-names>T.</given-names></name></person-group><year>2024</year><article-title>Does the COVID-19 pandemic affect excellence in academic research? A study of science and engineering faculty members in China</article-title><source>Higher Education Policy</source><volume>37</volume><issue>3</issue><fpage>532</fpage><lpage>548</lpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1057/s41307-023-00313-4">https://doi.org/10.1057/s41307-023-00313-4</ext-link></element-citation></ref>
<ref id="R65"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Yao</surname><given-names>L.</given-names></name><name><surname>Chu</surname><given-names>Z.</given-names></name><name><surname>Li</surname><given-names>S.</given-names></name><name><surname>Li</surname><given-names>Y.</given-names></name><name><surname>Gao</surname><given-names>J.</given-names></name><name><surname>Zhang</surname><given-names>A.</given-names></name></person-group><year>2021</year><article-title>A survey on causal inference</article-title><source>ACM Transactions on Knowledge Discovery from Data (TKDD)</source><volume>15</volume><issue>5</issue><fpage>1</fpage><lpage>46</lpage><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1145/3444944">https://doi.org/10.1145/3444944</ext-link></element-citation></ref>
</ref-list>
</back>
</article>