Preliminary Conference Agenda

Traditionally, scientific evaluation leaning on quantity and citation metrics rarely places a study within a specific context or a particular historical process for examination, making it difficult to fully reveal its substantial contributions. In a specific scientific field, each study focuses on a certain topic and corre-sponds to a certain evolutionary stage of the topic. However, few studies ana-lyze research contributions from context-oriented and process-oriented per-spectives. This study investigates the contributions of research under several representative topics in the field of quantitative science studies, using articles published in the international journal Scientometrics as samples. BERTopic model is employed for topic clustering, and four research topics are selected for in-depth analysis. In order to unveil research contributions to knowledge production and to different audiences, various metrics including disruptive-ness, citation impact and altmetrics are combined for indicator-level analysis, and articles are classified into different categories according to the knowledge contribution types and research orientations for content-level analysis. Results reveal that representative research topics exhibit greater disruptiveness and re-search impact compared to the overall sample. However, as research topics develop, there is a declining trend in introducing new knowledge and produc-ing impact within academia. Simultaneously, there is a certain degree of en-hancement in their impact beyond academia, and also a shift in knowledge contribution types and research orientations. Our findings contribute to a con-textual and processual understanding of diverse research contribution, serving as a reference for the evaluation practices of research outcomes oriented to-wards contribution assessment.

We present our approach for identifying the importance of citing sentences, where the importance of citing sentences is termed “micro citation importance” in our research. This approach characterizes a regression method based on the pretrained language model SciBERT, where the citation function is incorporated into the citing sentence as its input. Remarkably, our approach demonstrates superior performance on the 3C Citation Context Classification Shared Task corpus, suggesting that both regarding micro citation importance identification as a regression problem and integrating the citation function contribute to enhanced performance. Furthermore, we extend our investigation to literature evaluation, introducing a novel metric coined “micro citation frequency” derived from micro citation importance acquired by our proposed regression method. Notably, it is observed that micro citation frequency outperforms the established metric of citation frequency in terms of evaluating high-quality papers, further validating our proposed regression method. Our work not only enriches citation content analysis, but also holds implications for optimizing literature evaluation.

Interdisciplinary collaboration has emerged as a pivotal driver of academic progress and innovation. As researchers work across disciplinary bounda-ries, it becomes imperative to identify and examine the factors that affect the pace of scientific knowledge dissemination. This study introduces cita-tion lag as a metric to gauge the knowledge diffusion speed in Library and Information Science research. It further explores the factors associated with citation lag from both disciplinary and publication perspectives. Our re-sults indicate that an article is less likely to be cited if it remains uncited within 24 months after publication. Both the disciplinary attribute and the Open access mechanism were found to have a significant impact on citation lag. Furthermore, the result reveals a negative correlation between publica-tion lag and citation lag, implying that rigorous editorial review processes may ensure article quality and accelerate knowledge diffusion. Drawing on these insights, this paper endeavors to provide valuable guidance for craft-ing scholarly articles and facilitating knowledge diffusion.