Impact Factor Based on Logarithmic Correction for Papers’ Citations and Studies on its Category Normalization

Article Sidebar

FULLTEXT
Published: Dec 1, 2023
DOI: https://doi.org/10.22452/mjlis.vol28no3.1
Keywords:
Citation analysis Journal Impact Factor Standardization Impact Factor Journal Evaluation Journal Quartile

Main Article Content

Xue-li Liu
Henan Research Center for Science Journals, Xinxiang Medical University, Xinxiang, Henan, PR CHINA
Jia Guo
Management Institute, Xinxiang Medical University, Xinxiang, Henan 453003, PR China

Abstract

The objective of this study is to address the disciplinary variations in Journal Impact Factor (JIF), enabling its reasonable application in the evaluation of journals across diverse disciplines. To achieve this, the study utilized journals indexed in the Journal Citation Reports and considered papers from eight distinct disciplines as the research subjects. The citations of papers within each academic field were transformed into normal distributions, each with a different base logarithm. Subsequently, the logarithm-corrected impact factor (IFlog) for each journal was calculated. Category normalization for the IFlog (cnIFlog) was conducted by dividing each journal’s IFlog by the logarithmic correction aggregate impact factor of the discipline to which it belongs and the superiorities of cnIFlog in the evaluation of academic journals across different disciplines were demonstrated empirically. The results showed that taking different base logarithms could convert the citations of the journal papers into an approximately normal distribution. The IFlog of the eight disciplines’ journals was normally distributed, and the IFlog1.5, IFln, IFlog5, and IFlog10 of the journals were 100% positively related (r=1.000, P=0.000) both in the same and different disciplines. Compared with the impact factor (IF2018), average impact factor percentile (aJIFP), journal index of PR8 (JIPR8), IFlog and relative impact factor (rIF2018), and other indicators, cnIFlog1.5 exhibits the least variation among the journals from the eight different fields. In comparison to aJIFP and JIPR8, it demonstrates the highest correlation, ideal discrimination, and stability. It is concluded that cnIFlog1.5 is an ideal journal evaluation indicator in same or different disciplines.

Downloads

Download data is not yet available.

Article Details

How to Cite
Liu, X.- li, & Guo, J. (2023). Impact Factor Based on Logarithmic Correction for Papers’ Citations and Studies on its Category Normalization. Malaysian Journal of Library and Information Science, 28(3), 1–21. https://doi.org/10.22452/mjlis.vol28no3.1
Issue
Vol. 28 No. 3 (2023): Malaysian Journal of Library & Information Science
Section
Articles

It is a condition of publication that manuscripts submitted to the journal have not been published, accepted for publication, nor simultaneously submitted for publication elsewhere. By submitting a manuscript, the author(s) agree that copyright for the article is transferred to the publisher, if and when the manuscript is accepted for publication.

References

Abramo, G., and D’Angelo, C. A. 2016. A comparison of university performance scores and ranks by MNCS and FSS. Journal of Informetrics, Vol. 10, no. 4: 889-901.

Adam, D. 2002. The counting house. Nature, Vol. 415, no. 6873: 726-729.

Clarivate Analytics. 2020. Journal impact factor percentile. Available at: http://help.incites.clarivate.com/incitesLiveJCR/glossaryAZgroup/g8/9586-TRS.html.

Clauset, A., Shalizi, C. R., and Newman, M. E. J. 2009. Power-law distributions in empirical data. SIAM Review, Vol. 51, no.4: 661-703.

Garcia, J. A.,Rodriguez-Sánchez, R.,Fdez-Valdivia, J., and Martinez-Baena, J. 2012. On first quartile journals which are not of highest impact. Scientometrics, Vol.90, no.3: 925-943.

Hsu, J. W., and Huang, D. W. 2012. A scaling between impact factor and uncitedness. Physica A: Statistical Mechanics and Its Applications, Vol.391, no.5: 2129-2134.

Hu, S. H. 2020. The enlightenment of publishing group strategy to the development of scientific journals: deviation of scientific values oriented by SCI evaluation system. Acta Editologica, Vol.32, no.2:119-127.

Jiang, W. S. 2010. JCR and periodical quality partition: a case study on biological periodicals. Journal of Library and Information Science in Agriculture, Vol.22, no.10:8-12.

Katritsis, D. G. 2019. Journal impact factor:widely used,misused and abused. Arrhythmia Electrophysiology Review, Vol.8, no.3:153-155.

Kulczycki, E., Huang, Y., Zuccala, A. A., Engels, T. C. E., Ferrara, A., Guns, R., et al. 2022. Uses of the Journal Impact Factor in national journal rankings in China and Europe. Journal of the Association for Information Science and Technology,Vol.73, no.12:1741-17554.

Leydesdorff, L., Zhou, P., and Bornmann, L. 2013. How can journal impact factors be normalized across fields of science? An assessment in terms of percentile ranks and fractional counts. Journal of the American Society for Information Science and Technology, Vol.64, no.1: 96-107.

Liu, W. S., Hu, G. Y., and Gu, M. D. 2016. The probability of publishing in first-quartile journals. Scientometrics, Vol.106, no.3:1273-1276.

Liu, X. L. 2012. The global SCI phenomenon and impact factor worship. Chinese Journal of Scientific and Technical Periodicals, Vol.23, no.2:185-190.

Liu, X. L. 2014. Structural characteristics of impact factors of the ten top international journals. Acta Editologica, Vol.26, no.3:296-300.

Liu, X. L. 2016. Comparative studies on the cumulative impact factor and the annual impact factor of journals.Chinese Journal of Scientific and Technical Periodicals, Vol.27, no.7:774-778.

Liu, X. L., Guo, J., Shen, L., Wang, Y., Sheng, L. N., Fang, H. L., Li, J. H., et al. 2021. Impact factor based on logarithmic correction for papers’citations and studies on its category normalization. Journal of the China Society for Scientific and Technical Information,Vol.40, no.2:125-134.

Liu, X. L.,Ren, S. L.,Cheng, W. H., and Zheng, C. M. 2017. Comparison on CiteScore and impact factor of different discipline journals. Chinese Journal of Scientific and Technical Periodicals, Vol.28, no.9: 837-841.

Liu, X. L.,Shen, L.,Wang, Y.,Meng, J., Wei Y. H.,Zheng, C. M. 2019. Journal index of PR8:an indicator of academic journals in different fields and its applications. Chinese Journal of Scientific and Technical Periodicals, Vol.30, no.6:663-670.

Liu, X. L.,Wei, Y. H., & Meng, J. 2018. Limitations of journal impact factor percentile in interdisciplinary evaluation of academic journals. Chinese Journal of Scientific and Technical Periodicals, Vol.29, no.10:1018-1021.

Liu, X. L.,Wei, Y. H.,Sheng, L. N.,Wang, Y.,Fu, Z. J.,Zheng, C. M. 2017. Journal PR8 index: a new indicator for the evaluation of journals across fields and the empirical studies. Library and Information Service, Vol.61, no.11:116-123.

Logan, B. E. 2016. Relative impact factors. Environmental Science & Technology Letters, Vol.3, no.7: 255-56.

Lou, W. G.,Wang, Y. Y., and Zhang, B. 2019. New modified clout index of academic journals and the positive analysis. Chinese Journal of Scientific and Technical Periodicals, Vol.30, no.11: 1233-1239.

Malan, D. F. 2022.Journal impact factors-the good, the bad, and the ugly. Journal of the Southern African Institute of Mining and Metallurgy, Vol.122, no.9:541-548.

Marshakova-Shaikevich, I. 1996. The standard impact factor as an evaluation tool of science and scientific journals. Scientometrics, Vol.25, no.3: 283-290.

Mingers, J., and Leydesdorff, L. 2015. A review of theory and practice in scientometrics. European Journal of Operational Research, Vol.246, no.1: 1-19.

Oelrich, B., Peters, R., and Jung, K. 2007. A bibliometric evaluation of publications in Urological journals among European union countries between 2000-2005. European Urology, Vol.52, no.4: 1238-1248.

Perneger, T. V. 2015. Online accesses to medical research articles on publication predicted years later. Journal of Clinical Epidemiology, Vol.68 no.12: 1440-1445.

Pudovkin, A. I., and Garfield, E. 2005. Rank-normalized impact factor:a way to compare journal performance across subject categories. Proceedings of the American Society for Information Science and Technology, Vol.41 no.1: 507-515.

Raban, D. R., Gordon, A., and Geifman, D. 2011. The information society: the development of a scientific specialty.Information communication and society, Vol.14, no.3: 375-399.

Sen, B. K. 1992. Normalised impact factor. Journal of Documentation, Vol.48, no.3: 318-325.

Simons, K. 2008. The misused impact factor. Science, Vol.322, no.5899:165.

Sun, J., and Yuan, B. Z. 2020. Bibliometric mapping of top papers in Library and Information Science based on the Essential Science Indicators Database. Malaysian Journal of Library & Information Science, Vol.25, no.2: 61-76.

Sundaram, M., Hodler, J., and Rosenthal, D. I. 2012. On the relevance of the impact factor and other factors. Skeletal Radiology, Vol.41, no.2: 125-126.

Tahamtan, I., Safipour Afshar, A., and Ahamdzadeh, K. 2016. Factors affecting number of citations: a comprehensive review of the literature. Scientometrics, Vol.107, no.3: 1195-1225.

Thelwall, M. 2016. The discretised lognormal and hooked power law distributions for complete citation data: best options for modelling and regression. Journal of Informetrics, Vol.10, no.2: 336-346.

Traylor, C., and Herrmann-Lingen, C. 2023. Does the journal impact factor reflect the impact of German medical guideline contributions? Scientometrics, Vol.128. no.3:1951-1962.

Vanclay, J. K. 2012. Impact factor: outdated artefact or stepping-stone to journal certification?. Scientometrics, Vol.92, no.2: 211-238.

Vinkler, P. 2012. The case of scientometricians with the "absolute relative" impact indicator.

Journal of Informetrics, Vol.6, no.2: 254-264.

Wang, L. F. 2013. Insufficiency and improvement of the SCI journals patition method of the Chinese Academy of Sciences. Management and Research on Scientific &Technological Achievements, no. 2: 36-45．

Wang, Q., and Yuan, H. 2020. Development methods of scientific journals under the new situation: thoughts based on two documents issued by Ministry of Education and the Ministry of Science and Technology. Acta Editologica, Vol.32, no.2:128-131.

Wang, X. W., Fang, Z. C., and Wang, H. Y. 2015. Study on the continuous,dynamic and comprehensive article-level evaluation system. Science of Science and Management of S.&.T, Vol.36, no.8: 37-48.

Xiong, X. Y. 2005.Relative impact factor and its significance. Chinese Journal of Scientific and Technical Periodicals, Vol.16, no.6: 912-914.

Yang, B., Peng, C. Q.,Yuan, S. Q., and Wang, H. D. 2008. Application of relative impact factor in journal and scientific evaluation. Acta Editologica, Vol.20, no.5: 466-468.

Ye, Y. 2015. The research progress and developing perspective of assessment indicators. Journal of the China Society for Scientific and Technical Information, Vol.33, no.2: 215-224.

Yu, L. P. 2016. Study on characteristic of ‘journal impact factor percentile’ indicator. Library and Information Service, Vol.60, no.10: 103-107.

Yu, L. P.,Yuan, Y. Y., and Wang, Z. G. 2018. Improvement of the Academic Journal Clout Index. Information Studies:Theory & Application, Vol.41, no.11:69-72.

Zou, C. L. 1999. Studies on the basis of quantitative evaluation. Sciencetimes (in Chinese) 25 March 1999.