Awareness, familiarity and usage of traditional research metrics and altmetrics among academics in Malaysia

Article Sidebar

FULL TEXT
Published: Dec 1, 2022
DOI: https://doi.org/10.22452/mjlis.vol27no3.1
Keywords:
Altmetrics Social media usage Research metrics Citation-based metrics Malaysia

Main Article Content

Siau-Ting Keng
Department of Pharmaceutical Life Sciences, Faculty of Pharmacy, Universiti Malaya, 50603 Kuala Lumpur, MALAYSIA
Pei-Boon Ooi
Department of Medical Sciences, School of Medical and Life Sciences, Sunway University, 47500 Petaling Jaya, Selangor, MALAYSIA
Khong-Yun Pang
Department of General Studies, School of Interdisciplinary Studies, Sunway University, 47500 Petaling Jaya, Selangor, MALAYSIA
Chia-Wei Phan
Clinical Investigation Centre (CIC), University Malaya Medical Centre, 59100 Lembah Pantai Kuala Lumpur, MALAYSIA

Abstract

The growing necessity to improve the evaluation methods of research impact as scholarly communication has progressed increasingly online. Studies investigating awareness and usage of social media among academics have been increasing. However, only limited studies focus on the familiarity and usage of research metrics among them. The aim of the study was to investigate the relationship between awareness, familiarity, and usage, as well as hindrances in using research metrics among academics in Malaysia. A total of 344 individuals took part in an online survey and the data were analyzed using Partial Least Squares-Structural Equation Modeling (PLS-SEM) to examine the postulated hypotheses. Our results revealed that familiarity is the only predictor associated with the usage of research metrics among academics with 62.7% of variance explained. Seniority did not mediate the relationship between familiarity and awareness to the usage of research metrics among academics. In conclusion, altmetrics have the potential to develop as complements to traditional metrics and to provide a useful insight into new impact modes not included in existing measures.

Downloads

Download data is not yet available.

Article Details

How to Cite
Keng, S.-T., Ooi, P.-B. ., Pang, K.-Y. ., & Phan, C.-W. . (2022). Awareness, familiarity and usage of traditional research metrics and altmetrics among academics in Malaysia. Malaysian Journal of Library and Information Science, 27(3), 1–19. https://doi.org/10.22452/mjlis.vol27no3.1
Issue
Vol. 27 No. 3 (2022): Malaysian Journal of Library & Information Science
Section
Articles

It is a condition of publication that manuscripts submitted to the journal have not been published, accepted for publication, nor simultaneously submitted for publication elsewhere. By submitting a manuscript, the author(s) agree that copyright for the article is transferred to the publisher, if and when the manuscript is accepted for publication.

References

Adeyemi, I.O. 2021. Awareness, knowledge and use of altmetrics as measure of research impact: Nigerian librarians’ perspectives. Library Philosophy and Practice, 5225. Available at: https://digitalcommons.unl.edu/libphilprac/5225/.

Ahmad, S., Zulkurnain, N., and Khairushalimi, F. 2016. Assessing the validity and reliability of a measurement model in Structural Equation Modeling (SEM). British Journal Of Mathematics & Computer Science, Vol. 15 no. 3: 1-8. Available at: doi:10.9734/bjmcs/2016/25183.

Alarcón, D. Sánchez, J.A., and De Olavide, U. 2015. Assessing convergent and discriminant validity in the ADHD-R IV rating scale: User-written commands for Average Variance Extracted (AVE), Composite Reliability (CR), and Heterotrait-Monotrait ratio of correlations (HTMT). In Spanish STATA Meeting, Vol. 39. Universidad Pablo de Olavide.

Aung, H.H. 2016. A worldwide survey: investigating awareness and usage of traditional metrics and altmetrics among researchers. Altmetrics Conference Presentation. Figshare. Available at: https://doi.org/10.6084/m9.figshare.3980103.v1

Aung, H.H., Erdt, M., and Theng, Y.L. 2017. Awareness and usage of altmetrics: a user survey. Proceedings of the Association for Information Science and Technology, Vol. 54, no. 1: 18-26. Available at: doi:10.1002/pra2.2017.14505401003.

Aung, H.H., Han, Z., Mojisola, E., Ashley, S.A., Sei‐Ching, J.S., and Theng, Y.L. 2019. Investigating familiarity and usage of traditional metrics and altmetrics. Journal of the Association for Information Science and Technology, Vol. 70, no. 8: 872-887. doi:10.1002/asi.24162.

Bakker, C., Kristen, C., Allison, L-P., and Jennifer, M. 2020. Qualitative analysis of faculty opinions on and perceptions of research impact metrics. College & Research Libraries, Vol. 81, no. 6: 896-912. Available at: doi:10.5860/crl.81.6.896.

Beall, J. 2015. The “Metric” system: yet more chaos in scholarly publishing. The Journal Of Physical Chemistry Letters, Vol. 6, no. 11: 2020-2021. Available at: doi:10.1021/acs.jpclett.5b00910.

Cabrera, D., Durga, R., and Margaret, S.C. 2018. Social media scholarship and alternative metrics for academic promotion and tenure. Journal of the American College of Radiology, Vol. 15, no. 1: 135-141. Available at: doi: 10.1016/j.jacr.2017.09.012.

Carpenter, C.R., David, C.C., and Cathy, C.S. 2014. Using publication metrics to highlight academic productivity and research impact. Academic Emergency Medicine, Vol. 21, no. 10: 1160-1172. Available at: doi:10.1111/acem.12482.

Cheung, M.K. 2013. Altmetrics: too soon for use in assessment. Nature, Vol. 494, no. 7436: 176-176. Available at: doi:10.1038/494176d.

Crotty, D. 2017. Altmetrics. European Heart Journal. Vol. 38, no. 35: 2647–2648. Available at: doi: 10.1093/eurheartj/ehx447

DeSanto, D., and Aaron, N. 2017. Scholarly metrics baseline: A survey of faculty knowledge, use, and opinion about scholarly metrics. College & Research Libraries, Vol. 78, no. 2: 150-170. Available at: doi:10.5860/crl.78.2.150.

Donato, H. 2014. Traditional and alternative metrics: the full story of impact". Revista Portuguesa De Pneumologia, Vol. 20, no. 1: 1-2. Available at: doi:10.1016/j.rppneu.2013.11.001.

Ferrier-Watson, A. 2019. Traditional metrics, altmetrics and researcher profiles: A survey of faculty perceptions and use. Available at: http://hdl.handle.net/10063/8362

Fraumann, G. 2017. Valuation of altmetrics in research funding. Master's thesis. University of Tampere, Finland. Available at: https://nbn-resolving.org/urn:nbn:de:0168-ssoar-58249-9

Fraumann, G. 2018. The values and limits of altmetrics. New Directions For Institutional Research, Vol. 2018, no. 178: 53-69. Available at: doi:10.1002/ir.20267.

Grech, V., and Rizk, D.E.E. 2018. Increasing importance of research metrics: Journal Impact Factor and h-index. International Urogynecology Journal, Vol. 29, no. 2018: 619–620. Available at: doi:10.1007/s00192-018-3604-8

García-Villar, C. 2021. A critical review on altmetrics: can we measure the social impact factor? Insights Imaging, Vol. 12, no. 92: 2021. Available at: doi:10.1186/s13244-021-01033-2

Hair, J.J.F., Tomas, G.M.H., Christian, M.R., and Marko, S. 2014. A primer on partial least squares structural equation modeling (PLS-SEM). Thousand Oaks, California: Sage Publications, 2014.

Hair, J.F., Jeffrey, J.R., Marko, S., and Christian, M.R. 2019. When to use and how to report the results of PLS-SEM. European Business Review, Vol. 31, no. 1: 2-24. Available at: doi:10.1108/ebr-11-2018-0203.

Holmberg, K., Bowman, S., Bowman, T., Didegah, F., and Kortelainen, T. 2019. What is societal impact and where do altmetrics fit into the equation? Journal of Altmetrics, Vol. 2, no. 1: p6. Available at: doi: 10.29024/joa.21

Htoo, T.H.H., and Na, J-C. 2017. User Profiling in Altmetrics: the need to enrich altmetric data. Available at: http://altmetrics.org/wp-content/uploads/ 2017/09/altmetrics17_paper_5.pdf.

Lemke, S., Maryam, M., Athanasios, M., and Isabella, P. 2019. “When you use social media, you are not working”: barriers for the use of metrics in social sciences". Frontiers in Research Metrics and Analytics, Vol. 3, no. 39: 1-18. Available at: doi:10.3389/frma.2018.00039.

Mamtora, J., and Gaby, H. 2015. From bibliometrics to altmetrics: An Australian study. In IFLA academic and research libraries satellite conference. In The Quest for deeper meaning of research support, Cape Town, South Africa, pp. 13-14.

Markham, A., and Elizabeth, B. 2012. Ethical decision-making and internet research: Version 2.0. recommendations from the AoIR ethics working committee. Available at: aoir. org/reports/ethics2. pdf.

Mech, E., Ahmed, M.M., Tamale, E., Holek, M., Li, G., and Thabane, L. 2020. Evaluating journal impact factor: a systematic survey of the pros and cons, and overview of alternative measures. Journal of Venomous Animals and Toxins including Tropical Diseases, Vol. 26, no. e20190082. Available at: doi: 10.1590/1678-9199-JVATITD-2019-0082.

Moher, D., Florian, N., Ioana, A., Cristea, F.M., John, P.A.I., and Steven, N.G. 2018. Assessing scientists for hiring, promotion, and tenure. PLOS Biology, Vol. 16, no. 3: e2004089. Available at: doi:10.1371/journal.pbio.2004089.

Noah, A.O., Pearce, I., and Modgil, V. 2020. Altmetrics and citations: the impact of journal publications. The Bulletin of The Royal College of Surgeons of England, Vol. 102, no. 7: 324-327. Available at: doi:10.1308/rcsbull.2020.132.

Peters, I., Peter, K., Elisabeth, L., Christian, G., and Juan, G. 2016. Research data explored: an extended analysis of citations and altmetrics. Scientometrics, Vol. 107, no. 2: 723-744. Available at: doi:10.1007/s11192-016-1887-4.

Roemer, R.C., and Rachel, B. 2015. Introduction to altmetrics. Chapter 1 of Library Technology Reports, Vol. 51, no. 5. Available at: https://journals.ala.org/index.php /ltr/article/view/5745

Sommer, S. 2018. Altmetrics: Tools for measuring the impact of polar publications on public discourse. Polar Libraries Colloquy 2018. Proceedings. Developing Polar Networks: Ideas & Possibilities for The Future. Available at: https://lauda.ulapland.fi/bitstream/handle/10024/63993/Sommer.Shelly.pdf?sequence=1&isAllowed=y

Sugimoto, C.R., Sam, W., Vincent, L., and Stefanie, H. 2017. Scholarly use of social media and altmetrics: a review of the literature. Journal of the Association For Information Science and Technology, Vol. 68, no. 9: 2037-2062. Available at: doi:10.1002/asi.23833.

Sutton, S.W. 2014. Altmetrics: what good are they to academic libraries. Kansas Library Association College and University Libraries Section Proceedings, Vol. 4, no. 2: 1-7. Available at: https://doi.org/10.4148/2160-942X.1041

Sutton, S., Rachel, M., and Stacy, K. 2018. Awareness of altmetrics among LIS scholars and faculty. Journal of Education for Library And Information Science, Vol. 59, no. 1-2: 33-47. Available at: doi:10.3138/jelis.59.1-2.05.

Sutton, S., Rachel, M., and Stacy, K. 2019. The future of impact metric use among collection development librarians. Qualitative and Quantitative Methods in Libraries, Vol. 6, no. 1: 13-21. Available at: https://qqml-journal.net/index.php/qqml/article/view/385

Tattersall, A., and Christopher, C. 2018. Corrigendum: what can altmetric.com tell us about policy citations of research? an analysis of altmetric.com data for research articles from the University of Sheffield. Frontiers In Research Metrics and Analytics, Vol. 3, no. 33: 1. Available at: doi:10.3389/frma.2018.00033.

Thelwall, M. 2020. The pros and cons of the use of altmetrics in research assessment. Scholarly Assessment Reports, Vol. 2, no. 1: 1-9. Available at: doi:10.29024/sar.10.

Williams, C. 2017. 5 tips for using altmetrics effectively in Editorial Board meetings. Blog – Altmetric. Available at: https://www.altmetric.com/blog/5-tips-for-using-altmetrics-effectively-in-editorial-board-meetings/

Xu, S. 2018. Issues in the interpretation of “Altmetrics” digital traces: a review. Frontiers In Research Metrics and Analytics, Vol. 3, no. 29: 1-8. Available at: doi:10.3389/frma.2018.00029.