Implementing Responsible Research Assessment in Practice: A Case Study of an Integrated Bibliometric Analysis System

Suntae Kim

doi:10.5865/IJKCT.2026.16.3.127

Implementing Responsible Research Assessment in Practice

A Case Study of an Integrated Bibliometric Analysis System

Authors

Suntae Kim Professor, Jeonbuk National University, Korea http://orcid.org/0000-0002-8726-6367

DOI:

https://doi.org/10.5865/IJKCT.2026.16.3.127

Keywords:

Bibliometrics, Research Evaluation, Research Performance, Analysis, Decision Support System, Information Systems, Evaluation, Academic Libraries

Abstract

Purpose: This study presents the design and an exploratory pilot evaluation of ORAP (Open Research Analysis Platform), a web-based system for data-driven university research management. Unlike SciVal and InCites, which report metrics separately, ORAP integrates multiple bibliometric indicators into a single, transparently decomposable composite score.

Design/methodology/approach: ORAP provides a hierarchical weighted composite score, Citation Gap analysis, a Four-Quadrant Strategic Matrix, and publication-level drilldown. Analyzing institutional SciVal exports, it complements rather than replaces the underlying subscription. Seven users at a Korean national university evaluated it using an instrument adapted from the DeLone and McLean model; results are exploratory.

Findings: The study reveals that the overall mean was 4.40 out of 5.0, with usefulness highest (M = 4.71) and use experience lowest (M = 3.57).

Originality/Value: The study shows how responsible-assessment principles can be operationalized in a working tool combining composite scoring, adjustable weighting, and publication-level transparency, offering a lower-cost complement to commercial platforms.

Publication Facts

This article

Author statements

Data availability

N/A

16%

External funding

N/A

32%

Competing interests

N/A

11%

This journal

Other journals

Articles accepted

44%

33%

Days to publication

136

145

Indexed in

Editor & editorial board: profiles
Society: N/A
Publisher: RIKCDT(Research Institute for Knowledge Content Development & Technology)

Downloads

Published

2026-09-29

How to Cite

Kim, S. (2026). Implementing Responsible Research Assessment in Practice: A Case Study of an Integrated Bibliometric Analysis System. International Journal of Knowledge Content Development & Technology, 16(3), 127–150. https://doi.org/10.5865/IJKCT.2026.16.3.127

Download Citation

Issue

Vol. 16 No. 3 (2026)

Section

Articles

License

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

The authors retain copyright in their work.
The RIKCDT is granted a non-exclusive, perpetual worldwide license to publish, disseminate, and maintain the version of record in all media formats, including print and electronic formats.
The article will be published under a Creative Commons Attribution-NonCommercial-NoDerivatives (CC BY-NC-ND 4.0) license, which permits users to read, download, and share the work for non-commercial purposes with appropriate attribution, but does not permit any modification, adaptation, or creation of derivative works.
IJKCDT articles may not be republished in whole or in part, whether for commercial purposes, in print or online.
No dispute shall be raised on matters RIKCDT already managed on research papers published in previous journal.