Inconsistencies of Recently Proposed Citation Impact Indicators and how to Avoid Them

Details Inconsistencies of Recently Proposed Citation Impact Indicators and how to Avoid Them Inconsistencies of Recently Proposed Citation Impact Indicators and how to Avoid Them

2012-02-17

arxiv.org/abs/1202.3861v2

Statistics

Applications

14 pages, 9 figures, accepted by Journal of the American Society for Information Science and Technology Final version with sli

Scientific paper

It is shown that under certain circumstances in particular for small datasets the recently proposed citation impact indicators I3(6PR) and R(6,k) behave inconsistently when additional papers or citations are taken into consideration. Three simple examples are presented, in which the indicators fluctuate strongly and the ranking of scientists in the evaluated group is sometimes completely mixed up by minor changes in the data base. The erratic behavior is traced to the specific way in which weights are attributed to the six percentile rank classes, specifically for the tied papers. For 100 percentile rank classes the effects will be less serious. For the 6 classes it is demonstrated that a different way of assigning weights avoids these problems, although the non-linearity of the weights for the different percentile rank classes can still lead to (much less frequent) changes in the ranking. This behavior is not undesired, because it can be used to correct for differences in citation behavior in different fields. Remaining deviations from the theoretical value R(6,k) = 1.91 can be avoided by a new scoring rule, the fractional scoring. Previously proposed consistency criteria are amended by another property of strict independence which a performance indicator should aim at.

Affiliated with

Also associated with

No associations

Rating

Inconsistencies of Recently Proposed Citation Impact Indicators and how to Avoid Them does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Inconsistencies of Recently Proposed Citation Impact Indicators and how to Avoid Them, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Inconsistencies of Recently Proposed Citation Impact Indicators and how to Avoid Them will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-35477