Users and Assessors in the Context of INEX: Are Relevance Dimensions Relevant?

Computer Science – Information Retrieval

Scientific paper

Rate now

  [ 0.00 ] – not rated yet Voters 0   Comments 0

Details

Scientific paper

The main aspects of XML retrieval are identified by analysing and comparing the following two behaviours: the behaviour of the assessor when judging the relevance of returned document components; and the behaviour of users when interacting with components of XML documents. We argue that the two INEX relevance dimensions, Exhaustivity and Specificity, are not orthogonal dimensions; indeed, an empirical analysis of each dimension reveals that the grades of the two dimensions are correlated to each other. By analysing the level of agreement between the assessor and the users, we aim at identifying the best units of retrieval. The results of our analysis show that the highest level of agreement is on highly relevant and on non-relevant document components, suggesting that only the end points of the INEX 10-point relevance scale are perceived in the same way by both the assessor and the users. We propose a new definition of relevance for XML retrieval and argue that its corresponding relevance scale would be a better choice for INEX.

No associations

LandOfFree

Say what you really think

Search LandOfFree.com for scientists and scientific papers. Rate them and share your experience with other people.

Rating

Users and Assessors in the Context of INEX: Are Relevance Dimensions Relevant? does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Users and Assessors in the Context of INEX: Are Relevance Dimensions Relevant?, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Users and Assessors in the Context of INEX: Are Relevance Dimensions Relevant? will most certainly appreciate the feedback.

Rate now

     

Profile ID: LFWR-SCP-O-46520

  Search
All data on this website is collected from public sources. Our data reflects the most accurate information available at the time of publication.