Computer Science – Information Retrieval
Scientific paper
2005-10-19
Computer Science
Information Retrieval
This paper pointed out the future direction for novelty detection research. 37 pages, double spaced version
Scientific paper
Sentence level novelty detection aims at reducing redundant sentences from a sentence list. In the task, sentences appearing later in the list with no new meanings are eliminated. Aiming at a better accuracy for detecting redundancy, this paper reveals the nature of the novelty detection task currently overlooked by the Novelty community $-$ Novelty as a combination of the partial overlap (PO, two sentences sharing common facts) and complete overlap (CO, the first sentence covers all the facts of the second sentence) relations. By formalizing novelty detection as a combination of the two relations between sentences, new viewpoints toward techniques dealing with Novelty are proposed. Among the methods discussed, the similarity, overlap, pool and language modeling approaches are commonly used. Furthermore, a novel approach, selected pool method is provided, which is immediate following the nature of the task. Experimental results obtained on all the three currently available novelty datasets showed that selected pool is significantly better or no worse than the current methods. Knowledge about the nature of the task also affects the evaluation methodologies. We propose new evaluation measures for Novelty according to the nature of the task, as well as possible directions for future study.
Ma Shaoping
Zhang Min
Zhao Le
No associations
LandOfFree
The Nature of Novelty Detection does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with The Nature of Novelty Detection, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and The Nature of Novelty Detection will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-241895