The Nature of Novelty Detection

Computer Science – Information Retrieval

Scientific paper

Rate now

  [ 0.00 ] – not rated yet Voters 0   Comments 0

Details

This paper pointed out the future direction for novelty detection research. 37 pages, double spaced version

Scientific paper

Sentence level novelty detection aims at reducing redundant sentences from a sentence list. In the task, sentences appearing later in the list with no new meanings are eliminated. Aiming at a better accuracy for detecting redundancy, this paper reveals the nature of the novelty detection task currently overlooked by the Novelty community $-$ Novelty as a combination of the partial overlap (PO, two sentences sharing common facts) and complete overlap (CO, the first sentence covers all the facts of the second sentence) relations. By formalizing novelty detection as a combination of the two relations between sentences, new viewpoints toward techniques dealing with Novelty are proposed. Among the methods discussed, the similarity, overlap, pool and language modeling approaches are commonly used. Furthermore, a novel approach, selected pool method is provided, which is immediate following the nature of the task. Experimental results obtained on all the three currently available novelty datasets showed that selected pool is significantly better or no worse than the current methods. Knowledge about the nature of the task also affects the evaluation methodologies. We propose new evaluation measures for Novelty according to the nature of the task, as well as possible directions for future study.

No associations

LandOfFree

Say what you really think

Search LandOfFree.com for scientists and scientific papers. Rate them and share your experience with other people.

Rating

The Nature of Novelty Detection does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with The Nature of Novelty Detection, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and The Nature of Novelty Detection will most certainly appreciate the feedback.

Rate now

     

Profile ID: LFWR-SCP-O-241895

  Search
All data on this website is collected from public sources. Our data reflects the most accurate information available at the time of publication.