Distantly Labeling Data for Large Scale Cross-Document Coreference

Computer Science – Artificial Intelligence

Scientific paper

Rate now

  [ 0.00 ] – not rated yet Voters 0   Comments 0

Details

16 pages, submitted to ECML 2010

Scientific paper

Cross-document coreference, the problem of resolving entity mentions across multi-document collections, is crucial to automated knowledge base construction and data mining tasks. However, the scarcity of large labeled data sets has hindered supervised machine learning research for this task. In this paper we develop and demonstrate an approach based on ``distantly-labeling'' a data set from which we can train a discriminative cross-document coreference model. In particular we build a dataset of more than a million people mentions extracted from 3.5 years of New York Times articles, leverage Wikipedia for distant labeling with a generative model (and measure the reliability of such labeling); then we train and evaluate a conditional random field coreference model that has factors on cross-document entities as well as mention-pairs. This coreference model obtains high accuracy in resolving mentions and entities that are not present in the training data, indicating applicability to non-Wikipedia data. Given the large amount of data, our work is also an exercise demonstrating the scalability of our approach.

No associations

LandOfFree

Say what you really think

Search LandOfFree.com for scientists and scientific papers. Rate them and share your experience with other people.

Rating

Distantly Labeling Data for Large Scale Cross-Document Coreference does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Distantly Labeling Data for Large Scale Cross-Document Coreference, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Distantly Labeling Data for Large Scale Cross-Document Coreference will most certainly appreciate the feedback.

Rate now

     

Profile ID: LFWR-SCP-O-119017

  Search
All data on this website is collected from public sources. Our data reflects the most accurate information available at the time of publication.