Wrapper Maintenance: A Machine Learning Approach

Computer Science – Artificial Intelligence

Scientific paper

Rate now

  [ 0.00 ] – not rated yet Voters 0   Comments 0

Details

Scientific paper

10.1613/jair.1145

The proliferation of online information sources has led to an increased use of wrappers for extracting data from Web sources. While most of the previous research has focused on quick and efficient generation of wrappers, the development of tools for wrapper maintenance has received less attention. This is an important research problem because Web sources often change in ways that prevent the wrappers from extracting data correctly. We present an efficient algorithm that learns structural information about data from positive examples alone. We describe how this information can be used for two wrapper maintenance applications: wrapper verification and reinduction. The wrapper verification system detects when a wrapper is not extracting correct data, usually because the Web source has changed its format. The reinduction algorithm automatically recovers from changes in the Web source by identifying data on Web pages so that a new wrapper may be generated for this source. To validate our approach, we monitored 27 wrappers over a period of a year. The verification algorithm correctly discovered 35 of the 37 wrapper changes, and made 16 mistakes, resulting in precision of 0.73 and recall of 0.95. We validated the reinduction algorithm on ten Web sources. We were able to successfully reinduce the wrappers, obtaining precision and recall values of 0.90 and 0.80 on the data extraction task.

No associations

LandOfFree

Say what you really think

Search LandOfFree.com for scientists and scientific papers. Rate them and share your experience with other people.

Rating

Wrapper Maintenance: A Machine Learning Approach does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Wrapper Maintenance: A Machine Learning Approach, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Wrapper Maintenance: A Machine Learning Approach will most certainly appreciate the feedback.

Rate now

     

Profile ID: LFWR-SCP-O-393632

  Search
All data on this website is collected from public sources. Our data reflects the most accurate information available at the time of publication.