Computer Science – Artificial Intelligence
Scientific paper
2011-09-09
Journal Of Artificial Intelligence Research, Volume 24, pages 305-339, 2005
Computer Science
Artificial Intelligence
Scientific paper
10.1613/jair.1648
We present a novel approach to the automatic acquisition of taxonomies or concept hierarchies from a text corpus. The approach is based on Formal Concept Analysis (FCA), a method mainly used for the analysis of data, i.e. for investigating and processing explicitly given information. We follow Harris distributional hypothesis and model the context of a certain term as a vector representing syntactic dependencies which are automatically acquired from the text corpus with a linguistic parser. On the basis of this context information, FCA produces a lattice that we convert into a special kind of partial order constituting a concept hierarchy. The approach is evaluated by comparing the resulting concept hierarchies with hand-crafted taxonomies for two domains: tourism and finance. We also directly compare our approach with hierarchical agglomerative clustering as well as with Bi-Section-KMeans as an instance of a divisive clustering algorithm. Furthermore, we investigate the impact of using different measures weighting the contribution of each attribute as well as of applying a particular smoothing technique to cope with data sparseness.
Cimiano P.
Hotho Andreas
Staab Steffen
No associations
LandOfFree
Learning Concept Hierarchies from Text Corpora using Formal Concept Analysis does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Learning Concept Hierarchies from Text Corpora using Formal Concept Analysis, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Learning Concept Hierarchies from Text Corpora using Formal Concept Analysis will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-38068