Learning Multi-modal Similarity

Details Learning Multi-modal Similarity Learning Multi-modal Similarity

2010-08-30

arxiv.org/abs/1008.5163v1

Computer Science

Artificial Intelligence

Scientific paper

In many applications involving multi-media data, the definition of similarity between items is integral to several key tasks, e.g., nearest-neighbor retrieval, classification, and recommendation. Data in such regimes typically exhibits multiple modalities, such as acoustic and visual content of video. Integrating such heterogeneous data to form a holistic similarity space is therefore a key challenge to be overcome in many real-world applications. We present a novel multiple kernel learning technique for integrating heterogeneous data into a single, unified similarity space. Our algorithm learns an optimal ensemble of kernel transfor- mations which conform to measurements of human perceptual similarity, as expressed by relative comparisons. To cope with the ubiquitous problems of subjectivity and inconsistency in multi- media similarity, we develop graph-based techniques to filter similarity measurements, resulting in a simplified and robust training procedure.

Affiliated with

Also associated with

No associations

Rating

Learning Multi-modal Similarity does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Learning Multi-modal Similarity, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Learning Multi-modal Similarity will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-179219