Discovering Emerging Topics in Social Streams via Link Anomaly Detection

Details Discovering Emerging Topics in Social Streams via Link Anomaly Detection Discovering Emerging Topics in Social Streams via Link Anomaly Detection

2011-10-13

arxiv.org/abs/1110.2899v1

Statistics

Machine Learning

10 pages, 6 figures

Scientific paper

Detection of emerging topics are now receiving renewed interest motivated by the rapid growth of social networks. Conventional term-frequency-based approaches may not be appropriate in this context, because the information exchanged are not only texts but also images, URLs, and videos. We focus on the social aspects of theses networks. That is, the links between users that are generated dynamically intentionally or unintentionally through replies, mentions, and retweets. We propose a probability model of the mentioning behaviour of a social network user, and propose to detect the emergence of a new topic from the anomaly measured through the model. We combine the proposed mention anomaly score with a recently proposed change-point detection technique based on the Sequentially Discounting Normalized Maximum Likelihood (SDNML), or with Kleinberg's burst model. Aggregating anomaly scores from hundreds of users, we show that we can detect emerging topics only based on the reply/mention relationships in social network posts. We demonstrate our technique in a number of real data sets we gathered from Twitter. The experiments show that the proposed mention-anomaly-based approaches can detect new topics at least as early as the conventional term-frequency-based approach, and sometimes much earlier when the keyword is ill-defined.

Affiliated with

Also associated with

No associations

Rating

Discovering Emerging Topics in Social Streams via Link Anomaly Detection does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Discovering Emerging Topics in Social Streams via Link Anomaly Detection, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Discovering Emerging Topics in Social Streams via Link Anomaly Detection will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-500135