Paper 4
Distributed Large-Scale Information FilteringAuthors: Christos Tryfonopoulos, Stratos Idreos,Manolis Koubarakis, and Paraskevi Raftopoulou |
AbstractWe study the problem of distributed resource sharing in peer-to-peer networks and focus on the problem of information fi ltering. In our setting, subscriptions and publications are specifi ed using an expressive attribute-value representation that supports both the Boolean and Vector Space models.We use an extension of the distributed hash table Chord to organise the nodes and store user subscriptions, and utilise efficient publication protocols that keep the network traffic and latency low at fi ltering time. To verify our approach, we evaluate the proposed protocols experimentally using thousands of nodes, millions of user subscriptions, and two diff erent real-life corpora. We also study three important facets of the load-balancing problem in such a scenario and present a novel algorithm that manages to distribute the load evenly among the nodes. Our results show that the designed protocols are scalable and efficient: they achieve expressive information fi ltering functionality with low message traffic and latency. |
|
|