Data Mining Using High Performance Data Clouds: Experimental Studies Using Sector and Sphere

Details Data Mining Using High Performance Data Clouds: Experimental Studies Using Sector and Sphere Data Mining Using High Performance Data Clouds: Experimental Studies Using Sector and Sphere

2008-08-22

arxiv.org/abs/0808.3019v1

Computer Science

Distributed, Parallel, and Cluster Computing

Scientific paper

We describe the design and implementation of a high performance cloud that we have used to archive, analyze and mine large distributed data sets. By a cloud, we mean an infrastructure that provides resources and/or services over the Internet. A storage cloud provides storage services, while a compute cloud provides compute services. We describe the design of the Sector storage cloud and how it provides the storage services required by the Sphere compute cloud. We also describe the programming paradigm supported by the Sphere compute cloud. Sector and Sphere are designed for analyzing large data sets using computer clusters connected with wide area high performance networks (for example, 10+ Gb/s). We describe a distributed data mining application that we have developed using Sector and Sphere. Finally, we describe some experimental studies comparing Sector/Sphere to Hadoop.

Affiliated with

Also associated with

No associations

Rating

Data Mining Using High Performance Data Clouds: Experimental Studies Using Sector and Sphere does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Data Mining Using High Performance Data Clouds: Experimental Studies Using Sector and Sphere, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Data Mining Using High Performance Data Clouds: Experimental Studies Using Sector and Sphere will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-185364