Slides

G. De Francisci Morales SAMOA: A Platform for Mining Big Data Streams Keynote Talk at RAMSS '13: 2nd International Workshop on Real-Time Analysis and Mining of Social Streams WWW, Rio De Janeiro, 2013.

API Javadoc Reference

https://samoa-project.net/docs/api

Mailing lists

SAMOA users: https://groups.google.com/group/samoa-user

SAMOA developers: https://groups.google.com/group/samoa-dev

Contributors

List of contributors to the SAMOA project.

Build SAMOA

• Apache Storm

  Go to the folder where you want to store your project, and clone the new repository:

  ~$git clone [email protected]:yahoo/samoa.git

  ~$cd samoa

  ~$mvn -Pstorm package

  The deployable jar for SAMOA will be in target/SAMOA-Storm-0.0.1-SNAPSHOT.jar.

• Apache S4

  If you want to compile SAMOA for S4, you will need to install the S4 dependencies manually as explained in Executing SAMOA with Apache S4.

  ~$git clone [email protected]:yahoo/samoa.git

  ~$cd samoa

  ~$mvn -Ps4 package

  The deployable jar for SAMOA will be in target/SAMOA-S4-0.0.1-SNAPSHOT.jar.

• Local Test Mode

  If you want to test SAMOA in a local environment, simply clone the repository and install SAMOA.

  ~$git clone [email protected]:yahoo/samoa.git

  ~$cd samoa

  ~$mvn package

  The deployable jar for SAMOA will be in target/SAMOA-Local-0.0.1-SNAPSHOT.jar.

Getting Started

• Download SAMOA

  ~$git clone [email protected]:yahoo/samoa.git

  ~$cd samoa

  ~$mvn package

• Download the Forest CoverType dataset

  If you want to compile SAMOA for S4, you will need to install the S4 dependencies manually as explained in Executing SAMOA with Apache S4.

  ~$wget "https://downloads.sourceforge.net/project/moa-datastream/Datasets/Classification/covtypeNorm.arff.zip"

  ~$unzip covtypeNorm.arff.zip

  Forest Covertype contains the forest cover type for 30 x 30 meter cells obtained from the US Forest Service (USFS) Region 2 Resource Information System (RIS) data. It contains 581,012 instances and 54 attributes, and it has been used in several articles on data stream classification.

• Run an example

  Classifying the CoverType dataset with the bagging algorithm

  ~$bin/samoa local target/SAMOA-Local-0.0.1-SNAPSHOT.jar "PrequentialEvaluation -l classifiers.ensemble.Bagging -s (ArffFileStream -f covtypeNorm.arff) -f 100000"

  The output will be a list of the evaluation results, plotted each 100,000 instances.