Stop Thinking, Just Do!

Sungsoo Kim's Blog

BDAS Software Stack

tagsTags

23 October 2015


Article Source


BDAS Software Stack

BDAS, the Berkeley Data Analytics Stack, is an open source software stack that integrates software components being built by the AMPLab to make sense of Big Data.

BDAS consists of the components shown below. Components shown in Blue or Green are available for download now. Click on a title to go that project’s homepage.

In-house Apps
Access and
Interfaces
Processing Engine
Storage
Resource Virtualization
AMPLab Developed Spark Community 3rd Party In Development

 
 

In addition to BDAS, the AMPLab has released additional software components useful for processing data:

  • AMPCrowd: A RESTful web service for sending tasks to human workers on crowd platforms like Amazon’s Mechanical Turk. Used by the SampleClean project for context-heavy data cleaning tasks.
  •   In addition to BDAS, the AMPLab has released additional software components useful for processing data: - [AMPCrowd](http://amplab.github.io/ampcrowd): A RESTful web service for sending tasks to human workers on crowd platforms like Amazon’s Mechanical Turk. Used by the [SampleClean](http://sampleclean.org) project for context-heavy data cleaning tasks. Roadmap ------- BDAS will continue to evolve over the life of the AMPLab project, as existing components evolve and mature and new ones are added. Community --------- - Software project Meetups – Help organize monthly developer meetups around BDAS components. Check out the [Spark/Shark meetup group](http://www.meetup.com/spark-users/), the [Mesos meetup group](http://www.meetup.com/Distributed-data-processing-with-Mesos/), and the [Tachyon meetup group](http://www.meetup.com/Tachyon/) - [AMP Camp](http://ampcamp.berkeley.edu) “Big Data Bootcamp” – Two days packed full of software system intros, demos and hands-on exercises. Aims to bring practitioners with no prior experience up to speed and writing real code with real advanced algorithms. - Support – Unlike many research software prototypes that never see production use, we support BDAS software components by actively monitoring and responding on developer and user mailing lists.

comments powered by Disqus