Hadoop at VisualPath: The ecosystem hub

Ecosystem

Big Data ecosystem is evolving at a very rapid pace and it's difficult to keep track of the changes. The ecosystem provides a lot of choices (open source vs proprietary, free vs commercial, batch vs streaming). For a new-bee, it not only takes good amount of time and effort to get familiar with a framework, but it's also perplexing where to start.

Hadoop has got a lot of attention and many start with Hadoop, but Hadoop is not the solution for everything. Let's take graph processing, Hama and Giraph (though in incubating) are better then Hadoop for it. This page attempts to give an idea of the ecosystem around Big Data.

http://indoos.wordpress.com/2010/08/16/hadoop-ecosystem-world-map/ http://nosql.mypopescu.com/post/1541593207/quick-reference-hadoop-tools-ecosystem http://www.acunu.com/blogs/sean-owen/hadoop-universe/ http://karmasphere.com/Blog/making-sense-of-the-big-data-and-hadoop-ecosystem-finding-some-clarity.html http://www.onstrategies.com/blog/2011/06/06/hadoop-ecosystem-starts-crystallizing/ http://radar.oreilly.com/2012/02/what-is-apache-hadoop.html

Here are some of the useful articles/blogs to get started with the Hadoop ecosystem.

Sqoop

https://blogs.apache.org/sqoop/entry/apache_sqoop_overview

https://blogs.apache.org/sqoop/entry/apache_sqoop_highlights_of_sqoop

HBase

http://hbase.apache.org/book.html

http://www.larsgeorge.com/

https://blogs.apache.org/hbase/entry/coprocessor_introduction

https://github.com/jrkinley/hbase-bulk-import-example
http://www.deerwalk.com/blog/bulk-importing-data/

Giraph

http://engineering.linkedin.com/open-source/apache-giraph-framework-large-scale-graph-processing-hadoop-reaches-01-milestone

Oozie