Apache Beam wants to be uber-API for big data

A long-standing joke about the Hadoop ecosystem is that if you don’t like an API for a particular system, wait five minutes and two new Apache projects will spring up with shiny new APIs to learn.

It’s a lot to keep up with. Worse, it leads to a lot of work migrating to different projects merely to keep current. “We’ve implemented our streaming solution in Storm! Now we’ve redone it in Spark! We’re currently undergoing a rewrite of the core in Apache Flink (or Apex)!  … and we’ve forgotten what business case we were attempting to solve in the first place.”

To read this article in full or to leave a comment, please click here

from InfoWorld Big Data http://ift.tt/23Hj7i9
via IFTTT

Advertisements

Leave a Reply

Please log in using one of these methods to post your comment:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s