Last year, Twitter dropped two bombshells. First, it would no longer use Apache Storm in production. Second, it had replaced it with a homegrown data processing system, Heron.
Despite releasing a paper detailing the architecture of Heron, Twitter’s alternative to Storm remained hidden in Twitter’s data centers. That all changed last week when Twitter released Heron under an open source license. So what is Heron, and where does it fit in the world of data processing at scale?