Saturday, June 30, 2018

Implementing Time Windowing in an Evented Streaming System

Hi there! Welcome to the second and final installment of my trending Twitter hashtags example series. In Part 1, we covered the basic dataflow and logic of the application. In part 2, we are going to take a look at how windowing for the "trending" aspect of our application is implemented.

When implementing any sort of "trending" application, what we are really doing is implementing some kind of windowing. That is, for some duration of time, we want to know what was popular, what was "trending" during that period of time. To do that, we need to implement an appropriate windowing algorithm. We'll start by taking a look at a few different types of windowing and then proceed to dive into how windowing was implemented in our Twitter Trending Hashtags example application.



from DZone.com Feed https://ift.tt/2Ktvkqj

No comments:

Post a Comment