Data Has a Half-Life

Integration is your differentiation!

In the modern world what makes the difference is the shelf-life of your data analysis. When you run analysis on your data to derive insights, these insights rely on the recency of the data. Deriving one from the other introduces latency; the insights go stale as time passes and their value diminishes. After all, who wants to know yesterday’s weather. We want to know today’s and better still tomorrow’s. What we need to do is derive our insights continuously. As one data record changes, so does the derivation. Then the insights stay up to date.

By way of a demo, I’ll show how this is done using a Trading Platform where we wish to see all trades and trade summary information together. All you need is a stream processing engine integrated with a fast data store. Changes in core data in the data store flow through streaming analytics to create derived data. If it’s all integrated, performance is excellent for high volume and low latency.