Systems and methods for integrating analytic data warehouse with an in-memory database for batch and live streaming

Abstract

A method for processing batch and live streaming data is disclosed. The method may include receiving a first data object from a data source, the first data object being of information technology event data; processing the first data object; determining, by utilizing a message queue, a first identifier for the first data object; storing the processed first data object in a data sink layer; transferring the first data object to a data warehouse configured to apply an analytic algorithm to the first data object, wherein the transfer is based on the first identifier; determining, by applying the analytic algorithm to the first data object, a third data object; transferring the first data object and third data object to an in-memory database; retrieving and presenting the first data object and / or third data object from the in-memory database to present in a presentation layer of a user interface.

Images