Cluster processing of an aggregated dataset

Abstract

Systems and methods are presented that may involve receiving a aggregated dataset, wherein the aggregated dataset includes data from a panel data source, a fact data source, and a dimension data source that have been associated with a standard population database. The process may also involve storing the aggregated data in a partition within a partitioned database, wherein the partition is associated with a data characteristic. The process may also involve associating a master processing node with a plurality of slave nodes, wherein each of the plurality of slave nodes is associated with a partition of the partitioned database. The process may also involve submitting an analytic query to the master processing node. The process may also involve assigning analytic processing to at least one of the plurality of slave nodes by the master processing node, wherein the assignment is based at least in part on the association of the partition with the data characteristic. The process may also involve reading the aggregated data from the partitioned database by the assigned slave node. The process may also involve analyzing the aggregated data by the assigned slave node, wherein the analysis produces a result at each slave node. The process may also involve combining the results from each of the plurality of slave nodes by the master processing node into a master result and reporting the master result to a user interface.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS[0001]This application claims the benefit of the following U.S. provisional applications: App. No. 60 / 887,573 filed on Jan. 31, 2007 and entitled “Analytic Platform,” App. No. 60 / 891,508 filed on Feb. 24, 2007 and entitled “Analytic Platform,” App. No. 60 / 891,936 filed on Feb. 27, 2007 and entitled “Analytic Platform,” App. No. 60 / 952,898 filed on Jul. 31, 2007 and entitled “Analytic Platform.”[0002]This application is a continuation-in-part of U.S. application Ser. No. 12 / 021,263 filed on Jan. 28, 2008 and entitled “Associating a Granting Matrix with an Analytic Platform”, which claims the benefit of the following U.S. provisional applications: App. No. 60 / 886,798 filed on Jan. 26, 2007 and entitled “A Method of Aggregating Data,” App. No. 60 / 886,801 filed on Jan. 26, 2007 and entitled “Utilizing Aggregated Data.”[0003]Each of the above applications is incorporated by reference herein in its entirety.BACKGROUND[0004]1. Field[0005]This inventio...

AI Technical Summary

Problems solved by technology

In practice, going back and changing the a priori decisions can lift these constraints, but this requires an arduous and computationally complex restructuring and reprocessing of data.

In practice, configuring a system to apply the releasability rules is an error-prone process that requires extensive manual set up and results in a brittle mechanism that cannot adapt to on-the-fly changes in data, dimensions, third parties, rules, aggregations, projections, user queries, and so on.

Existing methods allow an analyst to choose a projection methodology and thereby affect the statistical qualities of the output, but this does not satisfy the analyst's desire to directly dictate the statistical qualities.

Information systems are a significant bottle neck for market analysis activities.

The architecture of information systems is often not designed to provide on-demand flexible access, integration at a very granular level, or many other critical capabilities necessary to support growth.

Thus, information systems are counter-productive to growth.

Hundreds of market and consumer databases make it very difficult to manage or integrate data.

Restatements of data hierarchies waste precious time and are very expensive.

Navigation from among views of data, such as from global views to regional to neighborhood to store views is virtually impossible, because there are different hierarchies used to store data from global to region to neighborhood to store-level data.

Analyses and insights often take weeks or months, or they are never produced.

Currently, market analysis, business intelligence, and the like often use rigid data cubes that may include hundreds of databases that are impossible to integrate.

This may make it almost impossible to navigate from global uses that are used, for example, to develop overall company strategy, down to specific program implementation or customer-driven uses.

These ad hoc analytic tools and infrastructure are fragmented and disconnected.

Images