Pre-aggregated User Behavior Data Reporting System

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Web page developers face challenges in efficiently processing and analyzing user behavior data due to high processing power and time requirements, making it difficult to generate timely insights from raw data.

Innovation Solution

Preprocessing historical raw transaction data by aggregating and indexing it, allowing for rapid generation of reports on user behavior, reducing the need for extensive processing power and enabling timely interaction with data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If raw user behavior data is processed in real-time, then timely insights can be obtained, but processing power requirements become prohibitively high

Engineering Contradiction:

Improvetime to generate insightsVSAvoidprocessing power requirements

Core Design Contradiction:

Loss of timeVSPower

Solution Approach 1:

The system performs preliminary aggregation of raw user behavior data into summary statistics (e.g., page view counts, unique visitor counts) and stores these pre-computed results. When a report query is received, the system retrieves and processes only the pre-aggregated data rather than processing all raw transactions, thereby reducing processing power requirements while maintaining timely insight generation.

Inventive Principle:

Principle #10Preliminary action

2Measurement precision

If detailed raw data is stored and processed, then comprehensive analysis is possible, but processing time increases significantly

Engineering Contradiction:

Improveanalysis granularityVSAvoidprocessing time

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

The system segments the data processing task into two stages: (1) pre-aggregation of raw data into summary statistics grouped by relevant dimensions (page ID, time period, user characteristics), and (2) query-time processing of only the pre-aggregated segments. This segmentation allows comprehensive analysis capabilities while reducing processing time by working with condensed data representations.

Inventive Principle:

Principle #1Segmentation

3Reliability

If extensive raw data processing is performed, then accurate user behavior insights are obtained, but the system cannot serve multiple users simultaneously with limited resources

Engineering Contradiction:

Improveaccuracy of user behavior insightsVSAvoidnumber of users served

Core Design Contradiction:

ReliabilityVSProductivity

Solution Approach 1:

The system pre-computes and stores aggregated user behavior statistics for multiple time periods and page groups in advance. When multiple users request reports, the system retrieves these pre-computed results and applies minimal filtering or aggregation based on user-specific query parameters. This approach maintains accurate insights while enabling simultaneous service to multiple users with limited processing resources.

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS7533130B2User behavior reporting based on pre-aggregated activity data

Publication Date: 2009.05.12 R2 SOLUTIONS LLC

AI summary

User behavior relative to particular web pages is reported on. The user behavior is represented by historical raw transaction data for the users with respect to the web pages. A collection of the historical raw transaction data is processed, including aggregating the historical raw transaction data and storing the aggregated historical raw transaction data. A report query is received and the aggregated historical raw transaction data is processed based on the report query. A report is caused to be generated based on the result of processing the aggregated historical raw transaction data.