OLAP Database Update Sequencing via Directed Acyclic Graph

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current OLAP systems lack the ability to sequence and prioritize units of work (UsOW) effectively, leading to potential execution failures due to unmet prerequisites and inefficient resource allocation, which impacts user experience and computational efficiency.

Innovation Solution

The implementation of an execution plan controller that generates and manages unit of work lists to preserve prerequisites, ensuring pseudo-synchronous processing by dispatching UsOW in a controlled manner, using a directed acyclic graph to arrange tasks and monitor completion status, thereby preventing execution failures and optimizing resource utilization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If units of work are processed without sequencing control in OLAP systems, then resource allocation flexibility is improved, but execution reliability deteriorates due to unmet prerequisites

Engineering Contradiction:

Improveresource allocation flexibilityVSAvoidexecution reliability

Core Design Contradiction:

Adaptability or versatilityVSReliability

Solution Approach 1:

The system performs preliminary sequencing of units of work using a directed acyclic graph to establish execution order before actual processing begins. This preliminary action ensures prerequisites are met while maintaining resource flexibility during execution.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

A sequencing layer is introduced as an intermediary between resource allocation and execution. This intermediary component manages the conflict by decoupling prerequisite satisfaction from resource assignment, allowing both flexibility and reliability.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Productivity

If units of work are processed in parallel without ordering, then computational efficiency is improved, but error rate increases due to prerequisite violations

Engineering Contradiction:

Improvecomputational efficiencyVSAvoiderror rate

Core Design Contradiction:

ProductivityVSReliability

Solution Approach 1:

Units of work are segmented into distinct execution stages based on their prerequisite relationships in the directed acyclic graph. This segmentation allows parallel processing within stages while maintaining sequential integrity across stages, reducing errors without sacrificing efficiency.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The system dynamically adjusts execution ordering based on real-time resource availability and prerequisite satisfaction. This dynamic approach enables maximum parallelization while preventing prerequisite violations that would cause errors.

Inventive Principle:

Principle #15Dynamics

3Ease of operation

If user control over processing order is added to OLAP systems, then user experience is improved, but system complexity increases

Engineering Contradiction:

Improveuser experienceVSAvoidsystem complexity

Core Design Contradiction:

Ease of operationVSDevice complexity

Solution Approach 1:

The system provides self-service sequencing capabilities where users can define their own execution orders through simple interfaces. The complex Directed Acyclic Graph management is handled automatically by the system, giving users control without exposing system complexity.

Inventive Principle:

Principle #25Self-service

Data Source

PatentUS11232123B2Pseudo-synchronous processing by an analytic query and build cluster

Publication Date: 2022.01.25 SALESFORCE INC

AI summary

The technology disclosed relates to creating and frequently updating multiple online analytic processing (OLAP) analytic databases from an online transaction processing (OLTP) transaction updatable system that includes transaction commit, rollback, and field level security capabilities. It also relates to transparently decoupling extraction from rebuilding of frequently updated OLAP analytic databases from the OLTP transaction updatable system.