Database Log Access via Incremental Sub-Control Files

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Database log access performance is hindered by the need to read and query entire control files, which can be inefficient and impact disk input/output operations, especially when replication tools access database logs.

Innovation Solution

The approach involves determining the least used control file based on usage patterns and providing incremental sub-control files that offer a granular, filtered view of log data, allowing for faster and more efficient querying by segregating control files for different workloads and using incremental sub-control files for incremental queries.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the entire control file is read and queried for database log access, then complete log data is available for querying, but disk input/output operations are inefficient and performance is impacted

Engineering Contradiction:
Improvelog data completenessVSAvoiddisk input/output performance
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The control file is divided into multiple control file segments, each containing a portion of the log data. Instead of reading the entire control file, the system reads only the specific segment needed for the query, reducing I/O operations while maintaining data completeness for the required time range.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system extracts and stores log data into separate control file segments organized by time ranges. When a query is made, only the relevant segment containing the requested time range is extracted and read, rather than processing the entire control file, thus improving I/O efficiency.

Inventive Principle:
Principle #2Taking out (Extraction)

2Productivity

If multiple control files are used for database operations, then log data can be organized by time ranges, but determining the optimal control file adds complexity to access operations

Engineering Contradiction:
Improvelog access efficiencyVSAvoidcontrol file management complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

Each control file segment contains metadata including time range information and identifiers. When a query is received, the system autonomously determines which segment to read by examining this embedded metadata, without requiring complex external management logic. The segments serve themselves by containing all necessary information for their own identification and retrieval.

Inventive Principle:
Principle #25Self-service

3Speed

If incremental sub-control files are provided for querying incremental log data, then querying performance is improved, but the system complexity increases due to multiple file types

Engineering Contradiction:
Improvequerying speedVSAvoidfile structure complexity
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The system dynamically determines whether to return a full control file segment or an incremental sub-control file based on the query type and requirements. For incremental queries, it provides optimized incremental sub-control files with only the changed data. This dynamic adaptation improves query speed while managing complexity through context-aware file generation.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11249967B1Database access performance improvement
Publication Date: 2022.02.15 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US11249967B1 patent drawing
  • US11249967B1 patent drawing
  • US11249967B1 patent drawing

AI summary

In an approach for database log management and log access performance improvement, a processor receives an access request for an optimal control file to minimize a database access performance impact. A processor determines the optimal control file based on usage of a plurality of control files for a database. A processor outputs the optimal control file to a user to access the database. A processor provides an incremental sub-control file of the optimal control file to the user. The incremental sub-control file is an incremental view of the optimal control file to query the incremental log data in the database.