Open Data Sharing Layer for Delta Logs Across Mixed File Formats

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing Delta Sharing protocols do not support widely used customer data formats such as .csv, Apache Avro, and Apache ORC, requiring expensive data copy/conversion and risking loss of source truth.

Innovation Solution

A data share server generates a data log associated with a data table at a data source, allowing secure sharing of data tables with clients regardless of data format, using a cloud computing or data analytics environment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If Delta Sharing protocol is used with limited data formats (Parquet, Delta), then secure real-time data sharing is achieved, but support for widely used customer data formats (.csv, Apache Avro, Apache ORC, JSON) is lost

Engineering Contradiction:

Improvesecure real-time data sharingVSAvoidsupport for customer data formats

Core Design Contradiction:

ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent introduces an intermediary conversion layer that translates between Delta Sharing's supported formats (Parquet, Delta) and customer's data formats (.csv, Apache Avro, Apache ORC, JSON). This intermediary component enables format compatibility without requiring changes to the core Delta Sharing protocol, thus maintaining security while expanding format support.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Adaptability or versatility

If data copy/conversion is performed to support unsupported formats, then format compatibility is achieved, but expensive data copy/conversion costs are incurred and potential loss of source of truth occurs

Engineering Contradiction:

Improveformat compatibilityVSAvoiddata copy/conversion cost

Core Design Contradiction:

Adaptability or versatilityVSLoss of energy

Solution Approach 1:

The patent implements a virtual copying mechanism where instead of physically copying and converting data, it creates a virtual representation or view of the data in the required format. This allows clients to access data in their preferred format without actual data movement, eliminating conversion costs and preserving the single source of truth.

Inventive Principle:

Principle #26Copying

Data Source

PatentUS20260064714A1System and method for providing an open data share for data formats with delta sharing

Publication Date: 2026.03.05 ORACLE INT CORP

AI summary

Embodiments described herein are generally related to cloud computing, cloud infrastructure, or data analytics environments, and are particularly directed to systems and methods for use with a data analytics environment or other cloud computing environment to provide an open data share for data formats with Delta Sharing. The systems and methods described herein allow for a data sharing service to share data to a client regardless of the format of the data. In accordance with an embodiment, a data share server generates a data log associated with a data table at data source. The data share server can receive a request from a data sharing client. Based upon the created data log associated with the data source, the data share server can share the data table, together with the generated data log associated therewith, to the data sharing client.