Selective Encryption Manager for Streaming Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional database systems face challenges in efficiently processing and analyzing large amounts of streaming data in real-time due to double encryption requirements for sensitive data, which impacts performance in stream processing applications.

Innovation Solution

Implementing an encryption manager that determines the sensitivity of data attributes and calculates entropy values to decide whether encryption is necessary, thereby skipping unnecessary encryption processes for already encrypted data, thus optimizing the encryption process.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If encryption is applied to all sensitive data attributes in streaming data, then data security is improved, but processing performance deteriorates due to unnecessary encryption operations

Engineering Contradiction:
Improvedata securityVSAvoidprocessing performance
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent applies encryption selectively to specific data attributes based on their sensitivity classification rather than uniformly encrypting all data. The system determines sensitivity for each attribute individually and applies encryption only where necessary, optimizing the balance between security and performance by avoiding redundant encryption operations on non-sensitive or already-encrypted attributes

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements partial encryption action by encrypting only the portion of data that requires protection. Through entropy calculation and sensitivity determination, the system identifies and encrypts only the necessary sensitive attributes while leaving other attributes unencrypted, thus reducing unnecessary processing overhead while maintaining adequate security

Inventive Principle:
Principle #16Partial or excessive action

2Productivity

If entropy calculation is performed to determine encryption necessity, then processing efficiency is improved by avoiding unnecessary encryption, but computational overhead increases

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidcomputational overhead
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent performs entropy calculation and sensitivity determination as preliminary actions before the actual encryption process. By calculating entropy values and determining sensitivity in advance, the system可以避免不必要的加密操作,从而提高整体处理效率。虽然增加了预处理步骤的计算开销,但避免了后续不必要的加密计算

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses the data's own statistical properties (entropy) to determine whether encryption is needed, rather than requiring external classification or metadata. The entropy calculation inherently reveals whether data is already encrypted or sensitive, allowing the system to self-determine encryption necessity without additional overhead

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11588873B2Selective encryption of streaming data
Publication Date: 2023.02.21 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US11588873B2 patent drawing
  • US11588873B2 patent drawing
  • US11588873B2 patent drawing

AI summary

An embodiment includes determining, in response to receiving data at a source node for transmission as streaming data on a network, whether a characteristic of the data indicates that an attribute of the data includes sensitive information. The embodiment also includes calculating, responsive to determining that the attribute includes sensitive information, an entropy value for the attribute. The embodiment also includes determining, responsive to the calculating of the entropy value, a likelihood that the attribute is encrypted by comparing the entropy value to a threshold value. The embodiment also includes generating a parameter value for a cryptographic parameter for the attribute.