Encrypted Database Search via Segmented Tables

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Encrypted data in databases is difficult to search using wildcards or partial matches, as existing solutions require exact matches, which conflicts with business needs for full-text searches in applications handling personally identifiable information.

Innovation Solution

A searchable encrypted database scheme is implemented by separating encrypted data into multiple tables, where plaintext versions of encrypted columns are stored in searchable tables with encrypted foreign keys, allowing for decryption and querying without linking to other sensitive data, enabling full-text searches using wildcards.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If encrypted data is stored in a database, then security and privacy protection are improved, but the ability to search the data using wildcards or partial matches deteriorates

Engineering Contradiction:
ImprovesecurityVSAvoidsearch ability
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent segments the database into multiple tables: a source table storing encrypted data with encrypted foreign keys, and separate searchable tables storing plaintext versions of specific columns. This segmentation allows the encrypted data to remain secure while enabling wildcard searches on the plaintext copies without exposing the actual encrypted values or their direct associations.

Inventive Principle:
Principle #1Segmentation

2Ease of operation

If hashing function is used to enable search on encrypted data, then search capability is improved, but the ability to perform wildcard or partial match searches deteriorates

Engineering Contradiction:
Improvesearch capabilityVSAvoidwildcard search flexibility
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent performs preliminary action by creating and storing plaintext copies of encrypted columns in separate searchable tables before any search operations occur. These pre-prepared plaintext tables enable both exact match and wildcard searches without requiring hashing operations during query execution, thus maintaining full search flexibility.

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If plaintext data is stored to enable full-text searches, then search flexibility is improved, but security and privacy protection deteriorate

Engineering Contradiction:
Improvesearch flexibilityVSAvoidsecurity
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent extracts only the specific columns that need to be searchable from the encrypted source table and stores them as plaintext in separate searchable tables. This extraction allows full-text search flexibility on those specific columns while the main encrypted data remains protected. The searchable tables contain only what is necessary for search operations.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent introduces searchable tables as intermediary structures between the encrypted source data and the search query interface. These intermediary tables provide the flexibility needed for wildcard and partial match searches without exposing the encrypted data structure or enabling direct attacks on the encryption scheme, as they contain only plaintext copies of specific columns without associated encrypted foreign keys.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Reliability

If encrypted foreign keys are used to link data, then security is improved, but the ability to decrypt and query data efficiently deteriorates

Engineering Contradiction:
ImprovesecurityVSAvoidquery efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent extracts the decryption functionality and performs decryption only when necessary for retrieving specific records, rather than maintaining continuous decrypted states. The searchable tables are designed to return encrypted foreign keys that are decrypted only for the specific records matched by the search, improving efficiency by minimizing decryption operations while maintaining security.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentEP3256967B1Increasing search ability of private, encrypted data
Publication Date: 2023.09.27 VISA INTERNATIONAL SERVICE ASSOCIATION
  • EP3256967B1 patent drawingFigure 1
  • EP3256967B1 patent drawingFigure 2
  • EP3256967B1 patent drawingFigure 3

AI summary

Techniques are provided to allow full search for encrypted data within a database. In some embodiments, searchable data may be separated into different searchable tables in a database in such a way that encrypted data is stored as plaintext but has no usable link to other data within the source database. In some embodiments, performing a query on a particular user data may result in the retrieval of an encrypted identifier, which may then be decrypted via an encryption module. A second search based on the decrypted identifier may produce a set of relevant search results from a source table.