Quantum-Inspired Convolutional Kernels for Neural Networks

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current machine learning methods, particularly in deep learning, face computational intensity challenges during both training and inference, especially as model complexity increases, necessitating improved performance and efficiency.

Innovation Solution

The implementation of quantum-inspired convolutional kernels within neural networks, which include quantum convolutional layers that perform quantum convolution, generate output wave functions, and derive marginal probability distributions to facilitate inference.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If quantum convolutional layers are implemented in neural networks, then representational power and flexibility are improved, but computational complexity and implementation difficulty increase

Engineering Contradiction:
Improverepresentational powerVSAvoidimplementation complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent uses wave functions as intermediary representations that bridge quantum mechanical operations and classical neural network outputs. The wave function serves as a mediator that carries quantum-inspired transformations while remaining computable on classical hardware, thus enabling enhanced representational power without requiring actual quantum hardware.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent transforms classical neural network parameters into quantum-inspired parameters by representing filter weights and activations as wave functions with complex amplitudes. This parameter transformation allows the network to leverage quantum mechanical properties like superposition and interference while maintaining compatibility with classical computational frameworks.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If quantum convolution operations are performed, then processing efficiency for complex data is improved, but computational resource requirements increase

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidcomputational resource consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent replaces traditional mechanical convolution operations with quantum-inspired wave function transformations. By substituting classical filter applications with quantum-inspired operations involving wave function multiplication and interference, the system achieves higher processing efficiency for complex patterns while using the same physical hardware.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces a complex amplitude dimension to traditional real-valued neural network operations. By operating in the complex domain with wave functions that have both magnitude and phase, the system processes information in an additional dimension, enabling more efficient representation and transformation of complex data structures.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS11836572B2Quantum inspired convolutional kernels for convolutional neural networks
Publication Date: 2023.12.05 QUALCOMM INC
  • US11836572B2 patent drawing
  • US11836572B2 patent drawing
  • US11836572B2 patent drawing

AI summary

Certain aspects of the present disclosure provide a method for performing quantum convolution, including: receiving input data at a neural network model, wherein the neural network model comprises at least one quantum convolutional layer; performing quantum convolution on the input data using the at least one quantum convolutional layer; generating an output wave function based on the quantum convolution using the at least one quantum convolution layer; generating a marginal probability distribution based on the output wave function; and generating an inference based on the marginal probability distribution.