Quantum Neural Network Training Accelerator

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current AI training methods, particularly in deep learning, face challenges such as high energy consumption, long training times, and large carbon footprints due to the need for extensive computational resources and large datasets, which are exacerbated by the inefficiencies of traditional neural networks in processing and deploying models for applications like medical imaging.

Innovation Solution

A quantum system is employed to accelerate the training of neural networks by mapping activation function tensors to energy levels in a quantum state, allowing for the detection of minimum energy states and determination of optimal neural network parameters, thereby reducing training and inference times and energy usage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional neural network training methods are used with large datasets, then model accuracy can be improved, but training time and energy consumption increase dramatically

Engineering Contradiction:
Improvemodel accuracyVSAvoidtraining time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent replaces classical computational mechanisms with quantum mechanical processes. Specifically, it uses quantum systems to perform optimization tasks that traditionally require extensive classical computing, thereby reducing training time while maintaining accuracy. The quantum system leverages phenomena like superposition and entanglement to explore the solution space more efficiently than classical algorithms.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The invention changes the fundamental parameters of the computational system by transitioning from classical bits to quantum bits (qubits). This parameter change enables parallel processing of multiple states simultaneously, allowing the system to evaluate many possible network configurations at once, thus dramatically reducing the time required to find optimal parameters for large datasets.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If traditional neural network training methods are used with large datasets, then model accuracy can be improved, but energy consumption increases dramatically

Engineering Contradiction:
Improvemodel accuracyVSAvoidenergy consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent substitutes energy-intensive classical computing operations with quantum mechanical processes that can achieve the same computational goals with significantly lower energy consumption. The quantum system performs optimization and pattern recognition tasks using quantum states and transitions, which require far less power than the sequential processing of classical neural networks.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The quantum system performs preliminary exploration of the solution space by preparing quantum states that represent multiple possible configurations simultaneously. This preliminary action allows the system to identify promising regions of the parameter space before committing computational resources, thereby reducing overall energy consumption during the training process.

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If larger neural network models are built to handle complex tasks, then model capability is improved, but computational resource requirements increase

Engineering Contradiction:
Improvemodel capabilityVSAvoidcomputational resource requirements
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent replaces complex classical computational architectures with a quantum system that inherently handles complexity through quantum mechanics. Instead of increasing the size of classical neural networks, the invention uses quantum states to represent and process complex patterns, reducing the need for additional computational resources while maintaining or enhancing model capability.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The invention transitions from the classical computational dimension to the quantum dimension, utilizing quantum superposition and entanglement to process information in a fundamentally different space. This dimensional change allows the system to handle complex tasks more efficiently by leveraging quantum parallelism and interference effects that have no direct classical equivalent.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

4Loss of time

If quantum system is used to accelerate training, then training time is reduced, but system complexity increases

Engineering Contradiction:
Improvetraining timeVSAvoidsystem complexity
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The patent introduces a quantum system as an intermediary component that bridges classical neural network training and optimization. Rather than completely replacing the classical system, the quantum component acts as a specialized accelerator that handles specific computational tasks (such as optimization and pattern recognition) more efficiently, thereby reducing training time while adding manageable complexity through a modular hybrid architecture.

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach significantly reduces the time and energy required for training and inference, enabling faster convergence to optimal parameters and allowing for more efficient deployment of AI models, even with large datasets, while also addressing the limitations of traditional neural networks.

Implementation Method 1

mapping a plurality of activation function tensors of the neural network to energy levels representing a quantum state in a quantum system

Methodology Applied
Scientific EffectQuantum state energy mapping:

Implementation Method 2

detecting minimum energy states at one or more observation points in the quantum system after the quantum system converges to a minimum total energy

Methodology Applied
Scientific EffectQuantum convergence to minimum energy:

Data Source

PatentUS20210342730A1System and method of quantum enhanced accelerated neural network training
Publication Date: 2021.11.04 EQUAL1 LABS INC
  • US20210342730A1 patent drawing
  • US20210342730A1 patent drawing
  • US20210342730A1 patent drawing

AI summary

A novel and useful system and method of quantum enhanced accelerated training of a classic neural network (NN). The quantum system implements an optimizer that accelerates training of the classic NN by exploiting the properties of quantum mechanics and manipulating the quantum system into a state that represents the complete state of the classic NN, including the loss function. The quantum system is then allowed to transition to its “optimum state” and the minimum energy state is read out from detectors and weight updates are calculated and fed back to the classic NN. Mapping and detection helper neural networks learn the characteristics of the quantum system structures. By averaging this over a number of images the learning weight or gradient of descent can be controlled to yield optimum neural network parameters. The time and energy required for training the classic NN as well as for inference is drastically reduced.