Staged Neural Networks for NP-Hard Problem Solving

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing neural networks, such as Hopfield networks, are limited by the quality of initial guesses when solving NP hard/complete problems, requiring a staged approach with deep neural networks providing preliminary solutions for recursive neural networks to reduce overall solution time.

Innovation Solution

A staged neural network system combining deep neural networks for fast but imprecise preliminary solutions and recursive neural networks for precise final solutions, using a feedback loop to iterate and improve the solution, with deep neural networks trained on similar NP hard/complete problems to generate initial inputs for recursive networks.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If Hopfield neural networks are used to solve NP hard/complete problems, then the network can find solutions, but the solution time becomes excessively long due to dependence on initial guess quality

Engineering Contradiction:
Improvesolution qualityVSAvoidsolution time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

A deep neural network is employed to generate preliminary solutions (initial guesses) for the Hopfield network before the main solving process begins. This preliminary action provides high-quality starting points that significantly reduce the iteration time required by the Hopfield network to converge to optimal or near-optimal solutions for NP hard/complete problems.

Inventive Principle:
Principle #10Preliminary action

2Speed

If deep neural networks are used to generate initial guesses, then the speed of solution generation improves, but the precision of the preliminary solutions decreases

Engineering Contradiction:
Improvesolution generation speedVSAvoidsolution precision
Core Design Contradiction:
SpeedVSMeasurement precision

Solution Approach 1:

The deep neural network serves as an intermediary component that generates preliminary solutions which are then fed into the Hopfield network. This intermediary role allows the system to leverage the speed advantages of deep neural networks while using the Hopfield network to refine and improve solution precision, thus resolving the trade-off between speed and precision.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Loss of time

If a staged approach combining deep neural networks and recursive neural networks is used, then the overall solution time is reduced, but the system complexity increases

Engineering Contradiction:
Improveoverall solution timeVSAvoidsystem complexity
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The problem-solving system is segmented into two distinct stages: a deep neural network stage for generating preliminary solutions quickly, and a Hopfield network stage for refining these solutions to optimality. This segmentation allows each component to specialize in its strength (speed or precision) while working together to achieve both reduced overall solution time and manageable system complexity through clear functional separation.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11551056B2Staged neural networks for solving NP hard/complete problems
Publication Date: 2023.01.10 HEWLETT PACKARD ENTERPRISE DEV LP
  • US11551056B2 patent drawing
  • US11551056B2 patent drawing
  • US11551056B2 patent drawing

AI summary

Staged neural networks and methods are described herein. In some embodiments, the methods may identify a plurality of second NP hard/complete problems that are similar to the first NP hard/complete problem and identify solutions to the second NP hard/complete problems. The methods may train a deep neural network with the second NP hard/complete problems and the solutions. The methods may provide the first NP hard/complete problem to the trained deep neural network to generate a preliminary solution to the first NP hard/complete problem and provide the preliminary solution to a recursive neural network configured to execute an energy minimization search. The recursive neural network may generate a final solution to the problem based on the preliminary solution.