AI Design Application for Neural Network Analysis and Modification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Deep neural networks are challenging to design, analyze, and modify due to their complex architectures, which obfuscate the design process, making it difficult for designers to understand and explain their functionality, and limiting the ability to evaluate and characterize their performance effectively.

Innovation Solution

An AI design application that includes a network generator for creating neural networks based on user interactions, a network analyzer for analyzing behavior at the layer and neuron level, a network evaluator for comprehensive evaluation across training data, and a network descriptor that articulates behavior in natural language and constrains it according to rules.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If deep neural networks use complex network architecture with many layers and intricate connections, then the accuracy and task performance are improved, but the design difficulty and device complexity increase

Engineering Contradiction:
ImproveaccuracyVSAvoidnetwork architecture complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments the complex neural network design process into distinct functional components: a network generator that creates network architectures, a network analyzer that examines behavior at layer and neuron levels, and a network evaluator that assesses performance. This segmentation allows designers to manage complexity by interacting with specialized tools rather than writing extensive code for each aspect of network design and analysis.

Inventive Principle:
Principle #1Segmentation

2Reliability

If deep neural networks use complex network architecture with many layers and intricate connections, then the accuracy and task performance are improved, but the ease of operation and understanding deteriorate

Engineering Contradiction:
ImproveaccuracyVSAvoidease of design and modification
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent introduces intermediary tools that mediate between the designer and the complex neural network system. The network generator acts as an intermediary that translates high-level design specifications into complex network architectures without requiring designers to write extensive code. The network analyzer and evaluator serve as intermediaries that provide insights into network behavior, enabling designers to understand and modify networks more easily despite their complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If deep neural networks use complex network architecture with many layers and intricate connections, then the task performance is improved, but the ease of repair and modification deteriorate

Engineering Contradiction:
Improvetask performanceVSAvoidease of modification
Core Design Contradiction:
ReliabilityVSEase of repair

Solution Approach 1:

The patent implements feedback mechanisms through the network analyzer and network evaluator, which provide detailed information about network behavior and performance. This feedback enables designers to identify specific components responsible for particular behaviors or performance issues, facilitating targeted modifications and repairs without requiring extensive code changes throughout the entire network.

Inventive Principle:
Principle #23Feedback

4Reliability

If deep neural networks use complex network architecture with many layers and intricate connections, then the accuracy is improved, but the loss of information about design and operation increases

Engineering Contradiction:
ImproveaccuracyVSAvoidloss of design understanding
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The patent applies preliminary action by having the network generator create and document the network architecture before training and deployment. The system预先 establishes a structured representation of the network design, including layer configurations and connections, which preserves design information throughout the network lifecycle. This preliminary documentation enables later analysis and modification without losing design understanding.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11615321B2Techniques for modifying the operation of neural networks
Publication Date: 2023.03.28 VIAN SYSTEMS INC
  • US11615321B2 patent drawing
  • US11615321B2 patent drawing
  • US11615321B2 patent drawing

AI summary

As described, an artificial intelligence (AI) design application exposes various tools to a user for generating, analyzing, evaluating, and describing neural networks. The AI design application includes a network generator that generates and/or updates program code that defines a neural network based on user interactions with a graphical depiction of the network architecture. The AI design application also includes a network analyzer that analyzes the behavior of the neural network at the layer level, neuron level, and weight level in response to test inputs. The AI design application further includes a network evaluator that performs a comprehensive evaluation of the neural network across a range of sample of training data. Finally, the AI design application includes a network descriptor that articulates the behavior of the neural network in natural language and constrains that behavior according to a set of rules.