Convolutional Recurrent Neural Network Image Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image segmentation technologies face challenges in accurately segmenting images while efficiently managing computational resources and time constraints, often requiring retraining of neural networks to adjust for varying processing conditions.

Innovation Solution

A system utilizing a convolutional recurrent neural network (CRNN) that iteratively processes input images, dynamically adjusting the number of time steps to optimize computational resources, time, and segmentation quality without retraining, by generating and refining segmentation outputs through a series of time steps.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the number of time steps is increased to improve segmentation accuracy, then segmentation quality improves, but computational resource consumption and processing time increase

Engineering Contradiction:
Improvesegmentation accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system dynamically adjusts the number of time steps based on segmentation quality metrics. When segmentation accuracy reaches a satisfactory threshold, the process terminates early without completing all planned time steps, thus reducing processing time while maintaining adequate segmentation quality

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system implements feedback mechanisms by evaluating segmentation quality at intermediate time steps and using this information to决定是否 continue processing. This feedback loop allows the system to adapt the number of time steps to actual performance needs rather than using a fixed predetermined number

Inventive Principle:
Principle #23Feedback

2Measurement precision

If the number of time steps is increased to improve segmentation accuracy, then segmentation quality improves, but computational resource consumption increases

Engineering Contradiction:
Improvesegmentation accuracyVSAvoidcomputational resource consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system dynamically adjusts the number of time steps based on segmentation quality metrics. When segmentation accuracy reaches a satisfactory threshold, the process terminates early without completing all planned time steps, thus reducing computational resource consumption while maintaining adequate segmentation quality

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the parameter of time steps from a fixed value to a dynamically adjusted value based on performance metrics. This parameter change allows the system to optimize the balance between segmentation accuracy and computational resource usage for each specific input image

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If the neural network is retrained to adapt to varying processing conditions, then adaptability improves, but system complexity and training time increase

Engineering Contradiction:
Improveadaptability to processing conditionsVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system is pre-configured with a range of possible time step values and the capability to adjust them during inference. This preliminary setup eliminates the need for retraining when processing conditions change, as the system can adapt by selecting appropriate time step values from its predefined range

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system adapts to varying processing conditions by changing operational parameters (number of time steps) rather than changing the model weights through retraining. This approach maintains adaptability while avoiding the complexity and time costs associated with retraining neural networks

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11257217B2Image segmentation using neural networks
Publication Date: 2022.02.22 GOOGLE LLC
  • US11257217B2 patent drawing
  • US11257217B2 patent drawing
  • US11257217B2 patent drawing

AI summary

A method for generating a segmentation of an image that assigns each pixel to a respective segmentation category from a set of segmentation categories is described. The method includes obtaining features of the image, the image including a plurality of pixels. For each of one or more time steps starting from an initial time step and continuing until a final time step, the method includes generating a network input from the features of the image and a current segmentation output as of the time step, processing the network input using a convolutional recurrent neural network to generate an intermediate segmentation output for the time step, and generating an updated segmentation output for the time step from the intermediate segmentation output for the time step and the current segmentation output as of the time step. The method includes generating a final segmentation of the image from the updated segmentation output.