Semantic Division Network for Vehicle Image Classification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Autonomous driving systems face challenges in achieving high recognition performance due to limitations in power consumption, semiconductor reliability, latency, throughput, and cost, particularly when using deep learning networks optimized for GPU or ARM environments, which degrade performance on simple hardware accelerators.

Innovation Solution

An embedded semantic division network apparatus optimized for a matrix multiplication accelerator (MMA) is developed, incorporating a communication module, memory, and processor that executes a semantic division network program, utilizing convolutional neural networks (CNN) and depth-wise separable convolution (DSC) modules, along with extended Atrous spatial pyramid pooling (ASPP), to classify pixels in vehicle images, thereby improving recognition performance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a deep learning network with high complexity is used to improve recognition performance, then recognition performance is improved, but power consumption, latency, and hardware cost increase

Engineering Contradiction:
Improverecognition performanceVSAvoidpower consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent changes the architectural parameters of the deep learning network by replacing standard convolutional layers with depth-wise separable convolutional layers. This parameter change reduces computational complexity and power consumption while maintaining recognition performance through the separable convolution structure that decomposes the convolution operation into depth-wise convolution and pointwise convolution steps.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent segments the convolutional neural network into distinct encoder and decoder units with specific layers. The encoder unit includes multiple convolutional layers followed by pooling layers, while the decoder unit uses transposed convolutional layers. This segmentation allows optimized processing where each unit performs specific functions, reducing overall computational burden while maintaining performance.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If a deep learning network optimized for GPU or ARM is used, then recognition performance is improved, but performance degrades on simple hardware accelerators

Engineering Contradiction:
Improverecognition performanceVSAvoidhardware compatibility
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent changes the computational parameters by using depth-wise separable convolution instead of standard convolution. This parameter change makes the network more adaptable to simple hardware accelerators like MMA by reducing the computational intensity and memory bandwidth requirements, while still achieving high recognition performance that was previously only attainable on GPUs.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent employs a simplified network architecture that can run on cheaper, less powerful hardware accelerators rather than requiring expensive GPUs. The depth-wise separable convolution structure enables the system to achieve acceptable performance on lower-cost hardware, making the solution more versatile and cost-effective for embedded automotive applications.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

3Measurement precision

If standard convolutional neural network layers are used, then feature extraction is performed, but computational complexity and processing time increase

Engineering Contradiction:
Improvefeature extraction qualityVSAvoidprocessing throughput
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent changes the convolution operation parameters by implementing depth-wise separable convolution, which divides the standard convolution into two separate operations: depth-wise convolution that processes each input channel independently, and pointwise convolution that combines the results. This parameter change reduces the number of multiplications and increases processing throughput while maintaining feature extraction quality.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent segments the convolutional processing into distinct stages within each layer: depth-wise convolution stage followed by pointwise convolution stage. This segmentation allows for more efficient computation where the depth-wise convolution captures spatial patterns and the pointwise convolution combines channel information, improving overall processing throughput without sacrificing feature quality.

Inventive Principle:
Principle #1Segmentation

4Measurement precision

If more convolutional layers are added to improve feature representation, then recognition performance is improved, but network complexity and memory requirements increase

Engineering Contradiction:
Improvefeature representation qualityVSAvoidnetwork complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent changes the convolutional layer structure by using depth-wise separable convolution, which reduces the number of parameters and computations required per layer. This parameter change allows the network to achieve good feature representation with fewer effective layers, reducing overall network complexity and memory requirements while maintaining recognition performance.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent discards the need for many heavy convolutional layers by using the more efficient depth-wise separable convolution structure. Instead of adding more standard convolutional layers to improve feature representation, the system recovers performance through the optimized convolution structure and strategic placement of pooling and upsampling layers, achieving the same representation quality with reduced complexity.

Inventive Principle:
Principle #34Discarding and recovering

Data Source

PatentUS12175735B2Embedded semantic division network apparatus optimized for MMA that classifies pixels in vehicle images
Publication Date: 2024.12.24 HYUNDAI MOBIS CO LTD
  • US12175735B2 patent drawing
  • US12175735B2 patent drawing
  • US12175735B2 patent drawing

AI summary

Provided is an embedded semantic division network including a communication module configured to receive an image captured by a camera, a memory configured to store a semantic division network (MMANet)-based program for extracting a context of the captured image, and a processor extracts the context of the captured image by selecting a convolutional neural network (CNN) processing module or a depth-wise separable convolution (DSC) processing module according to a size of a activation map in each layer of the semantic division network that includes an encoder unit and a decoder unit including at least one of the CNN processing module and the DSC processing module that are connected from an upper layer to a lower layer and reduce features of an input image.