Semantic Division Network for Vehicle Image Classification
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Autonomous driving systems face challenges in achieving high recognition performance due to limitations in power consumption, semiconductor reliability, latency, throughput, and cost, particularly when using deep learning networks optimized for GPU or ARM environments, which degrade performance on simple hardware accelerators.
Innovation Solution
An embedded semantic division network apparatus optimized for a matrix multiplication accelerator (MMA) is developed, incorporating a communication module, memory, and processor that executes a semantic division network program, utilizing convolutional neural networks (CNN) and depth-wise separable convolution (DSC) modules, along with extended Atrous spatial pyramid pooling (ASPP), to classify pixels in vehicle images, thereby improving recognition performance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a deep learning network with high complexity is used to improve recognition performance, then recognition performance is improved, but power consumption, latency, and hardware cost increase
Solution Approach 1:
The patent changes the architectural parameters of the deep learning network by replacing standard convolutional layers with depth-wise separable convolutional layers. This parameter change reduces computational complexity and power consumption while maintaining recognition performance through the separable convolution structure that decomposes the convolution operation into depth-wise convolution and pointwise convolution steps.
Solution Approach 2:
The patent segments the convolutional neural network into distinct encoder and decoder units with specific layers. The encoder unit includes multiple convolutional layers followed by pooling layers, while the decoder unit uses transposed convolutional layers. This segmentation allows optimized processing where each unit performs specific functions, reducing overall computational burden while maintaining performance.
2Measurement precision
If a deep learning network optimized for GPU or ARM is used, then recognition performance is improved, but performance degrades on simple hardware accelerators
Solution Approach 1:
The patent changes the computational parameters by using depth-wise separable convolution instead of standard convolution. This parameter change makes the network more adaptable to simple hardware accelerators like MMA by reducing the computational intensity and memory bandwidth requirements, while still achieving high recognition performance that was previously only attainable on GPUs.
Solution Approach 2:
The patent employs a simplified network architecture that can run on cheaper, less powerful hardware accelerators rather than requiring expensive GPUs. The depth-wise separable convolution structure enables the system to achieve acceptable performance on lower-cost hardware, making the solution more versatile and cost-effective for embedded automotive applications.
3Measurement precision
If standard convolutional neural network layers are used, then feature extraction is performed, but computational complexity and processing time increase
Solution Approach 1:
The patent changes the convolution operation parameters by implementing depth-wise separable convolution, which divides the standard convolution into two separate operations: depth-wise convolution that processes each input channel independently, and pointwise convolution that combines the results. This parameter change reduces the number of multiplications and increases processing throughput while maintaining feature extraction quality.
Solution Approach 2:
The patent segments the convolutional processing into distinct stages within each layer: depth-wise convolution stage followed by pointwise convolution stage. This segmentation allows for more efficient computation where the depth-wise convolution captures spatial patterns and the pointwise convolution combines channel information, improving overall processing throughput without sacrificing feature quality.
4Measurement precision
If more convolutional layers are added to improve feature representation, then recognition performance is improved, but network complexity and memory requirements increase
Solution Approach 1:
The patent changes the convolutional layer structure by using depth-wise separable convolution, which reduces the number of parameters and computations required per layer. This parameter change allows the network to achieve good feature representation with fewer effective layers, reducing overall network complexity and memory requirements while maintaining recognition performance.
Solution Approach 2:
The patent discards the need for many heavy convolutional layers by using the more efficient depth-wise separable convolution structure. Instead of adding more standard convolutional layers to improve feature representation, the system recovers performance through the optimized convolution structure and strategic placement of pooling and upsampling layers, achieving the same representation quality with reduced complexity.
Data Source
AI summary
Provided is an embedded semantic division network including a communication module configured to receive an image captured by a camera, a memory configured to store a semantic division network (MMANet)-based program for extracting a context of the captured image, and a processor extracts the context of the captured image by selecting a convolutional neural network (CNN) processing module or a depth-wise separable convolution (DSC) processing module according to a size of a activation map in each layer of the semantic division network that includes an encoder unit and a decoder unit including at least one of the CNN processing module and the DSC processing module that are connected from an upper layer to a lower layer and reduce features of an input image.


