Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Image visual semantic segmentation method based on two-way region attention coding and decoding

An image vision and semantic segmentation technology, applied in the field of image processing, can solve the problems of limited manpower and camera angle, lack of pertinence, accurate segmentation, etc., to achieve the effect of improving semantic segmentation accuracy, stable training effect, and high segmentation accuracy.

Active Publication Date: 2021-07-02
合肥市正茂科技有限公司
View PDF9 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Method 1 and method 2 are limited by manpower and the angle of the camera, lack of pertinence, and cannot filter out most unnecessary images and deal with emergencies
[0004] In order to enhance the flexibility of the semantic segmentation system, researchers embed the semantic segmentation system into devices containing cameras such as surveillance probes, and then realize the semantic segmentation of images through the movement of the camera. However, this method usually uses computer vision The semantic segmentation task has replaced the carrying platform, ignoring the characteristics of the image itself
In practical application scenarios, this kind of method is often because the proportion of the target in the lens is too small, and the direction is unpredictable. At the same time, due to the angle of view of the camera, the target is easily blocked by other objects, resulting in the uncertainty of the boundary contour of different targets. Unable to achieve precise segmentation of the target

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image visual semantic segmentation method based on two-way region attention coding and decoding
  • Image visual semantic segmentation method based on two-way region attention coding and decoding
  • Image visual semantic segmentation method based on two-way region attention coding and decoding

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0067] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0068] Please refer to figure 1 with figure 2 , in an embodiment of the present invention, an image visual semantic segmentation method based on two-way area attention encoding and decoding, the specific steps include:

[0069] S1. Acquiring scene image samples;

[0070] S2. Preprocessing the scene image samples, and importing the constructed depth model for training;

[0071] S3. Build a network codec, perform feature fusion on image samples and obtain a ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an image visual semantic segmentation method based on two-way region attention coding and decoding. The method comprises the following specific steps: acquiring an image sample of a specific scene in advance; normalizing an RBG channel of the sample image, and preparing to train a depth model; encoding an image through a two-way encoder to obtain multi-scale and refined image depth features; carrying out adaptive channel feature enhancement on different distributed targets through regional information by using a decoder based on regional attention; fusing encoder shallow layer features and decoder deep layer features in different extraction stages through skip-connection, and multiplexing the depth features to the maximum extent; and finally, mapping from a final convolutional layer of the deep neural network to an original image, and classifying each pixel point to obtain a final image visual segmentation image. The invention can be embedded into equipment such as a monitoring probe and the like, and the image with complicated distribution is guided through regional information, so that accurate visual semantic segmentation of the image is realized.

Description

technical field [0001] The invention relates to the technical field of image processing, in particular to an image visual semantic segmentation method based on two-way area attention coding and decoding. Background technique [0002] With the development of society, semantic segmentation, as an important technology of image visual semantic segmentation method based on two-way regional attention codec, has attracted more and more attention, and its application scope has gradually expanded. From conventional daily image semantic segmentation to Semantic segmentation extended to specific application scenarios. After deep learning is applied to semantic segmentation, the semantic segmentation of conventional images has been greatly improved, but the semantic segmentation effect for specific work scenes is not very obvious, because conventional images are taken with the ground as a reference, The target in the photo is horizontal and vertical, and occupies most of the area of ​​...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/62G06N3/04G06N3/08G06T7/11
CPCG06T7/11G06N3/04G06N3/08G06T2207/10004G06T2207/20081G06T2207/20084G06T2207/20221G06F18/214G06F18/241G06F18/253
Inventor 陈思宝吕建春纪宇昕张克林王文中吕强汤进王雪雁郑刚胡昌隆
Owner 合肥市正茂科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products