Image segmentation and classification method and device

An image segmentation and classification method technology, applied in the field of image processing, can solve the problems of incapable of image frame scene classification and recognition, the model occupies a large memory, and the operation speed is slow, and achieves the effect of fast segmentation and classification, and small memory space occupation.

Pending Publication Date: 2020-05-15
CAPITALBIO CORP
View PDF4 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Moreover, most of the current segmentation deep learning models can only segment the target area, but cannot simultaneously classify and identify the validity of the scene state of the image frame, and cannot meet the needs of real-time analysis of the target object on the mobile electronic device side.
Although there is indeed a method in the field of autonomous driving that can simultaneously segment, classify, or detect image frames, the model used in this method takes up a large amount of memory, the calculation speed is slow, and it has high requirements for the hardware platform, which cannot meet the requirements of mobile devices. Requirements for video image processing in terminals

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image segmentation and classification method and device
  • Image segmentation and classification method and device
  • Image segmentation and classification method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] In order to enable those skilled in the art to better understand the technical direction of the present invention, the present invention is described in detail through specific embodiments. However, it should be understood that specific embodiments are provided only for better understanding of the present invention, and they should not be construed as limiting the present invention. In describing the present invention, it should be understood that the terms used are for the purpose of description only, and should not be understood as indicating or implying relative importance.

[0025] This embodiment provides a method for image segmentation and classification, which can be used for images in pictures or videos, such as figure 1 , figure 2 As shown, it includes the following steps: S1 establishes a network model for image segmentation and classification, and realizes the segmentation and classification of image frames at the same time; the network model for segmentati...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an image segmentation and classification method and device, and the method comprises the steps: S1, building an image segmentation and classification network model, and achieving the segmentation and classification of image frames, wherein the segmentation and classification network model comprises a context information extraction path and a spatial information extractionpath, the context information extraction path is in communication connection with the spatial information extraction path, and the context information extraction path outputs an image classification result; the spatial information extraction path outputs an image segmentation result; and S2, training the segmented and classified network model to enable the network model to reach a preset standard.According to the network model for segmentation and classification in the method, end-to-end real-time semantic segmentation can be performed on the video acquired by the mobile terminal, the targetstate category of the scene in the image frame can be identified in real time, and semantic segmentation of the video and classification of the scene state in the image frame are completed in parallel.

Description

technical field [0001] The invention relates to an image segmentation and classification method and device, and belongs to the technical field of image processing. Background technique [0002] For a video containing the target object to be analyzed, some image frames have the target object in the scene, and some image frames do not exist. At the same time, some image frames have the target object, but due to occlusion in the target area, or the target is not clear, or the target These image frames are unusable due to reasons such as the area is too small, or the pose of the target object is incorrect. Therefore, in order to realize the automatic photography of human-computer interaction, it is necessary to solve the problem of segmenting the target object area and giving the classification category of the frame image at the same time. [0003] The conventional method in the prior art is to divide the segmentation of the target object in the image frame and the classificati...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/34G06N3/04
CPCG06V10/267G06N3/045
Inventor 王文君朱婷候建伟王东邢婉丽程京
Owner CAPITALBIO CORP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products