Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Article classification method based on depth recovery information

A technology for depth restoration and object classification, applied in neural learning methods, image analysis, biological neural network models, etc., can solve problems such as lack of geometric information, and achieve improved performance and good performance

Active Publication Date: 2018-09-11
TIANJIN UNIV
View PDF11 Cites 42 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

For humans, it is not difficult to infer the underlying 3D structure from a single image. For computer vision algorithms, it is a very challenging task because there are no specific and reliable features such as geometric information that can be directly utilized.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Article classification method based on depth recovery information
  • Article classification method based on depth recovery information
  • Article classification method based on depth recovery information

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] The problem to be solved by the present invention is to design a model for the two-dimensional image classification problem so that it can introduce depth information to improve the classification performance, and only need RGB images instead of real depth images collected by sensors as input during testing .

[0039] The technical scheme that the present invention takes is to adopt the deep learning method based on convolutional neural network, and main steps are as follows:

[0040] (1) Preprocess the dataset. Different data sets use different depth sensors to collect depth information and save them in different formats. The matrix of depth information stored in the database is uniformly converted into a general depth image format, which is used for network training and visualization of generated depth maps. And the color image and the corresponding depth image are composed of an image pair, and a 10-fold cross-validation is constructed for network training and resul...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to the technical field of article classification and monocular image depth estimation in the field of computer vision, and proposes a model which enhances the classification performance through introduction of depth information and only needs an RGB image instead of a real depth image acquired by a sensor as input. The invention provides an article classification method basedon depth recovery information. The method includes following steps: (1) preprocessing a data set; (2) establishing a depth recovery model in the model; (3) training two image classification models which respectively receive RGB and depth images as input; (4) establishing a final fusion model, and performing training and tests; (5) migrating a trained fusion network in step 4 to a classified dataset of a natural image; and (6) comparing effects of image classification of the model on two disclosed data sets and performing visualization. The method is mainly applied to occasions of article classification and monocular image estimation in the field of computer vision.

Description

technical field [0001] The invention relates to the technical field of object classification and monocular image depth estimation in the field of computer vision, in particular to a depth estimation method based on a generative confrontation network. Background technique [0002] Image object classification is a fundamental problem in computer vision research, and it is also the basis for other high-level vision tasks such as image segmentation, object tracking, and behavior analysis. Since the color RGB image is a two-dimensional projection of the real three-dimensional world, a flat image may correspond to countless actual scenes in the real world. Therefore, the depth information is inevitably lost. Depth information can reflect geometric information that 2D images do not have, and is of great significance for 3D scene reconstruction, gesture recognition, human body pose estimation, etc. [1] . The 2D information represented by the RGB image and the depth information re...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T7/50G06T7/90G06N3/08G06N3/04G06K9/62
CPCG06N3/08G06T7/50G06T7/90G06N3/045G06F18/253
Inventor 侯春萍管岱杨阳郎玥章衡光
Owner TIANJIN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products