Unlock instant, AI-driven research and patent intelligence for your innovation.

Image video scene identification method based on distance prediction information

A technology of predicting information and recognition methods, applied in the field of information, can solve problems such as poor effect and low accuracy of scene recognition, and achieve the effect of improved ability

Active Publication Date: 2016-11-09
SHANGHAI ADVANCED RES INST CHINESE ACADEMY OF SCI +1
View PDF2 Cites 16 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] In view of the shortcomings of the prior art described above, the purpose of the present invention is to provide a method for image and video scene recognition based on distance prediction information, which is used to solve the problems of low scene recognition accuracy and poor effect in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image video scene identification method based on distance prediction information
  • Image video scene identification method based on distance prediction information
  • Image video scene identification method based on distance prediction information

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0030] Please refer to the attached figure 1 , the accompanying drawing is a schematic flow chart of extracting distance features from distance prediction information, which is Step 1 of the image and video scene recognition method based on distance prediction information in the present invention. The process of extracting distance features from distance prediction information in this embodiment includes :

[0031] 1) Use the existing image training set (or training image set) to train and obtain the distance prediction model. Specifically, the image training set consists of RGB-D images captured by an RGB-D camera, and each image contains distance information for each location. Optionally, the training image set may also include some RGB images with a small amount of distance annotation information for improving the accuracy of the distance prediction model. The training distance prediction model takes the RGB information of the image at multiple scales as input, and takes ...

Embodiment 2

[0035] Please refer to the attached figure 2, the accompanying drawing is another schematic flow chart for extracting distance features from distance prediction information, which is also Step 1 of the image and video scene recognition method based on distance prediction information in the present invention. In this embodiment, distance features are extracted from distance prediction information The process includes:

[0036] 1) Use the existing image training set (or training image set) to train and obtain the distance prediction model. This step is the same as step 1) in the first embodiment.

[0037] 2) Use the distance prediction model to predict the distance information of each pixel for the RGB image. This step is the same as step 2) in Embodiment 1.

[0038] 3) Extend the RGB-D image training set with the predicted distance information. This step is an optional step, and its main function is to use the distance prediction information generated in step 2) to combine...

Embodiment 3

[0042] Please refer to the attached image 3 , the accompanying drawing is one of the flow diagrams of the image and video scene recognition method based on distance prediction information in the present invention, and the flow of the recognition method includes:

[0043] 1) Extract image distance features (that is, extract distance features from distance prediction information). Specifically, given an RGB image, the corresponding image distance feature is extracted using the procedure provided in Embodiment 1 or Embodiment 2.

[0044] 2) Use the pre-trained distance feature classifier to perform scene recognition on the given image, and obtain the scene recognition result. Given a scene, use the RGB image data set (i.e. image video set) labeled with the scene, and extract the distance features of step 1) for each data set image, and then train the distance feature classifier for the scene category. For example, you can use Support Vector Machines (Support Vector Machines) o...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides an image video scene identification method based on distance prediction information. The method at least comprises the following steps: obtaining a distance prediction model through training by use of an existing image training set, applying the distance prediction model to RGB images to be predicted, obtaining distance prediction information corresponding to the RGB images to be predicted, and then extracting distance features from the distance prediction information; and step two, obtaining feature classifiers through training by use of an existing image video set, and obtaining scene types of image videos by performing prediction by use of the feature classifiers and the distance features. According to the image video scene identification method, by use of the distance prediction information based on RGB image content, such image features representing the distance prediction information, visual color information and the like are obtained, then by use of the various trained classifiers, scene identification is performed on the RGB images to be predicted, and thus the capability of image video scene identification is improved.

Description

technical field [0001] The invention belongs to the field of information technology, and relates to an image and video scene recognition method, in particular to an image and video scene recognition method based on distance prediction information. Background technique [0002] Scene understanding is an important problem in the field of computer vision. Image and video scene recognition, as a main task of scene understanding, refers to using the visual information in the image and video to automatically process and analyze it, and judge the specific scene contained in it. With the rapid development of Internet technology and large-capacity storage technology in the past few decades, large-scale image and video data sets have emerged one after another, and various scene recognition methods have been proposed. The general steps include: first describe the visual information of the image and video, and then It is called visual feature extraction; then use the acquired recogniti...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62
CPCG06V20/40G06F18/2411G06F18/24G06F18/214
Inventor 郑莹斌汪宏叶浩
Owner SHANGHAI ADVANCED RES INST CHINESE ACADEMY OF SCI