Curvature feature recurrent neural network-based three-dimensional target identification method

A recursive neural network and 3D target technology, applied in the field of 3D target recognition based on the curvature feature recursive neural network, can solve problems such as poor recognition effect, inability to effectively describe 3D target features, and inability to express sequence attributes, etc., to solve image noise problem effect

Active Publication Date: 2018-06-12
SHENYANG INST OF AUTOMATION - CHINESE ACAD OF SCI
View PDF8 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The method based on artificial marking points needs to manually initialize the feature points in the two-dimensional image. Due to the need for human interaction, such methods are not repeatable; the method based on geometric features achieves the goal by extracting information such as the midline skeleton and contour shape of the target. recognition, but the recognition effect of such methods is poor when there is noise in the image; methods based on deep learning use deep neural networks to fuse low-level image features into high-level features with semantic information, which can well solve three-dimensional The image noise problem of two-dimensional images in the target recognition process, but the commonly used deep convolutional neural network cannot express sequence attributes, and cannot effectively describe the characteristics of three-dimensional targets under different viewing angles

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Curvature feature recurrent neural network-based three-dimensional target identification method
  • Curvature feature recurrent neural network-based three-dimensional target identification method
  • Curvature feature recurrent neural network-based three-dimensional target identification method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments.

[0038] The present invention is mainly divided into two parts, as figure 1 Shown is the flow chart of the method of the present invention, and the specific implementation process is as follows.

[0039] Step 1: Calculate the joint curvature of the target 3D model, and construct the curvature sketch of the 3D model by extracting the local maximum value of the joint curvature, and use the transmission projection transformation to generate a 360° two-dimensional image as the input of the training recurrent neural network;

[0040] Step 1.1: Set is the normal vector of a given point (x, y, z) on the 3D model. make then p x ,p y ,q x ,q y defined as Then the Gaussian curvature G of the three-dimensional model K for

[0041] G K =|C|,

[0042] where the curvature matrix The mean curvature M of the 3D model K for trace( ) is the t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an image identification technology, and provides a curvature feature recurrent neural network-based three-dimensional target identification method for the problem of image noises in a three-dimensional target identification process in order to effectively describe features of a three-dimensional target under different view angles. The method comprises the steps of firstly,obtaining a joint curvature of a target three-dimensional model by calculating a local average Gaussian curvature and an average mean curvature of the target three-dimensional model, forming a curvature sketch of the three-dimensional model by extracting a local maximum value of the joint curvature, and generating a 360-degree two-dimensional image sequence by utilizing transmission projection transform to serve as an input of a trained recurrent neural network; and secondly, obtaining an identification type with a maximum correct probability by utilizing a softmax function in a softmax layerthrough utilizing a bidirectional recurrent neural network (BRNN) as a three-dimensional model multi-view sequence feature learning method. According to the method, common features of the three-dimensional target and a two-dimensional image can be automatically extracted; and relatively good robustness and relatively high target identification rate can be kept under image noise conditions.

Description

technical field [0001] The invention relates to the technical field of image recognition, in particular to a three-dimensional object recognition method based on a curvature feature recursive neural network. Background technique [0002] 3D object recognition refers to the process of automatically detecting, locating, and recognizing the specified object pattern from any given 2D image scene, which is one of the key issues in computer vision research. With the continuous development of computer vision technology, 3D object recognition is more and more widely used in industrial inspection, augmented reality and medical imaging and other fields. However, due to factors such as illumination changes, image noise, and object occlusion, it is difficult to extract the common features of 3D objects and 2D images from different viewing angles, which has become an urgent problem to be solved in 3D object recognition. [0003] The key to 3D target recognition is to find the 2D represe...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06N3/04
CPCG06N3/04G06V20/647G06V2201/07
Inventor 梁炜李杨郑萌谈金东彭士伟
Owner SHENYANG INST OF AUTOMATION - CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products