Object detection method based on depth reinforcement learning

A technology of reinforcement learning and object detection, applied in image enhancement, image data processing, instruments, etc., can solve problems such as single image occlusion or partial shooting

Active Publication Date: 2018-09-18
TSINGHUA UNIV
View PDF4 Cites 16 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This existing technology uses a reinforcement learning method to operate a single image to obtain a better object positioning effect, but for a robot, a single image may have problems such as occlusion or partial shooting, and the existing methods cannot effectively solve this problem

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Object detection method based on depth reinforcement learning
  • Object detection method based on depth reinforcement learning
  • Object detection method based on depth reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0056] The present invention proposes an object detection method based on deep reinforcement learning, which will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0057] The present invention proposes an object detection method based on deep reinforcement learning, which is applicable to any general-purpose mobile robot equipped with any type of RGB camera. This embodiment uses a turtlebot robot equipped with a Kinect for Xbox camera. This embodiment is only used to illustrate the method of use of the present invention, and does not constrain the claims of the present invention.

[0058] The present invention proposes an object detection method based on deep reinforcement learning, the overall process is as follows figure 1 shown, including the following steps:

[0059] 1) Construct a deep reinforcement learning neural network Q, including five parts: image feature extraction network, image feature dimensionality r...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an object detection method based on depth reinforcement learning, and belongs to the mode identification technical field and active object detection technical field; the methodcomprises the following steps: firstly building a depth reinforcement learning nerve network; carrying out multi object detection tests for a robot, obtaining training data to train the nerve network,thus obtaining a trained nerve network; in the usage phase, the robot obtains a present time image and an envelope box of a to-be-detected object in the image, and inputs same into the trained nervenetwork; the network outputs a motion to-be-executed by the robot in the next moment; the robot executes the motion to obtain a new present time envelope box, and uses an identification function for determination; if the identification credibility of the to-be-detected object in the envelope box is higher than a set identification threshold, the object detection succeeds. The method uses the reinforcement learning technology to control the robot motions, and uses the robot visual angle changes to obtain better observation images, thus obtaining a better object detection result.

Description

technical field [0001] The invention proposes an object detection method based on deep reinforcement learning, which belongs to the technical field of pattern recognition and the technical field of active object detection. Background technique [0002] As one of the main research contents of robotics and computer vision systems, object detection is widely used in video surveillance, unmanned driving and multimedia processing. Most of the current object detection methods are aimed at static images with good shooting conditions, but in practical applications, such images are often difficult to obtain, especially in robotic applications, where occlusions, partial shots, and small scales often appear in the captured pictures. defect. But in robot applications, the shooting angle can be changed by adjusting the pose of the robot to obtain an image more suitable for detection, so as to realize the active object detection of the robot. [0003] Related published patents such as 1...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/246
CPCG06T7/246G06T2207/20081G06T2207/20084
Inventor 刘华平韩小宁孙富春
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products