Active camera target positioning method based on depth reinforcement learning

A technology of reinforcement learning and target positioning, applied in the field of active camera positioning, which can solve problems such as inability to adjust

Active Publication Date: 2017-02-01
TSINGHUA UNIV
View PDF5 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The disadvantage of this method is that it can only be applied to target positioning scenarios that can distinguish infrared signals, and it cannot be adjusted according to different applications.
In addition, this method needs to add an additional infrared device, instead of making adjustments directly based on image information

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0016] The specific implementation method of the camera active target location method based on deep reinforcement learning proposed by the present invention includes the following steps:

[0017] (1) Train a deep neural network to evaluate the effect of camera positioning, and name the network as evaluation network N R It consists of a multi-layer neural network, and the specific steps are as follows:

[0018] (1-1) Setting the evaluation network N R : Evaluation network N R The network structure is as follows: the input layer is an RGB image, and the image height is H net , the width is W net , (generally set to H net =W net = 256 pixels), since the RGB image has 3 dimensions, the dimension of the input layer is H net ×W net ×3; L RC The layer is a convolutional neural network, and the excitation function is the ReLU function (L RC The number of layers is generally between 3 and 7); L RP The layer is a fully connected layer (L RP The number of layers is generally b...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method carrying out target positioning through active adjustment of a camera in an image acquisition application and belongs to the mode identification technology field and the active camera positioning technology field. The method comprises steps that a depth neural network for evaluating the camera positioning effect is trained; multiple times of target positioning tests are carried out, in a positioning test process, a depth neural network for fitting a reinforcement learning value function is trained, and quality of seven types of operation including upward turn, downward turn, leftward turn, rightward turn, amplification, reduction and no change of the camera is determined through the depth neural network; decision for camera operation is made through employing a decision network according to the image information presently acquired by the camera. Through the method based on depth reinforcement learning, image acquisition quality is improved, different target positioning tasks can be adapted to, the method is an autonomous learning positioning method, artificial participation stages are quite few, and the method refers to a method of active camera learning and autonomous target learning.

Description

technical field [0001] The invention relates to a camera active target positioning method based on deep reinforcement learning, belonging to the technical field of pattern recognition and the technical field of camera active positioning. Background technique [0002] In recent years, cameras have been increasingly used in production and life, such as: security monitoring, vehicle detection, target tracking, face recognition. In current application scenarios, cameras provide image information, and use manual monitoring or target detection algorithms to implement corresponding applications. During the entire camera image acquisition process, the camera is fixed or cyclically adjusts the angle according to the specified route. It cannot actively adjust the field of view and actively locate the target according to the actual scene. [0003] In the existing technical documents, the invention patent "Camera Infrared Active Tracking Device and Camera Control System Using the Devic...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/70G06N3/04
CPCG06N3/045
Inventor 刘华平张辉孙富春
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products