Missing target searching method based on reinforcement learning algorithm

A technology of reinforcement learning and target search, applied in machine learning, computing, computing models, etc.

Active Publication Date: 2020-04-24
FUZHOU UNIV
View PDF1 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This presents a huge challenge for finding the target

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Missing target searching method based on reinforcement learning algorithm
  • Missing target searching method based on reinforcement learning algorithm
  • Missing target searching method based on reinforcement learning algorithm

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0059] In order to make the features and advantages of this patent more obvious and understandable, the following specific examples are given to illustrate in detail as follows:

[0060] Such as image 3 As shown, taking a vehicle as a target as an example, the method for selecting a search position at a search time based on a reinforcement learning algorithm provided in an embodiment of the present invention mainly includes the following steps:

[0061] Step S1. Data preprocessing: This step includes discretization of time and space; discretization of target movement trajectory; scalarization of search difficulty in different time and space, namely search cost: Step S11, connect and read the original database, and obtain the target GPS coordinate information, extract the complete trajectory data of the target one day according to the ID; step S12, discretize the time of one day at a fixed time interval ΔT, discretize a certain space according to a fixed size area ΔS, and each Disc...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a missing target searching method based on a reinforcement learning algorithm. The missing target searching method comprises the following steps: S1, data preprocessing including: discretizing time and space; discretizing a target moving track; standardizing the search difficulty in different time spaces; S2, constructing a reinforcement learning training environment: constructing the reinforcement learning training environment, wherein the training environment information comprises expected search costs of objects starting from different positions at different times atdifferent search moments and the probability of transferring to different positions at different search moments; S3, off-line training of a space-time search model: defining states and behaviors and performing adaptive optimization on the model; and S4, online space-time search decision making: iteratively determining a space-time search sequence by adopting a greedy strategy based on the space-time search model trained in the step S3, and executing space-time search. According to the method, the search cost for finding the position of the target at the target moment is effectively reduced, and the target search task under the search cost constraint is completed.

Description

Technical field [0001] The invention belongs to the field of missing target search under the constraint of group intelligence perception cost, and in particular relates to a missing target search method based on a reinforcement learning algorithm. Background technique [0002] Finding missing targets (for example, cars or people) in the city is essential for city safety management. For example, a suspicious car was identified at a certain point in the past. Instruction attached figure 1 Shows typical application scenarios. The serial number indicates the waypoint of the vehicle trajectory from 8:00 to 9:00 on a certain day, including the position of some key moments (light color). By determining the location of the suspicious vehicle at a specific moment (ie the target moment) and marking it on the map, and so on, until the approximate trajectory can be grasped. Soon after this, the police seized this clue and planned to monitor the suspicious vehicle's whereabouts to determin...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/9537G06N20/00G01S19/19
CPCG06F16/9537G06N20/00G01S19/19
Inventor 於志勇韩磊黄昉菀郭文忠
Owner FUZHOU UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products