Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Human body behavior intelligent identification method based on multi-unmanned aerial vehicle visual angle image data driving

A multi-UAV and image data technology, which is applied in character and pattern recognition, mechanical equipment, combustion engines, etc., can solve the problems that are difficult to apply to UAV work scenarios, limit the accuracy and robustness of recognition effects, and achieve Improve the robustness of recognition and enhance the effect of recognition

Active Publication Date: 2021-07-13
TONGJI UNIV
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

But at the same time, because the depth camera is difficult to work normally in the outdoor environment, it is difficult to apply to most working scenarios of drones
Therefore, the accuracy and robustness of the recognition effect of the UAV behavior recognition method are largely limited.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Human body behavior intelligent identification method based on multi-unmanned aerial vehicle visual angle image data driving
  • Human body behavior intelligent identification method based on multi-unmanned aerial vehicle visual angle image data driving
  • Human body behavior intelligent identification method based on multi-unmanned aerial vehicle visual angle image data driving

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0052] An intelligent recognition method of human behavior based on image data driven by multi-UAV perspectives. This method first observes the same human target from different angles, different heights, and different distances through UAVs in different orientations, and collects information containing the target behavior. Then process the video sequences collected by each UAV to obtain the human body joint point coordinate sequence, and then use the LSTM-based short-time-long-term deep neural network to perform time-series modeling on the human body joint point coordinate sequence to obtain a single The human behavior recognition result probability of all UAVs is calculated, and finally the human behavior recognition result probability of all UAVs is fused to obtain the human behavior recognition result. This method uses UAVs in different orientations to observe the same human target from different angles, different heights, and different distances, and jointly judges through ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a human body behavior intelligent identification method based on multi-unmanned aerial vehicle visual angle image data driving, and the method comprises the steps: observing from different angles, different heights and different distances through unmanned aerial vehicles in different directions relative to a same human body target, and collecting to obtain a video sequence containing a target behavior; processing a video sequence collected by each unmanned aerial vehicle to obtain a human body joint point coordinate sequence, and using a short-time-long-time deep neural network based on LSTM to model a time sequence of the human body joint point coordinate sequence to obtain a human body behavior recognition result probability of a single unmanned aerial vehicle; and finally, fusing the human behavior recognition result probabilities of all the unmanned aerial vehicles to obtain a human behavior recognition result. Compared with the prior art, the invention has the advantages that the robustness is high, the human behavior recognition effect is effectively enhanced, the method can be applied to various complex environments, and a new solution is provided for unmanned aerial vehicle human behavior recognition tasks.

Description

technical field [0001] The invention relates to the technical field of UAV visual behavior recognition, in particular to an intelligent human behavior recognition method driven by multi-UAV perspective image data. Background technique [0002] Human action recognition is an important research direction in the field of computer vision. The essence of the human behavior recognition process is to model the temporal-spatial relationship according to the behavior of the observed target, so as to judge the behavior category of the observed target. With the rapid development of artificial intelligence technology and image processing technology in recent years, human behavior recognition technology has also been rapidly improved, and is gradually applied to a wide range of fields such as human-computer interaction, urban monitoring systems, and motion analysis. [0003] As a highly integrated unmanned device, UAV can be applied to diverse mission requirements due to its strong mane...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/46G06K9/62G06N3/04
CPCG06V40/20G06V20/46G06V10/44G06N3/044G06F18/2415G06F18/256Y02T10/40
Inventor 符长虹曾祥鹏林付凌叶俊杰曹子昂
Owner TONGJI UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com