Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Human body action detection method suitable for mobile robot platform

A technology of mobile robots and human body movements, applied in instruments, computer components, biological neural network models, etc., can solve problems such as complex network structures

Pending Publication Date: 2021-08-20
NANJING UNIV OF TECH
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The current relatively new technology in this field is to directly establish a model of the paired interaction relationship between two target objects, and then continue to determine the actions of the two, but the relationship between objects in reality is not always available. The clues that can be presented in pairs and can provide more accurate information often exist in the implicit interactive relationship between the target and surrounding things (that is, the high-order relationship derived from the direct first-order relationship); The predecessors have also done a lot of work to model the high-order interaction relationship. Most of them need to add a pre-trained object detector on the basis of the original network, which will make the network structure more complex and use has many limitations

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Human body action detection method suitable for mobile robot platform
  • Human body action detection method suitable for mobile robot platform
  • Human body action detection method suitable for mobile robot platform

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047] A human body motion detection method suitable for a mobile robot platform of the present invention will be further described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0048] Such as Figure 1 ~ Figure 3 As shown, a human motion detection method suitable for a mobile robot platform includes the following steps:

[0049] Step 1, obtain feature quantity: edit the input video, use the existing person detector and backbone network to extract N target person features A from the key frames respectively 1 ,A 2 ,...,A N ∈R C and a set of background environment feature maps X∈R C ×H×W , where C represents the channel, H represents the height, W represents the width; R represents the number field;

[0050] Step 2, generate the encoding of the first-order target person-background environment relationship: import the two sets of features obtained in step 1 into the person-centered relationship network OCR-Net, and gene...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a human body action detection method suitable for a mobile robot platform, which comprises the following steps: step 1, collecting a characteristic quantity: editing an input video, and respectively extracting N target character characteristics A1, A2,..., AN belonging to RC and a group of background environment characteristic mapping X belonging to RC * H * W from a key frame by adopting a character detector and a backbone network, c represents a channel, H represents height, and W represents width; r represents a number field. The high-order interaction relation is modeled in the form of target person-background environment-target person relation (OCOR), the indirect relation between multiple target persons and the background environment is deduced, then action positioning is achieved more accurately and efficiently, the whole design is simple and flexible, information of the background environment and other objects is fully utilized, and the method has the advantages of being high in practicability and easy to popularize. The accuracy of target action detection can be effectively improved.

Description

technical field [0001] The invention relates to the technical field of robot application, in particular to a human body motion detection method suitable for a mobile robot platform. Background technique [0002] As an important branch in the field of video understanding, human action detection technology is being more and more widely used. At present, the obstacle avoidance of mobile robots is mostly based on passive methods such as laser radar and infrared induction. Once there is an emergency (such as a passerby suddenly appearing on the road of the robot), the mobile robot will suddenly brake, which will greatly reduce the use of the robot motor. Life expectancy; at the same time, in some complex environmental scenarios, unsafe things such as pickpocketing and people falling may occur from time to time. At present, only relying on artificial video monitoring judgments still has the defects of incomplete monitoring range and low efficiency. In view of the above problems, ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/00G06K9/32G06K9/62G06N3/04
CPCG06V40/20G06V10/25G06N3/045G06F18/213G06F18/241
Inventor 朱文俊孙阳易阳张梦怡
Owner NANJING UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products