Character interaction detection method based on bidirectional attention mechanism under knowledge guidance

An interactive detection and attention technology, applied in the field of human interaction recognition and detection, to achieve the effect of performance improvement, good detection performance, and good interpretability

Pending Publication Date: 2022-05-24
PEKING UNIV SHENZHEN GRADUATE SCHOOL
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In this case, how to conduct customized relationship analysis for different person-person pairs is a difficul

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Character interaction detection method based on bidirectional attention mechanism under knowledge guidance
  • Character interaction detection method based on bidirectional attention mechanism under knowledge guidance

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0032] In order to make the purposes, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below through specific embodiments in conjunction with the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present invention. , rather than all the embodiments, the drawings, the embodiments and their descriptions are used to explain the present invention, and do not constitute an improper limitation of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the scope of protection in this aspect.

[0033]The present invention adopts a two-stage person interaction detection process: firstly, instance detection (including people and objects) is performed and a person-object proposal pair is co...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a character interaction detection method based on a bidirectional attention mechanism under knowledge guidance. The character interaction detection method comprises the following five steps of target detection, grouping, bottom-up encoder, top-down encoder and binary classification. The key of character interaction detection on multiple person and object instances existing in a complex scene is that relation modeling analysis is effectively carried out on objects in the scene, and a knowledge-guided top-down attention mechanism is introduced into a character interaction detection task. The model can adaptively search related information in a scene for a given human-object pair so as to carry out interaction behavior discrimination, so that human interaction detection is realized; the method provided by the invention has better detection performance (mAP) and better interpretability.

Description

technical field [0001] The invention relates to character interaction recognition detection in pictures, in particular to a character interaction detection method based on a knowledge-guided bidirectional attention mechanism, which is a character interaction recognition detection method under a two-stage setting. [0002] technical background [0003] In recent years, with the continuous development of computer vision, the task of human-based interaction detection has received extensive attention. The core problem of the human interaction detection task is to understand and detect the relationship between people and their surrounding objects in the scene. This task has many broad application scenarios: it can be directly applied to monitoring systems, robot vision systems, and human-computer interaction. At the same time, it can be used as a basic interface to provide support for a series of downstream complex visual tasks, such as image and video recommendation and retrieval...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06V20/20G06V40/20G06N3/04G06N3/08
CPCG06N3/08G06N3/045
Inventor 李革杨百祥高伟
Owner PEKING UNIV SHENZHEN GRADUATE SCHOOL
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap