Character interaction relationship detection method, device and system

Abstract

The invention discloses a character interaction relationship detection method, device and system. The method comprises the following steps: acquiring a to-be-detected video segment, wherein the video segment comprises a preset character interaction action; inputting the video segments into a pre-trained target detection network for framing target detection to obtain a preset first object detection point which is corresponding to each frame of image and possibly interacts with a human body; performing framing processing on the video segment, and extracting a preset first human body skeleton point of each frame of image; and connecting the first object detection point with the first human body skeleton point according to a preset connection mode, constructing a first space-time diagram, and inputting the first space-time diagram into a pre-trained space-time diagram convolutional network model to obtain a detection result of the character interaction action. The invention can solve the problems of time consumption, complex calculation and lack of fine grit caused by detecting all objects in a scene, only paying attention to the overall characteristics of a human body and analyzing the interaction relationship between the human body and the objects in the prior art.

Description

technical field [0001] The present invention relates to the technical field of human behavior recognition and analysis, in particular to a detection method, device and system for human interaction relationship. Background technique [0002] To achieve scene cognition, not only object instances must be detected, but also the visual relationship between object instances must be learned to be recognized. The visual relationship includes the relationship between objects and objects, the relationship between people and objects, and the relationship between people and people. Among them, the interactive relationship between characters is a special visual relationship. In identifying the interactive relationship between people, it is not only required to detect people and objects in the image, Also identify the category of interaction. [0003] Most of the existing human interaction detection methods use people as an instance to detect, but only using appearance features and rough...

AI Technical Summary

Problems solved by technology

[0004] The purpose of the embodiments of the present invention is to propose a detection method, device and system for character interaction relationship, so as to solve the time-consuming and troublesome problems caused by the detection of all objects in the scene and only focusing on the overall appearance characteristics of the human body in the existing detection method of character interaction. Computationally complex, lack of fine-grained problems

Images