A detection method, device and system for character interaction relationship

Abstract

The invention discloses a detection method, device and system for character interaction relationship. The method includes: acquiring a video segment to be detected; wherein, the video segment contains preset character interaction actions; inputting the video segment into a pre-trained target Frame-by-frame target detection is performed in the detection network to obtain a preset first object detection point corresponding to each frame of image that may interact with the human body; frame-by-frame processing is performed on the video segment, and the preset first object detection point of each frame of image is extracted The first human skeleton point; connecting the first object detection point and the first human skeleton point according to a preset connection mode, constructing a first space-time graph and inputting it into a pre-trained spatio-temporal graph convolutional network model, Get the detection result of the character interaction. The invention can solve the problems of time-consuming, complicated calculation and lack of fine-grainedness caused by detecting all objects in the scene and only focusing on the overall characteristics of the human body and analyzing the interaction relationship between the human body and the objects in the prior art.

Description

technical field [0001] The present invention relates to the technical field of human behavior recognition and analysis, in particular to a detection method, device and system for human interaction relationship. Background technique [0002] To achieve scene cognition, not only object instances must be detected, but also the visual relationship between object instances must be learned to be recognized. The visual relationship includes the relationship between objects and objects, the relationship between people and objects, and the relationship between people and people. Among them, the interactive relationship between characters is a special visual relationship. In identifying the interactive relationship between people, it is not only required to detect people and objects in the image, Also identify the category of interaction. [0003] Most of the existing human interaction detection methods use people as an instance to detect, but only using appearance features and rough...

AI Technical Summary

Problems solved by technology

[0004] The purpose of the embodiments of the present invention is to propose a detection method, device and system for character interaction relationship, so as to solve the time-consuming and troublesome problems caused by the detection of all objects in the scene and only focusing on the overall appearance characteristics of the human body in the existing detection method of character interaction. Computationally complex, lack of fine-grained problems

Images