Behavior detection system applied to complex scene

Abstract

The invention discloses a behavior detection system applied to a complex scene. The behavior detection system is structurally characterized in that a network camera is connected with a hard disk video recorder in a field control box through a switch in the field control box; the 5G wireless signal transceiver unit CPE is connected with the switch; the detection module taking the CPU and the GPU as the core is connected with the switch; the detection module carries out sampling processing on a video stream collected by the network camera and sends a processing result to the background end through the CPE. In the detection module, an AI algorithm is adopted to process and identify a video stream, and in the AI algorithm, skeleton information of a person in each frame is extracted from a video frame sequence obtained by an image acquisition device; carrying out normalization processing on position features of skeleton joints of the skeleton information in corresponding frames; and finally, performing identification by adopting an action skeleton identification network, and performing classified output.

Description

technical field

[0001] The invention relates to the technical field of target recognition, in particular to a behavior detection system applied to complex scenes. technical background

[0002] The research purpose of behavior detection is to locate the specific temporal and even spatial location of behaviors of interest from long videos, which is one of the most important video understanding tasks. In complex application scenarios, the target is usually affected by factors such as illumination change, noise, environment, etc., and has a large appearance change, which leads to the degradation of algorithm performance, and it becomes a very challenging task to accurately track pedestrians. What needs to be considered is that complex scenes are changing, and pedestrian tracking needs to adapt to dynamic changes in the scene, especially changes in lighting conditions, such as changes in light intensity caused by fluttering clouds, and sudden changes in weather.

[0003] With th...

Examples

Embodiment Construction

[0010] The present invention is further described below in conjunction with the accompanying drawings and specific embodiments:

[0011] refer to figure 1 and figure 2 , In this example, the system is applied at traffic intersections to detect pedestrians. In this example, the image acquisition device is a network camera, and the network camera is connected to the hard disk video recorder in the box through the switch in the on-site control box; there is also a 5G wireless signal transceiver unit CPE in the control box, and the CPE is connected to the switch; There is a detection module with CPU and GPU as the core, the detection module is connected with the switch, and the video stream collected by the network camera is sampled and processed, and the processing result is sent to the backend through the CPE;

[0012] In the application of this system, the detection module can be integrated on the basis of the existing monitoring equipment, and the use requirements of the ba...

technical field

[0001] The invention relates to the technical field of target recognition, in particular to a behavior detection system applied to complex scenes. technical background

[0002] The research purpose of behavior detection is to locate the specific temporal and even spatial location of behaviors of interest from long videos, which is one of the most important video understanding tasks. In complex application scenarios, the target is usually affected by factors such as illumination change, noise, environment, etc., and has a large appearance change, which leads to the degradation of algorithm performance, and it becomes a very challenging task to accurately track pedestrians. What needs to be considered is that complex scenes are changing, and pedestrian tracking needs to adapt to dynamic changes in the scene, especially changes in lighting conditions, such as changes in light intensity caused by fluttering clouds, and sudden changes in weather.

[0003] With th...

Examples

Embodiment Construction

[0010] The present invention is further described below in conjunction with the accompanying drawings and specific embodiments:

[0011] refer to figure 1 and figure 2 , In this example, the system is applied at traffic intersections to detect pedestrians. In this example, the image acquisition device is a network camera, and the network camera is connected to the hard disk video recorder in the box through the switch in the on-site control box; there is also a 5G wireless signal transceiver unit CPE in the control box, and the CPE is connected to the switch; There is a detection module with CPU and GPU as the core, the detection module is connected with the switch, and the video stream collected by the network camera is sampled and processed, and the processing result is sent to the backend through the CPE;

[0012] In the application of this system, the detection module can be integrated on the basis of the existing monitoring equipment, and the use requirements of the ba...

Images