Real-time online pedestrian analysis and counting system and method in complex scene

Abstract

The invention provides a real-time online pedestrian analysis and counting system and method in a complex scene, and the method comprises the steps: taking video information as input, converting videodata into continuous RGB frame images through data preprocessing, and carrying out the personnel target detection through employing an original SSD network; secondly, inputting a plurality of generated suggestion boxes into two parallel branch networks for human body key point detection, one of the suggestion boxes is a stacked hourglass network for position correction and optimization of a suggestion box result generated by target detection, and the other suggestion box is a posture convolution machine. According to the method, a specific complex scene is analyzed, and a complete solution and framework is established; algorithms in multiple fields are organically integrated by utilizing the advanced feature of human body key points, so that the problems of target detection and tracking,human body key point analysis, human body action recognition, counting analysis and the like of personnel in an actual engineering scene can be solved, and the method has a wide application scene.

Description

technical field [0001] The invention belongs to the technical field of pedestrian analysis, and in particular relates to a real-time online pedestrian analysis and counting system and method in complex scenes. Background technique [0002] With the continuous progress and development of science and technology, pedestrian analysis technology is widely used in information statistics and related emergency measures in public places, such as people flow control, shopping mall layout reference and public security, etc. This technology not only has a wide range of applications in intelligent monitoring systems Promising and great potential, it is also an attractive and challenging problem in computer vision. The visual analysis of pedestrian movement is an emerging frontier research field, involving intelligent assisted driving, motion capture, intelligent monitoring, human behavior recognition and analysis, environmental control and monitoring, etc. It can be widely used in banks,...

AI Technical Summary

Problems solved by technology

This method can deal with the occlusion between pedestrians, the influence of image depth and the change of pedestrian pose to a certain extent. However, in the actual engineering scene with severe human body occlusion, changeable pose and many disturbing objects, the detection results of the existing method are still to be determined. improve

[0005] At present, although pedestrian analysis has made breakthroughs in individual fields such as target detection and tracking, human action recognition, etc., it lacks a complete set of solutions and frameworks that can solve the problem of pedestrian analysis and counting in complex scenes. It only exists in isolation and cannot be integrated organically, making it difficult to transfer and cross-process data information, the data utilization rate is not high, and the effect of detection and recognition is difficult to improve in actual engineering scenarios

In addition, due to the limited shooting angle of the camera and the occlusion of the moving target by the complex background, it is difficult to detect and track the target, and the analysis of pedestrians in a single monitoring area for a single camera is often affected by the complex background, lighting and The large influence of factors such as interference objects cannot well solve the interference caused by the non-rigid deformation of the human body and the occlusion of pedestrians on the detection results.

Finally, due to the emergence of high-definition cameras, massive video data has relatively high requirements for computer hardware, and the existing methods cannot achieve a balance in terms of performance and speed.

When processing high-resolution video frame images, most algorithms perform offline analysis, and the detection speed drops, making it impossible to realize online real-time pedestrian analysis and counting in complex scenes

[0006] To sum up, most of the current research on pedestrian analysis technology is still based on data sets in simple scenarios for algorithm testing, and the application background is relatively single, which cannot well solve the problems in specific actual engineering scenarios. The proposed method Either it is too simple, or the calculation speed cannot keep up, it is difficult to apply to real-time systems, and there is a lack of establishment of a set of real-time and efficient solutions and frameworks. The detection effect of pedestrian analysis and counting problems in complex environments such as offshore oil production platforms needs to be improved urgently

Images