Multi-view stereo vision scene stream-based strenuous exercise detection method

A technology of multi-eye stereo vision and violent motion, which is applied in image data processing, instrumentation, computing, etc., can solve the problems of false alarm and missing alarm, and achieve the effect of effective violent motion detection

A technology of multi-eye stereo vision and violent motion, which is applied in image data processing, instrumentation, computing, etc., can solve the problems of false alarm and missing alarm, and achieve the effect of effective violent motion detection

CN107341815AActive Publication Date: 2017-11-10HARBIN ENG UNIV

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-view stereo vision scene stream-based strenuous exercise detection method
  • Multi-view stereo vision scene stream-based strenuous exercise detection method
  • Multi-view stereo vision scene stream-based strenuous exercise detection method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0050] combine figure 1 , the violent motion detection based on the multi-eye stereo vision scene stream of the present invention mainly includes the following steps:

[0051] S1. Use the calibrated multi-eye camera to acquire multiple sets of image sequences.

[0052] S2. Preprocess the input image, and use the image pyramid to perform multi-resolution downsampling on the image sequence. The coordinate system is transformed according to the internal and external parameters of the camera, and the relationship between the image coordinate system and the camera coordinate system is established.

[0053] S3. Design of scene flow energy functional data items. Different from most previous constraint methods that combine optical flow and parallax, the present invention directly fuses 3-dimensional scene flow information and 3-dimensional surface depth information. The design of the data items adopts the assumption of constancy based on the structure tensor and introduces a robust...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a multi-view stereo vision scene stream-based strenuous exercise detection method which comprises the following steps: I: acquiring multiple groups of image sequences by using a calibrated multi-view camera; II: preprocessing the image sequences; III: designing a scene stream energy function data item; IV: designing a scene stream energy function smoothing item; V: optimally solving an energy function, and performing calculation with a calculation model from an image with the lowest resolution in an image pyramid obtained in the step II; VI: clustering a scene stream exercise region; VII: constructing an exercise direction discrete degree estimation model to judge whether an exercise is a strenuous exercise; VIII: constructing an exercise region kinetic energy size estimation model; and XI: setting a threshold value, and triggering an alarm when continuous n frames meet an estimation condition. By adoption of multi-view stereo vision scene stream-based estimation, the multiple groups of image sequences of the same scene are acquired by using the calibrated multi-view camera, and the strenuous exercise can be effectively detected by using a three-dimensional scene stream.

Description

technical field [0001] The invention relates to a violent motion detection method, in particular to a violent motion detection method based on multi-eye stereo vision scene flow. Background technique [0002] With the high development of today's scientific and technological information technology, especially human beings have made breakthroughs in computer vision and artificial intelligence, many tasks that should be done by humans can be done by computers. For example, video surveillance, the most common method of operation is for people to observe the monitoring display and then respond to abnormal events that occur. Since people cannot concentrate for a long time to monitor all the events happening in the video, the phenomenon of missed alarms inevitably occurs. Therefore, it is particularly important to use a computer to process video frames and determine whether an abnormal event occurs. [0003] Under normal circumstances, the camera of video surveillance is fixed in...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
10 Nov 2017
Publication
CN107341815A
IPC
G06T7/215; G06T7/246; G06T7/292
CPC
G06T7/215; G06T7/251; G06T7/292
Inventors
项学智; 肖德广