Multi-view stereo vision scene stream-based strenuous exercise detection method

A technology of multi-eye stereo vision and violent motion, which is applied in image data processing, instrumentation, computing, etc., can solve the problems of false alarm and missing alarm, and achieve the effect of effective violent motion detection

Active Publication Date: 2017-11-10
HARBIN ENG UNIV
View PDF4 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In the absence of depth information, it is difficult to evaluate and judge the detection of violent motion, which is likely to cause false alarms and missed alarms

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-view stereo vision scene stream-based strenuous exercise detection method
  • Multi-view stereo vision scene stream-based strenuous exercise detection method
  • Multi-view stereo vision scene stream-based strenuous exercise detection method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0050] combine figure 1 , the violent motion detection based on the multi-eye stereo vision scene stream of the present invention mainly includes the following steps:

[0051] S1. Use the calibrated multi-eye camera to acquire multiple sets of image sequences.

[0052] S2. Preprocess the input image, and use the image pyramid to perform multi-resolution downsampling on the image sequence. The coordinate system is transformed according to the internal and external parameters of the camera, and the relationship between the image coordinate system and the camera coordinate system is established.

[0053] S3. Design of scene flow energy functional data items. Different from most previous constraint methods that combine optical flow and parallax, the present invention directly fuses 3-dimensional scene flow information and 3-dimensional surface depth information. The design of the data items adopts the assumption of constancy based on the structure tensor and introduces a robust...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a multi-view stereo vision scene stream-based strenuous exercise detection method which comprises the following steps: I: acquiring multiple groups of image sequences by using a calibrated multi-view camera; II: preprocessing the image sequences; III: designing a scene stream energy function data item; IV: designing a scene stream energy function smoothing item; V: optimally solving an energy function, and performing calculation with a calculation model from an image with the lowest resolution in an image pyramid obtained in the step II; VI: clustering a scene stream exercise region; VII: constructing an exercise direction discrete degree estimation model to judge whether an exercise is a strenuous exercise; VIII: constructing an exercise region kinetic energy size estimation model; and XI: setting a threshold value, and triggering an alarm when continuous n frames meet an estimation condition. By adoption of multi-view stereo vision scene stream-based estimation, the multiple groups of image sequences of the same scene are acquired by using the calibrated multi-view camera, and the strenuous exercise can be effectively detected by using a three-dimensional scene stream.

Description

technical field [0001] The invention relates to a violent motion detection method, in particular to a violent motion detection method based on multi-eye stereo vision scene flow. Background technique [0002] With the high development of today's scientific and technological information technology, especially human beings have made breakthroughs in computer vision and artificial intelligence, many tasks that should be done by humans can be done by computers. For example, video surveillance, the most common method of operation is for people to observe the monitoring display and then respond to abnormal events that occur. Since people cannot concentrate for a long time to monitor all the events happening in the video, the phenomenon of missed alarms inevitably occurs. Therefore, it is particularly important to use a computer to process video frames and determine whether an abnormal event occurs. [0003] Under normal circumstances, the camera of video surveillance is fixed in...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/215G06T7/246G06T7/292
CPCG06T7/215G06T7/251G06T7/292
Inventor 项学智肖德广宋凯翟明亮吕宁尹力郭鑫立王帅张荣芳于泽婷张玉琦
Owner HARBIN ENG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products