Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Severe motion detection method based on multi-eye stereo vision scene flow

A technology of multi-eye stereo vision and violent motion, which is applied in image analysis, instrumentation, calculation, etc., can solve the problems of false alarm and missing alarm, and achieve the effect of effective violent motion detection

Active Publication Date: 2020-10-16
HARBIN ENG UNIV
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In the absence of depth information, it is difficult to evaluate and judge the detection of violent motion, which is likely to cause false alarms and missed alarms

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Severe motion detection method based on multi-eye stereo vision scene flow
  • Severe motion detection method based on multi-eye stereo vision scene flow
  • Severe motion detection method based on multi-eye stereo vision scene flow

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0050] combine figure 1 , the severe motion detection based on multi-eye stereo vision scene flow of the present invention mainly comprises the following steps:

[0051] S1. Use the calibrated multi-eye camera to acquire multiple sets of image sequences.

[0052] S2. The input image is preprocessed, and the image sequence is multi-resolution down-sampled by using the image pyramid. Transform the coordinate system according to the internal and external parameters of the camera, and establish the relationship between the image coordinate system and the camera coordinate system.

[0053] S3. Design of scene flow energy functional data items. Different from most previous constraint methods that combine optical flow and parallax, the present invention uses direct fusion of 3D scene flow information and 3D surface depth information. The design of the data item is based on the constancy assumption of the structure tensor, and a robust penalty function is introduced at the same tim...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a multi-view stereo vision scene stream-based strenuous exercise detection method which comprises the following steps: I: acquiring multiple groups of image sequences by using a calibrated multi-view camera; II: preprocessing the image sequences; III: designing a scene stream energy function data item; IV: designing a scene stream energy function smoothing item; V: optimally solving an energy function, and performing calculation with a calculation model from an image with the lowest resolution in an image pyramid obtained in the step II; VI: clustering a scene stream exercise region; VII: constructing an exercise direction discrete degree estimation model to judge whether an exercise is a strenuous exercise; VIII: constructing an exercise region kinetic energy size estimation model; and XI: setting a threshold value, and triggering an alarm when continuous n frames meet an estimation condition. By adoption of multi-view stereo vision scene stream-based estimation, the multiple groups of image sequences of the same scene are acquired by using the calibrated multi-view camera, and the strenuous exercise can be effectively detected by using a three-dimensional scene stream.

Description

technical field [0001] The present invention relates to a method for detecting violent motion, in particular to a method for detecting violent motion based on multi-eye stereoscopic scene flow. Background technique [0002] With the high development of today's science and technology information technology, especially the breakthroughs made by humans in computer vision and artificial intelligence, many tasks that should be done by humans can be done by computers. For example, in video surveillance, the most common method of operation is for people to observe the monitor display, and then respond accordingly to abnormal events that occur. Since people cannot concentrate on monitoring all the events in the video for a long time, the phenomenon of missed alarms will inevitably occur. Therefore, it is particularly important to use a computer to process video frames and judge whether abnormal events occur. [0003] In general, the position of the video surveillance camera is fix...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T7/215G06T7/246G06T7/292
CPCG06T7/215G06T7/251G06T7/292
Inventor 项学智肖德广宋凯翟明亮吕宁尹力郭鑫立王帅张荣芳于泽婷张玉琦
Owner HARBIN ENG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products