Audio and video fused monitoring method

A video fusion and audio technology, applied in TV, color TV, closed-circuit TV system and other directions, can solve the problems of narrow field of view, easy to be affected by the environment, less information obtained, etc., achieve good real-time performance, avoid high cost, solve the problem oversize effect

Inactive Publication Date: 2014-12-24
INST OF ACOUSTICS CHINESE ACAD OF SCI
View PDF8 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The purpose of the present invention is to overcome the shortcomings of a single video surveillance with a narrow field of view, being easily affected by the environment, and obtaining less information, thereby providing an audio-video fusion monitoring method based on a microphone array and a pan-tilt camera

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Audio and video fused monitoring method
  • Audio and video fused monitoring method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] The present invention will be further described now in conjunction with accompanying drawing.

[0038] The audio-video fusion monitoring method of the present invention realizes the monitoring of the monitoring scene based on the audio signal obtained by the microphone array and the video signal obtained by the camera.

[0039] Before describing the implementation steps of the method of the present invention in detail, the related concepts involved in the present invention will be described first.

[0040] Target feature database: The target refers to sudden abnormal events in the monitoring scene. The target feature database is used to store the feature information of the target. The features include basic features of audio or video signals, transform domain features, statistical features, motion features, and these Information about features in terms of time, space, spectrum, and phase (such as mean, variance, cepstrum, envelope, etc.).

[0041] Background noise data...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an audio and video fused monitoring method. The method includes the steps that an audio signal and a video signal are collected, and the collected signals are conditioned; synergistic preprocessing is performed on the conditioned signals; whether an obtained signal includes the audio signal and the video signal or not is judged, when the two signals are included, the audio signal and the video signal are analyzed in a fused mode, according to the fused analysis result, target information included in the audio and video signals is found out, and if the obtained signal only includes the audio signal, independent analysis and processing are performed on the audio signal to obtain the target information included in the audio signal; according to the obtained target information, whether the posture of a camera needs to be adjusted or not is determined, and if in need, the posture of the camera is adjusted, and then execution is performed again, wherein the process of adjusting the posture of the camera includes focusing, light supplementing and angle adjusting.

Description

technical field [0001] The invention relates to the monitoring field, in particular to an audio and video fusion monitoring method. Background technique [0002] Video surveillance is a major means in the surveillance field. Traditional video surveillance is mainly based on low-resolution monocular video sensors. Faced with increasingly complex dynamic scenes and the requirements of intelligent real-time early warning, its technology has two major challenges: first, the video sensor has a narrow viewing angle and is easily blocked. It is easily affected by complex meteorological conditions and light intensity, such as wind, rain, snow, fog and day and night changes; second, the algorithm complexity of video surveillance based on a large number of continuous video data streams for detection, positioning and tracking is relatively high, especially based on high-definition video The real-time performance of intelligent analysis is poor, and cost and energy consumption are also...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04N7/18H04N5/232H04N5/262G06F17/30
Inventor 陈孝良李晓东
Owner INST OF ACOUSTICS CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products