Self-adaptive tiny action highlighting system

An adaptive, tiny technology, applied in the field of video processing, which can solve problems such as limitations

Pending Publication Date: 2021-02-09
PEKING UNIV
View PDF0 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In the field of video processing, there have been some previous works on micro-motion highlighting technology, but there is still a bottleneck: the phase-based micro-motion highlighting technology proposed by predecessors (N Wadhwa et al.2013) is aimed at videos containing specific motion components Effective, but limited for videos containing many small motion components at the same time

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Self-adaptive tiny action highlighting system
  • Self-adaptive tiny action highlighting system
  • Self-adaptive tiny action highlighting system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0018] The present invention will be further described through examples below, so as to better understand the technical solution of the present invention, but the present invention is not limited thereto. Resources such as video data used in the following embodiments, unless otherwise specified, can be obtained from various conventional video acquisition devices.

[0019] 1. Build a simulation video

[0020] In order to better explain the comparison between the effect of the system's adaptively highlighting the actions of different components and the gold standard, a simulation video is included in this embodiment to replace the original video data V obtained by the video acquisition module. 1 . image 3 It shows the first frame image of the simulation video and the corresponding positions of each component in the Fourier complex space. Due to the symmetry of the Fourier space, we can ignore image 3 The left half of the right figure, specifying image 3 The black-gray part...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for adaptively dividing a Fourier complex number space and carrying out tiny action highlighting. The method comprises the following steps: firstly, carrying out non-negative matrix factorization denoising and visual equalization preprocessing on a collected video; then, carrying out variational mode decomposition on different tiny action components existing in thevideo, splitting the video into sub-mode videos only containing a single action component according to a preset decomposition number, and then carrying out tiny action highlighting; and finally, filtering the video frame of each sub-modal video under different scales by the micro-motion highlighting processing module, extracting interested micro-motion frequency bands, performing phase amplification and inverse scale transformation, and performing superposition reconstruction on the same frame after inverse transformation of a plurality of modals to obtain a micro-motion highlighted video. Therefore, the effect of performing self-adaptive tiny action highlighting on the video is achieved, and a new tool is provided for the highlighting problem that various videos contain various tiny action components.

Description

technical field [0001] The invention relates to the field of video processing, and relates to a method for highlighting tiny movements. Background technique [0002] There are many small movements recorded by cameras in life. Although these tiny pixel-level movements are almost invisible to the human eye, they often contain important characteristics and intrinsic characteristics that reflect the object. For example, the periodic tiny blood vessel protrusions at the carotid artery are closely related to the blood supply to the human brain and can reflect vital signs; the tiny fluctuations caused by the breathing of creatures at the scene of natural disasters provide hope for the creatures to be rescued in the first place; bridges, The small vibration of the building under load greatly facilitates the analysis of its structural dynamic characteristics in a non-contact manner. In addition, the tiny movements of microorganisms, human cells, tissues, etc. that exist in the micr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/46
CPCG06V20/40G06V20/46G06V10/443
Inventor 龙云飞曾冯庆阳鹿群张珏
Owner PEKING UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products