Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Lagrange video motion amplification method based on image deformation technology

A technology of motion magnification and image deformation, applied in image enhancement, image analysis, image data processing and other directions, can solve problems such as increasing the complexity of the algorithm

Pending Publication Date: 2020-07-31
CHINA THREE GORGES UNIV
View PDF4 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This not only requires expensive optical flow calculation time, but also needs to apply motion segmentation technology and texture filling technology in each frame of the video. For occlusion boundaries and complex motion areas, human intervention is required. These processes greatly increase the algorithm. Complexity

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Lagrange video motion amplification method based on image deformation technology
  • Lagrange video motion amplification method based on image deformation technology
  • Lagrange video motion amplification method based on image deformation technology

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0059] The invention discloses a video micro-motion amplification method based on image deformation, and the specific process is as follows Figure 7 as shown,

[0060] The specific steps of this embodiment are as follows:

[0061] Step 1, input a baby video, the resolution of the image frame is 1280×720, such as Figure 1a shown;

[0062] Step 2, frame alignment, detects feature points in the first frame and tracks them in the subsequent sequence of frames. The overall position change of the camera is obtained by estimating the coordinate changes of the smaller moving points, and finally the subsequent frames are aligned with the first frame through affine transformation to obtain a video sequence with a static background;

[0063] Step 3, target area selection, first manually select a number of points around the baby, and then connect these points to form a polygon, within the polygon is the area of ​​interest, this example is called the target area, such as Figure 1b , ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a Lagrange video motion amplification method based on an image deformation technology. The method comprises the steps: estimating the motion information of feature points of a region of interest in a video through an optical flow method, amplifying the motion displacement, and then taking the coordinates of the feature points before and after amplification as traction points, and achieving the motion amplification of an image through an image deformation technology for maintaining image content. Compared with the current motion amplification technology, the method has less blurring and ringing artifacts, and each frame of image can be processed only by a small amount of manual intervention. An input picture sequence is from a static camera; an amplification area canbe manually selected and amplification times can be set, the whole system can automatically detect and track feature points, a target area is deformed through an image deformation technology after motion is estimated again, and finally, a foreground and a background are reconstructed to obtain an amplified video sequence, so physical motion of a target in a video is amplified.

Description

technical field [0001] The invention relates to the application field of computer technology, in particular to a Lagrangian video motion amplification method based on image deformation technology. Background technique [0002] In the real world, every moment there are slight movements that are difficult for the human eye to detect. Video micro-motion amplification technology can display these motions. This technology is widely used in the fields of medical health, scientific analysis and building monitoring. Therefore, it is necessary to use motion amplification technology to solve the problem of difficult-to-detect micro-motion observation. However, this is a very difficult task because the motion in the original video is so faint that it is difficult to distinguish them from noise. The current technique can be divided into two categories: Euler-based methods and Lagrangian-based methods. [0003] Euler-based methods do not distinguish motion from stationary regions, and ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T3/40G06T5/50G06T7/246
CPCG06T3/4007G06T5/50G06T2207/10016G06T7/246
Inventor 孙水发施云飞许安宁董方敏黄志勇但志平
Owner CHINA THREE GORGES UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products