Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

Nonuniform sparse sampling video super resolution method

A sparse sampling, super-resolution technology, applied in high-definition television systems, image data processing, instruments, etc., can solve the problems of waste of computation, reduced recovery performance, and reduced algorithm complexity, and achieves improved quality and reduced atomic size. The effect of low number and computational cost

Inactive Publication Date: 2016-11-09
SHENZHEN INSTITUTE OF INFORMATION TECHNOLOGY
View PDF3 Cites 19 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0010] (2) Current interpolation techniques or upsampling techniques have limitations in terms of reconstruction quality and computation time
Compared with image upsampling, current real-time video upsampling techniques produce more obvious visual artifacts and cannot fully utilize existing computing resources
At the same time, since the target boundary and important details are usually unknown, it will increase the calculation time of upsampling
[0011] (3) Due to the lack of high-frequency prior information and the limitation of computational complexity, the effect of super-resolution technology is unsatisfactory, far lower than the level that theoretical analysis should achieve
In practical applications, this is often limited by the computational complexity, and the individual restoration of each frame of image fails to effectively utilize the useful information of the restored image of the adjacent frame, resulting in a large waste of computation
The method based on iterative and adaptive filtering reduces the complexity of the algorithm by effectively utilizing the effective information of the restored high-resolution image, but this is at the cost of reducing the restoration performance
At present, the problems existing in the super-resolution reconstruction of compressed video mainly focus on three aspects: first, the effectiveness and universal adaptability of the compressed video model need further research; second, the effect of conventional reconstruction methods is not satisfactory, It is far lower than the level that theoretical analysis should achieve; third, the computational complexity of almost all reconstruction algorithms is too high to be implemented in real time
[0012] (4) The traditional wavelet transform cannot effectively capture the smoothness of image edges and contours, so it cannot achieve simplified or sparse image representation
The main difficulties include: how to implement sparse coding in video has certain technical barriers; sparse coding of heterogeneous data in heterogeneous networks has certain difficulties; video data is usually massive data, how to effectively expand the sparse coding algorithm and improve the efficiency of the algorithm , is also a very difficult problem

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Nonuniform sparse sampling video super resolution method
  • Nonuniform sparse sampling video super resolution method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be described in further detail below with reference to the accompanying drawings and examples.

[0031] The system architecture is designed as a tightly coupled structure that unites the server side and the client side (see appendix figure 1 ). At the source end, the original video signal (generally high-definition digital video (HD) source) is sampled non-uniformly and sparsely to form metadata, and the original resolution video is down-sampled and encoded into low-resolution and low-bit-rate video data; The data is transmitted on the network with the downsampled low-resolution video data; the high-resolution video is reconstructed by super-resolution interpolation technology at the client decoding end to provide good visual quality.

[0032] The whole process of non-uniform sparse sampling video super-resolution method (see figure 2 ) includes...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a nonuniform sparse sampling video super resolution method, which belongs to the technical field of video super resolution. The method comprises key technologies such as shot detection, key frame extraction, original image fuzzy processing and down sampling, nonuniform sampling vision model building, sparse dictionary construction, and video reconstruction. A nonuniform sparse sampling method based on foveated vision is adopted, differential sparse sampling is carried out on a video sequence, the number of atoms is greatly reduced, a dual dictionary of high and low resolutions (high and low resolution reference copy) is generated in real time or calculated in a prior mode according to the resolution of a mobile terminal device screen as carried meta data, a hardware-supported nonlinear Mipmap interpolation method is used for simulating and generating a Foveation image in real time, a result similar to that in a Gauss pyramid method can be acquired, and the computation overhead is lower.

Description

technical field [0001] The invention relates to the technical field of video super-resolution, in particular to a non-uniform sparse sampling video super-resolution method. Background technique [0002] Today's mobile devices have become an integral part of our daily lives. Mature wireless communication technology and video codec enable video streaming to run on mobile devices, so people can easily access digital content anytime and anywhere through mobile devices, such as online TV programs, music videos, sports reports and news programs, which Promote the integration of computers, radio and television networks, and various communication systems, make cross-platform video communication gradually become the mainstream method, and initially provide powerful multimedia engines and full high-definition video technology (full high-definition video) support. [0003] However, due to limitations of wireless network bandwidth and terminal processing capabilities, there are still m...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T3/40G06T5/00H04N7/015
CPCH04N7/015G06T3/4053G06T5/70
Inventor 张运生耿煜谭旭赖红许志良
Owner SHENZHEN INSTITUTE OF INFORMATION TECHNOLOGY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products