Method and system for automatic video inserting frame compensation in mediated reality

A technology that mediates reality and compensation methods, applied in the field of image processing, can solve problems such as low comfort frames, undetected, etc., and achieve the effects of improving accuracy, smooth operation experience, and improving block effects

Inactive Publication Date: 2017-11-24
ZHONGKE HENGYUN CO LTD
View PDF8 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Mixed reality technology is now in the early stages of development, and there is currently no research and solution to this problem that occurs in mixed reality below the minimum comfort frame

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for automatic video inserting frame compensation in mediated reality
  • Method and system for automatic video inserting frame compensation in mediated reality
  • Method and system for automatic video inserting frame compensation in mediated reality

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] Embodiments of the present invention are described in detail below, and examples of the embodiments are shown in the drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary and are intended to explain the present invention and should not be construed as limiting the present invention.

[0038] The embodiment of the present invention proposes a method and system for automatic video frame interpolation and compensation in mediated reality, which adopts a motion compensation frame interpolation method to automatically perform fast video frame interpolation in a mixed reality engine.

[0039] Such as figure 1 with figure 2 As shown, the mediated automatic video frame insertion compensation method in the embodiment of the present invention includes the following steps:

[0040] In step S1, the 3D depth ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method and a system for automatic video inserting frame compensation in mediated reality. The method comprises the following steps of adopting a 3D depth camera to collect a real image in display; fusing the real image collected by the 3D depth camera and a virtual scene image through a visual image processing computer; obtaining an engine refresh rate, judging whether the engine refresh rate is lower than a preset frame rate threshold, if yes, storing two frames of fused video data fn-1 and fn, carrying out 8*8 bidirectional search weighting motion estimation and smoothing filtering on the two frames of data, judging whether the two frames of data meets a matching condition, if the matching conditions is met, utilizing a linear interpolation of a 4*4 pixel motion vector to obtain an initial interpolation value, otherwise splitting 8*8 blocks into 4*4 blocks to inherit a result of motion estimation of the last stage and carrying out smoothing filtering. According to the method and the system, the blocking effect caused by block partition in calculation of the motion vector can be effectively improved, and the accuracy of the motion vector is greatly improved.

Description

technical field [0001] The invention relates to the technical field of image processing, in particular to a method and system for mediating automatic video frame insertion compensation in reality. Background technique [0002] In mixed reality technology, when the engine is not connected to a virtual reality helmet, the refresh frequency of the video can meet the needs of viewing (without feeling dizzy). When a virtual reality helmet is connected to a machine with a slightly lower configuration, the video refresh rate will basically drop to about 40 frames (lower than the minimum comfortable frame rate of 60 frames for human viewing). The virtual reality helmet is a necessary device to realize the immersive experience, and the video refresh rate after wearing the helmet directly affects the final effect of the product. In order to achieve a better product experience, frame interpolation compensation must be performed for video frame rates lower than 60 frames to achieve a g...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04N19/172H04N19/55H04N19/577
CPCH04N19/172H04N19/55H04N19/577
Inventor 钟秋发锡泊黄煦高晓光李晓阳
Owner ZHONGKE HENGYUN CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap