Unlock instant, AI-driven research and patent intelligence for your innovation.

Efficient determination of optical flow between images

An optical flow and image technology, which is applied to the details of image stitching, image enhancement, image analysis, etc., can solve problems such as slow operation

Active Publication Date: 2019-02-05
META PLATFORMS INC
View PDF7 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Existing techniques for canvas view generation can be slow, for example, require manual stitching or other input from the user, and when dealing with differences in source camera views such as different brightness or color between camera views, existing techniques can be slow Encounter problems

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Efficient determination of optical flow between images
  • Efficient determination of optical flow between images
  • Efficient determination of optical flow between images

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0061] system structure

[0062] figure 1 It is a block diagram of the system environment in which the canvas creation system according to the embodiment of the present invention operates. figure 1 The illustrated system environment 100 includes an image capture system 105 , a canvas generation system 110 , and a client virtual reality (VR) device 115 . In other implementations, the system environment 100 can include different or additional components.

[0063] The image capture system 105 captures multiple camera views of the scene, which are processed by the canvas generation system 110 and can be presented to the user via the client VR device 115 . A scene can represent the physical environment in which the image capture system 105 captures the camera view. The scene can be enhanced later by the canvas generation system 105 to add virtual components to the scene. For example, the scene may be a park where a physical image capture system 105 is placed to capture a came...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A canvas generation system generates a canvas view of a scene based on a set of original camera views depicting the scene, for example to recreate a scene in virtual reality. Canvas views can be generated based on a set of synthetic views generated from a set of original camera views. Synthetic views can be generated, for example, by shifting and blending relevant original camera views based on anoptical flow across multiple original camera views. An optical flow can be generated using an iterative method which individually optimizes the optical flow vector for each pixel of a camera view andpropagates changes in the optical flow to neighboring optical flow vectors.

Description

Background technique [0001] This disclosure relates generally to the generation of canvas views for virtual reality headsets, and more particularly, to canvas view generation from images captured by cameras. A canvas view represents a panoramic wide-angle view that recreates a virtual reality scene, and can be paired with other canvas views to give the scene a 3D stereoscopic effect. Existing techniques for canvas view generation can be slow, for example, require manual stitching or other input from the user, and when dealing with differences in source camera views such as different brightness or color between camera views, existing techniques can be slow Encounter problems. Contents of the invention [0002] Embodiments of the invention can generate a canvas view of a scene based on images describing the scene captured, eg, by a camera in an image capture system, and images describing the scene captured by multiple cameras, or a set of raw camera views. A canvas view can ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): H04N5/247H04N5/222H04N5/262H04N13/239H04N13/243H04N23/90
CPCH04N13/239G06T7/269G06T5/50G06T2207/20221G06T7/33G06T7/246H04N13/128H04N13/282G06T2207/10012G06T2207/10024H04N13/243H04N13/111G06T3/4038G06T2200/32H04N23/90G06T7/207G06T7/215G06T7/337G06T19/006H04N13/156H04N13/257H04N5/222H04N5/2628
Inventor 布里安·基思·卡布拉尔福里斯特·塞缪尔·布里格斯阿尔贝特·帕拉·波索皮特·瓦伊达
Owner META PLATFORMS INC