Unlock instant, AI-driven research and patent intelligence for your innovation.

Methods and apparatus for encoding, communicating and/or using images

An image and image capture technology, applied in image communication, image data processing, components of TV systems, etc., can solve the problems of high-resolution image communication, impracticality, etc. Effect

Pending Publication Date: 2022-02-01
NEVERMIND CAPITAL LLC
View PDF10 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Unfortunately, capturing high-resolution images at high frame rates may involve the use of extremely expensive high-speed, high-resolution cameras, which may not be practical due to cost reasons for many applications
[0005] While capturing high-resolution images to support virtual reality is desirable, there can be communication issues with overall delivery of large numbers of high-resolution images, given the bandwidth constraints of the communication networks available to transmit the images to playback devices

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Methods and apparatus for encoding, communicating and/or using images
  • Methods and apparatus for encoding, communicating and/or using images
  • Methods and apparatus for encoding, communicating and/or using images

Examples

Experimental program
Comparison scheme
Effect test

Embodiment approach 1

[0122] Method Embodiment 1 A content distribution method comprising: storing (908) images (751) captured at a first frame rate, performing interpolation (924) to generate interpolated frame data to support a second frame rate of the frame rate; and communicating (926) the captured frame data and the interpolated frame data to at least one playback device.

[0123] Method Embodiment 2 The method of method embodiment 1, wherein the first frame rate is the highest frame rate supported by the camera used to capture images when the camera is operating at a maximum image capture resolution.

[0124] Method embodiment 3 The method according to method embodiment 1, further comprising: operating a camera of a first camera of the camera pair to capture the images at a first rate.

[0125] Method embodiment 4. The method of method embodiment 3, wherein when capturing images at a lower resolution, the first camera supports a higher frame rate than said first frame rate.

[0126] Method E...

Embodiment approach 11

[0154] System Embodiment 11C The image capture and processing system according to system embodiment 11B, wherein the 3D video information includes left eye information and right eye information corresponding to each frame time of the base video layer.

[0155] Computer-readable first numbered list

Embodiment approach

[0157] Computer-readable medium embodiment 1 A non-transitory computer-readable medium comprising computer-executable instructions that, when executed by a processor (706) of a content delivery system (700), cause the processor to control the content delivery system (700) to: access an image (751) stored in the memory (712) of the content delivery system (700) that has been captured by the camera (1302) at a first frame rate; perform interpolation (924) to generate The frame data is interpolated to support a second frame rate higher than the first frame rate; and the capture frame data and the interpolated frame data are communicated (926) to at least one playback device.

[0158] Second List of Numbered Method Implementations

[0159] Method Embodiment 1. A method of operating a playback system (300), the method comprising: receiving (1603) capture frame data and interpolated frame data; recovering (1607) a capture frame from the received capture frame data; generating (16...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

Methods and apparatus for capturing, communicating and using image data to support virtual reality experiences are described. Images, e.g., frames, are captured at a high resolution but lower frame rate than is used for playback. Interpolation is applied to captured frames to generate interpolated frames. Captured frames, along with interpolated frame information, are communicated to the playback device. The combination of captured and interpolated frames correspond to a second frame playback rate which is higher than the image capture rate. Cameras operate at a high image resolution but slower frame rate than images could be captured with the same cameras at a lower resolution. Interpolation is performed prior to delivery to the user device with segments to be interpolated being selected based on motion and / or lens FOV information. A relatively small amount of interpolated frame data is communicated compared to captured frame data for efficient bandwidth use.

Description

[0001] Related Patent Applications [0002] This application claims the benefit of the filing date of U.S. Provisional Patent Application Serial No. 62 / 838,300, filed April 24, 2019, which is hereby expressly incorporated by reference in its entirety. technical field [0003] The present invention relates to methods and apparatus for encoding and delivering images with motion for a virtual reality system (eg, a system that supports playback on a virtual reality device, eg, that can render 2D or 3D image content). Background technique [0004] High quality image capture may be important for practical virtual reality applications. Unfortunately, capturing high-resolution images at high frame rates may involve the use of extremely expensive high-speed, high-resolution cameras, which may not be practical due to cost reasons for many applications. [0005] While it is desirable to capture high resolution images to support virtual reality, there may be communication issues with ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): H04N13/139H04N13/161H04N13/194H04N13/243H04N13/344
CPCH04N13/139H04N13/194H04N13/243H04N13/344H04N13/111H04N13/275H04N19/132H04N19/137H04N19/172H04N19/597H04N19/587G06T19/00H04N23/951
Inventor R·潘查吉努拉D·克勒A·莫斯
Owner NEVERMIND CAPITAL LLC