View-related operations during panoramic video playback
A technology of panoramic video and related operations, applied in color TV parts, TV system parts, digital video signal modification and other directions, can solve problems such as waste of resources, and achieve the effect of improving quality
Active Publication Date: 2021-01-15
MICROSOFT TECH LICENSING LLC
View PDF7 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0004] When computer systems reconstruct and render panoramic video, resources may be wasted reconstructing image content that was not viewed
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment approach
[0135] In some example embodiments, to reproject the relevant portion of the input equirectangular projection to the output equirectangular projection, for each position of the output equirectangular projection, a corresponding position in the input equirectangular projection is identified. Sample values are then assigned to locations in the output equirectangular projection based on sample values at corresponding locations in the input equirectangular projection or interpolation between sample values at adjacent locations in the input equirectangular projection.
[0136] Figure 12The output equirectangular projection (1210) is shown having w O The width of the sampled value and h O The height of the sampled value. The point of the output equirectangular projection (1210) is u O ,v O mark. For illustration, output the point u in the equirectangular projection (1210) O ,v O is the center point in the view direction, but the reprojection operation is performed in t...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
This disclosure describes innovations in the reconstruction and rendering of panoramic videos. For example, a view-dependent operations controller of a panoramic video playback system receives an indication of a view direction for an application and identifies a segment of a panoramic video picture in an input projection based at least in part on the view direction. The view-dependent operations controller restricts the operations of the color converter, video decoder, and / or stream controller to the identified fragments. In this way, the panoramic video playback system can avoid performing operations to reconstruct segments of the panoramic video picture that will not be viewed. As another example, a mapper of a panoramic video playback system reprojects at least some samples in an input slab projection toward a center position in the view direction, thereby producing an output slab projection that an application can use to generate one or more screen projection.
Description
Background technique [0001] Video is delivered in digital form when it is streamed over the Internet and played back through a web browser or media player. Digital video is also used in the delivery of video over many broadcast services, satellite services, and cable television services. Real-time video conferencing typically uses digital video, and digital video is used with most smartphones, web cameras, and other video capture devices during video capture. Digital video is also used in technologies such as virtual and augmented reality, whether the video is played back in a head-mounted display, mobile device, or other type of device. [0002] Panoramic video is video in which views in multiple directions around a central location are recorded simultaneously. The recorded video may include image content in every direction, or at least in every direction in a 360 degree sphere around the center location, including at least some image content above the center location and a...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): H04N5/232H04N9/67G06T3/00H04N19/597
CPCH04N9/67H04N13/243H04N5/76H04N19/597H04N23/698G06T3/073G06T3/067G06T3/12G06T3/08H04N19/136H04N19/44G06T7/13G06T7/90G06T3/20H04N5/775
Inventor M·沃斯尼亚克B·S·雷迪V·亚历山德罗夫D·H·梅班D·罗伊S·萨赫瓦尼
Owner MICROSOFT TECH LICENSING LLC