Method and system for rendering 360° virtual reality (VR) streaming based on user viewport

The method optimizes 360° VR streaming by transcoding, dividing, and encoding video feeds to create ultra-low resolution chunks, addressing bandwidth inefficiencies and ensuring smooth rendering on low-end devices.

WO2026003866A1PCT designated stage Publication Date: 2026-01-02TESSERACT IMAGING PVT LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
PCT/IN2025/050921
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-06-28
Filing Date
2025-06-23
Publication Date
2026-01-02

AI Technical Summary

Technical Problem

Existing 360° Virtual Reality (VR) streaming methods inefficiently utilize bandwidth, leading to high data usage and inconsistent quality due to complete video transfer or partitioning, causing spikes during user movement or edge viewing.

Method used

A method and system that transcodes video feeds into a compressed spatial format, divides them into frames, encodes using Adaptive Bitrate (ABR) logic, generates ultra-low resolution videos, retrieves metadata-based chunks, decodes and merges them to create optimized 360° VR streaming compatible with low-end devices.

Benefits of technology

Optimizes bandwidth usage and ensures consistent quality by dynamically rendering 360° VR streaming on low-end devices, reducing data requirements and maintaining smooth user experience despite network fluctuations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure IN2025050921_02012026_PF_FP_ABST
    Figure IN2025050921_02012026_PF_FP_ABST
Patent Text Reader

Abstract

The present invention relates to a system and a method for rendering a 360° Virtual Reality (VR) streaming The invention supports rendering 360° Virtual Reality (VR) streaming on a low-end device on without requirement of a 4k / 8k decoder. The present invention achieves optimized method for rendering 360° Virtual Reality (VR) streaming by dividing a spatially compressed plurality of video feeds into multiple frames, which are further sub divided in multiple parts / sub frames. Based on a user's view port, a plurality of video chunks is retrieved and decoded. Further, an ultra-low full video of the spatially compressed plurality of video feeds is merged with the decoded video chunks for the optimized rendering 360° Virtual Reality (VR) streaming which is compatible to run on the low-end device.
Need to check novelty before this filing date? Find Prior Art

Description

METHOD AND SYSTEM FOR RENDERING 360° VIRTUAL REALITY (VR) STREAMING BASED ON USER VIEWPORTCROSS-REFERENCE TO RELATED DISCLOSUREThis application claims priority to the Indian Patent Application No. 202421049708, titled "Method and system for rendering 360° virtual reality (VR) streaming based on user viewport", filed with the Indian Patent Office on June 28, 2024, the entire contents of which are incorporated herein by reference.FIELD OF THE INVENTION

[0001] The present invention relates to the field of wireless communication system, more particularly relates to a method and a system for rendering 360° Virtual Reality (VR) streaming.BACKGROUND OF THE INVENTION

[0002] In communication networks, a Virtual Reality (VR) streaming allows users to project VR content on a User Equipment (UE) such as a headset. This is achieved through basic technologies like 360° cameras that capture a user's immediate surroundings and allows the users to view these images / videos in much higher quality.

[0003] Traditionally, in 360° VR streaming, the complete video is transferred to the UE and then decoding is performed. In such scenarios, only the 25% of the available data pertaining to the complete video is usable to the user, that’s the amount of data which the user is seeing at that point of time.

[0004] In yet another scenario, in the 360° VR streaming, the compete video is divided / split in six parts and further the video of that part of the video which is seen by the user at that point of time is loaded on the UE. This approach leads to a reduction in the bandwidth usage which ranges between 50% to 70%. Although, this approachcreates spikes in the bandwidth usage when the user is looking at edges of the video or the user movement is very fast.

[0005] Therefore, there is a need for a method and a system for rendering 360° Virtual Reality (VR) streaming which further optimizes the bandwidth usage and minimizes requirements in a system and the UE for rendering 360° Virtual Reality (VR) streaming.SUMMARY OF THE INVENTION

[0006] One or more embodiments of the present disclosure provides a method and a system for rendering 360° Virtual Reality (VR) streaming.

[0007] In one aspect of the present invention, the method of rendering 360°Virtual Reality (VR) streaming is disclosed. The method includes the step of transcoding, by one or more processors, plurality of video feeds to a compressed spatial format. The method further includes the step of dividing, by the one or more processors, the spatially compressed plurality of video feeds into multiple frames. The method further includes the step of encoding, by the one or more processors, the multiple frames utilizing Adaptive Bitrate (ABR) logic. The method further includes the step of generating, by the one or more processors, an ultra-low resolution video based on the encoded multiple frames. The method further includes the step of retrieving, by the one or more processors, metadata pertaining to a plurality of video chunks from the encoded multiple frames. The method further includes the step of retrieving, by the one or more processors, one or more video chunks from the plurality of video chunks based on user’s viewport and ultra-low resolution video stored in a storage unit based on one or more parameters. The method further includes the step of decoding, by the one or more processors, the retrieved one or more video chunks utilizing one or more decoders in at least one of, a parallel or a sequential manner. The method further includes the step of merging, by the one or more processors, the ultra-low resolution video as a base feed of the 360° VR video with the decoded one or more video chunkspertaining to the decoded multiple frames at a specific location based on metadata retrieved in order to generate a single complete image for 360° VR video rendering. The method further includes the step of rendering, by the one or more processors, an optimized 360° VR streaming video based on the single complete image for 360° VR video.

[0008] In another aspect of the present invention, the system for rendering 360° Virtual Reality (VR) streaming is disclosed. The system includes a transcoder unit configured to transcode plurality of video feeds to a compressed spatial format. The system further includes a splitting unit configured to divide the spatially compressed plurality of video feeds into multiple frames. The system further includes an encoder, configured to encode the multiple frames utilizing Adaptive Bitrate (ABR) logic. The system further includes a video generation unit configured to generate an ultra-low resolution video based on the encoded multiple frames. The system further includes an extraction unit configured to retrieve metadata pertaining to a plurality of video chunks from the multiple encoded frames. The extraction unit further configured to retrieve one or more video chunks from the plurality of video chunks based on user’s viewport and ultra-low resolution video stored in the storage unit based on one or more parameters. The system further includes a decoder unit configured to decode the retrieved one or more video chunks utilizing one or more decoders in at least one of, a parallel or a sequential manner. The system further includes a merger unit configured to merge the ultra-low resolution video as a base feed of the 360° VR video with the decoded one or more video chunks pertaining to the decoded multiple frames at a specific location based on metadata retrieved in order to generate a single complete image for 360° VR video rendering. The system further includes a rendering unit configured to render an optimized 360° VR streaming video based on the single complete image for 360° VR video.

[0009] In another aspect of the present invention, a User Equipment (UE) is disclosed. One or more primary processors communicatively coupled to one or more processors. The one or more primary processors coupled with a memory. The memorystores instructions which when executed by the one or more primary processors causes the UE to transmit an interaction signal to one or more processors pertaining to interaction of the user with the 360° video via a User Interface (UI), the interaction of the user with the 360° video is performed by, at least one of, pressing play / pause button, gestures, switching to VR mode, change in the user’s viewport. Further, the UE fetches relevant video tiles pertaining to the 360° video subsequent to transmitting the interaction signal. Thereafter, the UE dynamically renders the relevant video tiles corresponding to the user’s interaction with the 360° video.

[0010] In another aspect of the present invention, an apparatus is disclosed. The apparatus includes one or more sources configured to receive a plurality of video feeds. The apparatus further includes a stitching unit configured to stitch the plurality of video feeds received from the one or more sources. The apparatus further includes a mixer configured to mix the stitched plurality of video feeds with an additional Audio Video (AV) feed. The apparatus further includes a switching unit configured to select at least one feed from the plurality of video feeds. The apparatus further includes a streaming unit configured to convert the format of the selected feed into a suitable format.

[0011] In another aspect of the present invention, a non-transitory computer- readable medium having stored thereon computer-readable instructions that, when executed by a processor. The processor is configured to transcode, plurality of video feeds to a compressed spatial format. The processor is further configured to divide, the spatially compressed plurality of video feeds into multiple frames. The processor is further configured to encode, the multiple frames utilizing Adaptive Bitrate (ABR) logic. The processor is further configured to generate, an ultra-low resolution video based on the encoded multiple frames. The processor is further configured to retrieve, metadata pertaining to a plurality of video chunks from the encoded multiple frames. The processor is further configured to retrieve, one or more video chunks from the plurality of video chunks based on user’s viewport and ultra-low resolution video stored in a storage unit based on one or more parameters. The processor is furtherconfigured to decode, the retrieved one or more video chunks utilizing one or more decoders in at least one of, a parallel or a sequential manner. The processor is further configured to merge, the ultra-low resolution video as a base feed of the 360° VR video with the decoded one or more video chunks pertaining to the decoded multiple frames at a specific location based on metadata retrieved in order to generate a single complete image for 360° VR video rendering. The processor is further configured to render, an optimised 360° VR streaming video based on the single complete image for 360° VR video.

[0012] Other features and aspects of this invention will be apparent from the following description and the accompanying drawings. The features and advantages described in this summary and in the following detailed description are not all- inclusive, and particularly, many additional features and advantages will be apparent to one of ordinary skill in the relevant art, in view of the drawings, specification, and claims hereof. Moreover, it should be noted that the language used in the specification has been principally selected for readability and instructional purposes and may not have been selected to delineate or circumscribe the inventive subject matter, resort to the claims being necessary to determine such inventive subject matter.BRIEF DESCRIPTION OF THE DRAWINGS

[0013] The accompanying drawings, which are incorporated herein, and constitute a part of this disclosure, illustrate exemplary embodiments of the disclosed methods and systems in which like reference numerals refer to the same parts throughout the different drawings. Components in the drawings are not necessarily to scale, emphasis instead being placed upon clearly illustrating the principles of the present disclosure. Some drawings may indicate the components using block diagrams and may not represent the internal circuitry of each component. It will be appreciated by those skilled in the art that disclosure of such drawings includes disclosure of electrical components, electronic components or circuitry commonly used to implement such components.

[0014] FIG. 1 is an exemplary block diagram of an environment for rendering 360° Virtual Reality (VR) streaming, according to one or more embodiments of the present invention;

[0015] FIG. 2 is an exemplary block diagram of the system for rendering 360° Virtual Reality (VR) streaming, according to one or more embodiments of the present invention;

[0016] FIG. 3 is an exemplary block diagram of the apparatus for rendering 360° Virtual Reality (VR) streaming, according to one or more embodiments of the present invention;

[0017] FIG. 4 illustrates an exemplary diagram of frame splitting, according to one or more embodiments of the present invention.

[0018] FIG. 5 is an exemplary flow diagram of the system of FIG. 2, according to one or more embodiments of the present invention;

[0019] FIG. 6 is an exemplary diagram for decoding the plurality of video chunks using the decoder units, according to one or more embodiments of the present invention; and

[0020] FIG. 7 is an exemplary flow diagram of a method for rendering 360° Virtual Reality (VR) streaming, according to one or more embodiments of the present invention.

[0021] The foregoing shall be more apparent from the following detailed description of the invention.DETAILED DESCRIPTION OF THE INVENTION

[0022] Some embodiments of the present disclosure, illustrating all its features, will now be discussed in detail. It must also be noted that as used herein and in theappended claims, the singular forms "a", "an" and "the" include plural references unless the context clearly dictates otherwise.

[0023] Various modifications to the embodiment will be readily apparent to those skilled in the art and the generic principles herein may be applied to other embodiments. However, one of ordinary skill in the art will readily recognize that the present disclosure including the definitions listed here below are not intended to be limited to the embodiments illustrated but is to be accorded the widest scope consistent with the principles and features described herein.

[0024] A person of ordinary skill in the art will readily ascertain that the illustrated steps detailed in the figures and here below are set out to explain the exemplary embodiments shown, and it should be anticipated that ongoing technological development will change the manner in which particular functions are performed. These examples are presented herein for purposes of illustration, and not limitation. Further, the boundaries of the functional building blocks have been arbitrarily defined herein for the convenience of the description. Alternative boundaries can be defined so long as the specified functions and relationships thereof are appropriately performed. Alternatives (including equivalents, extensions, variations, deviations, etc., of those described herein) will be apparent to persons skilled in the relevant art(s) based on the teachings contained herein. Such alternatives fall within the scope and spirit of the disclosed embodiments.

[0025] The present invention provides a system and method for rendering 360° Virtual Reality (VR) streaming. In particular, the system provides the 360° Virtual Reality (VR) streaming which is compatible to run on a low-end device such as a smartphone without the requirement of a 4k / 8k decoder. The invention achieves optimized method for rendering 360° Virtual Reality (VR) streaming by dividing a spatially compressed plurality of video feeds into multiple frames, which are further sub divided in multiple parts so that multiple small decoders can create a complete single complete image for 360° Virtual Reality (VR) streaming and pursuantto decoding the multiple frames, a ultra-low full video of the spatially compressed plurality of video feeds is merged with high resolution video frames for the optimized rendering 360° Virtual Reality (VR) streaming which is compatible to run on the low end device.

[0026] Referring to FIG. 1, FIG. 1 illustrates an exemplary block diagram of a environment 100 for rendering 360° Virtual Reality (VR) streaming, according to one or more embodiments of the present invention. The environment 100 includes, a User device 102, a server 104, a network 106, a system 108, and an apparatus 110.

[0027] Hereinafter, the User device 102 is referred to as the User Equipment (UE) 102, without deviating from the scope of the present disclosure.

[0028] As per the illustrated embodiment and for the purpose of description and explanation, the description will be explained with respect to the User Equipment’s (UEs) 102, or to be more specific will be explained with respect to a first UE 102a, a second UE 102b, a third UE 102c, and a fourth UE 102d of the UEs 102, and should nowhere be construed as limiting the scope of the present disclosure. Each of the at least one UE 102 namely the first UE 102a, the second UE 102b, the third UE 102c, and the fourth UE 102d is configured to connect to the server 104 via the network 106. Further, each of the at least one of the UE 102 is connected to the apparatus 110 via the network 106.

[0029] In an embodiment, each of the UE 102 is one of, but not limited to, any electrical, electronic, electro-mechanical or an equipment and a combination of one or more of the above devices such as, Extended reality (XR) devices, Virtual Reality (VR) devices, Augmented Reality (AR) devices, laptop, television, VR headset, a general-purpose computer, desktop, personal digital assistant, tablet, computer, mainframe computer, or any other computing device.

[0030] The network 106 includes, by way of example but not limitation, one or more of a wireless network, a wired network, an internet, an intranet, a public network,a private network, a packet-switched network, a circuit-switched network, an ad hoc network, an infrastructure network, a Public-Switched Telephone Network (PSTN), a cable network, a cellular network, a satellite network, a fiber optic network, or some combination thereof. The network 106 may include, but is not limited to, a Third Generation (3G), a Fourth Generation (4G), a Fifth Generation (5G), a Sixth Generation (6G), a New Radio (NR), a Narrow Band Internet of Things (NB-IoT), an Open Radio Access Network (O-RAN), and the like.

[0031] The network 106 may also include, by way of example but not limitation, at least a portion of one or more networks having one or more nodes that transmit, receive, forward, generate, buffer, store, route, switch, process, or a combination thereof, etc. one or more messages, packets, signals, waves, voltage or current levels, some combination thereof, or so forth. The network 106 may also include, by way of example but not limitation, one or more of a wireless network, a wired network, an internet, an intranet, a public network, a private network, a packet-switched network, a circuit-switched network, an ad hoc network, an infrastructure network, a Public- Switched Telephone Network (PSTN), a cable network, a cellular network, a satellite network, a fiber optic network, a VOIP or some combination thereof.

[0032] The environment 100 includes the server 104 accessible via the network 106. The server 104 may include by way of example but not limitation, one or more of a standalone server, a server blade, a server rack, a bank of servers, a server farm, hardware supporting a part of a cloud service or system, a home server, hardware running a virtualized server, a processor executing code to function as a server, one or more machines performing server-side functionality as described herein, at least a portion of any of the above, some combination thereof. In an embodiment, the entity may include, but is not limited to, a vendor, a network operator, a company, an organization, a university, a lab facility, a business enterprise side, a defense facility side, or any other facility that provides service.

[0033] The environment 100 further includes the apparatus 110. The apparatus 110 pertains to a camera setup which includes, one or more sources 302, stitching unit 304, a mixer 306, a feed recorder 308 and a switching unit 310.

[0034] The environment 100 further includes the system 108 communicably coupled to the server 104, the apparatus 110, and each of the UE 102 via the network 106. In one or more embodiments, the system 108 is adapted to be embedded within the server 104 or is embedded as an individual entity. However, for the purpose of description, the system 108 is illustrated as remotely coupled with the server 104, without deviating from the scope of the present disclosure.

[0035] Operational and construction features of the system 108 will be explained in detail with respect to the following figures.

[0036] FIG. 2 is an exemplary block diagram of the system 108 for rendering 360° Virtual Reality (VR) streaming, according to one or more embodiments of the present invention.

[0037] As per the illustrated and preferred embodiment, the system 108 includes one or more processors 202, a memory 204, and a storage unit 222. The one or more processors 202 includes a transcoder unit 206, a splitting unit 208, an encoder 210, a video generation unit 212, an extraction unit 214, a decoder unit 216, a merger unit 218 and a rendering unit 220. The one or more processors 202, hereinafter referred to as the processor 202, may be implemented as one or more microprocessors, microcomputers, microcontrollers, digital signal processors, central processing units, state machines, logic circuitries, single board computers, and / or any devices that manipulate signals based on operational instructions. However, it is to be noted that the system 108 may include multiple processors as per the requirement and without deviating from the scope of the present disclosure. Among other capabilities, the processor 202 is configured to fetch and execute computer-readable instructions stored in the memory 204.

[0038] As per the illustrated embodiment, the processor 202 is configured to fetch and execute computer-readable instructions stored in the memory 204 as the memory 204 is communicably connected to the processor 202. The memory 204 is configured to store one or more computer-readable instructions or routines in a non-transitory computer-readable storage medium, which may be fetched and executed to render 360° Virtual Reality (VR) streaming. The memory 204 may include any non-transitory storage device including, for example, volatile memory such as RAM, or non-volatile memory such as disk memory, EPROMs, FLASH memory, unalterable memory, and the like.

[0039] As per the illustrated embodiment, the storage unit 222 is a master database configured to stores the encoded multiple frames of the video in multiple Adaptive Bitrate (ABR) levels. The storage unit 222 is one of, but not limited to, a centralized database, a cloud-based database, a commercial database, an open-source database, a distributed database, an end-user database, a graphical database, a No-Structured Query Language (NoSQL) database, an object-oriented database, a personal database, an in-memory database, a document-based database, a time series database, a wide column database, a key value database, a search database, a cache databases, and so forth. The foregoing examples of storage unit 222 types are non-limiting and may not be mutually exclusive e.g., a database can be both commercial and cloud-based, or both relational and open-source, etc.

[0040] In an embodiment, the transcoder unit 206 of the processor 202 is configured to transcode a plurality of video feeds to a compressed spatial format. The plurality of video feeds is received by the transcoder unit 206 from one or more sources. The one or more sources include at least one of, but not limited to a prerecorded video feed, and a live streaming camera. The transcoder unit 206 further compresses the received plurality of video feeds into at least one of multiple spatial compression formats. In particular, the plurality of video feeds includes at least one of, but not limited to, a 360°video feed, and a Virtual Reality (VR) high-resolutionvideo. In an alternate embodiment, the plurality of video feeds is transcoded for any polyhedron or a 3D shape.

[0041] The multiple compression formats include at least one of, a cube map, a pyramid, and any other polyhedron format spatial compression. The spatial compression technique is also known as lossless compression, which is used to reduce a file size pertaining to plurality of video feeds or an image feed without sacrificing visual information or quality of the plurality of video feeds.

[0042] In an embodiment, the splitting unit 208 of the processor 202 is configured to divide the spatially compressed plurality of video feeds into multiple frames. At least one frame among the multiple frames, in a plurality of video feeds, is a single still image that, when played in sequence with the other frames of the plurality of video feeds, creates motion on the playback surface. In an alternate embodiment, the plurality of video feeds such as a special feed are divided into multiple frames symmetrically or asymmetrically which can be either deployed on each face of any polyhedron or 3D shape.

[0043] In an embodiment, the encoder 210 of the processor 202 is configured to encode the multiple frames utilizing an Adaptive Bitrate (ABR) logic. For example, the encoder 210 encodes the multiple frames into multiple ABR levels. In one embodiment, the encoded multiple frames with respective to multiple ABR levels are stored as a plurality of video chunks with different resolution qualities in the storage unit 222. The plurality of video chunks pertaining to encoded multiple frames includes the position of each frame which is utilized by the UE 102. In an embodiment, the plurality of video chunks relates to the spatial position and mapping of the encoded multiple frames. These encoded multiple frames are compressed in at least one of, but not limited to, the multiple spatial compression formats.

[0044] In an embodiment, the video generation unit 212 of the processor 202 is configured to generate an ultra-low resolution video based on the encoded multipleframes. The ultra-low resolution video includes the fully spatial compressed video stream. In one embodiment, the ultra-low resolution video is utilized by the UE 102 as a base feed when the UE 102 is not able to shift or load the plurality of video chunks due to error including at least one of a prediction error and a low bandwidth.

[0045] In an embodiment, the extraction unit 214 of the processor 202 is configured to retrieve metadata pertaining to a plurality of video chunks from the multiple encoded frames. The extraction unit 214 is further configured to retrieve at least one of, one or more video chunks from the plurality of video chunks based on user’s viewport and ultra-low resolution video stored in the storage unit 222 based on one or more parameters. The one or more parameters includes, at least one of, but not limited to, the network quality of the UE 102, the screen size of the UE 102 and the decoding capability of the UE 102.

[0046] The extraction unit 214 retrieves at least one of, one or more video chunks from the plurality of video chunks based on user’s viewport and ultra-low resolution video stored in the storage unit 222 based on one or more parameters by predicting a location of user’s eye / head utilizing a prediction logic in order to determine the user’s viewport of viewing the video.

[0047] In an embodiment, the decoder unit 216 of the processor 202 is configured to decode the retrieved one or more video chunks utilizing one or more decoders in at least one of, a parallel or a sequential manner based on number of transcoders available at the UE 102. The decoder unit 216 includes the combination of hardware and software decoders. In an alternate embodiment, the multiple decoded frames pertaining to the user’s viewport are compressed in at least one of the multiple spatial compression formats.

[0048] In an embodiment, the merger unit 218 of the processor 202 is configured to merge the ultra-low resolution video which acts as a base feed of the 360° VR video with the decoded one or more video chunks pertaining to the decoded multiple framesat a specific location based on the metadata retrieved in order to generate a single complete image for 360° VR video rendering. In particular, the multiple decoded frames are merged with the base feed, to create the 360° VR video to render the high- resolution video on the UE 102 based on user’s viewport.

[0049] In an embodiment, the rendering unit 220 of the processor 202 is configured to render an optimized 360° VR streaming video based on the single complete image for 360° VR video. In particular, the rendering unit 220 dynamically renders the relevant video tiles / frame corresponding to the user’s interaction with the 360° video.

[0050] In an alternate embodiment, the extraction unit 214, the decoder unit 216, the merger unit 218, and the rendering unit 220 may be included in the UE 102 to perform the method for rendering 360° Virtual Reality (VR) streaming without deviating from the scope of the present disclosure.

[0051] The transcoder unit 206, the splitting unit 208, the encoder 210, the video generation unit 212, the extraction unit 214, the decoder unit 216, the merger unit 218, and the rendering unit 220 in an exemplary embodiment, are implemented as a combination of hardware and programming (for example, programmable instructions) to implement one or more functionalities of the processor 202. In the examples described herein, such combinations of hardware and programming may be implemented in several different ways. For example, the programming for the processor 202 may be processor-executable instructions stored on a non-transitory machine-readable storage medium and the hardware for the processor may comprise a processing resource (for example, one or more processors), to execute such instructions. In the present examples, the memory 204 may store instructions that, when executed by the processing resource, implement the processor 202. In such examples, the system 108 may comprise the memory 204 storing the instructions and the processing resource to execute the instructions, or the memory 204 may be separate but accessible to the system 108 and the processing resource. In other examples, the processor 202 may be implemented by electronic circuitry.

[0052] FIG. 3 illustrates an exemplary block diagram of an apparatus 110, according to one or more embodiments of the present invention.

[0053] As per the illustrated and preferred embodiment, the apparatus 110 pertains to a camera setup which includes, one or more sources 302, the stitching unit 304, the mixer 306, the feed recorder 308 and the switching unit 310.

[0054] In one embodiment, the one or more sources 302 are configured to receive the plurality of video feeds. Furthermore, the stitching unit 304 is configured to stitch the plurality of video feeds received from the one or more sources 302. The stitching is a digital process that combines plurality of video feeds from the one or more sources 302 into equirectangular videos for playback and distribution in VR.

[0055] In one embodiment, the mixer 306 is configured to mix the stitched plurality of video feeds with an additional Audio Video (AV) feed. Thereafter, the feed recorder 308 is configured to record / store the mixed plurality of video feeds.

[0056] In one embodiment, the switching unit 310 is configured to select at least one feed from the plurality of video feeds. Thereafter, the streaming unit 312 is configured to convert the format of the selected feed into a suitable format.

[0057] Further, the selected feed with the suitable format is transmitted from the apparatus 110 pertaining to the camera setup to the transcoder unit 206 of the processor 202 to transcode the selected video feed.

[0058] FIG. 4 illustrates an exemplary diagram of frame splitting, according to one or more embodiments of the present invention. FIG. 4 includes Fig. (4A), Fig. (4B), Fig. (4C), Fig. (4D), Fig. (4E) and Fig. (4F) which illustrates various techniques for the frame splitting.

[0059] In one embodiment, the Fig. (4A) illustrates a symmetrical frame splitting technique.

[0060] In another embodiment, the Fig. (4B) illustrates a multiple symmetrical frame splitting technique.

[0061] In yet another embodiment, the Fig. (4C) illustrates an asymmetrical frame splitting technique with miss matching splitting across various faces.

[0062] In yet another embodiment, the Fig. (4D) illustrates an asymmetrical frame splitting technique with matching splitting across various faces.

[0063] In yet another embodiment, the Fig. (4E) and Fig. (4F) illustrates an asymmetrical frame splitting technique for any polyhedron, pyramid or a 3D shape.

[0064] In one embodiment, subsequent to the transcoding of the at least one selected video feed among the plurality of video feeds in the compressed spatial format, the spatially compressed at least one video feed is divided / split into multiple frames utilizing at least one of the various techniques which are illustrated above.

[0065] In one embodiment, the various techniques of the frame splitting facilitate optimizing the plurality of video feeds by compressing each frame at different resolution or different ABR levels based on content for more optimization.

[0066] FIG. 5 illustrates an exemplary block diagram of an architecture for the system 108 of FIG. 2, according to one or more embodiments of the present invention. More specifically, FIG. 5 illustrates the system 108 configured for rendering 360° Virtual Reality (VR) streaming. It is to be noted that the embodiment with respect to FIG. 5 will be explained with respect to the UE 102 for the purpose of description and illustration and should nowhere be construed as limited to the scope of the present disclosure.

[0067] FIG. 5 shows communication between the UE 102 and the system 108. For the purpose of description of the exemplary embodiment as illustrated in FIG. 3, the UE 102 uses network protocol connection to communicate with the system 108. In an embodiment, the network protocol connection is the establishment and managementof communication between the UE 102 and the system 108 over the network 106 using a specific protocol or set of protocols. The network protocol connection includes, but not limited to, Session Initiation Protocol (SIP), System Information Block (SIB) protocol, Transmission Control Protocol (TCP), User Datagram Protocol (UDP), File Transfer Protocol (FTP), Hypertext Transfer Protocol (HTTP), Simple Network Management Protocol (SNMP), Internet Control Message Protocol (ICMP), Hypertext Transfer Protocol Secure (HTTPS) and Terminal Network (TELNET).

[0068] In an embodiment, the of UE 102 includes a primary processor 502, and a memory 504, and a user interface 506. In alternate embodiments, the UE 102 may include more than one primary processor 502 as per the requirement of the network 106. The primary processor 502, may be implemented as one or more microprocessors, microcomputers, microcontrollers, digital signal processors, central processing units, state machines, logic circuitries, single board computers, and / or any devices that manipulate signals based on operational instructions.

[0069] In an embodiment, the primary processor 502 is configured to fetch and execute computer-readable instructions stored in the memory 504. The memory 504 may be configured to store one or more computer-readable instructions or routines in a non-transitory computer-readable storage medium, which may be fetched and executed for rendering 360° Virtual Reality (VR) streaming. The memory 504 may include any non-transitory storage device including, for example, volatile memory such as RAM, or non-volatile memory such as disk memory, EPROMs, FLASH memory, unalterable memory, and the like.

[0070] In an embodiment, the user interface 506 of the UE 102 includes a variety of interfaces, for example, a Graphical User Interface (GUI), a web user interface, a Command Line Interface (CLI), and the like. The UE 102 interacts with the 360° video via the user interface 506.Y1

[0071] In an embodiment, the UE 102 interacts with the 360° video by transmitting an interaction signal to the processor 202 pertaining to interaction of the user with the 360° video via the user interface 506. Herein, the interaction of the user with the 360° video is performed by, at least one of, but not limited to, pressing play / pause button, making gestures, switching to VR mode, and change in the user’s viewport, etc.

[0072] In an embodiment, the processor 202 receives the interaction signal as the user input to interact with the 360° video. The user input includes at least one of, but not limited to, the gesture on the UE 102 and utilizing a remote control for the interaction. Further, the processor 202 fetches relevant video tiles / frames pertaining to the 360° video subsequent to transmitting the interaction signal. Thereafter, the relevant video tiles / frames are dynamically rendered on the UE 102 corresponding to the user’s interaction with the 360° video. In particular, the user gets better experience of the 360° video using the UE 102 such as using XR / AR / VR devices.

[0073] In an alternate embodiment, the primary processor 502 of the UE 102 may include the extraction unit 214, the decoder unit 216, the merger unit 218, and the rendering unit 220 in order to perform the method for rendering 360° Virtual Reality (VR) streaming without deviating from the scope of the present disclosure.

[0074] In yet another alternate embodiment, the UE 102 interacts with the 360° video by transmitting an interaction signal to the primary processor 502 pertaining to interaction of the user with the 360° video via the user interface 506. For example, the interaction signal as the user input is transmitted to the primary processor 502 when there is a change in the user’s viewport. Further, the primary processor 502 fetches the relevant video tiles or one or more video chunks pertaining to the 360° video subsequent to transmitting the interaction signal based on the user’s viewport. Simultaneously, the primary processor 502 fetches the ultra-low resolution video pertaining to the 360° video from the storage unit 222. Thereafter, the primary processor 502 decodes the fetched relevant video tiles or one or more video chunks utilizing one or more decoders and further merges the fetched ultra-low resolutionvideo with the decoded relevant video tiles or one or more video chunks in order to generate a single complete image for 360° VR video rendering. Further, the primary processor 502 dynamically renders the relevant video tiles of the optimized 360° VR streaming video on the UE 102 based on the single complete image for 360° VR video corresponding to the user’s interaction with the 360° video.

[0075] FIG. 6 is an exemplary diagrams for decoding the plurality of video chunks using the decoder unit 216, according to one or more embodiments of the present invention. FIG. 6 includes Fig. (6A), Fig. (6B), and Fig. (6C), which illustrates various ways for the decoding the plurality of video chunks. It is to be noted that the embodiment with respect to FIG. 6 will be explained with respect to the UE 102 for the purpose of description and illustration and should nowhere be construed as limited to the scope of the present disclosure.

[0076] In an embodiment, the decoder units 216 pertains to the combination of hardware and software decoders. Here, multiple small hardware decoders are used for decoding rather than a very big decoder which facilitates dividing the load of decoding the plurality of video chunks. In an alternate embodiment, one or more smaller size software decoders are used for decoding.

[0077] In one embodiment, the Fig. (6A) illustrates decoding of plurality of video chunks by the multiple instances of decoder units 216 included in a single transcoder of the UE 102. In an alternate embodiment, the transcoder is included in the primary processor 502 of the UE 102. The multiple instances of decoder units 216 receives plurality of video chunks from one or more sources such as a Sourcel and a Source 2. The plurality of video chunks is extracted by the extraction unit 214 which are related to the current view which is viewed by the user or user’s viewport. The decoding of the retrieved plurality of video chunks is performed by the decoder units 216 in sequential manner.

[0078] Similarly, in Fig. (6B) which illustrates decoding of plurality of video chunks by the single instance of decoder unit 216 included in a single transcoder of the UE 102, the single instances of decoder units 216 receives plurality of video chunks from one or more sources such as the Sourcel and the Source 2. Further, the decoding of the retrieved plurality of video chunks is performed by the decoder unit 216 in sequential manner and then rendered by the rendering unit 220 in sync.

[0079] In particular, the plurality of video chunks is decoded in the sequential manner when a single transcoder is available at the UE 102.

[0080] In one embodiment, the Fig. (6C) illustrates decoding of plurality of video chunks by the multiple instances of decoder units 216 included in multiple transcoders of the UE 102. The multiple transcoders are included in the primary processor 502 of the UE 102. The multiple instances of decoder units 216 receives plurality of video chunks from one or more sources such as the Sourcel and the Source 2. The plurality of video chunks is related to the current view which is viewed by the user. The decoding of the retrieved plurality of video chunks is performed by the decoder units 216 in the parallel manner.

[0081] In particular, the plurality of video chunks is decoded in parallel manner when the multiple transcoders are available at the UE 102.

[0082] FIG. 7 is a flow diagram of a method 700 for rendering 360° Virtual Reality (VR) streaming, according to one or more embodiments of the present invention. For the purpose of description, the method is described with the embodiments as illustrated in FIG. 2 and should nowhere be construed as limiting the scope of the present disclosure.

[0083] At step 702, the method 700 includes the step of transcoding, plurality of video feeds to a compressed spatial format. In one embodiment, transcoder unit 206 of the processor 202 is configured to transcode plurality of video feeds to the compressed spatial format. The plurality of video feeds is received by the transcoderunit 206 from the one or more sources 302 of the apparatus 110 and further compresses the plurality of video feeds in at least one of the compressed spatial format. For example, transcoder unit 206 receives the 360° video feed from the live streaming camera and compresses in at least one of the compressed spatial format.

[0084] At step 704, the method 700 includes the step of dividing, the spatially compressed plurality of video feeds into multiple frames. In one embodiment, the splitting unit 208 of the processor 202 is configured to divide the spatially compressed plurality of video feeds into multiple frames. For example, the spatially compressed plurality of video feeds is divided into 6 frames such as a front frame, a back frame, a top frame, a right frame, a left frame and a bottom frame. Each of these frame is further sub divided in various parts / subframes, but not limited to, 4 parts / subframes. For example, the front frame is divided into Fl, F2, F3 and F4. Similarly, other frames are sub divided into 4 parts / subframes. This approach of division facilitates in 360° Virtual Reality (VR) streaming to run on the low-end device such as the UE 102.

[0085] At step 706, the method 700 includes the step of encoding the multiple frames utilizing Adaptive Bitrate (ABR) logic. In one embodiment, the encoder 210 of the processor 202 is configured to encode the multiple frames utilizing an Adaptive Bitrate (ABR) logic. The encoder 210 encodes the multiple frames into multiple ABR levels. For example, the part / subframe of Front frame Fl is encoded as Fl -High (H), Fl - Medium(M), Fl -Low (L) which are stored as the plurality of video chunks in the storage unit 222. In particular, the encoding of the multiple frames utilizing ABR logic optimizes the bandwidth requirement for the different network quality of the UE 102 and screen size of the UE 102.

[0086] At step 708, the method 700 includes the step of generating, an ultra-low resolution video based on the encoded multiple frames. In one embodiment, the video generation unit 212 of the processor 202 is configured to generate the ultra-low resolution video based on the encoded multiple frames which is used as the base feed when the UE 102 is not able to shift or load the plurality of video chunks. In particular,full video at a very ultra-low resolution is processed by the video generation unit 212 to make sure, at least a lower resolution view is provided to the UE 102 in case of any network delay or prediction error until processor 202 switches to the higher resolution.

[0087] At step 710, the method 700 includes the step of retrieving, metadata pertaining to a plurality of video chunks from the encoded multiple frames. In one embodiment, the extraction unit 214 of the processor 202 is configured to retrieve metadata pertaining to the plurality of video chunks from the multiple encoded frames which is utilized to retrieve the appropriate plurality of video chunks.

[0088] At step 712, the method 700 includes the step of retrieving, one or more video chunks from the plurality of video chunks based on the user’s viewport and the ultra-low resolution video stored in the storage unit 222 based on one or more parameters. In one embodiment, the extraction unit 214 of the processor 202 is configured to retrieve one or more video chunks from the plurality of video chunks based on the user’s viewport.

[0089] Initially, when the user’s interacts with the 360° video, the processor 202 predicts the location of user’s eye / head utilizing the prediction logic to determine the next view of the user’s viewport. The prediction of the user’s viewport makes sure that the user may experience best quality of viewing the 360° video. In particular, the viewport of the user is predicted utilizing at least one of, a sensor and interaction data of the UE 102 which includes the user’s movement velocity data, and the past behavior data of the user. For example, when the user makes a small movement, the sensors immediately detect the movements and predict the next user’s viewport, due to which the extraction unit 214 of the processor 202 retrieves the appropriate one or more video chunks.

[0090] Further, the extraction unit 214 retrieves the ultra-low resolution video which is stored in the storage unit 222 based on one or more parameters. For example, based on the user viewport, the extraction unit 214 retrieves ultra-low resolution videowhich is compatible with the at least of, but not limited to the network quality of the UE 102, the screen size of the UE 102 and the decoding capability of the UE 102.

[0091] In an alternate embodiment, the primary processor 502 of the UE 102 is configured to retrieve one or more video chunks from the plurality of video chunks based on the user’s viewport without deviating from the scope of the present disclosure.

[0092] At step 714, the method 700 includes the step of decoding, the retrieved one or more video chunks utilizing one or more decoders in at least one of, a parallel or a sequential manner. In one embodiment, the decoder unit 216 of the processor 202 is configured to decode the retrieved one or more video chunks utilizing one or more decoders in at least one of, the parallel or the sequential manner based on the number of transcoders available at the UE 102. The decoding of the plurality of video chunks is disclosed in the description of FIG. 6.

[0093] In an alternate embodiment, the primary processor 502 of the UE 102 is configured to decode the retrieved one or more video chunks utilizing one or more decoders in at least one of, a parallel or a sequential manner based on number of transcoders available at the UE 102 without deviating from the scope of the present disclosure.

[0094] At step 716, the method 700 includes the step of merging, the ultra-low resolution video as a base feed of the 360° VR video with the decoded one or more video chunks pertaining to the decoded multiple frames at a specific location based on metadata retrieved in order to generate a single complete image for 360° VR video rendering. In one embodiment, the merger unit 218 of the processor 202 is configured to merge, the ultra-low resolution video with the decoded one or more video chunks pertaining to the decoded multiple frames at the specific location based on the metadata retrieved in order to generate the single complete image for 360° VR video rendering. For example, the single complete image for 360° VR video is generated bythe merger unit 218 by merging the decoded one or more video chunks with the ultralow resolution video. Due to this approach of merging the bandwidth requirement is less for rendering of the optimized 360° VR streaming video without compromising the quality of the 360° VR streaming video,

[0095] In an alternate embodiment, the primary processor 502 of the UE 102 is configured to merge the ultra-low resolution video as a base feed of the 360° VR video with the decoded one or more video chunks pertaining to the decoded multiple frames at a specific location based on metadata retrieved in order to generate a single complete image for 360° VR video rendering without deviating from the scope of the present disclosure.

[0096] At step 718, the method 700 includes the step of rendering, an optimized 360° VR streaming video based on the single complete image for 360° VR video. In one embodiment, the rendering unit 220 of the processor is configured to render an optimized 360° VR streaming video based on the single complete image for 360° VR video on the UE 102 which is the low-end device via at least one of, but not limited to, the 4G and 5G network. In particular, the complete image for 360° VR video is rendered on the UE 102 such as using XR / AR / VR devices.

[0097] In an alternate embodiment, the primary processor 502 of the UE 102 is configured to render an optimized 360° VR streaming video based on the single complete image for 360° VR video without deviating from the scope of the present disclosure.

[0098] A person of ordinary skill in the art will readily ascertain that the illustrated embodiments and steps in description and drawings (FIG.1-7) are set out to explain the exemplary embodiments shown, and it should be anticipated that ongoing technological development will change the manner in which particular functions are performed. These examples are presented herein for purposes of illustration, and not limitation. Further, the boundaries of the functional building blocks have beenarbitrarily defined herein for the convenience of the description. Alternative boundaries can be defined so long as the specified functions and relationships thereof are appropriately performed. Alternatives (including equivalents, extensions, variations, deviations, etc., of those described herein) will be apparent to persons skilled in the relevant art(s) based on the teachings contained herein. Such alternatives fall within the scope and spirit of the disclosed embodiments.

[0099] The present disclosure provides technical advancements such as 360° VR streaming runs on the low-end devices such as smartphones without 4k / 8k decoders. The 360° VR streaming runs using the 4G / 5G networks. The 360° VR streaming optimization is used for both Video on Demand (VoD) and a live streaming. The compression of the plurality of the video feeds are applied to cube format and any other formats which are existing or the formats developed in the future. The invention provides better video quality while 360° VR streaming as it does not do any complex spatial compression. The system can scale with constant processing once and there is no requirement to perform video processing for each user to optimize the experience.

[0100] The present invention offers multiple advantages over the prior art and the above listed are a few examples to emphasize on some of the advantageous features. The listed advantages are to be read in a non-limiting manner.REFERENCE NUMERALS

[0101] Environment - 100;

[0102] User Equipment (UE) - 102;

[0103] Server - 104;

[0104] Network- 106;

[0105] System -108;

[0106] Apparatus -110;

[0107] Processor - 202;

[0108] Memory - 204;

[0109] Transcoder unit - 206;

[0110] Splitting unit - 208;

[0111] Encoder - 210;

[0112] Video generation unit - 212;

[0113] Extraction unit - 214;

[0114] Decoder unit - 216;

[0115] Merger unit - 218;

[0116] Rendering unit - 220;

[0117] Storage unit - 222 ;

[0118] One or more sources - 302;

[0119] Stitching unit - 304;

[0120] Mixer - 306;

[0121] Feed recorder - 308;

[0122] Switching unit - 310;

[0123] Streaming unit - 312;

[0124] Primary processor- 502;

[0125] Memory- 504;

[0126] User Interface - 506;

Claims

CLAIMSWe Claim:

1. A method for rendering 360° Virtual Reality (VR) streaming, the method comprises the steps of: transcoding, by one or more processors, plurality of video feeds to a compressed spatial format; dividing, by the one or more processors, the spatially compressed plurality of video feeds into multiple frames; encoding, by the one or more processors, the multiple frames utilizing Adaptive Bitrate (ABR) logic; generating, by the one or more processors, an ultra-low resolution video based on the encoded multiple frames; retrieving, by the one or more processors, metadata pertaining to a plurality of video chunks from the encoded multiple frames; retrieving, by the one or more processors, one or more video chunks from the plurality of video chunks based on user’s viewport and ultra-low resolution video stored in a storage unit based on one or more parameters; decoding, by the one or more processors, the retrieved one or more video chunks utilizing one or more decoders in at least one of, a parallel or a sequential manner; merging, by the one or more processors, the ultra-low resolution video as a base feed of the 360° VR video with the decoded one or more video chunks pertaining to the decoded multiple frames at a specific location based on metadata retrieved in order to generate a single complete image for 360° VR video rendering; and rendering, an optimised 360° VR streaming video based on the single complete image for 360° VR video.

2. The method as claimed in claim 1, wherein the step of transcoding, plurality of video feeds to a compressed spatial format, includes the steps of: receiving, by the one or more processors, plurality of video feeds from one or more sources; and compressing, by the one or more processors, the plurality of video feeds into at least one of multiple spatial compression formats.

3. The method as claimed in claim 2, wherein the plurality of video feeds includes at least one of a 360°video feed, and aa virtual reality high-resolution videos.

4. The method as claimed in claim 2, wherein the one or more sources include at least one of, a pre-recorded video feed, and a live streaming camera.

5. The method as claimed in claim 2, wherein the multiple compression formats include at least one of, a cube map, a pyramid, and any other polyhedron format spatial compression.

6. The method as claimed in claim 1, wherein the plurality of video feeds is transcoded for any polyhedron or a 3D shape.

7. The method as claimed in claim 1, wherein the multiple frames are encoded utilizing the ABR logic in order to optimize bandwidth for different network quality of a user device and screen size of the user device.

8. The method as claimed in claim 1, wherein the encoded multiple frames with respective multiple ABR levels are stored as the plurality of video chunks with different resolution qualities in the storage unit.

9. The method as claimed in claim 1, wherein the plurality of video chunks pertaining to encoded multiple frames includes the position of each frame which is utilized by the user device.

10. The method as claimed in claim 1, wherein the plurality of video chunks relates to the spatial position and mapping of the encoded multiple frames.

11. The method as claimed in claim 1, wherein the encoded multiple frames are compressed in at least one of the multiple spatial compression formats.

12. The method as claimed in claim 1, wherein the ultra-low resolution video includes the fully spatial compressed video stream.

13. The method as claimed in claim 1, wherein the step of retrieving, one or more video chunks from the plurality of video chunks based on user’s viewport and ultra-low resolution video stored in the storage unit based on one or more parameters, include the step of: predicting, by the one or more processors, utilizing a prediction logic, location of user’s eye / head to determine the user’s viewport of viewing the video.

14. The method as claimed in claim 13, wherein the viewport of the user is predicted utilizing at least one of, a sensor and interaction data of the user device which includes users movement velocity data, and the past behaviour data of the user.

15. The method as claimed in claim 1, wherein the one or more parameters includes, at least one of, the network quality of the user device, the screen size of the user device and the decoding capability of the user device.

16. The method as claimed in claim 1, wherein decoding, the retrieved plurality of video chunks utilizing the one or more decoders, in at least one of, the paralleland the sequential manner is based on number of transcoders available at the user device.

17. The method as claimed in claim 16, wherein the plurality of video chunks pertaining to the multiple frames are decoded in parallel when the multiple transcoders are available at the user device.

18. The method as claimed in claim 16, wherein the plurality of video chunks pertaining to the multiple frames are decoded in the sequential manner when a single transcoder is available at the user device.

19. The method as claimed in claim 1, wherein the one or more decoders includes the combination of hardware and software decoders.

20. The method as claimed in claim 1, wherein the multiple decoded frames pertaining to the user’s viewport are compressed in at least one of the multiple spatial compression formats.

21. The method as claimed in claim 1, wherein the ultra-low resolution video provides a base feed when the user device is not able to shift or load the plurality of video chunks due to error including at least one of a prediction error and a low bandwidth.

22. The method as claimed in claim 1, wherein the single complete image for 360° VR video rendering is generated based on the viewport of the user and the bandwidth of the user device.

23. The method as claimed in claim 1, wherein the multiple decoded frames are merged with the base feed, to create the 360° VR video to render the high resolution video on the user device based on user’s viewport.

24. The method as claimed in claim 1, wherein the special feed can be divided in frames symmetrically or asymmetrically which can be either deployed on each face of the any polyhedron or 3D shape.

25. The method as claimed in claim 1, wherein the method further includes the steps of: receiving, by the one or more processors, a user input via a User Interface (UI) of the user device in order to interact with the 360° video.

26. The method as claimed in claim 25, wherein the user input includes at least one of, gesture on the user device and utilizing remote control for the interaction.

27. The method as claimed in claim 25, wherein the user device includes at least one of, a smartphone, a Virtual Reality (VR) headset, a Television (TV) and any compute device.

28. A system for rendering 360° Virtual Reality (VR) streaming, the system comprising: a transcoder unit, configured to, transcode plurality of video feeds to a compressed spatial format; a splitting unit, configured to, divide the spatially compressed plurality of video feeds into multiple frames; an encoder, configured to, encode the multiple frames utilizing Adaptive Bitrate (ABR) logic; a video generation unit, configured to, generate an ultra-low resolution video based on the encoded multiple frames; an extraction unit, configured to: retrieve, metadata pertaining to a plurality of video chunks from the multiple encoded frames;retrieve, one or more video chunks from the plurality of video chunks based on user’s viewport and ultra-low resolution video stored in the storage unit based on one or more parameters; a decoder unit, configured to, decode the retrieved one or more video chunks utilizing one or more decoders in at least one of, a parallel or a sequential manner; a merger unit, configured to, merge, the ultra-low resolution video as a base feed of the 360° VR video with the decoded one or more video chunks pertaining to the decoded multiple frames at a specific location based on metadata retrieved in order to generate a single complete image for 360° VR video rendering; and a rendering unit, configured to, render, an optimised 360° VR streaming video based on the single complete image for 360° VR video.

29. A method for interacting with a 360° video utilizing a user device, the method comprises the steps of: transmitting, an interaction signal to one or more processors pertaining to interaction of the user with the 360° video via a User Interface (UI), wherein the interaction of the user with the 360° video is performed by, at least one of, pressing play / pause button, gestures, switching to VR mode, change in the user’s viewport; fetching, relevant video tiles pertaining to the 360° video subsequent to transmitting the interaction signal; and dynamically rendering, the relevant video tiles corresponding to the user’s interaction with the 360° video.

30. An apparatus, comprising: one or more sources, configured to, receive a plurality of video feeds; a stitching unit, configured to, stitch the plurality of video feeds received from the one or more sources;a mixer, configured to, mix the stitched plurality of video feeds with an additional Audio Video (AV) feed; a feed recorder, configured to, record the mixed plurality of video feeds; a switching unit, configured to, select at least one feed from the plurality of video feeds; and a streaming unit, configured to, convert the format of the selected feed into a suitable format.

31. A non-transitory computer-readable medium having stored thereon computer- readable instructions that, when executed by a processor, causes the processor to: transcode, plurality of video feeds to a compressed spatial format; divide, the spatially compressed plurality of video feeds into multiple frames; encode, the multiple frames utilizing Adaptive Bitrate (ABR) logic; generate, an ultra-low resolution video based on the encoded multiple frames; retrieve, metadata pertaining to a plurality of video chunks from the encoded multiple frames; retrieve, one or more video chunks from the plurality of video chunks based on user’s viewport and ultra-low resolution video stored in a storage unit based on one or more parameters; decode, the retrieved one or more video chunks utilizing one or more decoders in at least one of, a parallel or a sequential manner; merge, the ultra-low resolution video as a base feed of the 360° VR video with the decoded one or more video chunks pertaining to the decoded multiple frames at a specific location based on metadata retrieved in order to generate a single complete image for 360° VR video rendering; and render, an optimised 360° VR streaming video based on the single complete image for 360° VR video.

Citation Information

Patent Citations

  • Construction status management device

    KR102297794B1

  • Method and apparatus for streaming panoramic video

    US11153615B2

  • Methods and apparatus for content interaction

    US20160080830A1

  • Method and apparatus for delivery of streamed panoramic images

    WO2018193330A1