Multiple Renderers and Computing Data in Scene Description

Description

1 / 73 “Multiple Renderers and Computing Data in Scene Description” CROSS-REFERENCE TO RELATED REQUESTS

[001] This application claims the benefit of European Patent Application No. EP23305514, filed on April 7, 2023, entitled “MULTI-RENDERER AND COMPUTATION DATA IN SCENE DESCRIPTION”, which is incorporated herein by reference in its entirety. FUNDAMENTALS OF THE INVENTION

[002] Extended reality (XR) is a technology that enables interactive experiences in which the real-world environment and / or video content are enhanced by virtual content, which can be defined in multiple sensory modalities, including visual, auditory, tactile, etc. During application execution, the virtual content (3D content or audio / video file, for example) is rendered in real time in a manner consistent with the user context (environment, viewpoint, device, etc.). Scene graphs (such as that proposed by Khronos / glTF and its extensions defined in the MPEG or Apple / USDZ scene description format, for example) are one possible way to represent the content to be rendered. They combine a declarative description of the scene structure, linking real-world objects and virtual objects, on the one hand, and binary representations of the virtual content, on the other hand.

[003] Although such scene description structures ensure that timed media and corresponding relevant virtual content are available at any time during application rendering, such structures do not provide a description of how a user can interact with scene objects at runtime for immersive XR experiences. Therefore, there is no support for user-specific XR experiences for immersive media consumption. SUMMARY OF THE INVENTION Petition 870250094130, dated 10 / 15 / 2025, page 7 / 96 2 / 73

[004] A first illustrative method, according to some embodiments, may include: obtaining information indicating the interaction with one or more renderers used in the rendering of a three-dimensional (3D) scene; identifying renderer data, object data, and component data associated with at least one respective renderer of one or more renderers used; in response to the determination that renderer data is global scene data, adding, at scene level, renderer data to a dedicated structure for the respective renderer; adding, at node level, for at least one node associated with the respective renderer, object data to the dedicated structure for the respective renderer; and adding, at component level, for at least one component associated with the respective node, component data to the dedicated structure for the respective renderer.

[005] For some embodiments of the first exemplary method, one or more renderers are selected from the group consisting of video-related renderers, audio-related renderers, and tactile-related renderers.

[006] For some embodiments of the first exemplary method, one or more renderers are selected from the group consisting of video-related renderers, audio-related renderers, tactile-related renderers, geometry-related renderers, texture-related renderers, camera-related renderers, animation-related renderers, physics-related renderers, and lighting-related renderers.

[007] For some embodiments of the first exemplary method, at least two renderers are used in rendering the 3D scene, and at least two categories of renderers are selected from the group consisting of ren Petition 870250094130, dated 10 / 15 / 2025, page 8 / 96 3 / 73 video-related renderers, audio-related renderers, haptic-related renderers, geometry-related renderers, texture-related renderers, camera-related renderers, animation-related renderers, physics-related renderers, and lighting-related renderers.

[008] For some forms of the first example method, at least one of the dedicated structures is compatible with a glTF format.

[009] For some modes of the first exemplary method, at least one of the dedicated structures is compatible with an MPEG-I scene description format.

[010] For some modalities of the first exemplary method, the dedicated structures are stored in a single file.

[011] For some embodiments of the first exemplary method, the renderer data includes functionality support information.

[012] For some embodiments of the first exemplary method, the supporting functionality information includes the renderer functionality required to render at least one component of an object.

[013] For some embodiments of the first exemplary method, the component data for at least one component includes information indicating the ability to render the scene in a degraded mode without rendering at least one component.

[014] A first exemplary apparatus, according to some embodiments, may include: a processor; and a non-transient computer-readable medium that stores operative instructions, when executed by the processor, to make the apparatus execute any of the methods listed above.

[015] A second illustrative method according to some modalities Petition 870250094130, dated 10 / 15 / 2025, page 9 / 96 4 / 73 may include: obtaining information indicating interaction with one or more renderers used in rendering a three-dimensional (3D) scene; identifying renderer data, object data, and component data associated with at least one respective renderer from one or more renderers used; obtaining, at the scene level, renderer data from a structure dedicated to the respective renderer; obtaining, at the node level, for at least one node associated with the respective renderer, object data from the structure dedicated to the respective renderer; obtaining, at the component level, for at least one component associated with the respective node, component data from the structure dedicated to the respective renderer; and determining the renderer support for the respective renderer.

[016] For some embodiments of the second exemplary method, determining renderer support includes: verifying that the user equipment (UE) supports the respective renderer; obtaining render data associated with the respective renderer; and rendering at least one component associated with the render data.

[017] For some embodiments of the second exemplary method, determining renderer support includes: determining whether the user equipment (UE) does not support the respective renderer; sending rendering data associated with the respective renderer to an edge server; and verifying whether the edge server has accepted the delegation of rendering data.

[018] For some embodiments of the second exemplary method, determining renderer support includes: determining whether the user equipment (UE) does not support the respective renderer; sending rendering data associated with the respective renderer to an edge server; determining whether the edge server refused to delegate the rendering data; and in response to the determination that rendering the rendering data is not required, continuing to use Petition 870250094130, dated 10 / 15 / 2025, page 10 / 96 5 / 73 the 3D scene without rendering the render data.

[019] For some embodiments of the second exemplary method, determining renderer support includes: determining whether the user equipment (UE) does not support the respective renderer; sending rendering data associated with the respective renderer to an edge server; determining whether the edge server refused to delegate the rendering data; and in response to the determination that rendering the rendering data is required, generating an error message; and stopping the use of the 3D scene without rendering the rendering data.

[020] For some modalities of the second exemplary method, one or more renderers are selected from the group consisting of video-related renderers, audio-related renderers, and tactile-related renderers.

[021] For some embodiments of the second exemplary method, one or more renderers are selected from the group consisting of video-related renderers, audio-related renderers, tactile-related renderers, geometry-related renderers, texture-related renderers, camera-related renderers, animation-related renderers, physics-related renderers, and lighting-related renderers.

[022] For some embodiments of the second exemplary method, at least two renderers are used in rendering the 3D scene, and at least two categories of renderers are selected from the group consisting of video-related renderers, audio-related renderers, tactile-related renderers, geometry-related renderers, texture-related renderers, camera-related renderers, animation-related renderers, physics-related renderers, and renderers Petition 870250094130, dated 10 / 15 / 2025, page 11 / 96 6 / 73 related to lighting.

[023] For some forms of the second example method, at least one of the dedicated structures is compatible with a glTF format.

[024] For some modes of the second exemplary method, at least one of the dedicated structures is compatible with an MPEG-I scene description format.

[025] For some modalities of the second exemplary method, the dedicated structures are stored in a single file.

[026] A second exemplary apparatus according to some embodiments may include: a processor; and a non-transient computer-readable medium that stores operative instructions, when executed by the processor, to make the apparatus execute any of the methods listed above.

[027] A third illustrative method according to some embodiments may include: obtaining information indicating interaction with one or more computation blocks used in the generation of a three-dimensional (3D) scene; identifying computation block data, object data, and component data associated with at least one respective computation block of one or more computation blocks used; in response to the determination that computation block data are global scene data, adding, at scene level, computation block data to a structure dedicated to the respective computation block; adding, at node level, for at least one node associated with the respective computation block, object data to the structure dedicated to the respective computation block; and adding, at component level, for at least one component associated with the respective node, component data to the structure dedicated to the respective computation block.

[028] For some modalities of the third exemplary method, one or Petition 870250094130, dated 10 / 15 / 2025, page 12 / 96 7 / 73 more computing blocks are selected from the group consisting of video-related computing blocks, audio-related computing blocks, tactile-related computing blocks, geometry-related computing blocks, texture-related computing blocks, camera-related computing blocks, animation-related computing blocks, physics-related computing blocks, and lighting-related computing blocks.

[029] For some embodiments of the third exemplary method, at least two computation blocks are used to perform a computation related to the 3D scene, and at least two categories of computation blocks are selected from the group consisting of computation blocks related to video, computation blocks related to audio, computation blocks related to tactile sensation, computation blocks related to geometry, computation blocks related to texture, computation blocks related to camera, computation blocks related to animation, computation blocks related to physics and computation blocks related to lighting.

[030] For some forms of the third example method, at least one of the dedicated structures is compatible with the glTF format.

[031] For some modes of the third exemplary method, at least one of the dedicated structures is compatible with the MPEG-I scene description format.

[032] For some modalities of the third exemplary method, the dedicated structures are stored in a single file.

[033] For some embodiments of the third exemplary method, the computation block data includes functionality support information.

[034] For some embodiments of the third exemplary method, the supporting functionality information includes the functionality of the computing block. Petition 870250094130, dated 10 / 15 / 2025, page 13 / 96 8 / 73 is needed to perform a calculation for at least one component of an object.

[035] For some embodiments of the third exemplary method, the component data for at least one component includes information indicating the ability to generate the scene in a degraded mode without performing a calculation related to at least one component.

[036] A third exemplary apparatus, according to some embodiments, may include: a processor; and a non-transient computer-readable medium that stores operative instructions, when executed by the processor, to make the apparatus execute any of the methods listed above.

[037] A fourth exemplary method according to some embodiments may include: obtaining information indicating the interaction with one or more computing blocks used in the generation of a three-dimensional (3D) scene; identifying computing block data, object data and component data associated with at least one respective computing block of one or more computing blocks used; obtaining, at scene level, computing block data from a structure dedicated to the respective computing block; obtaining, at node level, for at least one node associated with the respective computing block, object data from the structure dedicated to the respective computing block; obtaining, at component level, for at least one component associated with the respective node, component data from the structure dedicated to the respective computing block; and determining the computing block support for the respective computing block.

[038] For some embodiments of the fourth exemplary method, determining compute block support includes: verifying whether the user equipment (UE) supports the respective compute block; obtaining compute block data associated with the respective compute block; and computing a calculation related to at least one component associated with the compute block data. Petition 870250094130, dated 10 / 15 / 2025, page 14 / 96 9 / 73

[039] For some embodiments of the fourth exemplary method, determining compute block support includes: determining whether the user equipment (UE) does not support the respective compute block; sending compute block data associated with the respective compute block to an edge server; and verifying whether the edge server has accepted the delegation of compute block data.

[040] For some embodiments of the fourth exemplary method, determining compute block support includes: determining whether the user equipment (UE) does not support the respective compute block; sending compute block data associated with the respective compute block to an edge server; determining whether the edge server has refused delegation of the compute block data; and, in response to the determination that performing a calculation related to the compute block data is not required, continuing to use the 3D scene without performing the calculation related to a component.

[041] For some embodiments of the fourth exemplary method, determining compute block support includes: determining whether the user equipment (UE) does not support the respective compute block; sending compute block data associated with the respective compute block to an edge server; determining whether the edge server refused delegation of the compute block data; and, in response to the determination that computation of the compute block data is required, generating an error message; and stopping the use of the 3D scene without performing the calculation related to a component.

[042] For some embodiments of the fourth exemplary method, one or more computing blocks are selected from the group consisting of video-related computing blocks, audio-related computing blocks, tactile-related computing blocks, computing blocks related Petition 870250094130, dated 10 / 15 / 2025, page 15 / 96 10 / 73 related to geometry, texture-related computing blocks, camera-related computing blocks, animation-related computing blocks, physics-related computing blocks, and lighting-related computing blocks.

[043] For some embodiments of the fourth exemplary method, at least two computing blocks are used in the generation of the 3D scene, and at least two categories of computing blocks are selected from the group consisting of video-related computing blocks, audio-related computing blocks, tactile-related computing blocks, geometry-related computing blocks, texture-related computing blocks, camera-related computing blocks, animation-related computing blocks, physics-related computing blocks, and lighting-related computing blocks.

[044] For some forms of the fourth exemplary method, at least one of the dedicated structures is compatible with the glTF format.

[045] For some modes of the fourth exemplary method, at least one of the dedicated structures is compatible with the MPEG-I scene description format.

[046] For some modalities of the fourth exemplary method, the dedicated structures are stored in a single file.

[047] For some embodiments of the fourth exemplary method, the single file includes two or more versions of object data.

[048] For some embodiments of the fourth exemplary method, the single file includes two or more versions of component data.

[049] For some modalities of the fourth exemplary method, at least two computing blocks are used in the generation of the 3D scene, the first and second categories of computing blocks are selected from the group that Petition 870250094130, dated 10 / 15 / 2025, page 16 / 96 11 / 73 consists of computation blocks related to video, computation blocks related to audio, computation blocks related to haptic feedback, computation blocks related to geometry, computation blocks related to texture, computation blocks related to camera, computation blocks related to animation, computation blocks related to physics, and computation blocks related to lighting. The first category is different from the second category; the single file includes both the first and second versions of object data. The first version of the object data is associated with the first category of computation blocks, and the second version of the object data is associated with the second category of computation blocks.

[050] For some embodiments of the fourth exemplary method, at least two computation blocks are used in the generation of the 3D scene, the first and second categories of computation blocks are selected from the group consisting of computation blocks related to video, computation blocks related to audio, computation blocks related to tactile sensation, computation blocks related to geometry, computation blocks related to texture, computation blocks related to camera, computation blocks related to animation, computation blocks related to physics and computation blocks related to lighting, the first category is different from the second category, the single file includes the first and second versions of the component data, the first version of the component data is associated with the first category of computation blocks, and the second version of the component data is associated with the second category of computation blocks.

[051] A fourth exemplary apparatus, according to some embodiments, may include: a processor; and a non-transient computer-readable medium that stores operative instructions, when executed by the processor, to make the apparatus execute any of the methods listed above. Petition 870250094130, dated 10 / 15 / 2025, page 17 / 96 12 / 73

[052] A fifth illustrative method according to some embodiments may include: obtaining information indicating interaction with one or more manipulators used in the processing of a three-dimensional (3D) scene; identifying manipulator data, object data and component data associated with at least one respective manipulator of one or more manipulators used; obtaining, at scene level, manipulator data from a structure dedicated to the respective manipulator; obtaining, at node level, for at least one node associated with the respective manipulator, object data from the structure dedicated to the respective manipulator; obtaining, at component level, for at least one component associated with the respective node, component data from the structure dedicated to the respective manipulator; and determining the manipulator support for the respective manipulator.

[053] For some embodiments of the fifth exemplary method, one or more handlers include one or more renderers.

[054] For some embodiments of the fifth exemplary method, one or more manipulators include one or more computation blocks.

[055] For some embodiments of the fifth exemplary method, one or more handlers include one or more renderers and one or more compute blocks.

[056] A sixth exemplary method according to some embodiments may include: obtaining information indicating interaction with a handler used in the processing of a three-dimensional (3D) scene; obtaining handler data, object data and component data from a structure dedicated to the handler; determining the handler support for the handler; and, in response to the determination that the handler support indicates local support, processing, by means of the handler, at least one of the handler data, the object data and the component data.

[057] A seventh illustrative method according to some modalities Petition 870250094130, dated 10 / 15 / 2025, page 18 / 96 13 / 73 may include: obtaining information indicating interaction with a handler used in processing a three-dimensional (3D) scene; obtaining handler data, object data, and component data from a structure dedicated to the handler; determining the handler support for the handler; and, in response to the determination that the handler support indicates delegation, sending at least one of the handler data, object data, and component data to a delegation device.

[058] An eighth exemplary method according to some embodiments may include: obtaining information indicating interaction with one or more handlers used in the processing of a three-dimensional (3D) scene; identifying handler data, object data, and component data associated with at least one respective handler from one or more handlers used; in response to the determination that handler data is global scene data, adding, at scene level, handler data to a structure dedicated to the respective handler; adding, at node level, for at least one node associated with the respective renderer, object data to the structure dedicated to the respective handler; and adding, at component level, for at least one component associated with the respective node, component data to the structure dedicated to the respective handler.

[059] For some embodiments of the eighth exemplary method, one or more handlers include one or more renderers.

[060] For some embodiments of the eighth exemplary method, one or more handlers include one or more computation blocks.

[061] For some embodiments of the eighth exemplary method, one or more handlers include one or more renderers and one or more compute blocks.

[062] A ninth illustrative method according to some modalities may include: obtaining information corresponding to an associated scene description Petition 870250094130, dated 10 / 15 / 2025, p. 19 / 96 14 / 73 to a single node graph; and add, to a dedicated structure, renderer data, object data, and component data associated with each of at least two respective renderers, wherein the dedicated structure comprises two or more representations of an object in a scene associated with the scene description.

[063] For some modalities of the ninth exemplary method, the dedicated structure is compatible with the glTF format.

[064] For some modes of the ninth exemplary method, the dedicated structure is compatible with the MPEG-I scene description format.

[065] For some modalities of the ninth exemplary method, the dedicated structure is stored in a single file.

[066] For some embodiments of the ninth exemplary method, at least one of the two or more representations of the object comprises mesh geometries of the object.

[067] For some embodiments of the ninth exemplary method, the dedicated structure comprises a data memory structure.

[068] A ninth exemplary apparatus, according to some embodiments, may include: a processor; and a non-transient computer-readable medium that stores operative instructions, when executed by the processor, to make the device execute any of the methods listed above. BRIEF DESCRIPTION OF THE DRAWINGS

[069] Figure 1A is a schematic side view illustrating an example of a waveguide screen that can be used with extended reality (XR) applications according to some modalities.

[070] Figure 1B is a schematic side view illustrating an exemplary alternative screen type that can be used with extended reality applications according to some modalities.

[071] Figure 1C is a schematic side view illustrating a type of screen. Petition 870250094130, dated 10 / 15 / 2025, p. 20 / 96 15 / 73 is an illustrative alternative that can be used with extended reality applications according to some modalities.

[072] Figure 1D is a system diagram that illustrates an exemplary set of interfaces for a system according to some modalities.

[073] Figure 2 is a system diagram that illustrates an exemplary set of interfaces for an MPEG-I node hierarchy that supports scene interactivity elements according to some modalities.

[074] Figure 3 is a system diagram that illustrates an exemplary set of interfaces for the glTF node hierarchy, according to some modalities.

[075] Figure 4 is an illustration that shows an example of various representations of a virtual car, targeting different renderers / modules / computing blocks, according to some modalities.

[076] Figure 5 is an illustration showing an exemplary XR use case with various renderers and computing modules / blocks, according to some modalities.

[077] Figure 6 is an illustration that shows an example of several representations of a virtual tree, aimed at various renderers / modules / computation blocks, according to some modalities.

[078] Figure 7 is a flowchart that illustrates an exemplary process for generating a single shared scene graph, storing all XR data, according to some modalities.

[079] Figures 8A-8B are flowcharts that illustrate an exemplary process for retrieving, on the client side, XR data from a shared scene graph, according to some modalities.

[080] Figures 9A-9D are code listings for an example scene description file related to the XR use case in Figure 3, according to Petition 870250094130, dated 10 / 15 / 2025, p. 21 / 96 16 / 73 with some modalities.

[081] Figure 10 is a listing of codes for exemplary mappings of delegated renderers / computation modules, according to some modalities.

[082] Figure 11 is a flowchart that illustrates an exemplary process for generating a single shared scene graph, according to some modalities.

[083] Entities, connections, arrangements and the like that are represented and described together with the various figures are presented as examples and not as limitations. As such, any and all statements or other indications about what a specific figure “represents”, what a specific element or entity in a specific figure “is” or “has”, and any and all similar statements that may, in isolation and out of context, be read as absolute and therefore limiting, can only be properly read as being constructively preceded by a clause such as “In at least one embodiment, ....” For brevity and clarity of presentation, this implicit initial clause is not repeated ad nauseam in the detailed description. DETAILED DESCRIPTION

[084] Figure 1A is a schematic side view illustrating an exemplary waveguide display that can be used with extended reality (XR) applications according to some embodiments. An image is projected by an image generator 102. The image generator 102 can use one or more of several techniques to project an image. For example, the image generator 102 can be a laser beam scanning projector (LBS), a liquid crystal display (LCD), a light-emitting diode (LED) display (including an organic LED (OLED) or micro LED^LED) display), a digital light processor (DLP), a liquid crystal display on silicon (LCoS), or another type of image generator or light mechanism. Petition 870250094130, dated 10 / 15 / 2025, p. 22 / 96 17 / 73

[085] The light representing an image 112 generated by the image generator 102 is coupled to a waveguide 104 by a diffractive coupler 106. The coupler diffracts the light representing the image 112 into one or more diffractive orders. For example, the light ray 108, which is one of the light rays representing a portion of the lower part of the image, is diffracted by the coupler 106, and one of the diffracted orders 110 (for example, the second order) is at an angle capable of being propagated through the waveguide 104 by total internal reflection. The image generator 102 displays images as directed by a control module 124, which operates to render image data, video data, point cloud data, or other displayable data.

[086] At least a portion of the light 110 that was coupled to the waveguide 104 by the input diffractive coupler 106 is coupled out of the waveguide by an output diffractive coupler 114. At least part of the light coupled out of the waveguide 104 replicates the angle of incidence of the light coupled to the waveguide. For example, in the illustration, the out-coupled light rays 116a, 116b, and 116c replicate the angle of the in-coupled light ray 108. Because the light exiting the output coupler replicates the directions of the light that entered the input coupler, the waveguide substantially replicates the original image 112. The user's eye 118 can focus on the replicated image.

[087] In the example in Figure 1A, the output coupler 114 couples only a portion of the light, with each reflection allowing a single input beam (such as beam 108) to generate multiple parallel output beams (such as beams 116a, 116b, and 116c). In this way, at least some of the light from each portion of the image will likely reach the user's eye, even if it is not perfectly aligned with the center of the output coupler. For example, if eye 118 moves downward, beam 116c may enter the eye even if beams 116a and 116b do not, so the user may still perceive the lower part of the image. Petition 870250094130, dated 10 / 15 / 2025, p. 23 / 96 18 / 73 image 112, despite the change in position. The output coupler 114, therefore, operates, in part, as an exit pupil expander in the vertical direction. The waveguide may also include one or more additional exit pupil expanders (not shown in Figure 1A) to expand the exit pupil in the horizontal direction.

[088] In some embodiments, the waveguide 104 is at least partially transparent with respect to light originating outside the waveguide screen. For example, at least some of the light 120 from real-world objects (such as object 122) passes through the waveguide 104, allowing the user to see the real-world objects while using the waveguide screen. Since light 120 from real-world objects also passes through the diffraction grating 114, there will be multiple diffraction orders and therefore multiple images. To minimize the visibility of multiple images, it is desirable that the zero diffraction order (no deviation by 114) has a high diffraction efficiency for light 120 and zero order, while higher diffraction orders have lower energy. Thus, in addition to expanding and decoupling the virtual image, the output coupler 114 is preferably configured to allow the zero order of the real image to pass through.In such modes, the images displayed by the waveguide screen may appear superimposed on the real world.

[089] Figure 1B is a schematic side view illustrating an exemplary alternative screen type that can be used with extended reality applications, according to some embodiments. In an XR virtual reality glasses device 130, a control module 132 controls a screen 134, which may be an LCD, to display an image. The virtual reality glasses include a partially reflective surface 136 that reflects (and, in some embodiments, reflects and focuses) the image displayed on the LCD to make it visible to the user. The partially reflective surface 136 also allows the passage of at least some external light, enabling the user to see their surroundings.

[090] Figure 1C is a schematic side view illustrating a type of screen. Petition 870250094130, dated 10 / 15 / 2025, page 24 / 96 19 / 73 an exemplary alternative that can be used with extended reality applications, according to some embodiments. In an XR virtual reality glasses device 140, a control module 142 controls a screen 144, which may be an LCD, to display an image. The image is focused by one or more lenses of the screen optics 146 to make it visible to the user. In the example of Figure 1C, external light does not reach the user's eyes directly. However, in some of these embodiments, an external camera 148 may be used to capture images of the external environment and display these images on the screen 144, along with any virtual content that may also be displayed.

[091] The modalities described here are not limited to any specific type or structure of XR display device.

[092] Figure 1D is a system diagram illustrating an exemplary set of interfaces for a system according to some embodiments. An extended reality display device, along with its control electronics, can be implemented using a system such as that in Figure 1D. System 150 can be embodied as a device that includes the various components described below and is configured to perform one or more of the aspects described in this document. Examples of such devices include, but are not limited to, various electronic devices such as personal computers, laptops, smartphones, tablets, digital multimedia set-top boxes, digital television receivers, personal video recording systems, connected home appliances, and servers. Elements of System 150, individually or in combination, can be incorporated into a single integrated circuit (IC), multiple ICs, and / or discrete components.For example, in at least one embodiment, the processing and encoder / decoder elements of the 150 system are distributed across multiple ICs and / or discrete components. In several embodiments, the 150 system is communicatively coupled to one or more other ICs. Petition 870250094130, dated 10 / 15 / 2025, page 25 / 96 20 / 73 other systems, or other electronic devices, by means of, for example, a communications bus or dedicated input and / or output ports. In various embodiments, the 1000 system is configured to implement one or more of the aspects described in this document.

[093] System 150 includes at least one processor 152 configured to execute instructions loaded into it to implement, for example, the various aspects described in this document. Processor 152 may include embedded memory, input / output interface, and various other circuits known in the art. System 150 includes at least one memory 154 (for example, a volatile memory device and / or a non-volatile memory device). System 150 may include a storage device 158, which may include non-volatile memory and / or volatile memory, including, but not limited to, Electrically Erasable Programmable Read-Only Memory (EEPROM), Read-Only Memory (ROM), Programmable Read-Only Memory (PROM), Random Access Memory (RAM), Dynamic Random Access Memory (DRAM), Static Random Access Memory (SRAM), flash memory, magnetic disk drive, and / or optical disk drive.Storage device 158 may include an internal storage device, an attached storage device (including detachable and non-detachable storage devices), and / or a network-accessible storage device, as non-limiting examples.

[094] System 150 includes an encoder / decoder module 156 configured, for example, to process data to provide an encoded or decoded video, and the encoder / decoder module 156 may include its own processor and memory. The encoder / decoder module 156 represents module(s) that may be included in a device to perform encoding and / or decoding functions. As is known, a device may include one or both encoding and decoding modules. Furthermore, the encoder / decoder module Petition 870250094130, dated 10 / 15 / 2025, page 26 / 96 21 / 73 156 can be implemented as a separate element of the system 150 or it can be incorporated into the processor 152 as a combination of hardware and software, as known to those skilled in the art.

[095] The program code to be loaded into processor 152 or encoder / decoder 156 to execute the various aspects described in this document may be stored in storage device 158 and subsequently loaded into memory 154 for execution by processor 152. According to various embodiments, one or more of processor 152, memory 154, storage device 158, and encoder / decoder module 156 may store one or more of several items during the execution of the processes described in this document. Such stored items may include, among others, the input video, the decoded video or parts of the decoded video, the bitstream, matrices, variables, and intermediate or final results of the processing of equations, formulas, operations, and operational logic.

[096] In some embodiments, the memory within the processor 152 and / or the encoder / decoder module 156 is used to store instructions and provide working memory for the processing required during encoding or decoding. In other embodiments, however, memory external to the processing device (for example, the processing device may be the processor 152 or the encoder / decoder module 152) is used for one or more of these functions. The external memory may be memory 154 and / or storage device 158, for example, volatile dynamic memory and / or non-volatile flash memory. In several embodiments, non-volatile external flash memory is used to store the operating system, for example, of a television.In at least one embodiment, a fast external dynamic volatile memory, such as RAM, is used as working memory for video encoding and decoding operations, such as for MPEG-2 (MPEG refers to Specialist Group). Petition 870250094130, dated 10 / 15 / 2025, page 27 / 96 22 / 73 in Motion Picture, MPEG-2 is also known as ISO / IEC 13818, 13818-1 is also known as H.222, and 13818-2 is also known as H.262), HEVC (HEVC refers to High Efficiency Video Coding, also known as H.265 and MPEG-H Part 2) or VVC (Versatile Video Coding, a new standard being developed by JVET, a Joint Video Experts Team).

[097] Input to the elements of system 150 may be provided by means of various input devices, as indicated in block 172. Such input devices include, among others, (i) a radio frequency (RF) part that receives an RF signal transmitted, for example, through the air by a broadcaster, (ii) a Component Input (COMP) terminal (or a set of COMP input terminals), (iii) a Universal Serial Bus (USB) input terminal and / or (iv) a High Definition Multimedia Interface (HDMI) input terminal. Other examples, not shown in Figure 1C, include composite video.

[098] In various embodiments, the input devices of block 172 have respective associated input processing elements, as known in the art. For example, the RF part may be associated with elements suitable for (i) selecting a desired frequency (also called signal selection or band limiting of a signal to a frequency band), (ii) down-converting the selected signal, (iii) again band-limiting to a narrower frequency band to select (for example) a signal frequency band that may be called a channel in certain embodiments, (iv) demodulating the down-converted and band-limited signal, (v) performing error correction, and (vi) demultiplexing to select the desired stream of data packets. The RF part of various embodiments includes one or more elements to perform these functions, for example, frequency selectors, signal selectors, li Petition 870250094130, dated 10 / 15 / 2025, p. 28 / 96 23 / 73 band selectors, channel selectors, filters, down-converters, demodulators, error correctors, and demultiplexers. The RF part may include a tuner that performs several of these functions, including, for example, down-converting the received signal to a lower frequency (e.g., an intermediate frequency or a frequency close to baseband) or to baseband. In a decoder embodiment, the RF part and its associated input processing element receive an RF signal transmitted over a wired medium (e.g., cable) and perform frequency selection by means of filtering, down-conversion, and filtering again to a desired frequency band. Various embodiments rearrange the order of the elements described above (and others), remove some of these elements, and / or add other elements that perform similar or different functions.The addition of elements may include inserting elements between existing elements, such as, for example, inserting amplifiers and an analog-to-digital converter. In several embodiments, the RF part includes an antenna.

[099] In addition, the USB and / or HDMI terminals may include respective interface processors for connecting the system 150 to other electronic devices via USB and / or HDMI connections. It should be understood that various aspects of input processing, for example, Reed-Solomon error correction, may be implemented, for example, in a separate input processing integrated circuit or in the processor 152, as needed. Similarly, aspects of USB or HDMI interface processing may be implemented in separate interface ICs or in the processor 152, as needed. The demodulated, error-corrected, and demultiplexed stream is provided to various processing elements, including, for example, the processor 152, and the encoder / decoder 156, operating in combination with the memory and storage elements to process the data stream as needed for presentation on a device. Petition 870250094130, dated 10 / 15 / 2025, page 29 / 96 24 / 73 outbound.

[0100] Several elements of the system 150 can be provided within an integrated housing. Within the integrated housing, the various elements can be interconnected and transmit data to each other using a suitable connection arrangement 174, for example, an internal bus, as known in the art, including the Inter-CI (I2C) bus, wiring and printed circuit boards.

[0101] System 150 includes a communication interface 160 that allows communication with other devices through communication channel 162. Communication interface 160 may include, but is not limited to, a transceiver configured to transmit and receive data through communication channel 162. Communication interface 160 may include, but is not limited to, a modem or network card, and communication channel 162 may be implemented, for example, within a wired and / or wireless medium.

[0102] Data is transmitted, or otherwise provided, to system 150 in various modes using a wireless network, such as a Wi-Fi network, for example, IEEE 802.11 (IEEE refers to the Institute of Electrical and Electronics Engineers). The Wi-Fi signal in these modes is received by communication channel 162 and communication interface 160, which are adapted for Wi-Fi communications. Communication channel 162 in these modes is typically connected to an access point or router that provides access to external networks, including the Internet, to enable streaming applications and other over-the-top communications. Other modes provide data transmitted to system 150 using a decoder that delivers the data via the HDMI connection of input block 172. Still other modes provide data transmitted to system 150 using the RF connection of input block 172. As indicated above, various modes provide data in a non-streaming manner.In addition, several modalities utilize wireless networks other than Wi-Fi, for example, a cellular network or a Bluetooth network. Petition 870250094130, dated 10 / 15 / 2025, page 30 / 96 25 / 73

[0103] System 150 can provide an output signal to various output devices, including a screen 176, speakers 178, and other peripheral devices 180. The screen 176 of various embodiments includes one or more of, for example, a touch screen, an organic light-emitting diode (OLED) screen, a curved screen, and / or a foldable screen. The screen 176 can be for a television, a tablet, a laptop, a mobile phone, or another device. The screen 176 can also be integrated into other components (for example, as in a smartphone) or separate (for example, an external screen for a laptop). The other peripheral devices 180 include, in various embodiments, one or more of a standalone digital video disc (or digital versatile disc) (DVR, for both terms), a disc player, a stereo system, and / or a lighting system.Several modes utilize one or more peripheral devices 180 that provide a function based on the system output 150. For example, a record player performs the function of playing the system output 150.

[0104] In various embodiments, control signals are communicated between the system 150 and the screen 176, the loudspeakers 178, or other peripheral devices 180 using signaling such as AV.Link, Consumer Electronics Control (CEC), or other communication protocols that allow device-to-device control with or without user intervention. Output devices can be communicatively coupled to the system 1000 via dedicated connections through their respective interfaces 164, 166, and 168. Alternatively, output devices can be connected to the system 150 using communication channel 162 via communication interface 160. The screen 176 and the loudspeakers 178 can be integrated into a single unit with the other components of the system 150 in an electronic device, such as, for example, a television.In several embodiments, the 164-bit display interface includes a display driver, such as, for example, a timing controller chip (T-Con). Petition 870250094130, dated 10 / 15 / 2025, p. 31 / 96 26 / 73

[0105] The screen 176 and the speaker 178 may alternatively be separated from one or more of the other components, for example, if the RF part of input 172 is part of a separate decoder. In various embodiments in which the screen 176 and the speakers 178 are external components, the output signal may be provided via dedicated output connections, including, for example, HDMI ports, USB ports or COMP outputs.

[0106] System 150 may include one or more sensor devices 168. Examples of sensor devices that may be used include one or more GPS sensors, gyroscopic sensors, accelerometers, light sensors, cameras, depth cameras, microphones, and / or magnetometers. Such sensors may be used to determine information such as the user’s position and orientation. When System 150 is used as a control module for an extended reality display (such as control modules 124, 132), the user’s position and orientation may be used to determine how to render image data so that the user perceives the correct part of a virtual object or virtual scene from the correct viewpoint. In the case of virtual reality glasses devices, the position and orientation of the device itself may be used to determine the user’s position and orientation for the purpose of rendering virtual content.In the case of other display devices, such as a phone, tablet, computer screen, or television, other inputs can be used to determine the user's position and orientation for the purpose of rendering content. For example, a user can select and / or adjust a desired viewpoint and / or viewing direction using a touchscreen, numeric keypad, trackball, game controller, or other input. When the display device has sensors such as accelerometers and / or gyroscopes, the viewpoint and orientation used for the purpose of rendering content can be selected and / or adjusted based on the movement of the display device. Petition 870250094130, dated 10 / 15 / 2025, page 32 / 96 27 / 73

[0107] The embodiments may be implemented by computer software implemented by the processor 152 or by hardware, or by a combination of hardware and software. As a non-limiting example, the embodiments may be implemented by one or more integrated circuits. The memory 154 may be of any type appropriate to the technical environment and may be implemented using any appropriate data storage technology, such as optical memory devices, magnetic memory devices, semiconductor-based memory devices, fixed memory and removable memory, as non-limiting examples. The processor 152 may be of any type appropriate to the technical environment and may include one or more microprocessors, general-purpose computers, special-purpose computers and processors based on a multi-core architecture, as non-limiting examples. Scene Description Structure for XR

[0108] These principles generally refer to the domain of extended reality scene description rendering and extended reality rendering. This document also applies to the context of formatting and running extended reality applications when rendered on end-user devices, such as mobile devices or Virtual Reality Headsets (HMDs).

[0109] Extended Reality (XR) is a technology that enables interactive experiences where the real-world environment and / or video content are enhanced by virtual content, which can be defined in multiple sensory modalities, including visual, auditory, tactile, etc. During application execution, the virtual content (3D content or audio / video file, for example) is rendered in real time in a manner consistent with the user's context (environment, viewpoint, device, etc.). Scene graphs (such as those proposed by Khronos / glTF and their extensions defined in the MPEG or Apple / USDZ scene description format, for example) are one possible way to represent the content to be rendered. They combine Petition 870250094130, dated 10 / 15 / 2025, page 33 / 96 28 / 73 a declarative description of the scene's structure, linking objects from the real environment and virtual objects, on the one hand, and binary representations of the virtual content, on the other hand.

[0110] Although such MPEG scene description structures ensure that timed media and corresponding relevant virtual content are available at any time during application rendering, there is no description of how a user can interact with scene objects at runtime for immersive XR experiences.

[0111] There is a lack of an XR system that can utilize an XR scene description, including metadata that describes how a user can interact with scene objects at runtime and how those interactions can be updated during the runtime of the XR application.

[0112] In XR applications, a scene description is used to combine an explicit and easy-to-parse description of a scene structure and some binary representations of media content.

[0113] In time-based media streaming, the scene description itself can evolve over time to provide the relevant virtual content for each sequence of a media stream. For example, for advertising purposes, a virtual bottle might be displayed during a video sequence where people are drinking.

[0114] For some modes, the structure described in the document Scene Description for MPEG Media Document, Information Technology - Coded Representation of Immersive Media - Part 14: Scene Description for MPEG Media, International Organization for Standardization (ISO), ISO / IEC DIS 23090-14:2021 (E) (2021), may be used. Runtime Interactivity Petition 870250094130, dated 10 / 15 / 2025, page 34 / 96 29 / 73

[0115] Figure 2 is a system diagram illustrating an exemplary set of interfaces for an MPEG-I node hierarchy that supports scene interactivity elements according to some modalities. According to the present principles, some of which are shown in the 200-node hierarchy, in addition to a node tree, behavior metadata items (examples of what is here called “behaviors”) are added to the scene description. In exemplary modalities, the scene description evolving over time is supplemented by the addition of information that identifies behaviors. These behaviors may relate to predefined virtual objects in which runtime interactivity is enabled for specific user XR experiences.

[0116] In some modes, these behaviors evolve over time. In such modes, behaviors can be updated through the existing scene description update mechanism.

[0117] In exemplary modalities, a behavior can be characterized by one or more of the following properties:

[0118] • One or more triggers that define the conditions to be met for activation.

[0119] • A trigger control parameter that defines the logical operations between the defined triggers.

[0120] • Actions to be implemented in response to the activation of the triggers.

[0121] • An action control parameter that defines the order in which the defined actions are executed.

[0122] • A priority number that allows the selection of the highest priority behavior in the case of concurrency of multiple behaviors on the same virtual object at the same time.

[0123] • An interrupt action to specify how to terminate this behavior when it is no longer defined in a newly updated scene. Petition 870250094130, dated 10 / 15 / 2025, page 35 / 96 30 / 73 received. For example, a behavior will no longer be defined if the related object has been removed or if the behavior is no longer relevant to the current media sequence (e.g., audio or video).

[0124] With the addition of these behaviors, time-dependent user interactivity in immersive content for XR experiences can be defined.

[0125] When a second scene description is received, some of the behaviors from the first scene description may be “in progress,” for example, they are triggered and their actions are running. The second scene description may be provided as update metadata, for example, metadata describing the differences between the first scene description and the second scene description. The second scene description includes a node tree describing objects that may be common to or different from the objects in the first scene descriptions. Objects from the node tree of the first scene description may no longer be present in the second description. If objects related to the running actions of ongoing behaviors are missing in the second scene description, those ongoing behaviors will no longer apply. If an ongoing behavior is not defined in the second description, the ongoing behavior will no longer apply.The interrupt action field describes how to interrupt actions being executed in ongoing behavior.

[0126] In XR applications, a scene description is used to combine the explicit and easy-to-parse description of a scene structure and some binary representations of media content.

[0127] Figure 3 is a system diagram illustrating an exemplary set of interfaces for the glTF node hierarchy according to some modalities. As shown in the example in Figure 3, a scene 302 has a scene structure 304 containing a node graph with a single root node. The root node has two child nodes for a camera and a car. The car node has two child nodes for the Petition 870250094130, dated 10 / 15 / 2025, page 36 / 96 31 / 73 front wheels and rear wheels. The scene shown in Figure 3 shows a car being filmed by a camera. The left side of Figure 3 shows an example of a glTF 306 node array structure. For the root node, the nodes are indicated as element #1 of the “children” array for the first node (camera) and element #2 of the “children” array for the second node (car). The camera node structure includes a “matrix” array that provides the spatial transformation (which may include translation, rotation, and scaling, and which is shown as “...” in Figure 3) of that node relative to its parent node. The car node structure includes references to element #3 (front wheels node) and element #4 of the “children” array (rear wheels node). The structure for the front wheels node includes information about the “rotation” and “translation” values ​​(both shown as “...” in Figure 3).The structure for the rear wheel node includes information about the “rotation” and “translation” values ​​(which are also shown as “...” in Figure 3).

[0128] Rich XR experiences can be supported by: (1) multiple renderers, such as visual, immersive audio, and tactile renderers; and (2) multiple computing modules, such as physics engine, Augmented Reality (AR) anchor detection and tracking, interactivity, and lighting estimation. Such renderers and computing modules / blocks utilize data that can be provided in a spatially and temporally structured manner. A node-based scene description stores and transmits such data from a server to the user's device.

[0129] Several scene description formats are available and primarily target one or a subset of renderers: Khronos' glTF, which is outlined in the GLTF 2.0 SPECIFICATION, Khronos 3D Formats Working Group (October 2021), available at [link to registry]. <dot>chronos <dot>org / glTF / via github <dot>com / KhronosGroup / glTF ("Khronos glTF"), provides geometry data, Petition 870250094130, dated 10 / 15 / 2025, p. 37 / 96 32 / 73 texture, camera, animation, and lighting elements to be used by a visual renderer, and the MPEG-I immersive audio group defined an Encoder Input Format (EIF), which is discussed in MPEG-I IMMERSIVE AUDIO ENCODER INPUT FORMAT, Version 3, International Organization for Standardization (ISO), ISO / IEC JTC 1 / SC 29 / WG 6 (October 28, 2022), available at isotc <ponto>iso <ponto>org / livelink / livelink / open / jtc1sc29wg6, to transmit acoustic data to be used by an immersive audio renderer.

[0130] For rich XR experiences that utilize multiple renderers, multiple scene graphs can be generated to store and transmit the data. For example, one scene graph can be generated for each renderer. However, a limitation of this approach is maintaining the spatial and temporal consistencies of scene graphs targeting multiple renderers. Therefore, an example problem statement might indicate a problem with maintaining the spatial and temporal consistencies of scene graphs targeting multiple renderers.

[0131] The MPEG-I Scene Description is based on the Khronos glTF format. The new semantics, as explained in this application, are achieved through the Khronos vendor extension mechanism, as shown in Figures 9A-9D. As a result, a single scene graph can support, for example, dedicated structures to provide EIF scene description data within the MPEG-I Scene Description (SD). Figure 7 shows an example of how such a file can be generated, and Figures 8A-8B show an example of how such a file can be decompressed and used by an XR client.

[0132] Figure 4 is an illustration showing an example of various representations of a virtual car targeting different renderers / modules / computing blocks, according to some modalities. For example, as shown in Figure 4, a moving virtual car 400 can be represented by highly detailed meshes and textures for visual rendering 402. Mesh primitives, such Petition 870250094130, dated 10 / 15 / 2025, page 38 / 96 33 / 73, such as an Axis-Aligned Bounding Box (AABB), can be associated with acoustic material for audio rendering. For example, a geometric box primitive 406 can be used for spatial aspects of an audio source 408, which is the car's engine in this example. An AABB and / or mesh 404 can be used for collision detection and interactivity calculations associated with tactile rendering(s) and feedback. For example, a box can be drawn around the ends of the car, as shown in Figure 4. When the car is in motion, the spatial consistency and temporal consistency of this rendering and / or computational data must be maintained.

[0133] For some modalities, a single scene graph can be generated to store the data for manipulators, such as renderers (of which some or all may be required for some modalities) and compute blocks (e.g., compute modules). This approach is in the spirit of Support of 5D Glass-Type Augmented Reality / Mixed Reality (AR / MR) Devices, 3rd Generation Partnership Project (3GPP), TR26.998, Version 17.0.0 (March 2022) ("3GPP TR26.998") (see section 4.3, Basic Processes for Delivering an AR Experience), in which an initial scene description document summarizing all XR assets is provided as an entry point for the User Equipment (UE). Depending on the capabilities of the user equipment (which, for some modes, may be the UE's ability to render and / or compute XR resources), some parts may be delegated to the network edge. For example, in a split rendering architecture (3GPP TR26).998, section 6.3.4.2, EDGARBased Interactive Immersive Service), the UE delegates visual rendering to the edge; only the decoding and display of the rendered 2D video stream are performed by the UE.

[0134] To support XR data in addition to visual data, glTF extensions to the MPEG-I SD standard can be created. Such extensions may include: acoustic data Petition 870250094130, dated 10 / 15 / 2025, page 39 / 96 34 / 73 for audio support; interactivity data to support physics engines and efficient collision handling; lighting data; tactile data; and Augmented Reality anchor data for detecting and tracking features of the real environment, to name a few examples of extensions.

[0135] A single glTF file is capable of storing and transmitting multiple scene graphs through the scene arrangement property. For some modalities, for MPEG-I Scene Description (SD), each renderer / module-specific data can be assembled into a dedicated glTF scene. Visual data can be stored in the main glTF scene for visual rendering. However, as mentioned above, this approach, in some use cases, may require spatial and temporal consistency constraints between these scene graphs.

[0136] To ensure spatial and temporal consistency of all data, a scene description composed of a single shared node graph can be provided. However, a framework is lacking to generate (on the server side) and retrieve (on the client side) a single shared node graph containing all data from all renderers and compute modules / blocks for such an XR experience.

[0137] The application discusses, according to some embodiments, a structure that generates (on the server side) and retrieves (on the client side) a scene description based on a single node graph containing all the data for the renderers and compute modules needed for advanced XR experiences. A node graph relates to the geometry of a 3D object and can contain several representations of that object. These representations target a dedicated renderer / module / compute block. Target renderers can be, for example, audio, visual, or tactile renderers. Target compute blocks can, for example, simulate physics for realistic collision handling, lighting estimation Petition 870250094130, dated 10 / 15 / 2025, page 40 / 96 35 / 73 tion, interactivity event processing, AR anchor detection and tracking, and / or video processing. If the user's equipment, for example, is unable to render or compute some data, the client can delegate these unsupported capabilities to the network edge.

[0138] Figure 5 is an illustration showing an example of an XR use case with multiple renderers and computing modules / blocks, according to some embodiments. This application supports multiple use cases, as shown in Figure 5. Figures 4, 5, and 6 show examples of a complete VR experience that can be provided for a moving virtual car within a virtual environment. According to the examples, a user 502 can be equipped with HMD / VR glasses 504 to view the 3D virtual scene. The user can also use an immersive audio headset 506 to hear the car's engine 510. In addition, the user can use a dashboard controller 508 to drive the car 510. If a collision 512 occurs with a virtual tree (as shown on the right side of Figure 5), the user can hear the impact through the headphones and feel the tactile feedback as a vibration in the dashboard controller.

[0139] To support such an exemplary scenario, an XR server can generate visual, audio, physical, and tactile data in a scene graph in a spatially and temporally consistent manner. A scene description file can contain the scene graph transmitted over a network. A User Equipment (UE) device receives the scene description file and retrieves visual, audio, physical, and tactile data from the scene graph to feed the related renderers and compute modules / blocks. If the user equipment, for example, is unable to render or compute some of the data, delegation to the network edge can be requested for some modes. Generating a scene graph on an XR server. Petition 870250094130, dated 10 / 15 / 2025, page 41 / 96 36 / 73

[0140] Figure 6 is an illustration showing an example of various representations of a virtual tree targeted at various renderers / modules / computer blocks, according to some embodiments. As illustrated in Figures 4 to 6, some objects in the 3D scene may use different representations depending on the target renderer or computer block (e.g., module). For example, the car in Figure 4 may use a simplified geometry for audio source aspects, but a richer geometry for visual rendering. Another geometric representation is provided for interactivity calculations (such as collision detection). As another example, the tree in Figure 6 may use a simplified geometric primitive 606 associated with and supporting an acoustic material for audio rendering. For visual rendering of the tree, a richer geometry, such as a detailed mesh 602, may be used.For collision detection, a simplified geometric primitive can be used. For example, a 604 bounding box (as shown in the example in Figure 6) or a mesh can be used for collision detection associated with haptic feedback.

[0141] Figure 7 is a flowchart illustrating an exemplary process for generating a single shared scene graph, storing all XR data, according to some modalities. For some modalities, data can be inserted into the scene graph for each renderer / compute module / block, applying the following constraints. Data related to the entire scene is inserted starting with the top scene level. The graph can be traversed from top to bottom, starting with a specific root node and progressing to leaf nodes associated with that specific node. Data related to an entire object is inserted at the corresponding node level. Data related to specific object attributes is inserted at the component and subcomponent level of the corresponding node. For example, a mesh component can be inserted first at a component level, and a mesh material component can be inserted second. Petition 870250094130, dated 10 / 15 / 2025, p. 42 / 96 37 / 73 at a subcomponent level.

[0142] Flowchart 700 in Figure 7 executes a series of loops that progressively delve into the structure of a scene graph. The renderers / computer modules / computer blocks used for a 3D XR scene can be identified 702. A determination 704 is made regarding the number of renderers / computer modules / computer blocks remaining. If there are no more renderers / computer modules / computer blocks to be processed, the flowchart terminates. Otherwise, the data related to the current renderer / computer module / computer block is identified 706. A determination 708 is made regarding whether the data is global data for the scene. If the identified data is global scene data, the identified data is added 710 to a dedicated renderer / computer module / computer block structure at the scene level. A determination 712 is made regarding the existence of more nodes.If there are no more nodes to be processed, the flowchart returns to assess whether there are more renderers / compute modules / compute blocks to be processed. A 714 determination is made as to whether the current node has specific data. If specific data is available for the current node, the specific data is added 716 to the dedicated structure of the renderer / compute module / compute block at the node level related to the associated 3D object. A 718 determination is made as to whether there are more node components. If there are no more node components to be processed, the flowchart returns to assess whether there are more nodes to be processed. A 720 determination is made as to whether the current node component has specific data. If specific data is available for the current node component, the specific data is added 722 to the dedicated structure of the renderer / compute module / compute block at the node component level.The flowchart then returns to assess whether there are more node components to be processed. Petition 870250094130, dated 10 / 15 / 2025, page 43 / 96 38 / 73

[0143] A node or graph component corresponding to an object can contain various data types. Nodes and graph components provide a dedicated representation of an object to a renderer / module / computation block. For some embodiments, multiple versions of specific data can be stored. For example, a first renderer might use a first version of the specific data, and a second renderer might use a second version of the specific data. For example, the first version of the specific data might be a geometric mesh with a sparse level of detail, and the second version of the specific data might be a geometric mesh with a complex and highly detailed level of detail.

[0144] For some embodiments, one or more handlers may include one or more renderers. For some embodiments, one or more handlers may include one or more compute blocks. For some embodiments, one or more handlers may include one or more renderers and one or more compute blocks. For some embodiments, the term "renderer" may be substituted for the term "handler" and vice versa in this request. For some embodiments, the term "compute block" may be substituted for the term "handler" and vice versa in this request. For some embodiments, the term "compute module" may be substituted for the term "handler" and vice versa in this request. Retrieving data from a scene graph on a client

[0145] Figures 8A to 8B are flowcharts that illustrate an exemplary process for retrieving, on the client side, XR data from a shared scene graph, according to some modalities. Figures 8A and 8B show an exemplary process for retrieving data from a scene graph stored in a transmitted scene description file.

[0146] Flowchart 800 in Figures 8A and 8B executes a series of cycles that Petition 870250094130, dated 10 / 15 / 2025, p. 44 / 96 39 / 73 progressively delve into the scene graph structure. The renderers / computer modules / computer blocks used for a 3D XR scene can be identified and retrieved 802. A determination 804 is made as to whether there are more renderers / computer modules / computer blocks. If there are no more renderers / computer modules / computer blocks to be processed, the flowchart is terminated. Otherwise, global data is retrieved 806 from a dedicated renderer / computer module / computer block structure at the scene level. A determination 808 is made as to whether there are more nodes. If there are no more nodes to be processed, the flowchart progresses to connector "A" at the top of Figure 8B. Otherwise, 3D object data is retrieved 810 from the dedicated renderer / computer module / computer block structure at the node level. A determination 812 is made regarding the existence of more node components.If there are no more node components to be processed, the flowchart returns to assess whether there are more nodes to be processed. Otherwise, component data is retrieved 814 from the dedicated renderer / compute module / compute block structure at the node component level, and then the flowchart returns to determine 812 whether there are more node components. A determination 816 is made as to whether the renderer / compute module / compute block is supported by the user environment (UE). If the renderer / compute module / compute block is supported by the UE, the associated component, object, and / or global data are provided 818 to the current renderer / compute module / compute block, and then the flowchart returns to assess 804 whether there are more renderers / modules / blocks to be processed.Otherwise, the associated component, object, and / or global data may be sent to the network edge for rendering / computation delegation. A determination is made as to whether the delegation is accepted. If the delegation is accepted, the flowchart returns to evaluate whether they exist. Petition 870250094130, dated 10 / 15 / 2025, page 45 / 96 40 / 73 more renderers / modules / blocks to be processed. Otherwise, a determination 824 is made as to whether the renderer / module / block is required. If rendering / computation related to the component, object, and / or associated global data is not required, the UE may continue 826 with a degraded XR experience and return to evaluate 804 whether there are more renderers / modules / blocks to be processed. Otherwise, an error message may be sent 828 and the UE may interrupt 830 the XR data retrieval. For some modes, a delegation request summarizing unsupported compute renderers / blocks may be sent at the end of the XR data retrieval. For some modes, such a delegation request summarizes all compute renderers / blocks determined to be unsupported.

[0147] The scene description file can provide dedicated metadata to facilitate retrieval of the renderers / compute modules used and required for that XR experience. For example, glTF semantics provides dedicated "extensionsUsed" and "extensionsRequired" metadata (Figure 9A). The "extensionsRequired" metadata may be relevant for interrupting XR data retrieval in the event that no delegation for the related renderer / compute module has been found. The "extensionsUsed" metadata may be relevant for running the XR experience in a degraded operating mode without the related renderer / compute module / compute block. For example, running in a degraded operating mode may be due to, for example, (1) the user equipment not requesting a delegation or (2) no applicable renderer / compute module / compute block having been found.

[0148] For some modes, for each renderer / computer module / computer block, the data is retrieved from the scene graph. Petition 870250094130, dated 10 / 15 / 2025, page 46 / 96 41 / 73 applying the following constraints. Data related to the entire scene is retrieved starting with the top scene level. The graph can be traversed from top to bottom, starting with a specific root node and progressing to leaf nodes associated with that specific node. Data related to an entire object is retrieved at the corresponding node level. Data related to specific object attributes is retrieved at the component and subcomponent levels of the corresponding node. For example, a mesh component might be retrieved first at the component level, and a mesh material component might be retrieved second at the subcomponent level.

[0149] Once the data has been retrieved for a renderer / compute module / compute block, the user equipment can determine whether rendering / computing is done locally or delegated to the network edge. For some modes, such assessment is based on UE capabilities. Such assessment may correspond to step 8, as shown in section 6.3.4.2 of 3GPP TR26.998.

[0150] In the case of delegation, according to some exemplary modalities, the user equipment may provide, for example, the following 3 pieces of information to an Edge Application Server (EAS): (1) the content of the received scene description file, (2) which renderers / compute modules / compute blocks are not supported, and (3) the capabilities of the user equipment related to processing data from delegated renderers / compute modules / compute blocks.

[0151] For some modes, the indication of which renderers / computer modules are not supported may include user equipment capable of computing some trigger activations, but may not be able to support physical simulation for an interactivity compute module / computer block. Additionally, for some modes, the indication of which renderers / computer modules / computer blocks are not supported may include Petition 870250094130, dated 10 / 15 / 2025, page 47 / 96 42 / 73 a user device capable of supporting only a limited number of Augmented Reality anchor types (e.g., only those plane-sensing based AR anchor types). For some modes, indicating which renderers / compute modules are not supported may be an indication of which renderers / compute modules / compute blocks require complete or partial delegation.

[0152] In some embodiments, the indication of user equipment capabilities related to processing data from delegated renderers / computer modules / computer blocks may include user equipment with limited GPU capabilities, thus preventing 3D compositing and rendering. In this case, full scene rendering may be delegated to the network edge. The user equipment may provide 2D video decoding capabilities for receiving a rendered video stream.

[0153] In some embodiments, the user equipment may send, for example, the 3 pieces of information listed above (the contents of the received scene description file, which renderers / compute modules are not supported, and the capabilities of the user equipment related to processing data from renderers / compute modules / delegated compute blocks) to an Edge Application Server (EAS) in a separate file (e.g., a JSON, XML, or text file), in addition to the initial glTF file.

[0154] In some embodiments, the user equipment may generate a new scene description file, which may include: (1) the initial scene description file received by the user equipment, (2) dedicated metadata indicating which renderers / compute modules / compute blocks are not supported, and (3) dedicated metadata indicating the supported feature(s) and format(s). Petition 870250094130, dated 10 / 15 / 2025, page 48 / 96 43 / 73 data(s) in which the data resulting from the delegated computation / rendering / computation blocks can be sent by the Edge Application Server (EAS).

[0155] For some modes, dedicated metadata indicating which renderers / compute modules / compute blocks are not supported can be indicated in a glTF-based scene description, in which a new "extensionsUnsupported" section can be introduced at the glTF file level, in addition to the already existing "extensionsUsed" and "extensionsRequired" sections.

[0156] For some modes, dedicated metadata, which indicates the supported resource(s) and format(s) in which the resulting data from the delegated rendering / computing modules can be sent by the Edge Application Server (EAS), can be processed by the user equipment based on UE capabilities. For some modes, a supported resource can be associated with multiple supported formats, which can be defined and provided in an arrangement (in descending priority order, for example). Scene description file transmitted over a network

[0157] Figures 9A-9D are code listings for an exemplary scene description file related to the XR use case of Figure 4, according to some embodiments. A scene description file is detailed within the framework of the MPEG-I Scene Description (SD) framework, using Khronos' glTF extension mechanism to support additional scene description features.

[0158] As mentioned earlier, legacy glTF semantics (e.g., scene, node, mesh, ...) and associated data can be used by a visual renderer. In some embodiments, glTF extensions can be used to store other data types attached to the node graph to address renderers and additional computation modules / blocks, which may include, for example, (1) interactivity extensions for computing user / scene events and Petition 870250094130, dated 10 / 15 / 2025, page 49 / 96 44 / 73 scene / scene; (2) tactile extensions to provide data to the tactile renderer when a collision occurs; and (3) immersive audio extensions to provide data to the audio renderer.

[0159] In some embodiments, the interactivity extensions for computing user / scene and scene / scene events may include extensions described in application EP22305024, filed January 12, 2022; application EP22305197, filed February 23, 2022; application EP22305289, filed March 14, 2022; and application EP22305362, filed March 24, 2022, based on behavior objects composed of triggers and actions defined at the glTF scene level and dedicated trigger parameters at the glTF node level.

[0160] For example code listings 900, 920, 940, 960 of Figures 9A-9D, the scene-level MPEG scene interactivity structure indicates that a collision behavior between the car and the tree may include: (1) a collision trigger in which dedicated meshes (Figure 9D) have been referenced at the node level for the car and the tree; and (2) two actions to be initiated in parallel. The two actions may include: (1) a SET_HAPTIC action to produce a vibration and temperature feedback; and (2) a MEDIA action to produce a sound. Additionally, a car driving behavior may include: (1) a user input trigger; and (2) a MANIPULATE action to move the car based on a keyboard controller.

[0161] For some modes, tactile extensions can provide data to the tactile renderer when a collision occurs. For the example in Figures 9A-9D, references (in Figure 9C) to tactile signals for vibration and temperature are provided at the node level for the car and tree objects. Furthermore, for the example in Figures 9A-9D, dedicated tactile parameters to characterize vibration and temperature are provided in the tactile material extension (shown in Figure 9D) attached to the collider meshes of the car and tree. Petition 870250094130, dated 10 / 15 / 2025, page 50 / 96 45 / 73

[0162] For some modes, immersive audio extensions can provide data to the audio renderer. For the example in Figures 9A-9D, the structure of the MPEG immersive audio environment at the scene level (Figure 9B) indicates parameters applicable to the entire scene, such as, for example, an audio frequency, a 60 dB reverb time (RT60), a diffuse-direct ratio (DDR), a pre-delay time, or other parameters.

[0163] The audio source data is attached (in Figure 9C) to the node related to the car engine. Additionally, there is a reference to the accessor for retrieving the audio signal (in Figure 9C), to the audio source type (here, Higher Order Ambisonics - HOA) (in Figure 9C), and to the spatial extent geometry perceived by the listener in an elevation-azimuth sector (also in Figure 9C). The audio listener data is attached (in Figure 9C) to the node that has a camera and represents the user's representation in the XR experience.

[0164] The acoustic data of an object are entered at its related node level (tree node in Figure 9C) by referencing a mesh geometry accessor (here 0, indicating the first mesh). Then, the data are provided (in Figure 9D) at the mesh level within an acoustic material property. For each frequency provided, a specular reflected energy (reflection in a distinct output direction), a diffuse reflected energy (redispersion), an energy transmitted through the mesh geometry without altering the direction of the sound, and a coupled energy (vibration in the structure that is re-emitted throughout the structure) are defined. For some embodiments, the tree acoustic data are provided at the mesh level. In some embodiments, the tree acoustic data may be provided at the primitive mesh level.

[0165] The MPEG-I Scene Description is based on the Khronos glTF format. The new semantics, as explained in this application, are implemented through the mechanism of Petition 870250094130, dated 10 / 15 / 2025, page 51 / 96 46 / 73 extension of the Khronos vendor, as shown in Figures 9A-9D. As a result, a single scene graph can support, for example, the audio / acoustic data defined in the EIF scene description format and the other data types (which include visual, interactivity, and tactile data) defined in the MPEG I Scene Description (SD). Figure 7 shows an example of how such a file can be generated, and Figures 8A-8B show an example of how such a file can be decompressed and used by an XR client.

[0166] Furthermore, this application describes how to provide different representations of scene objects targeting various renderers / computer modules / computer blocks within a scene graph structure. This application also describes how to delegate based on the capabilities of the user's hardware.

[0167] Figure 10 is a listing of codes for example mappings of delegated renderers / computer modules according to some modalities. In the case of a glTF-based scene description, the mapping between the resource and the supported format(s) and the related delegated renderers / computer modules can be provided in the new "extensionsUnsupported" section, as shown in code listing 1000 of Figure 10.

[0168] The following two use cases are illustrated in Figure 10: (1) when 3D mesh and Physically Based Rendering (PBR) material are not supported, leading to delegation of visual rendering to an Edge Application Server (EAS); and (2) when collision handling is not supported, which may lead to delegation of scene interactivity computation (including, for example, collision and physics simulation) to an Edge Application Server (EAS).

[0169] For some modes, when 3D mesh and Physically Based Rendering (PBR) material are not supported, leading to delegation of visual rendering to the Edge Application Server, the supported feature is the Petition 870250094130, dated 10 / 15 / 2025, page 52 / 96 47 / 73 decoding of a 2D video corresponding to the rendered stream; and the supported 2D video format must be H.264 or HEVC to be successfully processed by the user's equipment.

[0170] For some modes, when collision handling is not supported, leading to the delegation of scene interactivity computation (including, for example, collision and physics simulation) to the Edge Application Server, the supported feature is 3D scene composition; and the pose of each 3D object emitted from the delegated interactivity computation (including, for example, collision and physics simulation) must be expressed in OpenXR pose format to be processed by the user's hardware for subsequent rendering (such as visual rendering).

[0171] The structure of the Khronos OpenXR XrPosef format, described in OpenXR Specification, Khronos OpenXR Working Group (Version 1.0.27), available in registry <dot>chronos <dot>org / openxr / specs / 1.0 / html / xrspec <dot>html#XrPsoef, is composed of a quaternion for orientation and a vector3 for position.

[0172] For some embodiments, the detection of the ideas presented in this application may be done by means of the use of dedicated semantics in the MPEG-I SD standard and / or by the detection of the call flow / function related to the capabilities of the User Equipment (UE) based on EDGAR in the 3GPP SA4 specification.

[0173] Figure 11 is a flowchart illustrating an exemplary process for generating a single shared scene graph according to some modalities. For some modalities, an exemplary process 1100 may include obtaining information 1102 indicating interaction with one or more handlers used in processing a three-dimensional (3D) scene. Some modalities of the exemplary process may further include identifying handler data 1104, object data, and component data associated with at least one respective handler. Petition 870250094130, dated 10 / 15 / 2025, p. 53 / 96 48 / 73 of one or more renderers used. For some embodiments, the exemplary process may further include, in response to the determination that handler data 1106 is global scene data, adding, at the scene level, handler data to a dedicated structure for the respective handler. Some embodiments of the exemplary process may further include adding, at the node level, object data for at least one node associated with the respective handler to the dedicated structure for the respective handler. For some embodiments, the exemplary process may further include adding, at the component level, component data for at least one component associated with the respective node to the dedicated structure for the respective handler.

[0174] Although the methods and systems according to some modalities are generally discussed in the context of extended reality (XR), some modalities can be applied to any XR context, such as, for example, virtual reality (VR) / mixed reality (MR) / augmented reality (AR) contexts. Furthermore, although the term "virtual reality headset (HMD)" is used here according to some modalities, some modalities can be applied to a wearable device (which may or may not be head-mounted) capable of, for example, XR, VR, AR and / or MR for some modalities.

[0175] A first illustrative method according to some embodiments may include: obtaining information indicating interaction with one or more renderers used in rendering a three-dimensional (3D) scene; identifying renderer data, object data, and component data associated with at least one respective renderer of one or more renderers used; in response to the determination that renderer data is global scene data, adding, at scene level, renderer data to a structure dedicated to the respective renderer; adding, at node level, for at least one node associated with the respective renderer, object data to the structure dedicated to the respective renderer; and Petition 870250094130, dated 10 / 15 / 2025, page 54 / 96 49 / 73 Add, at the component level, for at least one component associated with the respective node, component data to the structure dedicated to the respective renderer.

[0176] For some embodiments of the first exemplary method, one or more renderers are selected from the group consisting of video-related renderers, audio-related renderers, and tactile-related renderers.

[0177] For some embodiments of the first exemplary method, one or more renderers are selected from the group consisting of video-related renderers, audio-related renderers, tactile-related renderers, geometry-related renderers, texture-related renderers, camera-related renderers, animation-related renderers, physics-related renderers, and lighting-related renderers.

[0178] For some embodiments of the first exemplary method, at least two renderers are used in rendering the 3D scene, and at least two categories of renderers are selected from the group consisting of video-related renderers, audio-related renderers, tactile-related renderers, geometry-related renderers, texture-related renderers, camera-related renderers, animation-related renderers, physics-related renderers, and lighting-related renderers.

[0179] For some forms of the first example method, at least one of the dedicated structures is compatible with a glTF format.

[0180] For some modes of the first exemplary method, at least one of the dedicated structures is compatible with an MPEG-I scene description format. Petition 870250094130, dated 10 / 15 / 2025, page 55 / 96 50 / 73

[0181] For some modalities of the first exemplary method, the dedicated structures are stored in a single file.

[0182] For some embodiments of the first exemplary method, the renderer data includes functionality support information.

[0183] For some embodiments of the first exemplary method, the supporting functionality information includes the renderer functionality required to render at least one component of an object.

[0184] For some embodiments of the first exemplary method, the component data for at least one component includes information indicating the ability to render the scene in a degraded mode without rendering at least one component.

[0185] A first exemplary apparatus, according to some embodiments, may include: a processor; and a non-transient computer-readable medium that stores operative instructions, when executed by the processor, to make the apparatus execute any of the methods listed above.

[0186] A second illustrative method, according to some embodiments, may include: obtaining information indicating the interaction with one or more renderers used in the rendering of a three-dimensional (3D) scene; identifying renderer data, object data, and component data associated with at least one respective renderer of one or more renderers used; obtaining, at scene level, renderer data from a structure dedicated to the respective renderer; obtaining, at node level, for at least one node associated with the respective renderer, object data from the structure dedicated to the respective renderer; obtaining, at component level, for at least one component associated with the respective node, component data from the structure dedicated to the respective renderer; and determining the renderer support for the respective renderer. Petition 870250094130, dated 10 / 15 / 2025, page 56 / 96 51 / 73

[0187] For some embodiments of the second exemplary method, determining renderer support includes: verifying that the user equipment (UE) supports the respective renderer; obtaining render data associated with the respective renderer; and rendering at least one component associated with the render data.

[0188] For some embodiments of the second exemplary method, determining renderer support includes: determining whether the user equipment (UE) does not support the respective renderer; sending rendering data associated with the respective renderer to an edge server; and verifying whether the edge server has accepted the delegation of rendering data.

[0189] For some embodiments of the second exemplary method, determining renderer support includes: determining whether the user equipment (UE) does not support the respective renderer; sending render data associated with the respective renderer to an edge server; determining whether the edge server refused to delegate the render data; and in response to the determination that rendering the render data is not required, continuing to use the 3D scene without rendering the render data.

[0190] For some embodiments of the second exemplary method, determining renderer support includes: determining whether the user equipment (UE) does not support the respective renderer; sending render data associated with the respective renderer to an edge server; determining whether the edge server refused to delegate the render data; and in response to the determination that rendering the render data is required, generating an error message; and stopping the use of the 3D scene without rendering the render data.

[0191] For some modalities of the second exemplary method, one or Petition 870250094130, dated 10 / 15 / 2025, page 57 / 96 52 / 73 more renderers are selected from the group consisting of video-related renderers, audio-related renderers, and haptic feedback-related renderers.

[0192] For some embodiments of the second exemplary method, one or more renderers are selected from the group consisting of video-related renderers, audio-related renderers, tactile-related renderers, geometry-related renderers, texture-related renderers, camera-related renderers, animation-related renderers, physics-related renderers, and lighting-related renderers.

[0193] For some embodiments of the second exemplary method, at least two renderers are used in rendering the 3D scene, and at least two categories of renderers are selected from the group consisting of video-related renderers, audio-related renderers, tactile-related renderers, geometry-related renderers, texture-related renderers, camera-related renderers, animation-related renderers, physics-related renderers, and lighting-related renderers.

[0194] For some modalities of the second exemplary method, at least one of the dedicated structures is compatible with a glTF format.

[0195] For some modalities of the second exemplary method, at least one of the dedicated structures is compatible with an MPEG-I scene description format.

[0196] For some modalities of the second exemplary method, the dedicated structures are stored in a single file.

[0197] A second exemplary device, according to some model Petition 870250094130, of 10 / 15 / 2025, page 58 / 96 53 / 73 properties, may include: a processor; and a non-transient, computer-readable medium that stores operating instructions, when executed by the processor, to make the device perform any of the methods listed above.

[0198] A third illustrative method, according to some embodiments, may include: obtaining information indicating interaction with one or more compute blocks used in the generation of a three-dimensional (3D) scene; identifying compute block data, object data, and component data associated with at least one respective compute block of one or more compute blocks used; in response to the determination that compute block data are global scene data; adding, at scene level, compute block data to a structure dedicated to the respective compute block; adding, at node level, for at least one node associated with the respective compute block, object data to the structure dedicated to the respective compute block; and adding, at component level, for at least one component associated with the respective node, component data to the structure dedicated to the respective compute block.

[0199] For some embodiments of the third exemplary method, one or more computation blocks are selected from the group consisting of computation blocks related to video, computation blocks related to audio, computation blocks related to tactile sensation, computation blocks related to geometry, computation blocks related to texture, computation blocks related to camera, computation blocks related to animation, computation blocks related to physics, and computation blocks related to lighting.

[0200] For some embodiments of the third exemplary method, at least two computation blocks are used in the execution of a computation related to the 3D scene, and at least two categories of computation blocks are Petition 870250094130, dated 10 / 15 / 2025, page 59 / 96 54 / 73 selected from the group consisting of video-related computing blocks, audio-related computing blocks, tactile-related computing blocks, geometry-related computing blocks, texture-related computing blocks, camera-related computing blocks, animation-related computing blocks, physics-related computing blocks, and lighting-related computing blocks.

[0201] For some forms of the third exemplifying method, at least one of the dedicated structures is compatible with a glTF format.

[0202] For some modalities of the third exemplary method, at least one of the dedicated structures is compatible with an MPEG-I scene description format.

[0203] For some modalities of the third exemplary method, the dedicated structures are stored in a single file.

[0204] For some embodiments of the third exemplary method, the computation block data includes functionality support information.

[0205] For some embodiments of the third exemplary method, the supporting functionality information includes the computation block functionality required to perform a calculation for at least one component of an object.

[0206] For some embodiments of the third exemplary method, the component data for at least one component includes information indicating the ability to generate the scene in a degraded mode without performing a calculation related to at least one component.

[0207] A third exemplary apparatus, according to some embodiments, may include: a processor; and a non-transient computer-readable medium that stores operative instructions, when executed by the processor, to make the apparatus execute any of the methods listed above. Petition 870250094130, dated 10 / 15 / 2025, p. 60 / 96 55 / 73

[0208] A fourth exemplary method, according to some embodiments, may include: obtaining information indicating interaction with one or more computing blocks used in the generation of a three-dimensional (3D) scene; identifying computing block data, object data, and component data associated with at least one respective computing block of one or more computing blocks used; obtaining, at scene level, computing block data from a structure dedicated to the respective computing block; obtaining, at node level, for at least one node associated with the respective computing block, object data from the structure dedicated to the respective computing block; obtaining, at component level, for at least one component associated with the respective node, component data from the structure dedicated to the respective computing block; and determining the computing block support for the respective computing block.

[0209] For some embodiments of the fourth exemplary method, determining compute block support includes: verifying whether the user equipment (UE) supports the respective compute block; obtaining compute block data associated with the respective compute block; and computing a calculation related to at least one component associated with the compute block data.

[0210] For some embodiments of the fourth exemplary method, determining compute block support includes: determining whether the user equipment (UE) does not support the respective compute block; sending compute block data associated with the respective compute block to an edge server; and verifying whether the edge server has accepted the delegation of compute block data.

[0211] For some embodiments of the fourth exemplary method, determining compute block support includes: determining whether the user equipment (UE) does not support the respective compute block; sending, to a server of Petition 870250094130, dated 10 / 15 / 2025, pp. 61 / 96 56 / 73 edge, compute block data associated with the respective compute block; determine if the edge server refused delegation of compute block data; and, in response to the determination that performing a calculation related to compute block data is not necessary, continue using the 3D scene without performing the calculation related to a component.

[0212] For some embodiments of the fourth exemplary method, determining compute block support includes: determining whether the user equipment (UE) does not support the respective compute block; sending compute block data associated with the respective compute block to an edge server; determining whether the edge server refused delegation of the compute block data; and, in response to the determination that computation of the compute block data is required, generating an error message; and stopping the use of the 3D scene without performing the calculation related to a component.

[0213] For some modalities of the fourth exemplary method, one or more computation blocks are selected from the group consisting of computation blocks related to video, computation blocks related to audio, computation blocks related to tactile sensation, computation blocks related to geometry, computation blocks related to texture, computation blocks related to camera, computation blocks related to animation, computation blocks related to physics, and computation blocks related to lighting.

[0214] For some modalities of the fourth exemplary method, at least two computation blocks are used in the generation of the 3D scene, and at least two categories of computation blocks are selected from the group consisting of computation blocks related to video, computation blocks related to audio, computation blocks related to tactile sensation, computation blocks related to geometry, computation blocks related to texture, Petition 870250094130, dated 10 / 15 / 2025, pp. 62 / 96 57 / 73 camera-related computing blocks, animation-related computing blocks, physics-related computing blocks, and lighting-related computing blocks.

[0215] For some forms of the fourth exemplary method, at least one of the dedicated structures is compatible with the glTF format.

[0216] For some modes of the fourth exemplary method, at least one of the dedicated structures is compatible with the MPEG-I scene description format.

[0217] For some modalities of the fourth exemplary method, the dedicated structures are stored in a single file.

[0218] For some embodiments of the fourth exemplary method, the single file includes two or more versions of object data.

[0219] For some embodiments of the fourth exemplary method, the single file includes two or more versions of component data.

[0220] For some embodiments of the fourth exemplary method, at least two computation blocks are used in the generation of the 3D scene, the first and second categories of computation blocks are selected from the group consisting of computation blocks related to video, computation blocks related to audio, computation blocks related to tactile feel, computation blocks related to geometry, computation blocks related to texture, computation blocks related to camera, computation blocks related to animation, computation blocks related to physics and computation blocks related to lighting, the first category is different from the second category, the single file includes the first and second versions of object data, the first version of the object data is associated with the first category of computation blocks, and the second version of the object data is associated with the second category of computation blocks. Petition 870250094130, dated 10 / 15 / 2025, p. 63 / 96 58 / 73

[0221] For some embodiments of the fourth exemplary method, at least two computation blocks are used in the generation of the 3D scene, the first and second categories of computation blocks are selected from the group consisting of computation blocks related to video, computation blocks related to audio, computation blocks related to tactile sensation, computation blocks related to geometry, computation blocks related to texture, computation blocks related to camera, computation blocks related to animation, computation blocks related to physics and computation blocks related to lighting, the first category is different from the second category, the single file includes the first and second versions of the component data, the first version of the component data is associated with the first category of computation blocks, and the second version of the component data is associated with the second category of computation blocks.

[0222] A fourth exemplary apparatus, according to some embodiments, may include: a processor; and a non-transient computer-readable medium that stores operative instructions, when executed by the processor, to make the apparatus execute any of the methods listed above.

[0223] A fifth illustrative method, according to some embodiments, may include: obtaining information indicating interaction with one or more handlers used in the processing of a three-dimensional (3D) scene; identifying handler data, object data, and component data associated with at least one respective handler of one or more handlers used; obtaining, at scene level, handler data from a structure dedicated to the respective handler; obtaining, at node level, for at least one node associated with the respective handler, object data from the structure dedicated to the respective handler; obtaining, at component level, for at least one associated component Petition 870250094130, dated 10 / 15 / 2025, pp. 64 / 96 59 / 73 to the respective node, component data from the dedicated structure for the respective handler; and determine the handler support for the respective handler.

[0224] For some embodiments of the fifth exemplary method, one or more handlers include one or more renderers.

[0225] For some embodiments of the fifth exemplary method, one or more manipulators include one or more computation blocks.

[0226] For some embodiments of the fifth exemplary method, one or more handlers include one or more renderers and one or more computation blocks.

[0227] A sixth exemplary method, according to some embodiments, may include: obtaining information indicating interaction with a handler used in the processing of a three-dimensional (3D) scene; obtaining handler data, object data, and component data from a structure dedicated to the handler; determining the handler support for the handler; and, in response to the determination that the handler support indicates local support, processing, through the handler, at least one of the handler data, object data, and component data.

[0228] A seventh exemplary method, according to some embodiments, may include: obtaining information indicating interaction with a handler used in the processing of a three-dimensional (3D) scene; obtaining handler data, object data, and component data from a structure dedicated to the handler; determining the handler support for the handler; and in response to the determination that the handler support indicates delegation, sending, to a delegation device, at least one of the handler data, object data, and component data. Petition 870250094130, dated 10 / 15 / 2025, pp. 65 / 96 60 / 73

[0229] An eighth exemplary method, according to some embodiments, may include: obtaining information indicating interaction with one or more handlers used in the processing of a three-dimensional (3D) scene; identifying handler data, object data, and component data associated with at least one respective handler from one or more handlers used; in response to the determination that handler data is global scene data, adding, at scene level, handler data to a structure dedicated to the respective handler; adding, at node level, for at least one node associated with the respective renderer, object data to the structure dedicated to the respective handler; and adding, at component level, for at least one component associated with the respective node, component data to the structure dedicated to the respective handler.

[0230] For some embodiments of the eighth exemplary method, one or more handlers include one or more renderers.

[0231] For some embodiments of the eighth exemplary method, one or more manipulators include one or more computation blocks.

[0232] For some embodiments of the eighth exemplary method, one or more handlers include one or more renderers and one or more compute blocks.

[0233] A ninth exemplary method, according to some embodiments, may include: obtaining information corresponding to a scene description associated with a single node graph; and adding, to a dedicated structure, renderer data, object data, and component data associated with each of at least two respective renderers, wherein the dedicated structure comprises two or more representations of an object in a scene associated with the scene description. Petition 870250094130, dated 10 / 15 / 2025, pp. 66 / 96 61 / 73

[0234] For some modalities of the ninth exemplary method, the dedicated structure is compatible with the glTF format.

[0235] For some modes of the ninth exemplary method, the dedicated structure is compatible with the MPEG-I scene description format.

[0236] For some modalities of the ninth exemplary method, the dedicated structure is stored in a single file.

[0237] For some embodiments of the ninth exemplary method, at least one of the two or more representations of the object comprises mesh geometries of the object.

[0238] For some embodiments of the ninth exemplary method, the dedicated structure comprises a data memory structure.

[0239] A ninth example of an apparatus, according to some embodiments, may include: a processor; and a non-transient computer-readable medium that stores operative instructions, when executed by the processor, to make the apparatus execute any of the methods listed above.

[0240] An exemplary method, according to some embodiments, may include: obtaining information indicating interaction with one or more renderers used in rendering a three-dimensional (3D) scene; identifying renderer data, object data, and component data associated with at least one respective renderer of one or more renderers used; in response to the determination that renderer data is global scene data; adding, at scene level, renderer data to a dedicated structure for the respective renderer; adding, at node level, for at least one node associated with the respective renderer, object data to the dedicated structure for the respective renderer; and adding, at component level, for at least one component associated with the respective node, component data to the dedicated structure for the respective renderer. Petition 870250094130, dated 10 / 15 / 2025, pp. 67 / 96 62 / 73

[0241] For some embodiments of the exemplary method, one or more renderers are selected from the group consisting of video-related renderers, audio-related renderers, and tactile-related renderers.

[0242] For some embodiments of the exemplary method, one or more renderers are selected from the group consisting of video-related renderers, audio-related renderers, tactile-related renderers, geometry-related renderers, texture-related renderers, camera-related renderers, animation-related renderers, physics-related renderers, and lighting-related renderers.

[0243] For some embodiments of the exemplary method, at least two renderers are used in rendering the 3D scene, and at least two categories of renderers are selected from the group consisting of video-related renderers, audio-related renderers, tactile-related renderers, geometry-related renderers, texture-related renderers, camera-related renderers, animation-related renderers, physics-related renderers, and lighting-related renderers.

[0244] For some modalities of the exemplary method, at least one of the dedicated structures is compatible with a glTF format.

[0245] For some modalities of the exemplary method, at least one of the dedicated structures is compatible with an MPEG-I scene description format.

[0246] For some modalities of the exemplary method, the dedicated structures are stored in a single file.

[0247] For some modalities of the exemplary method, the data of Petition 870250094130, dated 10 / 15 / 2025, pp. 68 / 96 63 / 73 renderer includes functionality support information.

[0248] For some embodiments of the exemplary method, the supporting functionality information includes the renderer functionality required to render at least one component of an object.

[0249] For some embodiments of the exemplary method, the component data for at least one component includes information indicating the ability to render the scene in a degraded mode without rendering at least one component.

[0250] An exemplary apparatus according to some embodiments may include: a processor; and a non-transient computer-readable medium that stores operative instructions, when executed by the processor, to make the apparatus execute any of the methods listed above.

[0251] An additional illustrative method, according to some embodiments, may include: obtaining information indicating interaction with one or more renderers used in rendering a three-dimensional (3D) scene; obtaining, at scene level, renderer data from a structure dedicated to the respective renderer; obtaining, at node level, for at least one node associated with the respective renderer, object data from the structure dedicated to the respective renderer; obtaining, at component level, for at least one component associated with the respective node, component data from the structure dedicated to the respective renderer; and determining renderer support for at least one of one or more renderers.

[0252] For some embodiments of the additional exemplary method, determining renderer support may include: verifying that the user equipment (UE) supports the respective renderer; obtaining render data associated with the respective renderer; and rendering at least one component associated with the render data. Petition 870250094130, dated 10 / 15 / 2025, pp. 69 / 96 64 / 73

[0253] For some embodiments of the additional exemplary method, determining renderer support may include: determining whether the user equipment (UE) does not support the respective renderer; sending rendering data associated with the respective renderer to an edge server; and verifying whether the edge server has accepted the delegation of rendering data.

[0254] For some embodiments of the additional exemplary method, determining renderer support may include: determining whether the user equipment (UE) does not support the respective renderer; sending render data associated with the respective renderer to an edge server; determining whether the edge server has refused to delegate the render data; and in response to the determination that rendering the render data is not required, continuing to use the 3D scene without rendering the render data.

[0255] For some embodiments of the additional exemplary method, determining renderer support may include: determining whether the user equipment (UE) does not support the respective renderer; sending render data associated with the respective renderer to an edge server; determining whether the edge server refused to delegate the render data; and in response to the determination that rendering of the render data is required, generating an error message; and stopping the use of the 3D scene without rendering the render data.

[0256] For some embodiments of the additional exemplary method, one or more renderers are selected from the group consisting of video-related renderers, audio-related renderers, and tactile-related renderers.

[0257] For some embodiments of the additional exemplary method, one or more renderers are selected from the group consisting of rendered Petition 870250094130, dated 10 / 15 / 2025, pp. 70 / 96 65 / 73 renderers related to video, audio-related renderers, haptic-related renderers, geometry-related renderers, texture-related renderers, camera-related renderers, animation-related renderers, physics-related renderers, and lighting-related renderers.

[0258] For some embodiments of the additional exemplary method, at least two renderers are used in rendering the 3D scene, and at least two categories of renderers are selected from the group consisting of video-related renderers, audio-related renderers, tactile-related renderers, geometry-related renderers, texture-related renderers, camera-related renderers, animation-related renderers, physics-related renderers, and lighting-related renderers.

[0259] For some forms of the additional exemplary method, at least one of the dedicated structures is compatible with a glTF format.

[0260] For some modes of the additional exemplary method, at least one of the dedicated structures is compatible with an MPEG-I scene description format.

[0261] For some embodiments of the additional exemplary method, the dedicated structures are stored in a single file.

[0262] A further exemplary apparatus according to some embodiments may include: a processor; and a non-transient computer-readable medium that stores operative instructions, when executed by the processor, to make the apparatus execute any of the methods listed above.

[0263] An additional illustrative method, according to some embodiments, may include: obtaining information indicating interaction with one or more computing blocks used in the generation of a three-dimensional (3D) scene; identifying data from Petition 870250094130, dated 10 / 15 / 2025, pp. 71 / 96 66 / 73 compute block, object data, and component data associated with at least one respective compute block of one or more compute blocks used; in response to the determination that compute block data is global scene data; add, at scene level, compute block data to a dedicated structure for the respective compute block; add, at node level, for at least one node associated with the respective compute block, object data to the dedicated structure for the respective compute block; and add, at component level, for at least one component associated with the respective node, component data to the dedicated structure for the respective compute block.

[0264] For some embodiments of the additional exemplary method, one or more computation blocks are selected from the group consisting of computation blocks related to video, computation blocks related to audio, computation blocks related to tactile sensation, computation blocks related to geometry, computation blocks related to texture, computation blocks related to camera, computation blocks related to animation, computation blocks related to physics, and computation blocks related to lighting.

[0265] For some embodiments of the additional exemplary method, at least two computation blocks are used in performing a computation related to the 3D scene, and at least two categories of computation blocks are selected from the group consisting of computation blocks related to video, computation blocks related to audio, computation blocks related to tactile feel, computation blocks related to geometry, computation blocks related to texture, computation blocks related to camera, computation blocks related to animation, computation blocks related to physics, and computation blocks related to lighting. Petition 870250094130, dated 10 / 15 / 2025, pp. 72 / 96 67 / 73

[0266] For some forms of the additional exemplary method, at least one of the dedicated structures is compatible with a glTF format.

[0267] For some modes of the additional exemplary method, at least one of the dedicated structures is compatible with an MPEG-I scene description format.

[0268] For some embodiments of the additional exemplary method, the dedicated structures are stored in a single file.

[0269] For some embodiments of the additional exemplary method, the computation block data includes functionality support information.

[0270] For some embodiments of the additional exemplary method, the supporting functionality information includes the computation block functionality required to perform a calculation for at least one component of an object.

[0271] For some embodiments of the additional exemplary method, the component data for at least one component includes information indicating the ability to generate the scene in a degraded mode without performing a calculation related to at least one component.

[0272] A further exemplary apparatus according to some embodiments may include: a processor; and a non-transient computer-readable medium that stores operative instructions, when executed by the processor, to make the apparatus execute any of the methods listed above.

[0273] An additional illustrative method according to some embodiments may include: obtaining information indicating interaction with one or more computing blocks used in the generation of a three-dimensional (3D) scene; obtaining, at scene level, computing block data from a structure dedicated to the respective computing block; obtaining, at node level, for at least one associated node Petition 870250094130, dated 10 / 15 / 2025, pp. 73 / 96 68 / 73 associated with the respective computing block, object data from the structure dedicated to the respective computing block; obtain, at the component level, for at least one component associated with the respective node, component data from the structure dedicated to the respective computing block; and determine the computing block support for at least one of one or more computing blocks.

[0274] For some embodiments of the additional exemplary method, determining compute block support may include: verifying whether the user equipment (UE) supports the respective compute block; obtaining compute block data associated with the respective compute block; and computing a calculation related to at least one component associated with the compute block data.

[0275] For some embodiments of the additional exemplary method, determining compute block support may include: determining whether the user equipment (UE) does not support the respective compute block; sending compute block data associated with the respective compute block to an edge server; and verifying whether the edge server has accepted the delegation of compute block data.

[0276] For some embodiments of the additional exemplary method, determining compute block support may include: determining whether the user equipment (UE) does not support the respective compute block; sending compute block data associated with the respective compute block to an edge server; determining whether the edge server refused delegation of the compute block data; and, in response to the determination that performing a calculation related to the compute block data is not required, continuing to use the 3D scene without performing the calculation related to a component.

[0277] For some embodiments of the additional exemplary method, determining block computing support may include: determining whether the equipment Petition 870250094130, dated 10 / 15 / 2025, pp. 74 / 96 User 69 / 73 (UE) does not have support for the respective compute block; send compute block data associated with the respective compute block to an edge server; determine if the edge server refused delegation of compute block data; and, in response to the determination that computation of the compute block data is required, generate an error message; and stop using the 3D scene without performing the calculation related to a component.

[0278] For some embodiments of the additional exemplary method, one or more computation blocks are selected from the group consisting of computation blocks related to video, computation blocks related to audio, computation blocks related to tactile sensation, computation blocks related to geometry, computation blocks related to texture, computation blocks related to camera, computation blocks related to animation, computation blocks related to physics, and computation blocks related to lighting.

[0279] For some embodiments of the additional exemplary method, at least two computation blocks are used in the generation of the 3D scene, and at least two categories of computation blocks are selected from the group consisting of computation blocks related to video, computation blocks related to audio, computation blocks related to tactile feel, computation blocks related to geometry, computation blocks related to texture, computation blocks related to camera, computation blocks related to animation, computation blocks related to physics, and computation blocks related to lighting.

[0280] For some forms of the additional exemplary method, at least one of the dedicated structures is compatible with the glTF format.

[0281] For some modalities of the additional exemplary method, at least one of the dedicated structures is compatible with the description format of Petition 870250094130, dated 10 / 15 / 2025, pp. 75 / 96 70 / 73 scene MPEG-I.

[0282] For some embodiments of the additional exemplary method, the dedicated structures are stored in a single file.

[0283] For some embodiments of the additional exemplary method, the single file may include two or more versions of object data.

[0284] For some embodiments of the additional exemplary method, the single file may include two or more versions of component data.

[0285] For some embodiments of the additional exemplary method, at least two computation blocks are used in the generation of the 3D scene, the first and second categories of computation blocks are selected from the group consisting of computation blocks related to video, computation blocks related to audio, computation blocks related to tactile feel, computation blocks related to geometry, computation blocks related to texture, computation blocks related to camera, computation blocks related to animation, computation blocks related to physics and computation blocks related to lighting, the first category is different from the second category, the single file includes the first and second versions of object data, the first version of the object data is associated with the first category of computation blocks, and the second version of the object data is associated with the second category of computation blocks.

[0286] For some embodiments of the additional exemplary method, at least two computation blocks are used in the generation of the 3D scene, the first and second categories of computation blocks are selected from the group consisting of computation blocks related to video, computation blocks related to audio, computation blocks related to tactile sensation, computation blocks related to geometry, computation blocks related to texture, computation blocks related to camera, computation blocks related to Petition 870250094130, dated 10 / 15 / 2025, pp. 76 / 96 71 / 73 animation, physics-related computation blocks and lighting-related computation blocks, the first category is different from the second category, the single file includes the first and second versions of the component data, the first version of the component data is associated with the first category of computation blocks, and the second version of the component data is associated with the second category of computation blocks.

[0287] Another additional exemplary apparatus according to some embodiments may include: a processor; and a non-transient computer-readable medium that stores operative instructions, when executed by the processor, to make the apparatus execute any of the methods listed above.

[0288] Another illustrative method according to some modalities may include: obtaining information indicating interaction with one or more manipulators used in the processing of a three-dimensional (3D) scene; obtaining, at scene level, manipulator data from a structure dedicated to the respective manipulator; obtaining, at node level, for at least one node associated with the respective manipulator, object data from the structure dedicated to the respective manipulator; obtaining, at component level, for at least one component associated with the respective node, component data from the structure dedicated to the respective manipulator; and determining the manipulator support for at least one of one or more manipulators.

[0289] For some embodiments of the other exemplary method, one or more handlers may include one or more renderers.

[0290] For some embodiments of the other exemplary method, one or more handlers may include one or more computation blocks.

[0291] For some embodiments of the other exemplary method, one or more handlers include one or more renderers and one or more compute blocks. Petition 870250094130, dated 10 / 15 / 2025, pp. 77 / 96 72 / 73

[0292] Another illustrative method, according to some embodiments, may include: obtaining information indicating interaction with a handler used in the processing of a three-dimensional (3D) scene; obtaining handler data, object data, and component data from a structure dedicated to the handler; determining the handler support for the handler; and in response to the determination that the handler support indicates local support, processing, through the handler, at least one of the handler data, object data, and component data.

[0293] Yet another illustrative method, according to some embodiments, may include: obtaining information indicating interaction with a handler used in the processing of a three-dimensional (3D) scene; obtaining handler data, object data, and component data from a structure dedicated to the handler; determining the handler support for the handler; and in response to the determination that the handler support indicates delegation, sending, to a delegation device, at least one of the handler data, object data, and component data.

[0294] It is observed that several hardware elements of one or more of the embodiments described are referred to as "modules" that perform (i.e., execute, carry out, and the like) various functions described herein in conjunction with the respective modules. As used herein, a module includes hardware (e.g., one or more processors, one or more microprocessors, one or more microcontrollers, one or more microchips, one or more application-specific integrated circuits (ASICs), one or more field-programmable gate arrays (FPGAs), one or more memory devices) deemed suitable by those skilled in the art relevant to a particular implementation. Each described module may also include executable instructions to perform one or more functions described as being performed by the respective module, and it is important to emphasize that Petition 870250094130, dated 10 / 15 / 2025, pp. 78 / 96 73 / 73 These instructions may take the form of or include hardware instructions (i.e., wired), firmware instructions, software instructions and / or the like, and may be stored in any suitable non-transient computer-readable medium or media, as commonly known as RAM, ROM, etc.

[0295] Although resources and elements are described above in specific combinations, one skilled in the art will understand that each resource or element can be used in isolation or in any combination with the other resources and elements. Furthermore, the methods described herein can be implemented in a computer program, software, or firmware embedded in a computer-readable medium for execution by a computer or processor. Examples of computer-readable storage media include, but are not limited to, read-only memory (ROM), random-access memory (RAM), a register, cache memory, semiconductor memory devices, magnetic media such as internal hard disks and removable disks, magneto-optical media, and optical media such as CD-ROMs and digital versatile discs (DVDs).A processor, in conjunction with software, can be used to implement a radio frequency transceiver for use in a WTRU, UE, terminal, base station, RNC, or any host computer. Petition 870250094130, dated 10 / 15 / 2025, pp. 79 / 96< / dot> < / dot> < / dot> < / ponto> < / ponto> < / dot> < / dot> < / dot>

Claims

1 / 4 CLAIMS 1. A method, characterized in that it comprises: obtaining information indicating interaction with two or more manipulators used in the processing of a three-dimensional (3D) scene; identifying manipulator data, object data, and component data associated with at least one respective manipulator of two or more manipulators used; obtaining, at scene level, manipulator data from a structure dedicated to the respective manipulator; obtaining, at node level, for at least one node associated with the respective manipulator, object data from the structure dedicated to the respective manipulator; obtaining, at component level, for at least one component associated with the respective node, component data from the structure dedicated to the respective manipulator; and determining the manipulator support for the respective manipulator.

2. A method according to claim 1, characterized in that two or more handlers comprise one or more renderers.

3. A method according to claim 1, characterized in that two or more manipulators comprise one or more computing blocks.

4. A method according to claim 1, characterized in that two or more handlers comprise one or more renderers and one or more computing blocks.

5. A method, according to any one of claims 1 to 4, characterized in that the information and scene description are associated with a single node graph.

6. Method, according to claim 5, CHARACTERIZED by the fact that Petition 870250090845, dated 06 / 10 / 2025, page 67 / 70 2 / 4, determining handler support comprises: verifying whether the user equipment (UE) supports the respective handler; obtaining rendering data associated with the respective handler; and rendering at least one component associated with the rendering data.

7. Method, according to claim 5, CHARACTERIZED in that determining handler support comprises: determining whether the user equipment (UE) does not have support for the respective handler; sending rendering data associated with the respective handler to an edge server; and verifying whether the edge server has accepted the delegation of rendering data.

8. Method, according to claim 5, CHARACTERIZED in that determining handler support comprises: determining whether the user equipment (UE) does not support the respective handler; sending rendering data associated with the respective handler to an edge server; and determining whether the edge server rejected the delegation of rendering data; and in response to the determination that rendering the rendering data is not required, continuing to use the 3D scene without rendering the rendering data.

9. Method according to claim 5, CHARACTERIZED in that determining handler support comprises: determining whether the user equipment (UE) does not support the respective handler; Petition 870250090845, dated 06 / 10 / 2025, pp. 68 / 70 3 / 4 sending, to an edge server, rendering data associated with the respective handler; and determining whether the edge server rejected the delegation of rendering data; and in response to the determination that rendering of the rendering data is required, generating an error message; and stopping the use of the 3D scene without rendering the rendering data.

10. A method according to any one of claims 1 to 9, characterized in that two or more manipulators are selected from the group consisting of video-related manipulators, audio-related manipulators, and tactile sensation-related manipulators.

11. A method according to any one of claims 1 to 9, characterized in that two or more manipulators are selected from the group consisting of video-related manipulators, audio-related manipulators, tactile-sensitivity-related manipulators, geometry-related manipulators, texture-related manipulators, camera-related manipulators, animation-related manipulators, physics-related manipulators, and lighting-related manipulators.

12. A method, according to any one of claims 1 to 11, characterized in that at least one of the dedicated structures is compatible with a gITF format.

13. Method, according to any one of claims 1 to 11, CHARACTERIZED in that at least one of the dedicated structures is compatible with an MPEG-I scene description format.

14. Method, according to any one of claims 1 to 13, CHARACTERIZED in that the dedicated structures are stored in a single file. Petition 870250090845, dated 06 / 10 / 2025, pp. 69 / 70 4 / 4 15. Apparatus, CHARACTERIZED in that it comprises: a processor; and a non-transient, computer-readable medium that stores operating instructions, when executed by the processor, to make the apparatus execute the method according to any of claims 1 to 14. Petition 870250090845, dated 06 / 10 / 2025, p. 70 / 70

Images