Consistency between audio and visual scenes

By aligning acoustic and visual scene descriptions through parameter adjustments, the method addresses inconsistencies, enhancing the user's immersive media experience.

JP7595765B2Active Publication Date: 2024-12-06TENCENT AMERICA LLC
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023527786
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2022-09-14
Filing Date
2022-09-16
Publication Date
2024-12-06
Estimated Expiration
2042-09-16

AI Technical Summary

Technical Problem

Inconsistencies between acoustic and visual scenes during immersive media rendering degrade the user's experience due to mismatches in object size, shape, position, orientation, and material descriptions.

Method used

A method to align and modify acoustic and visual scene descriptions by adjusting parameters such as size, shape, position, orientation, and material to ensure consistency, using techniques like determining an integrated scene description based on both descriptions and generating signaling information for rendering.

Benefits of technology

Enhances the alignment of audio and visual scenes, improving the user's media experience by ensuring that audio rendering is consistent with visual expectations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007595765000001
    Figure 0007595765000001
  • Figure 0007595765000002
    Figure 0007595765000002
  • Figure 0007595765000003
    Figure 0007595765000003
Patent Text Reader

Abstract

Media content data for an object is received. It is determined whether a first parameter indicated by a first description of the object in the audio scene and a second parameter indicated by a second description of the object in the visual scene are inconsistent. In light of the inconsistency between the first parameter indicated by the first description of the object in the audio scene and the second parameter indicated by the second description of the object in the visual scene, one of the first description of the object in the audio scene and the second description of the object in the visual scene is modified based on the unmodified other of the first description and the second description, and the modified one of the first description and the second description is made consistent with the unmodified other of the first description and the second description.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The offline encoding / processing component (204) can process MPEG-I immersive audio streams. MPEG-H3D audio (206) can be the codec for all audio signals (e.g., (208)). Thus, the audio signals are all Suggested The AEP (200) may be common to the renderers (e.g., renderers A, B, and C). In the AEP (200), the audio signal may be "pre-coded," which may mean that the original audio signal may be encoded and then decoded using the MPEG-H3D audio (206), and these signals are fed to the Max / MSP (210) in the evaluation component (202) and to the individual max externals (or renderers). Still referring to FIG. 2, in the offline encoding / processing component (204), the data in the scene file (220) and the data in the directional file (222) may be processed by an MPEG-I processor (or compressor) (228). The processed data may be further sent to the Max / Msp (210). Furthermore, the data in the HRTF file (224) may be sent to the renderer of the Max / Msp (210), and the data in the model file / image file (226) may be sent to Unity (212) for processing.

[0002] If the object size of an object in the visual scene description differs from the object size of an object in the audio scene description, the object size of the object in the visual scene description may be modified based on the object size of the object in the audio scene description. For example, Vision The object size of the object in the scene description can be changed to be the same as the object size of the object in the audio scene description. [Background technology]

[0003] If the object shape of an object in the visual scene description differs from the object shape of the object in the audio scene description, the object shape of the object in the visual scene description may be modified based on the object shape of the object in the audio scene description. For example, Vision The object shape of the object in the scene description can be modified to be identical to the object shape of the object in the audio scene description.

[0004] If the object position of an object in the visual scene description differs from the object position of the object in the audio scene description, the object position of the object in the visual scene description may be modified based on the object position of the object in the audio scene description. For example, Vision The object positions of the objects in the scene description can be changed to be identical to the object positions of the objects in the audio scene description. Summary of the Invention [Means for solving the problem]

[0005] If the object orientation of an object in the visual scene description differs from the object orientation of the object in the audio scene description, the object orientation of the object in the visual scene description may be changed based on the object orientation of the object in the audio scene description. For example, Vision The object orientation of the object in the scene description can be changed to be the same as the object orientation of the object in the audio scene description.

[0006] If the object material of an object in the visual scene description differs from the object material of the object in the audio scene description, the object material of the object in the visual scene description can be modified based on the object material of the object in the audio scene description. For example: VisionThe object material of an object in the scene description can be changed to be identical to the object material of the object in the audio scene description.

[0007] In some embodiments, both the first parameter and the second parameter may be associated with one of an object size, an object shape, an object position, an object orientation and an object texture of the object.

[0008] One of the first description of the object in the audio scene and the second description of the object in the visual scene can be modified based on the other of the first description of the object in the audio scene and the second description of the object in the visual scene, such that a first parameter indicated by the first description of the object in the audio scene can be consistent with a second parameter indicated by the second description of the object in the visual scene.

[0009] In the method, a third description of the object in the integrated scene may be determined based on at least one of the first description of the object in the acoustic scene or the second description of the object in the visual scene. In response to the first parameter indicated by the first description of the object in the acoustic scene being different from the third parameter indicated by the third description of the object in the integrated scene, the first parameter indicated by the first description of the object in the acoustic scene may be modified based on the third parameter indicated by the third description of the object in the integrated scene. In response to the second parameter indicated by the second description of the object in the visual scene being different from the third parameter indicated by the third description of the object in the integrated scene, the second parameter indicated by the second description of the object in the visual scene may be modified based on the third parameter indicated by the third description of the object in the integrated scene.

[0010] In one example, an object size in the third description of the object in the integrated scene may be determined based on an object size in the first description of the object in the acoustic scene. An object size in the third description of the object in the integrated scene may be determined based on an object size in the second description of the object in the visual scene. An object size in the third description of the object in the integrated scene may be determined based on an intersection size of an intersection of an object in the first description of the object in the acoustic scene with an object in the second description of the object in the visual scene. An object size in the third description of the object in the integrated scene may be determined based on a size difference between an object size in the first description of the object in the acoustic scene and an object size in the second description of the object in the visual scene.

[0011] In one example, an object shape in the third description of the object in the integrated scene may be determined based on an object shape in the first description of the object in the acoustic scene. An object shape in the third description of the object in the integrated scene may be determined based on an object shape in the second description of the object in the visual scene. An object shape in the third description of the object in the integrated scene may be determined based on an intersection shape of an intersection of an object in the first description of the object in the acoustic scene with an object in the second description of the object in the visual scene. An object shape in the third description of the object in the integrated scene may be determined based on a shape difference between an object shape in the first description of the object in the acoustic scene and an object shape in the second description of the object in the visual scene.

[0012] In one example, an object position in the third description of the object in the integrated scene may be determined based on an object position in the first description of the object in the acoustic scene. An object position in the third description of the object in the integrated scene may be determined based on an object position in the second description of the object in the visual scene. An object position in the third description of the object in the integrated scene may be determined based on a position difference between an object position in the first description of the object in the acoustic scene and an object position in the second description of the object in the visual scene.

[0013] In one example, an object orientation in the third description of the object in the integrated scene may be determined based on an object orientation in the first description of the object in the acoustic scene. An object orientation in the third description of the object in the integrated scene may be determined based on an object orientation in the second description of the object in the visual scene. An object orientation in the third description of the object in the integrated scene may be determined based on a direction difference between an object orientation in the first description of the object in the acoustic scene and an object orientation in the second description of the object in the visual scene.

[0014] In one example, an object texture in the third description of the object in the integrated scene may be determined based on an object texture in the first description of the object in the audio scene. An object texture in the third description of the object in the integrated scene may be determined based on an object texture in the second description of the object in the visual scene. An object texture in the third description of the object in the integrated scene may be determined based on a texture difference between the object texture in the first description of the object in the audio scene and the object texture in the second description of the object in the visual scene.

[0015] In some embodiments, a description of an object in an anchor scene of the media content data may be determined based on one of a first description of an object in the audio scene and a second description of an object in the visual scene. In response to the description of the object in the anchor scene being determined based on the first description of the object in the audio scene, the second description of the object in the visual scene may be modified based on the first description of the object in the audio scene. In response to the description of the object in the anchor scene being determined based on the second description of the object in the visual scene, the first description of the object in the audio scene may be modified based on the second description of the object in the visual scene. Further, signaling information may be generated to indicate which of the first description of the object in the audio scene and the second description of the object in the visual scene is selected to determine the description of the anchor scene.

[0016] In some embodiments, signaling information may be generated to indicate which of a first parameter in a first description of an object in an acoustic scene and a second parameter in a second description of an object in a visual scene is selected to determine a third parameter in a third description of an object in an integrated scene.

[0017] According to another aspect of the present disclosure, an apparatus is provided, the apparatus including a processing circuit, the processing circuit may be configured to perform any of the methods for media processing.

[0018] Aspects of the present disclosure also provide a non-transitory computer-readable medium storing instructions that, when executed by a computer, cause the computer to perform any of the methods for media processing for video decoding.

[0019] Further features, nature and various advantages of the disclosed subject matter will become more apparent from the following detailed description and the accompanying drawings. [Brief description of the drawings]

[0020] [Figure 1] FIG. 1 illustrates an environment using six degrees of freedom (6 DoF) in some examples. [Diagram 2] FIG. 1 illustrates an MPEG-I immersive audio evaluation platform and process according to one embodiment of the present disclosure. [Diagram 3] FIG. 2 illustrates an exemplary acoustic scene of a test scene according to one embodiment of the present disclosure. [Figure 4] FIG. 2 illustrates an exemplary visual scene of a test scene from a Unity engine according to one embodiment of the present disclosure. [Diagram 5] FIG. 1 is a block diagram of a media system according to one embodiment of the present disclosure. [Figure 6] 1 is a flowchart outlining a process according to some embodiments of the present disclosure. [Figure 7] 1 is a schematic diagram of a computer system, according to one embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0021] The MPEG-I Immersive Media family of standards, including "Immersive Audio," "Immersive Video," and "System Support," can support a virtual reality (VR) or augmented reality (AR) presentation (100) in which a user (102) can move through and interact with an environment using six degrees of freedom (6 DoF), including spatial navigation (x, y, z) and the user's head orientation (yaw, pitch, roll), as shown, for example, in FIG. 1 .

[0022] The goal of an MPEG-I presentation is to give the user (e.g., (102)) the sense that he or she is actually present in the virtual world. Sounds within the world (or scene) can be perceived as being in the real world, with sounds derived from associated visual imagery; i.e., sounds can be perceived in the correct location and / or at the correct distance. The user's physical movements in the real world can be perceived as matching movements in the virtual world. Furthermore, and importantly, the user can interact with the virtual scene, producing sounds that are perceived as realistic, matching or otherwise simulating the user's experience in the real world.

[0023] The present disclosure relates to immersive media. When rendering immersive media, audio and visual scenes may show inconsistency, which may degrade a user's media experience. In the present disclosure, aspects are provided, including a method and an apparatus, for improving the consistency between audio and visual scenes.

[0024] In the MPEG-I Immersive Audio standard, the visual scene can be rendered by a first engine, such as the Unity engine, and the audio scene can be described by a second engine, which can be an audio engine, such as an MPEG-I Immersive Audio Encoder.

[0025] FIG. 2 is a block diagram of an exemplary MPEG-I Immersive Audio Evaluation Platform (AEP) (200). As shown in FIG. 2, the AEP (200) can include an evaluation component (202) and an offline encoding / processing component (204). The evaluation component (202) can include Unity (212) and Max / MSP (210). Unity is a cross-platform game engine that can be used to create 3D and 2D games, as well as interactive simulations and other experiences. Max / MSP, also known as Max or Max / MSP / Jitter, is a visual programming language for, for example, music and multimedia. Max is a platform that can house and connect a wide variety of tools for sound, graphics, music, and interactivity using a flexible patching and programming environment.

[0026] Unity (212) can display video on a head mounted display (HMD) (214). A head tracker in the HMD that responds to the positioning beacon can connect back to the Unity engine (212) and then transmit user position and orientation information to Max / MSP (210) via Unity extOSC messages. Max / MSP (210) can support multiple max externals running in parallel. In the AEP (200), each max external can be a candidate immersive audio decoding and rendering engine that runs in real time. For example, as shown in FIG. 2, Max / MSP (210) can include renderers A, B, and C that can run in parallel. Further in FIG. 2, the evaluation component (202) can include a compiler (216) configured to compile, for example, Python programs and communicate control and video data from controllers (218), such as smartphones and game controllers. The compiler (216) can also communicate with Max / MSP (210) via Unity extOSC messages.

[0027] In the offline encoding / processing component (204), MPEG-I immersive audio streams can be processed. MPEG-H3D Audio (206) can be the codec for all audio signals (e.g., (208)). Thus, the audio signals can be common to all proposer renderers (e.g., renderers A, B, and C). In the AEP (200), the audio signals can be "pre-coded," which can mean that the original audio signals can be encoded and then decoded using MPEG-H3D Audio (206), and these signals are fed to the Max / MSP (210) in the evaluation component (202) and to the individual max externals (or renderers). Still referring to FIG. 2, in the offline encoding / processing component (204), data in the scene file (220) and data in the directional file (222) can be processed by the MPEG-I processor (or compressor) (228). The processed data can be further sent to the Max / Msp (210). Additionally, the data in the HRTF file (224) can be sent to the Max / Msp (210) renderer, and the data in the model file / image file (226) can be sent to Unity (212) for processing.

[0028] For immersive media rendering, the audio scene and the visual scene can be described by different engines. For example, the audio scene can be described by the MPEG-I immersive audio encoder input format and the visual scene can be described from a Unity engine. If the audio scene and the visual scene are processed by two different engines or modules, it may happen that the audio scene and the visual scene are inconsistent.

[0029] Examples of mismatch between audio and visual scenes can be seen in Figures 3 and 4. Figure 3 shows an overview of the audio scene (300) of a test scene in the MPEG-I immersive audio standard. As seen in Figure 3, gaps (e.g. (302)) can exist between cubic wall elements (304). Sound diffraction and occlusion effects can be evaluated by a tester around the corners and edges of the wall elements (304).

[0030] FIG. 4 shows an overview of the visual scene (400) from the Unity engine for the same test scene of FIG. 3. As seen in FIG. 4, the walls can be rendered in stone shapes with almost no gaps between the wall elements (402). Such a mismatch can degrade the tester's (or user's) media experience, as the visible edges in the visual scene (400) rendered by Unity do not correspond to the edges of the acoustic shapes in the audio scene (300). In other words, the audio renderer can acoustically render the diffraction caused by the cubic wall elements in the audio scene (300), whereas the walls can exhibit a very different visual shape in the visual scene (400). The mismatch between the wall shapes in the visual scene and the wall shapes in the audio scene can confuse the tester, as the rendered audio behaves inconsistently with the visual expectations from the visual rendering.

[0031] Inconsistencies between the rendered audio and visual experiences can be caused by inconsistencies between the audio and visual scene descriptions. In this disclosure, methods are provided for improving the consistency of the audio and visual scene descriptions.

[0032] One or more parameters of an object (e.g., a wall element (304)) indicated by one of the description of the object in the audio scene and the description of the object in the visual scene may be modified according to one or more parameters of the object indicated by the other of the description of the object in the audio scene and the description of the object in the visual scene. The parameter of the object may be at least one of the object size, object shape, object position, object orientation, object texture (or object material), etc. of the object.

[0033] In some embodiments, the audio scene description (or description of the audio scene) can be altered (or modified) to be consistent with the visual scene description (or description of the visual scene), and audio rendering can be provided based on the altered (or modified) audio scene description.

[0034] For example, the audio scene description may be matched to the visual scene description, and if one or more inconsistencies, or possibly any inconsistencies, between the visual and audio scene descriptions are determined, the audio scene description may be modified to be consistent with the visual scene description. The inconsistencies may be determined, for example, based on one or more different parameters of the object and one or more thresholds.

[0035] If the object size of an object in the audio scene description differs from the object size of the object in the visual scene description, the object size of the object in the audio scene description may be changed (or modified) based on the object size of the object in the visual scene description. For example, the object size of the object in the audio scene description may be changed to be the same (or equal) as the object size of the object in the visual scene description. Thus, the object size of the object in the audio scene description may be consistent or more consistent with the object size of the object in the visual scene description.

[0036] If the object shape of an object in the audio scene description differs from the object shape of the object in the visual scene description, the object shape of the object in the audio scene description may be modified based on the object shape of the object in the visual scene description, for example, the object shape of the object in the audio scene description may be modified to be identical to the object shape of the object in the visual scene description.

[0037] If the object position of an object in the audio scene description differs from the object position of the object in the visual scene description, the object position of the object in the audio scene description may be modified based on the object position of the object in the visual scene description, for example, the object position of the object in the audio scene description may be modified to be the same as the object position of the object in the visual scene description.

[0038] If the object orientation of an object in the audio scene description differs from the object orientation of the object in the visual scene description, the object orientation of the object in the audio scene description may be modified based on the object orientation of the object in the visual scene description, for example, the object orientation of the object in the audio scene description may be modified to be the same as the object orientation of the object in the visual scene description.

[0039] If the object material of an object in the audio scene description differs from the object material of the object in the visual scene description, the object material of the object in the audio scene description may be modified based on the object material of the object in the visual scene description, e.g., the object material of the object in the audio scene description may be modified to be identical to the object material of the object in the visual scene description.

[0040] In some embodiments, the visual scene description may be modified to be consistent with the acoustic scene description, and if one or more inconsistencies, or possibly any inconsistencies, between the visual scene description and the acoustic scene description are determined, a visual rendering may be provided based on the modified visual scene description.

[0041] For example, the visual scene description can be matched with the audio scene description and the visual scene description can be modified to be consistent or more consistent with the audio scene description.

[0042] If the object size of an object in the visual scene description differs from the object size of the object in the audio scene description, the object size of the object in the visual scene description may be modified based on the object size of the object in the audio scene description, for example, the object size of the object in the audio scene description may be modified to be the same as the object size of the object in the audio scene description.

[0043] If the object shape of an object in the visual scene description differs from the object shape of the object in the audio scene description, the object shape of the object in the visual scene description may be modified based on the object shape of the object in the audio scene description, for example, the object shape of the object in the audio scene description may be modified to be identical to the object shape of the object in the audio scene description.

[0044] If the object position of an object in the visual scene description differs from the object position of the object in the audio scene description, the object position of the object in the visual scene description may be modified based on the object position of the object in the audio scene description, for example, the object position of the object in the audio scene description may be modified to be the same as the object position of the object in the audio scene description.

[0045] If the object orientation of an object in the visual scene description differs from the object orientation of the object in the audio scene description, the object orientation of the object in the visual scene description may be modified based on the object orientation of the object in the audio scene description, for example, the object orientation of the object in the audio scene description may be modified to be the same as the object orientation of the object in the audio scene description.

[0046] If the object material of an object in the visual scene description differs from the object material of the object in the audio scene description, the object material of the object in the visual scene description may be modified based on the object material of the object in the audio scene description, for example the object material of the object in the audio scene description may be modified to be identical to the object material of the object in the audio scene description.

[0047] In some embodiments, the audio scene description and the visual scene description can be merged or otherwise combined to generate a unified scene description. If the audio scene description differs from the unified scene description, the audio scene description can be modified based on or consistent with the unified scene description, and the audio rendering can apply the modified audio scene description. If the visual scene description differs from the unified scene description, the visual scene description can be modified based on or consistent with the unified scene description, and the visual rendering can apply the modified visual scene description.

[0048] In one embodiment, if the object size of an object in the audio scene description differs from the object size of the object in the visual scene description, the object size of the object in the integrated scene description may be, or may be based in another aspect on, one of: (1) the object size of the object in the audio scene description, (2) the object size of the object in the visual scene description, (3) the size of the intersection of the object in the audio scene description with the object in the visual scene description, or (4) a size based on the difference between the object size in the audio scene description and the object size in the visual scene description. In some examples, different weights may be applied to the sizes of objects in the audio scene description and the visual scene description.

[0049] In one embodiment, if the object shape of an object in the audio scene description differs from the object shape of the object in the visual scene description, the object shape in the integrated scene description may be one of, or may be based in another aspect on, (1) the object shape in the audio scene description, (2) the object shape in the visual scene description, (3) the shape of the intersection of the object in the audio scene description with the object in the visual scene description, or (4) a shape based on the difference between the object shape in the audio scene description and the object shape in the visual scene description. In some examples, different weights may be applied to the shapes of objects in the audio scene description and the visual scene description.

[0050] In one embodiment, if an object position of an object in the audio scene description differs from an object position of the object in the visual scene description, the object position of the object in the integrated scene description may be, or may be based in another aspect on, one of: (1) the object position in the audio scene description, (2) the object position in the visual scene description, or (3) a position based on the difference between the object position in the audio scene description and the object position in the visual scene description. In some examples, different weights may be applied to the object positions in the audio scene description and the visual scene description.

[0051] In one embodiment, if the object orientation of an object in the audio scene description differs from the object orientation of the object in the visual scene description, the object orientation in the integrated scene description may be one of, or may be based in another aspect on, (1) the object orientation in the audio scene description, (2) the object orientation in the visual scene description, or (3) an orientation based on the difference between the object orientation in the audio scene description and the object orientation in the visual scene description. In some examples, different weights may be applied to the object orientations of objects in the audio scene description and the visual scene description.

[0052] In one embodiment, if the object material (e.g., object texture, object composition, or object substance) of an object in the audio scene description differs from the object material of the object in the visual scene description, the object material in the integrated scene description may be one of, or may be otherwise based on, (1) the object material in the audio scene description, (2) the object material in the visual scene description, or (3) a material based on the difference between the object material in the audio scene description and the object material in the visual scene description. In some examples, different weights may be applied to the materials of objects in the audio scene description and the visual scene description.

[0053] In some embodiments, the anchor scene description can be determined (or selected) based on one of the visual scene description and the audio scene description. For example, the anchor scene can include anchors, which are objects that the AR software can recognize and apply to integrate the real world and the virtual world. The audio scene description can be modified to be consistent with the visual scene description, or the visual scene description can be modified to be consistent with the audio scene description. The visual or audio rendering can be further based on the selected (or determined) anchor scene description.

[0054] In one embodiment, an indication may be sent to the receiver (or client side) as part of the bitstream associated with the visual or audio data. The indication may indicate whether the anchor scene description is based on the visual scene description or the audio scene description. In another embodiment, such an indication may be sent as part of system level metadata.

[0055] In some embodiments, selection information such as a selection message can be signaled to the receiver (or client side). The selection message can indicate the manner in which the integrated scene description is generated. For example, the selection message can indicate whether the integrated scene description is determined by a visual scene and / or an audio scene (or an acoustic scene). Thus, according to the selection message, the integrated scene can be determined as, for example, one of a visual scene or an audio scene. In other words, in some examples, either a visual scene or an audio scene can be selected as the integrated scene. The visual rendering or the audio rendering can be based on the selected integrated scene description. The signaling information (e.g., the selection message) can be transmitted, for example, as part of a bitstream or as system-level metadata.

[0056] In one embodiment, the object size of an object in the integrated scene description may be signaled as originating from either a visual scene or an audio scene, and thus, according to the signaling information, the object size of an object in the integrated scene description may be determined as or based on one of the object sizes of the object in the visual scene description or the object size of the object in the audio scene description.

[0057] In one embodiment, the object shape of an object in the scene description may be signaled as originating from either a visual scene or an audio scene, and thus, according to the signaling information, the object shape of an object in the integrated scene description may be determined as or based on one of the object shapes of the object in the visual scene description or the object shape of the object in the audio scene description.

[0058] In one embodiment, the object orientation of an object in the scene description may be signaled as originating from either a visual scene or an audio scene, and thus, according to the signaling information, the object orientation of an object in the integrated scene description may be determined as or based on one of the object orientations of the object in the visual scene description or the object orientations of the object in the audio scene description.

[0059] In one embodiment, the object positions of the objects in the scene description may be signaled as originating from either the visual scene or the audio scene, and thus, according to the signaling information, the object positions of the objects in the integrated scene description may be determined as or based on one of the object positions of the objects in the visual scene description or the object positions of the objects in the audio scene description.

[0060] In one embodiment, object material of an object in the scene description may be signaled as originating from either a visual scene or an audio scene, and thus, according to the signaling information, object material of an object in the integrated scene description may be determined as or based on one of object material of an object in the visual scene description or object material of an object in the audio scene description.

[0061] 5 illustrates a block diagram of a media system (500) according to one embodiment of the present disclosure. The media system (500) can be used in a variety of use applications, such as immersive media applications, augmented reality (AR) applications, virtual reality applications, video game applications, sports game animation applications, video conferencing and telepresence applications, media streaming applications, and the like.

[0062] The media system (500) includes a media server device (510) and multiple media client devices, such as the media client device (560) shown in FIG. 5, that may be connected by a network (not shown). In one example, the media server device (510) may include one or more devices that include audio and video encoding capabilities. In one example, the media server device (510) includes a single computing device, such as a desktop computer, a laptop computer, a server computer, a tablet computer, etc. In another example, the media server device (510) includes a data center(s), a server farm(s), etc. The media server device (510) may receive media content data. The media content data may include video content and audio content. The media content data may include descriptions of objects in an audio scene generated by an audio engine and descriptions of objects in a visual scene generated by a visual engine. The media server device (510) may compress the video and audio content into one or more encoded bitstreams according to an appropriate media encoding standard. The encoded bitstreams may be distributed over a network to the media client device (560).

[0063] The media client device (560) may include one or more devices that include video and audio encoding capabilities for media applications. In one example, the media client device (560) may include a computing device such as a desktop computer, a laptop computer, a server computer, a tablet computer, a wearable computing device, an HMD device, etc. The media client device (560) may decode the encoded bitstream according to an appropriate media encoding standard. The decoded video and audio content may be used for media playback.

[0064] The media server device (510) may be implemented using any suitable technology. In the example of Figure 5, the media server device (510) includes a processing circuit (530) and an interface circuit (511) coupled to each other.

[0065] The processing circuitry (530) may include any suitable processing circuitry, such as one or more central processing units (CPUs), one or more graphic processing units (GPUs), application specific integrated circuits, etc. Additionally, the processing circuitry (530) may be configured to include various encoders, such as an audio encoder, a video encoder, etc. In one example, the one or more CPUs and / or GPUs may execute software to function as an audio encoder or a video encoder. In another example, the audio encoder or the video encoder may be implemented using an application specific integrated circuit.

[0066] In some examples, the processing circuit (530) includes a scene processor (531). The scene processor (531) can determine whether one or more parameters of an object represented by the description of the object in the audio scene differ from one or more parameters of an object represented by the description of the object in the visual scene. In response to the parameters of the object represented by the description of the object in the audio scene differ from the parameters of the object represented by the description of the object in the visual scene, the scene processor (531) can modify at least one of the description of the object in the audio scene or the description of the object in the visual scene such that the parameters of the object represented by the description of the object in the audio scene are consistent or more consistent with the parameters of the object represented by the description of the object in the visual scene.

[0067] The interface circuit (511) can interface the media server device (510) to a network. The interface circuit (511) can include a receiver for receiving signals from the network and a transmitter for transmitting signals to the network. For example, the interface circuit (511) can transmit signals carrying encoded bitstreams over the network to other devices, such as the media client device (560). The interface circuit (511) can receive signals from media client devices, such as the media client device (560).

[0068] The network is suitably coupled to the media server device (510) and the media client device (560) via wired and / or wireless connections, such as Ethernet connections, fiber optic connections, WiFi connections, cellular network connections, etc. The network may include network server devices, storage devices, network devices, etc. The components of the network are suitably coupled to each other via wired and / or wireless connections.

[0069] The media client device (560) can be configured to decode the encoded bitstream. In one example, the media client device (560) can perform video decoding to reconstruct a sequence of displayable video frames and can perform audio decoding to generate an audio signal for playback.

[0070] The media client device (560) may be implemented using any suitable technology. In the example of Figure 5, the media client device (560) is shown to be, but is not limited to, an HMD with earphones as user equipment available to the user (520).

[0071] In FIG. 5, the media client device (560) may include an interface circuit (561) and a processing circuit (570) coupled to each other as shown in FIG.

[0072] The interface circuit (561) can interface the media client device (560) to a network. The interface circuit (561) can include a receiver for receiving signals from the network and a transmitter for transmitting signals to the network. For example, the interface circuit (561) can receive signals carrying data, such as signals carrying encoded bitstreams from the network.

[0073] The processing circuitry (570) may include any suitable processing circuitry, such as a CPU, a GPU, an application specific integrated circuit, etc. The processing circuitry (570) may be configured to include various components, such as a scene processor (571), a renderer (572), a video decoder (not shown), and an audio decoder (not shown).

[0074] In some examples, an audio decoder can decode audio content in an encoded bitstream by selecting a decoding tool appropriate for the manner in which the audio content was encoded, and a video decoder can decode video content in an encoded bitstream by selecting a decoding tool appropriate for the manner in which the video content was encoded. The scene processor (571) is configured to modify one of the visual scene description and the audio scene description in the decoded media content such that one or more parameters of objects indicated by the object description in the audio scene are consistent with one or more parameters of objects indicated by the object description in the visual scene.

[0075] Additionally, a renderer (572) can generate a final digital product suitable for the media client device (560) from the audio and video content decoded from the encoded bitstream. It should be noted that the processing circuitry (570) can include other suitable components (not shown), such as mixers, post-processing circuitry, etc., for further media processing.

[0076] 6 shows a flow chart outlining a process (600) according to one embodiment of the present disclosure. The process (600) may be performed by a media processing device, such as a scene processor (531) in a media server device (510) or a scene processor (571) in a media client device (560). In some embodiments, the process (600) is implemented with software instructions, such that the processing circuitry executes the software instructions to perform the process (600). The process starts at (S601) and proceeds to (S610).

[0077] At (S610), media content data for an object can be received. The media content data can include a first description of the object in an audio scene generated by a speech engine and a second description of the object in a visual scene generated by a vision engine.

[0078] In (S620), it may be determined whether a first parameter indicated by a first description of an object in the audio scene and a second parameter indicated by a second description of an object in the visual scene are inconsistent.

[0079] At (S630), in response to a mismatch between a first parameter indicated by the first description of the object in the audio scene and a second parameter indicated by the second description of the object in the visual scene, one of the first description of the object in the audio scene and the second description of the object in the visual scene may be modified based on the other of the unmodified first description and the second description. The modified one of the first description and the second description may be made consistent with the unmodified other of the first description and the second description.

[0080] At (S640), media content data of the object may be provided to a receiver for a media application to render the media content data of the object.

[0081] In some embodiments, both the first parameter and the second parameter may be associated with one of an object size, an object shape, an object position, an object orientation and an object texture of the object.

[0082] One of the first description of the object in the audio scene and the second description of the object in the visual scene can be modified based on the other of the first description of the object in the audio scene and the second description of the object in the visual scene, such that a first parameter indicated by the first description of the object in the audio scene can be consistent with a second parameter indicated by the second description of the object in the visual scene.

[0083] The process (600) may determine a third description of the object in the integrated scene based on at least one of the first description of the object in the audio scene or the second description of the object in the visual scene. In response to the first parameter indicated by the first description of the object in the audio scene differing from the third parameter indicated by the third description of the object in the integrated scene, the first parameter indicated by the first description of the object in the audio scene may be modified based on the third parameter indicated by the third description of the object in the integrated scene. In response to the second parameter indicated by the second description of the object in the visual scene differing from the third parameter indicated by the third description of the object in the integrated scene, the second parameter indicated by the second description of the object in the visual scene may be modified based on the third parameter indicated by the third description of the object in the integrated scene.

[0084] In one example, an object size in the third description of the object in the integrated scene may be determined based on an object size in the first description of the object in the acoustic scene. An object size in the third description of the object in the integrated scene may be determined based on an object size in the second description of the object in the visual scene. An object size in the third description of the object in the integrated scene may be determined based on an intersection size of an intersection of an object in the first description of the object in the acoustic scene with an object in the second description of the object in the visual scene. An object size in the third description of the object in the integrated scene may be determined based on a size difference between an object size in the first description of the object in the acoustic scene and an object size in the second description of the object in the visual scene.

[0085] In one example, an object shape in the third description of the object in the integrated scene may be determined based on an object shape in the first description of the object in the acoustic scene. An object shape in the third description of the object in the integrated scene may be determined based on an object shape in the second description of the object in the visual scene. An object shape in the third description of the object in the integrated scene may be determined based on an intersection shape of an intersection of an object in the first description of the object in the acoustic scene with an object in the second description of the object in the visual scene. An object shape in the third description of the object in the integrated scene may be determined based on a shape difference between an object shape in the first description of the object in the acoustic scene and an object shape in the second description of the object in the visual scene.

[0086] In one example, an object position in the third description of the object in the integrated scene may be determined based on an object position in the first description of the object in the acoustic scene. An object position in the third description of the object in the integrated scene may be determined based on an object position in the second description of the object in the visual scene. An object position in the third description of the object in the integrated scene may be determined based on a position difference between an object position in the first description of the object in the acoustic scene and an object position in the second description of the object in the visual scene.

[0087] In one example, an object orientation in the third description of the object in the integrated scene may be determined based on an object orientation in the first description of the object in the acoustic scene. An object orientation in the third description of the object in the integrated scene may be determined based on an object orientation in the second description of the object in the visual scene. An object orientation in the third description of the object in the integrated scene may be determined based on a direction difference between an object orientation in the first description of the object in the acoustic scene and an object orientation in the second description of the object in the visual scene.

[0088] In one example, an object texture in the third description of the object in the integrated scene may be determined based on an object texture in the first description of the object in the audio scene. An object texture in the third description of the object in the integrated scene may be determined based on an object texture in the second description of the object in the visual scene. An object texture in the third description of the object in the integrated scene may be determined based on a texture difference between the object texture in the first description of the object in the audio scene and the object texture in the second description of the object in the visual scene.

[0089] In some embodiments, a description of an object in an anchor scene of the media content data may be determined based on one of a first description of an object in the audio scene and a second description of an object in the visual scene. In response to the description of the object in the anchor scene being determined based on the first description of the object in the audio scene, the second description of the object in the visual scene may be modified based on the first description of the object in the audio scene. In response to the description of the object in the anchor scene being determined based on the second description of the object in the visual scene, the first description of the object in the audio scene may be modified based on the second description of the object in the visual scene. Further, signaling information may be generated to indicate which of the first description of the object in the audio scene and the second description of the object in the visual scene is selected to determine the description of the anchor scene.

[0090] In some embodiments, signaling information may be generated to indicate which of a first parameter in a first description of an object in an acoustic scene and a second parameter in a second description of an object in a visual scene is selected to determine a third parameter in a third description of an object in an integrated scene.

[0091] Thereafter, the process proceeds to (S699) and ends.

[0092] The process (600) may be adapted as appropriate. Step(s) of the process (600) may be modified and / or omitted. Further step(s) may be added. Any suitable order of performance may be used.

[0093] The techniques described above can be implemented as computer software using computer readable instructions and can be physically stored on one or more computer readable media. For example, Figure 7 illustrates a computer system (700) suitable for implementing certain embodiments of the disclosed subject matter.

[0094] Computer software can be encoded using any suitable machine code or computer language that can be subjected to assembly, compilation, linking, or similar mechanisms to generate code including instructions that can be executed by one or more computer central processing units (CPUs) and graphics processing units (GPUs), etc., directly, or through interpretation and execution of microcode, etc.

[0095] The instructions may be executed on various types of computers or components thereof including, for example, personal computers, tablet computers, servers, smart phones, gaming devices, Internet of Things devices, and the like.

[0096] 7 are exemplary in nature and are not intended to suggest any limitation as to the scope of use or functionality of the computer software implementing the embodiments of the present disclosure. The arrangement of components should not be interpreted as having a dependency or requirement regarding any one or combination of components illustrated in the exemplary embodiment of computer system (700).

[0097] The computer system (700) may include certain human interface input devices. Such human interface input devices may be responsive to input by one or more human users via, for example, tactile input (keystrokes, swipes, data glove movements, etc.), audio input (voice, clapping, etc.), visual input (gestures, etc.), olfactory input (not shown). The human interface devices may further be used to capture certain media that do not necessarily involve direct conscious human input, such as audio (speech, music, ambient sounds, etc.), images (scanned images, photographic images obtained from a still camera, etc.), and video (two-dimensional video, three-dimensional video including stereoscopic video, etc.).

[0098] The human interface input devices may include one or more of a keyboard (701), a mouse (702), a trackpad (703), a touch screen (710), a data glove (not shown), a joystick (705), a microphone (706), a scanner (707), and a camera (708) (only one of each is depicted).

[0099] The computer system (700) may also include certain human interface output devices. Such human interface output devices may stimulate one or more of the human user's senses, for example, by haptic output, sound, light, and smell / taste. Such human interface output devices may include haptic output devices (e.g., haptic feedback via a touch screen (710), data gloves (not shown), or joystick (705), but may also be haptic feedback devices that do not function as input devices), audio output devices (speakers (709), headphones (not shown), etc.), visual output devices (screens (710), including CRT screens, LCD screens, plasma screens, OLED screens, etc., with or without touch screen input capabilities, with or without haptic feedback capabilities, some of which may output two-dimensional visual output, or output beyond three dimensions by means of stereoscopic output, virtual reality glasses (not shown), holographic displays, smoke tanks (not shown), etc.), and printers (not shown).

[0100] The computer system (700) may also include human accessible storage devices and their associated media, such as optical media including CD / DVD ROM / RW (720) with media (721) such as CDs / DVDs, thumb drives (722), removable hard drives or solid state drives (723), conventional magnetic media such as tape and floppy disks (not shown), dedicated ROM / ASIC / PLD based devices such as security dongles (not shown), etc.

[0101] Those skilled in the art will further appreciate that the term "computer-readable medium" as used in connection with the subject matter of this disclosure does not encompass transmission media, carrier waves or other transitory signals.

[0102] The computer system (700) may also include an interface (754) to one or more communication networks (755). The networks may be, for example, wireless, wired, optical. The networks may further be local, wide area, metropolitan, vehicular and industrial, real-time, delay tolerant, etc. Examples of networks include local area networks such as Ethernet, wireless LAN, cellular networks including GSM, 3G, 4G, 5G, LTE, etc., television wired or wireless wide area digital networks including cable TV, satellite TV, and terrestrial broadcast TV, and vehicular and industrial networks including CANBus, etc. Certain networks generally require an external network interface adapter attached to a particular general-purpose data port or peripheral bus (749) (e.g., a USB port of the computer system (700)), while others are generally integrated into the core of the computer system (700) by attachment to a system bus as described below (e.g., an Ethernet interface to a PC computer system or a cellular network interface to a smartphone computer system). Using any of these networks, the computer system (700) may communicate with other entities. Such communications may be unidirectional, receive only (e.g., broadcast TV), transmit only unidirectional (e.g., CANbus to a particular CANbus device), or bidirectional, for example, to other computer systems using local or wide area digital networks. Specific protocols and protocol stacks may be used in each of those networks and network interfaces, as described above.

[0103] The aforementioned human interface devices, human accessible storage devices and network interfaces may be attached to the core (740) of the computer system (700).

[0104] The core (740) includes one or more central processing units (CPUs) (741), graphics processing units (GPUs) (742), dedicated programmable processing units in the form of field programmable gate areas (FPGAs) (743), hardware accelerators for specific tasks (744), graphics adapters (750), etc. These devices may be connected via a system bus (748), along with read only memory (ROM) (745), random access memory (746), internal mass storage devices (747) such as internal hard drives, SSDs, etc. that are not user accessible. In some computer systems, the system bus (748) may be accessible in the form of one or more physical plugs, allowing expansion with additional CPUs, GPUs, etc. Peripheral devices may be attached directly to the core's system bus (748) or via a peripheral bus (749). In one example, a screen (710) may be connected to the graphics adapter (750). Peripheral bus architectures include PCI, USB, etc.

[0105] The CPU (741), GPU (742), FPGA (743) and accelerator (744) can execute certain instructions that may combine to constitute the aforementioned computer code. The computer code may be stored in a ROM (745) or a RAM (746). Transient data may also be stored in the RAM (746), while immutable data may be stored, for example, in an internal mass storage device (747). Rapid storage and retrieval in any of the memory devices may be made possible by the use of a cache memory that may be closely associated with one or more of the CPU (741), GPU (742), mass storage device (747), ROM (745), RAM (746), etc.

[0106] The computer-readable medium can bear computer code for performing various computer-implemented operations. The media and computer code can be those specially designed and constructed for the purposes of the present disclosure, or they can be of the kind well known and available to those skilled in the computer software arts.

[0107] By way of example and not limitation, a computer system having the architecture (700), and in particular the core (740), can provide functionality as a result of a processor(s) (including CPUs, GPUs, FPGAs, accelerators, etc.) executing software embodied in one or more tangible computer-readable media. Such computer-readable media can be user-accessible mass storage devices as introduced above, as well as media associated with specific storage devices of the core (740) that are non-transitory in nature, such as the core internal mass storage device (747) or ROM (745). Software implementing various embodiments of the present disclosure can be stored in such devices and executed by the core (740). The computer-readable media can include one or more memory devices or chips, depending on the particular needs. The software can cause the core (740) and in particular the processors therein (including CPUs, GPUs, FPGAs, etc.) to perform certain operations or certain portions of certain operations described herein, including defining data structures stored in RAM (746) and modifying such data structures according to operations defined by the software. Additionally or alternatively, the computer system may provide functionality as a result of logic hardwired or otherwise embodied in circuitry (e.g., accelerator (744)), operating in place of or in conjunction with software to perform particular operations or particular portions of particular operations described herein. References to software may encompass logic, and vice versa, where appropriate. Where appropriate, references to computer-readable media may encompass circuitry (such as an integrated circuit (IC)) that stores software for execution, circuitry that embodies logic for execution, or both. The present disclosure encompasses any suitable combination of hardware and software.

[0108] While this disclosure has described several exemplary embodiments, alterations, substitutions, and various alternative equivalents exist, which are within the scope of this disclosure. It will thus be appreciated that those skilled in the art will be able to devise numerous systems and methods that, although not explicitly shown or described herein, embody the principles of the present disclosure and are therefore within its spirit and scope. [Explanation of symbols]

[0109] 100 Presentations 102 users 200 MPEG-I Immersive Audio Evaluation Platform (AEP) 202 Evaluation Component 204 Offline Encoding / Processing Component 206 MPEG-H3D Audio 208 Audio Signal 210 Max / MSP 212 Unity Engine 214 Head Mounted Display (HMD) 216 Compiler 218 Controller 220 Scene File 222 directional files 224 HRTF files 226 Model files / Video files 228 MPEG-I processor (or compressor) 300 Sound Scenes 302 Gap 304 Wall Elements 400 visual scenes 402 Wall Elements 500 Media System 510 Media Server Device 511 Interface Circuit 520 users 530 Processing Circuit 531 Scene Processor 560 Media Client Devices 561 Interface Circuit 570 Processing Circuit 571 Scene Processor 572 Renderer 600 Processing 700 Computer Systems 701 Keyboard 702 Mouse 703 Trackpad 705 Joystick 706 Microphone 707 Scanner 708 Camera 709 Speaker 710 Touchscreen 720 CD / DVD ROM / RW 721 Medium 722 Thumb Drive 723 Removable Hard Drive or Solid State Drive 740 cores 741 Central Processing Unit (CPU) 742 Graphics Processing Unit (GPU) 743 Field Programmable Gate Area (FPGA) 744 Hardware Accelerator 745 Read-Only Memory (ROM) 746 Random Access Memory 747 Internal mass storage 748 System Bus 749 General Purpose Data Port or Peripheral Bus 750 Graphics Adapter 754 Interface 755 Communication Network

Claims

1. 1. A method of media processing performed by a media processing device, comprising: receiving media content data for an object, the media content data including a first description of the object in an audio scene generated by a speech engine and a second description of the object in a visual scene generated by a vision engine; determining whether a first parameter indicated by the first description of the object in the acoustic scene and a second parameter indicated by the second description of the object in the visual scene are inconsistent; in response to an inconsistency between the first parameter indicated by the first description of the object in the audio scene and the second parameter indicated by the second description of the object in the visual scene, modifying one of the first description of the object in the audio scene and the second description of the object in the visual scene based on an unmodified other of the first description and the second description, wherein the modified one of the first description and the second description is consistent with the other of the unmodified first description and the second description, and both of the first parameter and the second parameter are associated with one of an object size, an object shape, an object position, an object orientation and an object texture of the object; providing the media content data of the object for a media application to a receiver that renders the media content data of the object; determining a third description of the object in the integrated scene based on at least one of the first description of the object in the acoustic scene or the second description of the object in the visual scene; in response to the first parameter indicated by the first description of the object in the sound scene differing from a third parameter indicated by the third description of the object in the integrated scene, modifying the first parameter indicated by the first description of the object in the sound scene based on the third parameter indicated by the third description of the object in the integrated scene; and in response to the second parameter indicated by the second description of the object in the visual scene being different from the third parameter indicated by the third description of the object in the integrated scene, modifying the second parameter indicated by the second description of the object in the visual scene based on the third parameter indicated by the third description of the object in the integrated scene.

2. The step of modifying further comprises:

2. The method of claim 1, comprising: modifying one of the first description of the object in the acoustic scene and the second description of the object in the visual scene based on the other of the first description of the object in the acoustic scene and the second description of the object in the visual scene so that the first parameter indicated by the first description of the object in the acoustic scene is consistent with the second parameter indicated by the second description of the object in the visual scene.

3. The determining step further comprises: determining an object size in the third description of the object in the integrated scene based on an object size in the first description of the object in the acoustic scene; determining the object size in the third description of the object in the integrated scene based on the object size in the second description of the object in the visual scene; determining a size of the object in the third description of the object in the integrated scene based on an intersection size of an intersection of the object in the first description of the object in the acoustic scene with the object in the second description of the object in the visual scene; and 2. The method of claim 1, further comprising one of steps: determining the object size in the third description of the object in the integrated scene based on a size difference between the object size in the first description of the object in the acoustic scene and the object size in the second description of the object in the visual scene.

4. The determining step further comprises: determining an object shape in the third description of the object in the integrated scene based on an object shape in the first description of the object in the acoustic scene; determining the object shape in the third description of the object in the integrated scene based on the object shape in the second description of the object in the visual scene; determining the object shape in the third description of the object in the integrated scene based on an intersection shape of an intersection of the object in the first description of the object in the acoustic scene with the object in the second description of the object in the visual scene; and 2. The method of claim 1 , further comprising one of steps of determining the object shape in the third description of the object in the integrated scene based on a shape difference between the object shape in the first description of the object in the acoustic scene and the object shape in the second description of the object in the visual scene.

5. The determining step further comprises: determining an object position in the third description of the object in the integrated scene based on an object position in the first description of the object in the acoustic scene; determining an object position in the third description of the object in the integrated scene based on an object position in the second description of the object in the visual scene; and 2. The method of claim 1 , further comprising one of steps of determining the object position in the third description of the object in the integrated scene based on a position difference between the object position in the first description of the object in the acoustic scene and the object position in the second description of the object in the visual scene.

6. The determining step further comprises: determining an object orientation in the third description of the object in the integrated scene based on an object orientation in the first description of the object in the acoustic scene; determining an object orientation in the third description of the object in the integrated scene based on an object orientation in the second description of the object in the visual scene; 2. The method of claim 1 , further comprising one of the steps of determining the object orientation in the third description of the object in the integrated scene based on an orientation difference between the object orientation in the first description of the object in the acoustic scene and the object orientation in the second description of the object in the visual scene.

7. The determining step further comprises: determining an object texture in the third description of the object in the integrated scene based on an object texture in the first description of the object in the audio scene; determining the object texture in the third description of the object in the integrated scene based on the object texture in the second description of the object in the visual scene; and 2. The method of claim 1, further comprising one of the steps of determining the object texture in the third description of the object in the integrated scene based on a texture difference between the object texture in the first description of the object in the acoustic scene and the object texture in the second description of the object in the visual scene.

8. A method of media processing performed by a media processing device, comprising: receiving media content data for an object, the media content data including a first description of the object in an audio scene generated by a speech engine and a second description of the object in a visual scene generated by a vision engine; determining whether a first parameter indicated by the first description of the object in the acoustic scene and a second parameter indicated by the second description of the object in the visual scene are inconsistent; in response to an inconsistency between the first parameters indicated by the first description of the object in the audio scene and the second parameters indicated by the second description of the object in the visual scene, modifying one of the first description of the object in the audio scene and the second description of the object in the visual scene based on an unmodified other of the first description and the second description, wherein the modified one of the first description and the second description is consistent with the other of the unmodified first description and the second description; providing the media content data of the object for a media application to a receiver that renders the media content data of the object; determining a description of an object in an anchor scene of the media content data based on one of the first description of the object in the audio scene and the second description of the object in the visual scene; modifying the second description of the object in the visual scene based on the first description of the object in the audio scene in response to the description of the object in the anchor scene being determined based on the first description of the object in the audio scene; modifying the first description of the object in the acoustic scene based on the second description of the object in the visual scene in response to the description of the object in the anchor scene being determined based on the second description of the object in the visual scene; generating signaling information indicating which of the first description of the object in the acoustic scene and the second description of the object in the visual scene is selected to determine the description of the anchor scene; A method comprising:

9. generating signaling information indicating which of the first parameter in the first description of the object in the acoustic scene and the second parameter in the second description of the object in the visual scene are selected for determining the third parameter in the third description of the object in the integrated scene; The method of claim 1, further comprising:

10. Apparatus configured to perform the method according to any one of claims 1 to 9.

11. A computer program product which, when executed by at least one processor, causes said at least one processor to perform the method according to any one of claims 1 to 9.

Citation Information

Patent Citations

  • Adjusting Spatial Congruency in a Video Conferencing System

    US20170324931A1