System and method for augmented reality communication based on data channels

Abstract

Systems and methods for data channel based augmented reality (AR) communication are presented. A first wireless communication device may communicate with a wireless communication node via a data channel to share computer-generated perceptual information. Media content may be rendered with computer-generated perceptual information.

Description

Technical Field

[0001] The present disclosure relates generally to wireless communications, including but not limited to systems and methods for data channel-based augmented reality (AR) communications. Background Art

[0002] The third generation partnership project (3GPP), a standardization organization, is currently specifying a new air interface called 5G New Radio (5G NR) and the next generation packet core network (NG-CN or NGC). 5GNR will have three main components: 5G access network (5G-AN), 5G core network (5GC) and user equipment (UE). In order to facilitate the implementation of different data services and requirements, the elements of 5GC (also called network functions) have been simplified so that these elements can be adjusted as needed, some of which are software-based and some are hardware-based. Summary of the invention

[0003] The exemplary embodiments disclosed herein are intended to solve problems related to one or more problems raised in the prior art, and provide additional features that become readily understood by reference to the following detailed description when combined with the accompanying drawings. According to various embodiments, example systems, methods, devices, and computer program products are disclosed herein. However, it should be understood that these embodiments are given as examples rather than limitations, and it is apparent to a person of ordinary skill in the art who reads this disclosure that various modifications may be made to the disclosed embodiments (e.g., including combining features from various disclosed examples, embodiments, and / or implementations) while remaining within the scope of this disclosure.

[0004] At least one aspect relates to a system, method, apparatus, or computer-readable medium as follows. A first wireless communication device (e.g., a user equipment (UE)) can communicate with a wireless communication node (e.g., an application server) via a data channel (e.g., an application data channel) to share computer-generated perception information (e.g., AR-specific data, which can be locally generated or received from UE B). Media (e.g., audio media or video media) content can be rendered with computer-generated perception information (e.g., combining media content with AR-specific data). A media function (e.g., a data channel (DC) media function) of a wireless communication node can communicate with a rendering function (e.g., an AR rendering function) of a wireless communication node to obtain computer-generated perception information and send the computer-generated perception information to the wireless communication device.

[0005] In some implementations, the first wireless communication device may establish a data channel with the wireless communication node. The first wireless communication device may send a request for computer-generated perception information to the wireless communication node via the data channel. The first wireless communication device may receive the computer-generated perception information from the wireless communication node via the data channel.

[0006] In some embodiments, the first wireless communication device may generate (e.g., locally generate) media content. The first wireless communication device may render the media content with computer-generated perception information. The first wireless communication device (e.g., UE A) may send the rendered media content to the second wireless communication device (e.g., UE B) via a media channel (e.g., a real-time transport protocol (RTP) channel).

[0007] In some embodiments, the first wireless communication device may receive media content from the second wireless communication device via a media channel. The first wireless communication device may render the received media content with computer-generated perception information. The first wireless communication device may send the computer-generated perception information to the wireless communication node via a data channel. The media function (e.g., DC media function) of the wireless communication node may transmit the computer-generated perception information to the rendering function (e.g., AR rendering function) of the wireless communication node. The rendering function may store the computer-generated perception information.

[0008] In some embodiments, the first wireless communication device may send media content to a wireless communication node (e.g., an AR rendering function of an application server). The rendering function of the wireless communication node may render the media content with computer-generated perception information. The data channel may include an application data channel. The computer-generated perception information may include augmented reality (AR) specific data. The media channel may include a real-time transport protocol (RTP) channel. The media content may include audio media content or video media content.

[0009] In some embodiments, a wireless communication node (e.g., an application server) may communicate with a first wireless communication device (e.g., a UE) via a data channel (e.g., an application data channel) to share computer-generated perception information (e.g., AR-specific data). Media content may be rendered using the computer-generated perception information. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] Various exemplary embodiments of the present solution are described in detail below with reference to the following drawings. The drawings or diagrams are provided for illustrative purposes only and depict only exemplary embodiments of the present solution to facilitate the reader's understanding of the present solution. Therefore, the drawings should not be considered as limiting the breadth, scope or applicability of the present solution. It should be noted that for clarity and ease of illustration, these drawings are not necessarily drawn to scale.

[0011] Figure 1 An example cellular communication network according to an embodiment of the present disclosure is shown, in which the techniques disclosed herein may be implemented;

[0012] Figure 2 A block diagram showing an example base station and user equipment device according to some embodiments of the present disclosure;

[0013] Figure 3 A sequence diagram illustrating augmented reality (AR) communications according to some embodiments of the present disclosure;

[0014] Figure 4 A sequence diagram illustrating augmented reality (AR) communications according to some embodiments of the present disclosure;

[0015] Figure 5 A block diagram illustrating an example method for augmented reality (AR) communications according to some embodiments of the present disclosure; and

[0016] Figure 6 A flow chart of augmented reality (AR) communication according to an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0017] 1. Mobile communication technology and environment

[0018] Figure 1 An example wireless communication network and / or system 100 is shown in which the techniques disclosed herein may be implemented according to an embodiment of the present disclosure. In the following discussion, the wireless communication network 100 may be any wireless network, such as a cellular network or a narrowband Internet of Things (NB-IoT) network, and is referred to herein as "network 100." Such an example network 100 includes a base station 102 (hereinafter referred to as "BS 102"; also referred to as a wireless communication node) and a user equipment device 104 (hereinafter referred to as "UE 104"; also referred to as a wireless communication device) that may communicate with each other via a communication link 110 (e.g., a wireless communication channel), and a cluster of cells 126, 130, 132, 134, 136, 138, and 140 covering a geographic area 101. In Figure 1 1, BS 102 and UE 104 are contained within the respective geographic boundaries of cell 126. Each of the other cells 130, 132, 134, 136, 138, and 140 may include at least one base station operating on its allocated bandwidth to provide adequate radio coverage to its intended users.

[0019] For example, BS 102 may operate on the allocated channel transmission bandwidth to provide adequate coverage to UE 104. BS 102 and UE 104 may communicate via downlink radio frames 118 and uplink radio frames 124, respectively. Each radio frame 118 / 124 may be further divided into subframes 120 / 127, which may include data symbols 122 / 128. In the present disclosure, BS 102 and UE 104 are described herein as non-limiting examples of "communication nodes", which may generally practice the methods disclosed herein. According to various embodiments of the present solution, such communication nodes may be capable of wireless and / or wired communications.

[0020] Figure 2 A block diagram of an example wireless communication system 200 for sending and receiving wireless communication signals (e.g., OFDM / OFDMA signals) according to some embodiments of the present solution is shown. The system 200 may include components and elements configured to support known or conventional operating features that need not be described in detail herein. In one illustrative embodiment, the system 200 may be used in a communication environment such as described above. Figure 1 The wireless communication environment 100 may be used to transmit (eg, send and receive) data symbols.

[0021] The system 200 generally includes a base station 202 (hereinafter referred to as "BS 202") and a user equipment device 204 (hereinafter referred to as "UE 204"). The BS 202 includes a BS (base station) transceiver module 210, a BS antenna 212, a BS processor module 214, a BS memory module 216, and a network communication module 218, each of which is coupled and interconnected to each other via a data communication bus 220 as needed. The UE 204 includes a UE (user equipment) transceiver module 230, a UE antenna 232, a UE memory module 234, and a UE processor module 236, each of which is coupled and interconnected to each other via a data communication bus 240 as needed. The BS 202 communicates with the UE 204 via a communication channel 250, which can be any wireless channel or other medium suitable for data transmission as described herein.

[0022] As will be appreciated by those skilled in the art, the system 200 may also include Figure 2Any number of modules outside the modules shown. It will be appreciated by those skilled in the art that the various illustrative blocks, modules, circuits, and processing logic described in conjunction with the embodiments disclosed herein can be implemented in hardware, computer-readable software, firmware, or any actual combination thereof. In order to clearly illustrate this interchangeability and compatibility of hardware, firmware, and software, various illustrative components, blocks, modules, circuits, and steps are generally described according to their functions. Whether such functions are implemented as hardware, firmware, or software may depend on specific applications and design constraints imposed on the entire system. Personnel familiar with the concepts described herein can implement such functions in a manner suitable for each specific application, but such implementation decisions should not be interpreted as limiting the scope of the present disclosure.

[0023] According to some embodiments, the UE transceiver 230 may be referred to herein as an "uplink" transceiver 230, which includes a radio frequency (RF) transmitter and an RF receiver, each of which includes circuitry coupled to an antenna 232. A duplex switch (not shown) may alternatively couple the uplink transmitter or receiver to the uplink antenna in a time duplex manner. Similarly, according to some embodiments, the BS transceiver 210 may be referred to herein as a "downlink" transceiver 210, which includes an RF transmitter and an RF receiver, each of which includes circuitry coupled to an antenna 212. The downlink duplex switch may alternatively couple the downlink transmitter or receiver to the downlink antenna 212 in a time duplex manner. The operation of the two transceiver modules 210 and 230 may be coordinated in time such that while the downlink transmitter is coupled to the downlink antenna 212, the uplink receiver circuitry is coupled to the uplink antenna 232 to receive transmissions over the wireless transmission link 250. Instead, the operation of the two transceivers 210 and 230 may be coordinated in time such that while the uplink transmitter is coupled to the uplink antenna 232, the downlink receiver is coupled to the downlink antenna 212 to receive transmissions over the wireless transmission link 250. In some embodiments, there is tight time synchronization with minimal guard times between changes in duplex direction.

[0024] The UE transceiver 230 and the base station transceiver 210 are configured to communicate via a wireless data communication link 250 and cooperate with an appropriately configured RF antenna device 212 / 232 that can support a specific wireless communication protocol and modulation scheme. In some illustrative embodiments, the UE transceiver 210 and the base station transceiver 210 are configured to support industry standards such as long-term evolution (LTE) and emerging 5G standards. However, it should be understood that the present disclosure is not necessarily limited to application to specific standards and related protocols. Instead, the UE transceiver 230 and the base station transceiver 210 can be configured to support alternative or additional wireless data communication protocols, including future standards or variations thereof.

[0025] According to various embodiments, for example, BS202 can be an evolved node B (eNB), a serving eNB, a target eNB, a femtocell or a microcell. In some embodiments, UE 204 can be embodied in various types of user equipment, such as mobile phones, smart phones, personal digital assistants (PDAs), tablet computers, laptop computers, wearable computing devices, etc. Processor modules 214 and 236 can be implemented or completed with a general-purpose processor, a content addressable memory, a digital signal processor, an application-specific integrated circuit, a field programmable gate array, any suitable programmable logic device, a discrete gate or transistor logic, a discrete hardware component, or any combination thereof for performing the functions described herein. In this way, the processor can be implemented as a microprocessor, a controller, a microcontroller, a state machine, etc. The processor can also be implemented as a combination of computing devices, such as a combination of a digital signal processor and a microprocessor, a plurality of microprocessors, one or more microprocessors combined with a digital signal processor core, or any other such configuration.

[0026] In addition, the steps of the methods or algorithms described in conjunction with the embodiments disclosed herein may be directly embodied in hardware, in firmware, in software modules executed by the processor modules 214 and 236, respectively, or in any practical combination thereof. The memory modules 216 and 234 may be implemented as RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, removable disk, CD-ROM, or any other form of storage medium known in the art. In this regard, the memory modules 216 and 234 may be coupled to the processor modules 210 and 230, respectively, so that the processor modules 210 and 230 can read information from and write information to the memory modules 216 and 234, respectively. The memory modules 216 and 234 may also be integrated into their respective processor modules 210 and 230. In some embodiments, the memory modules 216 and 234 may each include a cache memory for storing temporary variables or other intermediate information during the execution of instructions to be executed by the processor modules 210 and 230, respectively. Memory modules 216 and 234 may also each include non-volatile memory for storing instructions to be executed by processor modules 210 and 230, respectively.

[0027] The network communication module 218 generally represents the hardware, software, firmware, processing logic and / or other components of the base station 202 that enable bidirectional communication between the base station transceiver 210 and other network components and communication nodes configured to communicate with the base station 202. For example, the network communication module 218 can be configured to support Internet or WiMAX traffic. In a typical deployment, but not limited to, the network communication module 218 provides an 802.3 Ethernet interface so that the base station transceiver 210 can communicate with a traditional Ethernet-based computer network. In this way, the network communication module 218 can include a physical interface for connecting to a computer network (e.g., a mobile switching center (MSC)). The terms "configured for", "configured to" and their variants used herein for a specific operation or function refer to a device, component, circuit, structure, machine, signal, etc. that is physically constructed, programmed, formatted and / or arranged to perform a specific operation or function.

[0028] The open systems interconnection (OSI) model (referred to herein as the "open systems interconnection model") is a concept and logical layout that defines network communications used by systems (e.g., wireless communication devices, wireless communication nodes) that are open to interconnect and communicate with other systems. The model is divided into seven subcomponents or layers, each of which represents a conceptual set of services provided to the layers above and below it. The OSI model also defines a logical network and effectively describes computer packet transmission by using different layer protocols. The OSI model may also be referred to as a seven-layer OSI model or a seven-layer model. In some embodiments, the first layer may be a physical layer. In some embodiments, the second layer may be a media access control (MAC) layer. In some embodiments, the third layer may be a radio link control (RLC) layer. In some embodiments, the fourth layer may be a packet data convergence protocol (PDCP) layer. In some embodiments, the fifth layer may be a radio resource control (RRC) layer. In some embodiments, the sixth layer may be a non-access (NAS) layer or an Internet Protocol (IP) layer, and the seventh layer is other layers.

[0029] Various exemplary embodiments of the present solution are described below with reference to the accompanying drawings to enable a person of ordinary skill in the art to make and use the present solution. It is apparent to a person of ordinary skill in the art that, after reading this disclosure, various changes or modifications may be made to the examples described herein without departing from the scope of the present solution. Therefore, the present solution is not limited to the exemplary embodiments and applications described and illustrated herein. In addition, the specific order or hierarchy of steps in the methods disclosed herein are merely example methods. Based on design preferences, the specific order or hierarchy of steps of the disclosed methods or processes may be rearranged while remaining within the scope of the present solution. Therefore, a person of ordinary skill in the art will understand that the methods and techniques disclosed herein present various steps or actions in a sample order, and unless otherwise expressly stated, the present solution is not limited to the specific order or hierarchy presented.

[0030] 2. Systems and methods for data channel-based augmented reality (AR) communication

[0031] Data channels can enhance the ability of the Internet Protocol Multimedia Subsystem (IMS) to handle interactions between user equipment (UE) or between UE and application servers in the network. Data channels can be highly flexible. Data channels can transmit any type of information. Augmented reality (AR) communications can bring a good experience to users with AR-enabled devices (e.g., AR glasses or mobile phones with AR capabilities). In AR communications, some AR-specific data (sometimes referred to as computer-generated perception information) can be used to render video content exchanged between users. The rendered video can bring / provide auxiliary information to the user. A technical problem is how to use data channels to support AR communications for exchanging or transmitting AR-specific data. The systems and methods proposed in this article include novel methods for augmented reality (AR) communications based on data channels.

[0032] Communication service providers can offer new services (e.g., screen sharing, visual interactive menus, and / or location sharing during calls). IMS data channels can transport different kinds of media types and can be used in parallel with other multimedia types (e.g., voice or video in telephony services). The data channel can be highly flexible and can transport any type of information end-to-end between the UE and the network and / or between UEs.

[0033] AR can combine virtual objects with reality. AR content may include one or more AR objects that can be superimposed on a real scene. AR communication can provide users with the function of sharing a real video rendered using some AR objects with other users. AR objects may be markers, stickers, cartoon characters, virtual human models, or 3D models for rendering objects in a scene. AR specific data may be an AR object or data / information for creating an AR object. In AR communication, a data channel may be used to transmit AR specific data between a UE and a network. AR specific data may be viewed / used as a resource for rendering (rendering together) a video or other content shared by a user. The present disclosure provides functions and processes for AR communication based on a data channel.

[0034] The data channel can be used to transmit AR-specific data during AR communication. AR-specific data may include markers, stickers, cartoon characters, virtual human models, or 3D models for rendering objects in the scene. The rendering operation can be performed by the AR rendering function on the UE or network side. For the UE rendering option, the UE may first download the AR-specific data from the network. The UE may render video media content received from a peer UE and may display the video media content to the user. The UE may render a locally captured video and may send the locally captured video to a peer UE. For the network rendering option, the UE may send video content to the AR rendering function in the network. The AR rendering function may use the stored AR-specific data to render the video content and may send the video content to the peer UE.

[0035] To support AR communication based on data channels (wireless cellular networks or connections), the following functions can be added to the IMS architecture: the data channel (DC) control function can implement the data channel business logic, including initiating and terminating the data channel control process; the DC media function can perform IMS data channel media operations (e.g., creation and closing of data channels), and / or can transmit AR specific data from the AR rendering function to the UE; or the AR rendering function can render video media content based on AR specific data, and can provide a repository for AR specific data. In an example implementation, Figure 3 The process of UE rendering using computer-generated perception information (e.g., AR-specific data) transmitted by a data channel is shown in FIG.

[0036] Implementation Example 1: UE rendering process using AR-specific data transmitted via data channel

[0037] Figure 3 A sequence diagram of augmented reality (AR) communications according to some embodiments of the present disclosure is shown.

[0038] In step 1, UE A may establish a data channel with a data channel (DC) media function. UE A may interact with functions in an Internet Protocol Multimedia Subsystem (IMS) core A, an IMS application server (IMS AS), a DC control function, and a DC media function to establish a data channel between UE A and the DC media function. Data channels may include two types: a guided data channel and an application data channel. The guided data channel may be established first in step 1. An application may be downloaded from the DC media function to UE A via the guided data channel. After being triggered by an application, UE A may establish an application data channel to transmit computer-generated perception information or AR-specific data between the IMS core A, the IMS AS, the DC control function, and / or the DC media function.

[0039] In step 2, UE A may request AR specific data from the DC media function through the data channel established in step 1.

[0040] In step 3, the DC media function may interact with the AR rendering function to obtain AR specific data from its repository.

[0041] In step 4, the DC media function may send AR specific data to UE A via the data channel.

[0042] In step 5, UE A may communicate with UE B. A real-time transport protocol (RTP) channel may be established between UE A and UE B to exchange media content (e.g., audio or video media content). This step may be performed before or in parallel with the establishment of the data channel.

[0043] In step 6a, video or audio media content may be transmitted from UE B to UE A via the RTP channel.

[0044] In step 7a, UE A may render (e.g., combine / process / format) the received video media content (e.g., render it into a displayable form) with the AR specific data (together with / in combination with the AR specific data), and may display the video media content to the user via the AR device.

[0045] In step 6b, UE A may render local video media content (e.g., generated / accessed / retrieved / acquired locally at UE A) with AR-specific data. UE A may send the (rendered) local video media content (e.g., after rendering / processing) to UE B (e.g., for display). In some embodiments, for a rendering process to use real-time AR-specific data, the process of step 6a or step 6b may be performed in parallel with step 4.

[0046] In step 7b, the rendered video media content may be transmitted from UE A to UE B via the RTP channel.

[0047] Implementation Example 2: Process of network rendering using AR-specific data transmitted via data channels

[0048] Figure 4 A sequence diagram of augmented reality (AR) communications according to some embodiments of the present disclosure is shown.

[0049] In step 1, UE A may establish a data channel with a data channel (DC) media function. UE A may interact with functions in an Internet Protocol Multimedia Subsystem (IMS) core A, an IMS application server (IMS AS), a DC control function, and / or a DC media function to establish a data channel between UE A and the DC media function. Data channels may be of two types: a guided data channel and an application data channel. The guided data channel may be established first in step 1. An application may be downloaded from the DC media function to UE A via the guided data channel. After being triggered by the application, UE A may establish an application data channel to transmit computer-generated perception information or AR-specific data between the IMS core A, the IMS AS, the DC control function, and / or the DC media function.

[0050] In step 2, UE A may upload / provide AR specific data to the DC media function.

[0051] In step 3, the DC media function may transmit / send / provide the AR specific data to the AR rendering function. The AR rendering function may store / maintain the AR specific data in a local repository.

[0052] In step 4, UE A may communicate with UE B. A real-time transport protocol (RTP) channel may be established between UE A and UE B to exchange media content (e.g., audio or video media content). The communication from UE A to UE B may request AR rendering to be performed on the network side.

[0053] In step 5, UE A may send audio or video media content via the RTP channel. The audio / video media content to be rendered may be sent to the AR rendering function.

[0054] In step 6, the AR rendering function may render the received video / audio media with AR specific data. The AR specific data used in step 6 may be data uploaded by UE A in any of steps 1 to 3. In some embodiments, the data may be pre-stored in the AR rendering function.

[0055] In step 7, the AR rendering function may send the rendered video / audio content to UE B (eg, for display).

[0056] In step 8, UE B may display the received (rendered) video / audio media content to the user via the AR device.

[0057] Figure 5 A block diagram of an example method for augmented reality (AR) communications according to some implementations of the present disclosure is shown. Figure 5The architecture of the AR rendering function is shown in FIG. The rendering process can render video / audio (or other) media content based on AR specific data. The AR specific data repository can provide storage functionality for AR specific data.

[0058] It should be understood that one or more features from the above-mentioned implementation examples do not exclude specific implementation examples, but can be combined in any manner (for example, in any priority and / or order, simultaneously or otherwise).

[0059] Figure 6 A flowchart of augmented reality (AR) communication according to an embodiment of the present disclosure is shown. Method 600 can be used in conjunction with Figure 1 and Figure 2 The method 600 may be implemented by any one or more components and devices described in detail. In summary, in some embodiments, the method 600 may be performed by a wireless communication device. Depending on the implementation, additional, fewer or different operations may be performed in the method 600. At least one aspect of the operation involves a system, method, apparatus or computer-readable medium.

[0060] A first wireless communication device (e.g., a user equipment (UE)) may communicate with a wireless communication node (e.g., an application server) via a data channel (e.g., an application data channel) to share computer-generated perception information (e.g., AR-specific data, which may be locally generated or received from UE B). Media (e.g., audio media or video media) content may be rendered with the computer-generated perception information (e.g., combining the media content with the AR-specific data, or processing / enhancing the media content using the AR-specific data). A media function (e.g., a data channel (DC) media function) of the wireless communication node may communicate with a rendering function (e.g., an AR rendering function) of the wireless communication node to obtain the computer-generated perception information, and / or send the computer-generated perception information to the wireless communication device (e.g., to perform rendering).

[0061] In some implementations, the first wireless communication device may establish a data channel with the wireless communication node. The first wireless communication device may send a request for computer-generated perception information to the wireless communication node via the data channel. The first wireless communication device may receive the computer-generated perception information from the wireless communication node via the data channel, for example, to perform rendering.

[0062] In some embodiments, the first wireless communication device may generate (e.g., locally generate) media content. The first wireless communication device may render the media content with / utilize computer-generated perceptual information. The first wireless communication device (e.g., UE A) may send the rendered media content to the second wireless communication device (e.g., UE B) via a media channel (e.g., a real-time transport protocol (RTP) channel), for example, for display / rendering / output to a user.

[0063] In some embodiments, the first wireless communication device may receive media content from the second wireless communication device via a media channel. The first wireless communication device may render the received media content with computer-generated perception information. The first wireless communication device may send the computer-generated perception information to the wireless communication node via a data channel. The media function (e.g., DC media function) of the wireless communication node may transmit the computer-generated perception information to the rendering function (e.g., AR rendering function) of the wireless communication node. The rendering function may store the computer-generated perception information.

[0064] In some embodiments, the first wireless communication device may send media content to the wireless communication node (e.g., an AR rendering function of an application server). The rendering function of the wireless communication node (rather than the first wireless communication device) may render the media content with computer-generated perception information. The wireless communication node (e.g., the AR rendering function) may send rendered media content to the second wireless communication device (e.g., for display / rendering / output to the user). The data channel may include an application data channel. The computer-generated perception information may include augmented reality (AR) specific data. The media channel may include a real-time transport protocol (RTP) channel. The media content may include audio media content and / or video media content.

[0065] In some embodiments, a wireless communication node (e.g., an application server) may communicate with a first wireless communication device (e.g., a UE) via a data channel (e.g., an application data channel) to share (e.g., receive / access or provide / send) computer-generated perception information (e.g., AR-specific data). Media content may be rendered with / utilized the computer-generated perception information (e.g., at the wireless communication node, or at an AR rendering function of an application server).

[0066] Although various embodiments of the present solution have been described above, it should be understood that they are given only by way of example and not by way of limitation. Similarly, each figure may depict an example architecture or configuration, which is provided to enable those of ordinary skill in the art to understand the exemplary features and functions of the present solution. However, these personnel will understand that the present solution is not limited to the example architecture or configuration shown, but can be implemented using a variety of alternative architectures and configurations. In addition, as will be understood by those of ordinary skill in the art, one or more features of an embodiment may be combined with one or more features of another embodiment described herein. Therefore, the breadth and scope of the present disclosure should not be limited by any of the above-mentioned illustrative embodiments.

[0067] It should also be understood that any reference to an element herein using names such as "first," "second," etc. does not generally limit the quantity or order of those elements. Rather, these names may be used herein as a convenient means of distinguishing between two or more elements or multiple instances of an element. Thus, a reference to a first and a second element does not mean that only two elements can be employed, or that the first element must precede the second element in some manner.

[0068] In addition, those of ordinary skill in the art will appreciate that information and signals may be represented using any of a variety of different techniques. For example, data, instructions, commands, information, signals, bits, and symbols that may be referenced in the above description may be represented by voltages, currents, electromagnetic waves, magnetic fields or particles, optical fields or particles, or any combination thereof.

[0069] Those of ordinary skill in the art will also understand that any of the various illustrative logic blocks, modules, processors, devices, circuits, methods, and functions described in conjunction with the aspects disclosed herein may be implemented by electronic hardware (e.g., digital implementation, analog implementation, or a combination of both), firmware, various forms of programs or design codes containing instructions (for convenience, referred to herein as "software" or "software modules"), or any combination of these technologies. In order to clearly illustrate this interchangeability of hardware, firmware, and software, various illustrative components, blocks, modules, circuits, and steps have been generally described above according to their functions. Whether such functionality is implemented as hardware, firmware, or software, or a combination of these technologies, depends on the specific application and the design constraints imposed on the entire system. Technicians can implement the described functionality in various ways for each specific application, but such implementation decisions will not cause a departure from the scope of this disclosure.

[0070] In addition, it will be understood by those of ordinary skill in the art that the various illustrative logic blocks, modules, devices, components, and circuits described herein may be implemented or performed within or by an integrated circuit (IC) including a general purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), or other programmable logic device, or any combination thereof. The logic blocks, modules, and circuits may further include antennas and / or transceivers to communicate with various components within a network or within a device. A general purpose processor may be a microprocessor, but alternatively, the processor may be any conventional processor, controller, or state machine. The processor may also be implemented as a combination of computing devices, for example, a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors combined with a DSP core, or any other suitable configuration to perform the functions described herein.

[0071] If implemented in software, the functions may be stored as one or more instructions or codes on a computer-readable medium. Therefore, the steps of the method or algorithm disclosed herein may be implemented as software stored on a computer-readable medium. Computer-readable media include computer storage media and communication media, and communication media include any media that enables a computer program or code to be transferred from one place to another. The storage medium can be any available medium that a computer can access. By way of example and not limitation, such computer-readable media may include RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, and any other medium that can be used to store the desired program code in the form of instructions or data structures and can be accessed by a computer.

[0072] In this article, the term "module" as used herein refers to software, firmware, hardware, and any combination of these elements for performing the relevant functions described herein. In addition, for the purpose of discussion, various modules are described as separate modules; however, it is obvious to a person of ordinary skill in the art that two or more modules can be combined to form a single module that performs the relevant functions according to the implementation of the present solution.

[0073] In addition, memory or other storage and communication components can be used in the implementation of the present solution. It should be understood that, for the sake of clarity, the above description has described the implementation of the present solution with reference to different functional units and processors. However, it will be apparent that any appropriate functional distribution between different functional units, processing logic elements or domains can be used without departing from the present solution. For example, the function illustrated as being performed by a separate processing logic element or controller can be performed by the same processing logic element or controller. Therefore, reference to a specific functional unit is only a reference to a suitable device for providing the described function, rather than indicating a strict logical or physical structure or organization.

[0074] Various modifications to the embodiments described in this disclosure will be apparent to those skilled in the art, and the general principles defined herein may be applied to other embodiments without departing from the scope of this disclosure. Therefore, this disclosure is not intended to be limited to the embodiments shown herein, but is to be given the widest scope consistent with the novel features and principles disclosed herein, as described in the appended claims.

Claims

1. A method comprising: The first wireless communication device communicates with the wireless communication node via a data channel to share computer-generated sensing information, Wherein the media content is rendered using the computer-generated perceptual information.

2. The method according to claim 1, wherein: The media function of the wireless communication node communicates with the rendering function of the wireless communication node to obtain the computer-generated perception information and transmits the computer-generated perception information to the wireless communication device.

3. The method according to claim 1, comprising: The data channel is established by the first wireless communication device and the wireless communication node.

4. The method according to claim 1, comprising: A request for the computer-generated sensing information is sent by the first wireless communication device to the wireless communication node via the data channel.

5. The method according to claim 1, comprising: The computer-generated sensing information is received by the first wireless communication device from the wireless communication node via the data channel.

6. The method according to claim 1, comprising: generating the media content by the wireless communication device; rendering, by the first wireless communication device, the media content using the computer-generated perception information; as well as The rendered media content is sent by the first wireless communication device to a second wireless communication device via a media channel.

7. The method according to claim 1, comprising: Receiving, by the first wireless communication device, the media content from a second wireless communication device via a media channel; as well as The received media content is rendered by the first wireless communication device with the computer-generated perceptual information.

8. The method according to claim 1, comprising: The computer-generated sensing information is sent by the first wireless communication device to the wireless communication node via the data channel.

9. The method according to claim 8, wherein: The media function of the wireless communication node transmits the computer-generated perception information to a rendering function of the wireless communication node, and the rendering function stores the computer-generated perception information.

10. The method according to claim 8, comprising: The first wireless communication device sends the media content to the wireless communication node, Wherein, the wireless communication node renders the media content using the computer-generated perception information.

11. The method according to claim 10, wherein: A rendering function of the wireless communication node renders the media content using the computer-generated perception information.

12. The method according to claim 1, wherein: The data channel includes an application data channel.

13. The method according to any one of claims 1, 2 and 4 to 11, wherein: The computer-generated sensory information includes augmented reality (AR) specific data.

14. The method according to any one of claims 6 and 7, wherein: The media channel includes a real-time transport protocol (RTP) channel.

15. The method according to claim 1, wherein: The media content includes audio media content or video media content.

16. A method comprising: The wireless communication node communicates with the first wireless communication device via a data channel to share computer-generated sensing information, Wherein the media content is rendered using the computer-generated perceptual information. 17 . A non-transitory computer-readable storage medium storing instructions, which, when executed by at least one processor, enable the at least one processor to perform the method according to any one of claims 1 to 16.

18. An apparatus comprising at least one processor configured to perform the method according to any one of claims 1 to 16.

Images