Perception sharing between multi-modal devices
By sharing sensing data among multimodal devices, the synchronization and coordination issues between devices are resolved, improving the synchronization of multimodal service flows and user experience, and adapting to the technological improvements of 5G NR and 6G networks.
Patent Information
- Application Number
- CN202580027480.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2024-04-19
- Filing Date
- 2025-03-07
- Publication Date
- 2026-11-17
AI Technical Summary
In wireless communication, the lack of synchronization and coordination of sensing data in multimodal devices leads to a decline in communication quality, affecting the synchronization of multimodal service flows and user experience.
By sharing sensing data among multimodal devices, the sensing data can be used to maintain coordination and synchronization between devices, such as generating depth maps and 3D representations of the environment from image data, and adjusting communication links to avoid obstruction.
It improves the synchronization of multimodal service flows, enhances user experience, avoids communication degradation, and adapts to technological improvements in 5G NR and 6G networks.
Smart Images

Figure CN123125909A_ABST
Abstract
Description
[0001] Cross-references to related applications
[0002] This patent application claims priority to U.S. Patent Application No. 18 / 641,084, filed April 19, 2024, entitled “PERCEPTION SHARING BETWEENMULTI-MODAL DEVICES”, assigned to the assignee of this patent application. The disclosure of the earlier application is considered part of this patent application and is incorporated herein by reference. Technical Field
[0003] All aspects of this disclosure relate to wireless communication in general, and more particularly to techniques, apparatus and methods for sensing sharing between multimodal devices. Background Technology
[0004] Wireless communication systems are widely deployed to provide a variety of services, including voice, text, messaging, video, data, and / or other services. Services may include unicast, multicast, and / or broadcast services, etc. Typical wireless communication systems employ multiple access radio access technologies (RATs) capable of supporting communication with multiple users by sharing available system resources (e.g., time-domain resources, frequency-domain resources, spatial-domain resources, and / or device transmit power, etc.). Examples of such multiple access RATs include Code Division Multiple Access (CDMA) systems, Time Division Multiple Access (TDMA) systems, Frequency Division Multiple Access (FDMA) systems, Orthogonal Frequency Division Multiple Access (OFDMA) systems, Single-Carrier Frequency Division Multiple Access (SC-FDMA) systems, and Time Division Synchronous Code Division Multiple Access (TD-SCDMA) systems.
[0005] The aforementioned Multiple Access RATs have been adopted in various telecommunications standards to provide a common protocol enabling different wireless communication devices to communicate at the city, national, regional, or global level. An example telecommunications standard is New Radio (NR). NR (also known as 5G) is part of the continuous evolution of mobile broadband announced by the 3rd Generation Partnership Project (3GPP). NR (and other mobile broadband evolutions beyond NR) can be designed to better support the Internet of Things (IoT) and reduced-capacity device deployments, industrial connectivity, millimeter-wave (mmWave) expansion, licensed and unlicensed spectrum access, non-terrestrial network (NTN) deployments, sidelinks and other device-to-device direct communication technologies (e.g., cellular vehicle-to-everything (CV2X) communications), massive MIMO, decomposed network architectures and network topology expansion, multi-subscriber implementations, high-precision positioning and / or radio frequency (RF) sensing, and more. As the demand for mobile broadband access continues to grow, further improvements to NR can be implemented, and other radio access technologies (such as 6G) can be introduced to further advance mobile broadband evolution. Summary of the Invention
[0006] Some aspects described herein relate to a method of wireless communication performed by a first multimodal device. The method may include receiving sensing data associated with a multimodal session from a second multimodal device. The method may include communicating with network nodes based at least in part on the sensing data.
[0007] Some aspects described herein relate to a method of wireless communication performed by a first multimodal device. The method may include generating sensing data associated with a multimodal session. The method may also include transmitting the sensing data associated with the multimodal session to a second multimodal device.
[0008] Some aspects described herein relate to a non-transitory computer-readable medium storing a set of instructions for wireless communication by a first multimodal device. When executed by one or more processors of the first multimodal device, the set of instructions enables the first multimodal device to receive sensing data associated with a multimodal session from a second multimodal device. When executed by one or more processors of the first multimodal device, the set of instructions causes the first multimodal device to communicate with a network node, at least in part, based on the sensing data.
[0009] Some aspects described herein relate to a non-transitory computer-readable medium storing a set of instructions for wireless communication by a first multimodal device. When executed by one or more processors of the first multimodal device, the set of instructions enables the first multimodal device to generate sensing data associated with a multimodal session. When executed by one or more processors of the first multimodal device, the set of instructions enables the first multimodal device to transmit the sensing data associated with the multimodal session to a second multimodal device.
[0010] Some aspects described herein relate to a first multimodal device for wireless communication. The first multimodal device may include one or more memories and one or more processors coupled to the one or more memories. The one or more processors may be configured to receive sensing data associated with a multimodal session from a second multimodal device. The one or more processors may be configured to communicate with network nodes based at least in part on the sensing data.
[0011] Some aspects described herein relate to a first multimodal device for wireless communication. The first multimodal device may include one or more memories and one or more processors coupled to the one or more memories. The one or more processors may be configured to generate sensing data associated with a multimodal session. The one or more processors may be configured to transmit the sensing data associated with the multimodal session to a second multimodal device.
[0012] Some aspects described herein relate to an apparatus for wireless communication. The apparatus may include components for receiving sensing data associated with a multimodal session from a multimodal device. The apparatus may also include components for communicating with network nodes, at least in part, based on the sensing data.
[0013] Some aspects described herein relate to an apparatus for wireless communication. The apparatus may include components for generating sensing data associated with a multimodal session. The apparatus may also include components for transmitting the sensing data associated with the multimodal session to a multimodal device.
[0014] Various aspects of this disclosure may be implemented or be implemented as described in whole by or embodied in the methods, apparatus, systems, computer program products, non-transitory computer-readable media, user equipment, base stations, network nodes, network entities, wireless communication devices and / or processing systems as fully described in the specification and drawings and illustrated in the specification and drawings.
[0015] The preceding paragraphs of this section have broadly summarized some aspects of this disclosure. These and additional aspects and their associated advantages will be described below. The disclosed aspects can serve as the basis for modifying or designing other aspects for performing the same or similar purposes of this disclosure. Such equivalent aspects do not depart from the scope of the appended claims. The characteristics of the aspects disclosed herein, their organization and operation, and their associated advantages will be better understood from the following description taken in conjunction with the accompanying drawings. Attached Figure Description
[0016] The accompanying drawings illustrate some aspects of this disclosure but do not limit its scope, as other aspects can be achieved by this description. Each drawing in the drawings is provided for illustrative and descriptive purposes and not as a definition of limitation of the claims. Identical or similar reference numerals in different drawings may identify identical or similar elements.
[0017] Figure 1 This is a diagram illustrating an example of a wireless communication network according to the present disclosure.
[0018] Figure 2 This is a diagram illustrating communication between an example network node and an example UE in a wireless network according to this disclosure.
[0019] Figure 3 This is a diagram illustrating an example decomposed base station architecture according to this disclosure.
[0020] Figure 4 This is a diagram illustrating an example of a multimodal service as described in this disclosure.
[0021] Figure 5 This is a diagram illustrating an example of perception sharing associated with multimodal devices according to this disclosure.
[0022] Figure 6 This is a diagram illustrating an example process performed, for example, at a first multimodal device or a device of the first multimodal device, according to the present disclosure.
[0023] Figure 7 This is a diagram illustrating an example process performed, for example, at a first multimodal device or a device of the first multimodal device, according to the present disclosure.
[0024] Figure 8 This is a diagram of an example device for wireless communication according to the present disclosure.
[0025] Figure 9 This is a diagram of an example device for wireless communication according to the present disclosure. Detailed Implementation
[0026] Various aspects of this disclosure are described below with reference to the accompanying drawings. However, aspects of this disclosure may be embodied in many different forms and should not be construed as limited to any specific aspect illustrated or described with reference to the drawings or otherwise presented in this disclosure. Rather, these aspects are provided so that this disclosure will be comprehensive and complete, and will fully convey the scope of protection of this disclosure to those skilled in the art. Those skilled in the art will understand that the scope of this disclosure is intended to cover any aspect of this disclosure disclosed herein, whether implemented independently of or in combination with any other aspect of this disclosure. For example, various combinations or numbers of aspects set forth herein may be used to implement an apparatus or practice. Furthermore, the scope of this disclosure is intended to cover apparatuses having structures and / or functionalities other than those available for practicing the various aspects of this disclosure set forth herein, or methods practiced using these other structures and / or functionalities. Any aspect of this disclosure disclosed herein may be embodied by one or more elements of the claims.
[0027] Various methods, operations, apparatuses, and techniques will now be presented with reference to them. These methods, operations, apparatuses, and techniques will be described in detail below and illustrated in the accompanying drawings by various boxes, modules, components, circuits, steps, processes, or algorithms (collectively, “elements”). These elements may be implemented using hardware, software, or a combination of hardware and software. Whether such elements are implemented as hardware or software depends on the specific application and the design constraints imposed on the system as a whole.
[0028] In some examples, an application service can be a multimodal service. A multimodal service can be associated with a multimodal business. As used herein, "multimodal business" can refer to a business associated with multiple modes of an application. For example, some applications can generate multiple types of uplink data streams (e.g., multiple modes). For example, an application (e.g., an extended reality (XR) application or a virtual reality (VR) application) can generate audio data, video data, location data, haptic data, and / or other types of data, each associated with the application. For example, an application can implement input from more than one source (such as business streams for audio, video, location, and / or haptics, etc.).
[0029] For example, an application service may be associated with a user equipment (UE) in a first mode (or a first service data stream) and a UE in a second mode (or a second service data stream). These UEs may be the same UE or different UEs. As an example, a UE associated with the first mode may include a head-mounted device, such as a VR headset or VR goggles (e.g., associated with audio and / or video data). A UE associated with the second mode may include wearable components, such as gloves, associated with obtaining tactile data as input.
[0030] Multimodal services can consist of multiple data streams (collectively referred to as multimodal data streams) that are related to each other and may originate from different sources. Each data stream (individually referred to as a unimodal data stream) can be considered as one type of data associated with the same communication service (e.g., audio, video, location, haptic, and / or another type of data). Multimodal data streams may carry closely related data and may require strong coordination to deliver multimodal application data correctly. For example, synchronization between different data streams of the same multimodal application (e.g., between different media components of an XR application) may be important to ensure a positive user experience.
[0031] For example, if the data streams of different media components of the same multimodal application are out of sync, users may be able to detect the lack of synchronization, resulting in a poor user experience. Therefore, in some cases, two or more data streams (e.g., associated with different modalities or media components) may be associated with a synchronization threshold. As used herein, a “synchronization threshold” can refer to the allowable amount of time between the transmission of services associated with two or more data streams (e.g., associated with different modalities or media components) to ensure that a lack of synchronization is not detected.
[0032] To maintain coordination and synchronization among multimodal devices (e.g., devices associated with multimodal services, multimodal applications, and / or multimodal applications), the multimodal devices should utilize communication channels with the same or similar channel conditions. In some cases, one of the multimodal devices may include one or more sensors (e.g., inertial measurement units (IMUs), cameras, temperature sensors, microphones, and / or other types of sensors) to acquire sensed data.
[0033] Perception data may include data that multimodal devices can use to construct perception or awareness of their surrounding environment. For example, perception or awareness of the environment may include obstruction detection (e.g., using image data to detect whether a communication link or channel will be blocked by an object), depth maps, three-dimensional (3D) reconstructions of the environment, radio frequency (RF) maps, estimation of user location, and / or estimation of user orientation.
[0034] In some cases, multimodal devices can utilize sensory data to generate perception or awareness of their environment, and / or adjust one or more parameters of the multimodal device. For example, a multimodal device can use image data to generate a depth map and / or 3D representation of the environment, and can determine, based on the image data, depth map, and / or 3D representation of the environment, that an object is moving through the environment and will block the communication link currently being used by the multimodal device. The multimodal device can switch to a different communication link to prevent communication degradation caused by an object blocking the current communication link.
[0035] However, another multimodal device may not be configured to acquire sensing data, and / or may not be configured to acquire sensing data that can be used to detect objects and / or determine that objects will obstruct the communication link. Due to the failure to detect objects and / or determine that objects will obstruct the communication link, the other multimodal device may experience communication degradation (e.g., an increased amount of time required to transmit data between the other multimodal device and another device).
[0036] Overall, these aspects involve utilizing sensed data to maintain coordination and synchronization among multimodal devices. Some aspects are more specifically related to sharing sensed data among multimodal devices. In some aspects, multimodal devices can identify other multimodal devices that cannot generate sensed data of a specific pattern or type, and multimodal devices can send sensed data of a specific pattern or type to other multimodal devices.
[0037] Specific aspects of the subject matter described in this disclosure may be implemented to achieve one or more of the following potential advantages. In some examples, by leveraging sensed data to maintain coordination and synchronization between multimodal devices, the described techniques can be used to increase the likelihood that multimodal business flows associated with multimodal services or applications are synchronized (e.g., synchronized in the time domain).
[0038] Multiple access radio access technology (RAT) has been adopted in various telecommunications standards to provide a common protocol that enables wireless communication devices to communicate at the city, enterprise, national, regional, or global level. For example, 5G New Radio (NR) is part of the continuous mobile broadband evolution announced by the 3rd Generation Partnership Project (3GPP). 5G NR supports a variety of technologies and use cases, including enhanced mobile broadband (eMBB), ultra-reliable low-latency communication (URLLC), massive machine-type communication (mMTC), millimeter wave (mmWave) technology, beamforming, network slicing, edge computing, Internet of Things (IoT) connectivity and management, and network function virtualization (NFV).
[0039] With increasing demand for broadband access and the evolution of technologies supported by wireless communication networks, further technological improvements can be adopted in or implemented for 5G NR or future RATs (such as 6G) to further advance the evolution of wireless communication for a variety of existing and new use cases and applications. These technological improvements can be associated with new frequency band extensions, licensed and unlicensed spectrum access, overlapping spectrum use, small cell deployments, non-terrestrial network (NTN) deployments, decomposed network architectures and network topology extensions, device aggregation, advanced duplex communication, sidelinks and other device-to-device direct communication, IoT (including passive or ambient IoT) networks, reduced-capacity (RedCap) UE functionality, industrial connectivity, multi-subscriber implementations, high-precision positioning, radio frequency (RF) sensing and / or artificial intelligence or machine learning (AI / ML), and more. Such technological improvements can support use cases such as wireless backhaul, wireless data centers, extended reality (XR) and metaverse applications, meta-services for supporting vehicle connectivity, holographic and mixed reality communications, autonomous and collaborative robots, vehicle platooning and collaborative manipulation, sensor networks, posture monitoring, brain-computer interfaces, digital twin applications, asset management, and general coverage applications using off-ground and / or aerial platforms, etc. The methods, operations, apparatuses, and techniques described herein can implement one or more of the foregoing technologies and / or support one or more of the foregoing use cases.
[0040] Figure 1 This is a diagram illustrating an example of a wireless communication network 100 according to the present disclosure. The wireless communication network 100 may be a 5G (or NR) network or a 6G network, or may include elements of a 5G (or NR) network or elements of a 6G network, etc. The wireless communication network 100 may include a plurality of network nodes 110, shown as network node (NN) 110a, network node 110b, network node 110c, and network node 110d. Network nodes 110 may support communication with a plurality of UEs 120 (shown as UE120a, UE 120b, UE 120c, UE 120d, and UE 120e).
[0041] Network nodes 110 and UEs 120 of wireless communication network 100 can communicate using the electromagnetic spectrum, which can be subdivided into various categories, bands, carriers, and / or channels according to frequency or wavelength. For example, devices of wireless communication network 100 can communicate using one or more operating bands. In some aspects, multiple wireless networks 100 can be deployed in a given geographical area. Each wireless communication network 100 can support a specific RAT (which may also be referred to as an air interface) and can operate on one or more carrier frequencies in one or more frequency ranges. Examples of RATs include 4G RATs, 5G / NR RATs, and / or 6G RATs, etc. In some examples, when multiple RATs are deployed in a given geographical area, each RAT in that geographical area can operate on a different frequency to avoid interference with each other.
[0042] Various operating bands have been defined by frequency range designations: FR1 (410 MHz to 7.125 GHz), FR2 (24.25 GHz to 52.6 GHz), FR3 (7.125 GHz to 24.25 GHz), FR4a or FR4-1 (52.6 GHz to 71 GHz), FR4 (52.6 GHz to 114.25 GHz), and FR5 (114.25 GHz to 300 GHz). Although a portion of FR1 is greater than 6 GHz, in some documents and articles, FR1 is often (interchangeably) referred to as the “sub-6 GHz” band. Similarly, in some documents and articles, FR2 is often (interchangeably) referred to as the “millimeter wave” band, but this is distinct from the Extremely High Frequency (EHF) band (30 GHz to 300 GHz) designated as the “millimeter wave” band by the International Telecommunication Union (ITU). The frequencies between FR1 and FR2 are generally referred to as the midband frequencies, including FR3. Frequency bands falling within FR3 can inherit FR1 or FR2 characteristics, thereby effectively extending the characteristics of FR1 or FR2 into the midband frequency range. Therefore, "below 6 GHz" (if used herein) can broadly refer to frequencies less than 6 GHz, within FR1, and / or included in the midband frequency range. Similarly, the term "millimeter wave" (if used herein) can broadly refer to frequencies included in the midband frequency range, within FR2, FR4, FR4-a, FR4-1, or FR5, and / or within the EHF band. Higher frequency bands can extend 5G NR operation, 6G operation, and / or other RATs above 52.6 GHz. For example, each of FR4a, FR4-1, FR4, and FR5 falls within the EHF band. In some examples, the wireless communication network 100 can implement dynamic spectrum sharing (DSS), where multiple RATs (e.g., 4G / LTE and 5G / NR) are implemented within a single frequency band using dynamic bandwidth allocation (e.g., based on user demand). It is conceivable that the frequencies included in these operating bands (e.g., FR1, FR2, FR3, FR4, FR4-a, FR4-1 and / or FR5) can be modified, and the techniques described herein are applicable to those modified frequency ranges.
[0043] Network node 110 may include one or more devices, components, or systems that enable communication between UE 120 and one or more devices, components, or systems of wireless communication network 100. Network node 110 may be, may include, or may also be referred to as an NR network node, 5G network node, 6G network node, node B, eNB, gNB, access point (AP), transmit / receive point (TRP), mobility element, core, network entity, network element, network equipment, and / or another type of device, component, or system included in a radio access network (RAN).
[0044] Network node 110 may be implemented as a single physical node (e.g., a single physical structure) or as two or more physical nodes (e.g., two or more different physical structures). For example, network node 110 may be a device or system implementing a portion of a radio protocol stack, a device or system implementing a complete radio protocol stack (such as a complete gNB protocol stack), or a collection of devices or systems collectively implementing a complete radio protocol stack. For example, and as shown, network node 110 may be an aggregated network node (with an aggregated architecture), meaning that network node 110 can implement a complete radio protocol stack physically and logically integrated within a single node (e.g., a single physical structure) in the wireless communication network 100. For example, aggregated network node 110 may consist of a single standalone base station or a single TRP that uses a complete radio protocol stack to implement or facilitate communication between UE 120 and the core network of wireless communication network 100.
[0045] Alternatively, and also as shown in the figure, network node 110 can be a decomposed network node (sometimes referred to as a decomposed base station), meaning that network node 110 can realize a radio protocol stack that is physically distributed and / or logically distributed among two or more nodes in the same or different geographic locations. For example, a decomposed network node may have a decomposed architecture. In some deployments, decomposed network node 110 may be used in integrated access and backhaul (IAB) networks, in open radio access networks (O-RAN) (such as network configurations compliant with the O-RAN Alliance), or in virtualized radio access networks (vRAN) (also referred to as cloud radio access networks (C-RAN)) to facilitate scaling by decomposing base station functionality into multiple units that can be deployed independently.
[0046] Network nodes 110 of the wireless communication network 100 may include one or more central units (CUs), one or more distributed units (DUs), and / or one or more radio units (RUs). CUs may host one or more higher-layer control functions, such as Radio Resource Control (RRC) functions, Packet Data Convergence Protocol (PDCP) functions, and / or Service Data Adaptation Protocol (SDAP) functions, etc. DUs may host one or more of the Radio Link Control (RLC) layer, Media Access Control (MAC) layer, and / or one or more higher physical (PHY) layers, at least in part, according to functional splits (such as functional splits defined by 3GPP). In some examples, DUs may also host one or more lower PHY layer functions, such as Fast Fourier Transform (FFT), Inverse FFT (iFFT), beamforming, Physical Random Access Channel (PRACH) extraction and filtering, and / or scheduling of resources for one or more UEs 120, etc. RUs may host RF processing functions or lower PHY layer functions, such as FFT, iFFT, beamforming, or PRACH extraction and filtering, etc., according to functional splits (such as lower-layer functional splits). In this type of architecture, each RU can be operated to handle over-the-air (OTA) communications with one or more UE 120s.
[0047] In some aspects, a single network node 110 may include a combination of one or more CUs, one or more DUs, and / or one or more RUs. Additionally or alternatively, network node 110 may include one or more near real-time (near RT) RAN Intelligent Controllers (RICs) and / or one or more non-real-time (non-RT) RICs. In some examples, CUs, DUs, and / or RUs may be implemented as virtual units, such as Virtual Central Units (VCUs), Virtual Distributed Units (VDUs), or Virtual Radio Units (VRUs), etc. Virtual units may be implemented as virtual network functions, such as those associated with cloud deployments.
[0048] Some network nodes 110 (e.g., base stations, RUs, or TRPs) can provide communication coverage for a specific geographic area. In 3GPP, the term "cell" can refer to the coverage area of network node 110 or to network node 110 itself, depending on the context in which the term is used. Network node 110 can support one or more (e.g., three) cells. In some examples, network node 110 can provide communication coverage for macro cells, pico cells, femto cells, or another type of cell. A macro cell can cover a relatively large geographic area (e.g., a radius of several kilometers) and can allow unrestricted access by UE 120 with a service subscription. A pico cell can cover a relatively small geographic area and can allow unrestricted access by UE 120 with a service subscription. A femto cell can cover a relatively small geographic area (e.g., a residential area) and can allow restricted access by UE 120 associated with that femto cell (e.g., UE 120 in a Closed Subscriber Group (CSG)). The network node 110 used for a macro cell can be referred to as a macro network node. Network node 110 used for a picocell may be referred to as a pico network node. Network node 110 used for a femtocell may be referred to as a femto network node or a home network node. In some examples, the cell may not necessarily be stationary. For example, the geographical area of the cell may move depending on the location of the associated mobile network node 110 (e.g., a train, satellite base station, drone, or NTN network node).
[0049] The wireless communication network 100 can be a heterogeneous network, comprising different types of network nodes 110, such as macro network nodes, piconet nodes, femtonet nodes, relay network nodes, aggregation network nodes, and / or decomposition network nodes, etc. Figure 1 In the example shown, network node 110a can be a macro network node for macro cell 130a, network node 110b can be a pico network node for pico cell 130b, and network node 110c can be a femto network node for femto cell 130c. Compared to other types of network nodes 110, the various types of network nodes 110 typically transmit at different power levels, serve different coverage areas, and / or have different effects on interference in the wireless communication network 100. For example, macro network nodes may have high transmit power levels (e.g., 5 watts to 40 watts), while pico network nodes, femto network nodes, and relay network nodes may have lower transmit power levels (e.g., 0.1 watts to 2 watts).
[0050] In some examples, network node 110 may be, may include, or operate as a RU, TRP, or base station communicating with one or more UEs 120 via a radio access link (which may be referred to as a "Uu" link). The radio access link may include a downlink and an uplink. A "downlink" (or "DL") refers to the communication direction from network node 110 to UE 120, and an "uplink" (or "UL") refers to the communication direction from UE 120 to network node 110. Downlink channels may include one or more control channels and one or more data channels. Downlink control channels may be used to transmit downlink control information (DCI) (e.g., scheduling information, reference signals, and / or configuration information) from network node 110 to UE 120. Downlink data channels may be used to transmit downlink data (e.g., user data associated with UE 120) from network node 110 to UE 120. Downlink control channels may include one or more physical downlink control channels (PDCCH), and downlink data channels may include one or more physical downlink shared channels (PDSCH). The uplink channel may similarly include one or more control channels and one or more data channels. The uplink control channel can be used to transmit uplink control information (UCI) from UE 120 to network node 110 (e.g., transmitting corresponding reference signals and / or feedback with one or more downlinks). The uplink data channel can be used to transmit uplink data (e.g., user data associated with UE 120) from UE 120 to network node 110. The uplink control channel may include one or more physical uplink control channels (PUCCH), and the uplink data channel may include one or more physical uplink shared channels (PUSCH). The downlink and uplink may each include a set of resources on which network node 110 and UE 120 can communicate.
[0051] Downlink and uplink resources may include time-domain resources (frames, subframes, time slots, and / or symbols), frequency-domain resources (bands, component carriers, subcarriers, resource blocks, and / or resource elements), and / or spatial-domain resources (specific transmission directions and / or beam parameters). Frequency-domain resources in some bands may be subdivided into bandwidth portions (BWPs). A BWP may be a contiguous block of frequency-domain resources allocated to one or more UEs 120 (e.g., a contiguous block of resource blocks). UEs 120 may be configured using both uplink and downlink BWPs (where the uplink and downlink BWPs may be the same BWP or different BWPs). BWPs may be dynamically configured and / or reconfigured (e.g., by sending DCI configuration to one or more UEs 120 via network node 110), meaning that BWPs may be adjusted in real-time (or near real-time) based on changing network conditions in the wireless communication network 100 and / or based on the specific requirements of one or more UEs 120. This allows for more efficient use of available frequency domain resources in the wireless communication network 100, as fewer frequency domain resources can be allocated to the BWP for UE 120 (which reduces the number of frequency domain resources that UE 120 needs to monitor), thus allowing more frequency domain resources to be distributed across multiple UE 120s. Therefore, the BWP can also assist in the implementation of such UE 120s by facilitating the configuration of smaller bandwidths for communications performed by lower-capacity UE 120s.
[0052] As described above, in some aspects, the wireless communication network 100 may be an IAB network, may include an IAB network, or may be included in an IAB network. In an IAB network, at least one network node 110 is an anchor network node communicating with a core network. The anchor network node 110 may also be referred to as an IAB donor (or "IAB donor"). The anchor network node 110 may be connected to the core network via a wired backhaul link. For example, the Ng interface of the anchor network node 110 may terminate at the core network. Additionally or alternatively, the anchor network node 110 may be connected to one or more devices in the core network that provide core access and mobility management functions (AMF). An IAB network typically also includes multiple non-anchor network nodes 110, which may also be referred to as relay network nodes or simply IAB nodes (or "IAB-nodes"). Each non-anchor network node 110 can directly communicate with the anchor network node 110 via a wireless backhaul link to access the core network, or can indirectly communicate with the anchor network node 110 via one or more other non-anchor network nodes 110 and an associated wireless backhaul link forming a backhaul path to the core network. Some anchor network nodes 110 or other non-anchor network nodes 110 can also directly communicate with one or more UEs 120 via a wireless access link carrying access services. In some examples, network resources used for wireless communication (such as time resources, frequency resources, and / or spatial resources) can be shared between the access link and the backhaul link.
[0053] In some examples, any network node 110 relaying communication may be referred to as a relay network node, a relay station, or simply a repeater. A repeater may receive communications from an upstream station (e.g., another network node 110 or UE 120) and transmit communications to a downstream station (e.g., UE 120 or another network node 110). In this case, the wireless communication network 100 may include or be referred to as a "multi-hop network." Figure 1 In the example shown, network node 110d (e.g., a relay network node) can communicate with network node 110a (e.g., a macro network node) and UE 120d to facilitate communication between network node 110a and UE 120d. Additionally or alternatively, UE 120 can be a relay station capable of relaying transmissions to or from other UE 120s, or can operate as such a relay station. UE 120 relaying communication can be referred to as a UE repeater or relay UE, etc.
[0054] UE 120 may be physically distributed throughout the wireless communication network 100, and each UE 120 may be stationary or mobile. UE 120 may be, may include, an access terminal, another terminal, a mobile station, or a subscriber unit, or may be included in an access terminal, another terminal, a mobile station, or a subscriber unit. UE 120 may be, or may include, a cellular phone (e.g., a smartphone), a personal digital assistant (PDA), a wireless modem, a wireless communication device, a handheld device, a laptop computer, a cordless phone, a wireless local loop (WLL) station, a tablet computer, a camera, a gaming device, a netbook, a smartbook, an ultrabook, a medical device, a biometric device, a wearable device (e.g., a smartwatch, smart clothing, smart glasses, a smart wristband and / or smart jewelry (such as a smart ring or smart bracelet)), an entertainment device (e.g., a music device, a video device and / or a satellite radio), an XR device, a vehicle component or sensor, a smart meter or sensor, industrial manufacturing equipment, a Global Navigation Satellite System (GNSS) device (such as a Global Positioning System device or another type of positioning device), a UE function of a network node, and / or any other suitable device or function that can communicate via a wireless medium, or may be coupled to them.
[0055] UE 120 and / or network node 110 may include one or more chips, system-on-a-chip (SoC), chipsets, packages, or devices that individually or collectively constitute or include a processing system. The processing system includes processor (or “processing”) circuitry in the form of one or more processors, microprocessors, processing units (such as central processing units (CPUs), graphics processing units (GPUs), neural processing units (NPUs), and / or digital signal processors (DSPs)), processing blocks, application-specific integrated circuits (ASICs), programmable logic devices (PLDs) (such as field-programmable gate arrays (FPGAs)), or other discrete gate or transistor logic components or circuits (all of which are generally referred to herein individually as “processors” or collectively as “processors” or “processor circuitry”). One or more of these processors may be individually or collectively configured to perform the various functions or operations described herein. A processor group that can be configured or configured to perform a set of functions may include a first processor that can be configured or configured to perform a first function in the set, and a second processor that can be configured or configured to perform a second function in the set, or may include the entire processor group that is configured or configured to perform the set of functions.
[0056] The processing system may also include memory circuitry in the form of one or more memory devices, memory blocks, memory elements, or other discrete gate or transistor logic components or circuits, each of which may include tangible storage media such as random access memory (RAM) or read-only memory (ROM) or combinations thereof (all of which are generally referred to herein individually as "memory" or collectively as "memory" or "memory circuitry"). One or more of these memories may be coupled to one or more processors in the processor (e.g., operatively coupled, communicatively coupled, electronically coupled, or electrically coupled) and may store processor-executable code (such as software) individually or collectively, which, when executed by one or more processors in the processor, may configure one or more processors in the processor to perform the various functions or operations described herein. Additionally or alternatively, in some examples, one or more processors in the processor may be pre-configured to perform the various functions or operations described herein without being configured by software. The processing system may also include or be coupled to one or more modems (such as Wi-Fi (e.g., IEEE compliant) modems or cellular (e.g., 3GPP 4G LTE, 5G, or 6G compliant) modems). In some embodiments, one or more processors of the processing system include or implement one or more modems among the modems. The processing system may also include, or be coupled to, multiple radio components (collectively, “radio components”), multiple RF chains, or multiple transceivers, each of which may in turn be coupled to one or more antennas among multiple antennas. In some embodiments, one or more processors of the processing system include or implement one or more of the radio components, RF chains, or transceivers. UE 120 may be included or may be contained in a housing that houses components associated with UE 120, including the processing system.
[0057] Some UEs 120 may be considered Machine Type Communication (MTC) UEs, Evolved or Enhanced Machine Type Communication (eMTC) UEs, Further Enhanced eMTC (feMTC) UEs or Enhanced feMTC (efeMTC) UEs, or further evolutions thereof, all of which may be collectively referred to as "MTC UEs". MTC UEs may be, may include, or may be included in or coupled with the following: robots, unmanned aerial vehicles, remote devices, sensors, instruments, monitors, and / or location tags. Some UEs 120 may be considered IoT devices and / or may be implemented as NB-IoT (Narrowband IoT) devices. IoT UEs or NB-IoT devices may be, may include, or may be included in or coupled with the following: industrial machines, appliances, refrigerators, doorbell camera devices, home automation devices, and / or lighting fixtures, etc. Some UEs 120 may be considered customer premises equipment, which may include telecommunications equipment installed at a customer location (such as a home or office) to enable access to a service provider’s network (such as being included in or communicating with the wireless communication network 100).
[0058] Some UEs 120 can be categorized according to different categories associated with varying levels of complexity and / or capabilities. UEs 120 in the first category facilitate large-scale IoT within the wireless communication network 100 and offer lower complexity and / or lower cost compared to UEs 120 in the second category. UEs 120 in the second category may include mission-critical IoT devices capable of URLLC, enhanced mobile broadband (eMBB), and / or precise positioning within the wireless communication network 100, legacy UEs, baseline UEs, high-level UEs, advanced UEs, full-capability UEs, and / or premium UEs. UEs 120 in the third category may have intermediate-level complexity and / or capabilities (e.g., capabilities between UEs 120 in the first category and UEs 120 in the second category). UEs 120 in the third category may be referred to as reduced-capacity UEs (“RedCap UEs”), intermediate-level UEs, NR lightweight UEs, and / or NR simplified UEs, etc. RedCap UEs bridge the gap in capabilities and complexity between NB-IoT devices and / or eMTC UEs and mission-critical IoT devices and / or premium UEs. RedCap UEs can include, for example, wearable devices, IoT devices, industrial sensors, and / or cameras associated with limited bandwidth, power capacity, and / or transmission range. RedCap UEs can support healthcare environments, building automation, power distribution, process automation, transportation and logistics, and / or smart city deployments, among others.
[0059] In some examples, two or more UEs 120 (e.g., shown as UE 120a and UE 120e) can communicate directly with each other using sidelink communication (e.g., without communicating through a network node 110 acting as an intermediary). As an example, UE 120a can send data, control information, or other signaling directly to UE 120e as sidelink communication. This contrasts with, for example, UE 120a first sending data to network node 110 in UL communication, and then that network node sending data to UE 120e in DL communication. In various examples, UE 120 can use peer-to-peer (P2P) communication protocols, device-to-device (D2D) communication protocols, vehicle-to-everything (V2X) communication protocols (which may include vehicle-to-vehicle (V2V) protocols, vehicle-to-infrastructure (V2I) protocols, and / or vehicle-to-pedestrian (V2P) protocols), and / or mesh network communication protocols to send and receive sidelink communication. In some deployments and configurations, network node 110 may schedule and / or allocate resources for sidelink communication between UEs 120 in the wireless communication network 100. In some other deployments and configurations, UE 120 (instead of network node 110) may perform or cooperate with or negotiate with one or more other UEs to perform scheduling operations, resource selection operations, and / or other operations for sidelink communication.
[0060] In various examples, in addition to half-duplex operation, some network nodes and UEs in the wireless communication network 100, including network node 110 and UE 120, can also be configured for full-duplex operation. Network node 110 or UE 120 operating in half-duplex mode can perform only one of transmission or reception during a specific time resource period (such as a specific time slot, symbol, or other time period). Half-duplex operation may involve time division duplex (TDD), where the DL transmission of network node 110 and the UL transmission of UE 120 do not occur in the same time resource (i.e., the transmissions do not overlap in time). In contrast, network node 110 or UE 120 operating in full-duplex mode can transmit and receive communications concurrently (e.g., within the same time resource). By operating in full-duplex mode, network node 110 and / or UE 120 can generally increase the capacity of the network and radio access links. In some examples, full-duplex operation may involve frequency division duplex (FDD), in which network node 110 performs DL transmission in a first frequency band or on a first component carrier, and UE 120 performs transmission in a second frequency band or on a second component carrier, the second frequency band or the second component carrier being different from the first frequency band or the first component carrier, respectively. In some examples, full-duplex operation may be enabled for UE 120 but not for network node 110. For example, UE 120 may simultaneously transmit UL to the first network node 110 and receive DL transmissions from the second network node 110 in the same time resources. In some other examples, full-duplex operation may be enabled for network node 110 but not for UE 120. For example, network node 110 may simultaneously transmit DL to the first UE 120 and receive UL transmissions from the second UE 120 in the same time resources. In some other examples, full-duplex operation may be enabled for both network node 110 and UE 120.
[0061] In some examples, UE 120 and network node 110 can perform MIMO communication. "MIMO" generally refers to the simultaneous transmission or reception of multiple signals (such as multiple layers or multiple data streams) using the same time and frequency resources. MIMO techniques typically utilize multipath propagation. MIMO can be implemented using various spatial processing or spatial multiplexing operations. In some examples, MIMO can support simultaneous transmission to multiple receivers, which is called multi-user MIMO (MU-MIMO). Some RATs can employ advanced MIMO techniques such as mTRP operations (including redundant transmission or reception on multiple TRPs), reciprocity in the time or frequency domain, single-frequency network (SFN) transmission, or noncoherent joint transmission (NC-JT).
[0062] In some aspects, the first multimodal device may include a communication manager 140. As described in more detail elsewhere herein, the communication manager 140 may receive sensing data associated with the multimodal session from the second multimodal device; and communicate with network nodes at least in part based on the sensing data. Additionally or alternatively, the communication manager 140 may perform one or more other operations described herein.
[0063] In some aspects, the first multimodal device may include a communication manager 140. As described in more detail elsewhere herein, the communication manager 140 may generate sensing data associated with the multimodal session and transmit the sensing data associated with the multimodal session to a second multimodal device. Additionally or alternatively, the communication manager 140 may perform one or more other operations described herein.
[0064] As indicated above, Figure 1 This is provided as an example. Other examples are available with reference to [the relevant information]. Figure 1 The examples described are different.
[0065] Figure 2 This is a diagram illustrating an example network node 110 communicating with an example UE 120 in a wireless network according to the present disclosure.
[0066] like Figure 2 As shown, network node 110 may include a data source 212, a transmit processor 214, a transmit (TX) MIMO processor 216, a set of modems 232 (shown as 232a to 232t, where t≥1), a set of antennas 234 (shown as 234a to 234v, where v≥1), a MIMO detector 236, a receive processor 238, a data sink 239, a controller / processor 240, a memory 242, a communication unit 244, a scheduler 246, and / or a communication manager 150, etc. In some configurations, one or a combination of antennas 234, modems 232, MIMO detectors 236, receive processors 238, transmit processors 214, and / or TX MIMO processors 216 may be included in the transceiver of network node 110. The transceiver may be under the control of and used by one or more processors (such as controller / processor 240), and in some respects, may perform aspects of the methods, procedures and / or operations described herein in conjunction with processor-readable code stored in memory 242. In some respects, network node 110 may include one or more interfaces, communication components and / or other components that facilitate communication with UE 120 or another network node.
[0067] The terms “processor,” “controller,” or “controller / processor” can refer to one or more controllers and / or one or more processors. For example, references to “a / the processor,” “a / the controller / processor,” etc. (in the singular) should be understood as referring to a combination of… Figure 2 The processor described refers to any one or more processors, such as a single processor or a combination of multiple different processors. The reference to "one or more processors" should be understood as a combination of references. Figure 2 Any one or more processors described herein. For example, one or more processors of network node 110 may include transmit processor 214, TX MIMO processor 216, MIMO detector 236, receive processor 238, and / or controller / processor 240. Similarly, one or more processors of UE 120 may include MIMO detector 256, receive processor 258, transmit processor 264, TX MIMO processor 266, and / or controller / processor 280.
[0068] In some aspects, a single processor can perform all operations described as being performed by one or more processors. In some aspects, a first set of one or more processors can perform a first operation described as being performed by that one or more processors, and a second set of one or more processors can perform a second operation described as being performed by that one or more processors. The processors in the first set and the processors in the second set can be from the same set of processors or can be from different sets of processors. The reference to "one or more memories" should be understood to refer to any one or more memories of the corresponding device, such as those in combination. Figure 2 The memory described. For example, an operation described as being performed by one or more memories can be performed by the same subset of the one or more memories or by different subsets of the one or more memories.
[0069] For downlink communication from network node 110 to UE 120, transmitting processor 214 may receive data (“downlink data”) intended for use by UE 120 (or a set of UEs including UE 120) from data source 212 (such as a data pipeline or data queue). In some examples, transmitting processor 214 may select one or more MCSs for UE 120 based on one or more Channel Quality Indicators (CQIs) received from UE 120. Network node 110 may process the data (e.g., including encoding the data) according to the MCS selected for UE 120 for transmission to UE 120 on the downlink, thereby generating data symbols. Transmitting processor 214 may process system information (e.g., semi-static resource partitioning information (SRPI)) and / or control information (e.g., CQI requests, grants, and / or upper-layer signaling) and provide overhead symbols and / or control symbols. The transmitting processor 214 can generate reference symbols for reference signals (e.g., cell-specific reference signals (CRS), demodulation reference signals (DMRS), or channel state information (CSI) reference signals (CSI-RS)) and / or synchronization signals (e.g., primary synchronization signal (PSS) or secondary synchronization signal (SSS)).
[0070] The TX MIMO processor 216 can perform space processing (e.g., pre-decoding) on data symbols, control symbols, overhead symbols, and / or reference symbols where applicable, and can output a set of symbol streams (e.g., T A set of output symbol streams is provided to modem 232. For example, each output symbol stream may be provided to a corresponding modulator component (shown as MOD) of modem 232. Each modem 232 may use the corresponding modulator component to process (e.g., modulate) the corresponding output symbol stream (e.g., for orthogonal frequency division multiplexing (OFDM)) to obtain an output sample stream. Each modem 232 may further use the corresponding modulator component to process (e.g., convert to analog, amplify, filter, and / or upconvert) the output sample stream to obtain a time-domain downlink signal. Modems 232a to 232t may transmit the set of downlink signals (e.g., via a set of corresponding antennas 234) together. T (One downlink signal).
[0071] Downlink signals may include DCI communication, MAC control element (MAC-CE) communication, RRC communication, downlink reference signals, or another type of downlink communication. Downlink signals may be transmitted on the PDCCH, PDSCH, and / or on another downlink channel. Downlink signals may carry one or more transport blocks (TBs) of data. A TB may be a data unit transmitted via the air interface in the wireless communication network 100. A data stream (e.g., from data source 212) may be encoded into multiple TBs for transmission via the air interface. The number of TBs used to carry data associated with a particular data stream may be associated with a TB size shared by multiple TBs. The TB size may be based on the radio channel conditions of the air interface, the MCS used to encode the data, downlink resources allocated for transmitting data, and / or other parameters, or otherwise associated with them. Generally, a larger TB size allows for a larger amount of data to be transmitted in a single transmission, reducing signaling overhead. However, a larger TB size may be more prone to transmission and / or reception errors than a smaller TB size, but such errors can be mitigated through more robust error correction techniques.
[0072] For uplink communication from UE 120 to network node 110, the uplink signal from UE 120 may be received by antenna 234, processed by modem 232 (e.g., demodulator component of modem 232, shown as DEMOD), detected where applicable by MIMO detector 236 (e.g., receive (Rx) MIMO processor), and / or further processed by receive processor 238 to obtain decoded data and / or control information. Receive processor 238 may provide the decoded data to data sink 239 (which may be a data pipeline, data queue, and / or another type of data sink) and provide the decoded control information to processors such as controller / processor 240.
[0073] Network node 110 may use scheduler 246 to schedule one or more UEs 120 for downlink or uplink communication. In some aspects, scheduler 246 may use DCI to dynamically schedule DL transmissions to and / or UL transmissions from UE 120. In some examples, scheduler 246 may allocate repetitive time-domain and / or frequency-domain resources that UE 120 may use to transmit and / or receive communication using RRC configuration (e.g., semi-static configuration), for example, to perform semi-persistent scheduling (SPS) or to configure configuration grant (CG) for UE 120.
[0074] One or more of the following may be included in the RF chain of network node 110: transmit processor 214, TX MIMO processor 216, modem 232, antenna 234, MIMO detector 236, receive processor 238, and / or controller / processor 240. The RF chain may include one or more filters, mixers, oscillators, amplifiers, analog-to-digital converters (ADCs), and / or other devices for converting analog signals (such as those used for transmission or reception via an air interface) to digital signals (such as those used for processing by one or more processors of network node 110). In some aspects, the RF chain may be a transceiver of network node 110, or may be included in such a transceiver.
[0075] In some examples, network node 110 may use communication unit 244 to communicate with the core network and / or other network nodes. Communication unit 244 may support wired and / or wireless communication protocols and / or connections, such as Ethernet, fiber optic, Common Public Radio Interface (CPRI), and / or wired or wireless backhaul, etc. Network node 110 may use communication unit 244 to send and / or receive data associated with UE 120, or to perform network control signaling, etc. Communication unit 244 may include transceivers and / or interfaces, such as network interfaces.
[0076] UE 120 may include a collection of antennas 252 (shown as antennas 252a to 252r, where r ≥ 1), a collection of modems 254 (shown as modems 254a to 254u, where u ≥ 1), a MIMO detector 256, a receive processor 258, a data sink 260, a data source 262, a transmit processor 264, a TX MIMO processor 266, a controller / processor 280, a memory 282, and / or a communication manager 140, etc. One or more components of UE 120 may be included in housing 284. In some aspects, one or a combination of antenna 252, modem 254, MIMO detector 256, receive processor 258, transmit processor 264, or TX MIMO processor 266 may be included in a transceiver included in UE 120. The transceiver may be under the control of and used by one or more processors (such as controller / processor 280), and in some respects, may perform aspects of the methods, procedures, or operations described herein in conjunction with processor-readable code stored in memory 282. In some respects, UE 120 may include another interface, another communication component, and / or another component that facilitates communication with network node 110 and / or another UE 120.
[0077] For downlink communication from network node 110 to UE 120, the set of antennas 252 can receive downlink communication or signals from network node 110, and can receive the set of downlink signals (e.g., R Each received signal is provided to a set of modems 254. For example, each received signal may be provided to a corresponding demodulator component (shown as DEMOD) of modem 254. Each modem 254 may use the corresponding demodulator component to condition (e.g., filter, amplify, down-convert, and / or digitize) the received signal to obtain an input sample. Each modem 254 may use the corresponding demodulator component to further demodulate or process the input sample (e.g., for OFDM) to obtain a received symbol. MIMO detector 256 may obtain the received symbols from the set of modems 254, perform MIMO detection on the received symbols where applicable, and provide the detected symbols. Receiver processor 258 may process (e.g., decode) the detected symbols, provide the decoded data for UE 120 to data sink 260 (which may include data pipelines, data queues, and / or applications executed on UE 120), and provide the decoded control information and system information to controller / processor 280.
[0078] For uplink communication from UE 120 to network node 110, the transmitting processor 264 may receive and process data (“uplink data”) from data source 262 (such as data pipelines, data queues, and / or applications running on UE 120) and control information from controller / processor 280. The control information may include one or more parameters, feedback, one or more signal measurements, and / or other types of control information. In some aspects, the receiving processor 258 and / or controller / processor 280 may determine one or more parameters related to the transmission of uplink communication for received signals (such as those received from network node 110 or another UE). One or more parameters may include a Reference Signal Received Power (RSRP) parameter, a Received Signal Strength Indicator (RSSI) parameter, a Reference Signal Received Quality (RSRQ) parameter, a CQI parameter, or a Transmit Power Control (TPC) parameter, etc. The control information may include indications of the RSRP parameter, RSSI parameter, RSRQ parameter, CQI parameter, TPC parameter, and / or another parameter. Control information can facilitate parameter selection and / or scheduling for UE 120 by network node 110.
[0079] Transmit processor 264 can generate reference symbols for one or more reference signals, such as uplink DMRS, uplink sounding reference signal (SRS), and / or another type of reference signal. Symbols from transmit processor 264 can be pre-decoded by TX MIMO processor 266 where applicable, and further processed by a set of modems 254 (e.g., for DFT-s-OFDM or CP-OFDM). TX MIMO processor 266 can perform spatial processing (e.g., pre-decoding) on data symbols, control symbols, overhead symbols, and / or reference symbols where applicable, and can output a set of symbol streams (e.g., ... U A set of output symbol streams is provided to modem 254. For example, each output symbol stream may be provided to a corresponding modulator component (shown as MOD) of modem 254. Each modem 254 may use the corresponding modulator component to process (e.g., modulate) the corresponding output symbol stream (e.g., for OFDM) to obtain an output sample stream. Each modem 254 may further use the corresponding modulator component to process (e.g., convert to analog, amplify, filter, and / or upconvert) the output sample stream to obtain an uplink signal.
[0080] Modems 254a to 254u can transmit uplink signal sets (e.g., via a set of corresponding antennas 252) R One uplink signal or U Uplink signals may include UCI communication, MAC-CE communication, RRC communication, or another type of uplink communication. Uplink signals may be transmitted on PUSCH, PUCCH, and / or another type of uplink channel. Uplink signals may carry one or more TBs of data. Sidelink data and control transmission (i.e., transmission directly between two or more UEs 120) may typically use techniques similar to those described for uplink data and control transmission, and may use sidelink-specific channels such as the Physical Sidelink Shared Channel (PSSCH), Physical Sidelink Control Channel (PSCCH), and / or Physical Sidelink Feedback Channel (PSFCH).
[0081] One or more antennas in the set of antennas 252 or the set of antennas 234 may include one or more antenna panels, one or more antenna groups, one or more sets of antenna elements, or one or more antenna arrays, etc., or may be included in one or more antenna panels, one or more antenna groups, one or more sets of antenna elements, or one or more antenna arrays, etc. Antenna panels, antenna groups, sets of antenna elements, or antenna arrays may include one or more antenna elements (within a single housing or multiple housings), a set of coplanar antenna elements, a set of non-coplanar antenna elements, or with one or more transmitting or receiving components (such as...) Figure 2 An antenna module is a combination of one or more antenna elements coupled to one or more components. As used herein, "antenna" can mean one or more antennas, one or more antenna panels, one or more antenna groups, one or more collections of antenna elements, or one or more antenna arrays. "Antenna panel" can mean a group of antennas (such as antenna elements) arranged in an array or panel that can facilitate beamforming by manipulating the parameters of that group of antennas. "Antenna module" can mean a circuit that includes one or more antennas, and may also include one or more other components (such as filters, amplifiers, or processors) associated with integrating the antenna module into a wireless communication device.
[0082] In some examples, each antenna element of antenna 234 or antenna 252 may include one or more sub-elements for radiating or receiving radio frequency signals. For example, a single antenna element may include a first sub-element cross-polarized with a second sub-element that can be used to independently transmit cross-polarized signals. Antenna elements may include patch antennas, dipole antennas, and / or other types of antennas arranged in a linear pattern, a two-dimensional pattern, or another pattern. The spacing between antenna elements can allow signals with a desired wavelength transmitted individually by the antenna elements to interact or interfere (e.g., to form a desired beam) in various directions. For example, given a desired wavelength or frequency range, the spacing may provide a quarter wavelength, half a wavelength, or another fraction of the wavelength between adjacent antenna elements to allow desired constructive and destructive interference modes of signals transmitted by individual antenna elements within that desired range.
[0083] The amplitude and / or phase of signals transmitted via antenna elements and / or sub-elements can be modulated and (e.g., by manipulating phase shifts, phase offsets, and / or amplitudes) shifted relative to each other to generate one or more beams; this is known as beamforming. The term "beam" can refer to the directional transmission of a wireless signal toward a receiving device or otherwise in a desired direction. "Beam" can also generally refer to the direction associated with such directional signal transmission, the set of directional resources associated with the signal transmission (e.g., angle of arrival, horizontal direction, and / or vertical direction), and / or a set of parameters indicating one or more aspects of the directional signal, the direction associated with the signal, and / or the set of directional resources associated with the signal. In some implementations, antenna elements can be individually selected or deselected for the directional transmission of a signal (or multiple signals) by controlling the amplitude of one or more corresponding amplifiers and / or the phase of the signal to form one or more beams. The shape of the beam (such as amplitude, width, and / or the presence of sidelobes) and / or the direction of the beam (such as the angle of the beam relative to the surface of the antenna array) can be dynamically controlled by modifying the phase shifts, phase offsets, and / or amplitudes of multiple signals relative to each other.
[0084] Different UEs 120 or network nodes 110 may include different numbers of antenna elements. For example, UE 120 may include a single antenna element, two antenna elements, four antenna elements, eight antenna elements, or different numbers of antenna elements. As another example, network node 110 may include eight antenna elements, 24 antenna elements, 64 antenna elements, 128 antenna elements, or different numbers of antenna elements. Generally speaking, a larger number of antenna elements provides increased control over the parameters used for beamforming compared to a smaller number of antenna elements, while a smaller number of antenna elements may be less complex to implement and can use less power. Multiple antenna elements can support multi-layer transmission, in which the same time and frequency resources are used to utilize spatial multiplexing to transmit a first layer of communication (which may include a first data stream) and a second layer of communication (which may include a second data stream).
[0085] Although Figure 2 The boxes in the diagram are illustrated as different components, but the functions described above with respect to these boxes may be implemented in a single hardware, software, or combined component, or in various combinations of components. For example, the functions described with respect to transmit processor 264, receive processor 258, and / or TX MIMO processor 266 may be performed by or under the control of controller / processor 280.
[0086] Figure 3This is an illustration of an example decomposed base station architecture 300 according to the present disclosure. One or more components of the example decomposed base station architecture 300 may be, may include, or may be included in one or more network nodes (such as one or more network nodes 110). The decomposed base station architecture 300 may include a CU 310, which may communicate directly with the core network 320 via a backhaul link, or may communicate indirectly with the core network 320 via one or more decomposed control units (such as non-RT RIC 350 and / or near-RT RIC 370 associated with a Service Management and Orchestration (SMO) framework 360 (e.g., via an E2 link)). The CU 310 may communicate with one or more DU 330s via a corresponding midhaul link (such as via an F1 interface). Each DU 330 may communicate with one or more RU 340s via a corresponding fronthaul link. Each RU 340 may communicate with one or more UE 120s via a corresponding RF access link. In some deployments, a UE 120 may be served simultaneously by multiple RU 340s.
[0087] Each component in the decomposed base station architecture 300 (including CU 310, DU 330, RU 340, near-RT RIC 370, non-RT RIC 350, and SMO frame 360) may include one or more interfaces or be coupled to one or more interfaces for receiving or transmitting signals, such as data or information, via wired or wireless transmission media.
[0088] In some respects, the CU 310 can be logically divided into one or more CU user plane (CU-UP) units and one or more CU control plane (CU-CP) units. When implemented in an O-RAN configuration, the CU-UP units can communicate bidirectionally with the CU-CP units via an interface such as an E1 interface. The CU 310 can be deployed to communicate with one or more DU 330s for network control and signaling, as needed. Each DU 330 may correspond to a logical unit that includes one or more base station functions for controlling the operation of one or more RU 340s. For example, the DU 330 may host various layers, such as the RLC layer, MAC layer, or one or more PHY layers (such as one or more high PHY layers or one or more low PHY layers). Each layer (which may also be referred to as a module) can be implemented using an interface for signaling to other layers (and modules) hosted by the DU 330, or for signaling to control functions hosted by the CU 310. Each RU 340 may implement lower-layer functionality. In some respects, the real-time and non-real-time aspects of communication with the control plane and user plane of the RU 340 can be controlled by the corresponding DU 330.
[0089] The SMO framework 360 supports RAN deployment and provisioning for both non-virtualized and virtualized network elements. For non-virtualized network elements, the SMO framework 360 supports the deployment of dedicated physical resources for RAN coverage requirements, which can be managed via operation and maintenance interfaces such as the O1 interface. For virtualized network elements, the SMO framework 360 can interact with cloud computing platforms such as the Open Cloud (O-Cloud) platform 390 to perform network element lifecycle management (such as instantiating virtualized network elements) via cloud computing platform interfaces such as the O2 interface. Virtualized network elements may include, but are not limited to, CU 310, DU 330, RU 340, non-RT RIC 350, and / or near-RT RIC 370. In some aspects, the SMO framework 360 can communicate with hardware aspects of the 4G RAN, 5G NR RAN, and / or 6G RAN (such as the Open eNB (O-eNB) 380) via the O1 interface. Additionally or alternatively, the SMO framework 360 can communicate directly with each of one or more RUs 340 via the corresponding O1 interface. In some deployments, this configuration enables each DU 330 and CU 310 to be implemented in a cloud-based RAN architecture, such as a vRAN architecture.
[0090] The non-RT RIC 350 may include or implement logic functions that enable non-real-time control and optimization of RAN elements and resources, including AI / ML workflows for model training and updates, and / or policy-based guidance of applications and / or features in the near-RT RIC 370. The non-RT RIC 350 may be coupled to or communicate with the near-RT RIC 370, such as via an A1 interface. The near-RT RIC 370 may include or implement logic functions that enable near real-time control and optimization of RAN elements and resources via an interface, such as an E2 interface, through data collection and actions, connecting one or more CU 310s, one or more DU 330s, and / or O-eNBs to the near-RT RIC 370.
[0091] In some aspects, to generate AI / ML models to be deployed in the near-RT RIC 370, the non-RT RIC 350 may receive parameters or external enrichment information from an external server. This information can be utilized by the near-RT RIC 370 and can be received from non-network data sources or network functions at the SMO framework 360 or the non-RT RIC 350. In some examples, the non-RT RIC 350 or near-RT RIC 370 may modulate RAN behavior or performance. For example, the non-RT RIC 350 may monitor long-term trends and patterns in performance and may employ AI / ML models to perform corrective actions via the SMO framework 360 (such as reconfiguration via the O1 interface) or via the creation of RAN management policies (such as A1 interface policies).
[0092] As indicated above, Figure 3 This is provided as an example. Other examples are available with reference to [the relevant information]. Figure 3 The examples described are different.
[0093] Figure 1 , Figure 2 or Figure 3 Network node 110, its controller / processor 240, UE 120, UE 120's controller / processor 280, CU 310, DU 330, RU 340, or any other component may implement one or more technologies or perform one or more operations associated with perception sharing between multimodal devices, as described in more detail elsewhere herein. For example, network node 110's controller / processor 240, UE 120's controller / processor 280, CU 310, DU 330, RU 340, or any other component may implement one or more technologies or perform one or more operations associated with perception sharing between multimodal devices, as described in more detail elsewhere herein. Figure 2 Any other component, CU310, DU 330, or RU 340 may execute or instruct, for example Figure 6 Process 600 Figure 7 The operation of process 700 or other processes as described herein (alone or in combination with one or more other processors). In some aspects, the multimodal device described herein is UE 120, included in UE 120, or comprising Figure 2One or more components of the UE 120 shown. Memory 242 may store data and program code for network node 110, CU 310, DU 330, or RU 340. Memory 282 may store data and program code for UE 120. In some examples, memory 242 or memory 282 may include a non-transitory computer-readable medium storing a set of instructions (e.g., code or program code) for wireless communication. Memory 242 may include one or more memories, such as a single memory or multiple different memories (of the same or different types). Memory 282 may include one or more memories, such as a single memory or multiple different memories (of the same or different types). For example, the set of instructions may be executed by one or more processors of network node 110, UE 120, CU 310, DU 330, or RU 340 (e.g., directly, or after compilation, transformation, or interpretation). Figure 6 Process 600 Figure 7 The process 700 or other processes as described herein. In some examples, the execution instructions may include run instructions, transformation instructions, compilation instructions, and / or interpretation instructions, etc.
[0094] In some aspects, the first multimodal device (e.g., the first UE 120) includes components for receiving sensing data associated with a multimodal session from a second multimodal device (e.g., the second UE 120); and / or components for communicating with network nodes at least in part based on the sensing data. In some aspects, components for the first multimodal device to perform the operations described herein may include one or more of, for example, a communication manager 140, an antenna 252, a modem 254, a MIMO detector 256, a receive processor 258, a transmit processor 264, a TX MIMO processor 266, a controller / processor 280, or a memory 282.
[0095] In some aspects, the first multimodal device (e.g., the first UE 120) includes components for generating sensing data associated with a multimodal session; and / or for transmitting the sensing data associated with the multimodal session to a second multimodal device (e.g., the second UE 120). In some aspects, components for the first multimodal device to perform the operations described herein may include one or more of, for example, a communication manager 140, an antenna 252, a modem 254, a MIMO detector 256, a receive processor 258, a transmit processor 264, a TX MIMO processor 266, a controller / processor 280, or a memory 282.
[0096] As indicated above, Figure 3 This is provided as an example. Other examples are available with reference to [the relevant information]. Figure 3 The examples described are different.
[0097] Figure 4 This is a diagram illustrating an example of a multimodal service 400 associated with this disclosure. For example... Figure 4 As shown, one or more UEs 120 can communicate with the application server 405 via RAN 410. RAN 410 can be a wireless network, such as... Figure 1 The wireless network 100. RAN 410 may include one or more network nodes 110, such as one or more RUs, one or more DUs, and / or one or more CUs, etc. Application server 405 may be associated with application services (e.g., may serve or otherwise support application services). As an example, application services may be associated with XR services, VR services, and / or another type of service.
[0098] In some examples, an application service can be a multimodal service. A multimodal service can be associated with a multimodal business. As used herein, "multimodal business" can refer to a business associated with multiple modes of an application. For example, some applications can generate multiple types of uplink data streams (e.g., multiple modes). For example, an application (e.g., an XR application or a VR application) can generate audio data, video data, location data, haptic data, and / or other types of data, each associated with the application. For example, application server 405 can support applications that receive input from more than one source (such as business streams for audio, video, location, haptics, etc.).
[0099] For example, such as Figure 4 As shown, the application service can be associated with UE 120 in the first mode (or first service data flow 415) and UE 120 in the second mode (or second service data flow 420). Figure 4 The UE 120 shown may be the same UE or may be different UEs. As an example, the UE 120 associated with the first mode may include a head-mounted device, such as a VR head-mounted device or VR goggles (e.g., associated with audio data and / or video data). The UE 120 associated with the first mode may include wearable components, such as gloves, associated with obtaining tactile data as input.
[0100] Multimodal services may include multiple data streams (e.g., collectively referred to as multimodal streams) that are related to each other and may originate from different sources. Each data stream (referred to individually as monomodal data) may be considered as one type of data associated with the same communication service (e.g., audio, video, location, haptic, and / or another type of data). Data streams including multimodal services may originate from a single UE (via a single device or via multiple devices connected to a single UE) or from multiple UEs. Multimodal streams may be associated with a multimodal session identifier (ID). The multimodal session ID may be an indicator of the application service's association with the multimodal service and / or multimodal communication session. The Policy Control Function (PCF) of RAN 410 can use the information indicated by the multimodal session ID to derive the correct policy and charging control (PCC) rules and apply QoS policies to data streams that are part of a given multimodal communication session.
[0101] Multimodal streams can carry closely related data and may require strong coordination to deliver multimodal application data correctly. For example, synchronization between different data streams of the same multimodal application (e.g., between different media components of an XR application) can be important to ensure a positive user experience. For instance, if the data streams of different media components of the same multimodal application are out of sync, the user may be able to detect the lack of synchronization, resulting in a poor user experience. Therefore, in some cases, two or more data streams (e.g., associated with different modalities or media components) may be associated with a synchronization threshold. As used herein, a “synchronization threshold” can refer to the allowable amount of time between the transmission of services associated with two or more data streams (e.g., associated with different modalities or media components) to ensure that a lack of synchronization is not detected. For example, a synchronization threshold can be defined as the allowable (e.g., maximum) tolerable time interval at which two stimuli begin, where one stimulus is presented to one sense and another stimulus is presented to another sense, such that the accompanying sensory objects are perceived as synchronized. A synchronization threshold may also be referred to as a multimodal synchronization threshold.
[0102] For example, by handling multiple media components associated with a multimodal service or application separately, synchronization between different media components can reduce the likelihood of negative impacts on the user experience (e.g., the user detecting a lack of synchronization). Applying synchronization thresholds in RAN 410 can help support immersive multimodal applications when the synchronization threshold between two or more modalities is less than the application's latency key performance indicator (KPI). As an example, the synchronization threshold between audio and haptic data streams may include an allowable audio latency of 50 ms (e.g., indicating that audio data should be delayed by up to 50 ms compared to the corresponding haptic data) and an allowable haptic latency of 25 ms (e.g., indicating that haptic data should be delayed by up to 25 ms compared to the corresponding audio data). As another example, the synchronization threshold between visual and haptic data streams may include an allowable visual latency of 15 ms (e.g., indicating that visual data should be delayed by up to 15 ms compared to the corresponding haptic data) and an allowable haptic latency of 50 ms (e.g., indicating that haptic data should be delayed by up to 50 ms compared to the corresponding visual data). For each data stream or media component, "latency" can refer to the situation where that media component is delayed compared to another media component (for example, visual latency can refer to the delay of a visual data stream compared to a haptic data stream).
[0103] Different data streams can have different timing deadlines. For example, different data streams within the same application can have different packet delay budgets. As an example, an application can generate gesture or control packets containing information with a packet delay budget of 4 ms, and these gesture or control packets can arrive at intervals of 10 ms for transmission (e.g., are generated). Such gesture data can be based on, respond to, or otherwise correlated with movement of the user's head and / or the user's field of vision, etc. For example, the application can sample the head position every 10 ms and generate an update to be transmitted to another end of the application (such as application server 405). The application can also generate gesture tracking information to track the movement of the user's hand, and this gesture tracking information can have a longer packet delay budget of 10 ms and can arrive at intervals of 40 ms for transmission. The application can generate voice or audio for transmission, which can have a longer delay budget of 15 ms and can arrive at intervals of 20 ms for transmission. In this example, the application can generate different traffic streams with different packet delay budgets and different generation periods.
[0104] To maintain coordination and synchronization among multimodal devices (e.g., devices associated with multimodal services, multimodal applications, and / or multimodal applications), the multimodal devices should utilize communication channels with the same or similar channel conditions. In some cases, one of the multimodal devices may include one or more sensors (e.g., inertial measurement units (IMUs), cameras, temperature sensors, microphones, and / or other types of sensors) to acquire sensed data.
[0105] Perception data may include data that multimodal devices can use to construct perception or awareness of their surrounding environment. For example, perception or awareness of the environment may include obstruction detection (e.g., using image data to detect whether a communication link or channel will be blocked by an object), depth maps, three-dimensional (3D) reconstructions of the environment, radio frequency (RF) maps, estimation of user location, and / or estimation of user orientation.
[0106] In some cases, multimodal devices can utilize sensory data to generate perception or awareness of their environment, and / or adjust one or more parameters of the multimodal device. For example, a multimodal device can use image data to generate a depth map and / or 3D representation of the environment, and can determine, based on the image data, depth map, and / or 3D representation of the environment, that an object is moving through the environment and will block the communication link currently being used by the multimodal device. The multimodal device can switch to a different communication to prevent communication degradation caused by an object blocking the current communication link.
[0107] However, another multimodal device may not be configured to acquire sensing data, and / or may not be configured to acquire sensing data that can be used to detect objects and / or determine that objects will obstruct the communication link. Due to the failure to detect objects and / or determine that objects will obstruct the communication link, the other multimodal device may experience communication degradation (e.g., an increased amount of time required to transmit data between the other multimodal device and another device).
[0108] Overall, these aspects involve utilizing sensed data to maintain coordination and synchronization among multimodal devices. Some aspects are more specifically related to sharing sensed data among multimodal devices. In some aspects, multimodal devices can identify other multimodal devices that cannot generate sensed data of a specific pattern or type, and multimodal devices can send sensed data of a specific pattern or type to other multimodal devices.
[0109] Specific aspects of the subject matter described in this disclosure may be implemented to achieve one or more of the following potential advantages. In some examples, by leveraging sensed data to maintain coordination and synchronization between multimodal devices, the described techniques can be used to increase the likelihood that multimodal business flows associated with multimodal services or applications are synchronized (e.g., synchronized in the time domain).
[0110] As indicated above, Figure 4 This is provided as an example. Other examples are available with reference to [the relevant information]. Figure 4 The examples described are different.
[0111] Figure 5 This is a diagram illustrating example 500 associated with sensing sharing between multimodal devices according to this disclosure. Figure 5 As shown, network node 110, first multimodal device 505 (e.g., first UE 120) and second multimodal device 510 (e.g., second UE 120) can communicate with each other.
[0112] As shown by reference numeral 515 in the accompanying drawings, the first multimodal device 505 may send capability information to the network node 110, and the network node 110 may receive the capability information. In some aspects, the capability information may indicate that the first multimodal device 505 is capable of (e.g., configured to) generating at least one type of sensing data. For example, the capability information may include a field indicating whether the first multimodal device 505 is configured to generate sensing data. The first multimodal device 505 may set this field to a first value (e.g., 1) to indicate that the first multimodal device 505 is configured to generate at least one type of sensing data.
[0113] In some respects, capability information may indicate that the first multimodal device 505 is configured to generate one or more types of perception data. For example, capability information may indicate that the first multimodal device 505 is configured to generate image data, depth maps, 3D representations of the environment, RF maps, localization data (e.g., data indicating an estimate of a user's position and / or orientation), obstruction detection data, and / or other types of data that can be used to generate perception or awareness of the environment of the first multimodal device 505.
[0114] As indicated by reference numeral 520 in the accompanying drawings, the second multimodal device 510 may send capability information to the network node 110, and the network node 110 may receive the capability information. In some aspects, the capability information may indicate that the second multimodal device 510 is not configured to generate at least one type of sensing data. For example, the capability information may include a field for indicating whether the second multimodal device 510 is configured to generate sensing data. The second multimodal device 510 may set this field to a second value (e.g., 0) to indicate that the second multimodal device 510 is not configured to generate at least one type of sensing data.
[0115] In some respects, the second multimodal device 510 can be configured to generate one or more types of sensing data. In these respects, capability information can indicate that the second multimodal device 510 is configured to generate one or more types of sensing data.
[0116] In some respects, the second multimodal device 510 may be configured to generate one or more types of sensing data that differ from the first multimodal device 505 may be configured to generate. Additionally or alternatively, the first multimodal device 505 may be configured to generate one or more types of sensing data that the second multimodal device 510 is not configured to generate.
[0117] As indicated by reference numeral 525 in the accompanying drawings, network node 110 may determine shared sensing information. In some aspects, shared sensing information may indicate to the first multimodal device 505 one or more multimodal devices (e.g., the second multimodal device 510 and / or one or more other multimodal devices) with which to share sensing data, and / or one or more types of sensing data that the first multimodal device 505 wants to share (e.g., send to the one or more multimodal devices).
[0118] In some aspects, one or more multimodal devices with which the first multimodal device 505 shares sensing data may include a group of one or more multimodal devices that are not configured to generate the sensing data type that the first multimodal device 505 is configured to generate. For example, network node 110 may identify one or more types of sensing data that the first multimodal device 505 is configured to generate, at least in part, based on capability information received from the first multimodal device 505. Network node 110 may identify one or more other multimodal devices that are not configured to generate the sensing data type that the first multimodal device 505 is configured to generate, at least in part, based on capability information received from one or more other multimodal devices. Sharing sensing information may indicate one or more other multimodal devices that are not configured to generate one or more types of sensing data, at least in part.
[0119] In some aspects, network node 110 may determine one or more multimodal devices with which the first multimodal device 505 will share sensing data, at least in part, based on the location of the first multimodal device 505 and / or one or more multimodal devices. For example, network node 110 may determine the location of the first multimodal device 505 at least in part based on capability information received from the first multimodal device 505 and / or other information indicating the location of the first multimodal device 505.
[0120] In some aspects, network node 110 may determine one or more multimodal devices with which the first multimodal device 505 will share sensing data, at least in part, based on session identifiers, service identifiers, and / or applications associated with the first multimodal device 505. For example, network node 110 may identify a group of one or more multimodal devices that are associated with the first multimodal device 505 and the same session identifier, the same service identifier, and / or the same application. Sharing sensing information may indicate that the first multimodal device 505 will share sensing data with the identified group of multimodal devices, at least in part, based on the fact that the identified group of multimodal devices and the first multimodal device 505 are associated with the same session identifier, the same service identifier, and / or the same application.
[0121] In some aspects, the first multimodal device 505 may share sensing data with one or more multimodal devices that are not configured to generate sensing data. For example, network node 110 may receive capability information from multiple multimodal devices. Network node 110 may identify one or more multimodal devices that are not configured to generate sensing data based at least in part on the received capability information. Sharing sensing information may indicate that, based at least in part on the identified multimodal devices not being configured to generate sensing data, the first multimodal device 505 will share sensing data with the identified multimodal devices.
[0122] Network node 110 may identify one or more other multimodal devices that are adjacent to the first multimodal device 505 (e.g., within a predetermined and / or pre-configured distance from the first multimodal device). Network node 110 may determine, at least in part, that the identified multimodal device and the first multimodal device 505 experience similar channel conditions (e.g., similar delay, signal-to-interference-plus-noise ratio (SINR), and / or other channel conditions) based on the proximity of the identified multimodal device to the first multimodal device 505.
[0123] Additionally or alternatively, network node 110 may determine, at least in part, that the identified multimodal device and the first multimodal device 505 experience similar channel conditions based on other information indicating the channel conditions experienced by the first multimodal device 505 and / or the identified multimodal device. Shared sensing information may indicate that, at least in part, the first multimodal device 505 will share sensing data with the identified multimodal device based on the similar channel conditions experienced by the identified multimodal device and the first multimodal device 505.
[0124] In some respects, sharing sensing information may not instruct the first multimodal device 505 to share sensing data with one or more multimodal devices, and the first multimodal device 505 may determine one or more multimodal devices with which to share sensing data.
[0125] In some respects, the first multimodal device 505 may determine one or more multimodal devices in a manner similar to that described above for determining one or more multimodal devices relative to network node 110. Additionally or alternatively, the first multimodal device 505 may determine one or more multimodal devices at least in part based on being configured to share sensing data with one or more multimodal devices and / or receiving requests from one or more multimodal devices.
[0126] In some respects, the shared sensing information may indicate one or more types of sensing data that the first multimodal device 505 wants to share with the multimodal device indicated in the shared sensing information (e.g., the second multimodal device 510 and / or one or more other multimodal devices).
[0127] In some aspects, network node 110 may determine one or more types of sensing data based at least in part on capability information received from a first multimodal device 505, capability information received from a second multimodal device 510, and / or capabilities received from one or more other multimodal devices.
[0128] In some aspects, the first multimodal device 505 will share one or more types of sensing data with the second multimodal device 510, including each type of sensing data that the first multimodal device 505 is configured to generate. For example, network node 110 may identify one or more types of sensing data that the first multimodal device 505 is configured to generate, at least in part, based on capability information received from the first multimodal device 505. Network node 110 may generate shared sensing information indicating that the first multimodal device 505 will share sensing data of the identified type, at least in part, based on the first multimodal device 505 being configured to generate sensing data of the identified type.
[0129] In some aspects, one or more types of sensing data that the first multimodal device 505 will share with the second multimodal device 510 include one or more multimodal devices, as indicated in the shared sensing information, that are not configured to generate one or more types of sensing data. For example, network node 110 may determine, at least in part, that the first multimodal device 505 is configured to generate a first type of sensing data and the second multimodal device 510 is not configured to generate the first type of sensing data, based on capability information received from the first multimodal device 505 and capability information received from the second multimodal device 510. The shared sensing information may indicate that, at least in part, the first multimodal device 505 will share the first type of sensing data with the second multimodal device 510, based on the fact that the second multimodal device 510 is not configured to generate the first type of sensing data.
[0130] In some aspects, the shared sensing information may instruct the first multimodal device 505 to share one or more types of sensing data with each multimodal device indicated in the shared sensing information. For example, the shared sensing information may instruct the first multimodal device 505 to share a first type of sensing data with the second multimodal device 510, a second type of sensing data with the third multimodal device, and a third type of sensing data with the fourth multimodal device.
[0131] In some aspects, the shared sensing information may not indicate one or more types of sensing data to be shared by the first multimodal device 505. In some aspects, the first multimodal device 505 may be configured to share all types of sensing data that the first multimodal device 505 is configured to generate with each multimodal device indicated in the shared sensing information. In some aspects, the first multimodal device 505 may be configured to share one or more types of sensing data with each multimodal device indicated in the shared sensing information.
[0132] In some aspects, the first multimodal device 505 may receive information indicating one or more types of sensing data to be shared with the multimodal device indicated in the sensing information via different communications and / or from another device. For example, the first multimodal device 505 may receive communications (e.g., requests) indicating one or more types of sensing data from the multimodal device (e.g., the multimodal device indicated in the shared sensing information), network node 110, and / or another network node.
[0133] In some respects, the shared sensing information may indicate additional information associated with the first multimodal device 505 sharing the sensing data. For example, the shared sensing information may indicate one or more resources that the first multimodal device 505 will use to send sensing data to the second multimodal device 510 and / or one or more other multimodal devices, the time at which the first multimodal device 505 will send the sensing data to the second multimodal device 510 and / or one or more other multimodal devices, the period at which the first multimodal device 505 will send the sensing data to the second multimodal device 510 and / or one or more other multimodal devices, the size of the sensing data, etc.
[0134] As shown by reference numeral 530 in the attached figure, network node 110 can send shared sensing information, and first multimodal device 505 can receive shared sensing information. Network node 110 can send shared sensing information to first multimodal device 505 so that first multimodal device 505 can share sensing data generated by first multimodal device 505 with other multimodal devices (e.g., second multimodal device 510).
[0135] In some respects, network node 110 may send shared sensing information to the first multimodal device 505 at least in part based on a request received from the first multimodal device 505. Additionally or alternatively, network node 110 may periodically and / or send shared sensing information to the first multimodal device 505 when events occur (e.g., when the type of sensing data to be shared by the first multimodal device 505 changes and / or when the multimodal device with which the first multimodal device 505 shares sensing data changes).
[0136] In some aspects, as indicated by reference numeral 535, network node 110 may send shared sensing information to second multimodal device 510. In some aspects, network node 110 may send shared sensing information to second multimodal device 510 to enable second multimodal device 510 to receive sensing data from first multimodal device 505. For example, the shared sensing information may instruct one or more resources used by first multimodal device 505 to send sensing data to second multimodal device 510. Network node 110 may send shared sensing information to second multimodal device 510 to enable second multimodal device 510 to receive sensing data via one or more resources.
[0137] Additionally or alternatively, network node 110 may send shared sensing information to each multimodal device indicated in the shared sensing information. For example, network node 110 may multicast the shared sensing information to the first multimodal device 505 and each of the multimodal devices indicated in the shared sensing information.
[0138] As indicated by reference numeral 540 in the accompanying drawings, the first multimodal device 505 can generate sensory data, which it can use to construct a perception or awareness of its environment. For example, the first multimodal device 505 can generate sensory data based at least in part on audio data, image data, positioning data (e.g., data indicating the six degrees of freedom of an object and / or a user's posture), tactile data, and / or another type of data acquired and / or generated by one or more sensors of the first multimodal device 505.
[0139] In some respects, the perceived data may include raw data. For example, the perceived data may include sensor data obtained by one or more sensors of the first multimodal device 505, one or more frames of image data captured by the camera of the first multimodal device 505, and / or other types of raw (e.g., unprocessed) data obtained or generated by the first multimodal device 505.
[0140] In some respects, the sensing data may include processed data. For example, the sensing data may include data indicating that an object is blocking (or will block) a communication link, a suggested beam that the second multimodal device 510 should switch to (e.g., based at least in part on the object blocking the communication link), Doppler spread, anchor information, and / or any other information associated with the perception or awareness of the environment.
[0141] In some aspects, the first multimodal device 505 may generate perceptual data based at least in part on audio data, image data, positioning data, tactile data, and / or other types of data. For example, the first multimodal device 505 may generate one or more depth maps, a 3D representation of the environment, obstruction data, one or more RF maps, an estimate of the user's position, and / or an estimate of the user's orientation based at least in part on audio data, image data, positioning data, tactile data, and / or other types of data.
[0142] In some aspects, the sensed data may indicate additional information. In some aspects, the additional information may include information indicating determinations and / or actions made by the first multimodal device 505 based at least in part on the sensed data. For example, the sensed data may indicate that the first multimodal device 505 is switching from a first beam to a second beam, a modification of one or more link parameters, a Doppler spread estimation utilized by the first multimodal device 505, a modification of one or more parameters associated with providing content to a user (e.g., an adjustment or modification of the frame insertion rate and / or video rate associated with providing content to a user), a modification of one or more parameters associated with processing data, or a combination thereof.
[0143] In some respects, the first multimodal device 505 may transmit one or more portions of the sensing data based at least in part on shared sensing information. For example, the first multimodal device 505 may process the shared sensing information to identify one or more multimodal devices and / or one or more types of projection data to be transmitted to one or more multimodal devices.
[0144] In some respects, the first multimodal device 505 may determine to send sensing data to the second multimodal device 510 based at least in part on processing shared sensing information, receiving a request from the second multimodal device 510, and / or determining that the second multimodal device 510 and the first multimodal device 505 are associated with the same session identifier, service identifier, and / or application.
[0145] As indicated by reference numeral 545 in the accompanying drawings, the first multimodal device 505 can transmit sensing data, and the second multimodal device 510 can receive sensing data. For example, the first multimodal device 505 can provide sensing data to a modem of the first multimodal device 505, and the modem of the first multimodal device 505 can transmit the sensing data to the second multimodal device 510 via a wireless communication link established between the first multimodal device 505 and the second multimodal device 510 and / or via network node 110 (e.g., to the modem and / or application of the second multimodal device 510).
[0146] As indicated by reference numeral 550 in the accompanying drawings, the second multimodal device 510 may modify one or more parameters at least in part based on sensing data. In some aspects, the sensing data may include information indicating determinations and / or actions made by the first multimodal device 505, and the second multimodal device 510 may modify one or more parameters at least in part based on determinations and / or actions made by the first multimodal device 505.
[0147] For example, the sensed data may indicate that the first multimodal device 505 is switching from a first beam to a second beam, modifying one or more link parameters, using Doppler spread estimation by the first multimodal device 505, modifying one or more parameters associated with providing content to the user, and / or modifying one or more parameters associated with processing data. At least in part based on the sensed data, the second multimodal device 510 may switch from the first beam to the second beam, modify one or more link parameters corresponding to one or more link parameters modified by the first multimodal device 505, use Doppler spread estimation utilized by the first multimodal device 505, modify one or more parameters associated with providing content to the user based at least in part on the modifications made by the first multimodal device 505 to one or more parameters associated with providing content, and / or modify one or more parameters associated with processing data based at least in part on the modifications made by the first multimodal device 505 to one or more parameters associated with processing data.
[0148] In some respects, the modem of the second multimodal device 510 may modify one or more parameters, at least in part, based on the sensed data. For example, the modem of the second multimodal device 510 may utilize the same beam and / or Doppler spread as that utilized by the first multimodal device 505.
[0149] In some respects, the application of the second multimodal device 510 may modify one or more parameters, at least in part, based on the sensed data. For example, the modem of the second multimodal device 510 may provide the application with one or more portions of the sensed data (e.g., via a cross-layer application programming interface (API)), and the application may modify or adjust the frame insertion rate, video rate, and / or one or more other parameters associated with the application and / or providing content to the user.
[0150] As indicated by reference numeral 555 in the accompanying drawings, the second multimodal device 510 may communicate with the network node 110 at least in part based on modifications to one or more parameters. For example, the second multimodal device 510 may communicate with the network node 110 using the second beam and / or Doppler spread estimation used by the first multimodal device 505.
[0151] As described in this article, sharing sensing data among multimodal devices enables them to maintain coordination and synchronization of multimodal service flows.
[0152] As indicated above, Figure 5 This is provided as an example. Other examples are available with reference to [the relevant information]. Figure 5 The examples described are different.
[0153] Figure 6 This is a diagram illustrating an example process 600 performed, for example, at a first multimodal device or a device of the first multimodal device, according to the present disclosure. Example process 600 is an example in which a device or a first multimodal device (e.g., a second multimodal device 510) performs operations associated with perception sharing between multimodal devices.
[0154] like Figure 6 As shown, in some aspects, process 600 may include receiving sensing data associated with the multimodal session from a second multimodal device (box 610). For example, the first multimodal device (e.g., using...) Figure 8 The depicted receiving component 802 and / or communication manager 806 can receive sensing data associated with the multimodal session from the second multimodal device, as described above.
[0155] like Figure 6 As further shown, in some aspects, process 600 may include communicating with network nodes at least in part based on sensed data (box 620). For example, a first multimodal device (e.g., using...) Figure 8 The receiving component 802, the transmitting component 804, and / or the communication manager 806 described herein may communicate with network nodes at least in part based on sensed data, as described above.
[0156] Process 600 may include additional aspects, such as any single aspect or any combination of aspects described below and / or in conjunction with one or more other processes described elsewhere in this document.
[0157] In the first aspect, the perceived data includes one or more of the following: detection information indicating whether a communication link will be blocked by an object, radio frequency maps, location information indicating the user's location, or information indicating the user's orientation.
[0158] In the second aspect, either alone or in combination with the first aspect, the perceived data includes obstruction detection information, and the obstruction detection information includes one or more of the following: imaging data obtained by one or more cameras of the second multimodal device, data corresponding to a depth map, or data corresponding to a three-dimensional representation of the user's environment.
[0159] In a third aspect, either alone or in combination with one or more of the first and second aspects, the multimodal session identifier associated with the first UE is also associated with the second UE.
[0160] In the fourth aspect, either alone or in combination with one or more of the first to third aspects, the first multimodal device is not configured to generate sensing data.
[0161] In the fifth aspect, either alone or in combination with one or more of the first to fourth aspects, the sensing data includes a first set of sensing data, and the first multimodal device is configured to generate a second set of sensing data that is different from the first set of sensing data.
[0162] In the sixth aspect, either alone or in combination with one or more of the first to fifth aspects, process 600 includes switching from the first beam to the second beam based at least in part on sensing data.
[0163] In the seventh aspect, either alone or in combination with one or more of the first to sixth aspects, process 600 includes adapting one or more link parameters based at least in part on sensing data.
[0164] In the eighth aspect, individually or in combination with one or more of the first to seventh aspects, one or more link parameters are adapted, including one or more of the following: switching to the beam utilized by the second multimode device, or utilizing the Doppler spread estimation utilized by the second multimode device.
[0165] In the ninth aspect, either alone or in combination with one or more of the first to eighth aspects, process 600 includes modifying one or more parameters, at least in part, based on perceived data, wherein the one or more parameters are associated with providing content to the user.
[0166] In the tenth aspect, either alone or in combination with one or more of the first to ninth aspects, modifying one or more parameters associated with providing content to the user includes one or more of the following: adjusting the frame insertion rate associated with providing content to the user, or adapting the video rate associated with providing content to the user.
[0167] although Figure 6 An example box of process 600 is shown, but in some respects, process 600 may include... Figure 6 The boxes depicted may be fewer, different, or arranged differently compared to additional boxes. Alternatively, two or more boxes in the process 600 may be executed in parallel.
[0168] Figure 7 This is a diagram illustrating an example process 700 performed, for example, at a first multimodal device or a device of the first multimodal device, according to the present disclosure. Example process 700 is an example in which a device or the first multimodal device (e.g., first multimodal device 505) performs operations associated with perception sharing between multimodal devices.
[0169] like Figure 7 As shown, in some aspects, process 700 may include generating perceptual data associated with the multimodal session (box 710). For example, a first multimodal device (e.g., using...) Figure 9 The described communication manager 906 can generate perceptual data associated with multimodal sessions, as described above.
[0170] like Figure 7 As further shown, in some aspects, process 700 may include sending sensing data associated with the multimodal session to a second multimodal device (box 720). For example, the first multimodal device (e.g., using...) Figure 9 The depicted transmitting component 904 and / or communication manager 906 can transmit sensing data associated with the multimodal session to the second multimodal device, as described above.
[0171] Process 700 may include additional aspects, such as any single aspect or any combination of aspects described below and / or in conjunction with one or more other processes described elsewhere in this document.
[0172] In the first aspect, the sensed data is transmitted to the second multimodal device based at least in part on the channel correlation between the first multimodal device and the second multimodal device.
[0173] In a second aspect, either alone or in combination with the first aspect, the sensing data is transmitted to the second multimodal device based at least in part on the distance between the first multimodal device and the second multimodal device.
[0174] In a third aspect, either alone or in combination with one or more of the first and second aspects, process 700 includes determining a distance satisfaction condition from the first multimodal device to the third multimodal device, wherein the sensed data is not transmitted to the third multimodal device based at least in part on the distance satisfaction condition from the first multimodal device to the third multimodal device.
[0175] In the fourth aspect, alone or in combination with one or more of the first to third aspects, the perceived data includes one or more of the following: detection information indicating whether a communication link will be blocked by an object, radio frequency maps, location information indicating the user's location, or information indicating the user's orientation.
[0176] In the fifth aspect, either alone or in combination with one or more of the first to fourth aspects, the perceived data includes obstruction detection information, and the obstruction detection information includes one or more of the following: imaging data obtained by one or more cameras of the first multimodal device, data corresponding to a depth map, or data corresponding to a three-dimensional representation of the user's environment.
[0177] In the sixth aspect, alone or in combination with one or more of the first to fifth aspects, the sensing data includes sensing data of the first type, and the process 700 includes receiving information indicating that the second multimodal device is not configured to generate sensing data of the first type, wherein the sensing data is sent to the second multimodal device at least in part based on the fact that the second multimodal device is not configured to generate sensing data of the first type.
[0178] although Figure 7 An example box of process 700 is shown, but in some respects, process 700 may include... Figure 7 The boxes depicted may be fewer, different, or arranged differently compared to additional boxes. Alternatively, two or more boxes in the process 700 may be executed in parallel.
[0179] Figure 8 This is a diagram illustrating an example device 800 for wireless communication according to the present disclosure. Device 800 may be a multimode device, or a multimode device may include device 800. In some aspects, device 800 includes a receiving component 802, a transmitting component 804, and / or a communication manager 806 that are communicable to each other (e.g., via one or more buses and / or one or more other components). In some aspects, the communication manager 806 is combined with... Figure 1 The described communication manager 140. As shown, device 800 can use receiving component 802 and transmitting component 804 to communicate with another device 808, such as a UE or a network node (such as a CU, DU, RU or base station).
[0180] In some respects, device 800 can be configured to perform the functions described herein. Figure 5 One or more operations described herein. Additionally or alternatively, the apparatus 800 may be configured to perform one or more processes described herein, such as Figure 6 The process is 600. In some respects, Figure 8 The illustrated device 800 and / or one or more components may include a combination Figure 2 One or more components of the first multimodal device described. Additionally or alternatively, Figure 8 One or more components shown can be combined Figure 2 Implementation within one or more of the described components. Additionally or alternatively, one or more components in the set of components may be implemented at least partially as software stored in one or more memories. For example, a component (or a portion thereof) may be implemented as instructions or code stored in a non-transitory computer-readable medium and executable by one or more controllers or one or more processors to perform the function or operation of the component.
[0181] Receiver 802 may receive communications from device 808, such as reference signals, control information, data communications, or combinations thereof. Receiver 802 may provide the received communications to one or more other components of device 800. In some aspects, receiver 802 may perform signal processing (such as filtering, amplification, demodulation, analog-to-digital conversion, demultiplexing, deinterleaving, demapping, equalization, interference cancellation, or decoding, etc.) on the received communications, and may provide the processed signals to the one or more other components of device 800. In some aspects, receiver 802 may include combinations of... Figure 2 The first multimode device described includes one or more antennas, one or more modems, one or more demodulators, one or more MIMO detectors, one or more receiver processors, one or more controllers / processors, one or more memories, or combinations thereof.
[0182] Transmitting component 804 can transmit communications, such as reference signals, control information, data communications, or combinations thereof, to device 808. In some aspects, one or more other components of device 800 can generate communications and provide the generated communications to transmitting component 804 for transmission to device 808. In some aspects, transmitting component 804 can perform signal processing (such as filtering, amplification, modulation, digital-to-analog conversion, multiplexing, interleaving, mapping, or encoding, etc.) on the generated communications and can transmit the processed signals to device 808. In some aspects, transmitting component 804 may include combinations of... Figure 2The described first multimode device includes one or more antennas, one or more modems, one or more modulators, one or more transmit MIMO processors, one or more transmit processors, one or more controllers / processors, one or more memories, or combinations thereof. In some aspects, the transmit component 804 may co-located with the receive component 802 in one or more transceivers.
[0183] The communication manager 806 may support the operation of the receiving component 802 and / or the transmitting component 804. For example, the communication manager 806 may receive information associated with configuring the receiving component 802 to receive communication and / or the transmitting component 804 to transmit communication. Additionally or alternatively, the communication manager 806 may generate control information and / or provide control information to the receiving component 802 and / or the transmitting component 804 to control the receiving and / or transmitting of communication.
[0184] The receiving component 802 can receive sensing data associated with the multimodal session from the second multimodal device. The receiving component 802 and / or the transmitting component 804 can communicate with the network node at least in part based on the sensing data.
[0185] The communication manager 806 can switch from the first beam to the second beam, at least in part, based on sensing data.
[0186] The communication manager 806 can adapt one or more link parameters, at least in part, based on sensing data.
[0187] The communication manager 806 can modify one or more parameters, at least in part, based on perceived data, wherein the one or more parameters are associated with providing content to the user.
[0188] Figure 8 The number and arrangement of components shown are provided as an example. In reality, with... Figure 8 Compared to the components shown, there may be additional components, fewer components, different components, or components arranged in a different manner. Furthermore, Figure 8 The two or more components shown can be implemented within a single component, or Figure 8 The single component shown can be implemented as multiple distributed components. Additionally or alternatively, Figure 8 The collection of (one or more) components shown is executable and described as being composed of Figure 8 Another set of components shown performs one or more functions.
[0189] Figure 9This is a diagram illustrating an example device 900 for wireless communication according to the present disclosure. Device 900 may be a multimode device, or a multimode device may include device 900. In some aspects, device 900 includes a receiving component 902, a transmitting component 904, and / or a communication manager 906 that are communicable to each other (e.g., via one or more buses and / or one or more other components). In some aspects, the communication manager 906 is combined with... Figure 1 The described communication manager 140. As shown, device 900 can use receiving component 902 and transmitting component 904 to communicate with another device 908, such as a UE or a network node (such as a CU, DU, RU or base station).
[0190] In some respects, device 900 can be configured to perform the functions described herein. Figure 5 One or more operations described herein. Additionally or alternatively, device 900 may be configured to perform one or more processes described herein, such as Figure 7 The process is 700. In some respects, Figure 9 The illustrated device 900 and / or one or more components may include a combination Figure 2 One or more components of the first multimodal device described. Additionally or alternatively, Figure 9 One or more components shown can be combined Figure 2 Implementation within one or more of the described components. Additionally or alternatively, one or more components in the set of components may be implemented at least partially as software stored in one or more memories. For example, a component (or a portion thereof) may be implemented as instructions or code stored in a non-transitory computer-readable medium and executable by one or more controllers or one or more processors to perform the function or operation of the component.
[0191] Receiver 902 may receive communications from device 908, such as reference signals, control information, data communications, or combinations thereof. Receiver 902 may provide the received communications to one or more other components of device 900. In some aspects, receiver 902 may perform signal processing on the received communications (such as filtering, amplification, demodulation, analog-to-digital conversion, demultiplexing, deinterleaving, demapping, equalization, interference cancellation, or decoding, etc.) and may provide the processed signals to the one or more other components of device 900. In some aspects, receiver 902 may include combinations of... Figure 2 The first multimode device described includes one or more antennas, one or more modems, one or more demodulators, one or more MIMO detectors, one or more receiver processors, one or more controllers / processors, one or more memories, or combinations thereof.
[0192] Transmitting component 904 can transmit communications, such as reference signals, control information, data communications, or combinations thereof, to device 908. In some aspects, one or more other components of device 900 can generate communications and provide the generated communications to transmitting component 904 for transmission to device 908. In some aspects, transmitting component 904 can perform signal processing (such as filtering, amplification, modulation, digital-to-analog conversion, multiplexing, interleaving, mapping, or encoding, etc.) on the generated communications and can transmit the processed signals to device 908. In some aspects, transmitting component 904 may include combinations of... Figure 2 The described first multimode device includes one or more antennas, one or more modems, one or more modulators, one or more transmit MIMO processors, one or more transmit processors, one or more controllers / processors, one or more memories, or combinations thereof. In some aspects, the transmit component 904 may co-located with the receive component 902 in one or more transceivers.
[0193] The communication manager 906 may support the operation of the receiving component 902 and / or the transmitting component 904. For example, the communication manager 906 may receive information associated with configuring the receiving component 902 to receive communication and / or the transmitting component 904 to transmit communication. Additionally or alternatively, the communication manager 906 may generate control information and / or provide control information to the receiving component 902 and / or the transmitting component 904 to control the receiving and / or transmitting of communication.
[0194] The communication manager 906 can generate sensing data associated with the multimodal session. The transmitting component 904 can transmit the sensing data associated with the multimodal session to a second multimodal device.
[0195] The communication manager 906 can determine that the distance from the first multimodal device to the third multimodal device meets the condition, wherein the sensed data is not transmitted to the third multimodal device at least in part based on the distance from the first multimodal device to the third multimodal device meeting the condition.
[0196] Figure 9 The number and arrangement of components shown are provided as an example. In reality, with... Figure 9 Compared to the components shown, there may be additional components, fewer components, different components, or components arranged in a different manner. Furthermore, Figure 9 The two or more components shown can be implemented within a single component, or Figure 9 The single component shown can be implemented as multiple distributed components. Additionally or alternatively, Figure 9 The collection of (one or more) components shown is executable and described as being composed of Figure 9 Another set of components shown performs one or more functions.
[0197] The following provides an overview of some aspects of this disclosure:
[0198] Aspect 1: A method of wireless communication performed by a first multimodal device, the method comprising: receiving sensing data associated with a multimodal session from a second multimodal device; and communicating with a network node based at least in part on the sensing data.
[0199] Aspect 2: According to the method of aspect 1, the sensing data includes one or more of the following: obstruction detection information indicating whether a communication link will be blocked by an object, radio frequency map, location information indicating the user's location, or orientation information indicating the user's orientation.
[0200] Aspect 3: According to the method of aspect 2, the perceived data includes the obstruction detection information, and the obstruction detection information includes one or more of the following: image data obtained by one or more cameras of the second multimodal device, data corresponding to a depth map, or data corresponding to a three-dimensional representation of the user's environment.
[0201] Aspect 4: The method according to any one of Aspects 1 to 3, wherein the multimodal session identifier associated with the first multimodal device is also associated with the second multimodal device.
[0202] Aspect 5: The method according to any one of Aspects 1 to 4, wherein the first multimodal device is not configured to generate the sensing data.
[0203] Aspect 6: The method according to any one of Aspects 1 to 5, wherein the sensing data includes a first sensing data set, and wherein the first multimodal device is configured to generate a second sensing data set different from the first sensing data set.
[0204] Aspect 7: The method according to any one of aspects 1 to 6, the method further comprising: switching from a first beam to a second beam based at least in part on the sensing data.
[0205] Aspect 8: The method according to any one of aspects 1 to 7, the method further comprising: adapting one or more link parameters at least in part based on the sensed data.
[0206] Aspect 9: According to the method of aspect 8, adapting the one or more link parameters includes one or more of the following: switching to a beam utilized by the second multimode device; or utilizing Doppler spread estimation utilized by the second multimode device.
[0207] Aspect 10: The method according to any one of Aspects 1 to 9, the method further comprising: modifying one or more parameters at least in part based on the perceived data, wherein the one or more parameters are associated with providing content to the user.
[0208] Aspect 11: According to the method of aspect 10, modifying the one or more parameters associated with providing the content to the user includes one or more of the following: adjusting the frame insertion rate associated with providing the content to the user; or adapting the video rate associated with providing the content to the user.
[0209] Aspect 12: A method of wireless communication performed by a first multimodal device, the method comprising: generating sensing data associated with a multimodal session; and transmitting the sensing data associated with the multimodal session to a second multimodal device.
[0210] Aspect 13: According to the method of aspect 12, the sensing data is transmitted to the second multimodal device based at least in part on the channel correlation between the first multimodal device and the second multimodal device.
[0211] Aspect 14: The method according to any one of Aspects 12 to 13, wherein the sensing data is transmitted to the second multimodal device based at least in part on the distance between the first multimodal device and the second multimodal device.
[0212] Aspect 15: The method according to any one of Aspects 12 to 14, the method further comprising: determining that a distance from the first multimodal device to the third multimodal device satisfies a condition, wherein the sensing data is not transmitted to the third multimodal device at least in part based on the distance from the first multimodal device to the third multimodal device satisfying the condition.
[0213] Aspect 16: The method according to any one of Aspects 12 to 15, wherein the sensing data includes one or more of the following: obstruction detection information indicating whether a communication link will be blocked by an object, radio frequency map, location information indicating the location of a user, or orientation information indicating the orientation of the user.
[0214] Aspect 17: According to the method of aspect 16, the perceived data includes the obstruction detection information, and the obstruction detection information includes one or more of the following: image data obtained by one or more cameras of the first multimodal device, data corresponding to a depth map, or data corresponding to a three-dimensional representation of the user's environment.
[0215] Aspect 18: The method according to any one of Aspects 12 to 17, wherein the sensing data includes sensing data of a first type, the method further comprising: receiving information indicating that the second multimodal device is not configured to generate the first type of sensing data, wherein the sensing data is transmitted to the second multimodal device at least in part based on the second multimodal device not being configured to generate the first type of sensing data.
[0216] Aspect 19: An apparatus for wireless communication at a device, the apparatus comprising: one or more processors; one or more memories coupled to the one or more processors; and instructions stored in the one or more memories and executable by the one or more processors to cause the apparatus to perform the method according to one or more of aspects 1 to 18.
[0217] Aspect 20: An apparatus for wireless communication at a device, the apparatus comprising: one or more memories; and one or more processors coupled to the one or more memories, the one or more processors being configured to cause the device to perform the method according to one or more of aspects 1 to 18.
[0218] Aspect 21: An apparatus for wireless communication, the apparatus comprising at least one component for performing the method according to one or more of aspects 1 to 18.
[0219] Aspect 22: A non-transitory computer-readable medium storing code for wireless communication, said code including instructions executable by one or more processors to perform the methods described in one or more of aspects 1 to 18.
[0220] Aspect 23: A non-transitory computer-readable medium storing a set of instructions for wireless communication, the set of instructions comprising one or more instructions that, when executed by one or more processors of a device, cause the device to perform the method according to one or more of aspects 1 to 18.
[0221] Aspect 24: A device for wireless communication, the device including a processing system comprising one or more processors and one or more memories coupled to the one or more processors, the processing system being configured to cause the device to perform the method according to one or more of aspects 1 to 18.
[0222] Aspect 25: An apparatus for wireless communication at a device, the apparatus comprising one or more memories and one or more processors coupled to the one or more memories, the one or more processors being individually or collectively configured to cause the device to perform the method according to one or more of aspects 1 to 18.
[0223] While the foregoing disclosure provides examples and descriptions, it is not intended to be exhaustive or to limit the aspects to the precise form disclosed. Modifications and variations may be made based on the foregoing disclosure, or from various forms of practice.
[0224] As used herein, the term "component" is intended to be broadly interpreted as hardware or a combination of hardware and at least one of software or firmware. "Software" should be broadly interpreted as instructions, instruction sets, code, code segments, program code, programs, subroutines, software modules, applications, software applications, software packages, routines, subroutines, objects, executable programs, threads of execution, procedures, or functions, whether referred to as software, firmware, middleware, microcode, hardware description languages, or other terms. As used herein, a "processor" is implemented in hardware or a combination of hardware and software. It will be apparent that the systems or methods described herein may be implemented in various forms of hardware or combinations of hardware and software. The actual dedicated control hardware or software code used to implement these systems or methods is not limited in any way. Therefore, the operation and behavior of these systems or methods are described herein without reference to specific software code, as those skilled in the art will understand that the software and hardware can be designed to implement these systems or methods, at least in part, based on the description herein. Unless otherwise stated, a component configured to perform a function means that the component has the capability to perform that function, but it is not necessary for the component to actually perform that function.
[0225] As used in this article, depending on the context, "meeting the threshold" can mean a value greater than the threshold, greater than or equal to the threshold, less than the threshold, less than or equal to the threshold, equal to the threshold, not equal to the threshold, etc.
[0226] As used in this article, the phrase “at least one of” in a list of items refers to any combination of these items, including a single member. As an example, “at least one of the following: a, b, or c” is intended to cover a, b, c, a+b, a+c, b+c, and a+b+c, as well as any combination with multiple of the same element (e.g., a+a, a+a+a, a+a+b, a+a+c, a+b+b, a+c+c, b+b, b+b+b, b+b+c, c+c, and c+c+c, or any other ordering of a, b, and c).
[0227] No element, action, or instruction used herein should be construed as essential or necessary unless explicitly stated otherwise. Furthermore, as used herein, the articles “a” and “an” are intended to include one or more items and are used interchangeably with “one or more.” Similarly, as used herein, the article “described” is intended to include one or more items mentioned in connection with the article “described” and is used interchangeably with “one or more.” Furthermore, as used herein, the terms “collection” and “group” are intended to include one or more items and are used interchangeably with “one or more.” If only one item is desired, the phrase “only one” or similar terminology will be used. Moreover, as used herein, the terms “having” and similar terms are intended as open-ended terms that do not limit the elements they modify (e.g., “having” A may also have B). Additionally, the phrase “based on” is intended to mean “based on or otherwise related to” unless otherwise explicitly stated. Furthermore, as used herein, the term “or” is intended to be inclusive when used consecutively and is interchangeable with “and / or” unless otherwise explicitly stated (e.g., if used in conjunction with “either of the two” or “only one of them”). It should be understood that “one or more” is equivalent to “at least one”.
[0228] Although specific combinations of features are set forth in the claims or disclosed in the description, these combinations are not intended to limit the disclosure of various aspects. Many of these features may be combined in ways not specifically stated in the claims or disclosed in the description. The disclosure of various aspects includes each dependent claim in combination with each other claim in the claim set.
Claims
1. A first multimode device for wireless communication, the first multimode device comprising: One or more memory units; and One or more processors, said one or more processors coupled to said one or more memories, said one or more processors being configured to cause the first multimodal device to: Receive sensing data associated with the multimodal session from a second multimodal device; and Communicating with network nodes is based at least in part on the perceived data.
2. The first multimodal device according to claim 1, wherein the sensing data includes one or more of the following: Obstruction detection information indicating whether a communication link will be blocked by an object. Radio frequency map, Location information indicating the user's location, or Information indicating the user's orientation.
3. The first multimodal device according to claim 2, wherein the sensing data includes the obstruction detection information, and wherein the obstruction detection information includes one or more of the following: Image data obtained by one or more cameras of the second multimodal device, Data corresponding to the depth map, or Data corresponding to a three-dimensional representation of the user's environment.
4. The first multimodal device of claim 1, wherein the multimodal session identifier associated with the first multimodal device is also associated with the second multimodal device.
5. The first multimodal device of claim 1, wherein the first multimodal device is not configured to generate the sensing data.
6. The first multimodal device of claim 1, wherein the sensing data includes a first sensing data set, and wherein the first multimodal device is configured to generate a second sensing data set different from the first sensing data set.
7. The first multimodal device of claim 1, wherein the one or more processors are further configured to cause the first multimodal device to: The switching from the first beam to the second beam is based at least in part on the sensing data.
8. The first multimodal device of claim 1, wherein the one or more processors are further configured to cause the first multimodal device to: One or more link parameters are adapted, at least in part, based on the perceived data.
9. The first multimodal device of claim 8, wherein, in order to adapt the first multimodal device to the one or more link parameters, the one or more processors are configured to cause the first multimodal device to: Switch to the beam utilized by the second multimode device; or The Doppler spread estimation is utilized by the second multimodal device.
10. The first multimodal device of claim 1, wherein the one or more processors are further configured to cause the first multimodal device to: One or more parameters may be modified, at least in part, based on the perceived data, wherein the one or more parameters are associated with providing content to the user.
11. The first multimodal device of claim 10, wherein, in order for the first multimodal device to modify the one or more parameters associated with providing the content to the user, the one or more processors are configured to cause the first multimodal device to: Adjust the frame insertion rate associated with providing the content to the user; or Adapting to the video rate associated with providing the content to the user.
12. A first multimode device for wireless communication, the first multimode device comprising: One or more memory units; and One or more processors, said one or more processors coupled to said one or more memories, said one or more processors being configured to cause the first multimodal device to: Generate perceptual data associated with multimodal conversations; and The sensing data associated with the multimodal session is sent to a second multimodal device.
13. The first multimodal device of claim 12, wherein the sensing data is transmitted to the second multimodal device based at least in part on channel correlation between the first multimodal device and the second multimodal device.
14. The first multimodal device of claim 12, wherein the sensing data is transmitted to the second multimodal device based at least in part on the distance between the first multimodal device and the second multimodal device.
15. The first multimodal device of claim 12, wherein the one or more processors are further configured to cause the first multimodal device to: A condition is determined that the distance from the first multimodal device to the third multimodal device satisfies the condition, wherein the sensed data is not transmitted to the third multimodal device at least in part based on the condition being satisfied by the distance from the first multimodal device to the third multimodal device.
16. The first multimodal device of claim 12, wherein the sensing data includes one or more of the following: Obstruction detection information indicating whether a communication link will be blocked by an object. Radio frequency map, Location information indicating the user's location, or Information indicating the user's orientation.
17. The first multimodal device of claim 16, wherein the sensing data includes the obstruction detection information, and wherein the obstruction detection information includes one or more of the following: Image data obtained by one or more cameras of the first multimodal device, Data corresponding to the depth map, or Data corresponding to a three-dimensional representation of the user's environment.
18. The first multimodal device of claim 12, wherein the sensing data includes sensing data of a first type, and wherein the one or more processors are further configured to cause the first multimodal device to: Receive information indicating that the second multimodal device is not configured to generate the first type of sensing data, wherein the sensing data is sent to the second multimodal device at least in part based on the fact that the second multimodal device is not configured to generate the first type of sensing data.
19. A method for wireless communication performed by a first multimode device, the method comprising: Receive sensing data associated with the multimodal session from the second multimodal device; as well as Communicating with network nodes is based at least in part on the perceived data.
20. The method of claim 19, wherein the sensed data comprises one or more of the following: Obstruction detection information indicating whether a communication link will be blocked by an object. Radio frequency map, Location information indicating the user's location, or Orientation information indicating the user's orientation.
