Methods and apparatuses for communication
By calibrating sensing information with geometric shape-based representations, the integration of sensing and communication systems addresses accuracy and resource challenges, enhancing system performance.
Patent Information
- Application Number
- PCT/CN2024/104734
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-04-08
- Filing Date
- 2024-07-10
- Publication Date
- 2025-10-16
AI Technical Summary
Existing communication systems face challenges in integrating sensing and communication functions, leading to increased hardware and resource requirements, with limited accuracy in UE position information due to factors like limited resolution, dynamic environments, and numerous objects with varying electromagnetic properties.
Implementing a method for calibrating sensing information using geometric shape-based representations, where devices receive calibration indications to improve accuracy and reduce computational and transmission overheads, utilizing integrated sensing and communication systems.
Enhances the accuracy of sensing results and reduces computational complexity and transmission overheads by using geometric shape-based representations for sensing information calibration, thereby improving overall system performance.
Smart Images

Figure CN2024104734_16102025_PF_FP_ABST
Abstract
Description
Methods and Apparatuses for Communication
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS
[0002] This application claims priority to U.S. provisional application No. 63 / 631,047, filed on April 8, 2024 and entitled “A METHOD AND APPARATUS FOR CALIBRATION-BASED SENSING INFORMATION FEEDBACK INDICATION” , which is incorporated in its entirety herein by reference.TECHNICAL FIELD
[0003] Example embodiments of the present disclosure generally relate to the field of communications, and in particular, to methods, apparatuses, systems, computer-readable storage media, computer program products and chips for calibration of sensing information.BACKGROUND
[0004] User equipment (UE) position information is often used in cellular communication networks to improve various performance metrics for a network (NW) . A sensing system may be used to help gather UE position information, including its location in a global coordinate system, its velocity and direction of movement in the global coordinate system, orientation information, and information about a wireless environment. While the sensing system may be separate from a communication system, it may be advantageous to gather the UE position information using an integrated system, which reduces hardware and cost in the integrated system as well as time, frequency, or spatial resources needed to achieve both functionalities. Accordingly, integrated sensing and communication is a desirable feature in existing and future communication systems.SUMMARY
[0005] In general, example embodiments of the present disclosure provide methods, apparatuses, systems, computer-readable storage media, computer program products and chips for calibration of sensing information.
[0006] In a first aspect, there is provided a method for communication. The method may be implemented at a first device. The method comprises: receiving a first indication for calibrating a first sensing information of a sensing target; and calibrating the first sensing information based on the first indication. In this way, the first device could receive calibration information from other device (s) and calibrate its sensing result based on the calibration information, thereby improving an accuracy of sensing description and better improve the performance of subsequent tasks.
[0007] In some embodiments, the method further comprises: transmitting the calibrated first sensing information of the sensing target. In this way, the first device could feed back the calibrated sensing information to other device (s) , thereby helping other device (s) to improve the sensing result.
[0008] In some embodiments, the first sensing information is represented by at least one geometric representation. In this way, the sensing information could be represented in a simplified and effective manner.
[0009] In some embodiments, the first indication comprises ground-truth information of the sensing target. In this way, the ground-truth information could be used for calibrating the sensing result, thereby further improving the accuracy of sensing.
[0010] In some embodiments, the first indication indicates at least one of the following: a rotation angle of a geometric representation of the sensing target; a translation vector of a geometric representation of the sensing target; an environment information related to the sensing target; a region information for selecting sensing information to be transmitted; and another sensing information having a different modality from the first sensing information. In this way, the first indication could comprise various types of information for sensing information calibration.
[0011] In some embodiments, the environment information is represented by at least one geometric representation. In this way, the first indication could be represented in a simplified and effective manner.
[0012] In some embodiments, the method further comprises: determining the rotation angle of the geometric representation of the sensing target based on the environment information related to the sensing target. In this way, a rotation angle could be derived based on the environment information related to the sensing target, and then be used for sensing information calibration.
[0013] In some embodiments, calibrating the first sensing information based on the first indication comprises: rotating the geometric representation of the sensing target based on the rotation angle. In this way, the sensing information could be calibrated by rotating the geometric representation of the sensing target.
[0014] In some embodiments, rotating the geometric representation of the sensing target based on the rotation angle comprises: rotating a normal vector of the geometric representation based on the rotation angle when the geometric representation is of a two-dimensional (2D) shape. In this way, it provides a specific manner for rotating the geometric representation of the sensing target.
[0015] In some embodiments, calibrating the first sensing information based on the first indication comprises: translating the geometric representation of the sensing target based on the translation vector. In this way, the sensing information could be calibrated by translating the geometric representation of the sensing target.
[0016] In some embodiments, the calibrated first sensing information of the sensing target comprises at least one element, and each of the at least one element corresponds to one geometric shape type. In this way, the calibrated sensing information could be represented in a simplified and effective manner.
[0017] In some embodiments, the calibrated first sensing information of the sensing target further comprises at least one of the following: a second indication of at least one geometric shape type; and a quantity of elements corresponding to each of the at least one geometric shape type.
[0018] In some embodiments, a geometric shape of a square is represented by one of: a center point and a side length; a center point, a side length and a normal vector; four vertices; and one vertex and two direction vectors; a geometric shape of a circle is represented by one of: a center point and a radius; and a center point, a radius and a normal vector; a geometric shape of a rectangle is represented by one of: four vertices; and one vertex and two direction vectors; a geometric shape of a polygon is represented by a set of vertices; a geometric shape of a line segment is represented by: two vertices; and one vertex and one direction vector; a geometric shape of a cube is represented by eight vertices; and a geometric shape of a sphere is represented by a center point and a radius. In this way, the geometric representation of the calibrated sensing information could use various kinds of representations.
[0019] In some embodiments, the method further comprises: transmitting a second sensing information of the sensing target for determination of the first indication. In this way, the first indication used for sensing information calibration could be derived based on a previous sensing information from the first device.
[0020] In a second aspect, there is provided a method for communication. The method may be implemented at a second device. The method comprises: determining a first indication for calibrating a first sensing information of a sensing target; and transmitting the first indication. In this way, the second device could determine a first indication for calibrating sensing result of the first device and transmit the first indication to the first device, thereby improving an accuracy of sensing description and better improve the performance of subsequent tasks.
[0021] In some embodiments, the method further comprises: receiving a calibrated first sensing information of the sensing target. In this way, the second device could receive the calibrated sensing information, thereby improving the sensing result.
[0022] In some embodiments, the first sensing information is represented by at least one geometric representation. In this way, the sensing information could be represented in a simplified and effective manner.
[0023] In some embodiments, the first indication comprises ground-truth information of the sensing target. In this way, the ground-truth information could be used for calibrating the sensing result, thereby further improving the accuracy of sensing.
[0024] In some embodiments, the first indication indicates at least one of the following: a rotation angle of a geometric representation of the sensing target; a translation vector of a geometric representation of the sensing target; an environment information related to the sensing target; a region information for selecting sensing information to be transmitted; and another sensing information having a different modality from the first sensing information. In this way, the first indication could comprise various types of information for sensing information calibration.
[0025] In some embodiments, the environment information is represented by at least one geometric representation. In this way, the first indication could be represented in a simplified and effective manner.
[0026] In some embodiments, the calibrated first sensing information of the sensing target comprises at least one element, and each of the at least one element corresponds to one geometric shape type. In this way, the calibrated sensing information could be represented in a simplified and effective manner.
[0027] In some embodiments, the calibrated first sensing information of the sensing target further comprises at least one of the following: a second indication of at least one geometric shape type; and a quantity of elements corresponding to each of the at least one geometric shape type.
[0028] In some embodiments, a geometric shape of a square is represented by one of: a center point and a side length; a center point, a side length and a normal vector; four vertices; and one vertex and two direction vectors; a geometric shape of a circle is represented by one of: a center point and a radius; and a center point, a radius and a normal vector; a geometric shape of a rectangle is represented by one of: four vertices; and one vertex and two direction vectors; a geometric shape of a polygon is represented by a set of vertices; a geometric shape of a line segment is represented by: two vertices; and one vertex and one direction vector; a geometric shape of a cube is represented by eight vertices; and a geometric shape of a sphere is represented by a center point and a radius. In this way, the geometric representation of the calibrated sensing information could use various kinds of representations.
[0029] In some embodiments, the method further comprises: receiving sensing information from a plurality of devices, wherein determining the first indication for calibrating the first sensing information of the sensing target comprises: determining the first indication based on the sensing information from the plurality of devices. In this way, the first indication used for sensing information calibration could be derived based on sensing information from a plurality of devices.
[0030] In some embodiments, the method further comprises: receiving a second sensing information of the sensing target from a device which is to receive the first indication, and wherein determining the first indication for calibrating the first sensing information of the sensing target comprises: determining the first indication based on the second sensing information. In this way, the first indication used for sensing information calibration could be derived based on a previous sensing information from the first device.
[0031] In a third aspect, there is provided an apparatus of communication. The apparatus may be configured to perform the method according to the first or second aspect.
[0032] In a fourth aspect, there is provided an apparatus for communication. The apparatus may be implemented at a first device. The apparatus comprises: a first receiving unit configured to receive a first indication for calibrating a first sensing information of a sensing target; and a first processing unit configured to calibrate the first sensing information based on the first indication.
[0033] In a fifth aspect, there is provided an apparatus for communication. The apparatus may be implemented at a second device. The apparatus comprises: a second processing unit configured to determine a first indication for calibrating a first sensing information of a sensing target; and a first transmitting unit configured to transmit the first indication.
[0034] In a sixth aspect, there is provided an apparatus of communication. The apparatus comprises at least one processor and at least one memory storing instructions that, when executed by the at least one processor, cause the apparatus to perform at least the method according to the first or second aspect.
[0035] In a seventh aspect, there is provided a system for communication. The system comprises a first communication apparatus configured to perform the method of the first aspect and a second communication apparatus configured to perform the method of the second aspect.
[0036] In an eighth aspect, there is provided a computer-readable storage medium having instructions stored thereon which, when executed by an apparatus, cause the apparatus to perform the method according to the first or second aspect.
[0037] In a ninth aspect, there is provided a computer program product storing instructions which, when executed, cause an apparatus to perform the method according to the first or second aspect.
[0038] The summary section is not intended to identify key or essential features of embodiments of the present disclosure, nor is it intended to be used to limit the scope of the present disclosure. Other features of the present disclosure will become easily comprehensible through the following description.BRIEF DESCRIPTION OF THE DRAWINGS
[0039] Some example embodiments will now be described with reference to the accompanying drawings, in which:
[0040] FIG. 1 illustrates a schematic illustration of an example communication system in which some embodiments of the present disclosure may be implemented;
[0041] FIG. 2 illustrates another schematic illustration of an example communication system in which some embodiments of the present disclosure may be implemented;
[0042] FIG. 3 illustrates a simplified block diagram of devices that are suitable for implementing embodiments of the present disclosure;
[0043] FIG. 4A illustrates an example apparatus according to an implementation of the present disclosure.
[0044] FIG. 4B illustrates a simplified block diagram of units or modules in a device that is suitable for implementing embodiments of the present disclosure;
[0045] FIG. 5A illustrates a diagram illustrating an example point cloud representation of sensing information according to some embodiments of the present disclosure;
[0046] FIG. 5B illustrates a diagram illustrating an example mesh representation of sensing information according to some embodiments of the present disclosure;
[0047] FIG. 6 illustrates a signaling chart illustrating an example process of communication according to some embodiments of the present disclosure;
[0048] FIG. 7A illustrates a diagram illustrating an example element-based representation for an object detection according to some embodiments of the present disclosure;
[0049] FIG. 7B illustrates a diagram illustrating an example element-based representation for an environment reconstruction according to some embodiments of the present disclosure;
[0050] FIG. 8 illustrates a signaling chart illustrating an example process of communication according to some other embodiments of the present disclosure;
[0051] FIG. 9A illustrates a diagram illustrating example rotation angles for sensing information calibration according to some embodiments of the present disclosure;
[0052] FIG. 9B illustrates a diagram illustrating example translation vectors for sensing information calibration according to some embodiments of the present disclosure;
[0053] FIG. 9C illustrates a diagram illustrating an example environment information for sensing information calibration according to some embodiments of the present disclosure;
[0054] FIG. 9D illustrates a diagram illustrating an example region information for sensing information calibration according to some embodiments of the present disclosure;
[0055] FIG. 10 illustrates a signaling chart illustrating an example process for sensing information calibration according to some embodiments of the present disclosure;
[0056] FIG. 11 illustrates a diagram illustrating an example element-based representation for an environment reconstruction according to some other embodiments of the present disclosure;
[0057] FIG. 12A illustrates a signaling chart illustrating an example process for sensing information calibration according to some other embodiments of the present disclosure;
[0058] FIG. 12B illustrates a signaling chart illustrating an example process for sensing information calibration according to yet some other embodiments of the present disclosure;
[0059] FIG. 13 illustrates a diagram illustrating an example element-based representation for an environment reconstruction according to still some other embodiments of the present disclosure;
[0060] FIG. 14 illustrates a flowchart of an example method for communication implemented at a first device according to some embodiments of the present disclosure;
[0061] FIG. 15 illustrates a flowchart of an example method for communication implemented at a second device according to some embodiments of the present disclosure;
[0062] FIG. 16 illustrates a simplified block diagram of an example apparatus of communication implemented at a first device according to some embodiments of the present disclosure; and
[0063] FIG. 17 illustrates a simplified block diagram of an example apparatus of communication implemented at a second device according to some embodiments of the present disclosure.
[0064] Throughout the drawings, the same or similar reference numerals represent the same or similar elements.DETAILED DESCRIPTION
[0065] Principle of the present disclosure will now be described with reference to some example embodiments. These embodiments are described only for the purpose of illustration and help those skilled in the art to understand and implement the present disclosure, without suggesting any limitation as to the scope of the disclosure. The disclosure described herein can be implemented in various manners other than the ones described below.
[0066] In the following description and claims, unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skills in the art to which this disclosure belongs.
[0067] References in the present disclosure to “one embodiment” , “an embodiment” , “an example embodiment” , and the like indicate that the embodiment described may include a particular feature, structure, or characteristic, but it is not necessary that every embodiment includes the particular feature, structure, or characteristic. Moreover, such phrases are not necessarily referring to the same embodiment. Further, when a particular feature, structure, or characteristic is described in connection with an embodiment, it is submitted that it is within the knowledge of one skilled in the art to affect such feature, structure, or characteristic in connection with other embodiments whether or not explicitly described.
[0068] It shall be understood that although the terms “first” and “second” etc. may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, a first element could be termed a second element, and similarly, a second element could be termed a first element, without departing from the scope of example embodiments. As used herein, the term “and / or” includes any and all combinations of one or more of the listed terms.
[0069] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of example embodiments. As used herein, the singular forms “a” , “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “comprises” , “comprising” , “has” , “having” , “includes” and / or “including” , when used herein, specify the presence of stated features, elements, and / or components etc., but do not preclude the presence or addition of one or more other features, elements, components and / or combinations thereof.
[0070] In the context of the present disclosure, the term “a location” may be used interchangeably with “a position” , and the “integrated sensing and communication” system describes a kind of sensing assisted communication system, and may be used interchangeably with “integrated communication and sensing” , “joint sensing and communication” , “cooperative sensing and communication” , or any other similar names.
[0071] In the context of the present disclosure, the term “a sensing target” may refer to an environment and / or object (s) within the environment. The term “environment” herein may be interchangeably used with “sensing environment” , and the term “object” herein may be interchangeably used with “sensing object” . The term “sensing information” may refer to information of the sensing target such as the sensing environment or object. The term “sensing information” herein may be interchangeably used with “sensing results” . The term “environment” may refer to a large sensing target, such as a building, etc. The term “object” may refer to a small sensing target, such as a car, a person, etc. In some embodiments, “a sensing target” may be associated with a sensing task, such as a sensing object or a reconstructed environment, and may be sensed to determine or generate the sensing information.
[0072] As mentioned above, UE position information is often used in cellular communication networks to improve various performance metrics for the network. Such performance metrics may, for example, include capacity, agility, and efficiency. The improvement may be achieved when elements of the network exploit the position, the behavior, the mobility pattern, etc., of the UE in the context of a priori information describing a wireless environment in which the UE is operating.
[0073] A sensing system may be used to help gather UE pose information, including its location in a global coordinate system, its velocity and direction of movement in the global coordinate system, orientation information, and the information about the wireless environment. Examples of well-known sensing systems include radio detection and ranging (RADAR) and light detection and ranging (LIDAR) . While the sensing system can be separate from the communication system, it could be advantageous to gather the information using an integrated system, which reduces the hardware (and cost) in the system as well as the time, frequency, or spatial resources needed to achieve both functionalities. However, using the communication system hardware to perform sensing of UE pose and environment information is a highly challenging and open problem. The difficulty of the problem relates to factors such as the limited resolution of the communication system, the dynamicity of the environment, and the huge number of objects whose electromagnetic properties and position are to be estimated.
[0074] Accordingly, the integrated sensing and communication is a desirable feature in existing and future communication systems.
[0075] In some scenarios of the integrated sensing and communication, a device (or sensor, or UE) may sense the environment, and then perform a corresponding task based on the sensing results. The task can be object detection, object tracking, obstacle avoidance, and so on. In some other scenarios of the integrated sensing and communication, the device may perform environment reconstruction based on the sensing results, and then use the reconstructed environment to further assist in communications. The device may also report the sensing results (e.g., the detected object, or the reconstructed environment) to a central node (or sensor, or base station) for further processing. For example, because each device may sense / observe a same environment from different angles, the central node may fuse the sensing results of a plurality of devices into a complete / large environment map. The fused environment map can be used to perform tasks / applications such as environment reconstruction or digital twin. Furthermore, the central node may also send the fused environment map to another device to assist its communication tasks such as beamforming / beam tracking, multiple input multiple output (MIMO) parameter estimation, etc. By sensing fusion, the reconstructed environment is more complete and refined, which helps to obtain better task execution results.
[0076] In the above scenarios, the exchanged sensing information, e.g., the detected object or sensed environment, needs to be described in a certain way. A very fine-grained description is good, but also causes relatively large computation overhead and large transmission overhead. Considering scenarios such as object detection, object tracking, obstacle avoidance and environment reconstruction to assist communication, a rough and general description for sensing information can meet the requirements of most tasks. Therefore, how to describe the environment / object in a simplified manner can be considered.
[0077] Thus, some example embodiments of the present disclosure provide a solution in which geometric shape-based representation is considered as an indication manner of sensing information, which can describe the sensing target (e.g., environment / object) in a simplified and effective way. The term “geometric shape-based representation” means that a sensing target or sensing information of the sensing target is represented by geometric shape (s) . Based on such simplified representation, computational complexity and power consumption at a device can be reduced, and transmission overheads for sensing information exchange can also be greatly reduced.
[0078] In some embodiments, because some devices may have limited sensing distance / range, or limited computing capabilities, and / or physical conditions (e.g. with some obstacles) for processing sensing information, the obtained results / descriptions at the devices may be different (i.e., with certain deviations) from the real sensing target. Thus, some example embodiments of the present disclosure provide a solution of providing some calibration information to such devices. In the solution, a first device may receive (e.g., from a second device) a first indication for calibrating a first sensing information of a sensing target. Then, the first device may calibrate the first sensing information based on the first indication. By implementing the embodiments of the present disclosure, an accuracy of sensing results / descriptions could be improved and performance of subsequent tasks could be better improved as well.
[0079] In some embodiments, the first device may be a terminal device (e.g., the electronic device (ED) 110) , or a RAN network device (e.g., the network node 170) , or a core network device in the core network 130, or an access point (AP) . In some embodiments, the second device may be a terminal device (e.g., the ED 110) , or a RAN device (e.g., the network node 170) in the RAN 120, or a core network device in the core network 130, or an AP.
[0080] Principles and implementations of the present disclosure will be described in detail below with reference to the figures.
[0081] FIG. 1 illustrates a schematic illustration of an example communication system 100 in which some embodiments of the present disclosure may be implemented. Referring to FIG. 1, as an illustrative example without limitation, a simplified schematic illustration of a communication system is provided. The communication system 100 comprises a radio access network (RAN) 120. The radio access network 120 may be a future generation radio access network, or a legacy (e.g. 5G, 4G, 3G or 2G) radio access network. One or more communication electronic devices (ED) 110a, 110b, 110c, 110d, 110e, 110f, 110g, 110h, 110i, 110j (generically referred to as 110) may be interconnected to one another or connected to one or more network nodes (170a, 170b, generically referred to as 170) in the radio access network 120. A core network 130 may be a part of the communication system 100 and may be dependent or independent of a radio access technology used in the communication system 100. The communication system 100 may also comprise a public switched telephone network (PSTN) 140, the internet 150, and other networks 160.
[0082] FIG. 2 illustrates another schematic illustration of an example communication system 200 in which some embodiments of the present disclosure may be implemented. The communication system 200 may be an example implementation of the communication system 100. In general, the communication system 200 enables multiple wireless or wired elements to communicate data and other content. The purpose of the communication system 200 may be to provide content, such as voice, data, video, and / or text, via broadcast, multicast, groupcast, unicast, etc. The communication system 200 may operate by sharing resources, such as carrier spectrum bandwidth, between its constituent elements. The communication system 200 may include a terrestrial communication system and / or a non-terrestrial communication system. The communication system 200 may provide a wide range of communication services and applications (such as earth monitoring, remote sensing, passive sensing and positioning, navigation and tracking, autonomous delivery and mobility, etc. ) . The communication system 200 may provide a high degree of availability and robustness through a joint operation of a terrestrial communication system and a non-terrestrial communication system. For example, integrating a non-terrestrial communication system (or components thereof) into a terrestrial communication system can result in what may be considered a heterogeneous network comprising multiple layers. Compared to conventional communication networks, the heterogeneous network may achieve better overall performance through efficient multi-link joint operation, more flexible functionality sharing, and faster physical layer link switching between terrestrial networks and non-terrestrial networks.
[0083] The terrestrial communication system and the non-terrestrial communication system could be considered sub-systems of the communication system 200. In the example shown in FIG. 2, the communication system 200 includes EDs 110a, 110b, 110c, 110d (generically referred to as ED 110) , radio access networks (RANs) 120a, 120b, a non-terrestrial communication network 120c, a core network 130, a public switched telephone network (PSTN) 140, the Internet 150, and other networks 160. The RANs 120a, 120b include respective base stations (BSs) 170a, 170b, which may be generically referred to as terrestrial transmit and receive points (T-TRPs) 170a, 170b. The non-terrestrial communication network 120c includes an access node 172, which may be generically referred to as a non-terrestrial transmit and receive point (NT-TRP) 172.
[0084] Any ED 110 may be alternatively or additionally configured to interface, access, or communicate with any T-TRP 170a, 170b and NT-TRP 172, the Internet 150, the core network 130, the PSTN 140, the other networks 160, or any combination of the preceding. In some examples, the ED 110a may communicate an uplink and / or downlink transmission over a terrestrial air interface 190a with the T-TRP 170a. In some examples, the EDs 110a, 110b, 110c, and 110d may also communicate directly with one another via one or more sidelink air interfaces 190b. In some examples, the ED 110d may communicate an uplink and / or downlink transmission over a non-terrestrial air interface 190c with the NT-TRP 172.
[0085] The air interfaces 190a and 190b may use similar communication technology, such as any suitable radio access technology. For example, the communication system 200 may implement one or more channel access methods, such as code division multiple access (CDMA) , space division multiple access (SDMA) , time division multiple access (TDMA) , frequency division multiple access (FDMA) , orthogonal FDMA (OFDMA) , or single-carrier FDMA (SC-FDMA, also known as discrete Fourier transform spread OFDMA, DFT-s-OFDMA) in the air interfaces 190a and 190b. The air interfaces 190a and 190b may utilize other higher dimension signal spaces, which may involve a combination of orthogonal and / or non-orthogonal dimensions.
[0086] The non-terrestrial air interface 190c may enable communication between the ED 110d and one or multiple NT-TRPs 172 via a wireless link or simply a link. For some examples, the link is a dedicated connection for unicast transmission, a connection for broadcast transmission, or a connection between a group of EDs 110 and one or multiple NT-TRPs 172 for multicast transmission.
[0087] The RANs 120a and 120b are in communication with the core network 130 to provide the EDs 110a 110b, and 110c with various services such as voice, data, and other services. The RANs 120a and 120b and / or the core network 130 may be in direct or indirect communication with one or more other RANs (not shown) , which may or may not be directly served by core network 130, and may or may not employ the same radio access technology as RAN 120a, RAN 120b or both. The core network 130 may also serve as a gateway access between (i) the RANs 120a and 120b or EDs 110a 110b, and 110c or both, and (ii) other networks (such as the PSTN 140, the Internet 150, and the other networks 160) . In addition, some or all of the EDs 110a 110b, and 110c may include functionality for communicating with different wireless networks over different wireless links using different wireless technologies and / or protocols. Instead of wireless communication (or in addition thereto) , the EDs 110a 110b, and 110c may communicate via wired communication channels to a service provider or switch (not shown) , and to the Internet 150. The PSTN 140 may include circuit switched telephone networks for providing plain old telephone service (POTS) . The Internet 150 may include a network of computers and subnets (intranets) or both, and incorporate protocols, such as Internet protocol (IP) , transmission control protocol (TCP) , user datagram protocol (UDP) . The EDs 110a 110b, and 110c may be multimode devices capable of operation according to multiple radio access technologies, and incorporate multiple transceivers necessary to support such operations.
[0088] FIG. 3 illustrates a simplified block diagram of devices 300 that are suitable for implementing embodiments of the present disclosure. FIG. 3 illustrates another example implementation of the ED 110 and the base station 170a, 170b and / or 170c. The ED 110 is used to connect persons, objects, machines, etc. The ED 110 may be widely used in various scenarios including, for example, cellular communications, device-to-device (D2D) , vehicle to everything (V2X) , peer-to-peer (P2P) , machine-to-machine (M2M) , machine-type communications (MTC) , Internet of things (IoT) , virtual reality (VR) , augmented reality (AR) , mixed reality (MR) , metaverse, digital twin, industrial control, self-driving, remote medical, smart grid, smart furniture, smart office, smart wearable, smart transportation, smart city, drones, robots, remote sensing, passive sensing, positioning, navigation and tracking, autonomous delivery and mobility, etc.
[0089] Each ED 110 represents any suitable end user device for wireless operation and may include such devices (or may be referred to) as a UE, a wireless transmit / receive unit (WTRU) , a mobile station, a fixed or mobile subscriber unit, a cellular telephone, a station (STA) , a machine type communication (MTC) device, a personal digital assistant (PDA) , a smartphone, a laptop, a computer, a tablet, a wireless sensor, a consumer electronics device, a smart book, a vehicle, a car, a truck, a bus, a train, or an IoT device, wearable devices (such as a watch, a pair of glasses, head mounted equipment, etc. ) , an industrial device, or an apparatus in (e.g. communication module, modem, or chip) or comprising the forgoing devices, among other possibilities. Future generation EDs 110 may be referred to as other terms. The base station 170a and 170b is a T-TRP and will hereafter be referred to as T-TRP 170. Also shown in FIG. 3, a NT-TRP will hereafter be referred to as NT-TRP 172. Each ED 110 connected to the T-TRP 170 and / or the NT-TRP 172 may be dynamically or semi-statically turned-on (i.e., established, activated, or enabled) , turned-off (i.e., released, deactivated, or disabled) and / or configured in response to one or more of:connection availability and connection necessity.
[0090] The ED 110 includes a transmitter 201 and a receiver 203 coupled to one or more antennas 204. Only one antenna 204 is illustrated to avoid congestion in the drawing. One, some, or all of the antennas 204 may alternatively be panels. The transmitter 201 and the receiver 203 may be integrated, e.g. as a transceiver. The transceiver is configured to modulate data or other content for transmission by at least one antenna 204 or network interface controller (NIC) . The transceiver is also configured to demodulate data or other content received by the at least one antenna 204. Each transceiver includes any suitable structure for generating signals for wireless or wired transmission and / or processing signals received wirelessly or by wire. Each antenna 204 includes any suitable structure for transmitting and / or receiving wireless or wired signals.
[0091] The ED 110 includes at least one memory 208. The memory 208 stores instructions and data used, generated, or collected by the ED 110. For example, the memory 208 could store software instructions or modules configured to implement some or all of the functionality and / or embodiments described herein and that are executed by one or more processing unit (s) (e.g., a processor 210) . Each memory 208 includes any suitable volatile and / or non-volatile storage and retrieval device (s) . Any suitable type of memory may be used, such as random access memory (RAM) , read only memory (ROM) , hard disk, optical disc, subscriber identity module (SIM) card, memory stick, secure digital (SD) memory card, on-processor cache, and the like.
[0092] The ED 110 may further include one or more input / output devices (not shown) or interfaces (such as a wired interface to the Internet 150 in FIG. 1) . The input / output devices or interfaces permit interaction with a user or other devices in the network. Each input / output device or interface includes any suitable structure for providing information to or receiving information from a user, and / or for network interface communications. Suitable structures include, for example, a speaker, microphone, keypad, keyboard, display, touch screen, etc.
[0093] The ED 110 includes the processor 210 for performing operations including those operations related to preparing a transmission for uplink transmission to the NT-TRP 172 and / or the T-TRP 170; those operations related to processing downlink transmissions received from the NT-TRP 172 and / or the T-TRP 170; and those operations related to processing sidelink transmission to and from another ED 110. Processing operations related to preparing a transmission for uplink transmission may include operations such as encoding, modulating, transmit beamforming, and generating symbols for transmission. Processing operations related to processing downlink transmissions may include operations such as receive beamforming, demodulating and decoding received symbols. Depending upon the embodiment, a downlink transmission may be received by the receiver 203, possibly using receive beamforming, and the processor 210 may extract signaling from the downlink transmission (e.g. by detecting and / or decoding the signaling) . An example of signaling may be a reference signal transmitted by the NT-TRP 172 and / or by the T-TRP 170. In some embodiments, the processor 210 implements the transmit beamforming and / or the receive beamforming based on the indication of beam direction, e.g. beam angle information (BAI) , received from the T-TRP 170. In some embodiments, the processor 210 may perform operations relating to network access (e.g. initial access) and / or downlink synchronization, such as operations relating to detecting a synchronization sequence, decoding and obtaining the system information, etc. In some embodiments, the processor 210 may perform channel estimation, e.g. using a reference signal received from the NT-TRP 172 and / or from the T-TRP 170.
[0094] Although not illustrated, the processor 210 may form part of the transmitter 201 and / or part of the receiver 203. Although not illustrated, the memory 208 may form part of the processor 210.
[0095] The processor 210, the processing components of the transmitter 201, and the processing components of the receiver 203 may each be implemented by the same or different one or more processors that are configured to execute instructions stored in a memory (e.g. in the memory 208) . Alternatively, some or all of the processor 210, the processing components of the transmitter 201, and the processing components of the receiver 203 may each be implemented using dedicated circuitry, such as a programmed field-programmable gate array (FPGA) , an application-specific integrated circuit (ASIC) , or a hardware accelerator such as a graphics processing unit (GPU) or an artificial intelligence (AI) accelerator.
[0096] The T-TRP 170 may be known by other names in some implementations, such as a base station, a base transceiver station (BTS) , a radio base station, a network node, a network device, a device on the network side, a transmit / receive node, a Node B, an evolved NodeB (eNodeB or eNB) , a Home eNodeB, a next Generation NodeB (gNB) , a transmission point (TP) , a site controller, an access point (AP) , a wireless router, a relay station, a terrestrial node, a terrestrial network device, a terrestrial base station, a base band unit (BBU) , a remote radio unit (RRU) , an active antenna unit (AAU) , a remote radio head (RRH) , a central unit (CU) , a distributed unit (DU) , a positioning node, among other possibilities. The T-TRP 170 may be a macro BS, a pico BS, a relay node, a donor node, or the like, or combinations thereof. The T-TRP 170 may refer to the forgoing devices or refer to apparatus (e.g. a communication module, a modem, or a chip) in the forgoing devices.
[0097] In some embodiments, the parts of the T-TRP 170 may be distributed. For example, some of the modules of the T-TRP 170 may be located remote from the equipment that houses the antennas 256 for the T-TRP 170, and may be coupled to the equipment that houses the antennas 256 over a communication link (not shown) sometimes known as front haul, such as common public radio interface (CPRI) . Therefore, in some embodiments, the term T-TRP 170 may also refer to modules on the network side that perform processing operations, such as determining the location of the ED 110, resource allocation (scheduling) , message generation, and encoding / decoding, and that are not necessarily part of the equipment that houses the antennas 256 of the T-TRP 170. The modules may also be coupled to other T-TRPs. In some embodiments, the T-TRP 170 may actually be a plurality of T-TRPs that are operating together to serve the ED 110, e.g. through the use of coordinated multipoint transmissions.
[0098] The T-TRP 170 includes at least one transmitter 252 and at least one receiver 254 coupled to one or more antennas 256. Only one antenna 256 is illustrated to avoid congestion in the drawing. One, some, or all of the antennas 256 may alternatively be panels. The transmitter 252 and the receiver 254 may be integrated as a transceiver. The T-TRP 170 further includes a processor 260 for performing operations including those related to: preparing a transmission for downlink transmission to the ED 110, processing an uplink transmission received from the ED 110, preparing a transmission for backhaul transmission to the NT-TRP 172, and processing a transmission received over backhaul from the NT-TRP 172. Processing operations related to preparing a transmission for downlink or backhaul transmission may include operations such as encoding, modulating, precoding (e.g. multiple input multiple output (MIMO) precoding) , transmit beamforming, and generating symbols for transmission. Processing operations related to processing received transmissions in the uplink or over backhaul may include operations such as receive beamforming, demodulating received symbols, and decoding received symbols. The processor 260 may also perform operations relating to network access (e.g. initial access) and / or downlink synchronization, such as generating the content of synchronization signal blocks (SSBs) , generating the system information, etc. In some embodiments, the processor 260 also generates an indication of beam direction, e.g. BAI, which may be scheduled for transmission by a scheduler 253. The processor 260 performs other network-side processing operations described herein, such as determining the location of the ED 110, determining where to deploy the NT-TRP 172, etc. In some embodiments, the processor 260 may generate signaling, e.g. to configure one or more parameters of the ED 110 and / or one or more parameters of the NT-TRP 172. Any signaling generated by the processor 260 is sent by the transmitter 252.
[0099] It should be noted that the term “signaling” , as used herein, may alternatively be called control signaling. Signaling may be transmitted in a physical layer control channel, e.g. a physical downlink control channel (PDCCH) , in which case the signaling may be known as dynamic signaling. Signaling transmitted in a downlink physical layer control channel may be known as downlink control information (DCI) . Signaling transmitted in an uplink physical layer control channel may be known as uplink control information (UCI) . Signaling transmitted in a sidelink physical layer control channel may be known as sidelink control information (SCI) . Signaling may be included in a higher-layer (e.g., higher than physical layer) packet transmitted in a physical layer data channel, e.g. in a physical downlink shared channel (PDSCH) , in which case the signaling may be known as higher-layer signaling, static signaling, or semi-static signaling. Higher-layer signaling may also refer to radio resource control (RRC) protocol signaling or media access control –control element (MAC-CE) signaling.
[0100] The scheduler 253 may be coupled to the processor 260. The scheduler 253 may be included within or operated separately from the T-TRP 170. The scheduler 253 may schedule uplink, downlink, sidelink, and / or backhaul transmissions, including issuing scheduling grants and / or configuring scheduling-free (e.g., “configured grant” ) resources. The T-TRP 170 further includes a memory 258 for storing information and data. The memory 258 stores instructions and data used, generated, or collected by the T-TRP 170. For example, the memory 258 could store software instructions or modules configured to implement some or all of the functionality and / or embodiments described herein and that are executed by the processor 260.
[0101] Although not illustrated, the processor 260 may form part of the transmitter 252 and / or part of the receiver 254. Also, although not illustrated, the processor 260 may implement the scheduler 253. Although not illustrated, the memory 258 may form part of the processor 260.
[0102] The processor 260, the scheduler 253, the processing components of the transmitter 252, and the processing components of the receiver 254 may each be implemented by the same or different one or more processors that are configured to execute instructions stored in a memory, e.g. in the memory 258. Alternatively, some or all of the processor 260, the scheduler 253, the processing components of the transmitter 252, and the processing components of the receiver 254 may be implemented using dedicated circuitry, such as a programmed FPGA, a hardware accelerator (e.g., a GPU or AI accelerator) , or an ASIC.
[0103] Although the NT-TRP 172 is illustrated as a drone only as an example, the NT-TRP 172 may be implemented in any suitable non-terrestrial form, such as satellites and high altitude platforms, including international mobile telecommunication base stations and unmanned aerial vehicles, for example. Also, the NT-TRP 172 may be known by other names in some implementations, such as a non-terrestrial node, a non-terrestrial network device, or a non-terrestrial base station. The NT-TRP 172 includes a transmitter 272 and a receiver 274 coupled to one or more antennas 280. Only one antenna 280 is illustrated to avoid congestion in the drawing. One, some, or all of the antennas may alternatively be panels. The transmitter 272 and the receiver 274 may be integrated as a transceiver. The NT-TRP 172 further includes a processor 276 for performing operations including those related to: preparing a transmission for downlink transmission to the ED 110, processing an uplink transmission received from the ED 110, preparing a transmission for backhaul transmission to T-TRP 170, and processing a transmission received over backhaul from the T-TRP 170. Processing operations related to preparing a transmission for downlink or backhaul transmission may include operations such as encoding, modulating, precoding (e.g. MIMO precoding) , transmit beamforming, and generating symbols for transmission. Processing operations related to processing received transmissions in the uplink or over backhaul may include operations such as receive beamforming, demodulating received symbols, and decoding received symbols. In some embodiments, the processor 276 implements the transmit beamforming and / or receive beamforming based on beam direction information (e.g. BAI) received from the T-TRP 170. In some embodiments, the processor 276 may generate signaling, e.g. to configure one or more parameters of the ED 110. In some embodiments, the NT-TRP 172 implements physical layer processing, but does not implement higher layer functions such as functions at the medium access control (MAC) or radio link control (RLC) layer. As this is only an example, more generally, the NT-TRP 172 may implement higher layer functions in addition to physical layer processing.
[0104] The NT-TRP 172 further includes a memory 278 for storing information and data. Although not illustrated, the processor 276 may form part of the transmitter 272 and / or part of the receiver 274. Although not illustrated, the memory 278 may form part of the processor 276.
[0105] The processor 276, the processing components of the transmitter 272, and the processing components of the receiver 274 may each be implemented by the same or different one or more processors that are configured to execute instructions stored in a memory, e.g. in the memory 278. Alternatively, some or all of the processor 276, the processing components of the transmitter 272, and the processing components of the receiver 274 may be implemented using dedicated circuitry, such as a programmed FPGA, a hardware accelerator (e.g., a GPU or AI accelerator) , or an ASIC. In some embodiments, the NT-TRP 172 may actually be a plurality of NT-TRPs that are operating together to serve the ED 110, e.g. through coordinated multipoint transmissions.
[0106] The T-TRP 170, the NT-TRP 172, and / or the ED 110 may include other components, but these have been omitted for the sake of clarity.
[0107] FIG. 4A illustrates an example apparatus 400A according to an implementation of the present disclosure. The apparatus 400A may be a communication device or an apparatus implemented in a communication device such as the ED 110 or the TRPs 170a, 170b, 172. For example, the apparatus 400A implemented in an ED may be an integrated circuit, which in some instances may be referred to as a chip, a modem, a modem chip, a baseband chip, or a baseband processor. In some implementations, one or more integrated circuits can be packaged into a system-on-chip, a system-in-package, or a multi-chip module. The apparatus 400A can include one or more integrated circuits and other discrete components. In some implementations, the apparatus 400A may be a module within the ED 110, or within the device 300. In some implementations, the apparatus 400A may be a module within one of the TRPs 170a, 170b, or 172.
[0108] In an example, the apparatus 400A may include one or more processors 411, and an interface circuit 412. The apparatus 400A may further include a memory 413. The one or more processors 411 are configured to process signals and execute one or more communication protocols. The memory 413 is configured to store at least a part of corresponding computer program instructions and / or data. In an example, the one or more processors 411 execute the computer program instructions stored in the memory 413 to implement related operations (for example, inputting, outputting, receiving, and transmitting) in the method embodiments disclosed herein. In some implementations, the memory 413 being configured to store the corresponding computer program instructions and / or data may mean that the memory 413 is configured to store all of the corresponding computer program instructions and / or data for execution by the one or more processors 411. In some implementations, the memory 413 being configured to store the corresponding computer program instructions and / or data may mean that the memory 413 is configured to store a part of the corresponding computer program instructions and / or data. For example, the part of the corresponding computer program instructions and / or data may include computer program instructions and / or data that need to be currently executed by the one or more processors 411. Thus, the memory 413 may store different parts of computer program instructions and / or data for a plurality times for the one or more processors 411 to perform related operations in the method embodiments disclosed herein. As a communication interface, the interface circuit 412 is configured to implement communication with another component. For example, the interface circuit 412 may communicate a signal with another apparatus or system, such as a radio frequency processing apparatus or another processor. The signal may include or carry information intended as a payload, such as user data, control information, etc. The signal may also include or carry information useful to a receiver, but not necessarily as a payload, such as a pilot signal or reference signal. Communicating the signal may include transmitting the signal to another component or device. Communicating the signal may additionally or alternatively include receiving the signal from another component or device. Transmitting the signal may include outputting the signal to a component or device that is directly or indirectly coupled to the interface circuit 412. Receiving the signal may include inputting or obtaining the signal from a component or device that is directly or indirectly coupled to the interface circuit 412. Optionally, to reduce a load of the one or more processors, a baseband signal processing circuit 414 may be also disposed to implement processing of at least a part of baseband signals, including signal demodulation, modulation, encoding, decoding, or the like.
[0109] The apparatus 400A may be the processor 210 (or 260) within the ED 110 (or the T-TRP 170) , in some scenarios, or may be included within the processor 210 (or 260) within the ED 110 (or the T-TRP 170) in some scenarios. The apparatus 400A may be a baseband chip or may include a baseband chip. In some implementations, the apparatus 400A may be independently packaged into a chip. In some implementations, the ED 110 (or the T-TRP 170) includes different types of chips. The apparatus 400A may be packaged into a processor chip (for example, an SoC chip or an SIP chip) with the different types of chips. In some implementations, the apparatus 400A may be packaged into a chip with some or all of circuits of a radio frequency processing system that may further be included in the ED 110 (or the T-TRP 170) .
[0110] Further, communication (s) between different devices / apparatuses in various embodiments of this application may refer to direct communication between different devices / apparatuses (that is, no forwarding is required by another device / apparatuses) , or may refer to communication (s) between different devices / apparatuses via another device / apparatus (that is, forwarding is required by another device / apparatus) . Alternatively, such further communication (s) may refer to that a functional unit inside the device / apparatus uses another functional unit in the device / apparatus to communicate with another device / apparatus. In other words, "sending (or transmitting) information to... (an ED or a base station) " in this application may be understood as that a destination endpoint of the information is an ED or a base station. It may include sending / transmitting information directly or indirectly to an ED or a base station. Similarly, "receiving information from... (an ED or a base station) " may be understood as that a source endpoint of the information is an ED or a base station, and may include directly or indirectly receiving information from an ED or a base station. Necessary processing such as format conversion, digital-to-analog conversion, amplification, and filtering may be performed on the information between the source endpoint that sends the information and the destination endpoint. However, the destination endpoint may understand valid information from the source endpoint. Similar descriptions in this application may be understood similarly. Details are not described herein again. In the present disclosure, the terms "send" and "transmit" may be used interchangeably in embodiments of this application.
[0111] FIG. 4B illustrates a simplified block diagram 400B of units or modules in a device that is suitable for implementing embodiments of the present disclosure. One or more steps of the embodiment methods provided herein may be performed by corresponding units or modules, according to FIG. 4B. FIG. 4B illustrates units or modules in a device, such as in the ED 110, in the T-TRP 170, or in the NT-TRP 172. For example, a signal may be transmitted or output by a transmitting unit or by a transmitting module. A signal may be received or input by a receiving unit or by a receiving module. A signal may be processed by a processing unit or a processing module. Other steps may be performed by an artificial intelligence (AI) or machine learning (ML) module. The respective units or modules may be implemented using hardware, one or more components or devices that execute software, or a combination thereof. For instance, one or more of the units or modules may be a circuit such as an integrated circuit. Examples of an integrated circuit includes a programmed FPGA, a GPU, or an ASIC. For instance, one or more of the units or modules may be logical such as a logical function performed by a circuit, by a portion of an integrated circuit, or by software instructions executed by a processor. It will be appreciated that where the modules are implemented using software for execution by a processor for example, the modules may be retrieved by a processor, in whole or part as needed, individually or together for processing, in single or multiple instances, and that the modules themselves may include instructions for further deployment and instantiation.
[0112] While not shown, the transmitting module and the receiving module may be part of, or combined into, a transceiver module. A transceiver module may also be known as an interface module, or simply an interface, for inputting and outputting operations.
[0113] Additional details regarding the EDs 110, the T-TRP 170, and the NT-TRP 172 are known to those of skill in the art. As such, these details are omitted here.
[0114] For a sensing task or application, a device (e.g., the ED 110 or the network node 170) may sense an environment, and then perform a corresponding task based on sensing results (e.g. a detected object, or a reconstructed environment, etc. ) . The sensing results may be sent to another device for further processing. Therefore, exchanged sensing information needs to be described in a certain way.
[0115] The detected object may be represented as a point position in a space, with a coordinate (x, y, z) . Although such position-based representation is simple and has low transmission overheads, it cannot well describe the detected object or the environment information. For example, contour information of the object or environment cannot be described.
[0116] The detected object or reconstructed environment may also be represented by a point cloud. FIG. 5A illustrates a diagram 500A illustrating an example point cloud representation of sensing information according to some embodiments of the present disclosure. FIG. 5A shows an example for two buildings represented by the point cloud. A point cloud is a discrete set of data points in space. Each point position has a coordinate (x, y, z) .
[0117] The detected object or reconstructed environment may also be represented by a mesh. FIG. 5B illustrates a diagram 500B illustrating an example mesh representation of sensing information according to some embodiments of the present disclosure. FIG. 5B shows an example for two buildings represented by the mesh. Mesh is a collection of vertices, edges and faces that defines the shape of an object. The faces usually comprise triangles (i.e., triangle mesh) , quadrilaterals (i.e., quads) , or other convex polygons. The mesh may also be referred to as a polygon, or a polygon mesh.
[0118] For both point cloud and mesh representations, they can provide detailed description of the sensing target (e.g., the object or environment) . However, because they both represent the sensing target based on points / vertices, the amount of bits for representation is relatively large, which brings large communication overhead in sensing fusion, sensing report, or other scenarios for sensing information exchange. For example, suppose 16bit precision for the coordinate (x, y, z) of each point / vertex, the total bits for 100 points / vertices will be 100 × 3 × 16 = 4800 bits. Mesh representation may need additional bits for edge representations, i.e. the relationship between vertices.
[0119] To describe the sensing target (e.g., the detected object or reconstructed environment) , a very fine-grained description is good, but it will cause relatively large computation overhead and large transmission overhead. Considering that for these scenarios or similar scenarios, a rough and general description can meet the requirements of most tasks, some example embodiments of the present disclosure provide a solution in which geometric shape-based representation is used to represent the sensing information. The geometric shape-based representation can describe the object and environment in a simplified and effective way. In addition, because some devices may have limited sensing distance / range, or limited computing capabilities, and / or physical conditions (e.g. with some obstacles) for processing sensing information, the obtained results / descriptions at the devices may be different (i.e. with certain deviations) from the real environment. Thus, some example embodiments of the present disclosure provide a solution of providing some calibration information (e.g., ground-truth information) to such devices, so as to improve the accuracy of sensing results / descriptions and better improve the performance of subsequent tasks. The solutions of the element-based representation and provision of calibration information will be described in detail in connection with FIG. 6 below.
[0120] FIG. 6 illustrates a signaling chart illustrating an example process 600 of communication according to some embodiments of the present disclosure. The process 600 may involve a first device 602 and a second device 604. The steps and the order of the steps in FIG. 6 are merely for illustration, not for limitation. For example, the order of the steps may be changed or reversed. Some of the steps may be omitted or any other suitable additional steps may be added.
[0121] As illustrated in FIG. 6, the first device 602 may be a terminal device (e.g., the ED 110) , and the second device 604 may be a network device (e.g., the network node 170) . In some embodiments, the first device 602 may be a network device (e.g., the network node 170) , and the second device 604 may be a terminal device (e.g., the ED 110) . In some embodiments, the first device 602 may be a terminal device (e.g., the ED 110a) , and the second device 604 may be another terminal device (e.g., the ED 110b) . In some embodiments, the first device 602 may be a network device (e.g., the network node 170a) , and the second device 604 may be another network device (e.g., the network node 170b) . In some embodiments, the network device may be a device in the RAN 120 (e.g., the network node 170) . For example, the network device may be an AP. Alternatively or additionally, the network device may be a device in the CN 130, e.g., an access management function (AMF) , session management function (SMF) , user plane function (UPF) , etc. Alternatively or additionally, the first device 602 or the second device 604 may be a chip or a module within the network device or the terminal device in the embodiments above.
[0122] As shown in FIG. 6, at 610, the first device 602 may receive, from a second device 604, a first indication for calibrating a first sensing information of a sensing target. Correspondingly, the second device 604 may transmit the first indication to the first device 602. At 620, the first device 602 may calibrate the first sensing information based on the first indication. In this way, the second device 604 could provide a first indication to the first device 602 for calibrating the first sensing information sensed at the first device 602, thereby improving an accuracy of sensing description and better improve the performance of subsequent tasks.
[0123] In some embodiments, at 630, the first device 602 may transmit, to the second device 604, the calibrated first sensing information of the sensing target. In this way, the first device 602 could feed back the calibrated sensing information to the second device 604, thereby helping the second device 604 to improve its sensing result.
[0124] In some embodiments, the first sensing information may be represented by at least one geometric representation. In this way, the sensing information could be represented in a simplified and effective manner.
[0125] FIGS 7A and 7B show two examples of sensing tasks: object detection and environment reconstruction. FIG. 7A illustrates a diagram illustrating an example element-based representation 700A for an object detection according to some embodiments of the present disclosure. FIG. 7B illustrates a diagram illustrating an example element-based representation for an environment reconstruction 700B according to some embodiments of the present disclosure. Geometric shape-based representations can be used to roughly and efficiently describe the detected object and reconstructed environment. In geometric shape-based representations, the sensing information can be represented by one or multiple simple geometric shapes that can represent information about a surface or edge, such as square, rectangle, polygon, circle, line / line segment, cube, sphere, etc.
[0126] As shown in FIG. 7A, as for a sensing object (e.g., a bus 710) , based on the geometric shape-based representation, the sensing information of the bus 710 may become simplified representations 712, 714 or 716. In some embodiments, the bus 710 may be represented by square (s) 711, in such scenario, the bus 710 will have a geometric shape-based representation 712. In some embodiments, the bus 710 may be represented by circle (s) 713, in such scenario, the bus 710 will have a geometric shape-based representation 714. In some embodiments, the bus 710 may be represented by line (s) 715, in such scenario, the bus 710 will have a geometric shape-based representation 716.
[0127] As shown in FIG. 7B, as for a sensing environment (e.g., a building 720) , based on the geometric shape-based representation, the sensing information of the building 720 becomes simplified representations 722 or 724. In some embodiments, the building 720 may be represented by cube (s) 721, in such scenario, the building 720 will have a geometric shape-based representation 722. In some embodiments, the building 720 may be represented by sphere (s) 723, in such scenario, the building 720 will have a geometric shape-based representation 724.
[0128] As can be seen from FIGS 7A and 7B, although the geometric shape-based representations are simple, we can still get the general outline of the detected target, which is sufficient for many sensing tasks or related applications.
[0129] In some embodiments, the first indication may comprise ground-truth information of the sensing target. The ground-truth information may refer to the information obtained based on direct observation rather than deduction, and is close to real information related to the sensing target. In this way, the ground-truth information could be used for calibrating the sensing result, thereby further improving the accuracy of sensing. FIG. 8 illustrates a signaling chart illustrating an example process 800 of communication according to some other embodiments of the present disclosure. The process 800 may involve device 1 and device 2. FIG. 8 may be an example of the process 600 as shown in FIG. 6. The steps and the order of the steps in FIG. 8 are merely for illustration, not for limitation. For example, the order of the steps may be changed or reversed. Some of the steps may be omitted or any other suitable additional steps may be added. Device 1 may refer to the first device 602 in FIG. 6 and device 2 may refer to the second device 604 in FIG. 6. The above contents regarding the first device 602 and the second device 604 described with reference to FIG. 6 also apply for the device 1 and the device 2 in FIG. 8.
[0130] Device 2 sends ground-truth information to device 1. Device 1 calibrates its sensing result / information based on the ground-truth information as shown by 801. Then, device 1 feeds back the calibrated sensing information (sensing feedback) 802 to device 2.
[0131] In some embodiments, the first indication (i.e., the calibration information or the ground-truth information) may indicate a rotation angle of a geometric representation of the sensing target. Alternatively or additionally, the first indication may indicate a translation vector of a geometric representation of the sensing target. Alternatively or additionally, the first indication may indicate an environment information related to the sensing target. For example, the environment information may be related to a subset of environment or a subset of environment object. The environment information may be represented by at least one geometric representation. Alternatively or additionally, the first indication may indicate a region information for selecting sensing information to be transmitted. For example, the region information may be related to a geography area, a spatial region, etc. Alternatively or additionally, the first indication may indicate another sensing information having a different modality from the first sensing information. In this way, the first indication could comprise various types of information for sensing information calibration.
[0132] In some embodiments, the ground-truth or calibration information may be obtained based on the sensing feedback information from other devices. Alternatively or additionally, the ground-truth or calibration information may also be obtained based on previous sensing information sent by device 1 to device 2.
[0133] In some embodiments, the calibrated first sensing information of the sensing target may comprise at least one element, and each of the at least one element corresponds to one geometric shape type. The term “element” may also be referred to as “base element” . That is to say, the calibrated sensing information exchanged between device 1 and device 2 can be based on the geometric shape-based representation, which can include one or multiple geometric shape types. In this way, the calibrated sensing information could be represented in a simplified and effective manner. In some embodiments, the calibrated sensing information of the sensing target can be included in a downlink / uplink / sidelink RRC signaling, a MAC-CE signaling or a physical layer (PHY) signaling.
[0134] With the geometric shape-based representation, the calibrated first sensing information could be represented by one or multiple simple geometric shapes. The calibrated first sensing information may be information about a surface or an edge in the environment, such as a square, a rectangle, a polygon, a circle, a line / line segment, a cube, a sphere, etc.
[0135] In some embodiments, the base element of geometric shape-based representation may be represented by a geometric shape S:
[0136] - In some embodiments, there is only one geometric shape type, and the representation / format of the calibrated first sensing information may be {S1, S2, …SN} , where N represents the number of geometric elements, and Sj represents a j-th geometric element, 1 ≤ j ≤ N. Referring back to FIG. 7A, based on geometric shape-based representation, the sensing information of the bus 710 may become a simplified representation 712 with three squares, i.e., N=3 and Sj represents a geometric shape square; the sensing information of the bus 710 may also become a simplified representation 714 with two circles, i.e., N=2 and Sj represents a geometric shape circle; the sensing information of the bus 710 may also become a simplified representation 716 with four lines, i.e., N=4 and Sj represents a geometric shape line. Referring back to FIG. 7B, based on geometric shape-based representation, the sensing information of the building 720 may become a simplified representation 722 with two cubes, i.e., N=2 and Sj represents a geometric shape cube; the sensing information of the bus 720 may also become a simplified representation 724 with two spheres, i.e., N=2 and Sj represents a geometric shape sphere. In this way, although the geometric shape representation is simple, we can still get the general outline of the detected target, which is sufficient for many sensing tasks or related applications.
[0137] - In some other embodiments, there are multiple geometric shape types, and the representation / format of the calibrated first sensing information may be { {S11, S12, …S1N1} , {S21, S22, …S2N2} … {SK1, SK2, …SKNK} } , or { {T1, S11, S12, …S1N1} , {T2, S21, S22, …S2N2} … {TK, SK1, SK2, …SKNK} } , where K is a number of geometric shape types, Tk is a k-th geometric shape type, Nk is a quantity of geometric elements corresponding to one shape type Tk, {Sk1, Sk2, …SkNk} are geometric elements of the shape type Tk, and Ski is an i-th geometric element of the shape type Tk, 1 ≤ k ≤ K, 1 ≤ i ≤ Nk. In some embodiments, the calibrated first sensing information of the sensing target further may comprise a second indication of at least one geometric shape type. If the shape types for each transmission are fixed or known between device 1 and device 2, e.g. pre-configured from device 2 to device 1 or previously indicated from device 1 to device 2, the shape type Tk may not need to be included in the geometric shape-based representation.
[0138] - Alternatively or additionally, the calibrated first sensing information of the sensing target may comprise a quantity of elements corresponding to each of the at least one geometric shape type. That is to say, a quantity / number of geometric elements, i.e., N or N1, N2, …Nk, …NK as above, can also be included in the geometric shape-based representation. If the number of geometric shapes is fixed or configured / indicated previously before the first indication, N or N1, N2, …Nk, …NK may not need to be transmitted together.
[0139] - In some embodiments, for ease of referencing to the geometric elements, each geometric element, Sj or Ski, may be configured with a shape index Ij or Iki respectively.
[0140] In some embodiments, the shape type Tk indicates the geometric shape type, including a square, a rectangle, a polygon, a circle, a line / line segment, a cube, a sphere, etc. Tk may be represented by an enumerate value, e.g., one of enumerate values {SQUARE, CIRCLE, RECTANGLE, POLYGON, LINE / LINE SEGMENT, CUBE, SPHERE, …} . Alternatively or additionally, Tk may be represented by an index from a predefined or an indicated table (as illustrated in Table 1 below) . For example, if Tk is represented by an enumerate value, the enumerate value SQUARE refers to a geometric shape of a square. In another example, if following table is used, an index 1 refers to a geometric shape of a square.
[0141] Table 1: Illustration for the index of shape types:
[0142] In some embodiments, there might be several kinds of representations for the above Sj and Ski depending on the geometric shape type. In some embodiments, a geometric shape of a square may be represented by one of: a center point and a side length; a center point, a side length and a normal vector; four vertices; and one vertex and two direction vectors. Alternatively or additionally, a geometric shape of a circle may be represented by one of: a center point and a radius; and a center point, a radius and a normal vector. Alternatively or additionally, a geometric shape of a rectangle may be represented by one of: four vertices; and one vertex and two direction vectors. Alternatively or additionally, a geometric shape of a polygon may be represented by a set of vertices. Alternatively or additionally, a geometric shape of a line segment may be represented by: two vertices; and one vertex and one direction vector. Alternatively or additionally, a geometric shape of a cube may be represented by eight vertices. Alternatively or additionally, a geometric shape of a sphere may be represented by a center point and a radius. In this way, the geometric representation of the calibrated sensing information could use various kinds of representations. Some examples are given but not limited to:
[0143] · If a circle: a center point v and a radius r (e.g. in a 2D plane) , e.g. {v, r} ;
[0144] · If a circle: a center point v, a radius r and a normal vector n, e.g. {v, r, n} ;
[0145] · If a square: a center point v and a side length e (e.g. in a 2D plane) , e.g. {v, e} ;
[0146] · If a square: a center point v, a side length e and a normal vector n, e.g. {v, e, n} ;
[0147] · If a square / rectangle: four points / vertices, e.g. {v1, v2, v3, v4} ;
[0148] · If a square / rectangle: one vertex v, and two direction vectors d1 and d2, e.g. {v, d1, d2} ;
[0149] · If a polygon: a set of points / vertices, e.g. {v1, v2, …vG} , where G is the number of points / vertices in this polygon. By connecting the points / vertices one by one, a polygon can be formed;
[0150] · If a line segment: two points / vertices, e.g. {v1, v2} ;
[0151] · If a line segment: one point / vertex and one direction vector, e.g. {v, p} (in this case, the other point / vertex can be obtained by v+p) ;
[0152] · If a sphere: a center point v and a radius r, e.g. {v, r} ;
[0153] · If a cube: eight points / vertices, e.g. {v1, v2, v3, v4, v5, v6, v7, v8} .
[0154] For the above points / vertices and vectors, such as v, vi, di, n and p, in some embodiments, they may be represented by 2D coordinates (x, y) or 3D coordinates (x, y, z) . In some embodiments, the above points / vertices and vectors may be global coordinates (within a geography coordinate system, or a coordinate system of a cell, etc. ) , or local coordinates (within a coordinate system of the device, a coordinate system referring to a reference point, a coordinate system defined by a plane, etc. ) .
[0155] Referring back to FIG. 8, device 2 sends a ground-truth indication to device 1, which may include ground-truth information. Based on the ground-truth indication, device 1 calibrates its sensing result as shown in 801, and then feeds back the calibrated sensing information (sensing feedback) 802 to device 2. The sensing feedback may use the geometric shape-based representation.
[0156] There may be several representations of the ground-truth indication:
[0157] · Option 1: the ground-truth indication may indicate a rotation angle information α of a geometric representation of the sensing target. Device 1 may rotate the geometric representation of the sensing target based on the rotation angle information α. α may indicate a rotation angle along the 2D axes, and can be represented by (α1, α2) , i.e., representing rotating along the 2D axes. Alternatively or additionally, α may indicate a rotation angle along the 3D axes, and can be represented by (α1, α2, α3) , i.e., representing rotating along the 3D axes. FIG. 9A illustrates a diagram 900A illustrating example rotation angles for sensing information calibration according to some embodiments of the present disclosure.
[0158] - In some embodiments, device 1 may rotate the geometric representation of the sensing target based on the rotation angle with respect to the 2D axes. Supposing the sensing information at device 1 is represented by geometric shape line (s) / line-segment (s) , device 1 may sense the environment 910 and obtain the result, e.g., as shown by the dotted line segments in 911. Based on the received ground-truth indication –rotation angle α, device 1 can calibrate / rotate its sensing result and obtain the calibrated sensing result, e.g., as shown by the solid line segments in 911.
[0159] - In some embodiments, device 1 may rotate a normal vector of the geometric representation based on the rotation angle when the geometric representation is of a 2D shape. In other words, the ground-truth indication–rotation angle α may be used to calibrate / rotate a normal vector of a surface such as square / rectangle / circle, as shown in 912.
[0160] - In some embodiments, device 1 may rotate the geometric representation of the sensing target based on the rotation angle with respect to the 3D axes. In other words, the ground-truth indication –rotation angle α may be used to calibrate / rotate a cube along the 3D axes (i.e., x, y, z directions, respectively) , as shown in 913.
[0161] · Option 2: the ground-truth indication may indicate a translation vector γ of a geometric representation of the sensing target. Device 1 may translate the geometric representation of the sensing target based on the translation vector γ. γ may be a 2D or 3D vector, and can be represented by (γ1, γ2) or (γ1, γ2, γ3) . FIG. 9B illustrates a diagram 900B illustrating example translation vectors for sensing information calibration according to some embodiments of the present disclosure. FIG. 9B shows two examples in which sensing information is represented by geometric shape line (s) / line-segment (s) as shown in 920 or square (s) as shown in 921. Based on the received ground-truth indication –translation vector γ, device 1 may calibrate / translate its sensing result, e.g., as shown by the dotted line segments / square, and obtain the calibrated sensing result, e.g., as shown by the solid line segments / square. Similarly, translation may also be applied to other geometric shapes such as a polygon, a cube, a sphere, etc.
[0162] · Option 3: the ground-truth indication may indicate an environment information related to the sensing target. The environment information may be local environment information, e.g., a subset of the environment objects related to (or close to) device 1. Device 1 may use the environment information to calibrate its sensing result. Device 1 may determine the rotation angle α of the geometric representation of the sensing target based on the environment information related to the sensing target, and then rotate the geometric representation of the sensing target based on the rotation angle α. The environment information included in the ground-truth indication may use the geometric shape-based representation / format described previously. FIG. 9C illustrates a diagram 900C illustrating an example environment information for sensing information calibration according to some embodiments of the present disclosure. FIG. 9C shows an example in which sensing information is represented by geometric shape line (s) / line-segment (s) as shown in 931. Based on the received ground-truth indication –local environment / environment subset, device 1 may calibrate its sensing result, for example by aligning directions of obtained line segments to a plane define by the ground-truth indication, and then obtaining the rotation angle α. Then device 1 may use the rotation angle α to rotate the dotted line segments and obtain the calibrated sensing result, e.g., as shown by the solid line segments. Other calibration methods may also be used, which are not limited in the present disclosure.
[0163] · Option 4: the ground-truth indication may indicate a region information for selecting sensing information to be transmitted. The region information may be e.g., a geography area, or a spatial region, etc. Device 1 may select the sensing information within a region indicated by the region information as the sensing information to be transmitted. That is to say, device 1 may only feeds back sensing information within the region indicated by the ground-truth indication. FIG. 9D illustrates a diagram 900D illustrating an example region information for sensing information calibration according to some embodiments of the present disclosure. FIG. 9D shows an example in which sensing information is represented by geometric shape line (s) / line-segment (s) as shown in 941. Device 1 may obtain four line segments, indexed from (1) to (4) as shown in 941 respectively. Based on the received ground-truth indication –the grey region, device 1 may know that only the sensing information within the grey region needs to be fed back to device 2. So after calibration, device 1 only keeps line segments (1) and (2) as the sensing feedback.
[0164] · Option 5: the ground-truth indication may indicate another sensing information having a different modality from the first sensing information. Device 1 may use the different modality information to calibrate its sensing result. For example, device 1 may sense the environment and obtain the sensing result by radio frequency (RF) signal (s) . If device 2 provides device 1 with the ground-truth indication such as an RGB image obtained by a camera, or point cloud data obtained by lidar, and so on, for the same environment, device 1 may use the information from another modality to calibrate / enhance its RF sensing results.
[0165] In some embodiments, the first indication (e.g., the ground-truth indication) may be included in a downlink / uplink / sidelink RRC signaling, a MAC CE or a PHY signaling. For example, the first indication (e.g., the ground-truth indication) may be included in synchronization signal blocks (SSBs) , in system information (SIB) , in RRC dedicated signaling, in user equipment assistance information (UAI) , in a control channel such as a physical uplink control channel (PUCCH) / physical downlink control channel (PDCCH) / downlink control information (DCI) / uplink control information (UCI) , etc.
[0166] In some embodiments, device 2 may receive sensing information from a plurality of devices, and determine the first indication based on the sensing information from the plurality of devices, which will be described with reference to FIG. 10. In this way, the first indication used for sensing information calibration could be derived based on sensing information from a plurality of devices.
[0167] FIG. 10 illustrates a signaling chart illustrating an example process 1000 for sensing information calibration according to some embodiments of the present disclosure. The process 1000 may involve device 1, device 2 and device 3. FIG. 10 may be an example of the process 600 as shown in FIG. 6 or the process 800 as shown in FIG. 8. The steps and the order of the steps in FIG. 10 are merely for illustration, not for limitation. For example, the order of the steps may be changed or reversed. Some of the steps may be omitted or any other suitable additional steps may be added. Device 1 may refer to the first device 602 in FIG. 6 or device 1 in FIG. 8, and device 2 may refer to the second device 604 in FIG. 6 and device 2 in FIG. 8. Device 2 may act as a central node which could get a refined result based on the sensing information from other devices. Device 3 may be a device similar as device 1. The above contents regarding the first device 602 and the second device 604 described with reference to FIG. 6 also apply for the device 1 and the device 2 in FIG. 10.
[0168] According to FIG. 10, the ground-truth indication sent from device 2 to device 1 may be obtained based on the sensing information (sensing feedback) of other devices (e.g., device 1 and / or device 3) through sensing fusion procedures. In sensing fusion, sensing results of a plurality of devices can be sent to a central node (or sensor, or base station) to get a refined result, so as to improve the performance of following tasks. The sensing information exchanged in sensing fusion can also be represented by geometric shape-based representation / format described previously.
[0169] FIG. 10 gives an example for illustration. In FIG. 10, device 3 may send geometric shape-based sensing information (i.e., sensing feedback) 1001 to device 2. Device 2 may determine the ground-truth indication 1002 based on the sensing information from device 3 and sensing information sensed by device 2. Device 2 may send the ground-truth indication 1002 to device 1. Device 1 may calibrate its sensing information based on the ground-truth indication as shown in 1003, and transmit the calibrated sensing information (i.e., sensing feedback) 1004 to device 2. Then, device 2 is able to obtain a fused sensing result 1005.
[0170] Suppose device 1 is a UE1, device 3 is a UE2, and device 2 is a BS. It should be noted that device 1 to device 3 may be a UE or a BS arbitrarily, not limited to the embodiments in the present disclosure.
[0171] FIG. 11 gives a detailed illustration for FIG. 10. FIG. 11 illustrates a diagram 1100 illustrating an example element-based representation for an environment reconstruction according to some other embodiments of the present disclosure.
[0172] As shown in FIG. 11, because UE1 and UE2 observe the environment from different angles, as shown in 1110, they may obtain different sensing information. UE2 may get geometric shape based representation of the environment, as shown in 1111 and 1112, and sends sensing information / sensing feedback to BS. Two examples 1111 and 1112 are given in FIG. 11 for illustrating different geometric shape-based representations. Geometric shape-based representation 1111 is based on line (s) / line segment (s) . Geometric shape-based representation 1112 is based on rectangle (s) . Based on the sensing feedback from UE2, BS can obtain an environment information (e.g., local environment information) , as shown in 1113 and 1114, using geometric shape-based representation with line (s) / line segment (s) or rectangle (s) in 1111 and 1112, respectively. Then BS uses the environment information as the ground-truth indication, i.e. option 3 described previously, and sends the ground-truth indication as shown in 1115 to UE1. Suppose UE1 uses geometric shape line (s) / line-segment (s) to represent the environment. Then, based on the ground-truth indication, UE1 can calibrate its sensing result as shown by the dotted line segments of 1116, and obtain the calibrated sensing result, e.g., as shown by solid line segments in 1117. And finally, UE1 sends the calibrated sensing information (sensing feedback) to BS, and BS can get the fused sensing results from UE1 and UE2, e.g., as shown by 1118.
[0173] In some embodiments, device 2 may receive a second sensing information of the sensing target from device 1, and determine the first indication based on the second sensing information. That is to say, the ground-truth indication sent from device 2 to device 1 can be obtained based on the previous sensing information (i.e., sensing feedback) sent by device 1, which could be described with reference to FIG. 12A. In this way, the first indication used for sensing information calibration could be derived based on a previous sensing information from the first device.
[0174] FIG. 12A illustrates a signaling chart illustrating an example process 1200A for sensing information calibration according to some other embodiments of the present disclosure. As shown in FIG. 12A, device 2 may receive a sensing feedback from device 1 at a moment t1, determine a ground-truth indication based on the sensing feedback from device 1, transmit the ground-truth indication to device 1, and receive a calibrated sensing feedback from device 1 at a moment t2. FIG. 12B illustrates a signaling chart illustrating an example process 1200B for sensing information calibration according to yet some other embodiments of the present disclosure. As shown in FIG. 12B device 1 may send a sensing information (i.e., sensing feedback) 1201 to device 2 at a moment t1, based on which device 2 obtains a ground-truth indication (e.g., a rotation angle α) in 1202 based on the sensing feedback 1201 from device 1 and sends the ground-truth indication (e.g., a rotation angle α) to device 1. With the ground-truth indication (e.g., a rotation angle α) , device 1 calibrates / adjusts its sensing result at a moment t2 as shown in 1203 and feeds back the calibrated sensing information (i.e., sensing feedback) 1204 to device 2. Afterwards, device 2 obtains a fused sensing result as shown in 1205.
[0175] Suppose device 1 is a UE and device 2 is a BS. It should be noted that device 1 and device 2 may be a UE or a BS arbitrarily, not limited to the embodiments in the present disclosure. Following FIG. 13 gives a detailed illustration for FIG. 12B. At a moment t1, UE may sense a sensing environment 1310, gets geometric shape-based representation of the environment as shown in 1311, and sends sensing information / sensing feedback to BS. Based on the sensing feedback from UE, BS can obtain the deviations of this UE’s sensing information compared to real environment (for example, based on some prior knowledge) . In this case, BS uses the rotation angle information α as the ground-truth indication, i.e., option 1 described previously, and sends the ground-truth indication α as shown in 1312 to UE. Then based on the ground-truth indication, UE can calibrate its sensing result as shown by the dotted line segments in 1313 at a moment t2, and obtain the calibrated sensing result as shown by the solid line segments in 1314. And finally, UE sends the calibrated sensing information (i.e., sensing feedback) 1314 to BS, and BS can get the fused sensing results 1315 from UE at a different moment.
[0176] The processes in FIG. 12A or FIG. 12B could be combined with the processes in FIG. 10. For example, device 2 may receive not only sensing information from device 1 but also sensing information from device 3, and determine the first indication for sensing information calibration. It should be understood that the determination of the first indication may also be based on sensing information from other devices.
[0177] So far, a solution of providing some calibration information (e.g., ground-truth information) to the first device and performing sensing information calibration based on the calibration information have been described in connection with FIGs 1 to 13. With the solution, an accuracy of sensing results / descriptions could be improved and performance of subsequent tasks could be better improved as well.
[0178] The present disclosure is described by using the interaction and processing procedures between the user equipment (UE) and the base station (BS) . The exchanged information and protocol flows can also be used between other network nodes described in FIG. 2, for example, between ED and TRP, between ED and core network, between ED and ED, between TRP and TRP.
[0179] The present disclosure can be also applied to Wi-Fi, ultra wide band (UWB) and other short range communications. Then the BS in the procedure described in the present disclosure may be replaced with APs.
[0180] Corresponding to the above process, embodiments of the present disclosure provide methods of communication implemented at a first device and at a second device. These methods will be described below with reference to FIGS 14 and 15.
[0181] FIG. 14 illustrates a flowchart of an example method 1400 for communication implemented at a first device according to some embodiments of the present disclosure. For example, the method 1400 may be performed at the ED 110 or network node 170 or a device in the core network 130 as shown in FIGs 1 to 4B. The method 1400 may include additional blocks not shown and / or may omit some blocks as shown, and the scope of the present disclosure is not limited in this regard.
[0182] As shown in FIG. 14, at block 1410, a first device may receive a first indication for calibrating a first sensing information of a sensing target. At block 1420, the first device may calibrate the first sensing information based on the first indication. In this way, the first device could receive calibration information from other device (s) and calibrate its sensing result based on the calibration information, thereby improving an accuracy of sensing description and better improve the performance of subsequent tasks.
[0183] In some embodiments, the first device may transmit the calibrated first sensing information of the sensing target. In this way, the first device could feed back the calibrated sensing information to other device (s) , thereby helping other device (s) to improve the sensing result.
[0184] In some embodiments, the first sensing information may be represented by at least one geometric representation. In this way, the sensing information could be represented in a simplified and effective manner.
[0185] In some embodiments, the first indication may comprise ground-truth information of the sensing target. In this way, the ground-truth information could be used for calibrating the sensing result, thereby further improving the accuracy of sensing.
[0186] In some embodiments, the first indication may indicate at least one of the following: a rotation angle of a geometric representation of the sensing target; a translation vector of a geometric representation of the sensing target; an environment information related to the sensing target; a region information for selecting sensing information to be transmitted; and another sensing information having a different modality from the first sensing information. In this way, the first indication could comprise various types of information for sensing information calibration.
[0187] In some embodiments, the environment information may be represented by at least one geometric representation. In this way, the first indication could be represented in a simplified and effective manner.
[0188] In some embodiments, the first device may determine the rotation angle of the geometric representation of the sensing target based on the environment information related to the sensing target. In this way, a rotation angle could be derived based on the environment information related to the sensing target, and then be used for sensing information calibration.
[0189] In some embodiments, the first device calibrating the first sensing information based on the first indication may comprise: rotating the geometric representation of the sensing target based on the rotation angle. In this way, the sensing information could be calibrated by rotating the geometric representation of the sensing target.
[0190] In some embodiments, the first device rotating the geometric representation of the sensing target based on the rotation angle may comprise: rotating a normal vector of the geometric representation based on the rotation angle when the geometric representation is of a two-dimensional (2D) shape. In this way, it provides a specific manner for rotating the geometric representation of the sensing target.
[0191] In some embodiments, calibrating the first sensing information based on the first indication comprises: translating the geometric representation of the sensing target based on the translation vector. In this way, the sensing information could be calibrated by translating the geometric representation of the sensing target.
[0192] In some embodiments, the calibrated first sensing information of the sensing target may comprise at least one element, and each of the at least one element corresponds to one geometric shape type. In this way, the calibrated sensing information could be represented in a simplified and effective manner.
[0193] In some embodiments, the calibrated first sensing information of the sensing target further may comprise at least one of the following: a second indication of at least one geometric shape type; and a quantity of elements corresponding to each of the at least one geometric shape type.
[0194] In some embodiments, a geometric shape of a square is represented by one of: a center point and a side length; a center point, a side length and a normal vector; four vertices; and one vertex and two direction vectors; a geometric shape of a circle is represented by one of: a center point and a radius; and a center point, a radius and a normal vector; a geometric shape of a rectangle is represented by one of: four vertices; and one vertex and two direction vectors; a geometric shape of a polygon is represented by a set of vertices; a geometric shape of a line segment is represented by: two vertices; and one vertex and one direction vector; a geometric shape of a cube is represented by eight vertices; and a geometric shape of a sphere is represented by a center point and a radius. In this way, the geometric representation of the calibrated sensing information could use various kinds of representations.
[0195] In some embodiments, the first device may transmit a second sensing information of the sensing target for determination of the first indication. In this way, the first indication used for sensing information calibration could be derived based on a previous sensing information from the first device.
[0196] With the method 1400, the sensing target may be described by a set of geometric shapes, and a rough and general description for sensing information may be provided. Thus, the sensing target could be described in a simplified and effective way. Further, a first indication for calibrating sensing information of a sensing target may be provided to the first device. Thus, the accuracy of sensing results / descriptions as well as the performance of subsequent tasks could be improved.
[0197] FIG. 15 illustrates a flowchart of an example method 1500 of communication implemented at a second device in accordance with some embodiments of the present disclosure. For example, the method 1500 may be performed at the ED 110 or network node 170 or a device in the core network 130 as shown in FIGs 1 to 4B. The method 1500 may include additional blocks not shown and / or may omit some blocks as shown, and the scope of the present disclosure is not limited in this regard.
[0198] As shown in FIG. 15, at block 1510, a second device may determine a first indication for calibrating a first sensing information of a sensing target. At block 1520, the second device may transmit the first indication. In this way, the second device could determine a first indication for calibrating sensing result of the first device and transmit the first indication to the first device, thereby improving an accuracy of sensing description and better improve the performance of subsequent tasks.
[0199] In some embodiments, the second device may receive a calibrated first sensing information of the sensing target. In this way, the second device could receive the calibrated sensing information, thereby improving the sensing result.
[0200] In some embodiments, the first sensing information may be represented by at least one geometric representation. In this way, the sensing information could be represented in a simplified and effective manner.
[0201] In some embodiments, the first indication may comprise ground-truth information of the sensing target. In this way, the ground-truth information could be used for calibrating the sensing result, thereby further improving the accuracy of sensing.
[0202] In some embodiments, the first indication may indicate at least one of the following: a rotation angle of a geometric representation of the sensing target; a translation vector of a geometric representation of the sensing target; an environment information related to the sensing target; a region information for selecting sensing information to be transmitted; and another sensing information having a different modality from the first sensing information. In this way, the first indication could comprise various types of information for sensing information calibration.
[0203] In some embodiments, the environment information may be represented by at least one geometric representation. In this way, the first indication could be represented in a simplified and effective manner.
[0204] In some embodiments, the calibrated first sensing information of the sensing target may comprise at least one element, and each of the at least one element corresponds to one geometric shape type. In this way, the calibrated sensing information could be represented in a simplified and effective manner.
[0205] In some embodiments, the calibrated first sensing information of the sensing target further may comprise at least one of the following: a second indication of at least one geometric shape type; and a quantity of elements corresponding to each of the at least one geometric shape type.
[0206] In some embodiments, a geometric shape of a square may be represented by one of: a center point and a side length; a center point, a side length and a normal vector; four vertices; and one vertex and two direction vectors; a geometric shape of a circle may be represented by one of: a center point and a radius; and a center point, a radius and a normal vector; a geometric shape of a rectangle may be represented by one of: four vertices; and one vertex and two direction vectors; a geometric shape of a polygon may be represented by a set of vertices; a geometric shape of a line segment may be represented by: two vertices; and one vertex and one direction vector; a geometric shape of a cube may be represented by eight vertices; and a geometric shape of a sphere may be represented by a center point and a radius. In this way, the geometric representation of the calibrated sensing information could use various kinds of representations.
[0207] In some embodiments, the second device may receive sensing information from a plurality of devices, wherein determining the first indication for calibrating the first sensing information of the sensing target comprises: determining the first indication based on the sensing information from the plurality of devices. In this way, the first indication used for sensing information calibration could be derived based on sensing information from a plurality of devices.
[0208] In some embodiments, the second device may receive a second sensing information of the sensing target from a device which is to receive the first indication (e.g., the first device) , and wherein determining the first indication for calibrating the first sensing information of the sensing target may comprise: determining the first indication based on the second sensing information. In this way, the first indication used for sensing information calibration could be derived based on a previous sensing information from the first device.
[0209] With the method 1500, the sensing target may be described by a set of geometric shapes, and a rough and general description for sensing information may be provided. Thus, the sensing target could be described in a simplified and effective way. Further, the second device may determine and transmit a first indication for calibrating sensing information of a sensing target. Thus, the accuracy of sensing results / descriptions as well as the performance of subsequent tasks could be improved.
[0210] Operations of the methods 1400 and 1500 correspond to the processes described in connection with FIGS 6, 8, 10 and 12, and thus other details are not repeated here for conciseness.
[0211] Corresponding to the above methods of communication, embodiments of the present disclosure provide apparatuses of communication implemented at a first device and at a second device. These apparatuses will be described below with reference to FIGS 16 and 17.
[0212] FIG. 16 illustrates a simplified block diagram of an example apparatus 1600 of communication implemented at a first device in accordance with some embodiments of the present disclosure. For example, the apparatus 1600 may be implemented as the ED 110 or network node 170 or a device in the core network 130 as shown in FIGS 1 to 4B, or as a part of the ED 110 or network node 170 or the device in the core network 130. The apparatus 1600 may include additional blocks not shown and / or may omit some blocks as shown, and the scope of the present disclosure is not limited in this regard.
[0213] As shown in FIG. 16, the apparatus 1600 may comprise a first receiving module 1610 and a first processing module 1620. The first receiving module 1610 may be configured to receive a first indication for calibrating a first sensing information of a sensing target. The first processing module 1620 may be configured to calibrate the first sensing information based on the first indication.
[0214] In some embodiments, the apparatus 1600 is capable of performing the method 1400, and may comprise means for performing the respective steps of the method 1600. The means may be implemented in any suitable form. For example, the means may be implemented in a circuitry or software module. In some embodiments, the apparatus may comprise means for performing other embodiments described with reference to FIG. 14.
[0215] FIG. 17 illustrates a simplified block diagram of an example apparatus 1700 of communication implemented at a second device in accordance with some embodiments of the present disclosure. For example, the apparatus 1700 may be implemented as the ED 110 or network node 170 or a device in the core network 130 as shown in FIGS 1 to 4B, or as a part of the ED 110 or network node 170 or the device in the core network 130. The apparatus 1700 may include additional blocks not shown and / or may omit some blocks as shown, and the scope of the present disclosure is not limited in this regard.
[0216] As shown in FIG. 17, the apparatus 1700 may comprise a second processing module 1710 and a first transmitting module 1720. The second processing module 1710 may be configured to determine a first indication for calibrating a first sensing information of a sensing target. The first transmitting module 1720 may be configured to transmit the first indication.
[0217] In some embodiments, the apparatus 1700 is capable of performing the method 1500, and may comprise means for performing the respective steps of the method 1500. The means may be implemented in any suitable form. For example, the means may be implemented in a circuitry or software module. In some embodiments, the apparatus may comprise means for performing other embodiments described with reference to FIG. 15. The present disclosure encompasses various embodiments, including not only method embodiments, but also other embodiments such as apparatus embodiments and embodiments related to non-transitory computer readable storage media. Embodiments may incorporate, individually or in combinations, the features disclosed herein.
[0218] Although this disclosure refers to illustrative embodiments, this is not intended to be construed in a limiting sense. Various modifications and combinations of the illustrative embodiments, as well as other embodiments of the disclosure, will be apparent to persons skilled in the art upon reference to the description.
[0219] Features disclosed herein in the context of any particular embodiments may also or instead be implemented in other embodiments. Method embodiments, for example, may also or instead be implemented in apparatus, system, and / or computer program product embodiments. In addition, although embodiments are described primarily in the context of methods and apparatus, other implementations are also contemplated, as instructions stored on one or more non-transitory computer-readable media, for example. Such media could store programming or instructions to perform any of various methods consistent with the present disclosure.
[0220] When the functions are implemented in the form of a software functional unit and sold or used as an independent product, the functions may be stored in a computer-readable storage medium. Based on such an understanding, the technical solutions of this application essentially, or the part contributing to the prior art, or some of the technical solutions may be implemented in a form of a software product. The software product is stored in a storage medium, and includes several instructions for instructing a computer device (which may be a personal computer, a server, or a network device) to perform all or some of the steps of the methods described in the embodiments of this application. The foregoing storage medium may include: any medium that can store program code, such as a universal serial bus (USB) flash drive, a removable hard disk, a read-only memory (ROM) , a random access memory (RAM) , a magnetic disk, or an optical disc.
[0221] The foregoing descriptions are merely specific implementations of this application, but are not intended to limit the protection scope of this application. Any variation or replacement readily figured out by a person skilled in the art within the technical scope disclosed in this application shall fall within the protection scope of this application. Therefore, the protection scope of this application shall be subject to the protection scope of the claims.
Claims
1.A method for communication, comprising:receiving a first indication for calibrating a first sensing information of a sensing target; andcalibrating the first sensing information based on the first indication.2.The method of claim 1, further comprising:transmitting the calibrated first sensing information of the sensing target.3.The method of claim 1 or 2, wherein the first sensing information is represented by at least one geometric representation.4.The method of any of claims 1 to 3, wherein the first indication comprises ground-truth information of the sensing target.5.The method of any of claims 1 to 4, wherein the first indication indicates at least one of the following:a rotation angle of a geometric representation of the sensing target;a translation vector of a geometric representation of the sensing target;an environment information related to the sensing target;a region information for selecting sensing information to be transmitted; andanother sensing information having a different modality from the first sensing information.6.The method of claim 5, wherein the environment information is represented by at least one geometric representation.7.The method of claim 5 or 6, further comprising:determining the rotation angle of the geometric representation of the sensing target based on the environment information related to the sensing target.8.The method of any of claims 5 to 7, wherein calibrating the first sensing information based on the first indication comprises:rotating the geometric representation of the sensing target based on the rotation angle.9.The method of claim 8, wherein rotating the geometric representation of the sensing target based on the rotation angle comprises:rotating a normal vector of the geometric representation based on the rotation angle when the geometric representation is of a two-dimensional (2D) shape.10.The method of claim 5, wherein calibrating the first sensing information based on the first indication comprises:translating the geometric representation of the sensing target based on the translation vector.11.The method of any of claims 1 to 10, wherein the calibrated first sensing information of the sensing target comprises at least one element, and each of the at least one element corresponds to one geometric shape type.12.The method of claim 11, wherein the calibrated first sensing information of the sensing target further comprises at least one of the following:a second indication of at least one geometric shape type; anda quantity of elements corresponding to each of the at least one geometric shape type.13.The method of claim 11 or 12, whereina geometric shape of a square is represented by one of: a center point and a side length; a center point, a side length and a normal vector; four vertices; and one vertex and two direction vectors;a geometric shape of a circle is represented by one of: a center point and a radius; and a center point, a radius and a normal vector;a geometric shape of a rectangle is represented by one of: four vertices; and one vertex and two direction vectors;a geometric shape of a polygon is represented by a set of vertices;a geometric shape of a line segment is represented by: two vertices; and one vertex and one direction vector;a geometric shape of a cube is represented by eight vertices; anda geometric shape of a sphere is represented by a center point and a radius.14.The method of any of claims 1 to 13, further comprising:transmitting a second sensing information of the sensing target for determination of the first indication.15.A method for communication, comprising:determining a first indication for calibrating a first sensing information of a sensing target; andtransmitting the first indication.16.The method of claim 15, further comprising:receiving a calibrated first sensing information of the sensing target.17.The method of claim 15 or 16, wherein the first sensing information is represented by at least one geometric representation.18.The method of any of claims 15 to 17, wherein the first indication comprises ground-truth information of the sensing target.19.The method of any of claims 15 or 18, wherein the first indication indicates at least one of the following:a rotation angle of a geometric representation of the sensing target;a translation vector of a geometric representation of the sensing target;an environment information related to the sensing target;a region information for selecting sensing information to be transmitted; andanother sensing information having a different modality from the first sensing information.20.The method of claim 19, wherein the environment information is represented by at least one geometric representation.21.The method of any of claims 15 to 20, wherein the calibrated first sensing information of the sensing target comprises at least one element, and each of the at least one element corresponds to one geometric shape type.22.The method of claim 21, wherein the calibrated first sensing information of the sensing target further comprises at least one of the following:a second indication of at least one geometric shape type; anda quantity of elements corresponding to each of the at least one geometric shape type.23.The method of claim 21 or 22, whereina geometric shape of a square is represented by one of: a center point and a side length; a center point, a side length and a normal vector; four vertices; and one vertex and two direction vectors;a geometric shape of a circle is represented by one of: a center point and a radius; and a center point, a radius and a normal vector;a geometric shape of a rectangle is represented by one of: four vertices; and one vertex and two direction vectors;a geometric shape of a polygon is represented by a set of vertices;a geometric shape of a line segment is represented by: two vertices; and one vertex and one direction vector;a geometric shape of a cube is represented by eight vertices; anda geometric shape of a sphere is represented by a center point and a radius.24.The method of any of claims 15 to 23, further comprising:receiving sensing information from a plurality of devices,wherein determining the first indication for calibrating the first sensing information of the sensing target comprises:determining the first indication based on the sensing information from the plurality of devices.25.The method of any of claims 15 to 23, further comprising:receiving a second sensing information of the sensing target from a device which is to receive the first indication, andwherein determining the first indication for calibrating the first sensing information of the sensing target comprises:determining the first indication based on the second sensing information.26.An apparatus for communication, configured to perform the method according to any one of claims 1 to 14 or claims 15 to 25.27.The apparatus of claim 26, comprising:a first receiving unit configured to receive a first indication for calibrating a first sensing information of a sensing target; anda first processing unit configured to calibrate the first sensing information based on the first indication.28.The apparatus of claim 26, comprising:a second processing unit configured to determine a first indication for calibrating a first sensing information of a sensing target; anda first transmitting unit configured to transmit the first indication.29.The apparatus of claim 26, comprising:one or more processors configured to perform the method according to any one of claims 1 to 14 or claims 15 to 25; andan interface circuit configured to cause the one or more processors to perform the method.30.The apparatus of claim 29, wherein the interface circuit comprises one or more transceivers.31.An apparatus for communication comprising:one or more processors; anda memory storing instructions which, when executed by the one or more processors, cause the apparatus to perform the method according to any one of claims 1 to 14 or claims 15 to 25.32.A system for communication, wherein the system comprises a first communication apparatus configured to perform the method of any one of claims 1 to 14 and a second communication apparatus configured to perform the method of any one of claims 15 to 25.33.A computer-readable storage medium having instructions stored thereon which, when executed by an apparatus, cause the apparatus to perform the method according to any one of claims 1 to 14 or claims 15 to 25.34.A computer program product storing instructions which, when executed, cause an apparatus to perform the method according to any one of claims 1 to 14 or claims 15 to 25.
Citation Information
Patent Citations
Integrated sensing and communication network
CN116548002A
Sensing method and apparatus, terminal, and network device
WO2023001243A1
Sensing method and apparatus, and communication device
WO2023109755A1
On-demand sensing of dynamic sensing area
WO2023236024A1