Communication methods and communication devices
Patent Information
- Application Number
- CN202480090389.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2024-04-08
- Filing Date
- 2024-06-19
- Publication Date
- 2026-11-10
AI Technical Summary
In cellular communication networks, existing technologies struggle to efficiently collect user equipment (UE) location information, resulting in high hardware costs, wasted time and frequency resources, and significant computational complexity and transmission overhead when the sensing system is separated from the communication system.
By using an element-based representation method, the sensing target is described using a set of geometric shapes. Sensing information, including the position, orientation, and size of elements, is sent and received. A simplified format and parameter exchange are used to reduce computational complexity and transmission overhead.
It enables efficient collection of UE location information in cellular communication networks, reduces hardware costs and resource consumption, and simplifies the process of exchanging sensing information.
Smart Images

Figure CN123077129A_ABST
Abstract
Description
Cross-referencing related applications
[0001] This application claims priority to U.S. Provisional Application No. 63 / 575,993, filed April 8, 2024. The entire disclosure of the above-cited provisional application is incorporated herein by reference. Technical Field
[0002] Exemplary embodiments of the present invention generally relate to the field of telecommunications, and more particularly to methods, apparatus, and computer storage media for communication based on sensing technologies. Background Technology
[0003] In cellular communication networks, user equipment (UE) location information is commonly used to improve various network (NW) performance metrics. Sensing systems can be used to help collect UE location information, including the UE's position in a global coordinate system, the UE's speed and direction of movement in that global coordinate system, orientation information, and information about the wireless environment. While the sensing system can be decoupled from the communication system, it can be advantageous to collect UE location information using an integrated communication-sensing system. This reduces the hardware and cost within the integrated system and the time, frequency, or spatial resources required to implement both functions. Therefore, such an integrated system is an ideal feature in both existing and future communication systems. Summary of the Invention
[0004] Typically, exemplary embodiments of the present invention provide methods, apparatus, non-transitory computer-readable media, and computer program products for communication based on sensing technologies.
[0005] In a first aspect, a communication method is provided. The method is implemented on a first device. The method includes: determining a set of elements representing a sensing target, each element in the set having a geometric shape; and transmitting sensing information of the sensing target, wherein the sensing information includes location information of the set of elements. Thus, the sensing target can be described by a set of geometric shapes, and a coarse and generalized description of the sensing information can be provided. Therefore, the computational complexity and power consumption on the device can be reduced, and the transmission overhead for exchanging sensing information can be significantly reduced.
[0006] In some embodiments, the location information includes first location information of elements in the element set, and the first location information includes two-dimensional (2D) coordinates or three-dimensional (3D) coordinates of a point associated with the element. Thus, the location information of the element can be represented.
[0007] In some embodiments, the point associated with the element includes the geometric center of the element. This allows for optimization of the representation of the element's positional information.
[0008] In some embodiments, the geometry is a 2D shape. In some embodiments, the 2D shape may include a square, a circle, or a rectangle. Thus, the sensing target can be described using a simple 2D shape.
[0009] In some embodiments, the geometry is a 3D shape. In some embodiments, the 3D shape may include a cube or a sphere. Thus, the perceptual target can be described using a simple 3D shape.
[0010] In some embodiments, the perceived information comprises a set of values organized according to their attributes. Thus, a format representing the perceived information can be specified.
[0011] In some embodiments, the element set comprises two or more elements, and the two or more elements have the same shape. Thus, an element-based representation of a perceived target can be provided in a simplified and efficient manner.
[0012] In some embodiments, the two or more elements are arranged at the same spacing in one direction, and the position information of the element set includes the position information of one of the two or more elements and the number of the two or more elements. This further reduces the transmission overhead of sensing information.
[0013] In some embodiments, the sensing information further includes at least one of the following: the orientation information of the element set; and the size information of the element set. This allows for a more accurate representation of the sensing information of the target.
[0014] In some embodiments, the element set includes two or more elements, and the two or more elements have the same orientation. The orientation information of the element set includes the orientation information of one of the two or more elements. This saves on the transmission overhead of the orientation information of the element set.
[0015] In some embodiments, the element set comprises two or more elements. The orientation information of the element set includes the orientation information of each of the two or more elements. Thus, the orientation information of the element set can be displayed.
[0016] In some embodiments, the orientation information of the elements in the element set includes: the 2D normal vector or rotation angle of the element relative to the axis of the 2D coordinate system; or the 3D normal vector or rotation angle of the element relative to the axis of the 3D coordinate system. Thus, the orientation information of the element set can be represented.
[0017] In some embodiments, the element set includes two or more elements, and the two or more elements have the same size. The size information of the element set includes the size information of one of the two or more elements. This saves on the transmission overhead of the element set size information.
[0018] In some embodiments, the element set comprises two or more elements. The size information of the element set includes the size information of each of the two or more elements. Thus, the size information of the element set can be displayed.
[0019] In some embodiments, the size information of the elements in the element set includes the scaling factor of the elements. Thus, the scaling factors of different base elements can be the same or different.
[0020] In some embodiments, the method further includes: sending information supporting the representation of the sensing target by the element set; and receiving an indication of the representation of the sensing target by the element set. Thus, it is possible to exchange information about the capability of element-based representation and the indication of element-based representation.
[0021] In some embodiments, the method further includes receiving information that enables or disables the representation of the perceived target by the element set. Thus, element-based representation can be enabled or disabled in real time.
[0022] In some embodiments, the method further includes: receiving a first set of parameters associated with the representation of the sensing target by the set of elements. This allows the device to configure relevant parameters for the element-based representation. In some embodiments, the method further includes: sending a second set of parameters associated with the representation of the sensing target by the set of elements. This allows the device to determine and indicate relevant parameters for the element-based representation.
[0023] In some embodiments, the first parameter set or the second parameter set indicates at least one of the following: the shape of the elements in the element set; the size of the elements; the coordinate system used for the position information; the number or maximum number of elements in a single transmission; the precision of the position information; the format representing the position information; whether rotation is applied to the elements; the precision of the orientation information of the elements; the format representing the orientation information; the value range of the orientation information; whether a scaling factor is applied to the elements; the value range of the scaling factor; the precision of the scaling factor; the format representing the scaling factor; whether compression is applied to the perceived information; the compression method of the compression; and one or more compression parameters of the compression. Thus, relevant parameters for the element-based representation can be specified.
[0024] In a second aspect, a communication method is provided. The method is implemented on a second device. The method includes: receiving sensing information of a sensing target, wherein the sensing information includes positional information of a set of elements, the set of elements representing the sensing target, and each element in the set of elements having a geometric shape; and determining the sensing target based on the sensing information. Thus, the sensing target can be described by a set of geometric shapes, and a coarse and generalized description of the sensing information can be received. Therefore, the computational complexity and power consumption on the device can be reduced, and the transmission overhead of sensing information exchange can be significantly reduced.
[0025] In some embodiments, the location information includes first location information of elements in the element set, and the first location information includes 2D or 3D coordinates of a point associated with the element. Thus, the location information of the element can be received.
[0026] In some embodiments, the point associated with the element includes the geometric center of the element. This allows for optimization of the representation of the element's positional information.
[0027] In some embodiments, the geometry is a 2D shape. In some embodiments, the 2D shape may include a square, a circle, or a rectangle. Thus, the sensing target can be described using a simple 2D shape.
[0028] In some embodiments, the geometry is a 3D shape. In some embodiments, the 3D shape may include a cube or a sphere. Thus, the perceptual target can be described using a simple 3D shape.
[0029] In some embodiments, the perceived information comprises a set of values organized according to their attributes. Thus, a format representing the perceived information can be specified.
[0030] In some embodiments, the element set comprises two or more elements, and the two or more elements have the same shape. Thus, an element-based representation of a perceived target can be received in a simplified and efficient manner.
[0031] In some embodiments, the two or more elements are arranged at the same spacing in one direction, and the position information of the element set includes the position information of one of the two or more elements and the number of the two or more elements. This further reduces the transmission overhead of sensing information.
[0032] In some embodiments, the sensing information further includes at least one of the following: the orientation information of the element set; and the size information of the element set. This allows for a more accurate representation of the sensing information of the target.
[0033] In some embodiments, the element set includes two or more elements, and the two or more elements have the same orientation. The orientation information of the element set includes the orientation information of one of the two or more elements. This saves on the transmission overhead of the orientation information of the element set.
[0034] In some embodiments, the element set includes two or more elements. The orientation information of the element set includes the orientation information of each of the two or more elements. Thus, the orientation information of the element set can be displayed.
[0035] In some embodiments, the orientation information of the elements in the element set includes: the 2D normal vector or rotation angle of the element relative to the axis of the 2D coordinate system; or the 3D normal vector or rotation angle of the element relative to the axis of the 3D coordinate system. Thus, the orientation information of the element set can be received.
[0036] In some embodiments, the element set includes two or more elements, and the two or more elements have the same size. The size information of the element set includes the size information of one of the two or more elements. This saves on the transmission overhead of the element set size information.
[0037] In some embodiments, the element set comprises two or more elements. The size information of the element set includes the size information of each of the two or more elements. Thus, the size information of the element set can be displayed and received.
[0038] In some embodiments, the size information of the elements in the element set includes the scaling factor of the elements. Thus, the scaling factors of different base elements can be the same or different.
[0039] In some embodiments, the method further includes: receiving information supporting the representation of the sensing target by the element set; and sending an indication indicating the representation of the sensing target by the element set. Thus, it is possible to receive information about the capability of element-based representations and to send an indication of element-based representations.
[0040] In some embodiments, the method further includes sending information to enable or disable the representation of the perceived target by the element set. This facilitates enabling or disabling element-based representations in real time.
[0041] In some embodiments, the method further includes: sending a first set of parameters associated with the representation of the sensing target by the set of elements. This allows the device to configure relevant parameters based on the element-based representation. In some embodiments, the method further includes: receiving a second set of parameters associated with the representation of the sensing target by the set of elements. This allows the device to receive relevant parameters based on the element-based representation.
[0042] In some embodiments, the first parameter set or the second parameter set indicates at least one of the following: the shape of the elements in the element set; the size of the elements; the coordinate system used for the position information; the number or maximum number of elements in a single transmission; the precision of the position information; the format representing the position information; whether rotation is applied to the elements; the precision of the orientation information of the elements; the format representing the orientation information; the value range of the orientation information; whether a scaling factor is applied to the elements; the value range of the scaling factor; the precision of the scaling factor; the format representing the scaling factor; whether compression is applied to the perceived information; the compression method of the compression; and one or more compression parameters of the compression. Thus, relevant parameters for the element-based representation can be specified.
[0043] In a third aspect, a communication device (e.g., the first device) is provided. The device includes: a first processing module for determining a set of elements representing a sensing target, each element in the set having a geometric shape; and a first transmitting module for transmitting sensing information of the sensing target, wherein the sensing information includes location information of the set of elements.
[0044] In some embodiments, the location information includes first location information of elements in the element set, and the first location information includes 2D or 3D coordinates of a point associated with the element. In some embodiments, the point associated with the element includes the geometric center of the element.
[0045] In some embodiments, the geometry is a 2D shape. In some embodiments, the 2D shape may include a square, a circle, or a rectangle. In some embodiments, the geometry is a 3D shape. In some embodiments, the 3D shape may include a cube or a sphere. Thus, the perceived target can be described using a simple 3D shape.
[0046] In some embodiments, the perceived information includes a set of values organized according to their attributes.
[0047] In some embodiments, the element set includes two or more elements, and the two or more elements have the same shape.
[0048] In some embodiments, the two or more elements are arranged at the same spacing in one direction, and the position information of the element set includes the position information of one of the two or more elements and the number of the two or more elements.
[0049] In some embodiments, the sensing information further includes at least one of the following: the orientation information of the element set; the size information of the element set.
[0050] In some embodiments, the element set includes two or more elements, and the two or more elements have the same orientation. The orientation information of the element set includes the orientation information of one of the two or more elements.
[0051] In some embodiments, the element set includes two or more elements. The orientation information of the element set includes the orientation information of each of the two or more elements.
[0052] In some embodiments, the orientation information of the elements in the element set includes: the 2D normal vector or rotation angle of the element relative to the axis of the 2D coordinate system; or the 3D normal vector or rotation angle of the element relative to the axis of the 3D coordinate system.
[0053] In some embodiments, the element set includes two or more elements, and the two or more elements have the same size. The size information of the element set includes the size information of one of the two or more elements.
[0054] In some embodiments, the element set includes two or more elements. The size information of the element set includes the size information of each of the two or more elements.
[0055] In some embodiments, the size information of the elements in the element set includes the scaling factor of the elements.
[0056] In some embodiments, the apparatus further includes: a second transmitting module for transmitting information supporting the representation of the sensing target by the element set; and a first receiving module for receiving an instruction indicating the representation of the sensing target by the element set.
[0057] In some embodiments, the apparatus further includes a second receiving module for receiving information that enables or disables the representation of the sensing target by the element set.
[0058] In some embodiments, the apparatus further includes: a third receiving module for receiving a first set of parameters associated with the representation of the sensing target by the set of elements; or a third sending module for sending a second set of parameters associated with the representation of the sensing target by the set of elements.
[0059] In some embodiments, the first parameter set or the second parameter set indicates at least one of the following: the shape of the elements in the element set; the size of the elements; the coordinate system used for the location information; the number or maximum number of elements in a single transmission; the precision of the location information; the format representing the location information; whether rotation is applied to the elements; the precision of the orientation information of the elements; the format representing the orientation information; the value range of the orientation information; whether a scaling factor is applied to the elements; the value range of the scaling factor; the precision of the scaling factor; the format representing the scaling factor; whether compression is applied to the perceived information; the compression method of the compression; and one or more compression parameters of the compression.
[0060] In a fourth aspect, a communication device (e.g., the second device) is provided. The device includes: a fourth receiving module for receiving sensing information of a sensing target, wherein the sensing information includes position information of a set of elements, the set of elements representing the sensing target, and each element in the set of elements having a geometric shape; and a second processing module for determining the sensing target based on the sensing information.
[0061] In some embodiments, the location information includes first location information of elements in the element set, and the first location information includes 2D or 3D coordinates of a point associated with the element. In some embodiments, the point associated with the element includes the geometric center of the element.
[0062] In some embodiments, the geometry is a 2D shape. In some embodiments, the 2D shape may include a square, a circle, or a rectangle. In some embodiments, the geometry is a 3D shape. In some embodiments, the 3D shape may include a cube or a sphere.
[0063] In some embodiments, the perceived information includes a set of values organized according to their attributes.
[0064] In some embodiments, the element set includes two or more elements, and the two or more elements have the same shape.
[0065] In some embodiments, the two or more elements are arranged at the same spacing in one direction, and the position information of the element set includes the position information of one of the two or more elements and the number of the two or more elements.
[0066] In some embodiments, the sensing information further includes at least one of the following: the orientation information of the element set; the size information of the element set.
[0067] In some embodiments, the element set includes two or more elements, and the two or more elements have the same orientation. The orientation information of the element set includes the orientation information of one of the two or more elements.
[0068] In some embodiments, the element set includes two or more elements. The orientation information of the element set includes the orientation information of each of the two or more elements.
[0069] In some embodiments, the orientation information of the elements in the element set includes: the 2D normal vector or rotation angle of the element relative to the axis of the 2D coordinate system; or the 3D normal vector or rotation angle of the element relative to the axis of the 3D coordinate system.
[0070] In some embodiments, the element set includes two or more elements, and the two or more elements have the same size. The size information of the element set includes the size information of one of the two or more elements.
[0071] In some embodiments, the element set includes two or more elements. The size information of the element set includes the size information of each of the two or more elements.
[0072] In some embodiments, the size information of the elements in the element set includes the scaling factor of the elements.
[0073] In some embodiments, the apparatus further includes: a fifth receiving module for receiving information supporting the representation of the sensing target by the element set; and a fourth sending module for sending an indication of the representation of the sensing target by the element set.
[0074] In some embodiments, the apparatus further includes a fifth transmitting module for transmitting information that enables or disables the representation of the sensing target by the element set.
[0075] In some embodiments, the apparatus further includes: a sixth transmitting module for transmitting a first set of parameters associated with the representation of the sensing target by the set of elements. In some embodiments, the apparatus further includes: a sixth receiving module for receiving a second set of parameters associated with the representation of the sensing target by the set of elements.
[0076] In some embodiments, the first parameter set or the second parameter set indicates at least one of the following: the shape of the elements in the element set; the size of the elements; the coordinate system used for the location information; the number or maximum number of elements in a single transmission; the precision of the location information; the format representing the location information; whether rotation is applied to the elements; the precision of the orientation information of the elements; the format representing the orientation information; the value range of the orientation information; whether a scaling factor is applied to the elements; the value range of the scaling factor; the precision of the scaling factor; the format representing the scaling factor; whether compression is applied to the perceived information; the compression method of the compression; and one or more compression parameters of the compression.
[0077] In a fifth aspect, a communication device is provided. The communication device includes: one or more processors; and interface circuitry. The one or more processors and the interface circuitry are configured to perform the method according to the first or second aspect.
[0078] In a sixth aspect, an apparatus is provided. The apparatus includes: one or more processors; and a memory storing instructions that, when executed by the one or more processors, cause the apparatus to perform the method according to the first aspect or the second aspect.
[0079] In a seventh aspect, a communication system is provided. The communication system includes: a first communication device for performing the method according to the third aspect; and a second communication device for performing the method according to the fourth aspect.
[0080] In an eighth aspect, a computer-readable storage medium is provided having instructions stored thereon that, when executed by a device, cause the device to perform the method according to the first aspect or the second aspect.
[0081] In a ninth aspect, a computer program product storing instructions, which, when executed, cause the apparatus to perform the method according to the first aspect or the second aspect.
[0082] The summary section is neither intended to identify key or essential features of embodiments of the invention, nor is it intended to limit the scope of the invention. Other features of the invention will become readily apparent from the following description. Attached Figure Description
[0083] Some exemplary embodiments will now be described in conjunction with the accompanying drawings, in which: Figure 1 A simplified schematic diagram of a communication system in which embodiments of the present invention can be implemented is shown; Figure 2 A schematic diagram of an exemplary communication system in which embodiments of the present invention can be implemented is shown; Figure 3 A diagram showing an example of a device that can perform wireless communication with a device in a communication system, thereby implementing an embodiment of the present invention; Figure 4A A diagram illustrating an example of an apparatus suitable for implementing embodiments of the present invention is shown; Figure 4B A diagram showing another example of an apparatus suitable for implementing embodiments of the present invention is illustrated; Figure 5A An illustration of an exemplary point cloud representation of perceived information is shown; Figure 5B A diagram illustrating an exemplary grid representation of perceived information is shown; Figure 6 A signaling diagram illustrating an exemplary communication process according to some embodiments of the present invention is shown; Figure 7A A diagram illustrating an exemplary element-based representation for object detection according to some embodiments of the present invention is shown; Figure 7B A diagram illustrating an exemplary element-based representation for environmental reconstruction according to some embodiments of the present invention is shown; Figure 8A A diagram illustrating another exemplary element-based representation for object detection according to some embodiments of the present invention is shown; Figure 8B A diagram illustrating another exemplary element-based representation for environmental reconstruction according to some embodiments of the present invention is shown; Figure 9A A diagram illustrating exemplary orientation information in an element-based representation according to some embodiments of the present invention is shown; Figure 9B A diagram illustrating another exemplary orientation information in an element-based representation according to some embodiments of the present invention is shown; Figure 10 An illustration of exemplary scaling in an element-based representation according to some embodiments of the present invention is shown; Figure 11 A flowchart illustrating an exemplary communication method implemented on a first device according to some embodiments of the present invention is shown; Figure 12 A flowchart illustrating an exemplary communication method implemented on a second device according to some embodiments of the present invention is shown; Figure 13 A simplified block diagram of an exemplary communication device implemented on a first device according to some embodiments of the present invention is shown; Figure 14 A simplified block diagram of an exemplary communication device implemented on a second device according to some embodiments of the present invention is shown.
[0084] In all the accompanying drawings, the same or similar reference numerals denote the same or similar elements. Detailed Implementation
[0085] The principles of the present invention will now be described in conjunction with some exemplary embodiments. These embodiments are described for illustrative purposes only and to assist those skilled in the art in understanding and implementing the invention, and do not constitute any limitation on the scope of the invention. The disclosure described herein can be implemented in various ways other than those described below.
[0086] In the following description and claims, unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention pertains.
[0087] References to "an embodiment," "an exemplary embodiment," etc., in this invention indicate that the described embodiment may include a particular feature, structure, or characteristic, but not every embodiment must include that particular feature, structure, or characteristic. Furthermore, such phrases do not necessarily refer to the same embodiment. Moreover, when a particular feature, structure, or characteristic is described in connection with an embodiment, it is understood that those skilled in the art will recognize how to implement such a feature, structure, or characteristic in conjunction with other embodiments, regardless of whether it is explicitly described.
[0088] It should be understood that although terms such as “first” and “second” may be used herein to describe various elements, these elements should not be limited by these terms. These terms are used only to distinguish one element from another. For example, without departing from the scope of the exemplary embodiments, a first element may be referred to as a second element, and similarly, a second element may be referred to as a first element. The term “and / or” as used herein includes any and all combinations of one or more of the listed items.
[0089] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit the exemplary embodiments. Unless the context clearly indicates otherwise, the singular forms “a” and “described” as used herein also include the plural forms. It should also be understood that the terms “comprising,” “having,” and / or “including” as used herein specify the presence of the stated features, elements, and / or components, but do not exclude the presence or addition of one or more other features, elements, components, and / or combinations thereof.
[0090] In the context of this invention, the term "location" may be used interchangeably with "position," and the term "integrated communication and sensing system" describes a sensing-assisted communication system and may be used interchangeably with "integrated communication and sensing," "joint communication and sensing," "integrated system," "communication based on sensing technology," "cooperative communication and sensing," or any other similar name.
[0091] In the context of this invention, the term "perceived target" can refer to an environment and / or one or more objects within that environment. The term "environment" is used interchangeably with "perceived environment," and the term "object" is used interchangeably with "perceived object." The term "perceived information" can refer to information about the perceived target (e.g., the perceived environment or the perceived object). The term "perceived information" is used interchangeably with "perceived result."
[0092] As described above, in cellular communication networks, UE location information is typically used to improve various network performance metrics. These metrics may include, for example, capacity, agility, and efficiency. Given prior information describing the wireless environment in which the UE operates, network components can achieve these improvements by utilizing the UE's location, behavior, mobility patterns, etc.
[0093] Sensing systems can be used to help collect UE pose information, including the UE's position in a global coordinate system, the UE's speed and direction of movement in that global coordinate system, orientation information, and information about the wireless environment. Well-known examples of sensing systems include radio detection and ranging (RADAR) and light detection and ranging (LIDAR). While sensing systems can be separated from communication systems, it can be advantageous to use an integrated system for information collection, reducing hardware (and cost) in the system and the time, frequency, or spatial resources required to implement both functions. However, using communication system hardware to sense UE pose and environmental information remains a highly challenging open problem. The difficulty stems from factors such as the limited resolution of communication systems, the dynamic nature of the environment, and the large number of objects whose electromagnetic properties and positions need to be estimated. Therefore, sensing-based communication is an ideal feature in both existing and future communication systems.
[0094] In some scenarios, a device (or sensor or UE) can sense its environment and then perform corresponding tasks based on the perception results. These tasks may include object detection, object tracking, obstacle avoidance, etc. In other scenarios, the device can perform environment reconstruction based on the perception results and then use the reconstructed environment to further assist communication. The device can also report the perception results (e.g., the detected objects or the reconstructed environment) to a central node (or sensor or base station) for further processing. For example, since each device can perceive / observe the same environment from different angles, the central node can fuse the perception results from multiple devices into a complete / large-scale environment map. The fused environment map can be used to perform tasks / applications such as environment reconstruction or digital twins. Furthermore, the central node can send the fused environment map to another device to assist it in performing communication tasks such as beamforming / beam tracking and multiple-input multiple-output (MIMO) parameter estimation. Through perception fusion, the reconstructed environment becomes more complete and detailed, thus contributing to better task execution results.
[0095] In the above scenarios, it is necessary to describe the exchanged perceived information (e.g., the detected object or the perceived environment) in a specific way. Extremely detailed descriptions are beneficial, but they also incur relatively large computational and transmission overhead. Considering scenarios involving auxiliary communication such as object detection, object tracking, obstacle avoidance, and environment reconstruction, a rough and generalized description of the perceived information can meet the requirements of most tasks. Therefore, we can consider how to describe objects and the environment in a simplified manner.
[0096] This invention provides an element-based representation scheme. In this scheme, a first device can determine a set of elements representing a sensing target, and each element in the set of elements has a geometric shape. The first device can send sensing information of the sensing target to a second device. The sensing information may include location information of the set of elements.
[0097] In the context of this invention, the term "element-based representation" means that a perceived target is represented by a set of elements having a geometric shape. This element-based representation can be considered a preferred method of indicating perceived information, as it can describe objects and the environment in a simplified and efficient manner. Based on this simplified representation, computational complexity and power consumption on the device can be reduced, and the transmission overhead for exchanging perceived information can be significantly reduced.
[0098] In some embodiments, the first device may be a terminal device (e.g., ED 110), or a RAN network device (e.g., network node 170), or a core network device in core network 130, or an access point (AP). In some embodiments, the second device may be a terminal device (e.g., ED 110), or a RAN device in RAN 120 (e.g., network node 170), or a core network device in core network 130, or an AP.
[0099] The principles and implementation of the present invention will be described in detail below with reference to the accompanying drawings.
[0100] Figure 1 A simplified schematic diagram of a communication system 100 in which embodiments of the present invention can be implemented is shown. (See reference...) Figure 1A simplified schematic diagram of a communication system is provided as an illustrative example, but not limited to. Communication system 100 includes a radio access network (RAN) 120. RAN 120 may be a next-generation radio access network or a traditional (e.g., 5G, 4G, 3G, or 2G) radio access network. One or more electronic devices (EDs) 110a, 110b, 110c, 110d, 110e, 110f, 110g, 110h, 110i, 110j (collectively referred to as 110) may interconnect with each other or connect to one or more network nodes (170a, 170b, collectively referred to as 170) in RAN 120. Core network 130 may be part of communication system 100 and may depend on or be independent of the radio access technology used in communication system 100. Communication system 100 may also include a public switched telephone network (PSTN) 140, the Internet 150, and other networks 160.
[0101] Figure 2 A schematic diagram of an exemplary communication system 200 in which embodiments of the present invention can be implemented is shown. Typically, communication system 200 serves as an exemplary implementation of communication system 100, enabling multiple wireless or wired components to transmit data and other content. The purpose of communication system 200 may be to provide content such as voice, data, video, and / or text via broadcast, multicast, unicast, etc. Communication system 200 can operate by sharing resources such as carrier spectrum bandwidth among its constituent components. Communication system 200 may include terrestrial communication systems and / or non-terrestrial communication systems. Communication system 200 can provide a wide range of communication services and applications (e.g., earth monitoring, remote sensing, passive sensing and positioning, navigation and tracking, autonomous delivery and mobility, etc.). Communication system 200 can provide high availability and robustness through the joint operation of terrestrial and non-terrestrial communication systems. For example, integrating a non-terrestrial communication system (or components thereof) into a terrestrial communication system can form a heterogeneous network comprising multiple layers. Compared with traditional communication networks, the heterogeneous network can achieve better overall performance through efficient multi-link joint operation, more flexible function sharing, and faster physical layer link switching between terrestrial and non-terrestrial networks.
[0102] The terrestrial communication system and the non-terrestrial communication system can be considered as subsystems of the communication system 200. Figure 2In the example shown, communication system 200 includes ED 110a, 110b, 110c, 110d (collectively referred to as ED 110), RAN 120a, 120b, non-terrestrial communication network 120c, core network 130, PSTN 140, Internet 150, and other networks 160. RAN 120a and 120b include corresponding BS 170a and 170b, which can be collectively referred to as terrestrial transmit and receive points (T-TRPs) 170a and 170b. Non-terrestrial communication network 120c includes access nodes 172, which can be collectively referred to as non-terrestrial transmit and receive points (NT-TRPs) 172.
[0103] Alternatively or additionally, any ED 110 can be used to connect, access, or communicate with any T-TRP 170a, 170b, and NT-TRP 172, the Internet 150, the core network 130, the PSTN 140, other networks 160, or any combination thereof. In some examples, ED 110a can communicate uplink and / or downlink with T-TRP 170a via terrestrial air interface 190a. In some examples, ED 110a, 110b, 110c, and 110d can also communicate directly with each other via one or more sidelink air interfaces 190b. In some examples, ED 110d can communicate uplink and / or downlink with NT-TRP 172 via non-terrestrial air interface 190c.
[0104] Air interfaces 190a and 190b can use similar communication technologies, such as any suitable wireless access technology. For example, communication system 200 can implement one or more channel access methods in air interfaces 190a and 190b, such as code division multiple access (CDMA), space division multiple access (SDMA), time division multiple access (TDMA), frequency division multiple access (FDMA), orthogonal FDMA (OFDMA), or single-carrier FDMA (SC-FDMA, also known as discrete Fourier transform spread OFDMA, DFT-s-OFDMA). Air interfaces 190a and 190b can utilize other higher-dimensional signal spaces, which may involve combinations of orthogonal and / or non-orthogonal dimensions.
[0105] The non-terrestrial air interface 190c enables communication between the ED 110d and one or more NT-TRP 172s via a wireless link or simply via a link. For some examples, the link is a dedicated connection for unicast transmission, a connection for broadcast transmission, or a connection between a group of ED 110s and one or more NT-TRP 172s for multicast transmission.
[0106] RANs 120a and 120b communicate with core network 130 to provide various services, such as voice, data, and other services, to EDs 110a, 110b, and 110c. RANs 120a and 120b, and / or core network 130, may communicate directly or indirectly with one or more other RANs (not shown), which may or may not be directly served by core network 130, and may or may not use the same radio access technology as RANs 120a, RAN 120b, or both. Core network 130 may also serve as a gateway between (i) RANs 120a and 120b, or EDs 110a, 110b, and 110c, or both, and (ii) other networks (e.g., PSTN 140, Internet 150, and other networks 160). Furthermore, some or all of ED 110a, 110b, and 110c may be capable of communicating with different wireless networks via different wireless links using different wireless technologies and / or protocols. ED 110a, 110b, and 110c may communicate with service providers or exchanges (not shown) via wired communication channels, and with the Internet 150, rather than wirelessly (or also wirelessly). PSTN 140 may include a circuit-switched telephone network for providing plain old telephone service (POTS). The Internet 150 may include computer networks and subnets (intranets) or both, and integrates protocols such as Internet Protocol (IP), Transmission Control Protocol (TCP), and User Datagram Protocol (UDP). ED 110a, 110b, and 110c may be multimode devices capable of operating under multiple wireless access technologies and integrate multiple transceivers required to support such operation.
[0107] Figure 3Figure 300 illustrates an example of a device 310 that wirelessly communicates with a device 320 in a communication system (e.g., communication system 100). Device 310 may be an electronic device (e.g., ED 110). Device 320 may be a network node (e.g., network node 170), such as T-TRP 170 or NT-TRP 172. Although the figures show only one device 310 and one device 320, the number of devices 310 and / or 320 may be one or more. For example, an ED 110 may be served by only one T-TRP 170 (or one NT-TRP 172), or it may be served by more than one T-TRP 170 (or more than one NT-TRP 172). An ED 110 may be served by one or more T-TRP 170s and one or more NT-TRP 172s. Similarly, a T-TRP 170 (or one NT-TRP 172) may serve one or more ED 110s.
[0108] Device 310 includes at least one processor 210. The accompanying drawings show only one processor 210 to avoid congestion. Device 310 may also include a transmitter 201 and a receiver 203 coupled to one or more antennas 204. The accompanying drawings show only one antenna 204 to avoid congestion. Alternatively, one, some, or all of the antennas 204 may be panels. For example, the transmitter 201 and receiver 203 may be integrated as a transceiver. The transceiver is used to modulate data or other content for transmission by at least one antenna 204 or a network interface controller (NIC). The transceiver is also used to demodulate data or other content received through at least one antenna 204. Each transceiver includes any suitable structure for generating signals for wireless or wired transmission and / or processing signals received wirelessly or wiredly. Each antenna 204 includes any suitable structure for transmitting and / or receiving wireless or wired signals. Device 310 may include at least one memory 208. For simplicity, only transmitter 201, receiver 203, processor 210, memory 208, and antenna 204 are shown, but device 310 may also include one or more other components. In this invention, the transceiver (or transmitter 201 and / or receiver 203) can be considered as interface circuitry.
[0109] Memory 208 stores instructions for performing the operations described herein. Memory 208 may also store data used, generated, or collected by device 310. For example, memory 208 may store software instructions or modules executed by one or more processors 210 for implementing some or all of the functions and / or embodiments described herein.
[0110] The device 310 may also include one or more input / output devices (not shown) or interfaces. These input / output devices or interfaces support interaction with the user or other devices in the network. Each input / output device or interface includes any suitable structure for providing or receiving information from the user and / or for network interface communication. Suitable structures include, for example, speakers, microphones, keypads, keyboards, displays, touchscreens, etc.
[0111] Processor 210 may perform (or control device 310 may perform) operations (or methods) described herein as being performed by device 310. For example, processor 210 may perform or control device 310 to perform the following operations: receive a transport block (TB), decode one TB of the received TB using resources, release the resources to decode another TB of the received TB, and / or receive configuration information for configuring resources. Specifically, the operations may include: those related to preparing UL transmissions for transmission to device 320; those related to processing DL transmissions received from device 320; and those related to processing SL transmissions with another device 310. Processing operations related to preparing UL transmissions for transmission may include operations such as encoding, modulation, transmit beamforming, and generating symbols for transmission. Processing operations related to processing DL transmissions may include operations such as receive beamforming, demodulating and decoding received symbols. Processing operations related to processing SL transmissions may include operations such as transmit / receive beamforming, modulating / demodulating symbols, and encoding / decoding. According to an embodiment, the DL transmission may be received by receiver 203 via receive beamforming, and processor 210 may extract the signaling (e.g., by detecting and / or decoding the signaling in the DL transmission). An example of the signaling may be a reference signal transmitted by device 320. In some implementations, processor 210 performs the transmit beamforming and / or receive beamforming based on an indication of beam direction (e.g., beam angle information (BAI)) received from device 320. In some implementations, processor 210 may perform operations related to network access (e.g., initial access) and / or downlink synchronization, such as operations related to detecting synchronization sequences, decoding system information, and acquiring system information. In some implementations, processor 210 may, for example, use the reference signal received from device 320 to perform channel estimation.
[0112] Although not shown, processor 210 may form part of transmitter 201 and / or receiver 203. Although not shown, memory 208 may form part of processor 210.
[0113] The processor 210, the processing components of the transmitter 201, and the processing components of the receiver 203 can all be implemented by one or more processors, which may be the same or different processors, for executing instructions stored in memory (e.g., memory 208).
[0114] Device 320 includes one or more processors 260 (only one processor 260 is shown in the figures). Device 320 may also include at least one transmitter 252 and at least one receiver 254 coupled to one or more antennas 256. Only one antenna 256 is shown in the figures to avoid congestion. Alternatively, one, some, or all of the antennas 256 may be panels. Transmitter 252 and receiver 254 may be integrated as a transceiver. Device 320 may also include at least one memory 258. Device 320 may also include a scheduler 253. For simplicity, only transmitter 252, receiver 254, processor 260, memory 258, antenna 256, and scheduler 253 are shown, but device 320 may also include one or more other components. In this invention, the transceiver (or transmitter 252 and / or receiver 254) may be considered as interface circuitry.
[0115] In some implementations, the components of device 320 may be distributed. For example, some modules of device 320 may be located at a remote end of the device housing antenna 256 of device 320 (and thus can be considered as one of multiple nodes), and may be coupled to the device housing antenna 256 via a communication link (not shown) sometimes referred to as a fronthaul (e.g., a common public radio interface (CPRI)). Therefore, in some implementations, the term device 320 may also refer to a network-side node that performs processing operations such as determining the location of device 310, resource allocation (scheduling), message generation, and encoding / decoding, and is not necessarily part of the device housing antenna 256 of device 320. The node may also be coupled to other devices 320. In some implementations, device 320 may actually be multiple nodes operating together to provide services to device 310, for example, by using coordinated multicast or by using an ORAN system as described above in this application.
[0116] Processor 260 performs operations, including those related to: preparing DL transmissions for transmission to device 310; processing UL transmissions received from device 310; preparing return transmissions for transmission to another device 320; and processing transmissions received from another device 320 via return. Processing operations related to preparing DL transmissions for transmission or return transmissions may include operations such as encoding, modulation, precoding (e.g., multiple-input multiple-output (MIMO) precoding), transmit beamforming, and generating symbols for transmission. Processing operations related to processing transmissions received in the UL or via return may include operations such as receive beamforming, demodulating received symbols, and decoding received symbols. Processor 260 may also perform operations related to network access (e.g., initial access) and / or DL synchronization, such as generating the contents of a synchronization signal block (SSB), generating system information, etc. In some implementations, processor 260 also generates beam direction indications such as BAI, which can be scheduled for transmission by scheduler 253, as described below. In some implementations, processor 276 performs transmit beamforming and / or receive beamforming based on beam direction information (e.g., BAI) received from another device 320. Processor 260 performs other network-side processing operations described herein, such as determining the location of device 310, determining the deployment location of the other device 320, etc. In some implementations, processor 260 may generate signaling, such as for configuring one or more parameters of device 310 and / or one or more parameters of the other device 320. Any signaling generated by processor 260 is transmitted by transmitter 252. In some implementations, device 320 implements physical layer processing. In some implementations, in addition to physical layer processing, device 320 may also implement higher-layer functions, such as functions at the medium access control (MAC) layer or radio link control (RLC) layer. Device 320 may also include a scheduler 253 coupled to or integrated into processor 260. Scheduler 253 may be included within device 320a or may operate separately from device 320a. Scheduler 253 may schedule UL transmissions, DL transmissions, SL transmissions and / or backhaul transmissions, including issuing scheduling authorizations and / or configuring unscheduled (e.g., "configured authorization") resources.
[0117] The device 320a may further include a memory 258 storing instructions for performing the operations described herein. The memory 258 may also store data used, generated, or collected by the device 320a. For example, the memory 258 may store software instructions or modules executed by the processor 260 for implementing some or all of the functions and / or embodiments described herein.
[0118] Although not shown, processor 260 may form part of transmitter 252 and / or receiver 254. Furthermore, although not shown, processor 260 may implement scheduler 253. Although not shown, memory 258 may form part of processor 260.
[0119] The processing components of processor 260, scheduler 253, transmitter 252, and receiver 254 can all be implemented by one or more processors, which are the same or different processors for executing instructions stored in memory (e.g., memory 258).
[0120] Device 320 and / or device 310 may include other components, but for clarity, these other components are omitted.
[0121] It should be noted that the term "signaling" as used herein can be alternatively referred to as control signaling, control message, control information, or simply message. Signaling between a base station (e.g., TRP 170a and 170b, 172) and a UE or sensing device (e.g., ED 110), or between different UEs or sensing devices (e.g., between ED 110a and ED 110b), can be carried in physical layer signaling (also known as dynamic signaling), which is transmitted in the physical layer control channel. For DL, this physical layer signaling can be referred to as downlink control information (DCI), which is transmitted in the physical downlink control channel (PDCCH). For UL, this physical layer signaling can be referred to as uplink control information (UCI), which is transmitted in the physical uplink control channel (PUCCH). For SL (Signaling over Linked Components), signaling between different UEs or sensing devices (e.g., between ED 110a and ED 110b) can be referred to as SL control information (SCI), which is transmitted in the physical sidelink control channel (PSCCH). Signaling can be carried in higher-layer (e.g., above the physical layer) signaling, which is transmitted in physical layer data channels. For example, for downlink signaling, the higher-layer signaling is transmitted in the physical downlink shared channel (PDSCH); for uplink signaling, it is transmitted in the physical uplink shared channel (PUSCH); and for SL signaling, it is transmitted in the physical sidelink shared channel (PSSCH). Higher-layer signaling can also be referred to as static signaling or semi-static signaling. Higher-layer signaling can be radio resource control (RRC) protocol signaling or media access control-control element (MAC-CE) signaling. Signaling can be included in a combination of physical layer signaling and higher-layer signaling.
[0122] It should be noted that in this application, when "information" and "message" are different, they can be contained in a single message or in more than one independent message.
[0123] Figure 4A Figure 400A illustrates an example of a device 410 suitable for implementing embodiments of the present invention. Device 410 may be a communication device such as ED 110 or TRP 170a and 170b, 172, or a device implemented in said communication device. For example, the device implemented in said communication device may be an integrated circuit, which in some cases may have other common names, such as chip, modem, modem chip, baseband chip, or baseband processor. In some implementations, one or more integrated circuits may be packaged as a system-on-a-chip, system-in-package, or multi-chip module. The device may include one or more integrated circuits, or it may include one or more integrated circuits and other discrete components. In some implementations, device 410 may be a module in ED 110 or device 310. In some implementations, device 410 may be a module in one of TRP 170a and 170b, 172 or device 320.
[0124] In one example, device 410 may include one or more processors / processor cores 411 and interface circuitry 412. Device 410 may also include memory 413. The one or more processors / processor cores 411 are used to process signals and execute one or more communication protocols. Memory 413 is used to store at least a portion of corresponding computer program instructions and / or data. In one example, one or more processors (or processor cores) 411 execute the computer program instructions stored in memory 413 to implement the relevant operations (e.g., input, output, reception, and transmission) in the above method embodiments. In some implementations, memory 413 storing the corresponding computer program instructions and / or data may mean that memory 413 stores all of the corresponding computer program instructions and / or data for execution by one or more processors / processor cores 411. In some implementations, memory 413 storing the corresponding computer program instructions and / or data may mean that memory 413 stores a portion of the corresponding computer program instructions and / or data. For example, a portion of the corresponding computer program instructions and / or data includes computer program instructions and / or data that one or more processors / processor cores 411 currently need to execute. Therefore, memory 413 can store different portions of computer program instructions and / or data multiple times for one or more processors (or processor cores) 411 to execute the relevant operations in the above method embodiments. Interface circuit 412 serves as a communication interface for communication with another component. For example, interface circuit 412 can transmit signals with other devices / systems (e.g., radio frequency processing devices or processor systems). Optionally, to reduce the load on the processor core, baseband signal processing circuit 414 can also be provided to process at least a portion of the baseband signal, including signal demodulation, modulation, encoding, decoding, etc.
[0125] In one scenario, device 410 may be processor 210 (or 260) within device 310 (or 320), or it may be included within processor 210 (or 260) within device 310 (or 320). Device 410 may be or may include a baseband chip. In some implementations, device 410 may be packaged as a standalone chip. In some implementations, device 310 (or 320) may include different types of chips. Device 410 may be packaged together with these different types of chips as a processor chip (e.g., a SoC chip or a SIP chip). In some implementations, device 410 may be packaged together with some or all of the circuitry from a radio frequency processing system that may also be included in device 310 (or 320) as a chip.
[0126] Figure 4BFigure 400B illustrates an example of an apparatus 420 suitable for implementing embodiments of the present invention. Apparatus 420 may include corresponding modules or units for implementing the methods and / or embodiments described herein. In some implementations, apparatus 420 includes a processing unit 421 and a communication unit 422. Optionally, apparatus 420 may further include a storage unit 423 for storing apparatus program code (or instructions) and / or data.
[0127] Device 420 may be an ED-side device (e.g., an ED or a module within an ED), or a circuit or chip within an ED responsible for communication functions. In some implementations, device 420 may be implemented as device 310, with processing unit 421 implemented as processor 210, communication unit 422 implemented as transmitter 201 and / or receiver 203, and storage unit 423 implemented as memory 208.
[0128] Device 420 may be a base station-side device (e.g., a base station or a module within a base station), or a circuit or chip within a base station responsible for communication functions. In some implementations, device 420 may be implemented as device 320, with the processing unit 421 implemented as processor 260 (a scheduler 253 may also be included), the communication unit 422 implemented as transmitter 252 and / or receiver 254, and the storage unit 423 implemented as memory 258.
[0129] In some implementations, when device 420 is ED 110 or a module within ED 110, the functionality of device 420 may be implemented by one or more processors. Specifically, the processor may include a modem chip, or a system-on-chip (SoC) chip or SIP chip including a modem core. The functionality of communication unit 422 may be implemented by transceiver circuitry.
[0130] In some implementations, when device 420 is a circuit or chip in ED 110 responsible for communication functions (e.g., a modem chip, a SoC chip including a modem core, or a SIP chip), the function of processing unit 421 can be implemented by a circuit system in the chip including one or more processors or processor cores. The function of communication unit 422 can be implemented by interface circuitry or data transceiver circuitry on the aforementioned chip.
[0131] It should be understood that the division of units in the above-described device is merely a logical functional division. Each function may correspond to a functional unit, or two or more functions may be integrated into one functional unit. In actual implementation, all or some of these units may be integrated into one physical entity or distributed across different physical entities. Furthermore, the above-described functional units may be implemented in hardware, software, or a combination of both. Whether a function is executed in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the functions described for each specific application, but this should not be considered as exceeding the scope of this application.
[0132] In one example, the functional unit in any of the above-described devices can be configured as one or more integrated circuits for implementing the above-described methods, such as one or more application-specific integrated circuits (ASICs), one or more central processing units (CPUs), one or more microprocessors (microcontroller units, MCUs), one or more digital signal processors (DSPs), one or more field-programmable gate arrays (FPGAs), or a combination of at least two of these integrated circuit forms.
[0133] In one example, storage unit 901 may include random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, and / or registers.
[0134] A processor, processor system, application processor, baseband processor, processor circuit, or processor core can all be collectively referred to as a processor. The processor may include one or a combination of a central processing unit (CPU), a digital signal processor (DSP), a microprocessor unit (MPU), a microcontroller unit (MCU), a graphics processing unit (GPU), a field-programmable gate array (FPGA), an artificial intelligence processor (AI processor), or a neural network processing unit (NPU).
[0135] The memory may include one or more of the following storage media: random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), phase-change memory (PCM), resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), cache, register, read-only memory (ROM), flash memory, erasable programmable read-only memory (EPROM), hard disk, etc. In one example, computer program instructions for executing the above embodiments may be stored in at least a portion of the memory 1060 (e.g., one or more of ROM, flash memory, EPROM, or hard disk) in a non-volatile memory. When the terminal is running, some or all of the corresponding computer program instructions can be loaded into a memory with a faster transfer speed than the processor (e.g., at least a portion of memory 1036 and / or memory 10312 (e.g., one or more of RAM, SRAM, DRAM, PCM, RERAM, MRAM, FRAM, cache, or register)), causing the processor to execute the computer program instructions, thereby performing the steps in the above method embodiments.
[0136] For sensing tasks / applications, a device (e.g., any ED 110 or network node 170) can sense the environment and then perform a corresponding task based on the sensing results (e.g., detected objects or reconstructed environment). The sensing results can be sent to another device for further processing. Therefore, the exchanged sensing information needs to be described in a specific way.
[0137] The detected object can be represented as a point in space using coordinates (x, y, z). While this position-based representation is simple and has low transmission overhead, it cannot adequately describe the detected object or environmental information. For example, it cannot describe the outline information of the object or the environment.
[0138] The detected objects or the reconstructed environment can also be represented by point clouds. Figure 5A Figure 500A shows an exemplary point cloud representation of perceived information. Figure 5A Examples of two buildings are shown. A point cloud is a set of discrete data points in space. Each point location has coordinates (x, y, z).
[0139] The detected objects or the reconstructed environment can also be represented by a grid. Figure 5B A diagram 500B shows an exemplary grid representation of perceived information. Figure 5B Two examples of buildings are also shown. A mesh is a collection of vertices, edges, and faces that define the shape of an object. The faces typically include triangles (i.e., a triangular mesh), quadrilaterals (i.e., quadrilateral faces), or other convex polygons. The mesh can also be called a polygon or polygonal mesh.
[0140] Both point cloud representation and mesh representation can provide a detailed description of an object or environment. However, because they both represent objects based on points / vertices, the number of bits used for representation is relatively large, resulting in significant communication overhead in scenarios such as sensor fusion, sensor reporting, or other sensor information exchange. For example, assuming each point / vertices has 16 bits of precision for its coordinates (x, y, z), the total number of bits for 100 points / vertices could be 100 × 3 × 16 = 4800 bits. Mesh representation may require additional bits for edge representation, i.e., the relationships between vertices.
[0141] To describe the detected objects or the reconstructed environment, an extremely detailed description is beneficial, but it also incurs relatively large computational and transmission overhead. Considering these or similar scenarios, a coarse and general description can meet the requirements of most tasks.
[0142] In this context, embodiments of the present invention provide an element-based representation scheme. This element-based representation can be used to represent perceptual information. It can describe objects and the environment in a simplified and efficient manner. The following will combine... Figure 6 The element-based representation scheme is described in detail.
[0143] Figure 6 A signaling diagram of an exemplary communication process 600 according to some embodiments of the present invention is shown. Process 600 may involve a first device and a second device. Figure 6 The steps and their order described are for illustrative purposes only and should not be considered limiting. For example, the order of the steps can be changed. Some steps can be omitted, and any other suitable additional steps can be added.
[0144] In some embodiments, the first device may be a terminal device (e.g., ED 110) or a chip or module in the terminal device, and the second device may be a network device or a chip or module in the network device. In some embodiments, the first device may be a network device or a chip or module in the network device, and the second device may be a terminal device or a chip or module in the terminal device. In some embodiments, the first device may be a terminal device or a chip or module in the terminal device, and the second device may be another terminal device or a chip or module in the other terminal device. In some embodiments, the first device may be a network device or a chip or module in the network device, and the second device may be another network device or a chip or module in the other network device.
[0145] In some embodiments, the network device may be a device in RAN 120 (e.g., network node 170). In some embodiments, the network device may be an AP. In some embodiments, the network device may be a device in CN 130 (e.g., access management function (AMF), session management function (SMF), user plane function (UPF), etc.).
[0146] like Figure 6 As shown, in step 610, the first device may send information to the second device supporting the representation of the sensing target by a set of elements (i.e., one or more elements) (i.e., supporting the element-based representation). In other words, before exchanging element-based sensing information, the devices may exchange their capabilities or mode selection information regarding the element-based representation. In the context of this invention, the term "element" may be used interchangeably with "basic element".
[0147] In some embodiments, the sensing target may be the environment to be sensed. In some embodiments, the sensing target may be an object to be sensed in the environment. For example, sensing targets (e.g., sensing objects or reconstructed environments) that may be associated with the sensing task can be sensed to determine or generate sensing information. In some examples, there may be one or more objects around the first device, such as people, cars, buildings, or other objects or machines. In some examples, the one or more objects may be static or moving, and the one or more objects may affect the communication of the first device or another device. In this case, obtaining detailed information about the one or more objects (e.g., location, size, direction of movement, speed of movement, etc.) may be advantageous. Sensing operations can be used to determine sensing information, and accordingly, the sensing information can be used to deduce the detailed information. In the context of this invention, for ease of description, the one or more objects may be referred to as sensing objects.
[0148] In some embodiments, the first device may indicate to the second device that a mode of the element-based representation has been selected for the perception information representation. In some embodiments, the first device (e.g., UE) may report to the second device (e.g., BS) its capability to support the element-based representation. Thus, the devices may exchange information about their capabilities or mode selections related to the element-based representation. Step 610 may be optional.
[0149] In some embodiments, such as radio resource control (RRC) signaling, medium access control (MAC) control element (CE) signaling, or physical (PHY) signaling, if the first device is a UE and the second device is a BS, the UE may indicate to the BS its capability regarding the element-based representation, or its mode selection regarding the element-based representation (e.g., using the element-based representation). In some embodiments, the first device may indicate whether it has the capability to extract element-based sensing information, or a mode selection for the first device to extract element-based sensing information. In some embodiments, the first device may indicate whether it has the capability to compress element-based sensing information, or a mode selection for the first device to compress element-based sensing information. In some embodiments, the first device may indicate the maximum number of basic elements that can be extracted / transmitted at once. In some embodiments, the first device may indicate whether rotation of the basic elements is supported. In some embodiments, the first device may indicate whether scaling of the basic elements is supported. The first device may indicate any combination of the above-described capability information or any other suitable capability information.
[0150] Re-reference Figure 6 In step 620, the second device may send an indication (also referred to herein as a mode selection indication) to the first device indicating the representation of the sensing target by the element set. In some embodiments where the first device is a UE and the second device is a BS, the BS may broadcast / multicast / unicast the mode selection indication for the element-based representation (e.g., using the element-based representation) to one or more UEs (including the first device). In some embodiments, the mode selection indication may be included in RRC signaling, MAC CE signaling, or PHY signaling. For example, the mode selection indication may be included in a synchronization signal block (SSB), a system information block (SIB), RRC-specific signaling, a control channel (e.g., PDCCH / DCI), etc. Step 620 may be optional.
[0151] Re-reference Figure 6In step 630, the second device may send information to the first device to enable or disable the representation of the perceived target by the element set. Based on the enable or disable information, the first device may enable or disable the element-based representation in real time. Step 630 may be optional.
[0152] In some embodiments, the enable or disable information may be included in broadcast / multicast / unicast messages (e.g., RRC signaling, MAC CE signaling, or PHY signaling). For example, the enable or disable information may be included in SSB, SIB, RRC dedicated signaling, UAI, control channels (e.g., PUCCH / PDCCH / DCI / UCI), etc.
[0153] In some embodiments, one or more parameters associated with the element-based representation may be exchanged between the first and second devices. (Reference) Figure 6 In some embodiments, at step 640, the second device may send a set of parameters associated with the element-based representation (also referred to herein as a first parameter set) to the first device. In some embodiments, some relevant parameters may be configured for the first device before exchanging element-based perception information. For example, if the first device is a UE and the second device is a BS, the BS may broadcast / multicast / unicast the first parameter set to one or more UEs (including the first device).
[0154] In some embodiments, the first parameter set may be included in downlink / uplink / sidelink RRC signaling, MACCE signaling, or PHY signaling. For example, the first parameter set may be indicated in SSB, SIB, general / dedicated RRC signaling, control channels (e.g., PUCCH / PDCCH / DCI / UCI), etc. Step 640 may be optional.
[0155] refer to Figure 6 In some embodiments, at step 650, the first device may send a set of parameters associated with the element-based representation (also referred to herein as a second parameter set) to the second device. In some embodiments, before exchanging element-based perception information, the first device may determine some relevant parameters and indicate these parameters to the second device. In some embodiments, if the first device is a UE and the second device is a BS, the UE may indicate the second parameter set to the BS.
[0156] In some embodiments, the second parameter set may be included in downlink / uplink / sidelink RRC signaling, MACCE signaling, or PHY signaling. For example, the second parameter set may be indicated in SSB, SIB, general / dedicated RRC signaling, control channels (e.g., PUCCH / PDCCH / DCI / UCI), etc. Step 650 may be optional.
[0157] In some embodiments, the first parameter set or the second parameter set may indicate the shape of the elements in the element set, i.e., the geometry of the basic elements. The geometry may be a 2D or 3D shape, such as a square, circle, rectangle, cube, sphere, etc. (The rest of the text is omitted as it is incomplete.) Figures 7A to 8B More details will be described later.
[0158] In some embodiments, the first parameter set or the second parameter set may indicate the size of the elements in the element set. For example, the size of the element may include the side length of the basic element (e.g., a square, rectangle, or cube) or the radius of the basic element (e.g., a circle or sphere).
[0159] In some embodiments, the first parameter set or the second parameter set may indicate a coordinate system used for the location information of the element set. In some embodiments, the coordinate system may be a 2D coordinate system or a 3D coordinate system. In some embodiments, the coordinate system of the basic element may be a global coordinate system, such as a geographic coordinate system, a cell coordinate system, etc. In some embodiments, the coordinate system of the basic element may be a local coordinate system, such as the coordinate system of the first device or the second device, a coordinate system based on a reference point, a coordinate system defined by a plane, etc.
[0160] In some embodiments, the location information may include first location information of elements in the element set (e.g., each element), and the first location information may include 2D or 3D coordinates of a point associated with the element. In some embodiments, the point associated with the element may include the geometric center of the element. It should be noted that any other suitable point associated with the element may also be feasible.
[0161] In some embodiments, the first parameter set or the second parameter set may indicate the number of elements in a single transmission (e.g., in each transmission). In some embodiments, the first parameter set or the second parameter set may indicate the maximum number of elements in a single transmission (e.g., in each transmission).
[0162] In some embodiments, the first parameter set or the second parameter set may indicate the precision of the positional information of the element set. For example, the first parameter set or the second parameter set may indicate the point associated with the basic element (represented herein as C).j The precision of (). For example, it can indicate the representation of C. j The number of bits for 2D or 3D coordinates.
[0163] In some embodiments, the first parameter set or the second parameter set may indicate a format representing the positional information of the element set, such as representing the center of the basic element {C1, C2, ..., C}. N The format is}. In some embodiments, the first parameter set or the second parameter set may indicate that each C is directly filled. j In some embodiments, the first parameter set or the second parameter set may instruct the organization or reorganization of C. j 2D or 3D coordinates.
[0164] In some embodiments, the first parameter set or the second parameter set may indicate whether to apply rotation to the elements in the element set, that is, whether to use rotation on the elements.
[0165] In some embodiments, the first parameter set or the second parameter set may indicate the precision of the orientation information of elements in the element set. In some embodiments, the orientation information of an element may include the orientation of the element. In some embodiments, the orientation information of an element may include the normal vector of the element. In some embodiments, the orientation information of an element may include the rotation angle of the element. In some embodiments, the orientation information of an element may include the orientation information of a point associated with the element. In some embodiments, the number of bits representing the orientation information of the element may be indicated.
[0166] In some embodiments, the first parameter set or the second parameter set may indicate the value range of the orientation information. For example, it may indicate the minimum and maximum values of the orientation, normal vector, or rotation angle of an element in the element set.
[0167] In some embodiments, the first parameter set or the second parameter set may indicate whether a scaling factor is applied to the elements in the element set, that is, whether scaling is applied to the elements.
[0168] In some embodiments, for example, if the scaling is applied to the elements, the first parameter set or the second parameter set may indicate a range of values for the scaling factor. In some embodiments, the minimum and maximum values of the scaling factor for the elements in the element set may be indicated. In some embodiments, the first parameter set or the second parameter set may indicate the scaling factor (e.g., denoted herein as S). j The precision of ). For example, it can indicate the representation of S. j The number of bits. In another example, if S jIf it is an enumerated value, then it can indicate S j An enumeration definition or table of values.
[0169] In some embodiments, for example, if the scaling is applied to the element, the first parameter set or the second parameter set may indicate a format representing the scaling factor.
[0170] In some embodiments, the first parameter set or the second parameter set may indicate whether compression is applied to the perceived information, that is, whether compression is used on the perceived information.
[0171] In some embodiments, for example, if the compression is used, the first parameter set or the second parameter set may indicate a compression method of the compression. In some embodiments, for example, if the compression is used, the first parameter set or the second parameter set may indicate one or more compression parameters of the compression. For example, the first parameter set or the second parameter set may indicate: a quantization method (e.g., scalar quantization, dynamic quantization, non-uniform quantization, etc.) for the center, normal vector, or rotation angle or scaling factor of the fundamental element; quantization parameters (e.g., quantization bits, minimum and maximum values, etc.); whether entropy coding is used (e.g., Huffman coding, arithmetic coding, etc.); or a combination of these.
[0172] Suppose a sensing target is detected on the first device. In some embodiments, the sensing target may be a sensing environment. In some embodiments, the sensing target may be a sensing object. To roughly describe the sensing target (e.g., the detected object and the reconstructed environment), an element-based representation can be used.
[0173] refer to Figure 6 In step 660, the first device may determine a set of elements representing the perceived target. Each element in the set of elements has a geometric shape.
[0174] In some embodiments, the geometry may be a 2D shape. For example, the geometry may be a square, a circle, or a rectangle. In some embodiments, the geometry may be a 3D shape. For example, the geometry may be a cube or a sphere. Any other suitable geometry, whether existing or to be developed in the future, may also be feasible.
[0175] In some embodiments, the element set may include two or more elements, and the two or more elements have the same shape. The following will combine... Figure 7A and Figure 7B Examples describing element-based representations.
[0176] Figure 7AFigure 700A illustrates an exemplary element-based representation according to some embodiments of the present invention. For example... Figure 7A As shown, a sensing target (e.g., an object or environment) 710 is detected. A square 711 can be used as an element to represent the sensing target. The sensing target can be represented by three squares, as indicated by reference numeral 712. Alternatively, a circle 713 can be used as an element to represent the sensing target. The sensing target can be represented by two circles, as indicated by reference numeral 714. Based on this representation, the sensing information of the sensing target can be a simplified representation indicated by reference numerals 712 or 714.
[0177] Figure 7B Figure 700B illustrates another exemplary element-based representation according to some embodiments of the present invention. (See figure 700B.) Figure 7B As shown, a sensing target (e.g., an object or environment) 720 is detected. A cube 721 can be used as an element representing the sensing target. The sensing target can be represented by two cubes, as indicated by reference numeral 722. Alternatively, a sphere 723 can be used as an element representing the sensing target. The sensing target can be represented by two spheres, as indicated by reference numeral 724. Based on this representation, the sensing information of the sensing target can be a simplified representation indicated by reference numerals 722 or 724.
[0178] although Figure 7A or Figure 7B The above representation is relatively simple, but it can obtain a general outline of the perceived target. This general outline is sufficient for many sensing tasks or related applications. Based on this element-based representation, the computational complexity and power consumption on the first device can be reduced, and the transmission overhead for exchanging sensing information can also be significantly reduced.
[0179] Re-reference Figure 6 In step 670, the first device may send the sensing information of the sensing target to the second device.
[0180] In some embodiments, the sensing information may include location information representing the set of elements of the sensing target. In some embodiments, the location information may include first location information of elements in the set of elements, and the first location information may include 2D or 3D coordinates of a point associated with the element. In some embodiments, the point associated with the element may include the geometric center of the element. Any other suitable point associated with the element may also be feasible.
[0181] Assume that the element-based representation uses the element set {E1, E2, ..., E...} N} represents the sensing information (e.g., detected objects, reconstructed environment, etc.). N denotes the number of elements, E j denotes the j-th element in the element set, where 1≤j≤N.
[0182] In some embodiments, the element set may include two or more elements, and the two or more elements have the same shape. That is, all base elements in one instance of the element-based representation (e.g., one sensing information report or indication) may all have the same shape. For example, as shown in Figure 7A indicated by reference numeral 712 in, the elements are squares, and three squares represent the sensing target 710. In Figure 7B another example indicated by reference numeral 724 in, the elements are spheres, and two spheres represent the sensing target 720.
[0183] Assume that the geometric center of element E j is denoted as C j , where 1≤j≤N. In some embodiments, C j may be represented by 2D coordinates (x j , y j ), where 1≤j≤N. In some embodiments, C j may be represented by 3D coordinates (x j , y j , z j ), where 1≤j≤N. In some embodiments, C j may be represented by global coordinates (e.g., geographic coordinate system, cell coordinate system, etc.). In some embodiments, C j may be represented by local coordinates (e.g., the coordinate system of the first apparatus, a coordinate system referenced to a reference point, a coordinate system defined by a plane, etc.).
[0184] In some embodiments, if all elements have the same shape and size, and they are known (e.g., fixed, preconfigured, or previously indicated between the first apparatus and the second apparatus), the representation of the sensing information may be simplified to {C1, C2, ..., C N}, that is, including the geometric centers of the elements. This representation is extremely simple and efficient. Some examples will be described in conjunction with Figure 8A and Figure 8B .
[0185] Figure 8A shows a diagram 800A of another exemplary element-based representation according to some embodiments of the present invention. As shown in Figure 8AAs shown, a sensing target (e.g., an object or environment) 810 is detected. A square 811 is used as an element to represent the sensing target. As indicated by reference numeral 812, based on square 811, the sensing target 810 can be represented by three squares of the same size, and the coordinates of the geometric centers of these three squares are C1, C2, and C3, respectively. In this case, the representation of the sensing information of the sensing target 810 can be simplified to {C1, C2, C3}. Alternatively, the sensing target 810 can be represented by two squares, as indicated by reference numeral 813. In this case, the representation of the sensing information of the sensing target 810 can be simplified to {C1, C2}.
[0186] Figure 8B Figure 800B illustrates another exemplary element-based representation for environmental reconstruction according to some embodiments of the present invention. Figure 8B As shown, a perceived target (e.g., an object or environment) 820 is detected. A sphere 821 is used as an element to represent the perceived target. As indicated by reference numeral 822, based on sphere 821, the perceived target 820 can be represented by two spheres of the same size, and the coordinates of the geometric centers of these two spheres are C1 and C2, respectively. In this case, the representation of the perceived information of the perceived target 820 can be simplified to {C1, C2}.
[0187] In some embodiments, the perceived information may include a set of values organized according to their attributes. Assume the perceived information (e.g., detected objects, reconstructed environment, etc.) is categorized by {C1, C2, ..., C...} N} indicates that C j It is a 3D coordinate (x) j y j z j ), where 1≤j≤N.
[0188] In some embodiments, {C1, C2, ..., C N The detailed information of} can be organized as {x1, y1, z1, x2, y2, z2, ..., x N y N z N In other words, directly fill each C. j The coordinates. In some embodiments, {C1, C2, ..., C... N The detailed information of} can be organized as {x1, x2, ..., x} N y1, y2, ..., y N z1, z2, ..., z N In other words, each C is reorganized by putting all x values together, all y values together, and all z values together. jThe coordinates. Any other suitable organized format is also acceptable.
[0189] In some embodiments, the element set may include two or more elements, and the two or more elements may be arranged with the same spacing in one direction. That is, the two or more elements are arranged in the same direction (e.g., in a straight line), and adjacent elements are arranged with the same spacing. In some embodiments, the adjacent elements may be arranged next to each other, i.e., the spacing is zero. In some embodiments, the adjacent elements may be arranged apart from each other, i.e., the spacing is greater than zero. It is assumed that the arrangement direction and the spacing are known. In this case, the position information of the element set may include the position information of one of the two or more elements and the number of the two or more elements. That is, {C1, C2, ..., C...} N The detailed information can be organized as {x1, y1, y2, y3, y4, y5, y6, y7, y8, y9, y1, y1, y9 ... 1、 z1, N}. Therefore, it is only necessary to indicate the geometric center C1 of the first element and the number of elements N. The geometric centers of the other elements can be inferred using C1, the arrangement direction, and the spacing. Any other suitable organized format may also be feasible.
[0190] For C j In the case of 2D coordinates, a similar representation can be used. For the sake of simplicity, other details will not be elaborated here.
[0191] In some embodiments, the sensing information may include orientation information representing a set of elements of the sensing target. In some embodiments, the elements in the set of elements may have an orientation or a normal vector, or they may have a rotation angle relative to the axes of the coordinate system. Figure 9A A diagram 900A illustrates exemplary orientation information in an element-based representation according to some embodiments of the present invention. For example... Figure 9A As indicated by reference numeral 911 in the attached drawing, the sensing target 910 can be represented by four squares with different normal vectors. Alternatively, as... Figure 9A As shown by reference numeral 912 in the attached figure, the sensing target 910 can be represented by two cubes with different rotation angles.
[0192] In some embodiments, the orientation, normal vector, or rotation of different elements may be the same. In some embodiments, the orientation, normal vector, or rotation of different elements may be different.
[0193] In some embodiments, an element may have an orientation and a normal vector, and may also have a rotation angle relative to an axis of a coordinate system (e.g., a local coordinate system or a global coordinate system). In some embodiments, the orientation, rotation, or normal vector of different elements may be the same. In some embodiments, the orientation, rotation, or normal vector of different elements may be different.
[0194] Figure 9B A diagram 900B illustrates another exemplary orientation information in an element-based representation according to some embodiments of the present invention. For example... Figure 9B As shown, a sensing target 920 is detected. If the element is a square indicated by reference numeral 921, the sensing information of the sensing target 920 can be represented by four squares indicated by reference numeral 922. Each square has a geometric center C. j and orientation R j (i.e., normal vectors), where j = 1, 2, 3, 4. Some of the orientations or normal vectors of the square are the same (e.g., R1 and R2); some of the orientations or normal vectors of the square are different (e.g., R1 and R3).
[0195] like Figure 9B As shown, if the element is a cube indicated by reference numeral 923, the perceptual information of the sensing target 920 can be represented by two cubes, each having a geometric center C1 and C2. As indicated by reference numeral 924, these two cubes can have the same rotation angle (θ, θ). Alternatively, the two cubes can each have different rotation angles (θ1, ω). 1, ω1) and (θ2, 2, ω2), as shown in the attached figure, reference numeral 925.
[0196] Besides squares and cubes, the orientation, rotation, or normal vector of an element can also be applied to other geometric shapes (e.g., circles, rectangles, etc.). In a 3D coordinate system, the normal vector of a square, circle, or rectangle can also be used to calculate the rotation angle relative to the axes of the local or global coordinate system.
[0197] Therefore, in addition to the geometric center of the element, the representation of the perceived information may also include the orientation information of the element. In some embodiments, the orientation information of the elements in the element set may include the 2D normal vector or rotation angle of the element relative to the axis of the 2D coordinate system. In some embodiments, the orientation information of the elements in the element set may include the 3D normal vector or rotation angle of the element relative to the axis of the 3D coordinate system.
[0198] Assume element E j The orientation is R j Where 1 ≤ j ≤ N. In some embodiments, Rj It can be derived from the 2D normal vector (a j b j ) or 3D normal vector (a j b j c j ) represents, where 1≤j≤N, such as Figure 9B As indicated by reference numeral 922 in the accompanying drawings. In some embodiments, R j It can be determined by the 2D rotation angle (θ) j , ) or 3D rotation angle (θ) j , ω j ) represents, where 1≤j≤N, such as Figure 9B As shown by reference numeral 925 in the attached figure. For illustration, the 3D normal vector (a) will be referred to below as the 3D normal vector. j b j c j Taking [example] as an example, we will explain the representation of perceptual information with orientation, rotation, or normal vector information. Perceptual information with rotation angles or in a 2D coordinate system can be represented similarly; for the sake of brevity, further details will not be elaborated here.
[0199] In some embodiments, the element set includes two or more elements, and the two or more elements have the same orientation. In this case, the orientation information of the element set may include the orientation information of one of the two or more elements.
[0200] In some embodiments, the orientation, rotation, or normal vector of different elements is the same, that is, R j = R = (a, b, c), where 1 ≤ j ≤ N. In this case, the representation of perceptual information can be {R, C1, C2, ..., C}. N}, or {C1, C2, ..., C N In some embodiments, {R, C1, C2, ..., C}. N The detailed information can be organized as {a, b, c, x1, y1, z1, x2, y2, z2, ..., x N y N z N}, or {a, b, c, x1, x2, ..., x N y1, y2, ..., y N z1, z2, ..., z N In some embodiments, {C1, C2, ..., C} N The detailed information of {x1, y1, z1, x2, y2, z2, ..., x} can be organized as {x1, y1, z1, x2, y2, z2, ..., x}. N y Nz N {a, b, c} or {x1, x2, ..., x} N y1, y2, ..., y N z1, z2, ..., z N a, b, c}. Any other suitable organized format is also acceptable.
[0201] In some embodiments, the element set includes two or more elements, and the two or more elements have different orientations. In this case, the orientation information of the element set may include the orientation information of each of the two or more elements. In some embodiments where the element set includes two or more elements, and the two or more elements have the same orientation, the orientation information of the element set may also include the orientation information of each of the two or more elements.
[0202] In some embodiments, if the orientation, rotation, or normal vectors of different elements are different, the representation of the perceived information can be {C1, C2, ..., C...} N R1, R2, ..., R N}, or {R1, R2, ..., R} N C1, C2, ..., C N}, or {C1, R1, C2, R2, ..., C N R N In some embodiments, {C1, C2, ..., C} N R1, R2, ..., R N The detailed information of} can be organized as {x1, y1, z1, x2, y2, z2, ..., x N y N z N ,a1,b1,c1,a2,b2,c2,…,a N b N c N}, or {x1, x2, ..., x N y1, y2, ..., y N z1, z2, ..., z N a1, a2, ..., a N b1, b2, ..., b N c1, c2, ..., c N In some embodiments, {R1, R2, ..., R} N C1, C2, ..., C N The detailed information can be organized as {a1, b1, c1, a2, b2, c2, ..., a N b N cN ,x1,y1,z1,x2,y2,z2,…,x N y N z N}, or {a1, a2, ..., a N b1, b2, ..., b N c1, c2, ..., c N x1, x2, ..., x N y1, y2, ..., y N z1, z2, ..., z N In some embodiments, {C1, R1, C2, R2, ..., C...} N R N The detailed information can be organized as {x1, y1, z1, a1, b1, c1, x2, y2, z2, a2, b2, c2, ..., x N y N z N a N b N c N}
[0203] The above format {x1, x2, ..., x N y1, y2, ..., y N z1, z2, ..., z N a1, a2, ..., a N b1, b2, ..., b N c1, c2, ..., c N} or {a1, a2, ..., a N b1, b2, ..., b N c1, c2, ..., c N x1, x2, ..., x N y1, y2, ..., y N z1, z2, ..., z N The organization is achieved by grouping all x values together, all y values together, all z values together, all a values together, all b values together, and all c values together. The advantage of grouping all x values together, or all y values together, ..., or all a values together, ..., or all c values together is that if compression (e.g., quantization and entropy coding) is enabled for element-based perceptual information, compression can be better by grouping numbers with similar properties together.
[0204] In some embodiments, the sensing information may include size information representing a set of elements of the sensing target. In some embodiments, the size information of the elements in the element set may include scaling factors of the elements. In some embodiments, different elements may have the same scaling factor. In some embodiments, different elements may have different scaling factors.
[0205] In some embodiments, for example, if the first device has the aforementioned capability, the first device can reconstruct the detected object or environment based on different scaling factors of the element. Figure 10 A diagram 1000 illustrating exemplary scaling in an element-based representation according to some embodiments of the present invention is shown. Figure 10 As shown, a sensing target 1010 was detected. Square 1011 can be used as an element to represent the sensing target 1010.
[0206] In some embodiments, the scaling factor can be defined as the ratio of the actual size of an element in the perceptual information representation to the reference size of the element. Reference numerals 1012 and 1013 illustrate two examples of perceptual information representations based on different scaling factors for the element. In the example indicated by reference numeral 1012, the perceptual target 1010 can be represented by a square larger than square 1011, and the corresponding scaling factor is greater than 1. In the example indicated by reference numeral 1013, the perceptual target 1010 can be represented by a square smaller than square 1011, and the corresponding scaling factor is less than 1.
[0207] In some alternative embodiments, the scaling factor may be defined as the ratio of the reference size of an element in the perceived information representation to the actual size of the element.
[0208] Re-reference Figure 10 Rectangle 1014 can be used as an element to represent the sensing target 1010. As shown by reference numeral 1015, the sensing target 1010 can be represented by two rectangles with the same scaling factor. As shown by reference numeral 1016, the sensing target 1010 can be represented by three rectangles with different scaling factors.
[0209] In this case, in addition to the center of the element, the representation of perceptual information can also include the scaling factor of the element. Assume element E... j The scaling factor is S j Where 1 ≤ j ≤ N. In some embodiments, S j It can be a floating-point number, an enumerated value, or a quantized value, etc.
[0210] In some embodiments, the element set includes two or more elements, and the two or more elements have the same size. In this case, the size information of the element set may include the size information of one of the two or more elements.
[0211] In some embodiments, if different elements have the same scaling factor, i.e., S j = S, then the representation of perceived information can be {S, C1, C2, ..., C}. N} or {C1, C2, ..., C N In some embodiments, {S, C1, C2, ..., C}. N The detailed information can be organized as {S, x1, y1, z1, x2, y2, z2, ..., x N y N z N}, or {S, x1, x2, ..., x N y1, y2, ..., y N z1, z2, ..., z N In some embodiments, {C1, C2, ..., C} N The detailed information of {x1, y1, z1, x2, y2, z2, ..., x} can be organized as {x1, y1, z1, x2, y2, z2, ..., x}. N y N z N S}, or {x1, x2, ..., x} N y1, y2, ..., y N z1, z2, ..., z N 、S}。 Any other suitable organizational format is also acceptable.
[0212] In some embodiments, the element set includes two or more elements, and the two or more elements have different sizes. In this case, the size information of the element set may include the size information of each of the two or more elements. In some embodiments where the element set includes two or more elements, and the two or more elements have the same size, the size information of the element set may also include the size information of each of the two or more elements.
[0213] In some embodiments, if different elements have different scaling factors, the representation of the perceived information can be {C1, C2, ..., C...} N S1, S2, ..., S N}, or {S1, S2, ..., S} N C1, C2, ..., C N}, or {C1, S1, C2, S2, ..., CN S N In some embodiments, {C1, C2, ..., C} N S1, S2, ..., S N The detailed information of} can be organized as {x1, y1, z1, x2, y2, z2, ..., x N y N z N S1, S2, ..., S N}, or {x1, x2, ..., x N y1, y2, ..., y N z1, z2, ..., z N S1, S2, ..., S N In some embodiments, {S1, S2, ..., S...} N C1, C2, ..., C N The detailed information of} can be organized as {S1, S2, ..., S} N ,x1,y1,z1,x2,y2,z2,…,x N y N z N}, or {S1, S2, ..., S} N x1, x2, ..., x N y1, y2, ..., y N z1, z2, ..., z N In some embodiments, {C1, S1, C2, S2, ..., C...} N S N The detailed information of} can be organized as {x1, y1, z1, S1, x2, y2, z2, S2, ..., x N y N z N S N}
[0214] The above format {x1, x2, ..., x N y1, y2, ..., y N z1, z2, ..., z N S1, S2, ..., S N} or {S1, S2, ..., S N x1, x2, ..., x N y1, y2, ..., y N z1, z2, ..., z NThe organization is achieved by grouping all x-values together, all y-values together, all z-values together, and all scaling factors together. The advantage of grouping all x-values together, or all y-values together, ..., or all scaling factors together is that if compression is enabled for element-based perceptual information (e.g., quantization and entropy coding), compression can be better by grouping numbers with similar properties together.
[0215] In some embodiments, if the element size has not been previously indicated or configured, the first device may need to compare the element size with the element {C1, C2, ..., C}. N The geometric center of the elements is reported together. In some embodiments, the representation of the previously described perceptual information can be used by replacing the scaling factor with the element size.
[0216] Thus, the first device can send the element-based sensing information to the second device.
[0217] like Figure 6 As shown, in step 680, after receiving the element-based perception information, the second device can determine the perception target based on the element-based perception information. The second device can determine the detected object or environment based on the element-based perception information in any suitable manner, and the present invention is not limited thereto.
[0218] In some embodiments, the first device may also receive the element-based sensing information from the second device. The content and format of the element location information are similar to those previously described for the first device. The element orientation information and / or element size information may be included, and their related content and format are similar to those previously described for the first device. Optionally, the number of elements may also be included. If the number of elements is fixed or previously configured or indicated before the sensing information indication, it may not be necessary to send the number of elements along with the element location information. The element-based sensing information of the second device may be generated and sent by the second device in a manner similar to that described for the first device; therefore, for brevity, further details are omitted here. Accordingly, the first device may also determine the sensing target detected by the second device based on the element-based sensing information of the second device.
[0219] So far, process 600 has described a scheme for element-based representation of the sensed target. This scheme provides a simplified and efficient representation of the sensed target. It can reduce computational complexity and power consumption on the device, and also significantly reduce the transmission overhead of sensed information exchange.
[0220] Procedure 600 can be performed between the UE and the BS (e.g., between the ED and the TRP), between the UE and the core network, between UEs, or between BSs (e.g., between TRPs). It should also be noted that Procedure 600 can also be applied to Wi-Fi, ultra-wideband (UWB), and other short-range communications; for example, Procedure 600 can be performed between the UE and the AP.
[0221] Corresponding to the above process, embodiments of the present invention provide a communication method implemented on a first device and a second device. The following will combine... Figure 11 and Figure 12 Describe these methods.
[0222] Figure 11 A flowchart illustrating an exemplary communication method 1100 implemented on a first device according to some embodiments of the present invention is shown. For example, method 1100 can be executed on a device in ED 110, network node 170, or core network 130, such as... Figure 1 As shown in Figure 4. Method 1100 may include additional boxes not shown, and / or some boxes shown may be omitted, and the scope of the invention is not limited thereto.
[0223] like Figure 11 As shown in block 1110, the first device can determine a set of elements representing a perceived target. Each element in the set of elements can have a geometric shape.
[0224] In some embodiments, the first device may be a terminal device. In some embodiments, the first device may be a wireless access network device. In some embodiments, the first device may be a core network device.
[0225] In some embodiments, the geometry can be a 2D shape. In some embodiments, the 2D shape can include a square, a circle, or a rectangle. Thus, the sensing target can be described using a simple 2D shape.
[0226] In some embodiments, the geometry can be a 3D shape. In some embodiments, the 3D shape can include a cube or a sphere. Thus, the perceived target can be described using a simple 3D shape.
[0227] In block 1120, the first device may send sensing information of the sensing target to the second device. The sensing information includes location information of the element set. In some embodiments, the second device may be a terminal device. In some embodiments, the second device may be a wireless access network device. In some embodiments, the second device may be a core network device.
[0228] In some embodiments, the location information may include first location information of elements in the element set, and the first location information may include 2D or 3D coordinates of a point associated with the element. This allows for the representation of the element's location information. In some embodiments, the point associated with the element may include the geometric center of the element. This optimizes the representation of the element's location information.
[0229] In some embodiments, the perceived information may include a set of values organized according to their attributes. Thus, a format representing the perceived information can be specified.
[0230] In some embodiments, the element set may include two or more elements, and the two or more elements may have the same shape. This allows for a simplified and efficient provision of an element-based representation of the perceived target. In some embodiments where the two or more elements are arranged at equal intervals in one direction, the positional information of the element set may include the positional information of one of the two or more elements and the number of the two or more elements. This further reduces the transmission overhead of the perceived information.
[0231] In some embodiments, the sensing information may further include at least one of the following: the orientation information of the element set; and the size information of the element set. This allows for a more accurate representation of the sensing information of the target.
[0232] In some embodiments, the element set may include two or more elements, and the two or more elements may have the same orientation. In some embodiments, the orientation information of the element set may include the orientation information of one of the two or more elements. This saves on the transmission overhead of the orientation information of the element set.
[0233] In some embodiments, the element set may include two or more elements, and the two or more elements may have different orientations. In some embodiments, the orientation information of the element set may include the orientation information of each of the two or more elements. Thus, the orientation information of the element set can be displayed.
[0234] In some embodiments, the orientation information of the elements in the element set may include: the 2D normal vector or rotation angle of the element relative to the axis of the 2D coordinate system; or the 3D normal vector or rotation angle of the element relative to the axis of the 3D coordinate system. Thus, the orientation information of the element set can be represented.
[0235] In some embodiments, the element set may include two or more elements, and the two or more elements may have the same size. In some embodiments, the size information of the element set may include the size information of one of the two or more elements. This saves on the transmission overhead of the element set size information.
[0236] In some embodiments, the element set may include two or more elements. In some embodiments, the size information of the element set may include the size information of each of the two or more elements. Thus, the size information of the element set can be provided explicitly.
[0237] In some embodiments, the size information of the elements in the element set may include the scaling factor of the elements. Thus, the scaling factors of different base elements may be the same or different.
[0238] In some embodiments, the first device may send information to the second device supporting the representation of the sensing target by the element set; and receive from the second device an instruction indicating the representation of the sensing target by the element set. Thus, the capability for element-based representation and the instruction for element-based representation can be exchanged.
[0239] In some embodiments, the first device may receive information enabling or disabling the representation of the perceived target by the element set. Thus, element-based representation can be enabled or disabled in real time.
[0240] In some embodiments, the first device may receive from the second device a first set of parameters associated with the representation of the sensing target by the set of elements. This allows the device to configure relevant parameters for the element-based representation. In some embodiments, the first device may send to the second device a second set of parameters associated with the representation of the sensing target by the set of elements. This allows the device to determine and indicate relevant parameters for the element-based representation.
[0241] In some embodiments, the first parameter set or the second parameter set may indicate at least one of the following: the shape of the elements in the element set; the size of the elements; the coordinate system used for the position information; the number or maximum number of elements in a single transmission; the precision of the position information; the format representing the position information; whether rotation is applied to the elements; the precision of the orientation information of the elements; the format representing the orientation information; the value range of the orientation information; whether a scaling factor is applied to the elements; the value range of the scaling factor; the precision of the scaling factor; the format representing the scaling factor; whether compression is applied to the perceived information; the compression method; and one or more compression parameters of the compression. Thus, relevant parameters for the element-based representation can be specified.
[0242] Using method 1100, the sensing target can be described using a set of geometric shapes, and a coarse and generalized description of the sensing information can be provided. Therefore, the computational complexity and power consumption on the device can be reduced, and the transmission overhead for exchanging sensing information can be significantly reduced.
[0243] Figure 12 A flowchart illustrating an exemplary communication method 1200 implemented on a second device according to some embodiments of the present invention is shown. For example, method 1200 can be executed on a device in ED 110, network node 170, or core network 130, such as... Figure 1 As shown in Figure 4. Method 1200 may include additional boxes not shown, and / or some boxes shown may be omitted, and the scope of the invention is not limited thereto.
[0244] like Figure 12 As shown in box 1210, the second device can receive sensing information of a sensing target from the first device. The sensing information includes positional information of a set of elements. The set of elements represents the sensing target, and each element in the set has a geometric shape.
[0245] In some embodiments, the first device may be a terminal device. In some embodiments, the first device may be a wireless access network device. In some embodiments, the first device may be a core network device.
[0246] In some embodiments, the second device may be a terminal device. In some embodiments, the second device may be a wireless access network device. In some embodiments, the second device may be a core network device.
[0247] In box 1220, the second device can determine the sensing target based on the sensing information.
[0248] In some embodiments, the location information may include first location information of elements in the element set, and the first location information may include 2D or 3D coordinates of a point associated with the element. This allows the location information of elements to be received. In some embodiments, the point associated with the element may include the geometric center of the element. This allows for optimization of the representation of the element's location information.
[0249] In some embodiments, the geometry can be a 2D shape. In some embodiments, the 2D shape can include a square, a circle, or a rectangle. Thus, the sensing target can be described using a simple 2D shape.
[0250] In some embodiments, the geometry can be a 3D shape. In some embodiments, the 3D shape can include a cube or a sphere. Thus, the perceived target can be described using a simple 3D shape.
[0251] In some embodiments, the perceived information may include a set of values organized according to their attributes. Thus, a format representing the perceived information can be specified.
[0252] In some embodiments, the element set may include two or more elements, and the two or more elements may have the same shape. This allows for the reception of element-based representations of the perceived target in a simplified and efficient manner. In some embodiments where the two or more elements are arranged at equal intervals in one direction, the positional information of the element set may include the positional information of one of the two or more elements and the number of the two or more elements. This further reduces the transmission overhead of the perceived information.
[0253] In some embodiments, the sensing information may further include at least one of the following: the orientation information of the element set; and the size information of the element set. This allows for a more accurate representation of the sensing information of the target.
[0254] In some embodiments, the element set may include two or more elements, and the two or more elements may have the same orientation. In some embodiments, the orientation information of the element set may include the orientation information of one of the two or more elements. This saves on the transmission overhead of the orientation information of the element set.
[0255] In some embodiments, the element set may include two or more elements, and the two or more elements may have different orientations. In some embodiments, the orientation information of the element set may include the orientation information of each of the two or more elements. Thus, the orientation information of the element set can be displayed.
[0256] In some embodiments, the orientation information of the elements in the element set may include: the 2D normal vector or rotation angle of the element relative to the axis of the 2D coordinate system; or the 3D normal vector or rotation angle of the element relative to the axis of the 3D coordinate system. Thus, the orientation information of the element set can be received.
[0257] In some embodiments, the element set may include two or more elements, and the two or more elements may have the same size. In some embodiments, the size information of the element set may include the size information of one of the two or more elements. This saves on the transmission overhead of the element set size information.
[0258] In some embodiments, the element set may include two or more elements. In some embodiments, the size information of the element set may include the size information of each of the two or more elements. Thus, the size information of the element set can be displayed and received.
[0259] In some embodiments, the size information of the elements in the element set may include the scaling factor of the elements. Thus, the scaling factors of different base elements may be the same or different.
[0260] In some embodiments, the second device may receive information from the first device supporting the representation of the sensing target by the element set; and send an instruction to the first device instructing the representation of the sensing target by the element set. Thus, it is possible to receive information regarding the capability of element-based representation and to send an instruction regarding element-based representation.
[0261] In some embodiments, the second device may send information to the first device to enable or disable the representation of the perceived target by the element set. This facilitates the real-time enabling or disabling of element-based representation.
[0262] In some embodiments, the second device may send a first set of parameters associated with the representation of the sensing target by the set of elements. This allows the device to configure parameters related to the element-based representation. In some embodiments, the second device may receive a second set of parameters associated with the representation of the sensing target by the set of elements. This allows the device to receive parameters related to the element-based representation.
[0263] In some embodiments, the first parameter set or the second parameter set may indicate at least one of the following: the shape of the elements in the element set; the size of the elements; the coordinate system used for the position information; the number or maximum number of elements in a single transmission; the precision of the position information; the format representing the position information; whether rotation is applied to the elements; the precision of the orientation information of the elements; the format representing the orientation information; the value range of the orientation information; whether a scaling factor is applied to the elements; the value range of the scaling factor; the precision of the scaling factor; the format representing the scaling factor; whether compression is applied to the perceived information; the compression method; and one or more compression parameters of the compression. Thus, relevant parameters for the element-based representation can be specified.
[0264] Method 1200 allows for the description of a sensing target using a set of geometric shapes, and enables the reception of a coarse and generalized description of the sensing information. Therefore, it reduces computational complexity and power consumption on the device, and significantly lowers the transmission overhead for exchanging sensing information.
[0265] The operations of methods 1100 and 1200 correspond to the combination Figure 6 The process described above will not be repeated here for the sake of brevity.
[0266] Corresponding to the above communication method, embodiments of the present invention provide a communication device implemented on a first device and a second device. The following will refer to... Figure 13 and Figure 14 Describe these devices.
[0267] Figure 13 A simplified block diagram of an exemplary communication device 1300 implemented on a first device according to some embodiments of the present invention is shown. For example, device 1300 may be implemented as an ED 110 or a network node 170 or a device in a core network 130, such as... Figure 1 As shown in Figure 4, it can also be implemented as part of the device in ED 110, network node 170, or core network 130. The device 1300 may include additional boxes not shown, and / or some boxes shown may be omitted, and the scope of the invention is not limited thereto.
[0268] like Figure 13 As shown, the device 1300 may include: a processing module 1310 (also referred to herein as a first processing module); and a transmitting module 1320 (also referred to herein as a first transmitting module). The processing module 1310 may be used to determine a set of elements representing a sensing target. Each element in the set of elements has a geometric shape. The transmitting module 1320 may be used to transmit sensing information of the sensing target. The sensing information includes positional information of the set of elements.
[0269] In some embodiments, the location information may include first location information of elements in the element set, and the first location information may include 2D or 3D coordinates of a point associated with the element. In some embodiments, the point associated with the element may include the geometric center of the element.
[0270] In some embodiments, the geometry can be a 2D shape. In some embodiments, the 2D shape can include a square, a circle, or a rectangle. In some embodiments, the geometry can be a 3D shape. In some embodiments, the 3D shape can include a cube or a sphere. Thus, the perceived target can be described using a simple 3D shape.
[0271] In some embodiments, the perceived information may include a set of values organized according to their attributes.
[0272] In some embodiments, the element set may include two or more elements, and the two or more elements may have the same shape. In some embodiments where the two or more elements are arranged at the same spacing in one direction, the position information of the element set may include the position information of one of the two or more elements and the number of the two or more elements.
[0273] In some embodiments, the sensing information may further include at least one of the following: the orientation information of the element set; the size information of the element set.
[0274] In some embodiments, the element set may include two or more elements, and the two or more elements have the same orientation. The orientation information of the element set may include the orientation information of one of the two or more elements.
[0275] In some embodiments, the element set may include two or more elements, and the two or more elements may have different orientations. In some embodiments, the orientation information of the element set may include the orientation information of each of the two or more elements.
[0276] In some embodiments, the orientation information of the elements in the element set may include: the 2D normal vector or rotation angle of the element relative to the axis of the 2D coordinate system; or the 3D normal vector or rotation angle of the element relative to the axis of the 3D coordinate system.
[0277] In some embodiments, the element set may include two or more elements, and the two or more elements may have the same size. In some embodiments, the size information of the element set may include the size information of one of the two or more elements.
[0278] In some embodiments, the element set may include two or more elements. In some embodiments, the size information of the element set may include the size information of each of the two or more elements.
[0279] In some embodiments, the size information of the elements in the element set may include the scaling factor of the elements.
[0280] In some embodiments, the apparatus 1300 may further include: a transmitting module (also referred to herein as a second transmitting module) for transmitting information supporting the representation of the sensing target by the element set; and a receiving module (also referred to herein as a first receiving module) for receiving an instruction indicating the representation of the sensing target by the element set.
[0281] In some embodiments, the apparatus 1300 may further include a receiving module (also referred to herein as a second receiving module) for receiving information that enables or disables the representation of the sensing target by the element set.
[0282] In some embodiments, the apparatus 1300 may further include: a receiving module (also referred to herein as a third receiving module) for receiving a first set of parameters associated with the representation of the sensing target by the set of elements; or a sending module (also referred to herein as a third sending module) for sending a second set of parameters associated with the representation of the sensing target by the set of elements.
[0283] In some embodiments, the first parameter set or the second parameter set may indicate at least one of the following: the shape of the elements in the element set; the size of the elements; the coordinate system used for the location information; the number or maximum number of elements in a single transmission; the precision of the location information; the format representing the location information; whether rotation is applied to the elements; the precision of the orientation information of the elements; the format representing the orientation information; the value range of the orientation information; whether a scaling factor is applied to the elements; the value range of the scaling factor; the precision of the scaling factor; the format representing the scaling factor; whether compression is applied to the perceived information; the compression method of the compression; and one or more compression parameters of the compression.
[0284] Figure 14A simplified block diagram of an exemplary communication device 1400 implemented on a second device according to some embodiments of the present invention is shown. For example, device 1400 may be implemented as an ED 110, a network node 170, or a device in a core network 130, such as... Figure 1 As shown in Figure 4, it can also be implemented as part of the device in ED 110, network node 170, or core network 130. The device 900 may include additional boxes not shown, and / or some boxes shown may be omitted, and the scope of the invention is not limited thereto.
[0285] like Figure 14 As shown, the device 1400 may include: a receiving module 1410 (also referred to herein as a fourth receiving module); and a processing module 1420 (also referred to herein as a second processing module). The receiving module 1410 can be used to receive sensing information of a sensing target. The sensing information includes location information of an element set. The processing module 1420 can be used to determine the sensing target based on the sensing information.
[0286] In some embodiments, the location information may include first location information of elements in the element set, and the first location information may include 2D or 3D coordinates of a point associated with the element. In some embodiments, the point associated with the element may include the geometric center of the element.
[0287] In some embodiments, the geometry may be a 2D shape. In some embodiments, the 2D shape may include a square, a circle, or a rectangle. In some embodiments, the geometry may be a 3D shape. In some embodiments, the 3D shape may include a cube or a sphere.
[0288] In some embodiments, the perceived information may include a set of values organized according to their attributes.
[0289] In some embodiments, the element set may include two or more elements, and the two or more elements may have the same shape.
[0290] In some embodiments where the two or more elements are arranged at the same spacing in one direction, the position information of the element set may include the position information of one of the two or more elements and the number of the two or more elements.
[0291] In some embodiments, the sensing information may further include at least one of the following: the orientation information of the element set; the size information of the element set.
[0292] In some embodiments, the element set may include two or more elements, and the two or more elements have the same orientation. In some embodiments, the orientation information of the element set may include the orientation information of one of the two or more elements.
[0293] In some embodiments, the element set may include two or more elements, and the two or more elements have different orientations. The orientation information of the element set may include the orientation information of each of the two or more elements.
[0294] In some embodiments, the orientation information of the elements in the element set may include: the 2D normal vector or rotation angle of the element relative to the axis of the 2D coordinate system; or the 3D normal vector or rotation angle of the element relative to the axis of the 3D coordinate system.
[0295] In some embodiments, the element set may include two or more elements, and the two or more elements may have the same size. In some embodiments, the size information of the element set may include the size information of one of the two or more elements.
[0296] In some embodiments, the element set may include two or more elements. In some embodiments, the size information of the element set may include the size information of each of the two or more elements.
[0297] In some embodiments, the size information of the elements in the element set may include the scaling factor of the elements.
[0298] In some embodiments, the apparatus 1400 may further include: a receiving module (also referred to herein as a fifth receiving module) for receiving information supporting the representation of the sensing target by the element set; and a sending module (also referred to herein as a fourth sending module) for sending an indication indicating the representation of the sensing target by the element set.
[0299] In some embodiments, the apparatus 1400 may further include a transmitting module (also referred to herein as a fifth transmitting module) for transmitting information that enables or disables the representation of the sensing target by the element set.
[0300] In some embodiments, the apparatus 1400 may further include a transmitting module (also referred to herein as a sixth transmitting module) for transmitting a first set of parameters associated with the representation of the sensing target by the set of elements. In some embodiments, the apparatus 1400 may further include a receiving module (also referred herein as a sixth receiving module) for receiving a second set of parameters associated with the representation of the sensing target by the set of elements.
[0301] In some embodiments, the first parameter set or the second parameter set may indicate at least one of the following: the shape of the elements in the element set; the size of the elements; the coordinate system used for the position information; the number or maximum number of elements in a single transmission; the precision of the position information; the format representing the position information; whether rotation is applied to the elements; the precision of the orientation information of the elements; the format representing the orientation information; the value range of the orientation information; whether a scaling factor is applied to the elements; the value range of the scaling factor; the precision of the scaling factor; the format representing the scaling factor; whether compression is applied to the perceived information; the compression method; and one or more compression parameters of the compression. Thus, relevant parameters for the element-based representation can be specified.
[0302] Other details of apparatus 1300 and 1400 are similar to those described for methods 1100 and 1200, and therefore will not be repeated here for the sake of brevity.
[0303] This invention encompasses a variety of embodiments, including not only method embodiments but also other embodiments, such as apparatus embodiments and embodiments relating to non-transitory computer-readable storage media. Embodiments may be combined, alone or in combination, with the features disclosed herein.
[0304] Although illustrative embodiments have been mentioned, the invention is not limited thereto. Various modifications and combinations of these illustrative embodiments, as well as other embodiments of the invention, will become apparent to those skilled in the art upon reference to this description.
[0305] Additionally or alternatively, features disclosed herein in the context of any particular embodiment may be implemented in other embodiments. For example, method embodiments may be implemented in apparatus, system, and / or computer program product embodiments. Furthermore, although embodiments are described primarily in the context of methods and apparatus, other implementations are contemplated, for example, as instructions stored on one or more non-transitory computer-readable media. Such media may store programs or instructions to perform any of the various methods consistent with the present invention.
[0306] When these functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of this application, the parts that contribute to the prior art, or some of these technical solutions can be implemented in the form of software products. The software product is stored in the storage medium and includes several instructions to instruct a computer device (which may be a personal computer, server, or network device) to execute all or some of the steps described in the embodiments of this application. The aforementioned storage medium may include any medium capable of storing program code, such as a universal serial bus (USB) flash drive, a removable hard disk, read-only memory (ROM), random access memory (RAM), a magnetic disk, or an optical disk.
[0307] The above description is merely a specific implementation of this application and is not intended to limit the scope of protection of this application. Any modifications or substitutions that are readily conceived by those skilled in the art within the scope of the technology disclosed in this application shall fall within the scope of protection of this application. Therefore, the scope of protection of this application shall be determined by the scope of the claims.
Claims
1. A communication method, characterized in that, include: Determine a set of elements representing a perceived target, wherein each element in the set has a geometric shape; as well as The sensing information of the sensing target is sent, wherein the sensing information includes the location information of the element set.
2. The method according to claim 1, characterized in that, The set of elements includes two or more elements, and the two or more elements have the same shape.
3. The method according to claim 2, characterized in that, The two or more elements are arranged at the same spacing in one direction, and the position information of the element set includes the position information of one of the two or more elements and the number of the two or more elements.
4. The method according to any one of claims 1 to 3, characterized in that, The location information includes first location information of elements in the element set, and the first location information includes two-dimensional (2D) coordinates or three-dimensional (3D) coordinates of points associated with the element.
5. The method according to claim 4, characterized in that, The point associated with the element includes the geometric center of the element.
6. The method according to any one of claims 1 to 5, characterized in that, The geometry is a two-dimensional (2D) shape, including squares, circles, or rectangles; or The geometry is a three-dimensional (3D) shape, including a cube or a sphere.
7. The method according to any one of claims 1 to 6, characterized in that, The perceived information includes a set of values, which are organized according to their attributes.
8. The method according to any one of claims 1 to 7, characterized in that, The perceived information also includes at least one of the following: The location information of the element set; and The size information of the element set.
9. The method according to claim 8, characterized in that, The element set includes two or more elements, and the two or more elements have the same orientation; the orientation information of the element set includes the orientation information of one of the two or more elements.
10. The method according to claim 8, characterized in that, The element set includes two or more elements, and the orientation information of the element set includes the orientation information of each of the two or more elements.
11. The method according to any one of claims 8 to 10, characterized in that, The location information of the elements in the element set includes: The 2D normal vector or rotation angle of the element relative to the axis of the 2D coordinate system; or The element's 3D normal vector or rotation angle relative to the axis of the 3D coordinate system.
12. The method according to claim 8, characterized in that, The element set includes two or more elements, and the two or more elements have the same size; the size information of the element set includes the size information of one of the two or more elements.
13. The method according to claim 8, characterized in that, The element set includes two or more elements, and the size information of the element set includes the size information of each of the two or more elements.
14. The method according to claim 8, 12 or 13, characterized in that, The size information of the elements in the element set includes the scaling factor of the elements.
15. The method according to any one of claims 1 to 14, characterized in that, Also includes: Send information supporting the representation of the perceived target by the element set; as well as Receive an instruction indicating the representation of the perceived target by the set of elements.
16. The method according to any one of claims 1 to 15, characterized in that, Also includes: Receive information to enable or disable the representation of the perceived target by the element set.
17. The method according to any one of claims 1 to 16, characterized in that, Also includes: Receive a first set of parameters associated with the representation of the perceived target by the set of elements; or Send a second set of parameters associated with the representation of the perceived target by the set of elements.
18. The method according to claim 17, characterized in that, The first parameter set or the second parameter set indicates at least one of the following: The shapes of the elements in the set of elements; The size of the element; Coordinate system used for the location information; The number or maximum number of elements in a single transmission; The accuracy of the location information; The format representing the location information; Whether to apply a rotation to the element; The accuracy of the orientation information of the element; The format representing the location information; The value range of the location information; Whether to apply a scaling factor to the element; The range of values for the scaling factor; The precision of the scaling factor; The format representing the scaling factor; Whether to apply compression to the perceived information; The compression method described above; as well as The compression refers to one or more compression parameters.
19. A communication method, characterized in that, include: Receive sensing information of a sensing target, wherein the sensing information includes position information of an element set, the element set representing the sensing target, and each element in the element set having a geometric shape; The sensing target is determined based on the sensing information.
20. The method according to claim 19, characterized in that, The set of elements includes two or more elements, and the two or more elements have the same shape.
21. The method according to claim 20, characterized in that, The two or more elements are arranged at the same spacing in one direction, and the position information of the element set includes the position information of one of the two or more elements and the number of the two or more elements.
22. The method according to any one of claims 19 to 21, characterized in that, The location information includes first location information of elements in the element set, and the first location information includes two-dimensional (2D) coordinates or three-dimensional (3D) coordinates of points associated with the element.
23. The method according to claim 22, characterized in that, The point associated with the element includes the geometric center of the element.
24. The method according to any one of claims 19 to 23, characterized in that, The geometry is a two-dimensional (2D) shape, including squares, circles, or rectangles; or The geometry is a three-dimensional (3D) shape, including a cube or a sphere.
25. The method according to any one of claims 19 to 24, characterized in that, The perceived information includes a set of values, which are organized according to their attributes.
26. The method according to any one of claims 19 to 25, characterized in that, The perceived information also includes at least one of the following: The location information of the element set; and The size information of the element set.
27. The method according to claim 26, characterized in that, The element set includes two or more elements, and the two or more elements have the same orientation; the orientation information of the element set includes the orientation information of one of the two or more elements.
28. The method according to claim 26, characterized in that, The element set includes two or more elements, and the orientation information of the element set includes the orientation information of each of the two or more elements.
29. The method according to any one of claims 26 to 28, characterized in that, The location information of the elements in the element set includes: The 2D normal vector or rotation angle of the element relative to the axis of the 2D coordinate system; or The element's 3D normal vector or rotation angle relative to the axis of the 3D coordinate system.
30. The method according to claim 26, characterized in that, The element set includes two or more elements, and the two or more elements have the same size; the size information of the element set includes the size information of one of the two or more elements.
31. The method according to claim 26, characterized in that, The element set includes two or more elements, and the size information of the element set includes the size information of each of the two or more elements.
32. The method according to claim 26, 30 or 31, characterized in that, The size information of the elements in the element set includes the scaling factor of the elements.
33. The method according to any one of claims 19 to 32, characterized in that, Also includes: Receive information supporting the representation of the perceived target by the element set; as well as Send an instruction indicating the representation of the perceived target by the set of elements.
34. The method according to any one of claims 19 to 33, characterized in that, Also includes: Send information to enable or disable the representation of the perceived target by the element set.
35. The method according to any one of claims 19 to 34, characterized in that, Also includes: Send a first set of parameters associated with the representation of the perceived target by the set of elements; or Receive a second set of parameters associated with the representation of the perceived target by the set of elements.
36. The method according to claim 35, characterized in that, The first parameter set or the second parameter set indicates at least one of the following: The shapes of the elements in the set of elements; The size of the element; Coordinate system used for the location information; The number or maximum number of elements in a single transmission; The accuracy of the location information; The format representing the location information; Whether to apply a rotation to the element; The accuracy of the orientation information of the element; The format representing the location information; The value range of the location information; Whether to apply a scaling factor to the element; The range of values for the scaling factor; The precision of the scaling factor; The format representing the scaling factor; Whether to apply compression to the perceived information; The compression method described above; as well as The compression refers to one or more compression parameters.
37. A communication device, characterized in that, Used to perform the method according to any one of claims 1 to 18 or any one of claims 19 to 36.
38. The communication device according to claim 37, characterized in that, include: A processing module is used to determine a set of elements representing a perceived target, wherein each element in the set has a geometric shape; as well as The sending module is used to send the sensing information of the sensing target, wherein the sensing information includes the location information of the element set.
39. The communication device according to claim 37, characterized in that, include: A receiving module is used to receive sensing information of a sensing target, wherein the sensing information includes position information of an element set, the element set representing the sensing target, and each element in the element set having a geometric shape; as well as A processing module is used to determine the sensing target based on the sensing information.
40. The communication device according to claim 37, characterized in that, include: One or more processors are configured to determine a set of elements representing a perceived target, each element in the set having a geometric shape; as well as An interface circuit is used to send the sensing information of the sensing target, wherein the sensing information includes the location information of the element set.
41. The communication device according to claim 37, characterized in that, include: An interface circuit is used to receive sensing information of a sensing target, wherein the sensing information includes position information of an element set, the element set representing the sensing target, and each element in the element set having a geometric shape; as well as One or more processors are configured to determine the perceived target based on the perceived information.
42. The communication device according to claim 40 or 41, characterized in that, The interface circuit includes one or more transceivers.
43. An apparatus, characterized in that, include: One or more processors; as well as A memory storing instructions that, when executed by the one or more processors, cause the apparatus to perform the method according to any one of claims 1 to 18 or any one of claims 19 to 36.
44. A communication system, characterized in that, The communication system includes: a first communication device for performing the method according to any one of claims 1 to 18; and a second communication device for performing the method according to any one of claims 19 to 36.
45. A computer-readable storage medium, characterized in that, It stores instructions that, when executed by the device, cause the device to perform the method according to any one of claims 1 to 18 or any one of claims 19 to 36.
46. A computer program product storing instructions, characterized in that, When the instruction is executed, it causes the device to perform the method according to any one of claims 1 to 18 or any one of claims 19 to 36.
