Communication method, communication device, computer readable storage medium, and program product
By extracting and utilizing the topological features of point cloud data for compression and recovery, the problem of low point cloud data reporting efficiency in multi-device joint perception is solved, and efficient point cloud data transmission and recovery is achieved.
Patent Information
- Application Number
- PCT/CN2023/097554
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-31
- Publication Date
- 2024-12-05
AI Technical Summary
In a multi-device joint perception scenario, a single device requires multiple angle and position transformations to obtain global point cloud information, resulting in large perception overhead and large amount of data when point cloud data is reported, affecting communication efficiency.
By extracting the topological features of point cloud data for compression, compressing, reducing the amount of reported data, and restoring the original point cloud data through topological features at the receiving end, improving accuracy. The specific methods include converting point cloud data into a two-dimensional matrix, extracting persistent homotopicity, selecting value information that meets preset conditions, generating compressed data, and recovering point cloud data at the receiving end by interpolation, etc.
It effectively reduces the amount of data reported by point cloud data, improves the accuracy of recovery of point cloud data by the receiver, reduces the perceived overhead of terminal devices, and improves communication efficiency.
Smart Images

Figure CN2023097554_05122024_PF_FP_ABST
Abstract
Description
Communication method, communication device, computer-readable storage medium, and program product Technical Field
[0001] The present disclosure relates generally to the field of telecommunications, and more particularly to a communication method, a communication device, a computer-readable storage medium, and a computer program product. Background Art
[0002] Point cloud data can be used in a variety of application scenarios such as 3D imaging, environmental reconstruction, and target recognition. It is an important native data form for future communication perception scenarios. When a single terminal device perceives the surrounding environment, it can only obtain local point cloud signals due to angle and position limitations. In order to perform subsequent tasks such as environmental reconstruction and target recognition, it is usually necessary to obtain global information. Using a single device to obtain global information requires the single device to change its angle and position and perform multiple perceptions. Using multiple devices to jointly perceive the surrounding environment from different angles and positions can reduce the perception overhead of a single terminal device and adjust the key observation area according to the position of each device to obtain more accurate local perception information. In a multi-device joint perception scenario, the point cloud information perceived by each terminal device from multiple angles and multiple positions needs to be sent to the base station for information fusion.
[0003] Summary of the Invention
[0004] The present disclosure provides a communication method, a communication device, a computer-readable storage medium, and a computer program product for reducing the amount of reported point cloud data in a perception scene.
[0005] In a first aspect, a communication method is provided. The method is performed by a first communication device, such as a terminal device or a chip used in the terminal device. In this method, the first communication device extracts topological features from point cloud data; compresses the point cloud data based on the topological features to obtain compressed point cloud data; and outputs the compressed data. This method reduces the amount of data required to report point cloud data.
[0006] In some implementations, extracting topological features from point cloud data includes: determining persistent coherence of point cloud data values; and obtaining first value information based on point cloud data values that satisfy a predetermined condition for persistent coherence, where the first value information is used to express the topological features. This method compresses the point cloud data and reduces the amount of data reported.
[0007] In some implementations, a persistence graph is generated based on point cloud data, and the persistence graph is used to obtain the persistent homology of the values of the point cloud data, thereby improving the efficiency of obtaining the persistent homology.
[0008] In some implementations, compressing the point cloud data includes generating compressed data based on first value information and first position vector information corresponding to the first value information, wherein the first position vector information includes information indicating a position corresponding to the first value information in the point cloud data. In this manner, a receiving end of the point cloud data can more accurately restore the point cloud data.
[0009] In some implementations, the first value information is associated with a first portion of the point cloud data, and the compressed data further includes second position vector information associated with a second portion of the point cloud data, the second position vector information including information indicating a position in the point cloud data corresponding to the second value information associated with the second portion of the point cloud data. This reduces the amount of data required for reporting the point cloud and improves the accuracy of the original point cloud when the point cloud receiver recovers the compressed data.
[0010] In some implementations, the first portion of the point cloud data and the second portion of the point cloud data constitute the point cloud data. Since the compressed data is obtained based on the components of the point cloud data, it is beneficial for the party receiving the point cloud to more accurately restore the point cloud data.
[0011] In some implementations, selecting point cloud data values whose persistent coherence satisfies a predetermined condition includes: receiving a topology information configuration indicating a ratio of topological features to be retained; and selecting, based on the ratio, multiple point cloud data values with the greatest persistent coherence, wherein the number of values satisfies the ratio. In this manner, topological features are extracted according to the configuration, and a receiving end of the point cloud data can more accurately restore the point cloud data.
[0012] In some implementations, obtaining persistent homology includes converting the point cloud data into a two-dimensional point cloud matrix, where elements in the two-dimensional point cloud matrix correspond to values in the point cloud data; and obtaining persistent homology based on the element values and positions in the two-dimensional point cloud matrix. In this manner, topological features can be extracted more easily.
[0013] In some implementations, obtaining persistent homology includes: generating a point cloud data vector based on element values and element positions in a two-dimensional point cloud matrix; and obtaining persistent homology based on the values of the point cloud data and their corresponding positions in the point cloud data vector, thereby facilitating the extraction of topological features.
[0014] In some implementations, the indication information in the first position vector information is used to indicate the position corresponding to the first value information in the point cloud data vector, thereby transmitting the overall information of the point cloud data and achieving data compression.
[0015] In some implementations, it also includes one of the following: obtaining a preset coordinate indication mode configuration; generating a coordinate indication mode configuration and sending the coordinate indication mode configuration; or receiving a coordinate indication mode configuration, wherein: the coordinate indication mode configuration indicates the arrangement order of the point cloud data values when the two-dimensional point cloud matrix is used to generate a point cloud data vector.
[0016] Some implementations also include sending or receiving a quantization configuration, where the quantization configuration indicates how the coordinate values of the point cloud data are quantized, with the Z-axis coordinate values of the quantized point cloud data in the three-dimensional coordinate system being the element values in the two-dimensional point cloud matrix. The quantization configuration can be performed on either the sender or receiver of the point cloud data, providing flexibility.
[0017] In some implementations, the 3D coordinate system is a 3D global coordinate system, and the method further includes: sending or receiving a conversion mode configuration; wherein the conversion mode configuration indicates whether coordinate system mapping is performed on the point cloud data from the 3D global coordinate system to the 3D local coordinate system. In this manner, whether coordinate system mapping is performed can be determined based on the configuration, providing flexibility in implementation.
[0018] In some implementations, the point cloud data corresponds to a clustering plane, and the method of the first aspect further includes: clustering the input point cloud data set based on the distances between corresponding points in the point cloud and one or more clustering planes, to obtain point cloud data corresponding to the clustering planes, wherein the clustering plane corresponding to the point cloud data is the clustering plane with the shortest distance among the one or more clustering planes. This allows the geometric surface structure of the point cloud data to be fully utilized to segment the raw point cloud data, facilitating the extraction of topological features and compression of the point cloud data.
[0019] In some implementations, the method further includes: sending a clustering configuration for clustering the input point cloud dataset, thereby clustering the point cloud data according to the configuration.
[0020] In some implementations, determining the clustering planes includes: projecting the input point cloud dataset onto planes in a three-dimensional coordinate system; obtaining a projected convex hull point set based on edge information of the projected point cloud dataset onto the planes in the three-dimensional coordinate system; and determining the clustering planes based on candidate planes formed by multiple points in the projected convex hull point set. In this manner, clustering planes for clustering the point cloud data are accurately selected.
[0021] In some implementations, determining the clustering planes includes selecting one or more candidate planes as clustering planes from a plurality of candidate planes formed by a plurality of points in the projected convex hull point set based on the distribution of the input point cloud dataset in the candidate planes. Clustering planes for clustering the point cloud data can be accurately selected.
[0022] In some implementations, the method further includes: obtaining preset first configuration information; generating the first configuration information and sending the first configuration information; or receiving the first configuration information; wherein the first configuration information is used to configure at least one of the following: a compression method configuration, which indicates a method for compressing point cloud data; or an auxiliary information accuracy configuration, which indicates at least one of a compression boundary for compressing point cloud data and the number of bits in the mapping coordinate system. The configuration method is flexible.
[0023] In a second aspect, a communication method is provided. The beneficial effects can be found in the description of the first aspect and are not further elaborated here. The method is performed by a second communication device, such as a network device or a chip used in a network device. In this method, compressed point cloud data is received, where the compressed data includes first value information and first position vector information associated with the point cloud data; and point cloud data is obtained based on the first value information and the first position vector information.
[0024] In some implementations, the first value information and the first position vector information are associated with a first portion of the point cloud data, the compressed data also includes second position vector information associated with a second portion of the point cloud data, and obtaining the point cloud data includes: obtaining the point cloud data based on the first value information, the first position vector information, the second value information, and the second position vector information, wherein the second value information is associated with the second portion of the point cloud data and is determined based on the first value information, the first position vector information, and the second position vector information.
[0025] In some implementations, determining the second value information includes: generating a point cloud data vector based on the first value information and the first position vector information; generating a function curve based on the point cloud data vector; and determining the second value information in the function curve based on the second position vector information.
[0026] In some implementations, obtaining point cloud data includes: determining a position set of first value information and second value information in the two-dimensional point cloud matrix based on the arrangement order of point cloud data values in the point cloud data vector indicated in the coordinate indication mode configuration; determining the two-dimensional point cloud matrix based on the position set; and determining the point cloud data based on the element values and element positions in the two-dimensional point cloud matrix.
[0027] In some implementations, it also includes one of the following: obtaining a preset coordinate indication mode configuration; generating a coordinate indication mode configuration and sending the coordinate indication mode configuration; or receiving a coordinate indication mode configuration, wherein: the coordinate indication mode configuration indicates the arrangement order of the point cloud data values of the two-dimensional point cloud matrix in the point cloud data vector.
[0028] In some implementations, obtaining point cloud data includes: determining the point cloud data in a three-dimensional coordinate system based on the element values and element positions in the two-dimensional point cloud matrix, where the element values in the two-dimensional point cloud matrix are the Z-axis coordinate values of the quantized point cloud data in the three-dimensional coordinate system.
[0029] In some implementations, the three-dimensional coordinate system is a three-dimensional global coordinate system, and the method of the second aspect also includes one of the following: obtaining a preset conversion mode configuration; generating a conversion mode configuration and sending the conversion mode configuration; or receiving a conversion mode configuration; wherein: the conversion mode configuration indicates whether the point cloud data is mapped from a three-dimensional global coordinate system to a three-dimensional local coordinate system.
[0030] In some implementations, it also includes one of the following: obtaining a preset quantization configuration; generating a quantization configuration and sending the quantization configuration; or receiving a quantization configuration; wherein: the quantization configuration indicates a method for quantizing the coordinate values of the point cloud data, and after the quantized coordinate values are dequantized, the corresponding point cloud data has a Z-axis coordinate value in the three-dimensional coordinate system.
[0031] In some implementations, the point cloud data corresponds to clustering planes, and the method of the second aspect further includes: receiving a clustering configuration for clustering the input point cloud dataset, the clustering configuration being used to obtain the input point cloud dataset based on the point cloud data corresponding to each clustering plane.
[0032] In some implementations, it also includes one of the following: obtaining preset first configuration information; generating first configuration information, and sending the first configuration information; or receiving first configuration information; wherein: the first configuration information is used to configure at least one of the following: compression method configuration, used to indicate the method for compressing point cloud data; or auxiliary information accuracy configuration, used to indicate at least one of the compression boundary for compressing point cloud data and the number of bits of the mapping coordinate system.
[0033] In some implementations, the method further includes: sending a topology information configuration, where the topology information configuration indicates a proportion of a topology feature that is retained, and the topology feature is used to determine first value information associated with a first portion of the point cloud data from the point cloud data.
[0034] In a third aspect, a first communication device is provided. The beneficial effects can be found in the description of the first aspect and will not be repeated here. The device has the function of implementing the behavior in the method example of the first aspect. The function can be implemented by hardware or by executing corresponding software through hardware. The hardware or software includes one or more modules corresponding to the above functions. In one possible design, the device includes: an extraction unit for extracting topological features from point cloud data; a compression unit for compressing point cloud data based on topological features to obtain compressed data of the point cloud data; and a sending unit for outputting compressed data.
[0035] In a fourth aspect, a second communication device is provided. The beneficial effects can be found in the description of the first aspect and will not be repeated here. The device has the function of implementing the behavior in the method example of the second aspect. The function can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions. In one possible design, it includes: a receiving unit for receiving compressed data of point cloud data, wherein the compressed data includes first value information and first position vector information associated with the point cloud data; a determining unit for obtaining point cloud data based on the first value information and the first position vector information.
[0036] In a fifth aspect, a communication device is provided, comprising: a processor, and a memory storing instructions, wherein when the instructions are executed by the processor, any method according to the first aspect and its implementation manner is executed.
[0037] In a sixth aspect, a communication device is provided, comprising: a processor, and a memory storing instructions, wherein when the instructions are executed by the processor, any method according to the second aspect and its implementation manner is executed.
[0038] In a seventh aspect, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores instructions, and when the instructions are executed, the methods executed by or in the above aspects are executed.
[0039] In an eighth aspect, a computer program product includes instructions, and when the instructions are executed by an electronic device, the method executed by or in the above aspects is executed.
[0040] In a ninth aspect, the present disclosure provides a chip system comprising a processor for implementing the functions of the methods of the above aspects. In one possible design, the chip system further comprises a memory for storing program instructions and / or data. The chip system may be composed of a chip or may include a chip and other discrete devices.
[0041] In a tenth aspect, the present disclosure further provides a communication system, comprising: a first communication device for executing the method of the first aspect, or a second communication device for executing the method of the second aspect. BRIEF DESCRIPTION OF THE DRAWINGS
[0042] FIG1A is a schematic diagram of a communication system according to some embodiments of the present disclosure.
[0043] FIG1B is a schematic diagram of a point cloud data compression scenario in some embodiments of the present disclosure.
[0044] FIG2 is a schematic diagram of a communication process according to some embodiments of the present disclosure.
[0045] FIG3 is a schematic diagram of a point cloud data compression process according to some embodiments of the present disclosure.
[0046] FIG4 is a schematic diagram of an original point cloud according to some embodiments of the present disclosure.
[0047] FIG5A is a schematic diagram of the projection of the original point cloud onto the yz-plane according to some embodiments of the present disclosure.
[0048] FIG5B is a schematic diagram of edge information of the projection plane of the original point cloud on the yz-plane according to some embodiments of the present disclosure.
[0049] FIG5C is a schematic diagram of the convex hull of the original point cloud projected onto the yz-plane according to some embodiments of the present disclosure.
[0050] FIG6 is a schematic diagram of a screening clustering plane according to some embodiments of the present disclosure.
[0051] FIG7 is a schematic diagram of a process for screening clustering planes according to some embodiments of the present disclosure.
[0052] FIG8 is a schematic diagram of a clustering plane according to some embodiments of the present disclosure.
[0053] FIG9 is a schematic diagram of a clustering plane of an original point cloud and its global coordinate system according to some embodiments of the present disclosure.
[0054] FIG10 is a schematic diagram of a clustering plane of an original point cloud and its mapping to a new coordinate system according to some embodiments of the present disclosure.
[0055] FIG11 is a schematic diagram of a 2D matrix A according to some embodiments of the present disclosure.
[0056] FIG. 12 is a diagram of matrix A after topological feature filtering in some embodiments of the present disclosure. f Schematic diagram of .
[0057] FIG13 is a schematic diagram of topological information analysis of a one-dimensional function according to some embodiments of the present disclosure.
[0058] FIG. 14 shows a 2D matrix constructed by interpolation in some embodiments of the present disclosure. Schematic diagram of .
[0059] FIG15 is a comparative display diagram of the original point cloud and the restored point cloud according to some embodiments of the present disclosure.
[0060] FIG16 is a schematic diagram of the signaling transmission process of some embodiments of the present disclosure.
[0061] FIG17 is a comparison diagram of simulation results of some embodiments of the present disclosure and Draco.
[0062] FIG18 is a flowchart of some embodiments of the present disclosure implemented at a first communication device.
[0063] FIG19 is a flowchart of some embodiments of the present disclosure implemented at a second communication device.
[0064] FIG20 is a schematic diagram showing the main components of an example device of a possible implementation method of an embodiment of the present disclosure.
[0065] FIG21 shows a simplified block diagram of an example device for one possible implementation of an embodiment of the present disclosure. DETAILED DESCRIPTION
[0066] The following describes embodiments of the present disclosure in more detail with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments described herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.
[0067] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, that is, "including but not limited to." The term "based on" should be understood as "based at least in part on." The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment." The terms "first," "second," etc. may refer to different or the same objects. Other explicit and implicit definitions may also be included below.
[0068] The embodiments of the present disclosure may be implemented according to any appropriate communication protocol, including but not limited to cellular communication protocols such as fourth generation (4G), fifth generation (5G) and future communication protocols (e.g., sixth generation (6G)), wireless local area network communication protocols such as Institute of Electrical and Electronics Engineers (IEEE) 802.11 (e.g., Wi-Fi 7, Wi-Fi 8), and / or any other protocol currently known or developed in the future.
[0069] The technical solutions of the embodiments of the present disclosure are applied to communication systems that comply with any appropriate communication protocols, such as: General Packet Radio Service (GPRS), Global System for Mobile Communications (GSM), Enhanced Data rate for GSM Evolution (EDGE), Universal Mobile Telecommunications Service (UMTS), Long Term Evolution (LTE) system, Wideband Code Division Multiple Access (WCDMA), Code Division Multiple Access 2000 (CDMA2000), Time Division-Synchronization Code Division Multiple Access (TD-SCDMA), Frequency Division Duplex (FDD), Time Division Duplex (TDD), fifth generation (5G) systems (e.g., New Radio (NR)) and future communication systems (e.g., sixth generation (6G) systems), etc. Specifically, the technical solution of the embodiment of the present disclosure can be used in any network with a pre-scheduling mode.
[0070] For illustrative purposes, the embodiments of the present disclosure are described below in the context of a 5G communication system in 3GPP. However, it should be understood that the embodiments of the present disclosure are not limited to this communication system, but can be applied to any communication system with similar problems, such as a wireless local area network (WLAN), a wired communication system, or other communication systems developed in the future.
[0071] The term "terminal" or "terminal device" used in this disclosure refers to any terminal device that can communicate with network devices or with each other by wire or wirelessly. Terminal devices may sometimes be referred to as User Equipment (UE). Terminal devices may be any type of mobile terminal, fixed terminal or portable terminal. Terminal devices may be various wireless communication devices with wireless communication capabilities. With the rise of Internet of Things (IOT) technology, more and more devices that did not previously have communication capabilities, such as but not limited to household appliances, vehicles, tools and equipment, service equipment and service facilities, have begun to obtain wireless communication capabilities by configuring wireless communication units, so that they can access wireless communication networks and accept remote control. Such devices have wireless communication capabilities because they are configured with wireless communication units, and therefore also fall into the category of wireless communication devices. As an example, the terminal device may include a mobile cellular phone, a cordless phone, a mobile terminal (MT), a mobile station, a mobile device, a wireless terminal, a handheld device, a client, a subscription station, a portable subscription station, an Internet node, a communicator, a desktop computer, a laptop computer, a notebook computer, a tablet computer, a personal communication system device, a personal navigation device, a personal digital assistant (PDA), a wireless data card, a wireless modem (modulator demodulator, Modem), a positioning device, a radio broadcast receiver, an e-book device, a gaming device, an Internet of Things (IoT) device, a vehicle-mounted device, an aircraft, a virtual reality (VR) device, an augmented reality (AR) device, a wearable device (e.g., a smart watch), a terminal device in a 5G network or any terminal device in an evolved public land mobile network (PLMN), other devices that can be used for communication, or any combination thereof. The embodiments of the present disclosure are not limited to this.
[0072] The term "network node" or "network device" used in this disclosure refers to an entity or node that can be used to communicate with a terminal device, for example, an access network device. An access network device can be a device deployed in a wireless access network to provide wireless communication functions for a mobile terminal, for example, a radio access network (RAN) network device. Access network devices may include various types of base stations. Base stations are used to provide wireless access services to terminal devices. Specifically, each base station corresponds to a service coverage area, and terminal devices entering the area can communicate with the base station through wireless signals to receive wireless access services provided by the base station. There may be overlap between the service coverage areas of base stations, and a terminal device in the overlapping area can receive wireless signals from multiple base stations, so that the terminal device can be served by multiple base stations at the same time. Depending on the size of the service coverage area provided, the access network device may include a macro base station providing macro cells, a micro base station for providing micro cells, a micro base station for providing micro cells, and a micro base station for providing femto cells. In addition, access network equipment may also include various forms of relay stations, access points, remote radio units (RRUs), radio heads (RHs), remote radio heads (RRHs), and so on. In systems using different wireless access technologies, the names of access network equipment may vary. For example, in Long Term Evolution (LTE) networks, it is called an evolved NodeB (eNB or eNodeB), in 3G networks, it is called a NodeB (NB), and in 5G networks, it may be called a gNodeB (gNB) or NR NodeB (NR NB), etc. In some scenarios, access network equipment may include a central unit (CU) and / or a distributed unit (DU). The CU and DU can be placed in different locations, for example: a remote DU placed in an area with high traffic volume and a CU placed in a central computer room. Alternatively, the CU and DU can be placed in the same computer room. The CU and DU can also be different components under the same rack. For the convenience of description, in the subsequent embodiments of the present disclosure, the above-mentioned devices that provide wireless communication functions for mobile terminals are collectively referred to as network devices. The device may also refer to a chip or module in a mobile terminal or access network device that implements related wireless communication functions, and the embodiments of the present disclosure are no longer specifically limited.
[0073] In a multi-device joint perception scenario, the point cloud information perceived by each terminal device from multiple angles and multiple locations needs to be sent to the base station for information fusion. The point cloud data exchanged between the device and the central node will occupy a large amount of air interface communication resources, so it is necessary to propose a more efficient point cloud compression transmission method. The embodiment of the present disclosure fully exploits the geometric surface structure contained in the point cloud data itself, and proposes a point cloud compression scheme assisted by geometric structure and topological features. In order to make the purpose, technical solutions and advantages of the present disclosure clearer, the present disclosure will be further described in detail with reference to the accompanying drawings. The specific operating methods, functional descriptions, etc. in the method embodiment can also be applied to the device embodiment or system embodiment.
[0074] As shown in FIG1A , system 100 includes a terminal device 110 and a network device 120. Terminal device 110 can communicate with network device 120. For example, terminal device 110 can compress sensed point cloud data and send the compressed point cloud data to network device 120. Network device 120 can be a network device under various network systems, for example, network device 120 can be any device with wireless transceiver capabilities. These include, but are not limited to, traditional macro base stations (eNBs) in traditional UMTS / LTE (Universal Mobile Telecommunications System / Long Term Evolution) wireless communication systems; micro base stations (eNBs) in Heterogeneous Network (Heterogeneous Network) scenarios; baseband processing units (BBUs) and remote radio units (RRUs) in distributed base station scenarios; and baseband pools (BBU pools and RRUs) in Cloud Radio Access Network (CRAN) scenarios. In future wireless communication systems, these may include gNBs, 3GPP-derived base stations, access nodes in WiFi systems, wireless relay nodes, wireless backhaul nodes, and the like. Base stations may include macro base stations, micro base stations, pico base stations, small cells, relay stations, or balloon base stations. Network device 120 may also include servers, wearable devices, or in-vehicle devices. The terminal device 110 may also be various user communication devices, such as an in-vehicle communication module or other embedded communication module, a mobile phone, a tablet computer, a computer with wireless transceiver function, a virtual reality (VR) terminal device, an augmented reality (AR) terminal device, a wireless terminal in industrial control, a tactile terminal device, an in-vehicle terminal device, a wireless terminal in unmanned driving, a wireless terminal in remote medical, a wireless terminal in a smart grid, a wireless terminal in transportation safety, a wireless terminal in a smart city, a wireless terminal in a smart home, a wearable terminal device, and the like.
[0075] Figure 1B is a schematic diagram of a point cloud data compression scenario in some embodiments of the present disclosure. As shown in Figure 1B, point cloud data in outdoor communication perception scenarios are generally generated by buildings with simple geometric surface features, and the data itself often also presents distinct geometric features, which can be used to assist in point cloud data compression. The vehicle-mounted terminal devices 130 and 140 in Figure 1B can be used as examples of terminal devices 110, and the network device 120 can be a base station. In this example, multiple devices (for example, two vehicle-mounted terminal devices 130 and 140 are exemplarily shown in Figure 1B) are used to jointly perceive the surrounding environment from different angles and different positions, such as perceiving the point cloud of the building 150, to obtain original point cloud data.
[0076] FIG2 is a schematic diagram of a communication process according to some embodiments of the present disclosure. In the embodiments of the present disclosure, the first communication device 201 may be, for example, the terminal device 110, and the second communication device 202 may be, for example, the network device 120. As shown in FIG2 , in process 200, at the first communication device 201, topological features are extracted (210) from point cloud data. In some embodiments, the point cloud data may correspond to a clustering plane, i.e., point cloud data obtained by clustering the input point cloud data set, with each clustered point cloud data type corresponding to a clustering plane.
[0077] To achieve a better clustering effect, the embodiments of the present disclosure first determine clustering planes. Specifically, the first communication device 201 may project the input point cloud dataset onto planes in a three-dimensional coordinate system, obtain a projected convex hull point set based on edge information of the point cloud data projections in the planes in the three-dimensional coordinate system, and determine clustering planes based on candidate planes formed by multiple points in the projected convex hull point set. In some examples, when determining clustering planes based on candidate planes formed by multiple points in the projected convex hull point set, the first communication device 201 may select one or more candidate planes as clustering planes from multiple candidate planes formed by multiple points in the projected convex hull point set based on the distribution of the input point cloud dataset in the candidate planes. During the clustering process, the first communication device 201 may cluster the input point cloud dataset based on the distances between corresponding points in the point cloud and one or more clustering planes, obtaining point cloud data corresponding to the clustering planes, wherein the clustering plane corresponding to the point cloud data is the clustering plane with the shortest distance among the one or more clustering planes.
[0078] After clustering is completed, the first communication device 201 can send a clustering configuration for clustering the input point cloud data set to the second communication device 202, so that the second communication device 202 can restore the original point cloud data from the clustered point cloud data according to the clustering configuration. The original point cloud data corresponding to the first communication device 201 is the input point cloud data set.
[0079] Referring to Figure 2 , the specific implementation process for extracting topological features will be described below. The first communication device 201 can obtain the persistent coherence of the values of the point cloud data and, based on the point cloud data values whose persistent coherence satisfies a preset condition, obtain first value information. The first value information is used to express the topological features. To obtain the persistent coherence of the values of the point cloud data, the first communication device 201 can generate a persistence graph based on the point cloud data. The persistence graph can be used to analyze the persistent coherence of the values of the point cloud data. Based on the persistence graph, the first communication device 201 can select the point cloud data values whose persistent coherence satisfies the preset condition to obtain the first value information. In some embodiments, the first value information is associated with the first portion of the point cloud data.
[0080] To obtain persistent homology, the first communication device 201 may convert the point cloud data into a two-dimensional point cloud matrix, wherein the elements in the two-dimensional point cloud matrix correspond to the values of the point cloud data. The first communication device 201 obtains persistent homology based on the element values and element positions in the two-dimensional point cloud matrix. For example, the point cloud data may be first converted into a two-dimensional point cloud matrix using the above method, and then a persistence graph may be generated based on the element values and element positions in the two-dimensional point cloud matrix, and persistent homology may be obtained using the persistence graph. In some embodiments, the first communication device 201 may first generate a point cloud data vector based on the element values and element positions in the two-dimensional point cloud matrix, and then obtain persistent homology based on the value of the point cloud data and its corresponding position in the point cloud data vector. As an example, a persistence graph may be generated using the above steps, and then persistent homology may be obtained using the persistence graph.
[0081] In some embodiments, the point cloud data vector may be generated specifically by generating the point cloud data vector based on the arrangement order of the point cloud data values indicated in the coordinate indication mode configuration in the two-dimensional point cloud matrix.
[0082] In some examples, the order in which the point cloud data values are arranged in a two-dimensional point cloud matrix can be indicated by a coordinate indication mode configuration. In other words, the coordinate indication mode configuration can indicate the order in which the point cloud data values are arranged when the two-dimensional point cloud matrix is used to generate a point cloud data vector. For example, the elements in each row and column of the two-dimensional point cloud matrix are arranged vertically, horizontally, or in a zigzag manner to obtain the point cloud data vector. In some embodiments, the first communication device 201 can obtain a preset coordinate indication mode configuration, or generate and transmit the coordinate indication mode configuration, or receive the coordinate indication mode configuration. Specifically, in some examples, the coordinate indication mode configuration is preset by a protocol, i.e., it is preset and both the first communication device 201 and the second communication device 202 are aware of the preset coordinate indication mode configuration and can be obtained when used. In other examples, the coordinate indication mode configuration can be generated by the first communication device 201 and transmitted to the second communication device 202. In still other embodiments, the coordinate indication mode configuration can be generated by the second communication device 202, and the first communication device 201 can receive the coordinate indication mode configuration from the second communication device 202.
[0083] Before being converted into a two-dimensional point cloud matrix, the point cloud data may be located in a three-dimensional coordinate system. The three-dimensional coordinate system may be converted into another three-dimensional coordinate system through coordinate system mapping. To distinguish the two three-dimensional coordinate systems, the three-dimensional coordinate system that has not been coordinate system mapped here may be referred to as a three-dimensional global coordinate system. The mapped three-dimensional coordinate system is referred to as a three-dimensional local coordinate system. In some examples, a coordinate system mapping operation may be performed during the process of converting the point cloud data into a two-dimensional point cloud matrix. Specifically, the first communication device 201 may map the point cloud data from a three-dimensional global coordinate system to a three-dimensional local coordinate system, wherein the numerical range corresponding to the Z axis of the point cloud data in the three-dimensional local coordinate system is smaller than the numerical range corresponding to the Z axis in the three-dimensional global coordinate system, and then convert the point cloud data in the three-dimensional local coordinate system into a two-dimensional point cloud matrix.
[0084] In some examples, whether to perform coordinate system mapping from a 3D global coordinate system to a 3D local coordinate system can be indicated by a conversion mode configuration. For example, if the conversion mode configuration indicates that coordinate system mapping is to be performed, the operation of mapping the point cloud data from the 3D global coordinate system to the 3D local coordinate system is performed; otherwise, the operation is not performed. The conversion mode configuration can be generated by the first communication device 201 and sent to the second communication device 202, so that the second communication device 202 can receive the conversion mode configuration. Alternatively, the conversion mode configuration can be generated by the second communication device 202, sent by the second communication device 202, and received by the first communication device 201 from the second communication device 202. In the example of performing coordinate system mapping, the first communication device 201 can send the center point and at least two coordinate axis information of the 3D local coordinate system to the second communication device 202. In some embodiments, the conversion mode configuration can be preset, for example, pre-set via a protocol.
[0085] The first communication device 201 can convert point cloud data in a three-dimensional local coordinate system into a two-dimensional point cloud matrix. Specifically, the first communication device 201 can quantize the coordinate values of the point cloud data in the three-dimensional local coordinate system based on a quantization configuration, and obtain a two-dimensional point cloud matrix based on the point cloud data after the coordinate values are quantized. In these embodiments, the element values corresponding to the values of the point cloud data in the two-dimensional point cloud matrix are specifically the Z-axis coordinate values of the quantized point cloud data in the three-dimensional local coordinate system. In other embodiments, the above-mentioned coordinate system mapping may not be performed. In such embodiments, the Z-axis coordinate values of the quantized point cloud data in the three-dimensional global coordinate system are the element values in the two-dimensional point cloud matrix.
[0086] The aforementioned quantization configuration indicates how the coordinate values of the point cloud data are quantized. It can be generated by the first communication device 201, which can then send the quantization configuration to the second communication device 202, so that the second communication device 202 can receive the quantization configuration. Alternatively, it can be generated by the second communication device 202, which can then send the quantization configuration to the first communication device 201, and the first communication device 201 can receive the quantization configuration from the second communication device 202. Alternatively, the quantization configuration can be preset, for example, pre-set via a protocol.
[0087] Selecting point cloud data values whose persistent coherence satisfies a preset condition may specifically include: receiving a topology information configuration, the topology information configuration indicating a ratio of topological features to be retained; and first communication device 201 may, based on the ratio, select multiple values from the point cloud data values with the greatest persistent coherence, the number of which satisfies the ratio. In some embodiments, first communication device 201 may receive the topology information configuration from second communication device 202, where the topology information configuration is generated by second communication device 202 and transmitted to first communication device 201.
[0088] After extracting the topological features in the above manner, the first communication device 201 may compress the point cloud data based on the topological features ( 220 ) to obtain compressed data 205 of the point cloud data.
[0089] In some embodiments, in the process of compressing point cloud data, specifically, the first communication device 201 can generate compressed data 205 based on the first value information and the first position vector information corresponding to the first value information, wherein: the first position vector information includes indication information of the position corresponding to the first value information in the point cloud data.
[0090] In other embodiments, the first value information is associated with the first portion of the point cloud data, and the compressed data 205 may further include second position vector information associated with the second portion of the point cloud data, the second position vector information including information indicating the position in the point cloud data corresponding to the second value information associated with the second portion of the point cloud data. Specifically, in the process of compressing the point cloud data, the first communication device 201 may generate the compressed data 205 based on the first value information associated with the first portion of the point cloud data, the first position vector information associated with the first portion of the point cloud data, and the second position vector information associated with the second portion of the point cloud data, wherein, with reference to the above, the first position vector information includes information indicating the position in the point cloud data corresponding to the first value information, and the second position vector information includes information indicating the position in the point cloud data corresponding to the second value information. In some embodiments, the first portion of the point cloud data and the second portion of the point cloud data constitute the point cloud data.
[0091] As described above, the first communication device 201 can generate a point cloud data vector based on the element values and element positions in the two-dimensional point cloud matrix. In such an example, the indication information in the first position vector information can be specifically used to indicate the corresponding position of the first value information in the point cloud data vector.
[0092] The first communication device 201 sends the compressed data 205 obtained in the above manner to the second communication device 202 .
[0093] During the aforementioned interaction between the first communication device 201 and the second communication device 202, in some embodiments, the first communication device 201 may also obtain, generate, or receive one or more other configuration information, referred to as first configuration information. In some examples, the first communication device 201 may generate the first configuration information and send it to the second communication device 202. This first configuration information may be used to configure, for example, a compression method, which indicates how the point cloud data is compressed, or an auxiliary information accuracy configuration, which indicates the compression boundary and the number of bits used in the mapping coordinate system for the point cloud data. In other examples, the first configuration information may be generated by the second communication device 202, sent to the first communication device 201, and received by the first communication device 201 from the second communication device 202. In yet other examples, the first configuration information for both the first communication device 201 and the second communication device 202 is pre-set first configuration information, such as that specified by a protocol.
[0094] The first communication device 201 may output compressed data 205, for example, the first communication device sends (230) the compressed data 205 to the second communication device. At the second communication device 202, the compressed data 205 of the point cloud data is received (240) from the first communication device 201. The second communication device 202 may obtain (250) the point cloud data based on the compressed data 205.
[0095] In some embodiments, the compressed data 205 includes first value information and first position vector information associated with the point cloud data. In such an embodiment, step 250 may be specifically implemented as follows: the second communication device 202 obtains the point cloud data based on the first value information and the first position vector information.
[0096] In other embodiments, the first value information and the first position vector information of the compressed data 205 are associated with the first portion of the point cloud data, and the compressed data 205 also includes the second position vector information associated with the second portion of the point cloud data. In other words, the compressed data 205 includes (i) the first value information and the first position vector information associated with the first portion of the point cloud data, and (ii) the second position vector information associated with the second portion of the point cloud data. In such an embodiment, step 250 can be specifically implemented as follows: obtaining the point cloud data based on the first value information, the first position vector information, the second value information, and the second position vector information. The second value information is associated with the second portion of the point cloud data and is determined based on the first value information, the first position vector information, and the second position vector information. In other words, the second communication device 202 can determine (250) the second value information associated with the second portion of the point cloud data based on the first value information, the first position vector information, and the second position vector information.
[0097] To determine the second value information, the second communication device 202 may generate a point cloud data vector based on the first value information and the first position vector information, generate a function curve based on the point cloud data vector, and determine the second value information within the function curve based on the second position vector information. The second value information may be determined in a variety of ways, such as by interpolation. It should be noted that the embodiments of the present disclosure are not limited to the methods listed, and other suitable methods may also be used.
[0098] The process of the second communication device 202 obtaining point cloud data, specifically, in some examples, the second communication device 202 can determine the position set of the first value information and the second value information in the two-dimensional point cloud matrix based on the arrangement order of the point cloud data values in the point cloud data vector in the two-dimensional point cloud matrix, determine the two-dimensional point cloud matrix based on the position set, and then determine the point cloud data based on the element values and element positions in the two-dimensional point cloud matrix. As described above, the arrangement order can be indicated by the coordinate indication mode configuration, which can be generated by the first communication device 201 or the second communication device 202, or preset through a protocol, and the details will not be repeated here.
[0099] In some examples, during the process of acquiring point cloud data, the second communication device 202 may first determine the point cloud data in a three-dimensional local coordinate system based on the element values and element positions in the two-dimensional point cloud matrix, and then map the point cloud data in the three-dimensional local coordinate system to a three-dimensional global coordinate system, wherein the numerical range corresponding to the Z axis of the point cloud data in the three-dimensional local coordinate system is smaller than the numerical range corresponding to the Z axis in the three-dimensional global coordinate system. Referring to the above description, at the first communication device 201, if the conversion mode configuration indicates that coordinate system mapping is to be performed, the first communication device 201 performs an operation to map the point cloud data from the three-dimensional global coordinate system to the three-dimensional local coordinate system; otherwise, the mapping operation to the three-dimensional local coordinate system is not performed. Correspondingly, at the second communication device 202, if the conversion mode configuration indicates that coordinate system mapping is to be performed, the point cloud data in the three-dimensional local coordinate system is mapped to the three-dimensional global coordinate system based on the center point and at least two coordinate axis information of the three-dimensional local coordinate system transmitted by the first communication device 201; otherwise, the second communication device 202 also does not perform the mapping operation to the three-dimensional global coordinate system. For some embodiments in which coordinate system mapping is not performed, in the process of obtaining point cloud data, specifically, the second communication device 202 can determine the point cloud data in the three-dimensional coordinate system (here referring to the three-dimensional global coordinate system) based on the element values and element positions in the two-dimensional point cloud matrix, where the element values in the two-dimensional point cloud matrix are the Z-axis coordinate values of the quantized point cloud data in the three-dimensional global coordinate system.
[0100] With reference to some of the examples described above, at the first communication device 201, the coordinate values of the point cloud data in the three-dimensional local coordinate system are quantized, and then a two-dimensional point cloud matrix is obtained based on the point cloud data after the coordinate values are quantized. Accordingly, at the second communication device 202, a corresponding dequantization operation can be performed to restore the two-dimensional point cloud data to three-dimensional point cloud data. For example, the quantized coordinate values of the point cloud data can be determined based on the element values and element positions corresponding to the values of the point cloud data in the two-dimensional matrix, and then the quantized coordinate values are dequantized based on the quantization configuration to determine the point cloud data. After the quantized coordinate values are dequantized, they correspond to the Z-axis coordinate values of the point cloud data in the three-dimensional local coordinate system. In other examples, no coordinate system mapping is performed at the first communication device 201, and then at the second communication device, the dequantization obtains the Z-axis coordinate values of the point cloud data in the three-dimensional global coordinate system.
[0101] In addition, in some examples, at the first communication device 201, the point cloud data used in the operation of extracting topological features from point cloud data can be point cloud data after clustering corresponding to the clustering plane. Then, at the second communication device 202, the point cloud data obtained by the second communication device 202 through the above steps also corresponds to the clustering plane accordingly. In order to obtain the original point cloud data, the second communication device 202 can receive a clustering configuration for clustering the input point cloud data set from the first communication device 201. The clustering configuration is used for the second communication device 202 to obtain the input point cloud data set, that is, the original point cloud data, based on the point cloud data corresponding to each clustering plane.
[0102] FIG3 is a schematic diagram of the point cloud data compression process of some embodiments of the present disclosure. Because the structure of the local point cloud cannot directly extract topological features, it is necessary to segment and cluster the original point cloud using the inherent geometric surface structure features of the building that generates the point cloud information before the topological feature screening. As shown in FIG3 , the geometric information of the point cloud is used as an auxiliary to perform surface clustering and coordinate system conversion on the point cloud data. The results of each surface clustering are converted into 2D data by plane projection of the 3D point cloud data in a new local coordinate system. The part representing important topological information is extracted from the 2D data and further compressed. In this example, the 3D perception data can be the 3D perception data obtained by the vehicle-mounted terminal device 130. In process 300, specifically, 3D (three-dimensional) perception data is converted (310) to perform point cloud surface clustering (320), that is, point cloud data is clustered into point cloud data corresponding to cluster planes respectively. Taking multiple cluster planes as an example, the point cloud data corresponding to each cluster plane can be subjected to coordinate system transformation (330), that is, the global coordinate system where the point cloud data is located is converted into a local coordinate system to obtain point cloud data in the local coordinate system. The point cloud data in the local coordinate system is projected onto a plane (340) to obtain (350) point cloud data in the form of 2D (two-dimensional) data, such as a two-dimensional point cloud information matrix. Topological information is extracted from the point cloud data in the form of two-dimensional data (360) to perform data compression (370). It is necessary to compress and report the information expressing the topological features and the necessary position information. Specifically, the data compression process can generate compressed information of the point cloud data, such as a compressed bit stream, by combining the point cloud data with topological information and the related position information, as well as the position information of the point cloud data without topological information. The compressed bit stream is sent (380) to the network device 120 (e.g., a base station). After extracting the topology information, the data can be divided into three parts: the first part is the sparse matrix element values, which can be compressed using entropy coding, such as arithmetic coding. The second part is the position vector corresponding to the element value of the first part. The third part is the position vector in the 2D data that contains the point cloud projection and does not belong to the second part. The position vectors of the second and third parts can be differentially calculated and then compressed using entropy coding.
[0103] The embodiments of the present disclosure can be used in future wireless communication systems with sensing capabilities, such as next-generation cellular systems and short-range wireless communication systems (e.g., Wi-Fi and UWB), and can be widely applied to terminal devices 110 or network-side devices 120 in future wireless communication scenarios. With reference to Figures 2 and 3 above, the detailed process of the embodiments of the present disclosure will be further described below.
[0104] In step 1, point cloud data segmentation and face clustering based on geometric features. The buildings that generate point cloud data in the perception scene are usually composed of simple geometric planes. Any three non-collinear points can define a plane. Usually, it is only necessary to find a few points on the edge of the geometric surface to help locate the geometric surface in the point cloud data. These point clouds that depict the geometric surfaces of the point cloud data constitute the convex hull (Convex Hull, abbreviated as Convhull) of the point clouds of each geometric surface. Depending on the angle, the elements of the convex hull cannot be identified on the projection of a certain plane. It is necessary to project the xy-, xz-, and yz-planes separately and calculate the corresponding convex hulls.
[0105] Specifically, the original point cloud is projected onto the xy-, xz-, and yz-planes. Taking the projection onto the yz-plane as an example, Figure 4 is the original point cloud, Figure 5A is the projection of the original point cloud onto the yz-plane, and Figure 5B further illustrates the edge information of the projection plane based on Figure 5A, with the edge information being marked with a gray star “☆”. Figure 5C further illustrates the convex hull of the projection plane based on Figure 5B, with the convex hull being marked with a black cross “×”. First, each plane is projected to find the edge information of the projection part, such as the part marked with a gray star “☆” in Figure 5B or Figure 5C. Then, based on the edge information, a set of points that can represent the convex hull of the projection is obtained, such as the part marked with a black “×” in Figure 5C. The convex hull S of the original point cloud is the set of convex hulls of the projections of each plane. Among the planes that can be represented by the points in the set of convex hulls obtained by projecting the three planes, candidate planes that can be used for clustering (i.e., candidate clustering planes) are screened out. For example, a plane can be determined from three points in the convex hull. However, if the three points are collinear, the plane cannot be determined and these three points cannot be used to determine a candidate plane. For another example, if two planes determined by two sets of points are the same plane (or the difference between the two planes is very small), the two planes can be considered coplanar, and only one of these planes can be retained. Using these criteria, some planes can be filtered out, resulting in a preliminary set of planes.
[0106] In some embodiments, due to the varying sizes of the geometric surface structures used to generate the point cloud information, the number of points clustered onto the candidate plane cannot be used as a criterion for further screening. That is, the candidate planes for clustering (i.e., clustering planes) cannot be effectively determined using only the above criteria. Therefore, further criteria may be set to determine the clustering planes. As shown in FIG6 , the points within circles 601 and 603 may be clustered onto the clustering plane represented by circle 605. In other words, the plane corresponding to circle 605 can be determined from the points within circles 601 and 603. Based on the geometric structure of the original point cloud, the candidate plane represented by circle 607 should be retained, while the candidate plane represented by circle 605 should be screened out. Because the correct candidate plane represented by circle 607 has a small geometric area for generating the point cloud information, the number of original point clouds distributed around the cluster of circle 607 is relatively small, and the number of point clouds on this candidate plane will be smaller than the number of point clouds within circles 601 and 603. Using the number of point clouds clustered onto the candidate plane as the basis for judging whether to retain the candidate plane, it is impossible to accurately screen out the candidate plane corresponding to circle 605 while retaining the candidate plane corresponding to circle 607. Therefore, other criteria are needed to further refine the candidate clustering planes. The process of further screening the clustering planes is shown in Figure 7. The candidate planes of the clustered point clouds are obtained (702), and the candidate planes of the clustered point clouds are projected onto the xy- / xz- / yz-plane (704). Under any projection, it is judged (706) whether the values in any dimension are only distributed at the two ends of the value range. For example, referring to Figure 6, the point clouds in circle 605 are distributed at the two ends of circle 605 (there is no point cloud distribution in other parts of circle 605), that is, the value range of the point cloud is located at the two ends of the dimension. Therefore, the candidate plane at circle 605 is a false candidate plane and should be filtered out instead of being used as a clustering plane. That is, if the result of the above judgment is yes, the candidate plane is judged to be a false candidate plane and is screened out from the candidate planes (708); if not, it is judged not to be a false plane and is retained in the candidate planes (710).
[0107] After filtering out some candidate planes using the methods of the above embodiments, the remaining candidate planes can be used as clustering planes. The clustering method can be to cluster the point cloud data according to the closest clustering plane, thereby obtaining point cloud data corresponding to each clustering plane. Specifically, the distance from the original point cloud to each candidate plane can be calculated. The point cloud is then clustered onto the closest plane based on the distance order.
[0108] After segmenting the original point cloud data based on geometric features and clustering the point cloud data corresponding to the clustering planes, as shown in FIG8 , the clustered point cloud data corresponding to the two clustering planes are calculated (point cloud data set a (a set of “×” in the figure), point cloud data set b (a set of “○” in the figure)). The terminal device 110 needs to dynamically report the clustering configuration after the point cloud segmentation to the base station. The clustering configuration may specifically include the number c indicating the clusters of the point cloud data, and may also include information on the local coordinate system corresponding to each cluster, such as the center point and two coordinate axes of the local coordinate system. The local coordinate system is obtained by coordinate system mapping (or coordinate system transformation) from the global coordinate system. The local coordinate system will be further introduced in step 2 below. The number of point cloud data clusters determines the number of local coordinate systems of the mapped point cloud and the number of 2D matrices A below.
[0109] Through the above step 1, the point cloud data generated by several different planes can be separated, which facilitates the subsequent compression operation of the clustered points in their respective local coordinate systems.
[0110] In step 2, the clustered point cloud data is transformed into a coordinate system and projected into 2D. Specifically, for each plane cluster point cluster obtained in step 1 (i.e., the clustered point cloud data corresponding to each clustering plane), the following operations are performed independently:
[0111] PCA (Principal Component Analysis) is used to calculate a new local coordinate system (or local coordinate system), and the terminal device 110 needs to report the relevant information of the local coordinate system to the base station. Specifically, all point clouds clustered to the plane are mapped to the new coordinate system. As shown in Figure 9, it is a clustering plane of the original point cloud and its global coordinate system (or global coordinate system). Figure 10 is a new local coordinate system mapped by coordinate system mapping. In the new coordinate system (local coordinate system), the value range of the z-axis will become smaller. The terminal device 110 needs to report to the base station at least the center point of the local coordinate system and the information of at least two coordinate axes, such as the position of the center point and the vectors corresponding to at least two coordinate axes. By performing coordinate system mapping and mapping the global coordinate system to the local coordinate system, the error caused by quantization can be reduced, which is beneficial to subsequent compression work.
[0112] By quantizing the x, y, and z axes in the new coordinate system, the 3D point cloud is stored in a 2D matrix (matrix A), as shown in Figure 11. Each element of matrix A contains at most one quantized point from the original point cloud, that is, the distance from the point to the clustering plane. Matrix A corresponds to a binary matrix B. Elements of A that do not contain point cloud information are 0, and otherwise are 1. The black dots in Figure 11 correspond to elements in matrix B that have a value of 1, and the white dots correspond to elements in matrix B that have a value of 0.
[0113] In step three, point filtering based on topological information is mainly based on the TSA (Topological Signal Analysis) method for each clustering plane to extract the topological features and corresponding location information of the point cloud data corresponding to the clustering plane, so as to screen the point cloud data based on the topological features and extract representative Persistent Homology (PH) as the topological feature of the data.
[0114] Specifically, we first extract the topological features of the point cloud information contained in the 2D matrix A in step 2. We filter out the position information in matrix A that can express the persistent homology that needs to be preserved and represent it with the PD position indicator set K. We use this set K to extract the corresponding matrix element values from matrix A. (n and m can be calculated from the quantization range and quantization step size), and the PD information indicates the set {A(k)} k∈K The PD information indicates that the set can express the topological characteristics of the matrix A. k∈K and K visualized as A f , as shown in Figure 12. The position indication information of other non-zero elements in B is represented by set K′, and K and K′ are complementary sets relative to the positions of non-zero elements in B.
[0115] The following specifically describes how TSA extracts the topological features of data based on the topological structure information expressed by PD. Persistent homology is a monomer complex constructed based on data, which describes the geometric structure of high-dimensional data in the topological space. For better visualization, this embodiment uses a simple one-dimensional function, such as the gray dotted lines in ①③ in Figure 13, to explain the process of extracting topological features using a one-dimensional monomer complex, that is, a line segment. It should be noted that the points where the gray dotted line (corresponding to the original function) and the solid line (corresponding to the reconstructed function) in Figure 13 coincide with each other are not shown because the dotted line is covered by the black solid line due to color reasons, not because the gray dotted line has no function value at these positions.
[0116] The persistent homology calculation results for the function in Figure 13(①) are visualized as the PD (Persistent Diagram) in Figure 13(②), and the persistent homology calculation results for the function in Figure 13(③) are visualized as the PD in Figure 13(④). TSA filters the data based on the persistence of the homology and selects the topological information (i.e., topological features) that need to be retained. The higher the proportion of topological features retained, the higher the accuracy of the reconstructed function. Based on the topological information displayed by the PD, when all topological structure information is retained, function values that are not related to the PD can be filtered out, as shown by the dashed "x" in Figure 13(①). This function value is not reflected in the PD information, indicating that it does not contain any topological structure information. The reconstructed function in Figure 13(①) is the function value and its position corresponding to the complete persistent homology information in Figure 13(②). Interpolation is used to reconstruct the function values corresponding to the positions of the gray crosses "×" in Figure 13(①). Therefore, the reconstructed function (solid line) and the original function (dashed line) have the same topological information, as shown in Figure 13(②). For function values that contain topological information and constitute homology, if only partial persistent homology is retained, the shorter-lasting homology features can be filtered out first. The reconstructed function corresponding to the black solid line in Figure 13(③) is the function value and its position corresponding to the persistent homology information in the black portion of Figure 13(④). Interpolation is used to reconstruct the function value corresponding to the position of the gray cross "×" in Figure 13(③). Therefore, the functions corresponding to the black and gray in Figure 13(③) only have partially identical PDs, as shown in Figure 13(④).
[0117] The longer a coherence persists, the more important it is. The persistence of coherence is a key condition for selecting function values with representative topological features. The function values that remain based on persistent coherence are a subset of the original function (the topological feature values and their positions). The receiver uses this subset to reconstruct its complement in the original function (indicated by the positions of the remaining function values in the original function).
[0118] Based on the above, in some embodiments, after the original point cloud is clustered, it is mapped to a new coordinate system corresponding to the clustering plane, which can narrow the value range of the z-axis and reduce quantization error. After converting the 3D point cloud in the new coordinate system into a 2D matrix data format, the key topological features can be extracted according to the following steps:
[0119] The coordinate system is defined by the center point coordinates (three real numbers) and two coordinate axis vectors (six real numbers). Specifically, one of two compression methods can be used: one method is to directly perform scalar quantization, and the number of quantization bits can be configured by the base station (dynamic indication or static configuration), or the terminal device 110 can determine the accuracy by itself and dynamically report it to the base station; the other method is to use floating point numbers (single precision, double precision or half precision).
[0120] The nature of the point cloud makes the generated 2D matrix A (see Figure 11) very sparse. To avoid wasting communication resources by transmitting the complete matrix A, we use the TSA method described above to extract topological features based on PD to further compress the matrix A. a) Extract the points that represent the topological information from the matrix A, record their position information, and represent them with the PD position indicator set K; b) The matrix element values corresponding to the extracted position set K are Use PD information to indicate the set {A(k)} k∈K c) Mark the positions of the matrix elements in the matrix A that are not selected but contain 3D point cloud information, recorded as the PD complement indicator set K′ (the complement of the non-zero element positions of the set K in the binary matrix B).
[0121] 2D matrices A and A before and after TSA information filtering based on persistent homology f See Figure 11 and Figure 12 respectively. f The point cloud information contained is a subset of A, and the terminal reports to base station A f And the information of PD complement indicator set K′:
[0122] A f Related data information may include: PD location indication set K, and PD information indication set {A(k)} k∈K .
[0123] Position indications K and K' are represented by marking them according to the 2D coordinate indication mode. For example, when the 2D coordinate indication mode is vertical, k = n(j-1) + i∈K. In some embodiments, the 2D coordinate indication mode can be represented by two bits: horizontal, vertical, or zigzag.
[0124] The terminal device 110 can dynamically report to the base station the PD location set K that expresses the topological characteristics, and report the matrix element values corresponding to the set K, that is, the PD information indication set {A(k)} k∈K , and also reports the PD complement indicator set K′.
[0125] The receiving end (eg, base station) obtains the above three pieces of information (PD position set K, PD information indication set {A(k)}) sent by the terminal device 110 in step 3. k∈K , PD complement indicator set K′) and then reconstruct the 2D data form matrix A of step 2. Further, based on the information of the reconstructed matrix A, the 3D point cloud data is restored by dequantization. The following takes the receiving end as an example to introduce the main process executed by the receiving end: the base station can use interpolation to reconstruct the element value at the K′ position. Then, the base station can determine the position of the 3D point cloud data in the corresponding row and column of the 2D matrix based on the position information indicated by K and K′, and visualize the result as a 2D matrix As shown in FIG14, the base station receives the data transmitted by the terminal device 110 in step 3. f The information in the 2D matrix is restored by interpolation. The base station dequantizes the received and reconstructed element values based on their row and column positions to restore the 3D point cloud data in the local coordinate system. The 3D point cloud data in the local coordinate system is mapped to the original 3D point cloud data in the global coordinate system. The comparison between the original point cloud and the restored point cloud is shown in Figure 15, where the original point cloud is represented by a circle "○" and the restored point cloud is represented by a cross "×".
[0126] The following describes the resource scheduling and signaling transmission process for point cloud data reporting by perception devices, for example, the device reporting criteria, resource scheduling, and signaling instruction process when used in cellular networks.
[0127] The configuration agreement between the terminal device 110 and the base station can be indicated by the base station to the terminal device 110, or reported by the terminal device 110 to the base station. In multiple rounds of interaction between the terminal device 110 and the base station, the corresponding configuration can be sent in each round, or it can be sent only in a certain round and the default configuration is adopted subsequently. The signaling transmission between the terminal device 110 and the base station can involve multiple configurations, such as topology information configuration, coordinate indication mode configuration, quantization configuration, conversion mode configuration, compression method configuration, auxiliary information accuracy configuration, etc. The signaling corresponding to the above-mentioned multiple configurations can be collectively referred to as compressed configuration signaling.
[0128] As shown in FIG16 , FIG16 is a schematic diagram of a signaling transmission process in some embodiments of the present disclosure, wherein the network device 120 in this example is a base station. As shown in FIG16 , in process 1600, in some embodiments, the terminal device 110 may send ( 1610 ) compression configuration signaling to the base station. Alternatively, in other embodiments, unlike step 1610 , the compression configuration signaling may be sent ( 1620 ) by the base station to the terminal device 110. In addition to exchanging compression configuration signaling between the terminal device 110 and the base station, the terminal device 110 may also send ( 1630 ) clustering information and compressed data corresponding to each cluster to the base station. As an example, the compression configuration signaling specifically includes signaling corresponding to the following configurations: conversion mode configuration (1 bit), used to specify whether to perform coordinate system mapping or not; 2D coordinate indication mode configuration (2 bits), for example, indicating that the 2D matrix is converted into a one-dimensional vector in a longitudinal / horizontal / zigzag manner; quantization method configuration (1 bit), used to indicate quantization in a uniform or non-uniform manner; compression method configuration (1 bit), used to indicate AC / NA (quantization only, no entropy coding) compression; auxiliary information accuracy configuration, used to indicate the compression boundary and the number of bits m of the specified coordinate system; topology information configuration: the retained topology feature ratio r (only for base station configuration).
[0129] The clustering information reported by the terminal device 110 to the base station and the compressed data of each cluster specifically include: the number of clusters c generated by the original point cloud data; and the compressed data related to each cluster. The compressed data related to each cluster includes: coordinate information related to the conversion mode configuration, wherein the information of the center point and the two coordinate axes is sent when the coordinate system mapping is specified, and when the coordinate system mapping is not specified, the coordinate information related to the conversion mode configuration is not sent. The compressed data related to each cluster may also include compressed information extracted based on TSA, including: PD position indication set K, PD information indication set {A(k)} k∈K , PD complement indicator set K'. If the coordinate system is configured to be quantized, each cluster-related compressed data can also specify the following information of the xyz axis in the new (original) coordinate system: uniform (non-uniform) quantization parameters: step size s (number of quantization intervals I and step size of each interval) ), and uniform (non-uniform) quantization boundary values: min and max (each quantization interval and )
[0130] FIG17 shows a comparison diagram of the simulation results of some embodiments of the present disclosure and Draco. Draco is a traditional open source algorithm for compressing point cloud data. In the new coordinate system, in the calculation of the 2D matrix A, the quantization accuracy of the x- and y-axes is 0.008, and the number of quantization bits of the z-axis is 3 to 6, as shown in the value of b in FIG17 . The curve corresponding to the b value in Draco is the 01 curve, and the curves corresponding to different b values in the embodiment of the present disclosure are 02, 03, 04 and 05 curves, respectively. When executing step three above in the embodiment of the present disclosure, only representative topological information is extracted, and the retained proportion gradually increases. The values of the black dotted lines are: 0.001, 0.001, 0.001, 0.005, 0.02, 0.03, 0.05, 0.05 from left to right. The calculation method of mse in the figure is mse=max(mse a ,mse b ), where mse a MSE from original point cloud to reconstructed point cloud, MSE b The mse of the reconstructed point cloud to the original point cloud.
[0131] The disclosed embodiment fully exploits the geometric surface structure contained in the point cloud data itself, and proposes a point cloud compression scheme assisted by geometric structure and topological features to better compress point cloud data in future perception scenarios, and realizes the use of the topological features of point cloud data to transmit the overall information of point cloud data, so as to reduce the amount of data reported by the terminal to the base station.
[0132] Figure 18 illustrates a flowchart implemented at a first communication device in some embodiments of the present disclosure. As shown in Figure 18 , in process 1800, at block 1810, topological features are extracted from point cloud data at the first communication device. At block 1820, the point cloud data is compressed based on the topological features to obtain compressed point cloud data. At block 1830, the compressed data is output. Outputting the compressed data can be accomplished in various ways. For example, in some examples, outputting the compressed data can specifically include sending the compressed data to a second communication device.
[0133] In some embodiments, extracting the topological features from the point cloud data specifically includes: obtaining persistent coherence of the point cloud data values, and obtaining first value information based on the point cloud data values whose persistent coherence satisfies a preset condition, wherein the first value information is used to express the topological features. In some embodiments, a persistence graph can be generated based on the point cloud data, and the persistence graph is used to obtain persistent coherence of the point cloud data values. Extracting the topological features from the point cloud data specifically includes: generating a persistence graph based on the point cloud data, and selecting, based on the persistence graph, point cloud data values whose persistent coherence satisfies a preset condition to obtain the first value information.
[0134] In some embodiments, compressing point cloud data includes: generating compressed data based on first value information and first position vector information corresponding to the first value information, wherein the first position vector information includes indication information of the position corresponding to the first value information in the point cloud data. In other embodiments, the first value information is associated with a first portion of the point cloud data, and the compressed data also includes second position vector information associated with a second portion of the point cloud data, and the second position vector information includes indication information of the position corresponding to the second value information associated with the second portion of the point cloud data in the point cloud data. Compressing point cloud data may specifically include: generating compressed data based on the first value information, the first position vector information associated with the first portion of the point cloud data, and the second position vector information associated with the second portion of the point cloud data. In some embodiments, the first portion of the point cloud data and the second portion of the point cloud data constitute the point cloud data.
[0135] In some embodiments, persistent homology is obtained. Specifically, point cloud data can be converted into a two-dimensional point cloud matrix, and the elements in the two-dimensional point cloud matrix correspond to the values of the point cloud data; and persistent homology is obtained based on the element values and element positions in the two-dimensional point cloud matrix.
[0136] In order to select the values of point cloud data whose persistent coherence meets preset conditions, the first communication device can receive a topology information configuration, which indicates the proportion of topological features retained. Based on the proportion, multiple values of the point cloud data with the largest persistent coherence are selected, and the number of values meets the proportion.
[0137] Specifically, persistent homology can be obtained by first generating a point cloud data vector based on element values and element positions in a two-dimensional point cloud matrix, and then obtaining persistent homology based on the values of the point cloud data and their corresponding positions in the point cloud data vector. In some examples, the indication information in the first position vector information is used to indicate the position corresponding to the first value information in the point cloud data vector.
[0138] The point cloud data vector may be generated specifically based on the arrangement order of the point cloud data values indicated in the coordinate indication mode configuration in the two-dimensional point cloud matrix.
[0139] In some embodiments, the first communication device may further generate a coordinate indication mode configuration and transmit the coordinate indication mode configuration, for example, by transmitting the coordinate indication mode configuration to the second communication device. In other embodiments, the first communication device may receive the coordinate indication mode configuration, for example, from the second communication device. In the above embodiments, the coordinate indication mode configuration may indicate the order in which the values of the point cloud data are arranged when the two-dimensional point cloud matrix is used to generate the point cloud data vector. In still other embodiments, the first communication device may obtain a preset coordinate indication mode configuration.
[0140] In some embodiments, the point cloud data may be located in a three-dimensional global coordinate system, and converting the point cloud data into a two-dimensional point cloud matrix may specifically include: mapping the point cloud data from the three-dimensional global coordinate system to a three-dimensional local coordinate system, wherein the numerical range corresponding to the Z axis of the point cloud data in the three-dimensional local coordinate system is smaller than the numerical range corresponding to the Z axis in the three-dimensional global coordinate system, and converting the point cloud data in the three-dimensional local coordinate system into a two-dimensional point cloud matrix. Converting the point cloud data in the three-dimensional local coordinate system into a two-dimensional point cloud matrix may specifically include: quantizing the coordinate values of the point cloud data in the three-dimensional local coordinate system based on a quantization configuration, and obtaining a two-dimensional point cloud matrix based on the point cloud data after the coordinate values are quantized, wherein the element values corresponding to the values of the point cloud data in the two-dimensional point cloud matrix are the Z axis coordinate values of the quantized point cloud data.
[0141] In some examples, the first communication device may generate a quantization configuration and transmit the quantization configuration, for example, to the second communication device. In other examples, the first communication device may receive the quantization configuration, for example, from the second communication device. The quantization configuration indicates how the coordinate values of the point cloud data are quantized.
[0142] In some embodiments, the Z-axis coordinate value of the quantized point cloud data in the three-dimensional coordinate system is the element value in the two-dimensional point cloud matrix. For examples in which coordinate system mapping is performed, the three-dimensional coordinate system can be a three-dimensional local coordinate system; for examples in which coordinate system mapping is not performed, the three-dimensional coordinate system can be a three-dimensional global coordinate system.
[0143] In some embodiments, the first communication device maps point cloud data from a 3D global coordinate system to a 3D local coordinate system when a conversion mode configuration indicates coordinate system mapping. The first communication device may generate a conversion mode configuration and transmit the conversion mode configuration, for example, to a second communication device. Alternatively, the first communication device may receive the conversion mode configuration, for example, from a second communication device. The conversion mode configuration indicates whether coordinate system mapping is performed on the point cloud data from a 3D global coordinate system to a 3D local coordinate system.
[0144] The first communication device may also send the center point and at least two coordinate axis information of the three-dimensional local coordinate system to the second communication device.
[0145] The point cloud data may correspond to a clustering plane. The first communication device may cluster the input point cloud dataset based on the distances between corresponding points in the point cloud and one or more clustering planes, thereby obtaining point cloud data corresponding to the clustering planes. The clustering plane corresponding to the point cloud data is the clustering plane with the shortest distance among the one or more clustering planes. Furthermore, the first communication device may also transmit (e.g., to the second communication device) a clustering configuration for clustering the input point cloud dataset.
[0146] Specifically, the clustering planes may be determined by projecting the input point cloud dataset onto planes in the three-dimensional coordinate system, obtaining a projected convex hull point set based on edge information of the projection of the point cloud data onto the planes in the three-dimensional coordinate system, and determining the clustering planes based on candidate planes formed by multiple points in the projected convex hull point set. In some examples, the first communication device may determine the clustering planes by selecting one or more candidate planes from multiple candidate planes formed by multiple points in the projected convex hull point set as the clustering planes based on the distribution of the input point cloud dataset onto the candidate planes.
[0147] In some embodiments, the first communication device may further generate first configuration information and send the first configuration information, for example, to the second communication device. Alternatively, the first communication device may receive (for example, from the second communication device) the first configuration information. The first configuration information is used to configure at least one of the following: a compression method configuration, which indicates a method for compressing point cloud data; or an auxiliary information accuracy configuration, which indicates at least one of a compression boundary for compressing point cloud data and the number of bits of a mapping coordinate system. Alternatively, the first communication device may obtain preset first configuration information.
[0148] Figure 19 illustrates a flowchart implemented at a second communication device in some embodiments of the present disclosure. As shown in Figure 19 , in process 1900, at block 1910, compressed point cloud data is received, where the compressed data includes first value information and first position vector information associated with the point cloud data. At block 1920, point cloud data is obtained based on the first value information and the first position vector information.
[0149] In some embodiments, the first value information and the first position vector information are associated with the first part of the point cloud data, the compressed data also includes second position vector information associated with the second part of the point cloud data, and obtaining the point cloud data can specifically include: obtaining the point cloud data based on the first value information, the first position vector information, the second value information and the second position vector information, wherein the second value information is associated with the second part of the point cloud data and is determined based on the first value information, the first position vector information and the second position vector information.
[0150] To determine the second value information, the second communication device may generate a point cloud data vector based on the first value information and the first position vector information, generate a function curve based on the point cloud data vector, and determine the second value information based on the second position vector information within the function curve. For example, the second value information may be determined by interpolation.
[0151] The second communication device may obtain point cloud data by determining a set of positions of the first value information and the second value information in the two-dimensional point cloud matrix based on an arrangement order of point cloud data values in the point cloud data vector in the two-dimensional point cloud matrix, determining the two-dimensional point cloud matrix based on the set of positions, and determining the point cloud data based on the element values and element positions in the two-dimensional point cloud matrix. In some examples, the arrangement order may be indicated by a coordinate indication mode configuration.
[0152] The second communication device may also generate a coordinate indication mode configuration and transmit the coordinate indication mode configuration, for example, to the first communication device. Alternatively, the second communication device may receive (for example, from the first communication device) the coordinate indication mode configuration. The aforementioned coordinate indication mode configuration indicates the order in which the values of the point cloud data are arranged when the two-dimensional point cloud matrix is used to generate the point cloud data vector. Alternatively, the second communication device may obtain a preset coordinate indication mode configuration.
[0153] In some embodiments, the second communication device obtains point cloud data. Specifically, this may include determining the point cloud data in a three-dimensional coordinate system based on element values and element positions in a two-dimensional point cloud matrix, where the element values in the two-dimensional point cloud matrix are the Z-axis coordinate values of the quantized point cloud data in the three-dimensional coordinate system. In some examples, the three-dimensional coordinate system is a three-dimensional global coordinate system, and the first communication device may obtain a preset conversion mode configuration, or generate and transmit the conversion mode configuration, or receive the conversion mode configuration. The conversion mode configuration indicates whether the point cloud data is mapped from a three-dimensional global coordinate system to a three-dimensional local coordinate system.
[0154] In some examples, for an embodiment of coordinate system mapping, in order to obtain point cloud data, the second communication device can first determine the point cloud data in the three-dimensional local coordinate system based on the element values and element positions in the two-dimensional point cloud matrix, and map the point cloud data in the three-dimensional local coordinate system to the three-dimensional global coordinate system, wherein the numerical range corresponding to the Z axis of the point cloud data in the three-dimensional local coordinate system is smaller than the numerical range corresponding to the Z axis in the three-dimensional global coordinate system.
[0155] In some embodiments, when a conversion mode configuration indicates coordinate system mapping, point cloud data in a three-dimensional local coordinate system can be mapped to a three-dimensional global coordinate system based on the center point and at least two coordinate axis information of the three-dimensional local coordinate system transmitted by the first communication device. A second communication device can generate a conversion mode configuration and transmit it to the first communication device. Alternatively, the second communication device can receive the conversion mode configuration from the first communication device. The conversion mode configuration is used to indicate whether coordinate system mapping should be performed.
[0156] In some embodiments, to obtain point cloud data, the second communication device may determine the quantized coordinate values of the point cloud data based on the element values and element positions corresponding to the values of the point cloud data in a two-dimensional matrix, and dequantize the quantized coordinate values based on the quantization configuration to determine the point cloud data. In some examples, the second communication device may generate a quantization configuration and transmit the quantization configuration, for example, to the first communication device. In other examples, the second communication device may receive the quantization configuration, for example, from the first communication device. In yet other examples, the second communication device may obtain a preset quantization configuration. The quantization configuration indicates how the coordinate values of the point cloud data are quantized. After dequantization, the quantized coordinate values correspond to the Z-axis coordinate values of the point cloud data in a three-dimensional coordinate system. For embodiments that perform coordinate system mapping, the three-dimensional coordinate system is a three-dimensional local coordinate system. For embodiments that do not perform coordinate system mapping, the three-dimensional coordinate system is a three-dimensional global coordinate system.
[0157] In some embodiments, the point cloud data may correspond to clustering planes. The second communication device may receive a clustering configuration for clustering the input point cloud dataset, for example, from the first communication device. The clustering configuration is used by the second communication device to obtain the input point cloud dataset based on the point cloud data corresponding to each clustering plane.
[0158] In some embodiments, the second communication device may further generate first configuration information and transmit the first configuration information, for example, transmitting the first configuration information to the first communication device. Alternatively, the second communication device may receive the first configuration information, for example, from the first communication device. Alternatively, the preset first configuration information is obtained from the first communication device. The first configuration information is used to configure at least one of the following: a compression method configuration, which indicates a method for compressing point cloud data; or an auxiliary information accuracy configuration, which indicates at least one of a compression boundary for compressing point cloud data and the number of bits of a mapping coordinate system.
[0159] The second communication device may also send a topology information configuration to the first communication device, where the topology information configuration indicates a proportion of topology features retained, and the topology features are used by the first communication device to determine first value information from the point cloud data.
[0160] Figure 20 is a schematic diagram of the main components of possible communication devices provided in an embodiment of the present disclosure. These communication devices can implement the functions of the first communication device or the second communication device in the above-mentioned method embodiment, and thus can also achieve the beneficial effects possessed by the above-mentioned method embodiment. In the embodiment of the present disclosure, for example, the network device 120 shown in Figure 1A as an example of the second communication device, the communication device can be, for example, the network device 120, or a module (such as a chip) applied to the network device 120.
[0161] Taking the example of a communication device implementing the functions of a second communication device, as shown in Figure 20, the communication device 2000 includes a receiving unit 2010 and a determining unit 2020. The communication device can be used to implement the functions of the second communication device in the method embodiment shown in Figure 19. In some embodiments, the receiving unit 2010 can be a receiver.
[0162] When the communication device 2000 is used to implement the function of the second communication device in the method embodiment shown in Figure 19 above, the receiving unit 2010 is used to receive compressed data of point cloud data from the first communication device, wherein the compressed data includes first value information and first position vector information associated with the point cloud data; the determination unit 2020 is used to obtain the point cloud data based on the first value information and the first position vector information.
[0163] The case where the communication device implements the function of the first communication device is similar to the above and will not be described in detail. In addition, for a more detailed description of the receiving unit 2010 and the determining unit 2020, reference can be made to the relevant description in the above method embodiment and will not be described here.
[0164] As shown in Figure 21, the communication device 2100 includes an interface circuit 2120. Optionally, it may also include a processor 2110. The processor 2110 and the interface circuit 2120 are coupled to each other. It will be appreciated that the interface circuit 2120 may be a transceiver or an input / output interface. Optionally, the communication device 2100 may also include a memory 2130 for storing instructions executed by the processor 2110, input data required by the processor 2110 to execute instructions, or data generated by the processor 2110 after executing instructions.
[0165] When the communication device 2100 is used to implement the method in the method embodiment of FIG18 , the interface circuit 2120 is used to perform the functions of the transmitting unit. When the communication device 2100 is used to implement the method in the method embodiment of FIG19 , the interface circuit 2120 is used to perform the functions of the receiving unit 2010.
[0166] When the aforementioned communication device is a chip applied to the terminal device 110, the terminal device chip implements the functions of the terminal device 110 according to the embodiment of the present disclosure. The terminal device chip receives information from other modules (such as a radio frequency module or antenna) in the terminal device 110, and the information may be sent by other terminal devices; or the terminal device chip sends information to other modules (such as a radio frequency module or antenna) in the terminal device 110, and the information is sent to other terminal devices.
[0167] It is understood that the processor in the embodiments of the present disclosure may be a central processing unit (CPU), or may be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field programmable gate arrays (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. The general-purpose processor may be a microprocessor or any conventional processor.
[0168] An embodiment of the present disclosure provides a communication system. The communication system may include the communication device involved in the embodiment shown in Figure 20 above, such as the terminal device 110 or the network device 120. Optionally, the terminal device 110 in the communication system may execute the communication method shown in Figure 18. The network device 120 in the communication system may execute the communication method shown in Figure 19. In other embodiments, the communication system may include a communication device 2100 that can execute the communication method shown in Figure 20.
[0169] The present disclosure also provides a circuit that can be coupled to a memory and can be used to execute the process related to the terminal device 110 or the network device 120 in any of the above method embodiments. The chip system may include the chip and may also include other components such as a memory or a transceiver.
[0170] It should be understood that the processor mentioned in the embodiments of the present disclosure may be a CPU, or may be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field programmable gate arrays (FPGAs) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor, etc.
[0171] It should also be understood that the memory mentioned in the embodiments of the present disclosure may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct rambus RAM (DR RAM).
[0172] It should be noted that when the processor is a general-purpose processor, DSP, ASIC, FPGA or other programmable logic device, discrete gate or transistor logic device, discrete hardware component, the memory (storage module) is integrated into the processor.
[0173] It should be noted that the memory described herein is intended to include, but not be limited to, these and any other suitable types of memory.
[0174] It should be understood that in the various embodiments of the present disclosure, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present disclosure.
[0175] Those skilled in the art will appreciate that the modules and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this disclosure.
[0176] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and modules described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.
[0177] In the several embodiments provided in the present disclosure, it should be understood that the disclosed communication methods and devices can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the modules is merely a logical function division. In actual implementation, there may be other division methods, such as multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or described can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.
[0178] The modules described as separate components may or may not be physically separate, and the components shown as modules may or may not be physical modules, that is, they may be located in one place or distributed across multiple network elements. Some or all of these elements may be selected to achieve the purpose of this embodiment according to actual needs.
[0179] In addition, each functional module in each embodiment of the present disclosure may be integrated into one processing module, or each module may exist physically separately, or two or more modules may be integrated into one module.
[0180] If this function is implemented in the form of a software function module and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present disclosure, or the part that makes the contribution, or part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device 120, etc.) to perform all or part of the steps of the method of each embodiment of the present disclosure. The aforementioned computer-readable storage medium can be any available medium that can be accessed by a computer. By way of example and not limitation, computer-readable media may include random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), compact disc read-only memory (CD-ROM), universal serial bus flash disk, mobile hard disk, or other optical disk storage, magnetic disk storage media or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and can be accessed by a computer.
[0181] As used herein, the term "including" and similar terms should be understood as open inclusion, i.e., "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The terms "first", "second", etc. can refer to different or the same objects and are only used to distinguish the objects referred to, and do not imply a specific spatial order, temporal order, order of importance, etc. of the objects referred to. In some embodiments, values, processes, selected items, determined items, devices, means, components, assemblies, etc. are referred to as "best", "lowest", "highest", "minimum", "maximum", etc. It should be understood that such descriptions are intended to indicate that a selection can be made from a number of available functional options, and that such a selection need not be better, lower, higher, smaller, larger, or otherwise preferred than other options in other aspects or all aspects. As used herein, the term "determine" can encompass a variety of actions. For example, "determine" can include calculating, computing, processing, deriving, investigating, searching (e.g., searching in a table, database, or another data structure), ascertaining, etc. Furthermore, "determining" may include receiving (eg, receiving information), accessing (eg, accessing data in a memory), etc. Furthermore, "determining" may include resolving, selecting, choosing, establishing, etc.
Claims
1. A communication method, comprising: Extracting topological features from point cloud data; Compressing the point cloud data based on the topological features to obtain compressed data of the point cloud data; as well as The compressed data is output.
2. The method according to claim 1, wherein extracting the topological features from the point cloud data comprises: Obtaining persistent homogeneity of values of the point cloud data; as well as Based on the values of the point cloud data whose persistent homology satisfies a preset condition, first value information is obtained, where the first value information is used to express the topological feature. 3 . The method according to claim 2 , wherein a persistence graph is generated based on the point cloud data, and the persistence graph is used to obtain the persistent homology of the values of the point cloud data.
4. The method according to claim 2, wherein compressing the point cloud data comprises: The compressed data is generated based on the first value information and the first position vector information corresponding to the first value information, wherein: The first position vector information includes indication information of a position corresponding to the first value information in the point cloud data.
5. A method according to claim 4, wherein the first value information is associated with a first part of the point cloud data, and the compressed data also includes second position vector information associated with a second part of the point cloud data, and the second position vector information includes indication information of a position in the point cloud data corresponding to the second value information associated with the second part of the point cloud data. The method according to claim 5 , wherein the first portion of the point cloud data and the second portion of the point cloud data constitute the point cloud data.
7. The method according to any one of claims 2 to 6, wherein selecting the value of the point cloud data whose persistent coherence satisfies a preset condition comprises: receiving a topology information configuration, wherein the topology information configuration indicates a proportion of the topology feature to be retained; as well as Based on the ratio, a plurality of values whose number satisfies the ratio are selected from the values of the point cloud data with the largest persistent homology.
8. The method according to claim 2, wherein acquiring the persistent coherence comprises: Converting the point cloud data into a two-dimensional point cloud matrix, wherein the elements in the two-dimensional point cloud matrix correspond to the values of the point cloud data; The persistent homology is obtained based on element values and element positions in the two-dimensional point cloud matrix.
9. The method of claim 8, wherein acquiring the persistent coherence comprises: Generate a point cloud data vector based on the element value and the element position in the two-dimensional point cloud matrix; as well as The persistent homology is obtained based on the value of the point cloud data and its corresponding position in the point cloud data vector.
10. The method according to claim 9, wherein the indication information in the first position vector information is used to indicate the position corresponding to the first value information in the point cloud data vector.
11. The method according to claim 9 or 10, further comprising one of the following: Obtaining a preset coordinate indication mode configuration; generating the coordinate indication mode configuration and sending the coordinate indication mode configuration; or The coordinate indication mode configuration is received, wherein: The coordinate indication mode configuration indicates an arrangement order of point cloud data values when the two-dimensional point cloud matrix is used to generate the point cloud data vector.
12. The method according to any one of claims 10 to 11, further comprising: Send or receive quantization configuration; where: The quantization configuration indicates a method for quantizing the coordinate values of the point cloud data, and the Z-axis coordinate value of the quantized point cloud data in the three-dimensional coordinate system is an element value in the two-dimensional point cloud matrix.
13. The method according to claim 12, wherein the three-dimensional coordinate system is a three-dimensional global coordinate system, and the method further comprises: Transmit or receive conversion mode configuration; where: The conversion mode configuration indicates whether to perform coordinate system mapping from the three-dimensional global coordinate system to a three-dimensional local coordinate system on the point cloud data.
14. The method according to any one of claims 1 to 13, wherein the point cloud data corresponds to a clustering plane, the method further comprising: Based on the distance between the corresponding point in the point cloud of the data in the input point cloud data set and one or more clustering planes, the input point cloud data set is clustered to obtain the point cloud data corresponding to the clustering planes, wherein the clustering plane corresponding to the point cloud data is the clustering plane with the shortest distance among the one or more clustering planes.
15. The method according to claim 14, further comprising: A clustering configuration for clustering the input point cloud data set is sent.
16. The method according to claim 14 or 15, wherein determining the clustering plane comprises: Projecting the input point cloud data set according to the plane of the three-dimensional coordinate system; Obtaining a projected convex hull point set based on edge information of the point cloud data projected in the plane of the three-dimensional coordinate system; as well as The clustering plane is determined based on a candidate plane formed by a plurality of points in the projected convex hull point set.
17. The method of claim 16, wherein determining the clustering plane comprises: Based on the distribution of the input point cloud data set in the candidate planes, one or more candidate planes are selected from a plurality of candidate planes formed by a plurality of points in the projected convex hull point set as the clustering planes.
18. The method according to any one of claims 1 to 17, further comprising one of the following: Obtaining preset first configuration information; Generate the first configuration information, and send the first configuration information; or Receive the first configuration information; wherein: The first configuration information is used to configure at least one of the following: Compression mode configuration, used to indicate the mode of compressing the point cloud data; or The auxiliary information precision configuration is used to indicate at least one of a compression boundary for compressing the point cloud data and a number of bits of a mapping coordinate system.
19. A communication method, comprising: Receiving compressed data of point cloud data, wherein the compressed data includes first value information and first position vector information associated with the point cloud data; The point cloud data is obtained based on the first value information and the first position vector information.
20. The method of claim 19, wherein the first value information and the first position vector information are associated with a first portion of the point cloud data, the compressed data further comprises second position vector information associated with a second portion of the point cloud data, and wherein obtaining the point cloud data comprises: The point cloud data is obtained based on the first value information, the first position vector information, the second value information and the second position vector information, wherein the second value information is associated with the second part of the point cloud data and is determined based on the first value information, the first position vector information and the second position vector information.
21. The method according to claim 20, wherein determining the second value information comprises: Generate a point cloud data vector based on the first value information and the first position vector information; Generate a function curve based on the point cloud data vector; In the function curve, the second value information is determined based on the second position vector information.
22. The method according to claim 21, wherein obtaining the point cloud data comprises: Determine a position set of the first value information and the second value information in the two-dimensional point cloud matrix based on an arrangement order of point cloud data values in the two-dimensional point cloud matrix in the point cloud data vector; Determining the two-dimensional point cloud matrix based on the position set; as well as The point cloud data is determined based on element values and element positions in the two-dimensional point cloud matrix.
23. The method of claim 22, further comprising one of the following: Obtaining a preset coordinate indication mode configuration; generating the coordinate indication mode configuration and sending the coordinate indication mode configuration; or The coordinate indication mode configuration is received, wherein: The coordinate indication mode configuration indicates an arrangement order of the point cloud data values of the two-dimensional point cloud matrix in the point cloud data vector.
24. The method according to claim 22 or 23, wherein obtaining the point cloud data comprises: The point cloud data in a three-dimensional coordinate system is determined based on the element values and element positions in the two-dimensional point cloud matrix, wherein the element values in the two-dimensional point cloud matrix are the Z-axis coordinate values of the quantized point cloud data in the three-dimensional coordinate system.
25. The method according to claim 24, wherein the three-dimensional coordinate system is a three-dimensional global coordinate system, and the method further comprises one of the following: Get the preset conversion mode configuration; generating the conversion mode configuration and sending the conversion mode configuration; or Receiving the conversion mode configuration; wherein: The conversion mode configuration indicates whether the point cloud data is subjected to coordinate system mapping from the three-dimensional global coordinate system to a three-dimensional local coordinate system.
26. The method according to any one of claims 20-25, further comprising one of the following: Get the preset quantization configuration; generating the quantization configuration and sending the quantization configuration; or Receiving the quantization configuration; wherein: The quantization configuration indicates a method for quantizing the coordinate values of the point cloud data. After the quantized coordinate values are dequantized, they correspond to the Z-axis coordinate values of the point cloud data in the three-dimensional coordinate system.
27. The method according to any one of claims 19 to 26, wherein the point cloud data corresponds to a clustering plane, and the method further comprises: A clustering configuration for clustering the input point cloud dataset is received, wherein the clustering configuration is used to obtain the input point cloud dataset based on the point cloud data corresponding to each of the clustering planes.
28. The method according to any one of claims 19 to 27, further comprising one of the following: Obtaining preset first configuration information; Generate the first configuration information, and send the first configuration information; or Receive the first configuration information; wherein: The first configuration information is used to configure at least one of the following: Compression mode configuration, used to indicate the mode of compressing the point cloud data; or The auxiliary information precision configuration is used to indicate at least one of a compression boundary for compressing the point cloud data and a number of bits of a mapping coordinate system.
29. The method according to any one of claims 19 to 28, further comprising: A topology information configuration is sent, where the topology information configuration indicates a proportion of a topology feature that is retained, and the topology feature is used to determine the first value information from the point cloud data.
30. A communication device, comprising: A processor, and a memory storing instructions, wherein when the instructions are executed by the processor, the method according to any one of claims 1 to 18 or claims 19 to 29 is performed.
31. A computer-readable storage medium storing instructions, which, when executed, cause the method according to any one of claims 1 to 18 or claims 19 to 29 to be performed.
32. A computer program product comprising instructions which, when executed, cause the method of any one of claims 1 to 18, or claims 19 to 29 to be performed.
Citation Information
Patent Citations
Point cloud geometry compression
CN111052189A
Dynamic threshold prediction method applied to AIOps fault early warning, equipment and medium
CN113886181A
Point cloud data processing method and device
CN114693696A
Point cloud data transmitting device, point cloud data transmitting method, point cloud data processing device and point cloud data processing method
CN115280780A
Point cloud data transmission device, point cloud data transmission method, point cloud data reception device, and point cloud data reception method
US20220327743A1
Cited By
Hot target extraction method and system based on infrared image recognition
CN119672321A
