Communication environment sensing method and apparatus, electronic device, and storage medium

Abstract

Embodiments of the present application relate to the technical field of communications, and provide a communication environment sensing method and apparatus, an electronic device, and a storage medium, for use in sensing a communication environment while transmitting a communication signal so as to achieve integrated sensing and communication. The method specifically comprises: receiving a long-range radio (LoRa) sensing-communication transmission signal; respectively performing data parsing processing on the LoRa sensing-communication transmission signal to obtain communication data; and performing sensing analysis processing on the LoRa sensing-communication transmission signal to obtain first environment sensing data, wherein the first environment sensing data is used for indicating location information and movement information of a target object present in a communication environment.

Description

Communication environment perception method, device, electronic device and storage medium

[0001] This application claims priority to the Chinese patent application filed on April 25, 2023, with application number 202310457394.2 and application name “A communication environment perception method, device, electronic device and storage medium”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present disclosure relates to the field of communication technologies, and in particular to a communication environment perception method, device, electronic device, and storage medium. Background Art

[0003] Perception services are provided by various specialized sensing devices, such as conventional radar, lidar, computed tomography (CT), and magnetic resonance imaging (MRI). For example, radar is a classic wireless sensing method. Its basic principle is that a transmitter transmits a specific waveform signal, which travels through a wireless channel to a receiver. The receiver then processes the transmitted and received signals to extract targets of interest in the wireless channel.

[0004] The primary function of wireless communication systems is to exchange information between transceivers. The basic principle is that a transmitter transmits a specific waveform signal, which is received by a receiver after passing through a wireless channel. After signal processing, the receiver demodulates the signal. Currently, users also need to be aware of their surroundings while communicating.

[0005] Summary of the Invention

[0006] In one aspect, a communication environment perception method is provided. Specifically, the method comprises: receiving a long-range radio LoRa (LoRa) communication transmission signal; performing data analysis on the LoRa communication transmission signal to obtain communication data; and performing perception analysis on the LoRa communication transmission signal to obtain first environment perception data. The first environment perception data indicates location information and movement information of a target object in the communication environment.

[0007] In some embodiments, the data analysis processing includes: performing one or more of down-mixing processing, frame synchronization processing, fast Fourier transform demodulation, Gray inverse mapping processing, Hamming decoding, deinterleaving processing, packet header detection, CRC check and de-whitening on the LoRa interaceptive transmission signal in sequence.

[0008] In some embodiments, the data parsing process is implemented based on the data receiving link of the LoRa physical layer.

[0009] In some embodiments, the above-mentioned perception analysis and processing of the LoRa synaesthesia transmission signal includes: performing mixing, filtering, digital-to-analog conversion and data processing on the LoRa synaesthesia transmission signal in sequence to obtain a radar imaging image; and determining the first environmental perception data based on the radar imaging image.

[0010] In some embodiments, the data processing includes one or more of one-dimensional fast Fourier transform, target detection, signal strength analysis, and two-dimensional fast Fourier transform.

[0011] In some embodiments, the LoRa physical layer also includes a radar processing link, and the perception analysis processing is implemented based on the radar processing link.

[0012] In some embodiments, the method further includes: performing signal generation processing on the communication transmission data to be sent to generate a LoRa transmission signal; sending the LoRa transmission signal and obtaining a radar echo obtained by the radar device detecting the communication environment when sending the LoRa transmission signal; and determining, based on the radar echo, second environmental perception data of the communication environment when sending the LoRa transmission beam.

[0013] In some embodiments, the above-mentioned signal generation processing includes: performing one or more of data whitening, data header addition, data cyclic redundancy check CRC, Hamming encoding, interleaving processing, Gray mapping processing, modulation processing and up-mixing processing on the communication data to be sent.

[0014] In some embodiments, the signal generation process is implemented based on a data transmission link of the LoRa physical layer.

[0015] In some embodiments, the radar device is a frequency modulated continuous wave (FMCW) radar.

[0016] In another aspect, a communication environment perception device is provided. The device includes a receiving unit and a processing unit. The receiving unit is configured to receive LoRa (Lower Power Wide Area Network) communication signals. The processing unit is configured to perform data analysis on the LoRa (Lower Power Wide Area Network) signals to obtain communication data. The processing unit is further configured to perform perception analysis on the LoRa (Lower Power Wide Area Network) signals to obtain first environment perception data; the first environment perception data indicates location and movement information of a target object in the communication environment.

[0017] In some embodiments, the data analysis processing includes: performing one or more of down-mixing processing, frame synchronization processing, fast Fourier transform demodulation, Gray inverse mapping processing, Hamming decoding, deinterleaving processing, packet header detection, CRC check and de-whitening on the LoRa interaceptive transmission signal in sequence.

[0018] In some embodiments, the processing unit is specifically configured to perform mixing, filtering, digital-to-analog conversion, and data processing on the LoRa interaceptive transmission signal in sequence to obtain a radar imaging image; and determine the first environmental perception data based on the radar imaging image.

[0019] In some embodiments, the data processing includes one or more of one-dimensional fast Fourier transform, target detection, signal strength analysis, and two-dimensional fast Fourier transform.

[0020] In some embodiments, the apparatus further includes a transmitting unit (the processing unit described above), further configured to perform signal generation processing on the communication transmit data to be transmitted to generate a LoRa transmit signal. The transmitting unit is configured to transmit the LoRa transmit signal and obtain a radar echo obtained by the radar device detecting the communication environment when transmitting the LoRa transmit signal. The processing unit is further configured to determine, based on the radar echo, second environmental sensing data of the communication environment when transmitting the LoRa transmit beam.

[0021] In some embodiments, the above-mentioned signal generation processing includes: performing one or more of data whitening, data header addition, data cyclic redundancy check CRC, Hamming encoding, interleaving processing, Gray mapping processing, modulation processing and up-mixing processing on the communication data to be sent.

[0022] In some embodiments, the radar device is a frequency modulated continuous wave (FMCW) radar.

[0023] On the other hand, an electronic device is provided, wherein the communication device includes a memory and a processor; the memory and the processor are coupled; the memory is used to store computer program code, and the computer program code includes computer instructions; when the processor executes the computer instructions, the electronic device executes the communication environment perception method as described in any one of the above items.

[0024] In another aspect, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer program instructions, and when the computer program instructions are executed on a computer, the computer executes the communication environment perception method as described in any one of the above embodiments.

[0025] In another aspect, a computer program product is provided, comprising computer program instructions, which, when executed on a computer, cause the computer to execute the communication environment perception method as described in any one of the above embodiments.

[0026] In another aspect, a computer program is provided, which, when executed on a computer, causes the computer to execute the communication environment perception method as described in any one of the above embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] To more clearly illustrate the technical solutions of the present disclosure, the following briefly introduces the drawings required for use in some embodiments of the present disclosure. Obviously, the drawings described below are only drawings of some embodiments of the present disclosure, and those skilled in the art can also derive other drawings based on these drawings. Furthermore, the drawings described below are schematic diagrams and are not intended to limit the actual dimensions of the products, actual processes of the methods, actual timing of signals, and the like involved in the embodiments of the present disclosure.

[0028] FIG1 is a diagram illustrating components of a communication system according to some embodiments;

[0029] FIG2 is a diagram of link composition according to some embodiments;

[0030] FIG3A is a diagram illustrating a data transmission link according to some embodiments;

[0031] FIG3B is a diagram illustrating a data receiving link according to some embodiments;

[0032] FIG3C is a diagram illustrating radar processing chain components according to some embodiments;

[0033] FIG4 is a diagram illustrating a radar signal processing process according to some embodiments;

[0034] FIG5 is a structural diagram of a communication environment perception device according to some embodiments;

[0035] FIG6 is a flow chart of a communication environment perception method according to some embodiments;

[0036] FIG7 is a diagram of a chirp signal according to some embodiments;

[0037] FIG8 is a diagram illustrating radar processing of signals according to some embodiments;

[0038] FIG9 is a flow chart of a communication environment perception method according to some embodiments;

[0039] FIG10 is a diagram showing the composition of a communication environment sensing device according to some embodiments. DETAILED DESCRIPTION

[0040] The following will be combined with the accompanying drawings to clearly and completely describe the technical solutions in some embodiments of the present disclosure. Obviously, the embodiments described are only some embodiments of the present disclosure, not all embodiments. Based on the embodiments provided by the present disclosure, all other embodiments obtained by ordinary technicians in this field are within the scope of protection of the present disclosure.

[0041] Unless the context requires otherwise, throughout the specification and claims, the term "comprise" and its other forms, such as the third person singular form "comprises" and the present participle form "comprising", are to be interpreted as open and inclusive, that is, "including, but not limited to". In the description of the specification, the terms "one embodiment", "some embodiments", "exemplary embodiments", "example", "specific example" or "some examples" are intended to indicate that the particular features, structures, materials or characteristics associated with the embodiment or example are included in at least one embodiment or example of the present disclosure. The schematic representation of the above terms does not necessarily refer to the same embodiment or example. In addition, the particular features, structures, materials or characteristics may be included in any one or more embodiments or examples in any appropriate manner.

[0042] Here we first explain the relevant technical terms involved in this application.

[0043] 1. Long range radio (LoRa):

[0044] LoRa is a spread spectrum modulation technology derived from linear frequency modulation, which is used to establish long-distance communication links through physical layer or wireless modulation. Many traditional wireless systems use frequency shift keying (FSK) modulation as the physical layer. Currently, LoRa has become a wireless platform for the Internet of Things (IoT) as a long-distance, low-power wireless platform. LoRa devices and networks (such as ) enables smart IoT applications to solve problems in energy management, natural resource reduction, pollution control, infrastructure efficiency, and disaster prevention. It can also be applied to smart cities, homes and buildings, communities, metering, supply chain and logistics, agriculture, etc.

[0045] LoRaWAN is a set of communication protocols and system architectures designed to complement LoRa long-range communication technology. LoRaWAN networks are typically deployed in a star topology, with gateways relaying messages between end devices and a central network server. Gateways connect to the network server via standard IP, while end devices communicate to one or more gateways using single-hop LoRa or FSK.

[0046] 2. Frequency Shift Keying

[0047] Frequency shift keying (FSK) is a modulation method that uses a digital signal to control carrier frequency variations. Depending on whether the modulated wave's phase is continuous or not, FSK is categorized into two types: discontinuous FSK and continuous FSK. FSK is an early modulation method used in information transmission. Its main advantages are ease of implementation and good noise and attenuation resistance. It is widely used in low- and medium-speed data transmission. For example, it can leverage the discrete value characteristics of baseband digital signals to key the carrier frequency to transmit information. The most common system is a dual-frequency FSK system, which uses two frequencies to carry binary 1s and 0s.

[0048] 3. Radar

[0049] Radar is a device that uses electromagnetic waves to detect targets. The radar's transmitting antenna converts the high-frequency current signal generated by the transmitter circuit or the guided wave on the transmission line into an electromagnetic wave with a specific polarization that can be transmitted through space. The wave is then transmitted in a predetermined direction. When the electromagnetic wave encounters an obstacle in its forward direction, part of the wave is reflected back in the opposite direction of transmission. The radar's receiving antenna then receives the reflected electromagnetic wave and converts it into a high-frequency current signal or the guided wave on the transmission line. By processing the resulting echo signal, information such as the target's range, speed, and angle can be extracted.

[0050] For example, a radar may be composed of a radar transmitter, a radar receiver, and an antenna.

[0051] A radar transmitter is a radio device that provides high-power RF signals for radar. It generates high-power RF signals with a modulated carrier wave, i.e., electromagnetic waves. Based on the modulation method, transmitters can be divided into two categories: continuous wave transmitters and pulse transmitters. The transmitter consists of a first-stage RF oscillator and a pulse modulator.

[0052] A radar receiver is a device that performs frequency conversion, filtering, amplification, and demodulation. It uses appropriate filtering to separate the weak high-frequency signal received by the antenna from the accompanying noise and interference. After amplification and detection, it is used for target detection, display, or other radar signal processing.

[0053] An antenna is a device in radar equipment that transmits or receives electromagnetic waves and determines the direction of detection. During transmission, it radiates energy in the desired direction. During reception, it receives echoes in the detection direction and determines the target's azimuth and / or elevation.

[0054] 4. Frequency Modulated Continuous Wave (FMCW) Radar

[0055] Frequency-modulated continuous wave (FMCW) radar refers to a continuous wave radar whose transmission frequency is modulated by a specific signal, such as a weather radar. FMCW radar determines target distance by comparing the difference between the echo signal frequency at any given moment and the frequency of the transmitted signal at that moment. Distance is proportional to the frequency difference. The target's radial velocity and range can be determined by processing the measured frequency difference. Compared to other range- and speed-measuring radars, FMCW radar has a simpler structure. Due to its extensive technical experience, low peak transmit power, ease of modulation, low cost, and simplified signal processing, FMCW radar is a commonly used radar system in automotive radars.

[0056] 5. Fast Fourier Transform (FFT)

[0057] Fast Fourier transform (FFT), also known as FFT, is a general term for efficient and fast computer calculations of the discrete Fourier transform (DFT). The basic idea of ​​FFT is to decompose the original N-point sequence into a series of shorter sequences. FFT is a time-frequency analysis method that converts time-domain signals into frequency-domain signals, obtaining frequency information.

[0058] 6. Chirp

[0059] Chirp is the phenomenon in which the frequency of a signal varies over time. It is a time-domain characterization of the pulse's properties. Within a pulse cycle, the various frequency components do not arrive simultaneously, meaning that the different frequency components of the laser pulse are not synchronized in the time domain. It can be divided into positive chirp and negative chirp. Positive chirp occurs when the frequency increases over time, meaning the laser output is initially low-frequency and then high-frequency. For example, the rising leading edge of a pulse is low-frequency, while the falling trailing edge is high-frequency. Negative chirp is the opposite. For example, in normal dispersion, high-frequency waves have a large refractive index and propagate slowly, while low-frequency waves propagate quickly, resulting in positive chirp. Chirp is primarily caused by the dynamic changes in the medium's refractive index due to dynamic electrical signal modulation, which causes the phase of the optical signal propagating through the medium to change. This phase change is directly reflected in the dynamic changes in the output optical signal frequency.

[0060] The above is an introduction to the technical terms involved in this application, which will not be repeated below.

[0061] To meet the need for simultaneous environmental awareness while achieving communication, an embodiment of the present application provides a communication environment awareness method. The method specifically comprises: receiving a LoRa synaesthesia transmission signal; performing data analysis and processing on the LoRa synaesthesia transmission signal to obtain communication data; and performing perception analysis and processing on the LoRa synaesthesia transmission signal to obtain first environmental awareness data. The first environmental awareness data is used to indicate the location and movement information of target objects in the communication environment. This method can simultaneously perceive the communication environment while transmitting communication signals, thereby achieving synaesthesia integration.

[0062] FIG1 illustrates a communication system 100 provided in an embodiment of the present application. As shown in FIG1 , the communication system 100 may include a network device 01 and a terminal device 02. The network device 01 and the terminal device 02 may communicate with each other. In some embodiments, the communication system 100 may be a communication system based on LoRa technology, and the network device 01 may transmit LoRa signals to the terminal device 02.

[0063] In each embodiment of the present application, the network device 01 may be an access network device. The access network device is mainly used to implement functions such as wireless physical control functions, resource scheduling and wireless resource management, wireless access control, and mobility management. Specifically, the access network device may be an access network (AN) / radio access network (RAN) device, or may be a device composed of multiple 5G-AN / 5G-RAN nodes, or may be any one of a base station (nodeB, NB), an evolved base station (evolution nodeB, eNB), a next generation base station (gNB), a transmission receive point (TRP), a transmission point (TP), and some other access nodes. In the embodiment of the present application, the device for implementing the function of the access network device may be an access network device, or may be a device that can support the access network device to implement the function, such as a chip system. In the technical solution provided in the embodiment of the present application, the technical solution provided in the embodiment of the present application is described by taking the device for implementing the function of the access network device as an access network device as an example.

[0064] In some embodiments, network device 01 may also have a perception-assisted communication function, thereby achieving more efficient beam management and more accurate beam tracking. Furthermore, communication-assisted perception can provide functions such as positioning enhancement, high-resolution imaging, environment reconstruction, and gesture recognition.

[0065] For example, the terminal device 02 may be a device with wireless transceiver capabilities. The terminal device 02 may be referred to by various names, such as user equipment (UE), access terminal, terminal unit, terminal station, mobile station, mobile station, remote station, remote terminal, mobile device, wireless communication device, terminal agent, or terminal apparatus. The terminal may be deployed on land, including indoors or outdoors, handheld or vehicle-mounted; on water (e.g., on a ship); or in the air (e.g., on an airplane, balloon, or satellite). The terminal can be a cellular phone, a cordless phone, a session initiation protocol (SIP) phone, a wireless local loop (WLL) station, a personal digital assistant (PDA), a handheld device with wireless communication capabilities, a computing device or other processing device connected to a wireless modem, a vehicle-mounted device or a wearable device, an unmanned aerial vehicle (UAV) and an unmanned aerial vehicle controller (UAVC), a virtual reality (VR) terminal device, an augmented reality (AR) terminal device, a wireless terminal in industrial control, a wireless terminal in self-driving, a wireless terminal in remote medical, a wireless terminal in smart grid, a wireless terminal in transportation safety, a wireless terminal in smart city, a wireless terminal in smart home, etc. The terminal can be mobile or fixed. In the embodiment of the present application, the device for realizing the function of the terminal device can be a terminal, or a device that can support the terminal to realize the function, such as a chip system. In the embodiment of the present application, the chip system can be composed of a chip, or can include a chip and other discrete devices. In the embodiment of the present application, the technical solution provided by the embodiment of the present application is described by taking the terminal device as an example of the device for realizing the function of the terminal device.

[0066] In some embodiments, as shown in Figure 2, the system's physical layer may include a data transmission link, a data reception link, and a radar processing link. As shown in Figure 3A, the data transmission link can be used to transmit data and can also be used to implement data whitening, data header addition, data cyclic redundancy check (CRC) addition, Hamming encoding, interleaving, Gray mapping, modulation, and up-mixing. As shown in Figure 3B, the data reception link can be used to receive data. Furthermore, it can also be used to implement down-mixing, frame synchronization, FFT demodulation, Gray inverse mapping, Hamming decoding, deinterleaving, packet header detection, CRC check, and de-whitening. As shown in Figure 3C, the radar processing link can be used to implement mixing, filtering, digital-to-analog conversion, and data processing.

[0067] In some embodiments, the radar processing link may be an FMCW radar.

[0068] As shown in Figure 4, an FMCW radar operates by transmitting a chirp whose frequency varies linearly with time. This chirp is radiated by the antenna, reflected from the target, and received by the receiving antenna. On the receiving side, the delayed received signal and an undelayed copy of the transmitted chirp are mixed (multiplied). The mixer outputs two sine waves with frequencies of the sum and difference waveforms. The received signal has nearly identical frequencies; the sum waveform has a frequency approximately twice that of the original signal and is filtered out, but the difference waveform has a frequency ranging from kHz to several MHz. The difference frequency depends on the delay of the received reflected signal, allowing the delay of the reflected signal to be determined. After low-pass filtering and amplification, the difference frequency signal is fed to a digital signal processor, which performs an FFT on the difference frequency signal, detects the difference frequency signal, and processes the target data.

[0069] It should be understood that FIG1 is merely an exemplary architecture diagram, and the number of devices included in the communication system shown in FIG1 is not limited. Furthermore, in addition to the devices shown in FIG1 , the communication system shown in FIG1 may also include other devices, which is not limited.

[0070] The present application also provides a communication environment perception device (hereinafter referred to as the perception device for ease of description), which is the execution subject of the above-mentioned communication environment perception method. The perception device is an electronic device with data processing capabilities, or a functional module in the electronic device, which is not limited to this. For example, the electronic device can be the network device 01 in the above-mentioned communication system 100.

[0071] The following takes the sensing device as an electronic device as an example, and introduces a hardware structure of the sensing device 200 in conjunction with Figure 5.

[0072] As shown in FIG. 5 , the sensing device 200 includes a processor 210 , a communication line 220 , and a communication interface 230 .

[0073] Optionally, the sensing device 200 may further include a memory 240 , wherein the processor 210 , the memory 240 and the communication interface 230 may be connected via a communication line 220 .

[0074] The processor 210 may be a central processing unit (CPU), a general-purpose processor, a network processor (NP), a digital signal processor (DSP), a microprocessor, a microcontroller, a programmable logic device (PLD), or any combination thereof. The processor 210 may also be any other device with processing capabilities, such as a circuit, a device, or a software module, without limitation.

[0075] In one example, the processor 210 may include one or more CPUs, such as CPU0 and CPU1 in FIG. 5 .

[0076] As an optional implementation, the sensing device 200 includes multiple processors. For example, in addition to the processor 210, it may also include a processor 270. The communication line 220 is used to transmit information between the various components included in the sensing device 200.

[0077] Communication interface 230 is used to communicate with other devices or other communication networks. Such other communication networks may be Ethernet, radio access networks (RAN), wireless local area networks (WLAN), etc. Communication interface 230 may be a module, circuit, transceiver, or any other device capable of communication.

[0078] The memory 240 is used to store instructions, where the instructions may be computer programs.

[0079] Among them, the memory 240 can be a read-only memory (ROM) or other types of static storage devices that can store static information and / or instructions, or a random access memory (RAM) or other types of dynamic storage devices that can store information and / or instructions, or an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compact disc, laser disc, optical disc, digital versatile disc, Blu-ray disc, etc.), magnetic disk storage media or other magnetic storage devices, etc., without limitation.

[0080] It should be noted that the memory 240 can exist independently of the processor 210 or can be integrated with the processor 210. The memory 240 can be used to store instructions, program codes, or some data. The memory 240 can be located inside the sensing device 200 or outside the sensing device 200, without limitation.

[0081] The processor 210 is configured to execute instructions stored in the memory 240 to implement the communication method provided in the following embodiments of the present application. For example, when the sensing device 200 is a terminal or a chip or system on a chip in the terminal, the processor 210 may execute instructions stored in the memory 240 to implement the method provided in the present application.

[0082] As an optional implementation, the sensing device 200 further includes an output device 250 and an input device 260. The output device 250 can be a device such as a display screen or a speaker that can output data from the sensing device 200 to a user. The input device 260 can be a device such as a keyboard, a mouse, a microphone, or a joystick that can input data into the sensing device 200.

[0083] It should be noted that the structure shown in FIG5 does not constitute a limitation on the computing device. In addition to the components shown in FIG5, the computing device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0084] The embodiments provided in this application are described in detail below with reference to the accompanying drawings.

[0085] As shown in FIG6 , an embodiment of the present application provides a communication environment perception method, which includes the following steps:

[0086] S101, receiving LoRa transmission signals.

[0087] Among them, the LoRa interaceptive transmission signal can be used to transmit LoRa communication data, and can also be used to transmit perception data of the communication environment.

[0088] In some embodiments, the aforementioned perception data may be perception information within a perception area of ​​a preset size within the communication environment. Furthermore, the perception data may be used to reflect the location and movement information of a target object within the perception area. The target object may be a preset object to be perceived, such as a vehicle, an animal, or other possible target object. Alternatively, the target object may be a combination of any number of animals, vehicles, and objects. For example, the target object may be a combination of multiple types.

[0089] In some embodiments, in a LoRa Technology-based communication system, broadband linear frequency modulation (LFM) pulses can be used to encode information bits. These pulses have either an up-chirp or a down-chirp. In an up-chirp, the frequency increases over time, while in a down-chirp, the frequency decreases over time. These LFM signals serve as carrier signals to encode messages, as shown in Figure 7. The preamble portion consists of several standard continuous up-chirps, synchronization, and 2.5 down-chirps. The up-chirps always move in the same direction and at the same slope until they reach the edge of the frequency band, while the down-chirps exhibit the opposite slope. The data portion consists of chirps with different initial positions.

[0090] S102: Perform data analysis on the LoRa communication transmission signal to obtain communication data.

[0091] In some embodiments, the data analysis processing includes: performing one or more of down-mixing processing, frame synchronization processing, FFT demodulation, Gray inverse mapping processing, Hamming decoding, deinterleaving processing, packet header detection, CRC check and de-whitening on the LoRa transmission signal in sequence.

[0092] In some embodiments, the processing operations included in the data parsing process and the order of each processing operation are determined based on the signal generation process when the data is sent. For example, if the transmitted data is whitened, the corresponding de-whitening process can be performed when the received data is received.

[0093] Down-mixing, also known as down-conversion, refers to a mixing method in which the intermediate frequency signal obtained after mixing is lower than the original signal. The purpose of down-mixing is to reduce the carrier frequency of the signal or directly remove the carrier frequency to obtain the baseband signal. Due to the simple circuit and low cost of down-mixing, it is widely used. In the embodiments of the present application, the down-mixing operation here can also be understood as mixing the information on the carrier to the baseband.

[0094] Frame synchronization processing involves detecting and acquiring the start marker of each frame provided by the transmitter at the receiving end. There are two types of frame synchronization: start-stop synchronization and inserting special synchronization code groups. The entire system must quickly enter frame synchronization after power-up, and quickly recover frame synchronization if it loses synchronization. In this embodiment of the present application, receiving time synchronization and finding the frame header can be achieved through the frame synchronization signal.

[0095] FFT demodulation refers to demodulating data into symbols using FFT transformation.

[0096] Gray inverse mapping involves converting symbols into bits of information using Gray code. In a set of number encodings, if any two adjacent codes differ by only one binary digit, this encoding is called a Gray code. Furthermore, because the largest and smallest numbers differ by only one digit, they are "end-to-end," making them also known as cyclic or reflected codes.

[0097] Hamming decoding is the inverse operation of Hamming Code, which is a code widely used for memory and disk error correction. Hamming Code can be used not only to detect errors that occur when transferring data, but also to correct errors.

[0098] Deinterleaving is the process of permuting the order of error-corrected symbols according to a pre-determined order. The permutation process is called interleaving. Correspondingly, the reverse permutation during data reception is called deinterleaving.

[0099] Packet header detection refers to detecting the packet header information.

[0100] CRC check is a powerful error detection and correction code with a relatively simple circuit for encoding and checking. It is often used in data communication between serial transmission auxiliary storage and host and in computer networks. The accuracy of data can be verified by CRC check.

[0101] Dewhitening is the inverse process of data whitening. Whitening involves performing an XOR operation on the payload bits with a specific pseudo-random sequence.

[0102] S103: Perform perception analysis on the LoRa interaceptive transmission signal to obtain first environmental perception data.

[0103] The first environment perception data is used to indicate location information and movement information of a target object existing in the communication environment.

[0104] In some embodiments, the LoRa interaceptive transmission signal may first be subjected to frequency mixing, filtering, digital-to-analog conversion, and data processing to obtain a radar image, and then the first environmental perception data may be determined based on the radar image.

[0105] Mixing involves mixing the transmitted carrier data with the received carrier data. Filtering involves low-pass filtering and band-pass filtering, which leave frequency information. Digital-to-analog conversion involves performing operations such as digital-to-analog sampling on the data.

[0106] Exemplarily, the data processing may include one or more of one-dimensional fast Fourier transform, target detection, signal strength analysis, and two-dimensional fast Fourier transform. Target detection refers to the process of finding a target in a scene and determining its location or other information. For example, as shown in FIG8 , the signal undergoes frequency mixing and fast Fourier transform processing.

[0107] In some embodiments, the embodiments of the present application can perform perception analysis and processing on the LoRa telepathic transmission signal based on the frequency modulated continuous wave radar link.

[0108] In the above embodiment, based on the analysis of LoRa interaceptive transmission signals, the communication environment can be perceived while transmitting communication data, and the location and movement information of the target object in the communication environment can be obtained to achieve target tracking and improve perception accuracy. In this way, communication, computing, and perception can be integrated.

[0109] In some embodiments, as shown in FIG9 , during the data transmission process, the method may further include the following steps:

[0110] S201. Perform signal generation processing on the communication transmission data to be transmitted to generate a LoRa transmission signal.

[0111] In some embodiments, the signal generation process includes: performing one or more of data whitening, data header addition, data CRC, Hamming coding, interleaving, Gray mapping, modulation, and up-mixing on the communication data to be transmitted.

[0112] Data whitening refers to performing an XOR operation on the payload bits and a specific pseudo-random sequence.

[0113] Adding a header to data means packaging the data and adding packet information.

[0114] The CRC number is added to the data to perform CRC check on the data. It is a powerful error detection and correction code that can be used to verify the accuracy of the data.

[0115] Hamming coding involves encoding the message bits using redundant bits. These redundant bits, or parity bits, are extra bits placed at different positions within the message bits. At the receiving end, when the coded bits are received, the receiver performs some recalculation, obtains the error bits, and applies the necessary corrections. If k represents the length of the information bits and n represents the total length of the coded bits, the length of the parity or redundant bits can be obtained by taking the difference between the coded bit length and the information bit length, i.e., (nk).

[0116] Interleaving processing refers to performing a certain regular permutation on the input original information sequence and then reading it out from front to back. In the embodiment of the present application, a diagonal interleaver can be used for interleaving processing.

[0117] Gray mapping processing refers to the mapping from bits to symbols using the inverse Gray code.

[0118] Modulation processing refers to mapping symbols to corresponding baseband waveforms, which can be modulated in the form of IFFT.

[0119] Up-mixing refers to loading baseband information onto the carrier.

[0120] S202: Send a LoRa signal and obtain a radar echo obtained by the radar device detecting the communication environment when sending the LoRa signal.

[0121] S203: Determine, based on the radar echo, second environmental perception data of the communication environment when sending the LoRa transmit beam.

[0122] In some embodiments, the second environment perception data is also used to indicate location information and movement information of a target object in the communication environment.

[0123] In some embodiments, the radar echo may first be subjected to frequency mixing, filtering, digital-to-analog conversion, and data processing to obtain a radar image, and then the first environmental perception data may be determined based on the radar image.

[0124] Exemplarily, the data processing may include one or more of one-dimensional fast Fourier transform, target detection, signal strength analysis, and two-dimensional fast Fourier transform. Target detection refers to the process of finding a target in a scene and determining its location or other information.

[0125] In the above embodiment, while sending data, the communication environment can also be perceived based on the received echo signal to obtain the location information, movement information, etc. of the target object in the communication environment, thereby realizing integrated perception.

[0126] The above mainly introduces the solution provided by the embodiment of the present application from the perspective of the method. In order to realize the above functions, it includes hardware structures and / or software modules corresponding to the execution of each function. It should be easy to realize that the technical goals in this field are combined with the units and algorithm steps of each example described in the embodiments disclosed herein, and the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional technical goals can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0127] As shown in FIG10 , it is a schematic structural diagram of a communication environment sensing device 300 provided in an embodiment of the present application. The communication environment sensing device 300 may include: a receiving unit 301 , a processing unit 302 , and a sending unit 303 .

[0128] The receiving unit 301 is configured to receive a LoRa low power wide area network communication signal.

[0129] The processing unit 302 is used to perform data analysis and processing on the LoRa communication transmission signal to obtain communication data.

[0130] The processing unit 302 is further configured to perform perception analysis on the LoRa interaceptive transmission signal to obtain first environmental perception data; the first environmental perception data is used to indicate location information and movement information of a target object in the communication environment.

[0131] In some embodiments, the data analysis processing includes: performing one or more of down-mixing processing, frame synchronization processing, fast Fourier transform demodulation, Gray inverse mapping processing, Hamming decoding, deinterleaving processing, packet header detection, CRC check and de-whitening on the LoRa interaceptive transmission signal in sequence.

[0132] In some embodiments, the processing unit 302 is specifically configured to perform mixing, filtering, digital-to-analog conversion, and data processing on the LoRa interaceptive transmission signal in sequence to obtain a radar imaging image; and determine the first environmental perception data based on the radar imaging image.

[0133] In some embodiments, the data processing includes one or more of one-dimensional fast Fourier transform, target detection, signal strength analysis, and two-dimensional fast Fourier transform.

[0134] In some embodiments, the processing unit 302 is further configured to perform signal generation processing on the communication transmit data to be transmitted to generate a LoRa transmit signal. The transmitting unit 303 is configured to transmit the LoRa transmit signal and obtain a radar echo obtained by the radar device detecting the communication environment when transmitting the LoRa transmit signal. The processing unit 302 is further configured to determine, based on the radar echo, second environmental sensing data of the communication environment when transmitting the LoRa transmit beam.

[0135] In some embodiments, the above-mentioned signal generation processing includes: performing one or more of data whitening, data header addition, data cyclic redundancy check CRC, Hamming encoding, interleaving processing, Gray mapping processing, modulation processing and up-mixing processing on the communication data to be sent.

[0136] In some embodiments, the radar device is a frequency modulated continuous wave (FMCW) radar.

[0137] For the detailed description of the above optional manner, please refer to the above method embodiment, which will not be repeated here. In addition, the explanation of any of the above-mentioned devices and the description of the beneficial effects can refer to the above corresponding method embodiment, which will not be repeated here.

[0138] As an example, in conjunction with Figure 5, the functions implemented by the processing unit 302 can be implemented by the processor 210 or processor 270 in Figure 5 executing the program code in the memory 240 in Figure 5. The functions implemented by the receiving unit 301 can be implemented by the communication line 220 in Figure 5, but are certainly not limited thereto.

[0139] It should be readily apparent to those skilled in the art that, in combination with the units and algorithmic steps of the various examples described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is performed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0140] It should be noted that the module division shown in FIG10 is schematic and represents only one logical functional division. In actual implementation, other divisions may be employed. For example, two or more functions may be integrated into a single processing module. Such integrated modules may be implemented in either hardware or software functional modules.

[0141] The present application also provides a computer-readable storage medium comprising computer-executable instructions. When executed on a computer, the computer performs any of the methods provided in the above embodiments. For example, one or more features of S101 to S103 in FIG6 may be performed by one or more computer-executable instructions stored in the computer-readable storage medium.

[0142] An embodiment of the present application further provides a computer program product comprising computer-executable instructions, which, when executed on a computer, enables the computer to execute any one of the methods provided in the above embodiments.

[0143] An embodiment of the present application further provides a computer program comprising computer-executable instructions, which, when executed on a computer, enables the computer to execute any one of the methods provided in the above embodiments.

[0144] In the above embodiments, all or part of the embodiments can be implemented by software, hardware, firmware, or any combination thereof. When implemented using a software program, all or part of the embodiments can be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer execution instructions are loaded and executed on a computer, all or part of the processes or functions according to the embodiments of the present application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that includes one or more media integrated therein. The available medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium (eg, a DVD), or a semiconductor medium (eg, a solid state disk (SSD)).

[0145] Although the present application has been described with reference to specific features and embodiments thereof, it is apparent that various modifications and combinations may be made thereto without departing from the spirit and scope of the present application. Accordingly, this specification and the drawings are merely illustrative of the present application as defined by the appended claims and are deemed to cover any and all modifications, variations, combinations or equivalents within the scope of the present application. Obviously, those skilled in the art may make various modifications and variations to the present application without departing from the spirit and scope of the present application. Thus, the present application is intended to include such modifications and variations as fall within the scope of the claims of the present application and their equivalents.

[0146] Although the present application has been described in conjunction with specific features and embodiments thereof, it is obvious that various modifications and combinations may be made thereto without departing from the spirit and scope of the present application. Accordingly, this specification and the drawings are merely illustrative of the present application as defined by the appended claims, and are deemed to cover any and all modifications, variations, combinations or equivalents within the scope of the present application. Obviously, those skilled in the art may make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these changes and variations. The above is only a specific embodiment of the present disclosure, but the scope of protection of the present disclosure is not limited thereto. Any changes or substitutions that a person skilled in the art can think of within the technical scope disclosed in the present disclosure should be covered within the scope of protection of the present disclosure. Therefore, the scope of protection of the present disclosure should be based on the scope of protection of the claims.

Claims

1. A communication environment perception method, wherein: The method comprises: Receive long-distance radio LoRa transmission signals; Performing data analysis on the LoRa interaceptive transmission signal to obtain communication data; The LoRa interaceptive transmission signal is sensed and analyzed to obtain first environmental perception data; the first environmental perception data is used to indicate location information and movement information of a target object existing in the communication environment.

2. The method according to claim 1, wherein: The data analysis processing includes: performing one or more of down-mixing processing, frame synchronization processing, fast Fourier transform demodulation, Gray inverse mapping processing, Hamming decoding, deinterleaving processing, packet header detection, CRC check and de-whitening on the LoRa interaceptive transmission signal in sequence.

3. The method according to claim 1 or 2, wherein: The data analysis and processing is implemented based on the data receiving link of the LoRa physical layer.

4. The method according to claim 1, wherein: The perceiving and analyzing the LoRa synaesthesia transmission signal includes: The LoRa interaceptive transmission signal is mixed, filtered, converted into digital-to-analog format, and processed in sequence to obtain a radar imaging image; The first environmental perception data is determined according to the radar imaging image.

5. The method according to claim 4, wherein: The data processing includes one or more of one-dimensional fast Fourier transform, target detection, signal strength analysis and two-dimensional fast Fourier transform.

6. The method according to claim 4 or 5, wherein: The LoRa physical layer also includes a radar processing link, and the perception analysis processing is implemented based on the radar processing link.

7. The method according to claim 1, wherein: The method further comprises: Perform signal generation processing on the communication transmission data to be transmitted to generate a LoRa transmission signal; Send the LoRa transmission signal, and obtain a radar echo obtained by the radar device detecting the communication environment when sending the LoRa transmission signal; Determine, according to the radar echo, second environmental perception data of the communication environment when sending the LoRa transmit beam.

8. The method according to claim 7, wherein: The signal generation process includes: performing one or more of data whitening, data header addition, data cyclic redundancy check CRC addition, Hamming coding, interleaving, Gray mapping, modulation and up-mixing on the communication data to be sent.

9. The method according to claim 7 or 8, wherein: The signal generation process is implemented based on the data transmission link of the LoRa physical layer.

10. The method according to any one of claims 1 to 9, wherein: The radar device is a frequency modulated continuous wave (FMCW) radar.

11. A communication environment sensing device, wherein: The device comprises: A receiving unit, used for receiving a LoRa interaceptive transmission signal of a low power wide area network communication; A processing unit, used for performing data analysis and processing on the LoRa interaceptive transmission signal to obtain communication data; The processing unit is also used to perform perception analysis on the LoRa interaceptive transmission signal to obtain first environmental perception data; the first environmental perception data is used to indicate location information and movement information of a target object existing in the communication environment.

12. The device according to claim 11, wherein The data analysis processing includes: performing one or more of down-mixing processing, frame synchronization processing, fast Fourier transform demodulation, Gray inverse mapping processing, Hamming decoding, deinterleaving processing, packet header detection, CRC check and de-whitening on the LoRa interaceptive transmission signal in sequence.

13. The device according to claim 11, wherein: The processing unit is specifically used for: The LoRa interaceptive transmission signal is mixed, filtered, converted into digital-to-analog format, and processed in sequence to obtain a radar imaging image; And determine the first environmental perception data according to the radar imaging image.

14. The device according to claim 12, wherein: The device also includes a sending unit; The processing unit is further used to perform signal generation processing on the communication transmission data to be transmitted to generate a LoRa transmission signal; The sending unit is further used to send the LoRa sending signal and obtain a radar echo obtained by the radar device detecting the communication environment when sending the LoRa sending signal; The processing unit is further used to determine, based on the radar echo, second environmental perception data of the communication environment when sending the LoRa transmit beam.

15. The device according to claim 14, wherein: The signal generation process includes: performing one or more of data whitening, data header addition, data cyclic redundancy check CRC addition, Hamming coding, interleaving, Gray mapping, modulation and up-mixing on the communication data to be sent.

16. An electronic device, wherein: The communication device includes a memory and a processor; The memory is coupled to the processor; the memory is used to store computer program code, the computer program code includes computer instructions; When the processor executes the computer instructions, the electronic device executes the communication environment perception method according to any one of claims 1 to 10.

17. A computer-readable storage medium storing a computer program; wherein: When the computer program is executed in an electronic device, the electronic device implements the communication environment perception method according to any one of claims 1 to 10.

Images