Sensing method and apparatus

Abstract

A sensing method and apparatus. The sensing apparatus comprises a first antenna and an RIS array, wherein the first antenna is used for transmitting at least one first signal, which is transmitted to an environment by means of the RIS array, each of the at least one first signal corresponding to a phase of the RIS array; and the RIS array is used for receiving at least one second signal, which passes through the first antenna, and then reach a reception link of the sensing apparatus, the at least one second signal being a signal generated after the at least one first signal is reflected, scattered or diffracted by one or more sensing objects in the environment. In the embodiments of the present application, an RIS array may be additionally provided in a sensing apparatus. Since the phase of the RIS array is variable, signals transmitted by a first antenna may be directed to different directions in an environment by means of changing the phase of the RIS array, thereby implementing the sensing of objects in different directions and improving the azimuth resolution.

Description

A sensing method and device

[0001] Cross-reference to related applications

[0002] This application claims priority to Chinese Patent Application No. 202411738181.8, filed on November 27, 2024, entitled "A Sensing Method and Apparatus", the entire contents of which are incorporated herein by reference. Technical Field

[0003] This application relates to the field of sensing technology, and in particular to a sensing method and apparatus. Background Technology

[0004] In a sensing scenario, the target to be sensed may be distributed in various directions in the environment. The azimuth resolution can be obtained by the aperture of the antenna array of the sensing device, so that the signal emitted by the antenna array can reach the direction of the target to be sensed.

[0005] However, due to factors such as the long signal wavelength and the small size of the antenna array, the azimuth resolution is insufficient. Summary of the Invention

[0006] This application provides a sensing method and apparatus to improve azimuth resolution. The sensing method and apparatus can also be considered a communication method and apparatus, or an integrated sensing and communication method and apparatus.

[0007] In a first aspect, a sensing device is provided, which is, for example, a device, a functional module included in a device, or a larger device including a device. The sensing device may include a first antenna and a reconfigurable intelligent surface (RIS) array, wherein the first antenna is used to transmit at least one first signal, the at least one first signal being transmitted into an environment via the RIS array, wherein each of the at least one first signal is used to sense a sensing target in the environment, and each of the at least one first signal corresponds to a phase of the RIS array; the RIS array is used to receive at least one second signal, the at least one second signal arriving at a receiving link of the sensing device via the first antenna, wherein the at least one second signal is a signal reflected, scattered, or diffracted by one or more sensing targets in the environment from the at least one first signal.

[0008] In this embodiment, a RIS array can be added to the sensing device. The signal emitted by the first antenna in the sensing device can be transmitted into the environment by the RIS array; the echo of the signal can then be transmitted back to the first antenna by the RIS array. The phase of the RIS array is variable. By changing the phase of the RIS array, the signal emitted by the first antenna can be directed in different directions in the environment, thereby enabling the sensing of targets in different directions and improving the azimuth resolution.

[0009] In one alternative implementation, the first antenna is an antenna array. The sensing device may include an antenna array, which can be used to receive echoes, thereby improving reception power.

[0010] In one alternative implementation, the first antenna is located at the center of the antenna array. Signals can be transmitted via the first antenna, or via additional antennas on the antenna array. The first antenna being located at the center of the antenna array provides better coverage for the RIS array.

[0011] In one alternative implementation, the distance between the antenna array and the RIS array is related to the size of the antenna array and / or the beamwidth of the second antenna in the antenna array; or, the distance between the first antenna and the RIS array is related to the size of the first antenna and / or the beamwidth of the first antenna. The second antenna and the first antenna can be the same antenna or different antennas. In this embodiment, the close distance between the RIS array and the antenna array (or the first antenna) facilitates deployment and allows the RIS array and the antenna array or the first antenna to be housed within a single device, effectively reducing the size of the device.

[0012] In an optional embodiment, the sensing device further includes a control module, which is configured to determine the phase of the RIS array corresponding to each of the first signals based on the location of the sensing target. The first signal may correspond to a specific phase of the RIS array, and the RIS array can transmit the first signal according to that phase, ensuring that the first signal reaches the direction of the sensing target, thereby achieving the sensing of the target.

[0013] In an optional implementation, the sensing device further includes a control module, which is configured to: determine M first images corresponding to the one or more sensing targets based on the at least one second signal, where M is a positive integer; and perform sensing based on the M first images. In this embodiment, for example, if the sensing result includes an imaging result, the sensing device can determine the M first images based on the received second signal, thereby performing sensing. For example, one sensing method involves the sensing device summing or stitching the M first images to obtain a sensing result, such as a high-resolution image.

[0014] In one optional implementation, the control module is configured to determine M first images corresponding to the one or more sensing targets based on the at least one second signal in the following manner: performing channel estimation based on each second signal received on each antenna in the antenna array to obtain multiple channel estimation results; determining M second images corresponding to the one or more sensing targets based on the multiple channel estimation results; and determining the M first images based on the M second images.

[0015] In one optional implementation, the control module is configured to determine the M first images based on the M second images in the following manner: determining the M first images based on the coordinates corresponding to the M second images on a first plane and a second plane, wherein the first plane is the plane where the antenna array is located, and the second plane is the imaging plane.

[0016] Determining M first images based on M second images can be understood as pixel relocalization, which is equivalent to shifting the positions of pixels in the second images on the imaging plane. Pixel relocalization can improve perception accuracy.

[0017] In one alternative implementation, the position of the RIS array remains unchanged when transmitting the at least one first signal; or, the position of the RIS array differs when transmitting different first signals among the at least one first signal. The position of the RIS array can be fixed, or the RIS array can be moved, allowing it to transmit signals from multiple different positions to sense targets in more directions.

[0018] In one alternative implementation, the RIS array is a transmission array. For example, the RIS array transmits signals via transmission. Alternatively, the RIS array may also transmit signals via reflection; this application does not impose any limitations.

[0019] Secondly, a sensing method is provided, which can be executed by a sensing device, the description of which is provided in the first aspect. The method includes: transmitting at least one first signal via a first antenna of the sensing device, the at least one first signal being transmitted into an environment via a RIS array included in the sensing device, wherein each of the at least one first signal is used to sense a sensing target in the environment, and each of the at least one first signal corresponds to a phase of the RIS array; receiving at least one second signal via the RIS array, wherein the at least one second signal reaches a receiving link of the sensing device via the first antenna, and wherein the at least one second signal is a signal reflected, scattered, or diffracted by one or more sensing targets in the environment from the at least one first signal.

[0020] In one alternative implementation, the first antenna belongs to an antenna array.

[0021] In one alternative implementation, the first antenna is located at the center of the antenna array.

[0022] In one alternative implementation, the distance between the antenna array and the RIS array is related to the size of the antenna array and / or the beamwidth of the second antenna in the antenna array.

[0023] In an alternative implementation, the method further includes: determining the phase of the RIS array corresponding to each of the first signals based on the location of the sensing target.

[0024] In an optional implementation, the method further includes: determining M first images corresponding to the one or more sensing targets based on the at least one second signal, where M is a positive integer; and performing sensing based on the M first images.

[0025] In one optional implementation, determining M first images corresponding to the one or more sensing targets based on the at least one second signal includes: performing channel estimation based on each second signal received on each antenna in the antenna array to obtain multiple channel estimation results; determining M second images corresponding to the one or more sensing targets based on the multiple channel estimation results; and determining the M first images based on the M second images.

[0026] In one optional implementation, determining the M first images based on the M second images includes: determining the M first images based on the coordinates corresponding to the M second images on a first plane and a second plane, wherein the first plane is the plane where the antenna array is located, and the second plane is the imaging plane.

[0027] In one alternative implementation, the position of the RIS array remains unchanged when the at least one first signal is transmitted; or, the position of the RIS array is different when different of the at least one first signal is transmitted.

[0028] In one alternative implementation, the RIS array is a transmission array.

[0029] For the technical effects of the second aspect or various alternative implementation methods, please refer to the introduction of the technical effects of the first aspect or corresponding implementation methods.

[0030] Thirdly, an apparatus is provided. The apparatus can be the sensing device described in the first aspect above, and the apparatus can execute the method provided in the second aspect. The apparatus possesses the functions of the aforementioned sensing device. For example, the apparatus can implement the functions described in the first or second aspect above. For instance, the apparatus includes modules, units, or means corresponding to the operations involved in the second aspect above. These modules, units, or means can be implemented through software, hardware, or a combination of software and hardware. In one optional implementation, the apparatus includes a baseband device and a radio frequency device. In another optional implementation, the apparatus includes a processing unit (sometimes also called a processing module) and a transceiver unit (sometimes also called a transceiver module). The transceiver unit can implement both transmitting and receiving functions. When the transceiver unit implements the transmitting function, it can be called a transmitting unit (sometimes also called a transmitting module), and when the transceiver unit implements the receiving function, it can be called a receiving unit (sometimes also called a receiving module). The transmitting unit and the receiving unit can be the same functional module, which is called the transceiver unit. This functional module can realize the transmitting and receiving functions; or, the transmitting unit and the receiving unit can be different functional modules, and the transceiver unit is a general term for these functional modules.

[0031] Optionally, the transceiver unit may include a first antenna and a RIS array.

[0032] Optionally, the transceiver unit may include an antenna array, which includes a first antenna.

[0033] In one optional implementation, the first antenna in the transceiver unit is used to transmit at least one first signal, which is transmitted into the environment via the RIS array, wherein each of the at least one first signal is used to sense a sensing target in the environment, and each of the at least one first signal corresponds to a phase of the RIS array; the RIS array in the transceiver unit is used to receive at least one second signal, which is transmitted to the receiving link of the sensing device via the first antenna, wherein the at least one second signal is a signal reflected, scattered, or diffracted by one or more sensing targets in the environment from the at least one first signal.

[0034] In an alternative embodiment, the device further includes a storage unit (sometimes also called a storage module), the processing unit being coupled to the storage unit and executing programs or instructions in the storage unit to enable the device to perform the functions of the second device described in the second aspect above.

[0035] Fourthly, an apparatus is provided, the apparatus comprising a memory and one or more processors. The memory is used to store part or all of a computer program or instructions necessary for implementing the functions involved in the second aspect above. The one or more processors are executable to carry out the computer program or instructions, such that when the computer program or instructions are executed, the apparatus implements the methods in any possible design or implementation of the second aspect above. Optionally, the apparatus is a sensing device as described in the first aspect above.

[0036] In one possible design, the device may further include interface circuitry, through which the processor communicates with other devices or components.

[0037] In one possible design, the device may also include the memory.

[0038] In one possible design, the device is, for example, a communication device.

[0039] In one possible design, the communication device may include a terminal device, or a communication module in the terminal device, or a chip in the terminal device responsible for communication functions such as a modem chip (also known as a baseband chip) or a SoC or SIP chip containing a modem module.

[0040] In one possible design, the communication device may include a network device, or a communication module in a network device, or a chip in a network device that is responsible for communication functions, such as a modem chip (also known as a baseband chip) or a SoC or SIP chip that contains a modem module.

[0041] Fifthly, a sensing system is provided, including a sensing device. The sensing device is used to perform the method described in the second aspect above. For example, the sensing device can be implemented using the apparatus described in the first, third, or fourth aspects.

[0042] In a sixth aspect, a computer-readable storage medium is provided for storing a computer program or instructions that, when executed, cause the methods performed by the sensing device in the above aspects to be implemented.

[0043] In a seventh aspect, a computer program product containing instructions is provided, which, when the computer program or instructions are run on a computer, causes the methods described in the above aspects to be implemented.

[0044] Eighthly, a chip system is provided, including a processor and an interface, the processor being configured to call and execute instructions from the interface to enable the chip system to implement the methods of the above aspects. Attached Figure Description

[0045] Figures 1 and 2 are schematic diagrams of two structures of the access network device in the embodiments of this application;

[0046] Figures 3 and 4 are schematic diagrams of single-station sensing mode and dual-station sensing mode, respectively.

[0047] Figures 5-7 and 10-11 are schematic diagrams of several structures of the sensing device provided in the embodiments of this application;

[0048] Figure 8 is a schematic diagram of a system PSF in an embodiment of this application;

[0049] Figure 9 is a schematic diagram of pixel relocation in an embodiment of this application;

[0050] Figure 12 is a flowchart of a sensing method provided in an embodiment of this application;

[0051] Figure 13 is a flowchart of another sensing method provided in an embodiment of this application;

[0052] Figure 14 is a schematic diagram of a device provided in an embodiment of this application;

[0053] Figure 15 is a schematic diagram of another device provided in an embodiment of this application. Detailed Implementation

[0054] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the embodiments of this application will be further described in detail below with reference to the accompanying drawings.

[0055] In this application embodiment, the number of nouns, unless otherwise specified, refers to "singular nouns or plural nouns," that is, "one or more." "At least one" means one or more, and "more than one" means two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can mean: A exists alone, A and B exist simultaneously, or B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the related objects before and after are in an "or" relationship. For example, A / B means: A or B. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c means: a, b, c, a and b, a and c, b and c, or a and b and c, where a, b, and c can be single or multiple.

[0056] The ordinal numbers such as "first" and "second" mentioned in the embodiments of this application are used to distinguish multiple objects, and are not used to limit the size, content, order, timing, priority, or importance of the multiple objects. Furthermore, the numbering of steps in the various embodiments described in this application is only to distinguish different steps and is not used to limit the order in which the steps are performed.

[0057] The following explanations of some terms or concepts used in the embodiments of this application are provided to facilitate understanding by those skilled in the art.

[0058] The communication devices in the embodiments of this application include, for example, network devices and / or terminal devices.

[0059] In this embodiment, the terminal device is a device with wireless transceiver capabilities, which can be a fixed device, a mobile device, a handheld device (e.g., a mobile phone), a wearable device, an in-vehicle device, or a wireless device (e.g., a communication module, a modem, or a chip system, etc.) built into the aforementioned devices. The terminal device is used to connect people, objects, machines, etc., and can be widely used in various scenarios, including but not limited to the following: sensing scenarios, cellular communication, device-to-device (D2D) communication, vehicle-to-everything (V2X) communication, machine-to-machine / machine-type communications (M2M / MTC) communication, Internet of Things (IoT), virtual reality (VR), augmented reality (AR), industrial control, self-driving, telemedicine, smart grid, smart furniture, smart office, smart wearables, smart transportation, smart city, drones, robots, and indoor commercial scenarios (such as mobile phone screen mirroring, file sharing, and mobile phone to VR glasses video transmission). When the terminal equipment is applied to V2X, it can also be called a V2X device, such as a smart car, digital car, unmanned car, driverless car, pilotless car, or automobile, self-driving car, or autonomous car, pure electric vehicle (EV), hybrid electric vehicle (HEV), range-extended electric vehicle (REEV), plug-in hybrid electric vehicle (PHEV), new energy vehicle, or roadside unit (RSU). The terminal equipment can also be a device used in D2D communication, such as an electricity meter or water meter.

[0060] Furthermore, in this embodiment, the terminal device can also be a terminal device in an Internet of Things (IoT) system. IoT is an important component of the future development of information technology. Its main technical feature is to connect objects to the network through communication technology, thereby realizing an intelligent network of human-machine interconnection and object-to-object interconnection.

[0061] The various terminal devices described above, if located in a vehicle (e.g., placed inside or installed inside a vehicle), can all be considered in-vehicle terminal devices, also known as on-board units (OBUs). The terminal device of this application can also be an in-vehicle module, in-vehicle component, in-vehicle chip, or in-vehicle unit built into a vehicle as one or more components or units. The vehicle can implement the methods of this application through the built-in in-vehicle module, in-vehicle component, in-vehicle chip, or in-vehicle unit.

[0062] The terminal equipment can be a UE, terminal, access station, UE station, remote station, wireless communication equipment, or user equipment, etc.

[0063] In this application embodiment, the device for implementing the terminal device function can be a terminal device, which can be a terminal device or a device capable of supporting the terminal device in implementing the function, such as a chip system. This device can be installed in the terminal device. In the technical solutions provided in this application embodiment, the example of a terminal device being used to implement the terminal device function is used to describe the technical solutions provided in this application embodiment.

[0064] The network devices in this application embodiment include, for example, access network devices (or access network elements) and / or core network devices (or core network elements). The access network devices are devices with wireless transceiver capabilities, used to communicate with the terminal devices. The access network devices include, but are not limited to, base stations (base transceiver stations, BTS, Node B, evolved Node B (eNodeB) / eNB, or the next generation Node B (gNodeB) / gNB), transmission reception points (TRPs), base stations evolved from the 3rd generation partnership project (3GPP), access nodes in wireless fidelity (Wi-Fi) systems, wireless relay nodes, wireless backhaul nodes, etc. The base stations can be: macro base stations, micro base stations, pico base stations, small cells, relay stations, etc. Multiple base stations can support networks using the same access technology or networks using different access technologies. A base station can contain one or more co-located or non-co-located transmission and reception points. The access network equipment can also be a radio controller, centralized unit (CU), and / or distributed unit (DU) in a cloud radio access network (CRAN) scenario. The access network equipment can also be a server, etc. For example, the network equipment in V2X technology can be a roadside unit (RSU). The following description uses a base station as an example to illustrate the access network equipment. A base station can communicate with a terminal device, or it can communicate with a terminal device through a relay station. A terminal device can communicate with multiple base stations in different access technologies. The core network equipment is used to implement functions such as mobility management, data processing, session management, policy and billing. The names of the equipment implementing core network functions may differ in systems using different access technologies; this application does not limit this.Taking the 5th generation (5G) mobile communication technology system as an example, the core network equipment includes, for example, access and mobility management function (AMF), session management function (SMF), policy control function (PCF), or user plane function (UPF), etc.

[0065] In a CU-DU architecture, or in an open RAN (ORAN) system, access network equipment can include one or more logical network elements such as a central unit (CU), a distributed unit (DU), a CU-control plane (CP), a CU-user plane (UP), or a radio unit (RU). CUs and DUs can be separate entities or included in the same network element, such as a baseband unit (BBU). RUs can be included in radio equipment or radio units, such as remote radio units (RRUs), active antenna units (AAUs), or remote radio heads (RRHs). One possible structure for access network equipment is shown in Figure 1. In this structure, core network equipment and access network equipment can communicate via a backhaul link; within the access network equipment, CUs and DUs can communicate via a midhaul link, and DUs and RUs can communicate via a fronthaul link.

[0066] Alternatively, another architecture for the access network device can be seen in Figure 2, which illustrates an access network device implemented using a chip, such as a RAN chip. The RAN chip may include a CU, DU, and RU. The CU can perform L2 and L3 functions, etc.; the DU can perform L1 functions and some L2 functions, etc.; and the RU can perform L1 computation and radio frequency (RF) digital functions, etc. The CU communicates with the core network device through a backhaul interface, which carries the traffic between the CU and the core network device. The CU may include a central processing unit (CPU) based on x86 or ARM architecture, and may include a field-programmable gate array (FPGA), graphics processing unit (GPU), or other accelerators. The CPU can communicate with the FPGA, GPU, or other accelerators via a peripheral component interconnect express (PCIe) interface.

[0067] The CU and DU communicate via a midhaul interface, which carries the traffic between the CU and DU. The DU may include an x86 or ARM architecture CPU, as well as FPGAs, GPUs, or other accelerators, which can communicate with the FPGA, GPU, or other accelerators via a PCIe interface.

[0068] The DU and RU communicate via a fronthaul (FH) interface, which carries the traffic between the DU and RU. If the access network equipment uses an integrated DU, the integrated DU can include the functions of both the DU and RU, and the RAN may no longer need to include a separate RU. The RU may include a RAN fronthaul processing unit, a digital processing unit, and an RF processing unit. The RAN fronthaul processing unit is implemented, for example, using an FPGA or an application-specific integrated circuit (ASIC). The digital processing unit is also implemented, for example, using an FPGA or an ASIC.

[0069] The RU can be connected to an antenna to communicate with the UE via the antenna.

[0070] In different systems, CU (or CU-CP and CU-UP), DU, or RU may have different names, but those skilled in the art will understand their meaning. For example, in an ORAN system, CU can also be called an open CU (O-CU), DU can also be called an open DU (O-DU), CU-CP can also be called an open CU-CP (O-CU-CP), CU-UP can also be called an open CU-UP (O-CU-CP), and RU can also be called an open RU (O-RU). For ease of description, this application uses CU, CU-CP, CU-UP, DU, and RU as examples in its embodiments. Any of the units among CU (or CU-CP, CU-UP), DU, and RU in the embodiments of this application can be implemented through software modules, hardware modules, or a combination of software modules and hardware modules.

[0071] The CU and DU can be configured according to the protocol layer functions of the wireless network they implement. For example, the CU can be configured to implement the functions of the Packet Data Convergence Protocol (PDCP) layer and above (such as the Radio Resource Control (RRC) layer and / or the Service Data Adaptation Protocol (SDAP) layer); the DU can be configured to implement the functions of protocol layers below the PDCP layer (such as one or more of the Radio Link Control (RLC) layer, Media Access Control (MAC) layer, or Physical (PHY) layer). As another example, the CU can be configured to implement the functions of protocol layers above the PDCP layer (such as the RRC and / or SDAP layers), and the DU can be configured to implement the functions of protocol layers below the PDCP layer (such as one or more of the RLC, MAC, or PHY layers).

[0072] The above CU and DU configurations are merely examples; the functions of the CU and DU can be configured as needed. For instance, the CU or DU can be configured to have more protocol layer functions, or only some protocol layer processing functions. For example, some RLC layer functions and protocol layer functions above the RLC layer can be placed in the CU, while the remaining RLC layer functions and protocol layer functions below the RLC layer can be placed in the DU. Furthermore, the functions of the CU or DU can be divided according to service type or other system requirements, such as by latency. Functions that require low latency can be placed in the DU, while functions that do not require low latency can be placed in the CU.

[0073] DU and RU can cooperate to implement the functions of the PHY layer. A DU can be connected to one or more RUs. The functions of DU and RU can be configured in various ways depending on the design. For example, a DU can be configured to implement baseband functions, and an RU can be configured to implement mid-RF functions. Another example is that a DU can be configured to implement higher-level functions in the PHY layer, and an RU can be configured to implement lower-level functions in the PHY layer, or to implement both lower-level and RF functions. Higher-level functions in the physical layer can include a portion of the physical layer's functions that are closer to the MAC layer, while lower-level functions in the physical layer can include another portion of the physical layer's functions that are closer to the mid-RF side.

[0074] In this application embodiment, the apparatus for implementing the functions of a network device can be referred to as a network apparatus. This network apparatus can be a network element, a network device, or an apparatus capable of supporting the network device or network element in implementing the function, such as a chip system. This apparatus can be installed within the network device. In the technical solutions provided in this application embodiment, the apparatus for implementing the functions of a network device is described as a network apparatus (for example, an apparatus for implementing the functions of an access network apparatus is an access network apparatus, and an apparatus for implementing the functions of a core network apparatus is a core network apparatus).

[0075] A sensing signal is a signal used to sense (or detect) a target (or object). Sensing signals can be detection signals, linear frequency modulated signals, radar signals, radar sensing signals, radar detection signals, or environmental sensing signals, etc. Sensing signals can be pulse signals or signals from wireless communication systems. For example, a sensing signal can be an orthogonal frequency division multiplexing (OFDM) signal obtained by modulating a specific sequence on a subcarrier. This specific sequence can be any of the following sequences: Zadoff-Chu sequence (ZC sequence), pseudo-random sequence, or predefined sequence. Pseudo-random sequences include any of the following sequences: longest linear feedback shift register sequence (m-sequence) or Gold sequence. Predefined sequences can be, for example, random data symbols, such as random data symbols modulated by quadrature phase shift keying (QPSK) or quadrature amplitude modulation (QAM).

[0076] An echo signal is a signal generated when a sensed signal is reflected by a target. Both the echo signal and the sensed signal can reflect the parameters of the target. For example, the time delay of the echo signal relative to the sensed signal can reflect the distance of the target relative to the transmitter, and the Doppler shift of the echo signal relative to the sensed signal can reflect the velocity of the target.

[0077] Communication-sensing fusion signals, also known as synthetic-sensing fusion signals, synthetic signals, or integrated synthetic-sensing signals, are signals used for both communication and sensing. When used for communication, the fusion signal carries the communication data or reference signal sequence that needs to be transmitted between communication devices. When used for sensing, the fusion signal can be understood as being used to sense (or detect) targets.

[0078] For example, the signals used for sensing described herein (such as the first signal described below) may include sensing signals and / or synesthetic fusion signals, etc.

[0079] The target can be any tangible object in the environment that can reflect electromagnetic waves, such as mountains, forests, or buildings, and can also include mobile objects such as vehicles, drones, pedestrians, and terminal devices. The target can also be referred to as a sensing target, detection target, perceived target, detected target, perceived object, detected object, or sensed device, etc., and the embodiments of this application do not limit it.

[0080] In summary, the embodiments of this application can add a RIS array within the sensing device. The signal emitted by the first antenna within the sensing device can be transmitted into the environment by the RIS array; the echo of this signal can then be transmitted back to the first antenna by the RIS array. The phase of the RIS array is variable. By changing the phase of the RIS array, the signal emitted by the first antenna can be directed in different directions in the environment, thereby enabling the perception of targets in different directions and improving azimuth resolution.

[0081] The sensing method provided in this application can be applied to fourth-generation (4G) communication systems, such as long-term evolution (LTE) communication systems, as well as 5G communication systems, such as 5G new radio (NR) communication systems, or various communication systems evolving after 5G, such as future communication systems. The method provided in this application can also be applied to Bluetooth systems, wireless fidelity (Wi-Fi) systems, long-range radio (LoRa) systems, or vehicle-to-everything (V2X) systems. The method provided in this application can also be applied to terrestrial networks (TN) and non-terrestrial networks (NTN), such as satellite communication systems, for example, transparent satellite architectures, backhaul satellite architectures, or regenerative satellite architectures, etc., without limitation.

[0082] For sensing, based on the different senders and receivers of the sensing signal, sensing modes can be divided into two types: single-site sensing and dual-site sensing. Single-site sensing mode, also known as self-transmitting and self-receiving mode, single-end sensing mode, or monocentric sensing mode, refers to the same device transmitting the sensing signal and receiving the echo signal reflected from the target. As shown in Figure 3, both the device transmitting the sensing signal and the device receiving the echo signal are device 1. Dual-site sensing mode, also known as A-transmitting and B-receiving mode or self-transmitting and other-receiving mode, refers to different devices transmitting the sensing signal and receiving the echo signal reflected from the target. As shown in Figure 4, the device transmitting the sensing signal is device 2, and the device receiving the echo signal is device 3. Figures 3 and 4 both use a vehicle as an example of the sensing target. For example, in Figure 3, device 1 is a base station or UE. In single-site sensing mode, device 1 transmits the sensing signal, and device 1 receives the echo signal generated by the reflection, scattering, or diffraction of the sensing signal by the sensing target in the environment (e.g., the vehicle in Figure 3) to perform environmental sensing. For example, in Figure 4, device 2 is a base station or UE, and device 3 is a base station or UE. In the dual-site sensing mode, device 1 sends a sensing signal, and device 2 receives the echo signal generated by the reflection, scattering, or diffraction of the sensing signal by a scatterer in the environment (such as a vehicle in Figure 4) to perform environmental sensing. The embodiments of this application can be applied to the single-site sensing mode, such as the sensing scenario shown in Figure 3.

[0083] The network architecture and method flow described in the embodiments of this application are for the purpose of more clearly illustrating the technical solutions of the embodiments of this application, and do not constitute a limitation on the technical solutions provided in the embodiments of this application. As those skilled in the art will know, with the evolution of network architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of this application are also applicable to similar technical problems.

[0084] The apparatus and method provided in the embodiments of this application are described below with reference to the accompanying drawings. The various embodiments of this application can be applied to the network architecture shown in FIG3. For example, the sensing device described in the various embodiments of this application can be the sensing device shown in FIG3. In the accompanying drawings corresponding to the various embodiments of this application, all steps indicated by dashed lines are optional steps, and all modules indicated by dashed lines are optional modules.

[0085] This application provides a sensing device. Please refer to Figure 5, which is a schematic diagram of the sensing device.

[0086] The sensing device may include a first antenna 501 and a RIS array 502, which may be positioned before the first antenna 501. The RIS array 502 is an array composed of a large number of passive components, which may be a planar array or a non-planar array. Each passive component in the RIS array 502 can independently induce a phase shift in the incident electromagnetic wave. The RIS array 503 can adjust the phase of these passive components, thereby intelligently configuring the wireless propagation environment and improving system performance.

[0087] Optionally, the sensing device may include an antenna array 503, as shown in FIG. 6. The antenna array 503 may include one or more antennas, for example, the antenna array 503 may be a multi-input multi-output (MIMO) array. A first antenna 501 may be included in the antenna array 503. Optionally, the first antenna 501 may be, for example, an antenna located at the center of the antenna array 503 (as exemplified in FIG. 6), or the first antenna 501 may be any antenna included in the antenna array 503. Using the antenna at the center of the antenna array 503 as the first antenna 501 allows the signal emitted by the first antenna 501 to better cover the RIS array 502, or allows the signal from the first antenna 501 to be received more completely by the RIS array 502.

[0088] There can be a certain distance between the first antenna 501 and the RIS array 502, or, if the sensing device includes an antenna array 503, there can be a certain distance between the antenna array 503 and the RIS array 502. For example, the distance between the first antenna 501 and the RIS array 502 is equal to the distance between the antenna array 503 and the RIS array 502. Optionally, this distance can be related to the size of the antenna array 503 and / or the beamwidth of the second antenna in the antenna array 503, such as the first antenna 501, or the second antenna can be any antenna in the antenna array 503 other than the first antenna 501. As an example, this distance can satisfy the following relationship: d = L × cotθ (Equation 1)

[0089] Where d represents the distance. L represents the size of antenna array 503, for example, the height of antenna array 503. θ represents the beamwidth of the second antenna, and cot represents the cotangent function.

[0090] During the sensing process, the first antenna 501 can transmit a first signal. The first signal travels from the first antenna 501 to the RIS array 502, and is then transmitted into the environment via the RIS array 502. The first signal can be used for sensing. The first signal may be reflected, scattered, or diffracted by one or more sensing targets in the environment. The reflected, scattered, or diffracted signal is, for example, called a second signal. The second signal travels to the RIS array 502, and then back to the first antenna 501, and finally to the receiving link of the sensing device. The sensing device processes the second signal to obtain the sensing result. Optionally, the first signal and the second signal can be the same signal, but with different transmission paths.

[0091] Optionally, the RIS array 502 in this embodiment can be a transmissive array, that is, the RIS array 502 transmits a first signal from the first antenna 501 to the environment in a transmissive manner, and also transmits a second signal from the environment to the first antenna 501 in a transmissive manner. Transmitting signals in a transmissive manner allows the signals to be transmitted more effectively in the direction corresponding to the phase of the RIS array 502. The phase of the RIS array 502 will be described later.

[0092] If the first antenna 501 belongs to the antenna array 503, then the antennas transmitting the first signal can be some or all of the antennas in the antenna array 503, including, for example, the first antenna 501. The antenna array 503 includes one or more antennas, but in this embodiment, the signal is mainly transmitted to the environment through the RIS array 502. Therefore, only one antenna in the antenna array 503 needs to transmit a signal; it is not necessary for multiple antennas in the antenna array 503 to transmit signals. For example, only the first antenna 501 needs to transmit the first signal. Alternatively, multiple antennas in the antenna array 503 can transmit the first signal, thereby increasing the transmission power of the first signal.

[0093] The first signal may correspond to a phase of the RIS array 502. Optionally, the sensing device may also include a control module 504, as shown in Figure 7, which illustrates a sensing device including a control module 504 and an antenna array 503. Alternatively, the sensing device may not include the antenna array 503, but instead include a control module 504 and a first antenna 501. The control module 504 may communicate with the first antenna 501 (or antenna array 503) and the RIS array 502 (e.g., direct or indirect communication). For example, the control module 504 may transmit signals through the first antenna 501 (or antenna array 503), and the control module 504 may also indicate a corresponding phase to the RIS array 502, thereby allowing the RIS array 502 to adjust its phase. The control module 504 may be, for example, a processor within the sensing device, such as a general-purpose central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits.

[0094] For example, the control module 504 can determine the phase corresponding to the first signal, for example, referred to as the first phase. The control module 504 can send first indication information to the RIS array 502, which can indicate the first phase. After receiving the first indication information, the RIS array 502 can adjust its phase to the first phase, so that the RIS array 502 can transmit the first signal according to the first phase. Optionally, the first phase may be related to the location of the first sensing target, for example, the target to be sensed by the first signal.

[0095] As an optional implementation of the control module 504 determining the first phase, the control module 504 can determine the first phase based on the aforementioned distance d and / or the location of the first sensing target. For example, the control module 504 can determine an initial phase based on the distance d, and then determine the first phase based on the location of the first sensing target and the initial phase. Since the first phase is determined based on the location of the first sensing target, the RIS array 502 can transmit the first signal in the direction of the first sensing target, so that the first signal can reach the first sensing target and realize the sensing of the first sensing target.

[0096] There may be one or more targets to be sensed, for example, the first sensing target is one of the sensing targets. For any one of the sensing targets, the first antenna 501 or antenna array 503 can transmit one or more first signals to the sensing target. For example, for one or more sensing targets, the first antenna 501 or antenna array 503 can transmit at least one first signal. The at least one first signal is transmitted to the environment via the RIS array 502, and each of the at least one first signal can be used to sense some or all of the sensing targets. Each of the at least one first signal can correspond to a phase of the RIS array 502. For example, before transmitting each first signal, the phase of the RIS array 502 can be adjusted to the phase corresponding to each first signal, and the phase corresponding to each first signal can be determined by the control module 504, for example, based on the location of the target to be sensed by each first signal. The sensing targets corresponding to different first signals can be the same or different; the phases corresponding to different first signals can be the same or different.

[0097] The at least one first signal can be reflected, scattered, or diffracted by one or more sensing targets in the environment. For example, the signal reflected, scattered, or diffracted by the first signal after passing through the one or more sensing targets is called the second signal, and at least one first signal can correspond to at least one second signal. The at least one second signal reaches the RIS array 502, which can transmit the at least one second signal, such that the at least one second signal reaches the first antenna 501. Wherein, if the first antenna 501 belongs to the antenna array 503, the at least one second signal can reach some or all of the antennas in the antenna array 503.

[0098] After the first antenna 501 or antenna array 503 receives the at least one second signal, it can send the at least one second signal to the receiving link of the sensing device. The at least one second signal reaches the control module 504 via the receiving link, and the control module 504 can perform sensing according to the at least one second signal.

[0099] Optionally, the control module 504 performs sensing based on the at least one second signal. One possible approach includes the control module 504 determining M first images corresponding to one or more sensing targets based on the at least one second signal. Each of the M first images may include one or more pixels on an imaging plane. The M first images may correspond to the one or more sensing targets; for example, the control module 504 can reflect the one or more sensing targets by imaging the at least one second signal. The M first images may be images composed of pixels corresponding to at least one target point on the one or more sensing targets on the imaging plane. The control module 504 may perform sensing based on the M first images. M is a positive integer.

[0100] The control module 504 determines M first images corresponding to the one or more sensing targets based on the at least one second signal. For example, in one optional implementation, the control module 504 performs channel estimation based on the at least one second signal received by the first antenna 501, obtaining N channel estimation results. Based on the N channel estimation results, the control module 504 can determine M second images corresponding to the one or more sensing targets. Each of the M second images may include one or more pixels on the imaging plane. Here, N is the number of antennas used to receive the at least one second signal. For example, in this implementation, the first antenna 501 receives the at least one second signal, meaning the number of antennas used to receive the at least one second signal is 1, then N = 1. The M second images can correspond to the one or more sensing targets. For example, the control module 504 reflects the one or more sensing targets by imaging the at least one second signal. The M second images can be images composed of pixels corresponding to at least one target point on the one or more sensing targets on the imaging plane. Based on the M second images, the control module 504 can determine the M first images. For example, a second image can be determined based on a first image. Optionally, the target point corresponding to the second image can be the same as the target point corresponding to the first image.

[0101] Alternatively, if the at least one second signal is received by some or all of the antennas within the antenna array 503, the control module 504 determines M first images corresponding to the one or more sensing targets based on the at least one second signal. For example, an optional implementation includes the control module 504 performing channel estimation based on the second signal received by each of the antennas in the partial or complete array, obtaining a channel estimation result corresponding to each antenna. For example, if the number of the partial or complete array is N, the control module 504 obtains a total of N channel estimation results, where N is a positive integer. Based on the N channel estimation results, the control module 504 can determine M second images corresponding to the one or more sensing targets. Based on the M second images, the control module 504 can determine the M first images.

[0102] The control module 504 determines M second images based on the N channel estimation results. For example, an optional implementation includes performing an inverse fast Fourier transform (IFFT) on each of the N channel estimation results to obtain N IFFT results. These N IFFT results, for example, all correspond to the power delay domain, where N is a positive integer. The N IFFT results correspond one-to-one with the N channel estimation results. Assuming the distance between the imaging plane and the plane containing the first antenna 501 remains constant, the network device can determine M images, for example, M second images, based on the N IFFT results. Each of the M second images may include one or more pixels on the imaging plane. For example, any one of the M second images can be represented as S(x,y,x′,y′), where (x,y) represents the coordinates of the antenna corresponding to the second image on the first plane, and (x′,y′) represents the coordinates of the pixels included in the second image on the second plane. The first plane is, for example, a receiving plane, and the second plane is, for example, an imaging plane. The receiving plane can be the plane where the first antenna 501 is located, or the plane where the antenna array 503 is located.

[0103] For example, the M second images are equivalent to the M first images; that is, the M second images constitute the final result. The control module 504 can perform perception based on the M second images, such as reconstructing environmental information or reconstructing one or more sensing targets. For instance, the control module 504 can determine an image based on the M second images (e.g., the control module 504 sums or stitches the M second images to determine a single image), which reflects the environmental information or the one or more sensing targets, and this image has a high resolution. This method is relatively simple to implement and simplifies the implementation of the sensing device.

[0104] Alternatively, the control module 504 can determine M first images based on the M second images, and then perform perception based on the M first images. For example, the control module 504 can determine an image based on the M first images (e.g., the control module 504 can sum or stitch the M first images to determine an image), which reflects environmental information or the one or more perceived targets, and the image has a high resolution.

[0105] The control module 504 determines M first images based on the M second images. One optional implementation includes the control module 504 determining the M first images based on the coordinates of the M second images on a first plane and a second plane. The coordinates of a second image on the first and second planes include, for example, the coordinates of pixels within the second image on the first and second planes. The process of determining M first images based on M second images can also be understood as pixel relocation or pixel translation, equivalent to translating the positions of the pixels included in the second images on the imaging plane. For example, if one of the M second images is S(x,y,x′,y′), the first image determined based on this second image can satisfy the following relationship: S(x+x′,y+y′) = S(x,y,x′, y′) (Formula 2)

[0106] Here, S(x+x′,y+y′) represents the first image, which is also considered to be a super-resolution image.

[0107] Pixel relocation can improve azimuth resolution. In this embodiment, the RIS array 502 is used as the transmitting aperture and the antenna array 503 as the receiving aperture. The final point spread function (PSF) obtained through signal processing is the product of the PSF corresponding to the RIS array 502 and the PSF corresponding to the antenna array 503. Therefore, the sensing device can obtain a narrower PSF, which means it can achieve higher azimuth resolution or imaging resolution. For example, referring to Figure 8, an example of the PSF corresponding to the RIS array 502, the PSF corresponding to the antenna array 503, and the system PSF is shown. In Figure 8, the curve on the right represents the PSF corresponding to the RIS array 502, the curve on the left represents the PSF corresponding to the antenna array 503 (Figure 8 uses the antenna array 503 as an example of a MIMO array), and the curve in the middle represents the system PSF (Figure 8 describes the system PSF as the PSF corresponding to RIS-MIMO). The horizontal axis in Figure 8 represents the distance between a pixel on the second plane and the center of the second plane, and the vertical axis represents the signal amplitude. As can be seen, the system PSF is narrower in the horizontal direction than the PSF of RIS array 502 and the PSF of antenna array 503.

[0108] The PSF of the RIS array 502 can satisfy the following relationship:

[0109] Where σ1 represents the mean square error of the Gaussian function, ∝ represents the proportional relationship, E(x) represents the distribution of the PSF of the RIS array 502 on the second plane, and exp(x) represents e x .

[0110] The multi-channel receive PSF can satisfy the following relationship:

[0111] Where σ² represents the mean square error of the Gaussian function, ∝ represents a proportional relationship, D(xh) represents the distribution of the multi-channel received PSF on the second plane, and xh represents the distance between the location of a pixel on the second plane and the location of the center point of the second plane. Optionally, the multi-channel received PSF can be, for example, the PSF of the antenna array 503.

[0112] The final PSF (or system PSF) obtained by the sensing device can satisfy the following relationship:

[0113] Where ∝ represents a direct proportional relationship, PSF(xp) represents the distribution of the system's PSF on the second plane, xp represents the distance between the location of a pixel on the second plane and the location of the center point of the second plane, and σ sys This represents the mean square error of the Gaussian function. Optional, σ sys The following relationship can be satisfied:

[0114] It is evident that when the aperture of the RIS array 502 is consistent with the aperture of the antenna array 503, the azimuth resolution or imaging resolution can be improved by √2 times. Due to the difference in viewing angle between the receiving pixel and the scanning center, or to be understood as the difference in viewing angle between the center points of the first plane and the second plane, in order to make the aperture of the RIS array 502 consistent with the aperture of the antenna array 503, or to improve the azimuth resolution or imaging resolution, pixel repositioning can be performed. For example, the pixel can be translated from one position h to one position p, thus achieving the system PSF as described above. Alternatively, it can be understood that the system PSF described in Formula 5 above is obtained after performing pixel repositioning. Wherein, if the RIS array 502 and the antenna array 503 are of equal size and spatially aligned, then during the pixel repositioning process, each pixel is translated to This can be done at any location. For example, referring to Figure 9, there is an example of pixel relocation. For example, according to the method provided in the embodiments of this application, pixel a is translated from position 1 to position 2, pixel b is translated from position 3 to position 4, and pixel c is translated from position 5 to position 6.

[0115] Referring to Figure 10, which is a schematic diagram of a sensing device, Figure 10 shows an example of a sensing device including an antenna array 503. For example, the control module 504 instructs the waveform generation module in the transmission link to generate at least one piece of raw information. This raw information is processed by modules such as the baseband module and the radio frequency link in the transmission link to obtain at least one first signal. This first signal is transmitted to the environment via the antenna array 503 and the RIS array 502. At least one second signal from the environment reaches the receiving link of the sensing device via the RIS array 502 and the antenna array 503. It then reaches the control module 504 via the radio frequency link, the baseband module, and the data acquisition module in the receiving link. The RIS array 502 can be connected to a RIS link, which may include a codebook generation module and a phase shifting module. The codebook generation module can receive first indication information from the control module 504 and generate a corresponding phase based on the first indication information. The codebook generation module can also instruct the phase shifting module to adjust the phase of the RIS array 502 to this phase. The modules in Figure 10 can be software or hardware modules. The modules in Figure 10 are only examples and are not limited to these examples.

[0116] Optionally, the RIS array 502 can be fixed in the sensing device, meaning the position of the RIS array 502 is immutable. In this case, the position of the RIS array 502 remains unchanged when the first antenna 501 or antenna array 503 transmits at least one first signal. Alternatively, the position of the RIS array 502 in the sensing device can be adjustable, meaning the position of the RIS array 502 can be variable. In this case, the position of the RIS array 502 may be the same or different when the first antenna 501 or antenna array 503 transmits different first signals among at least one first signal. For example, when the RIS array 502 is in a certain position, the first antenna 501 or antenna array 503 can transmit one or more first signals to obtain a corresponding first image; then the RIS array 502 can move to the next position, and the first antenna 501 or antenna array 503 can transmit one or more first signals again to obtain a corresponding first image. During the process of the first antenna 501 or antenna array 503 transmitting the at least one first signal, the RIS array 502 can move one or more positions without restriction. The movement of the RIS array 502 increases the aperture of the RIS array 502, allowing the signal of the sensing device to be transmitted to more directions or farther distances. As a result, the control module 504 can perform sensing based on the M first images with higher accuracy and better orientation resolution or imaging resolution.

[0117] If the RIS array 502 is movable, the area covered by the first signal emitted by the RIS array 502 in the first position may or may not overlap with the area covered by the first signal emitted by the RIS array in the second position. If these two areas overlap, the control module 504 may acquire the second signal corresponding to the same target point twice. For example, the RIS array 502 emits a first signal A in the first position, which can cover target point 1; the RIS array 502 emits a first signal B in the second position, which can also cover target point 1. The RIS array 502 can receive the second signal A after the first signal A is reflected, scattered, or diffracted by the sensing target, and it can also receive the second signal B after the first signal B is reflected, scattered, or diffracted by the sensing target. Both the second signal A and the second signal B can include the features of target point 1. For target point 1, the control module 504 can perform multi-aperture synthesis processing to determine the first image corresponding to target point 1. For example, the RIS array 502 can superimpose the signals of the second signal A and the second signal B corresponding to target point 1, and determine the first image corresponding to target point 1 based on the superimposed signal. The specific method for determining the first image can be referred to the previous text.

[0118] Referring to Figure 11, another schematic diagram of the sensing device structure is shown. Compared with Figure 10, Figure 11 adds a displacement module to the RIS link. This displacement module can be a hardware module or a software module, and it can control the movement of the RIS array 502. Optionally, the position of the RIS array 502 can be indicated by the control module 504, for example, the control module 504 instructs the displacement module to adjust the phase of the RIS array 502.

[0119] Optionally, the sensing device shown in any of Figures 5-7 and 10-11 may be included in a communication device, such as a network device or a UE, or an RU, which may be included in a network device within an ORAN architecture, or may be a stand-alone device. The network device may be, for example, a core network device and / or an access network device.

[0120] Next, this application provides a sensing method, please refer to FIG12, which is a flowchart of the method. The method can be executed by a sensing device, the structure of which can be referred to in any of FIG5-7 and FIG10-11.

[0121] S1201, transmit at least one first signal through the first antenna 501 or antenna array 503 of the sensing device.

[0122] The at least one first signal is transmitted into the environment via the RIS array 502 of the sensing device. Each of the at least one first signal is used to sense a target in the environment, and each of the at least one first signal corresponds to a phase of the RIS array 502.

[0123] S1202, Receive at least one second signal through the RIS array 502 of the sensing device.

[0124] The at least one second signal reaches the receiving link of the sensing device via the first antenna 501 or the antenna array 503. The at least one second signal is a signal reflected, scattered, or diffracted by one or more sensing targets in the environment as the at least one first signal.

[0125] Optionally, the method may further include S1203, performing sensing based on the at least one second signal. For example, S1203 may be performed by the control module 504 of the sensing device.

[0126] For more information on S1201 to S1203, please refer to the previous introduction to the sensing device; further details will not be provided here.

[0127] This application provides another sensing method, please refer to FIG13, which is a flowchart of the method. This method can be executed by a sensing device, the structure of which can be referred to in any of FIG5-7 and FIG10-11. Optionally, the method shown in FIG13 can be considered as a detailed flowchart example of the method shown in FIG12.

[0128] S1301, the control module 504 of the sensing device generates a first signal.

[0129] S1302, Control module 504 determines the scanning position. This scanning position is, for example, the location of one or more sensing targets in the environment.

[0130] S1303, the control module 504 determines the first phase based on the scanning position.

[0131] The control module 504 can also indicate the first phase to the RIS array 502, so that the RIS array 502 can adjust the phase to the first phase.

[0132] S1304, the control module 504 sends a first signal, which is transmitted into the environment via the first antenna 501 (or antenna array 503) and RIS array 502 of the sensing device.

[0133] S1305, RIS array 502 receives the second signal, which reaches the receiving link of the sensing device via the first antenna 501 (or antenna array 503). For example, the receiving link can send the second signal to the control module 504.

[0134] The second signal is, for example, a signal reflected, scattered, or diffracted by the first signal through a sensing target in the environment, such as the sensing target corresponding to the scanning position in S1302.

[0135] S1306, Control module 504 determines whether the scanning of the perceived target is complete.

[0136] For example, if the first signal has been sent to all the sensing targets to be scanned or detected, the scan is complete; if there are still sensing targets to be scanned or detected to which the first signal has not been sent, the scan is incomplete.

[0137] If the scan is complete, execute S1307; if the scan is not complete, continue executing S1301 until the scan is complete.

[0138] Optionally, S1301 to S1306 may belong to the system workflow or signal transmission process, for example.

[0139] S1307, the control module 504 performs channel estimation on the second signal received by the first antenna 501, or performs channel estimation on the second signal received by each antenna in the antenna array 503 that participates in receiving the second signal.

[0140] S1308, the control module 504 determines the IFFT result corresponding to the first antenna 501, or determines the IFFT result corresponding to each second antenna.

[0141] S1309, Control module 504 performs pixel relocation based on the obtained IFFT result.

[0142] S1310, Control module 504 determines whether the second signal received on all antennas has been processed.

[0143] If processing is complete, proceed to step S1311; otherwise, continue with step S1307.

[0144] S1311, Control module 504 performs image summation.

[0145] For example, through S1309, the control module 504 obtains M first images. In S1311, the control module 504 can sum or stitch the M first images.

[0146] In step S1312, the control module 504 obtains the reconstruction result. Steps S1311 and S1312 can be the same step, and the reconstruction result can be the result obtained by the control module 504 executing step S1311. This reconstruction result is, for example, a super-resolution image.

[0147] Optionally, S1307 to S1312 belong to the signal processing flow, for example.

[0148] For a more detailed description of the various steps of the embodiment shown in Figure 13, please refer to the preceding description of the sensing device.

[0149] In summary, this embodiment of the application can add a RIS array 502 within the sensing device. The signal transmitted by the first antenna 501 or antenna array 503 within the sensing device can be transmitted into the environment by the RIS array 502; the echo of this signal can also be transmitted by the RIS array 502 back to the first antenna 501 or antenna array 503. The phase of the RIS array 502 is variable. By changing the phase of the RIS array 502, the signal transmitted by the first antenna 501 or antenna array 503 can be directed in different directions within the environment, achieving target scanning and sensing within the area. Furthermore, the pixel relocation method reduces the viewing angle difference between transmission and reception, and the RIS transmission aperture and MIMO reception aperture are fused in the signal domain, effectively forming a narrower point spread function, thereby improving azimuth resolution or imaging resolution. Optionally, the position of the RIS array 502 can be moved, further increasing the aperture of the RIS array 502, thereby further improving azimuth resolution or imaging resolution.

[0150] Figure 14 shows a schematic diagram of the structure of a device provided in an embodiment of this application. The device 1400 may be a sensing device or a circuit system of the sensing device as shown in any of the figures 5-7 and 10-13, used to implement the method corresponding to the sensing device in the above method embodiments. For example, one type of circuit system is a chip system.

[0151] Since the device 1400 in the embodiments of this application can implement a sensing method, the device 1400 can also be called a sensing device. In implementation, the device 1400 may have sensing function but no communication function, or it may have both sensing and communication functions. If the device 1400 has communication function, it may also be called a communication device, etc., without limitation.

[0152] Optionally, the device 1400 may be a communication device, or may be included in a communication device. The communication device may be, for example, a terminal device or a network device.

[0153] The device 1400 includes at least one processor 1401. The processor 1401 can be used for internal processing within the device to implement certain control processing functions. Optionally, the processor 1401 includes instructions. Optionally, the processor 1401 can store data. Optionally, different processors can be independent devices, located in different physical locations, or located on different integrated circuits. Optionally, different processors can be integrated into one or more processors, for example, integrated on one or more integrated circuits.

[0154] Optionally, the device 1400 includes one or more memories 1403 for storing instructions. Optionally, the memories 1403 may also store data. The processor and the memories may be separate or integrated together.

[0155] Optionally, the device 1400 includes a communication line 1402 and at least one communication interface 1404. Since the memory 1403, communication line 1402, and communication interface 1404 are all optional, they are all represented by dashed lines in FIG14.

[0156] Optionally, device 1400 may further include a transceiver and / or an antenna. The transceiver can be used to send information to or receive information from other devices. The transceiver may be referred to as a transceiver unit, transceiver circuit, input / output interface, etc., and is used to implement the transmission and reception functions of device 1400 via the antenna. Optionally, the transceiver includes a transmitter and a receiver. For example, the transmitter can be used to generate a radio frequency (RF) signal from a baseband signal, and the receiver can be used to convert the RF signal back into a baseband signal.

[0157] Optionally, one or more of the first antenna 501, antenna array 503, or RIS array 502 may be included in the antenna.

[0158] Processor 1401 may include a general-purpose central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of programs according to the present application.

[0159] Optionally, the control module 504 may be the processor 1401, or the processor 1401 may include the control module 504.

[0160] Communication line 1402 may include a path for transmitting information between the aforementioned components.

[0161] Communication interface 1404 uses any transceiver-like device for communicating with other devices or communication networks, such as Ethernet, radio access network (RAN), wireless local area network (WLAN), wired access network, etc.

[0162] Memory 1403 may be a read-only memory (ROM) or other type of static storage device capable of storing static information and instructions, random access memory (RAM) or other type of dynamic storage device capable of storing information and instructions, or electrically erasable programmable read-only memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compressed optical discs, laser discs, optical discs, digital universal optical discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or any other medium capable of carrying or storing desired program code in the form of instructions or data structures and accessible by a computer, but not limited thereto. Memory 1403 may exist independently and be connected to processor 1401 via communication line 1402. Alternatively, memory 1403 may be integrated with processor 1401.

[0163] The memory 1403 stores computer execution instructions for implementing the present application scheme, and its execution is controlled by the processor 1401. The processor 1401 executes the computer execution instructions stored in the memory 1403, thereby realizing the function or the steps performed by the sensing device in any of the embodiments shown in Figures 5-7 and Figures 10-13.

[0164] Optionally, the computer execution instructions in the embodiments of this application may also be referred to as application code, and the embodiments of this application do not specifically limit this.

[0165] In a specific implementation, as one embodiment, processor 1401 may include one or more CPUs, such as CPU0 and CPU1 in FIG14.

[0166] In a specific implementation, as one embodiment, device 1400 may include multiple processors, such as processor 1401 and processor 1405 in FIG. 14. Each of these processors may be a single-core (single-CPU) processor or a multi-core (multi-CPU) processor. Here, a processor may refer to one or more devices, circuits, and / or processing cores for processing data (e.g., computer program instructions).

[0167] When the device shown in Figure 14 is a chip, such as a sensing device chip, or if the sensing device is a chip, then the chip includes a processor 1401 (and may also include a processor 1405), a communication line 1402, and a communication interface 1404. Optionally, it may include a memory 1403. Specifically, the communication interface 1404 may be an input interface, pins, or circuits, etc. The memory 1403 may be a register, cache, etc. The processor 1401 and processor 1405 may be a general-purpose CPU, microprocessor, ASIC, or one or more integrated circuits for controlling the execution of a program for controlling the sensing method of any of the above embodiments.

[0168] This application embodiment can divide the device into functional modules according to the above method examples. For example, each function can be divided into a separate functional module, or two or more functions can be integrated into a processing module. The integrated module can be implemented in hardware or software. The module division in this application embodiment is illustrative and only represents one logical functional division; other division methods may exist in actual implementation. For example, when dividing the functional modules according to each function, Figure 15 is a schematic diagram of a device 1500, which can be the sensing device involved in the above method embodiments or a chip in a sensing device. The device 1500 includes a processing unit 1502 and a transceiver unit 1501. Since the device 1500 in this application embodiment can implement the sensing method, the device 1500 can also be called a sensing device. In implementation, the device 1500 may have sensing function but no communication function, or it may have both sensing and communication functions. If the device 1500 has communication function, it can also be called a communication device, etc., without limitation.

[0169] It should be understood that the device 1500 can be used to implement the functions of the sensing device in the embodiments of this application, and / or to implement the steps performed by the sensing device in the sensing method of the embodiments of this application. The relevant features can be referred to the embodiments shown in any of the above figures 5 to 7 and 10 to 13, which will not be repeated here.

[0170] Optionally, the functions / implementation processes of the transceiver unit 1501 and processing unit 1502 in Figure 15 can be implemented by the processor 1401 in Figure 14 calling computer execution instructions stored in memory 1403. Alternatively, the functions / implementation processes of the processing unit 1502 in Figure 15 can be implemented by the processor 1401 in Figure 14 calling computer execution instructions stored in memory 1403, and the functions / implementation processes of the transceiver unit 1501 in Figure 15 can be implemented by the communication interface 1404 in Figure 14.

[0171] Optionally, when the device 1500 is a chip or circuit, the function / implementation process of the transceiver unit 1501 can also be implemented through pins or circuits, etc. Optionally, the transceiver unit 1501 may include a transmitting unit and / or a receiving unit, whereby the transmitting unit implements the transmitting function and the receiving unit implements the receiving function; or, the transceiver unit 1501 may be an integral module capable of implementing both transmitting and / or receiving functions. Optionally, the transceiver unit 1501 can be implemented using a transceiver.

[0172] This application also provides a computer-readable storage medium storing a computer program or instructions that, when executed, implement the method performed by the sensing device in the aforementioned method embodiments. Thus, the functions described in the above embodiments can be implemented as software functional units and sold or used as independent products. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to it, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, ROM, RAM, magnetic disks, or optical disks.

[0173] This application also provides a computer program product comprising: computer program code, which, when run on a computer, causes the computer to perform the method executed by the sensing device in any of the foregoing method embodiments.

[0174] This application also provides a processing device, including a processor and an interface; the processor is used to execute the method executed by the sensing device involved in any of the above method embodiments.

[0175] In the above embodiments, implementation can be achieved entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state disk (SSD)).

[0176] The various illustrative logic units and circuits described in the embodiments of this application can be implemented or operate the described functions using a general-purpose processor, digital signal processor (DSP), ASIC, field-programmable gate array (FPGA), or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof. The general-purpose processor can be a microprocessor; alternatively, it can be any conventional processor, controller, microcontroller, or state machine. The processor can also be implemented using a combination of computing devices, such as a digital signal processor and a microprocessor, multiple microprocessors, one or more microprocessors combined with a digital signal processor core, or any other similar configuration.

[0177] The steps of the methods or algorithms described in the embodiments of this application can be directly embedded in hardware, software units executed by a processor, or a combination of both. The software units can be stored in RAM, flash memory, ROM, erasable programmable read-only memory (EPROM), EEPROM, registers, hard disks, removable disks, CD-ROMs, or any other form of storage medium in the art. Exemplarily, the storage medium can be connected to the processor so that the processor can read information from the storage medium and write information to the storage medium. Optionally, the storage medium can also be integrated into the processor. The processor and storage medium can be disposed in an ASIC, which can be disposed in the terminal device. Optionally, the processor and storage medium can also be disposed in different components of the terminal device.

[0178] These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process, such that the instructions, which execute on the computer or other programmable apparatus, provide steps for implementing the functions specified in one or more flowcharts and / or one or more block diagrams.

[0179] The contents of the various embodiments of this application can be referenced to each other. Unless otherwise specified or there is a logical conflict, the terms and / or descriptions between different embodiments are consistent and can be referenced to each other. The technical features in different embodiments can be combined to form new embodiments according to their inherent logical relationship.

[0180] It is understood that in the embodiments of this application, the sensing device may execute some or all of the steps in the embodiments of this application. These steps or operations are merely examples. In the embodiments of this application, other operations or variations of various operations may also be performed. Furthermore, the steps may be executed in different orders as presented in the embodiments of this application, and it is not necessary to execute all the operations in the embodiments of this application.

Claims

A sensing device, characterized in that, The sensing device includes a first antenna and a smart reconfigurable metasurface RIS array, wherein... The first antenna is used to transmit at least one first signal, which is transmitted into the environment via the RIS array, wherein each of the at least one first signal is used to sense a target in the environment, and each of the at least one first signal corresponds to a phase of the RIS array; The RIS array is used to receive at least one second signal, which arrives at the receiving link of the sensing device via the first antenna, wherein the at least one second signal is a signal reflected, scattered, or diffracted by one or more sensing targets in the environment as the at least one first signal. The sensing device according to claim 1 is characterized in that, The first antenna is an antenna array. The sensing device according to claim 2 is characterized in that, The first antenna is located at the center of the antenna array. The sensing device according to claim 2 or 3 is characterized in that, The distance between the antenna array and the RIS array is related to the size of the antenna array and / or the beamwidth of the second antenna in the antenna array. The sensing device according to any one of claims 1 to 4 is characterized in that, The sensing device further includes a control module, which is used to determine the phase of the RIS array corresponding to each first signal based on the location of the sensing target. The sensing device according to any one of claims 1 to 5 is characterized in that, The sensing device further includes a control module, the control module being used for: M first images corresponding to the one or more sensing targets are determined based on the at least one second signal, where M is a positive integer; Perception is performed based on the M first images. The sensing device according to claim 6 is characterized in that, The control module is configured to determine M first images corresponding to the one or more sensing targets based on the at least one second signal in the following manner: Channel estimation is performed on each of the second signals received on each antenna in the antenna array to obtain multiple channel estimation results; Based on the multiple channel estimation results, determine M second images corresponding to the one or more sensing targets; The M first images are determined based on the M second images. The sensing device according to claim 7 is characterized in that, The control module is used to determine the M first images based on the M second images in the following manner: The M first images are determined based on the coordinates of the M second images on the first plane and the second plane, wherein the first plane is the plane where the antenna array is located, and the second plane is the imaging plane. The sensing device according to any one of claims 1 to 8 is characterized in that, When transmitting the at least one first signal, the position of the RIS array remains unchanged; or, The RIS array is positioned differently when transmitting different first signals among the at least one first signal. The sensing device according to any one of claims 1 to 9 is characterized in that, The RIS array is a transmission array. A sensing method, characterized in that, Applied to a sensing device, the method includes: At least one first signal is transmitted through the first antenna of the sensing device, the at least one first signal is transmitted into the environment via the RIS array included in the sensing device, wherein each of the at least one first signal is used to sense a sensing target in the environment, and each of the at least one first signal corresponds to a phase of the RIS array; At least one second signal is received via a RIS array, wherein the at least one second signal reaches the receiving link of the sensing device via the first antenna, and wherein the at least one second signal is a signal reflected, scattered, or diffracted by one or more sensing targets in the environment as the at least one first signal. The method according to claim 11, characterized in that, The first antenna is an antenna array. The method according to claim 12, characterized in that, The first antenna is located at the center of the antenna array. The method according to claim 12 or 13 is characterized in that, The distance between the antenna array and the RIS array is related to the size of the antenna array and / or the beamwidth of the second antenna in the antenna array. The method according to any one of claims 11 to 14, characterized in that, The method further includes: The phase of the RIS array corresponding to each first signal is determined based on the location of the sensing target. The method according to any one of claims 11 to 15, characterized in that, The method further includes: M first images corresponding to the one or more sensing targets are determined based on the at least one second signal, where M is a positive integer; Perception is performed based on the M first images. The method according to claim 16, characterized in that, Determining M first images corresponding to the one or more sensing targets based on the at least one second signal includes: Channel estimation is performed on each of the second signals received on each antenna in the antenna array to obtain multiple channel estimation results; Based on the multiple channel estimation results, determine M second images corresponding to the one or more sensing targets; The M first images are determined based on the M second images. The method according to claim 17, characterized in that, Determining the M first images based on the M second images includes: The M first images are determined based on the coordinates of the M second images on the first plane and the second plane, wherein the first plane is the plane where the antenna array is located, and the second plane is the imaging plane. The method according to any one of claims 11 to 18, characterized in that, When transmitting the at least one first signal, the position of the RIS array remains unchanged; or, The RIS array is positioned differently when transmitting different first signals among the at least one first signal. The method according to any one of claims 11 to 19, characterized in that, The RIS array is a transmission array. A communication device, characterized in that, Includes the sensing device as described in any one of claims 1 to 10. An apparatus characterized in that, The apparatus includes a module for performing the method as described in any one of claims 11 to 20. An apparatus characterized in that, The apparatus includes a processor for performing the method as described in any one of claims 11 to 20. A computer-readable storage medium, characterized in that, The computer-readable storage medium is used to store a computer program that, when run on a computer, causes the method as described in any one of claims 11 to 20 to be performed. A computer program product, characterized in that, The computer program product includes a computer program that, when run on a computer, causes the computer to perform the method as described in any one of claims 11 to 20.

Images