Switching method and device of sensing equipment, electronic equipment and storage medium

Abstract

The invention provides a switching method and device of sensing equipment, electronic equipment and a storage medium, relates to the technical field of communication and sensing integration, and is used for preventing sensing interruption in a severe communication environment. The method is applied to a mobile terminal UE, and comprises the following steps: in response to a sensing data request, acquiring first sensing detection data of an environment in which the UE is located through a cellular sensing device; and in response to the detection that the cellular sensing device is in the unavailable state, acquiring second sensing detection data of the environment where the UE is located through an Internet of Things sensing device connected with the UE.

Description

Technical Field

[0001] This application relates to the field of integrated communication and sensing technology, and in particular to a switching method, apparatus, electronic device, and storage medium for sensing devices. Background Technology

[0002] Currently, integrated communication and sensing refers to the intrinsic sensing function within a cellular mobile communication system. In other words, the normal operation of cellular intrinsic sensing functions relies on the proper functioning and normal operation of the terrestrial mobile communication system. However, in remote mountainous areas, uninhabited areas, or areas affected by natural disasters, where communication is severely hampered, cellular intrinsic sensing functions may experience interruptions.

[0003] In related technologies, a common approach is to switch between different sensing devices or nodes within the same type of sensing technology or solution. However, in harsh communication environments, even switching to other sensing nodes cannot improve signal strength, leading to the technical problem of sensing interruption under such conditions. Summary of the Invention

[0004] This application provides a method, apparatus, electronic device, and storage medium for switching sensing devices, used to prevent sensing interruption in harsh communication environments.

[0005] In a first aspect, this application provides a method for switching sensing devices, which is applied to a mobile terminal UE, including: in response to a sensing data request, acquiring first sensing detection data of the environment in which the UE is located through a cellular sensing device; and in response to detecting that the cellular sensing device is unavailable, acquiring second sensing detection data of the environment in which the UE is located through an Internet of Things (IoT) sensing device connected to the UE.

[0006] The technical solution provided in this application offers at least the following advantages: By responding to sensing data requests sent by business applications, the first sensing detection data of the UE's environment is preferentially obtained through cellular sensing devices. When the cellular signal is interrupted or UE environmental data can no longer be obtained through cellular sensing (i.e., the cellular sensing device is unavailable), the cellular sensing device can be switched to an IoT sensing device connected to the UE to obtain the second sensing detection data of the UE's environment through the IoT sensing device. In other words, cellular sensing devices are preferentially used to sense UE environmental data to achieve wider coverage and higher communication reliability. However, cellular sensing devices have signal blind spots in remote areas. Therefore, in harsh communication environments, switching from cellular sensing devices to IoT sensing devices to sense UE environmental data prevents sensing interruption, solves the technical problem of sensing interruption in harsh communication environments, and achieves the technical effect of preventing sensing interruption in harsh communication environments.

[0007] One possible implementation involves detecting that a cellular sensing device is in an unavailable state, including: determining that the cellular sensing device is in an unavailable state in response to the cellular sensing device meeting a first handover condition; wherein the first handover condition includes at least one of the following: no first sensing detection data sent by the cellular sensing device is received within a preset time; or, the signal strength of the cellular sensing device is continuously less than or equal to a signal strength threshold within a preset time; or, the distance between the cellular sensing device and the UE is greater than a distance threshold.

[0008] Another possible implementation method further includes: in response to detecting that the cellular sensing device has become available again, reacquiring the first sensing detection data through the cellular sensing device.

[0009] Another possible implementation involves detecting that the cellular sensing device has returned to an available state, including: determining that the cellular sensing device has returned to an available state in response to the cellular sensing device meeting a second handover condition; wherein the second handover condition includes at least one of the following: the signal strength of the cellular sensing device is continuously greater than a signal strength threshold for a preset time; or, the distance between the cellular sensing device and the UE is less than or equal to a distance threshold.

[0010] Another possible implementation involves responding to a sensing data request and obtaining first sensing detection data of the UE's environment through a cellular sensing device, including: responding to a sensing data request by sending a first request message to the cellular sensing device, wherein the first request message is used to request the cellular sensing device to sense environmental data of the UE's environment; and receiving the first sensing detection data sent by the cellular sensing device.

[0011] Another possible implementation involves obtaining second sensing detection data of the UE's environment through an IoT sensing device connected to the UE, including: sending a second request message to the IoT sensing device, wherein the second request message is used to request the IoT sensing device to sense environmental data of the UE's environment; and receiving the second sensing detection data sent by the IoT sensing device.

[0012] Another possible implementation of the method further includes: in response to detecting that the cellular sensing device has returned to an available state, sending a third request message to the IoT sensing device, wherein the third request message is used to request the IoT sensing device to stop IoT sensing operations.

[0013] Secondly, this application provides a switching device for sensing devices, which is applied to a mobile terminal UE, including: a first acquisition module, configured to acquire first sensing detection data of the environment where the UE is located through a cellular sensing device in response to a sensing data request; and a second acquisition module, configured to acquire second sensing detection data of the environment where the UE is located through an Internet of Things (IoT) sensing device connected to the UE in response to detecting that the cellular sensing device is unavailable.

[0014] Thirdly, this application provides an electronic device comprising: a processor and a memory; the memory storing processor-executable instructions; when the processor is configured to execute the instructions, causing the electronic device to implement the method of the first aspect described above.

[0015] Fourthly, this application provides a computer-readable storage medium comprising: computer software instructions; which, when executed in an electronic device, cause the electronic device to implement the method described in the first aspect.

[0016] Fifthly, this application provides a computer program product comprising a computer program; when the computer program is run in an electronic device, it causes the electronic device to implement the method described in the first aspect.

[0017] The beneficial effects of the second to fifth aspects mentioned above are described in the corresponding description of the first aspect and will not be repeated here. Attached Figure Description

[0018] Figure 1 A schematic diagram of the architecture of a switching system for sensing devices provided in this application; Figure 2 A flowchart of a switching method for a sensing device provided in this application; Figure 3 A flowchart of another switching method for a sensing device provided in this application; Figure 4 A schematic diagram of the composition of a switching device for a sensing device provided in this application; Figure 5 This is a schematic diagram of the composition of an electronic device provided in this application. Detailed Implementation

[0019] The following is a detailed description of a switching method for a sensing device provided in this application, with reference to the accompanying drawings.

[0020] In this article, the term "and / or" is merely a description of the relationship between related objects, indicating that there can be three relationships. For example, A and / or B can represent three situations: A exists alone, A and B exist simultaneously, and B exists alone.

[0021] The terms "first" and "second," etc., used in the specification and drawings of this application are used to distinguish different objects or to distinguish different treatments of the same object, rather than to describe a specific order of objects.

[0022] Furthermore, the terms "comprising" and "having," and any variations thereof, used in the description of this application are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not limited to the steps or units listed, but may optionally include other steps or units not listed, or may optionally include other steps or units inherent to such process, method, product, or apparatus.

[0023] It should be noted that in the embodiments of this application, the words "exemplary" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design scheme described as "exemplary" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design schemes. Specifically, the use of the words "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.

[0024] To facilitate a clear description of the technical solutions of the embodiments of this application, the terms "first" and "second" are used in the embodiments of this application to distinguish the same or similar items with essentially the same function and effect. Those skilled in the art can understand that the terms "first" and "second" are not intended to limit the quantity or execution order.

[0025] In the description of this application, unless otherwise stated, "a plurality of" means two or more.

[0026] Currently, the integration of communication and sensing is an inevitable trend in the development of next-generation terrestrial mobile communication systems. In environments with poor communication, cellular intrinsic sensing capabilities can be affected. For example, in special circumstances such as signal interruption or when cellular intrinsic sensing cannot be used, it is necessary to address the issue of sensing function interruption and how to continue sensing.

[0027] In related technologies, methods are commonly used to switch between different sensing devices or different sensing nodes under the same type of sensing technology or the same type of sensing solution. These methods include: switching between different sensing devices that transmit sensing radio frequency signals under the same sensing technology, such as switching between different sensing devices that all use cellular intrinsic sensing, or switching between different sensing devices that all use IoT sensing; or switching between different backscattering devices that receive radio frequency signals under the same sensing technology; or, although considering the fusion of cellular intrinsic sensing measurement and sensor sensing measurement, it is still switching between different sensing devices under the same sensing technology solution, that is, switching between different sensing devices under the fusion of cellular intrinsic sensing and sensor sensing; or switching between different sensing devices under a wireless local area network.

[0028] In summary, the current sensing handover solutions in related technologies still involve switching between different sensing devices using the same sensing technology or the same sensing solution. For integrated cellular mobile communication systems operating in harsh communication environments, simply switching sensing devices cannot solve the sensing interruption problem, because even switching to other sensing node devices in harsh environments will not improve signal strength. Therefore, the current sensing handover solutions in related technologies cannot solve the sensing interruption problem of integrated cellular mobile communication systems operating in harsh communication environments.

[0029] To address the aforementioned technical issues, this application provides a method for switching sensing devices. Considering that data acquisition cannot be fully achieved through cellular intrinsic sensing functions, a large number of IoT sensing devices, such as sensors, are still required for data collection. In the short term, and even for a considerable period in the future, integrated communication and sensing cellular mobile communication systems will likely see a coexistence of IoT sensing devices such as sensors and cellular intrinsic sensing functions. Therefore, IoT sensing can be used to solve the problem of how to continue sensing in adverse communication environments where signal interruption or inability to use cellular intrinsic sensing functions is possible.

[0030] Based on this, this application prioritizes acquiring first-level sensing detection data of the UE's environment via cellular sensing devices in response to sensing data requests sent by business applications. When cellular signals are interrupted or UE environmental data can no longer be acquired via cellular sensing (i.e., the cellular sensing device is unavailable), the cellular sensing device can be switched to an IoT sensing device connected to the UE to acquire second-level sensing detection data of the UE's environment via the IoT sensing device. In other words, cellular sensing devices are prioritized for sensing UE environmental data to achieve wider coverage and higher communication reliability. However, cellular sensing devices have signal blind spots in remote areas. Therefore, in harsh communication environments, switching from cellular sensing devices to IoT sensing devices to sense UE environmental data prevents sensing interruption, solves the technical problem of sensing interruption in harsh communication environments, and achieves the technical effect of preventing sensing interruption in harsh communication environments.

[0031] The embodiments provided in this application will now be described in detail with reference to the accompanying drawings.

[0032] The switching method for sensing devices provided in this application can be applied to, for example... Figure 1 In the system architecture shown. Figure 1 This application provides a schematic diagram of the architecture of a switching system for sensing devices, as shown below. Figure 1 As shown, the system includes: a cellular sensing device 101, a mobile terminal (User Equipment, UE) 102, and an Internet of Things sensing device 103.

[0033] In some embodiments, the cellular sensing device 101 can be a cellular network infrastructure node undertaking environmental sensing tasks, such as a cellular base station with integrated sensing and communication capabilities. When the UE initiates an environmental data request, the base station registers the sensing service requirement with the sensing server in the core network through control plane signaling. After the sensing server issues sensing instructions and authorizes resources, the base station dynamically activates its built-in cellular sensing program. Under the premise of ensuring normal communication, it reuses or schedules dedicated time-frequency resources to transmit sensing detection signals and establishes a two-way sensing data channel between the UE and the sensing server, thereby realizing active detection and periodic feedback of the UE's environment.

[0034] For example, the base station uses downlink synchronization signals or dedicated sensing reference signals to illuminate the environment where the UE is located, receives multipath echoes reflected by the human body, objects or the UE itself, extracts arrival time, angle of arrival, Doppler frequency shift and channel state information through high-precision channel estimation, and combines beamforming to analyze the UE's position, motion state and the distribution of surrounding obstacles in real time at the edge side to form structured environmental data, and transmits the sensing results back to the UE through the user plane or dedicated signaling at a preset period to complete the closed-loop "request-sensing-feedback" process.

[0035] In some embodiments, the mobile terminal 102 and the IoT sensing device 103 are connected. For example, the IoT sensing device and the UE are in the same physical space and geographical location, and they are connected and communicate with the UE over short distances via wireless or wired means. Typically, the IoT sensing device and the UE can be integrated into the same hardware device, and the user carries the UE terminal and the IoT sensing device connected to the UE while moving.

[0036] In some embodiments, the IoT sensing device 103 can be an intelligent sensing terminal deployed near the UE, possessing environmental awareness capabilities and connected to the UE via non-cellular IoT communication technology. The IoT sensing device runs a lightweight sensing service program, continuously listening for request messages from the UE. Once it receives a data acquisition instruction, it activates the corresponding sensors to collect current environmental information and transmits the structured sensing data back to the UE via an established short-range wireless connection. The entire process does not rely on a cellular network or core network, making it suitable for localized sensing in harsh communication scenarios.

[0037] For example, IoT sensing devices directly measure the local physical environment of the UE using their built-in sensors. For instance, they may use infrared or millimeter-wave radar to detect human presence and activity, temperature and humidity sensors to record microclimate conditions, and microphones or cameras (if enabled) to capture acoustic and light features. Detection is typically triggered on demand or performed based on a preset cycle after receiving a request from the UE. The collected data is filtered and fused locally and then fed back to the UE in real time via a low-latency, short-range wireless link, enabling close-range, high-precision, and low-power perception of the surrounding environment.

[0038] It should be noted that the system architecture described in the embodiments of this application is for the purpose of more clearly illustrating the technical solutions of the embodiments of this application, and does not constitute a limitation on the technical solutions provided in the embodiments of this application. As those skilled in the art will know, with the evolution of system architecture, the technical solutions provided in the embodiments of this application are also applicable to similar technical problems.

[0039] Figure 2 A flowchart of a switching method for a sensing device provided in this application is shown below. Figure 2 As shown, the handover method for sensing devices provided in this application is applied to a mobile terminal (UE), and specifically includes the following steps S201~S202: S201. In response to the sensing data request, obtain the first sensing detection data of the environment where the UE is located through the cellular sensing device.

[0040] Among these, the perception data request can be issued by a business application (APP) on the mobile terminal UE to request perception data of the UE's environment, in order to obtain real-time status information of the user's physical environment, supporting a more intelligent, secure, personalized, or context-aware service experience. For example, in a rescue scenario, the business APP on the UE sends a perception data request to the UE to quickly and accurately obtain information about the physical environment of the trapped person, in order to support efficient, accurate, and safe emergency response and life rescue. For instance, in a life detection scenario in an earthquake or collapsed rubble, the business APP (e.g., an emergency rescue APP) requests the UE to obtain information about the presence of micro-movements (e.g., breathing, knocking) or human thermal signals through the sensing function of the cellular base station; in a search and rescue scenario for missing persons in the wild, the business APP (e.g., an outdoor survival APP) automatically requests the UE to obtain information about terrain obstruction, movement trajectory, and whether there are other device signals in the vicinity through cellular sensing after the user triggers an emergency distress call.

[0041] The mobile terminal (UE) can also be referred to as user equipment, terminal equipment, etc. The first sensing and detection data can be the data obtained by cellular sensing devices sensing and detecting the environment in which the UE is located.

[0042] For example, a sensing data request can be received from a service app on the UE. After receiving the sensing data request from the app, the UE responds by acquiring first sensing detection data through the base station. Further signal processing and intelligent analysis are performed on the first sensing detection data, such as signal preprocessing, target detection and parameter estimation, point cloud generation and clustering, motion state interpretation, semantic and structured output, etc., to obtain UE environmental data. The UE environmental data can include at least the static environmental data of the UE itself and the dynamic data of other objects in the environment. For example, the static environmental data of the UE itself can include at least: the UE's location, the distribution of surrounding obstacles, etc. The dynamic data of other objects can include at least: the number of people, their approximate location, whether they are stationary or moving; the motion state of other targets, such as speed and direction (e.g., running, slow crawling), micro-motion characteristics (e.g., chest rise and fall frequency), abnormal behavior (e.g., falling, struggling, prolonged stillness), etc.; the dynamics of non-human targets, such as vehicle movement (in road rescue), environmental disturbances caused by water flow, falling rocks, or aftershocks (indirectly sensed through signal disturbances), etc.

[0043] In some embodiments, in response to a sensing data request, obtaining first sensing detection data of the environment where the UE is located through a cellular sensing device includes: in response to a sensing data request, sending a first request message to the cellular sensing device; and receiving the first sensing detection data sent by the cellular sensing device.

[0044] The first request message can be used to request environmental data of the cellular sensing device regarding the environment in which the UE is located.

[0045] In some embodiments, the first sensing detection data is obtained by the cellular sensing device based on a received start command, which is initiated by the sensing server in the core network in response to the request from the cellular sensing device for sensing the environmental data of the UE.

[0046] For example, in response to a sensing data request from a service app, a first request message is sent to the base station to request cellular sensing UE environmental data. The base station can request cellular sensing UE environmental data from a sensing server in the core network. The sensing server in the core network sends a message to the base station, requesting the base station to perform cellular sensing on the UE environmental data and to make the cellular sensing-acquired UE environmental data available to the service app on the terminal device. Furthermore, the base station can initiate a cellular sensing program to continuously acquire UE environmental data and feed it back to the UE.

[0047] For example, the sensing service in this application can be initiated by a service APP, and the UE can continuously and periodically feed back the cellular sensing UE environment data received from the base station to the service APP. The service APP performs sensing data processing on each received cellular sensing real-time UE environment data sent by the UE to obtain and record the UE environment information at the current moment.

[0048] This application achieves integrated communication and sensing between the network and the terminal by having the UE respond to the sensing data request and send a first request message to the cellular sensing device, and then receive the first sensing detection data returned by the cellular sensing device. This improves the accuracy of environmental sensing, the efficiency of resource utilization, and the overall sensing capability of the system.

[0049] S202, In response to detecting that the cellular sensing device is unavailable, second sensing detection data of the environment in which the UE is located is obtained through an IoT sensing device connected to the UE.

[0050] The unavailable state can be used to characterize the interruption of the sensing function of cellular sensing devices. For example, in a poor communication environment, the sensing function of cellular sensing devices is interrupted. The second sensing detection data can be data obtained by IoT sensing devices from sensing and detecting the environment in which the UE is located. For example, IoT sensing devices can be smart sensing terminals connected to the UE through non-cellular IoT communication technologies, such as Wi-Fi, Bluetooth, Zigbee, Long Range (LoRa), and Narrowband Internet of Things (NB-IoT). For example, IoT sensing devices can be inertial navigation and positioning devices, vital sign monitoring devices, environmental parameter sensors, etc.

[0051] For example, when a user holding a UE mobile terminal is moving, if the cellular signal is interrupted or the UE environmental data can no longer be obtained through cellular sensing, i.e. the base station is in an unavailable state, the base station can be switched to an IoT sensing device to obtain the UE environmental data through the IoT sensing device.

[0052] In some embodiments, detecting that a cellular sensing device is in an unavailable state includes: determining that the cellular sensing device is in an unavailable state in response to the cellular sensing device meeting a first handover condition; wherein the first handover condition includes at least one of the following conditions 1-1 to conditions 1-3: Condition 1-1: No first sensing detection data is received from the cellular sensing device within the preset time.

[0053] The preset time can be set according to the actual communication environment. For example, the preset time can be 1 minute. This is just an example and there is no specific limit to the value of the preset time.

[0054] For example, if the UE does not receive the sensing data sent by the base station within the aforementioned preset time, and has confirmed that its own communication function is normal, the wireless link quality is good, the sensing request has been successfully sent to the base station, and external factors such as temporary core network congestion or sensing server processing delay have been ruled out, it can be indicated that the base station has failed to complete the sensing detection, data processing, or backhaul process. If this state persists, accompanied by the loss of synchronization signals, unreadable system information, or simultaneous interruption of regular communication services (such as data transmission and signaling interaction), it can be determined that the base station has lost its basic operating capabilities, and thus it is determined to be in an unavailable state, that is, it cannot provide communication services or perform environmental detection as a sensing device.

[0055] Conditions 1-2: The signal strength of the cellular sensing device remains less than or equal to the signal strength threshold for a preset time period.

[0056] The signal strength threshold can be the minimum signal strength limit for cellular sensing devices set according to actual conditions.

[0057] For example, when the signal strength received by the UE from the base station is less than the threshold, and this state is not caused by temporary obstruction, multipath fading, or the UE's own movement (e.g., low signal for a long time in a stationary state, or other UEs in the vicinity also reporting the same phenomenon), it indicates that the base station's transmission power is abnormal, the antenna system is faulty, the radio frequency unit is down, or the base station has stopped working normally due to power outage, hardware damage, natural disasters, etc. If this is accompanied by system information that cannot be decoded, synchronization signal loss, random access failure, and service plane communication interruption, it can be determined that the base station has lost its basic coverage and service capabilities, and thus it is determined to be in an unavailable state.

[0058] Conditions 1-3: The distance between the cellular sensing device and the UE is greater than the distance threshold.

[0059] The distance threshold can be the maximum distance between the cellular sensing device and the UE, set according to the actual situation.

[0060] For example, when the distance between the base station and the UE exceeds a set distance threshold, a sensing interruption may occur for the following reasons: As distance increases, path loss increases significantly, resulting in low power of the sensing detection signal sent by the base station reaching the UE, making it difficult to receive and analyze effectively; weak signals are easily overwhelmed by noise, reducing the accuracy of sensing data or even preventing effective sensing; time or angular resolution is limited at long distances, affecting the ability to estimate parameters such as target position and speed; if the distance between the two exceeds the maximum sensing range designed by the system, the sensing process may fail to start or fail midway. Therefore, in an integrated communication and sensing system, a reasonable distance threshold can be set to ensure sensing performance. Once this threshold is exceeded, a sensing interruption or failure will occur.

[0061] For example, in an integrated communication and sensing system, proactive response and predictive switching can be achieved through the following mechanism, allowing base stations to be switched in advance to IoT sensing devices for environmental sensing: Based on multi-dimensional information such as historical communication data, UE movement trajectory, channel state information, service load, and environmental context, intelligent predictive models such as machine learning or digital twins can be used to identify potential sensing needs in advance (e.g., users entering blind spots, exhibiting abnormal behavior, or impending obstruction or interference). Once it is predicted that the traditional communication link may not be able to meet sensing accuracy or coverage requirements in the near future, the base station switching mechanism is proactively triggered to switch it to an IoT sensing device. This ensures communication while proactively providing continuous and reliable environmental sensing capabilities, preventing sensing interruptions, and improving the overall robustness and intelligence of the system.

[0062] It should be noted that the above are merely illustrative examples. Different conditions in the first switching condition can be combined with each other or used individually as switching conditions. All first switching conditions that enable the switching of a cellular sensing device to an IoT sensing device are within the protection scope of this application.

[0063] This application enables sensing through an external IoT sensing device in the event of signal interruption or inability to continue using cellular intrinsic sensing, thereby preventing sensing interruption and providing better sensing performance for the entire business process.

[0064] In some embodiments, obtaining second sensing detection data of the environment where the UE is located through an IoT sensing device connected to the UE includes: sending a second request message to the IoT sensing device; and receiving the second sensing detection data sent by the IoT sensing device.

[0065] The second request message can be used to request environmental data of the environment in which the UE is located by the IoT sensing device.

[0066] For example, when a user holding a UE mobile terminal is moving and the cellular sensing device is unavailable, the following operations can be performed: The UE can send a message to a connected IoT sensing device, requesting IoT-sensing UE environmental data. After the IoT sensing device continuously acquires UE environmental data through IoT sensing and continuously feeds back the IoT-sensing UE environmental data to the UE, the UE can continuously receive second sensing detection data sent by the IoT sensing device. Further processing the second sensing detection data in the same or similar manner as the first sensing detection data described above can yield UE environmental data.

[0067] In some embodiments, environmental information at the current moment is determined based on first sensing detection data from the previous moment at the current moment and second sensing detection data at the current moment.

[0068] For example, the UE can periodically feed back the received UE environment data to the business application. After receiving the IoT-sensed real-time UE environment data sent by the UE each time, the business application can calculate the latest UE environment information at the current moment based on the UE environment information calculated after the last real-time UE environment data was received, and record it.

[0069] For example, when the IoT sensing device is an inertial navigation and positioning device, after switching the base station to the IoT sensing device, the user's position and velocity information are obtained through the inertial navigation and positioning device connected to the terminal device. Inertial navigation and positioning calculates the current position based on the previous position using components such as gyroscopes and accelerometers. Therefore, when the business app receives sensing data from the inertial navigation and positioning device for the first time after the switch, it needs to calculate the user's initial position information after the switch based on the user's position information obtained from the last cellular intracellular positioning before the switch. Subsequent calculations are based on the position information obtained from the previous inertial navigation and positioning, ultimately recording the changes in the user's position, velocity, acceleration, and other data over time during the entire signal interruption period.

[0070] This application enhances the continuity and robustness of the integrated communication and sensing system by enabling the use of IoT sensing devices to continuously sense UE environmental data after switching cellular sensing devices to IoT sensing devices, and supports real-time response and efficient collaboration of intelligent services (such as positioning, early warning, etc.).

[0071] Following S202, the switching method for sensing devices provided in this application embodiment further includes the following step S203: S203. In response to detecting that the cellular sensing device has returned to an available state, the first sensing detection data is reacquired through the cellular sensing device.

[0072] The available status can be used to characterize the state of the recovery of the sensing function of the cellular sensing device, such as the recovery of cellular signal or the acquisition of UE environmental data through cellular sensing.

[0073] For example, when a user holding a UE mobile terminal is moving, and the cellular signal is restored or the UE environmental data can be obtained through cellular sensing, i.e., the base station is restored to an available state, the IoT sensing device can be switched back to the base station to re-sensor the UE environmental data through the base station.

[0074] In some embodiments, detecting that a cellular sensing device has regained its usability includes: determining that the cellular sensing device has regained its usability in response to the cellular sensing device meeting a second handover condition; wherein the second handover condition includes at least one of the following conditions 2-1 to 2-2: Condition 2-1: The signal strength of the cellular sensing device is continuously greater than the signal strength threshold within a preset time period.

[0075] For example, when the UE receives a signal strength from the base station that is greater than the signal strength threshold and can maintain that signal strength for a preset time, it indicates that the wireless coverage of the base station has been stably restored and the link quality meets the communication requirements, and then it can be determined that the base station has recovered to an available state.

[0076] Condition 2-2: The distance between the cellular sensing device and the UE is less than or equal to the distance threshold.

[0077] For example, in a communication and sensing integrated system, once the UE enters the effective sensing coverage area of ​​the base station, i.e., the distance is less than or equal to the distance threshold, the sensing interruption or performance degradation problems previously caused by excessive distance can usually be automatically recovered or significantly improved to achieve continuous and high-quality environmental sensing.

[0078] For example, in an integrated communication and sensing system, an intelligent monitoring and prediction mechanism can be used to enable proactive and predictive back-switching of IoT sensing devices to base stations. This involves continuously evaluating indicators such as cellular link quality, UE movement trajectory, channel status, and the validity of sensing data, and combining historical data with models to predict when cellular sensing capabilities will recover or surpass IoT sensing capabilities. Once it is determined that the cellular network can stably provide high-precision, low-latency environmental sensing services (e.g., UE returning to cellular coverage area, obstruction disappearing, service demand increasing), resource reconfiguration is triggered in advance to seamlessly migrate sensing tasks back to the base station. This leverages the base station's stronger computing power, higher spectral efficiency, and superior beamforming capabilities for sensing, thereby ensuring sensing continuity while optimizing system resource utilization and improving overall sensing performance.

[0079] For example, when the base station meets the second handover condition described above, it can perform the following operations: resume using cellular sensing to continuously acquire UE environmental data, and continuously and periodically feed back the UE environmental data acquired by cellular sensing to the UE. The UE can continuously and periodically feed back the cellular sensing UE environmental data received from the base station to the service APP. After receiving the real-time cellular sensing UE environmental data sent by the UE each time, the service APP can calculate and record the UE environmental information at the current moment.

[0080] It should be noted that the above are merely illustrative examples. Different conditions in the second switching condition can be combined with each other or used as individual switching conditions. All second switching conditions that enable the IoT sensing device to switch back to the cellular sensing device are within the protection scope of this application.

[0081] This application allows the sensing task to be switched back to the base station from the IoT sensing device when the cellular signal is restored or reliable cellular sensing capability is available. This fully leverages the advantages of the base station, such as high bandwidth, strong computing power, precise beamforming, and low latency, to achieve higher accuracy and higher efficiency in environmental sensing. At the same time, it frees up IoT device resources, reduces system energy consumption, and ensures deep integration and collaborative optimization of communication and sensing.

[0082] In some embodiments, a third request message is sent to the IoT sensing device in response to detecting that the cellular sensing device has become available again.

[0083] The third request message can be used to request the IoT sensing device to stop the IoT sensing operation.

[0084] For example, after the UE periodically feeds back the cellular sensing UE environment data received from the base station to the service app, the UE can send a third request message to the IoT sensing device to request to stop IoT sensing. After the service app receives the real-time cellular sensing UE environment data sent by the UE, calculates and records the UE environment information at the current moment, the IoT sensing device stops obtaining real-time UE environment data through IoT sensing.

[0085] This application allows the UE to proactively send a stop sensing request to the IoT sensing device when the cellular signal is restored and the base station can effectively perform sensing tasks. This can promptly release the computing, communication, and energy resources of the IoT device, avoid redundant sensing and data conflicts, improve the overall energy efficiency and resource coordination efficiency of the system, and ensure that the sensing tasks are led by the higher-performance cellular base station, thus guaranteeing sensing accuracy and continuity.

[0086] The technical solutions provided by the above embodiments bring at least the following beneficial effects. The switching method for sensing devices provided in this application, by responding to sensing data requests sent by the service application, prioritizes obtaining the first sensing detection data of the UE's environment through cellular sensing devices. When the cellular signal is interrupted or UE environmental data can no longer be obtained through cellular sensing, i.e., when the cellular sensing device is unavailable, the cellular sensing device can be switched to an IoT sensing device connected to the UE to obtain the second sensing detection data of the UE's environment through the IoT sensing device. In other words, cellular sensing devices are used preferentially to sense UE environmental data to achieve wider coverage and higher communication reliability. However, cellular sensing devices have signal blind spots in remote areas. Therefore, in harsh communication environments, switching cellular sensing devices to IoT sensing devices to sense UE environmental data prevents sensing interruption, solves the technical problem of sensing interruption in harsh communication environments, and achieves the technical effect of preventing sensing interruption in harsh communication environments.

[0087] The following describes a specific embodiment of the switching method for the sensing device according to this application. The specific implementation process of this method is as follows: Figure 3 As shown. Figure 3 A flowchart of another switching method for a sensing device provided in this application is provided. The switching method for the sensing device may include the following steps: In this method, the first sensing device is a base station; the second sensing device is an IoT sensing device connected to the UE; the UE is the device that determines the handover conditions and initiates the sensing handover; the first handover condition is: the signal strength received by the UE from the first sensing device is less than a threshold, or the UE does not receive sensing data sent by the first sensing device within a preset time. The second handover condition is: the signal strength received by the UE from the first sensing device is greater than a threshold, and can remain greater than the threshold within a preset time.

[0088] S301, the business application sends a perception data request to the user.

[0089] For example, a service application on a user terminal sends a perception data request to the user equipment.

[0090] S302, the UE requests cellular-aware UE environment data from the base station.

[0091] For example, after receiving a sensing data request sent by a service APP, the UE requests cellular sensing UE environmental data from the base station.

[0092] S303, the base station requests cellular sensing UE environmental data from the sensing server.

[0093] For example, the base station requests cellular sensing UE environmental data from the sensing server in the core network.

[0094] S304, The sensing server requires the base station to perform cellular sensing on the UE's environmental data.

[0095] For example, the perception server in the core network sends a message to the base station, requesting the base station to perform cellular sensing on the UE environment data and to make the UE environment data obtained by cellular sensing available to the service APP on the terminal device.

[0096] S305, the base station acquires UE environmental data.

[0097] For example, the base station, as the first sensing device, initiates a cellular sensing procedure to continuously acquire real-time UE environmental data through cellular sensing.

[0098] S306, the base station sends UE environment data to the UE.

[0099] For example, the base station continuously and periodically feeds back the UE environmental data acquired by cellular sensing to the UE.

[0100] S307, the UE sends UE environment data to the service APP.

[0101] For example, the UE continuously and periodically feeds back the cellular-aware UE environment data received from the base station to the service APP.

[0102] S308, the business APP records UE environment data.

[0103] For example, after receiving real-time UE environment data sent by the UE each time, the business APP can calculate and record the UE environment information at the current moment.

[0104] When a user holding a UE mobile terminal is moving and the cellular signal is interrupted or the UE environmental data can no longer be obtained through cellular sensing, i.e., the first handover condition is met, the following operations are performed: S309, the UE requests IoT sensing UE environmental data from the IoT sensing device.

[0105] For example, the UE sends a message to a connected IoT sensing device, requesting IoT sensing UE environmental data.

[0106] S310, IoT sensing devices acquire UE environmental data.

[0107] For example, IoT sensing devices continuously acquire UE environmental data through IoT sensing.

[0108] S311, IoT sensing devices send UE environmental data to UE.

[0109] For example, IoT sensing devices continuously feed back IoT-sensing UE environmental data to the UE.

[0110] S312, the UE sends UE environment data to the service APP.

[0111] For example, the UE continuously feeds back the IoT sensing UE environmental data received from the IoT sensing device to the business APP periodically.

[0112] S313, the business APP records UE environment data.

[0113] For example, after each time the business APP receives IoT sensing real-time UE environment data sent by the UE, it can calculate and record the latest UE environment information at the current moment based on the UE environment information calculated after the last real-time UE environment data was received, combined with the latest real-time UE environment data received this time.

[0114] When a user holding a UE mobile terminal is moving, and the cellular signal is restored or the UE environmental data can be obtained through cellular sensing, i.e., the second handover condition is met, the following operations are performed: S314, the UE resumes using cellular sensing to obtain UE environmental data.

[0115] For example, the base station resumes using cellular sensing to continuously acquire UE environmental data.

[0116] S315, the base station sends UE environment data to the UE.

[0117] For example, the base station continuously and periodically feeds back the UE environmental data acquired by cellular sensing to the UE.

[0118] S316, requesting the IoT sensing device to stop IoT sensing.

[0119] For example, the UE continuously feeds back the cellular sensing UE environment data received from the base station to the service APP periodically, and sends messages to the IoT sensing device to request to stop IoT sensing.

[0120] S317, IoT sensing devices stop IoT sensing.

[0121] For example, after the business APP receives the real-time UE environment data sent by the UE each time, it calculates and records the UE environment information at the current moment, and the IoT sensing device stops obtaining real-time UE environment data through IoT sensing.

[0122] For example, when users move in poor communication environments, they can use specific service apps on the UE terminal for positioning and navigation based on the integrated communication sensing cellular mobile communication system. For instance, geological surveyors or rescue personnel may encounter interruptions in terrestrial mobile communication signals when working in remote areas with poor communication conditions. When both terrestrial and satellite communication signals are weak, this can be resolved by switching the sensing and positioning method within the integrated communication sensing cellular mobile communication system. During the movement of personnel to their destination, they carry a terminal device equipped with the integrated communication sensing cellular mobile communication system, connected to an inertial navigation and positioning device. Inertial navigation and positioning uses components such as gyroscopes and accelerometers to collect the direction and distance of the positioning terminal's movement, and calculates the current position based on dead reckoning methods, knowing the previous position. Inertial navigation and positioning has unlimited coverage, low cost, does not rely on external communication, has strong anti-interference capabilities, and high security, but it suffers from cumulative errors.

[0123] For example, when the integrated cellular mobile communication system has a good signal or when the user's location and speed information can be obtained through cellular intrinsic positioning sensing, the cellular positioning function is still used. During personnel movement, when cellular signal interruption occurs or the UE's location and speed cannot be obtained through cellular intrinsic positioning sensing, the base station can be switched to an IoT sensing device using the aforementioned sensing device switching method. This involves obtaining the user's location and speed information through an inertial navigation positioning device connected to the terminal device. Inertial navigation positioning calculates the current location based on the previous location using components such as gyroscopes and accelerometers. Therefore, when the business APP receives sensing data from the inertial navigation device for the first time after the switch, it needs to calculate the first user location information after the switch based on the user's location information obtained from the last cellular intrinsic positioning before the switch. Subsequent calculations are based on the location information obtained from the previous inertial navigation positioning, ultimately recording the changes in the user's location, speed, acceleration, and other data over time during the entire signal interruption period. During personnel movement, when the cellular signal is restored or the UE's location and speed can be obtained through cellular positioning, the IoT sensing device is switched back to cellular intrinsic positioning.

[0124] To address the challenges of sensing interruption and continued sensing in harsh communication environments within an integrated communication and sensing cellular mobile communication system, this application proposes a sensing switching solution. This solution allows sensing to continue even when signal interruption or the inability to utilize cellular intrinsic sensing, via external IoT sensing devices. Once cellular signal is restored, the sensing data collected during the interruption is uploaded to the requesting party. This sensing method for harsh communication environments ensures uninterrupted location information acquisition for individuals in remote areas. Users can still obtain their location information even with interrupted cellular signals, facilitating target location locating and movement tracking in the field, thus reducing risks to personal safety and property. The integrated communication and sensing system possesses cellular intrinsic sensing capabilities. In this system, cellular sensing coexists with external IoT sensing devices such as sensors, providing opportunities for selecting sensing technologies in harsh communication environments. Switching sensing technologies in harsh environments prevents sensing interruption, thereby providing better sensing performance for the entire service process.

[0125] In integrated cellular mobile communication systems, a sensing switching solution is proposed to address the issue of signal interruption or inability to acquire UE environmental data via cellular intrinsic sensing under adverse communication conditions, leading to the interruption of cellular intrinsic sensing and the inability to continue sensing. When signal conditions are poor, the system switches from cellular intrinsic sensing to IoT sensing, which can achieve sensing without cellular mobile communication signals: As the user moves, signal conditions change; when the signal is good and UE environmental data can be acquired via cellular intrinsic sensing, the cellular intrinsic sensing function acquires the data; when the signal is interrupted or UE environmental data can no longer be acquired via cellular intrinsic sensing, the cellular intrinsic sensing function is interrupted, and the system quickly switches to IoT sensing. IoT sensing is implemented by IoT devices such as sensors. These IoT devices are in the same physical space as the UE and are connected to the UE via wired or wireless means, achieving sensing functionality without the need for cellular system communication sensing wireless signals. When signal conditions recover, the system switches back to cellular intrinsic sensing: During user movement, when the signal recovers and UE environmental data can be acquired via cellular intrinsic sensing, the system switches back to cellular intrinsic sensing.

[0126] As can be seen, the above mainly describes the solutions provided by the embodiments of this application from a methodological perspective. To achieve the above functions, the embodiments of this application provide corresponding hardware structures and / or software modules for executing each function. Those skilled in the art should readily recognize that, in conjunction with the modules and algorithm steps of the various examples described in the embodiments disclosed herein, the embodiments of this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed by hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this invention.

[0127] In some embodiments, this application also provides a switching device for sensing devices. This switching device may include one or more functional modules for implementing the sensing device switching method of the above method embodiments.

[0128] Figure 4 This is a schematic diagram illustrating the composition of a switching device for a sensing device provided in this application. Figure 4 As shown, the switching device of the sensing device includes: a first acquisition module 401 and a second acquisition module 402.

[0129] The first acquisition module 401 is used to respond to the sensing data request and acquire the first sensing detection data of the environment where the UE is located through the cellular sensing device.

[0130] The second acquisition module 402 is used to acquire second sensing detection data of the environment where the UE is located through an IoT sensing device connected to the UE in response to detecting that the cellular sensing device is unavailable.

[0131] In some embodiments, the second acquisition module 402 is used to detect that the cellular sensing device is in an unavailable state, including: a first determination unit, used to determine that the cellular sensing device is in an unavailable state in response to the cellular sensing device meeting a first handover condition; wherein the first handover condition includes at least one of the following: no first sensing detection data sent by the cellular sensing device is received within a preset time; or, the signal strength of the cellular sensing device is continuously less than or equal to a signal strength threshold within a preset time; or, the distance between the cellular sensing device and the UE is greater than a distance threshold.

[0132] In other embodiments, the apparatus further includes a third acquisition module, configured to reacquire the first sensing detection data via the cellular sensing device in response to detecting that the cellular sensing device has become available again.

[0133] In some other embodiments, the third acquisition module is used to detect that the cellular sensing device has recovered to an available state, including: a second determination unit, used to determine that the cellular sensing device has recovered to an available state in response to the cellular sensing device meeting a second handover condition; wherein the second handover condition includes at least one of the following: the signal strength of the cellular sensing device is continuously greater than a signal strength threshold for a preset time; or, the distance between the cellular sensing device and the UE is less than or equal to a distance threshold.

[0134] In some other embodiments, the first acquisition module 401 is configured to respond to a sensing data request and acquire first sensing detection data of the environment in which the UE is located through a cellular sensing device, including: a first sending unit, configured to respond to the sensing data request and send a first request message to the cellular sensing device, wherein the first request message is used to request the cellular sensing device to sense environmental data of the environment in which the UE is located; and a first receiving unit, configured to receive the first sensing detection data sent by the cellular sensing device. In some other embodiments, the second acquisition module 402 is used to acquire second sensing detection data of the environment in which the UE is located through an IoT sensing device connected to the UE, including: a second sending unit, used to send a second request message to the IoT sensing device, wherein the second request message is used to request the IoT sensing device to sense environmental data of the environment in which the UE is located; and a second receiving unit, used to receive the second sensing detection data sent by the IoT sensing device.

[0135] In some other embodiments, the apparatus further includes a sending module, configured to send a third request message to an IoT sensing device in response to detecting that the cellular sensing device has returned to an available state, wherein the third request message is configured to request the IoT sensing device to stop IoT sensing operations.

[0136] In the case of implementing the functions of the integrated modules described above in hardware, this embodiment of the invention provides a possible structural schematic diagram of the electronic device involved in the above embodiments. Figure 5 A schematic diagram of the composition of an electronic device provided in this application, such as... Figure 5 As shown, the electronic device 500 includes: a processor 502, a communication interface 503, and a bus 504. Optionally, the electronic device 500 may also include a memory 501.

[0137] Processor 502 may implement or execute various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of this application. Processor 502 may be a central processing unit, a general-purpose processor, a digital signal processor, an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It may implement or execute various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of this application. Processor 502 may also be a combination that implements computing functions, such as including one or more microprocessor combinations, a combination of a DSP and a microprocessor, etc.

[0138] Communication interface 503 is used to connect to other devices via a communication network. This communication network can be Ethernet, wireless access network, wireless local area network (WLAN), etc.

[0139] The memory 501 may be a read-only memory (ROM) or other type of static storage device capable of storing static information and instructions, random access memory (RAM) or other type of dynamic storage device capable of storing information and instructions, or electrically erasable programmable read-only memory (EEPROM), disk storage medium or other magnetic storage device, or any other medium capable of carrying or storing desired program code in the form of instructions or data structures and accessible by a computer, but is not limited thereto.

[0140] In one possible implementation, the memory 501 can exist independently of the processor 502. The memory 501 can be connected to the processor 502 via a bus 504 and is used to store instructions or program code. When the processor 502 calls and executes the instructions or program code stored in the memory 501, it can implement the switching method for the sensing device provided in this embodiment of the invention.

[0141] In another possible implementation, the memory 501 can also be integrated with the processor 502.

[0142] Bus 504 can be an extended industry standard architecture (EISA) bus, etc. Bus 504 can be divided into address bus, data bus, control bus, etc. For ease of representation, Figure 5 The bus is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.

[0143] Through the above description of the implementation methods, those skilled in the art can clearly understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the service calling device can be divided into different functional modules to complete all or part of the functions described above.

[0144] This application also provides a computer-readable storage medium. All or part of the processes in the above method embodiments can be executed by computer instructions instructing related hardware. The program can be stored in the aforementioned computer-readable storage medium, and when executed, it can include the processes of the above method embodiments. The computer-readable storage medium can be any of the foregoing embodiments or memory. The aforementioned computer-readable storage medium can also be an external storage device of the aforementioned service invocation device, such as a plug-in hard drive, smart media card (SMC), secure digital (SD) card, flash card, etc., equipped on the aforementioned service invocation device. Further, the aforementioned computer-readable storage medium can include both internal storage units of the aforementioned service invocation device and external storage devices. The aforementioned computer-readable storage medium is used to store the aforementioned computer program and other programs and data required by the aforementioned service invocation device. The aforementioned computer-readable storage medium can also be used to temporarily store data that has been output or will be output.

[0145] This application also provides a computer program product, which includes a computer program that, when run on a computer, causes the computer to execute any of the sensing device switching methods provided in the above embodiments.

[0146] The above are merely specific embodiments of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A method for switching sensing devices, characterized in that, Applied to mobile terminal UE, including: In response to a sensing data request, the system acquires first sensing detection data of the environment in which the UE is located through a cellular sensing device. In response to detecting that the cellular sensing device is unavailable, second sensing detection data of the environment in which the UE is located is obtained through an IoT sensing device connected to the UE.

2. The method according to claim 1, characterized in that, The detection that the cellular sensing device is unavailable includes: In response to the cellular sensing device meeting a first handover condition, it is determined that the cellular sensing device is in the unavailable state; wherein the first handover condition includes at least one of the following: If the first sensing detection data sent by the cellular sensing device is not received within a preset time; or, The signal strength of the cellular sensing device remains less than or equal to the signal strength threshold for the preset time period; or, The distance between the cellular sensing device and the UE is greater than a distance threshold.

3. The method according to claim 1, characterized in that, The method further includes: In response to the detection that the cellular sensing device has returned to an available state, the first sensing detection data is reacquired through the cellular sensing device.

4. The method according to claim 3, characterized in that, The detection that the cellular sensing device has returned to an available state includes: In response to the cellular sensing device meeting a second handover condition, it is determined that the cellular sensing device has resumed the available state; wherein the second handover condition includes at least one of the following: The signal strength of the cellular sensing device remains greater than the signal strength threshold for a preset time period; or, The distance between the cellular sensing device and the UE is less than or equal to a distance threshold.

5. The method according to claim 1, characterized in that, The response to the sensing data request, obtaining first sensing detection data of the environment where the UE is located through the cellular sensing device, includes: In response to the sensing data request, a first request message is sent to the cellular sensing device, wherein the first request message is used to request the cellular sensing device to sense the environmental data of the environment in which the UE is located; Receive the first sensing and detection data sent by the cellular sensing device.

6. The method according to claim 1, characterized in that, The acquisition of second sensing and detection data of the environment in which the UE is located through an IoT sensing device connected to the UE includes: Send a second request message to the IoT sensing device, wherein the second request message is used to request the IoT sensing device to sense environmental data of the environment in which the UE is located; Receive the second sensing and detection data sent by the IoT sensing device.

7. The method according to claim 3, characterized in that, The method further includes: In response to detecting that the cellular sensing device has resumed its available state, a third request message is sent to the IoT sensing device, wherein the third request message is used to request the IoT sensing device to stop IoT sensing operations.

8. A switching device for sensing devices, characterized in that, Applied to mobile terminal UE, including: The first acquisition module is used to respond to a sensing data request and acquire first sensing detection data of the environment where the UE is located through a cellular sensing device. The second acquisition module is used to acquire second sensing detection data of the environment where the UE is located through an IoT sensing device connected to the UE in response to detecting that the cellular sensing device is unavailable.

9. An electronic device, characterized in that, It includes a processor and a memory, the processor being coupled to the memory; the memory is used to store computer instructions, which are loaded and executed by the processor to enable the computer device to perform the method as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes computer-executable instructions that, when executed on a computer, cause the computer to perform the method of any one of claims 1 to 7.

11. A computer program product, characterized in that, The computer program product includes a computer program that, when run on an electronic device, causes the electronic device to perform the method as described in any one of claims 1 to 7.

Images