Device remote control method, system, and electronic device, vehicle

Abstract

This invention discloses a remote control method, system, electronic device, and vehicle, relating to the field of vehicle technology. The remote control method includes: acquiring the communication status of the vehicle, wherein the communication status includes the status of a first communication link between the vehicle and the cloud, and the status of a second communication link between the vehicle and the device; detecting network outage levels based on the communication status, and determining a target control mode based on the detected network outage level; and responding to a control command by remotely controlling the corresponding device based on the target control mode. Therefore, by real-time monitoring of the dual-link communication status between the vehicle and the cloud, and between the vehicle and the device, and dynamically adjusting the remote control mode according to the network outage level, appropriate control strategies can be adapted to different network environments, thereby improving the scenario adaptability and reliability of remote control.

Description

Technical Field

[0001] This invention relates to the field of vehicle technology, and more particularly to a remote control method, system, electronic device, and vehicle. Background Technology

[0002] Currently, the mainstream solution for interconnecting vehicles and remote devices relies on cloud servers for command forwarding: the vehicle connects to the cloud server via a 4G / 5G cellular network, the cloud server forwards commands to the gateway on the remote device side, and the gateway then controls the specific terminal device to execute the operation. This three-tier architecture of "vehicle → cloud → device" can meet basic requirements under normal network conditions.

[0003] However, the above technologies still have the following unresolved pain points: First, the system becomes ineffective when the network is down. When a vehicle enters underground parking garages, mountainous areas, tunnels, or other areas with no cellular signal, or when the network on the remote device side is interrupted, vehicle-side control commands become completely unexecutable. Some related technologies focus on the vehicle's own network fault recovery, such as using dual APN (Access Point Name) connections and network status detection to perform redialing or restart the entire device to restore the vehicle's network connection when a network anomaly is detected. However, these technologies only address the vehicle's own network recovery problem and do not provide a backup execution solution for vehicle-side control commands during network outages.

[0004] Secondly, path redundancy leads to latency. Even if the vehicle has entered the vicinity of the remote device (within meters), the command still needs to travel a long distance via "vehicle → cloud → device," which not only increases transmission latency but also wastes network resources. Although some technologies focus on near-field communication between vehicles and devices, such as using UWB (Ultra-Wideband) anchors for authentication and distance measurement to achieve vehicle control, these technologies mainly solve the near-field communication problem between the vehicle and mobile devices and have not been extended to cross-space direct control scenarios between the vehicle and remote devices.

[0005] Third, there is a lack of a mechanism for caching commands during network outages. User control requests generated during network outages cannot be temporarily stored, requiring users to re-perform them once the network is restored, resulting in a fragmented user experience. Existing caching technologies primarily target data response caching, rather than network-outage caching of control commands.

[0006] Fourth, there is a lack of tiered network outage protection strategies. Existing technologies handle network anomalies in a relatively simple way (such as uniformly executing redial), failing to adopt differentiated response strategies based on different levels of network outage (such as cloud communication anomalies, complete cloud disconnection, and all links being unavailable), making it difficult to strike a balance between ensuring a real-time control experience and ensuring reliable command execution. Summary of the Invention

[0007] This invention aims to at least partially solve one of the technical problems in related technologies. Therefore, the purpose of this invention is to propose a method, system, electronic device, and vehicle for remote control of equipment, which dynamically adapts control strategies through dual-link status monitoring and hierarchical network outage detection, thereby improving the scenario adaptability and reliability of remote control.

[0008] In a first aspect, embodiments of the present invention propose a method for remote control of a device, comprising: acquiring the communication status of a vehicle, wherein the communication status includes a first communication link status between the vehicle and the cloud, and a second communication link status between the vehicle and the device; performing network outage level detection based on the communication status, and determining a target control mode based on the detected network outage level; and responding to a control command, remotely controlling the device corresponding to the control command based on the target control mode.

[0009] In some embodiments, the step of detecting the network outage level based on the communication status and determining the target control method based on the detected network outage level includes: if the first communication link is abnormal but not disconnected, and the second communication link is available, then it is determined to be a minor network outage, and the target control method is determined to be: sending the control command to the device through the second communication link; if the first communication link is disconnected, and the second communication link is available, then it is determined to be a moderate network outage, and the target control method is determined to be: sending the control command to the device through the second communication link, and storing the control command in a local queue and marking it as pending synchronization; if both the first communication link and the second communication link are unavailable, then it is determined to be a severe network outage, and the target control method is determined to be: storing the control command in a local queue and marking it as pending transmission.

[0010] In some embodiments, the first communication link being abnormal but not disconnected means that the communication delay between the vehicle and the cloud exceeds a first threshold and / or the packet loss rate exceeds a second threshold; the first communication link being disconnected means that the communication heartbeat between the vehicle and the cloud times out more than a preset number of times.

[0011] In some embodiments, the method further includes: in response to the first communication link returning to normal, sending the pending control instructions in the local queue to the cloud in order of priority, wherein the pending control instructions include a control instruction to be synchronized and a control instruction to be sent; receiving the current state of the device returned by the device and comparing it with the expected state of the pending control instructions sent to the cloud; and updating the flag state of the pending control instructions according to the comparison result.

[0012] In some embodiments, updating the marking status of the control instruction to be processed based on the comparison result includes: if the current state of the device is consistent with the expected state of the control instruction to be processed, then updating the marking status of the control instruction to be processed to synchronized; if the current state of the device is inconsistent with the expected state of the control instruction to be processed, then resolving the conflict according to a preset rule, and updating the marking status of the control instruction to be processed to processed based on the conflict resolution result.

[0013] In some embodiments, the preset rule is one of the following: The instructions from the vehicle during the network outage shall prevail; Manual operation on the device side shall prevail; The latest timestamp of the instruction or operation shall prevail; Push notifications are decided by the user.

[0014] In some embodiments, the method further includes: controlling the central control screen of the vehicle to display at least one of the following information: The status of the first communication link and the second communication link; The target control method; The control instructions and their marked status in the local queue; Network restoration notification; Conflict resolution notification.

[0015] Secondly, embodiments of the present invention propose a remote control system for a device, comprising: an acquisition module, configured to acquire the communication status of a vehicle, wherein the communication status includes a first communication link status between the vehicle and the cloud, and a second communication link status between the vehicle and the device; a detection and decision module, configured to detect network outage levels based on the communication status, and determine a target control mode based on the detected network outage level; and a control module, configured to respond to control commands and remotely control the corresponding device based on the target control mode.

[0016] Thirdly, embodiments of the present invention provide an electronic device, including a memory, a processor, and a computer program stored in the memory, wherein when the computer program is executed by the processor, it implements the device remote control method described in the first aspect embodiment.

[0017] Fourthly, embodiments of the present invention provide a vehicle comprising: the device remote control system described in the second aspect embodiment, and / or the electronic device described in the third aspect embodiment.

[0018] The device remote control method, system, electronic device, and vehicle of this invention first acquire the communication status of the vehicle, including the status of a first communication link between the vehicle and the cloud, and the status of a second communication link between the vehicle and the device. Then, based on the communication status, a network outage level is detected, and a target control method is determined according to the detected outage level. Subsequently, in response to a control command, remote control is performed on the corresponding device based on the target control method. Therefore, by real-time monitoring of the dual-link communication status between the vehicle and the cloud, and between the vehicle and the device, and dynamically adjusting the remote control method according to the network outage level, appropriate control strategies can be adapted to different network environments, thereby improving the scenario adaptability and reliability of remote control.

[0019] Additional aspects and advantages of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. Attached Figure Description

[0020] Figure 1 This is a flowchart of a device remote control method according to an embodiment of the present invention; Figure 2 This is a schematic diagram of the structure of a controller for implementing a remote control method for a device according to an embodiment of the present invention; Figure 3 This is a schematic diagram illustrating the establishment of a UWB local direct connection according to an embodiment of the present invention; Figure 4 This is a flowchart of a device remote control method according to another embodiment of the present invention; Figure 5 This is a schematic diagram of a local queue according to an embodiment of the present invention; Figure 6 This is a flowchart of a device remote control method according to a specific embodiment of the present invention; Figure 7 This is a structural block diagram of an electronic device according to an embodiment of the present invention; Figure 8 This is a structural block diagram of the device remote control system according to an embodiment of the present invention. Detailed Implementation

[0021] Embodiments of the present invention are described in detail below, examples of which are illustrated in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and intended to explain the present invention, and should not be construed as limiting the present invention.

[0022] The following description, with reference to the accompanying drawings, outlines a remote control method, system, electronic device, and vehicle according to embodiments of the present invention.

[0023] Figure 1 This is a flowchart of a device remote control method according to an embodiment of the present invention. The method can be executed by a controller, which can be installed on a vehicle. The method can be applied to at least one of the following scenarios: Vehicle and smart home remote control: Users can remotely control smart devices in their homes, such as air conditioners, lights, and curtains, from their vehicles while driving. Offline collaborative control between RV and campsite facilities: After the RV enters the campsite, it establishes a local direct connection with the campsite equipment (such as water and electricity piles, sewage system, security equipment) to realize equipment control and status monitoring in the offline environment; Command relay between the lead vehicle and the tail vehicle when the convoy is traveling: When the convoy is traveling in a signal blind spot, the lead vehicle sends commands to the tail vehicle or other vehicles through a local direct link to achieve multi-vehicle collaborative control and information relay; Vehicle-to-Company / Office Network Disconnection Control: While driving to the company, users can remotely control office equipment (such as air conditioning, lighting, and office equipment) through the vehicle, and ensure that commands can be executed through local direct connection in case of network failure; Vehicle-to-charging-station offline charging reservation: When a vehicle approaches a charging station, it establishes communication with the charging station through a local direct link to realize online charging reservation, charging status inquiry and payment authentication in offline environments.

[0024] like Figure 1 As shown, the remote control method for the device includes: S11, obtain the communication status of the vehicle, wherein the communication status includes the status of the first communication link between the vehicle and the cloud, and the status of the second communication link between the vehicle and the device.

[0025] Specifically, such as Figure 2 As shown, the controller may include a multipath communication module, which is responsible for establishing and maintaining multiple communication links with the home terminal, including: Cellular communication unit: used to establish the first communication link (such as 4G / 5G) between the vehicle and the cloud. Specifically, it can be connected to the cloud server through the mobile communication network, and the cloud server can then connect to the gateway on the device, such as a home gateway. Local Direct Connection Unit: This unit includes one or more of the following: UWB communication submodule, Bluetooth communication submodule, 60GHz millimeter-wave communication submodule, Wi-Fi Direct communication submodule, and LiFi (Light Fidelity) communication submodule. It is used to establish a second communication link (such as UWB or Bluetooth) between the vehicle and the device. The UWB communication submodule uses a TOF (Time of Flight) algorithm for ranging and data transmission; the Bluetooth mesh submodule is used for command transmission in low-power scenarios.

[0026] Communication status detection unit: used to detect indicators such as availability, signal strength, latency, and packet loss rate of each communication link in real time. Its detection methods may include at least one of the following: heartbeat packet timeout detection, TCP (Transmission Control Protocol) connection failure detection, DNS (Domain Name System) resolution failure detection, ping command timeout detection, and signal strength threshold judgment.

[0027] S12, perform network outage level detection based on communication status, and determine the target control method based on the detected network outage level.

[0028] In some embodiments of the present invention, network outage level detection is performed based on the communication status, and a target control method is determined based on the detected network outage level, including: if the first communication link is abnormal but not disconnected, and the second communication link is available, it is determined to be a minor network outage, and the target control method is determined to be: sending control commands to the device through the second communication link; if the first communication link is disconnected, and the second communication link is available, it is determined to be a moderate network outage, and the target control method is determined to be: sending control commands to the device through the second communication link, and storing the control commands in a local queue and marking them as pending synchronization; if both the first and second communication links are unavailable, it is determined to be a severe network outage, and the target control method is determined to be: storing the control commands in a local queue and marking them as pending transmission.

[0029] In some examples, "the first communication link is abnormal but not disconnected" means that the communication delay between the vehicle and the cloud exceeds a first threshold and / or the packet loss rate exceeds a second threshold; "the first communication link is disconnected" means that the communication heartbeat between the vehicle and the cloud times out continuously more than a preset number of times.

[0030] Specifically, such as Figure 2 As shown, the controller also includes a network outage detection and decision-making module. This module is used to determine the current network outage level based on the vehicle's communication status and dynamically select a communication path. The network outage level is divided into three levels, as shown in Table 1 below: Table 1

[0031] The specific judgment logic is as follows: When the cloud communication link is normal, the normal cloud control mode is executed, that is, control commands are sent to the cloud through the first communication link, and then forwarded to the device by the cloud to achieve remote control of the target device. When the cloud communication link is abnormal (latency exceeds the first threshold or packet loss rate exceeds the second threshold) and the local direct connection link can be established, it is judged as a mild network outage; when the cloud communication link is completely disconnected (multiple consecutive heartbeat timeouts) and the local direct connection link can be established, it is judged as a moderate network outage; when the cloud communication link is disconnected and the local direct connection link cannot be established, it is judged as a severe network outage.

[0032] The first and second thresholds can be configured according to design requirements and user experience requirements.

[0033] S13, in response to a control command, remotely controls the corresponding device based on the target control method.

[0034] Specifically, see Figure 2 The controller also includes a local direct connection establishment module, which automatically establishes a direct connection channel, i.e., a second communication link (such as UWB, Bluetooth, etc.), when the vehicle approaches the device (such as a smart home device). The local direct connection establishment module includes: Anchor point discovery unit: When a vehicle enters a preset range, the UWB / Bluetooth communication submodule is activated to scan preset device-side anchor points (base stations with known locations, used for positioning and communication). Taking smart home devices as an example, device-side anchor points can be integrated into devices such as smart door locks, charging piles, door cameras, smart electricity / water meters, community public gateways / edge computing nodes, etc. Security Authentication Unit: Used for two-way authentication using at least one of the following: pre-shared key, digital certificate, biometrics (such as voiceprint, face), and OTP (One-Time Password) to ensure secure communication; Direct connection channel establishment unit: After two-way authentication is successful, a UWB / Bluetooth direct connection channel is established for command transmission.

[0035] See Figure 2 The controller also includes a local command queue module, which is used for command caching and management during network outages. This module includes a command cache unit. During network outages, this unit stores user-initiated control commands into local non-volatile memory, which can be stored in timestamp order to form a command queue. Each command record includes, but is not limited to: command ID, command type, target device, execution parameters, timestamp, and priority.

[0036] Specifically, when a mild or moderate network outage is identified, a second communication link between the vehicle and the device can be established through the local direct connection establishment module. If the vehicle receives a control command from the user, it sends the control command to the device through the second communication link. The device gateway then sends the control command to the corresponding device to control the device.

[0037] For example, such as Figure 3 As shown, the vehicle's central control screen invokes the UWB communication submodule and memory to execute a local direct-connection control process. The UWB communication submodule is responsible for transmitting and receiving ultra-wideband signals, while the memory pre-stores home anchor point identifiers (such as a home ID). The vehicle sends control commands to the home end via the UWB communication submodule. The home's UWB anchor point (such as a smart door lock or a dedicated positioning anchor point) receives the UWB signal and verifies the vehicle information. After successful verification, the UWB anchor point connects to the home gateway via a local wireless network (such as Wi-Fi), establishing a second communication link. Subsequently, the control commands are distributed to various smart devices under the home gateway, such as washing machines, water heaters, refrigerators, robot vacuums, and air purifiers.

[0038] Furthermore, in the event of a minor network outage, since the first communication link is not disconnected but there is a high latency or high packet loss anomaly, the vehicle can asynchronously attempt to synchronize the control command to the cloud through the first communication link while sending the command through the second communication link, so as to ensure the integrity of the command record in the cloud and not affect the user's operation response speed.

[0039] For example, if a vehicle is in a residential parking lot with weak 4G signal but usable UWB, and the cloud latency exceeds a first preset threshold, but UWB direct connection is available, it's determined to be a minor network outage. It can automatically switch to local direct connection mode, and the vehicle's central control screen can display a message: "Using local direct connection, faster response." When a user initiates a command to "turn on the living room air conditioner," it's sent via UWB direct connection. Once the network returns to normal, the system automatically switches back to cloud mode.

[0040] In the case of a moderate network outage, since the first communication link is completely disconnected and the vehicle cannot communicate with the cloud, control commands can be stored in a command queue and marked as pending synchronization. When the first communication link is restored, the pending synchronization commands in the queue are sent to the cloud for status synchronization and conflict resolution.

[0041] When a severe network outage is detected, if the vehicle receives a control command, it will store the control command in a local queue and mark it as pending transmission. When the first communication link and / or the second communication link is restored, the pending commands in the queue will be sent to the device for execution according to priority.

[0042] Therefore, by adopting differentiated command processing strategies according to different network outage levels, real-time control and cloud synchronization can be balanced during mild network outages, command execution can be guaranteed and synchronization can be performed afterward during moderate network outages, and command loss can be guaranteed and automatic resending can be performed after network recovery during severe network outages. This effectively improves the reliability, real-time performance and user experience of remote device control in network outage scenarios.

[0043] In some embodiments of the present invention, the device remote control method further includes: recording vehicle location information each time a second communication link is successfully established, and establishing a signal fingerprint map of anchor point locations based on the vehicle location information; when a vehicle enters the same recorded area, prioritizing the scanning of historically successfully connected anchor points in the signal fingerprint map; and automatically reducing the priority of the corresponding anchor point when multiple connections fail at the same location consecutively.

[0044] Specifically, see Figure 2 The local direct connection establishment module also includes an anchor point location self-learning unit. This anchor point location self-learning unit is used for: First, the vehicle's position information is recorded each time a second communication link is successfully established. This position information can be a relative position calculated based on the inertial navigation system (e.g., the vehicle's displacement and direction relative to the starting point), signal strength fingerprint feature data collected by the UWB communication submodule (e.g., received signal strength indication values ​​at different anchor points), or a combination of both. Second, based on the recorded vehicle position information, a signal fingerprint map of the anchor point positions is established. This signal fingerprint map is used to characterize the mapping relationship between the vehicle's position and connectable anchor points. When the vehicle re-enters the same or similar area recorded in the signal fingerprint map, the local direct connection establishment module prioritizes scanning historically successfully connected anchor points in that area, without performing a full scan, thereby effectively shortening the anchor point scanning time and improving connection efficiency. Furthermore, when the vehicle fails to connect to an anchor point multiple times consecutively (e.g., 3 or 5 times), the local direct connection establishment module automatically reduces the priority weight of that anchor point, decreasing the scanning frequency of that anchor point in subsequent scans or placing it in a low-priority scanning queue.

[0045] In some embodiments of the present invention, such as Figure 4 As shown, the remote control method for the device also includes: S41, in response to the restoration of normal operation of the first communication link, the pending control instructions in the local queue are sorted by priority and sent to the cloud. The pending control instructions include control instructions to be synchronized and control instructions to be sent.

[0046] For example, a local queue may adopt at least one of the following queue structures: Priority-based queues: Instructions are sorted according to their priority, with higher priority instructions (such as security instructions) placed at the front of the queue for priority processing. First-in-first-out queue based on timestamps: instructions are processed sequentially according to the time they are generated, with the first instruction to arrive being sent or synchronized first; Multi-queue based on instruction type: Multiple independent queues are divided according to instruction type (such as security, comfort, energy saving). Different types of instructions can be processed in parallel or assigned different processing priorities according to type.

[0047] S42 receives the current status of the device returned by the receiving device and compares it with the expected status of the pending control command sent to the cloud.

[0048] S43, update the flag status of the control command to be processed based on the comparison results.

[0049] In some examples, the flag status of the control instruction to be processed is updated based on the comparison results, including: if the current state of the device is consistent with the expected state of the control instruction to be processed, the flag status of the control instruction to be processed is updated to synchronized; if the current state of the device is inconsistent with the expected state of the control instruction to be processed, the conflict is resolved according to preset rules, and the flag status of the control instruction to be processed is updated to processed based on the conflict resolution result.

[0050] For example, the default rule is one of the following: The instructions from the vehicle during the network outage shall prevail; Manual operation on the device side shall prevail; The latest timestamp of the instruction or operation shall prevail; Push notifications are decided by the user.

[0051] Specifically, see Figure 2 The local instruction queue module also includes: Priority Management Unit: Priorities are set based on instruction type, with high-priority instructions (such as security instructions) processed and synchronized first. Priority rules can be pre-configured by the user via the vehicle's central control screen or mobile app. For example, users can set security instructions such as "close the gas valve" and "lock doors and windows" as the highest priority, and comfort instructions such as "adjust headlight brightness" and "turn on the air conditioning" as normal priority.

[0052] Conflict resolution unit: After the first communication link is restored, it checks whether there is a conflict between the instructions in the instruction queue and the actual state of the device (e.g., the user manually operated the device through another terminal during the network outage), and resolves the conflict according to the user's preset rules. For example, taking the vehicle-side instructions during the network outage as the standard means forcibly executing the vehicle-side instructions and overriding the current state of the device; taking the manual operation of the device as the standard means abandoning the execution of the vehicle-side instructions and maintaining the current state of the device; taking the latest timestamp as the standard means comparing the timestamp of the vehicle-side instructions with the timestamp of the last operation on the device and executing the instruction or operation with the newer time; push notification is decided by the user, which means pushing the conflict information to the user's mobile terminal, and executing the corresponding operation after receiving the user's selection.

[0053] Synchronization Unit: After the first communication link is restored, the unit automatically sends the instructions in the local queue to the cloud in priority order and synchronizes the status with the device. Once successful execution is confirmed, the instructions are removed from the queue. Furthermore, for instructions that fail to be sent (e.g., due to network fluctuations causing timeouts, cloud forwarding failures, or no response from the device), they are retained in the queue with the reason for failure marked (e.g., "network timeout," "device offline," etc.), and automatically retried when the network becomes available again. The number of retries can be preset to a maximum (e.g., 3 times). If the maximum is exceeded, the instruction is marked as "permanently failed" and the user is notified.

[0054] Therefore, by prioritizing and sending queue commands after network recovery, comparing them with the device status, resolving conflicts according to preset rules, and reserving retry for failed commands, the system achieves automatic recovery and synchronization of cached commands after network outages, improving the reliability, consistency, and user experience of cross-space remote control.

[0055] In addition to the above-mentioned vehicle-side proactive push synchronization scheme (i.e., the vehicle proactively pushes the pending instructions in the local queue to the cloud after detecting the restoration of the first communication link), network recovery synchronization can also adopt at least one of the following alternative schemes: Cloud-initiated retrieval: After the cloud server detects that the first communication link with the vehicle has been restored, it proactively sends a synchronization request to the vehicle. In response to the request, the vehicle uploads the pending instructions in its local queue to the cloud. Edge node cache synchronization: Data synchronization is established between the vehicle and the edge computing node. During the vehicle's network outage, the instructions are cached to the edge node. After the edge node resumes communication with the cloud, it forwards the cached instructions to the cloud.

[0056] In some embodiments of the present invention, the device remote control method further includes: The central control screen in the vehicle displays at least one of the following information: The status of the first and second communication links; Target control methods; Control commands and their flag status in the local queue; Network restoration notification; Conflict resolution notification.

[0057] Specifically, see Figure 2 The controller also includes a human-computer interaction module, which includes: The central control screen status display unit is used to display the current communication status in real time. For example, when the first communication link is normal, it displays "Cloud connection normal"; when the first communication link is abnormal but the second communication link is available, it displays "Local direct connection mode"; when in the state of network disconnection command caching, it displays "Network disconnection command caching". Through this unit, users can intuitively understand the current network status and system operating mode.

[0058] The instruction record query unit allows users to view the list of cached instructions and the execution status of each instruction during the network outage. Execution statuses include, but are not limited to: pending send (instruction not yet sent), pending synchronization (instruction sent via local direct connection but not synchronized to the cloud), sent (instruction sent to the device), successful execution (successfully executed on the device), failed execution (device encountered an error), and skipped due to manual operation (execution was abandoned due to a more recent user manual operation on the device). Users can view the above information through the interactive interface of the central control screen to understand the processing status of instructions during the network outage.

[0059] The network recovery notification unit is used to push notification information to the user after the first communication link and / or the second communication link are restored. For example, if there are cached instructions during the network outage and they have been processed after the network is restored, a notification such as "Instructions during the network outage have been processed" is displayed to inform the user that the operations during the network outage have been automatically synchronized or executed.

[0060] For example, such as Figure 5 As shown, taking a severe network outage scenario as an example, during the network outage, the user sends three control commands in sequence: command 001, command 002, and command 003.

[0061] Among them, instruction 001 is "turn off gas". It is determined that its priority is high, so it is stored in the instruction queue and recorded as sequence number 001, content "turn off gas", high priority, and status "pending to be sent".

[0062] Instruction 002 is "Turn on humidifier". It is determined that its priority is low, so it is stored in the instruction queue. The sequence number is 002, the content is "Turn on humidifier", the priority is low, the status is "pending to be sent", and it is placed after instruction 001.

[0063] Instruction 003 is "lock door". It is determined that its priority is high, so it is stored in the instruction queue. The sequence number is 003, the content is "lock door", the priority is high, and the status is "to be sent". It is placed after instruction 001 and before instruction 002 (that is, after sorting by priority, the queue order is: instruction 001, instruction 003, instruction 002).

[0064] After the network is restored, commands are sent in priority order. First, command 001 "Turn off gas" is sent, which is executed by the device, and a confirmation of successful execution is received from the device. Then, command 003 "Lock door" is sent, which is executed by the device, and a confirmation of successful execution is received from the device.

[0065] When processing instruction 002, the current status of the device is first checked, and it is found that the humidifier has been manually turned on by the user. According to the preset conflict resolution rules (based on manual operation), it is determined that instruction 002 will not be executed, and the conflict resolution result is recorded as "manual operation conflict skipped".

[0066] Subsequently, the status of the instructions in the local queue is updated: the status of instructions 001 and 003 is updated to "completed" and the execution result is "execution successful"; the status of instruction 002 is updated to "skipped" and the execution result is "manual operation conflict skipped".

[0067] Finally, the vehicle's central control screen displays the processing results, such as: "There were 3 instructions during the network outage, of which 2 have been executed and 1 was skipped due to a manual operation conflict."

[0068] Therefore, by displaying communication status in real time, providing access to records of disconnected commands, and proactively notifying users when the network is restored, the human-computer interaction experience of remote control in disconnected scenarios is improved, allowing users to clearly understand the execution status of commands and reducing repetitive operations.

[0069] In one specific embodiment of the present invention, such as Figure 6 As shown, the remote control method for the device includes: Step 1: Communication status monitoring.

[0070] The system monitors the communication status of the cellular network and local direct links in real time, including indicators such as signal strength, latency, and packet loss rate.

[0071] Step 2: Network outage detection and decision-making.

[0072] If normal cloud communication is detected, execute the standard cloud control procedure. If abnormal cloud communication is detected (latency exceeding the first threshold or packet loss rate exceeding the second threshold), but local direct connection is available, it is determined to be a minor network outage, and local direct connection mode is triggered. If a complete cloud disconnection is detected (multiple consecutive heartbeat timeouts), but local direct connection is available, it is determined to be a moderate network outage, and local direct connection + command queue mode is triggered. If all links are unavailable, it is determined to be a severe network outage, and command local storage mode is triggered.

[0073] Step 3: Establish local direct connection.

[0074] The vehicle activates its UWB / Bluetooth communication submodule and scans for preset home anchor points. If an anchor point is found, two-way authentication is initiated. After successful authentication, a direct UWB / Bluetooth connection is established.

[0075] Step 4: Instruction processing.

[0076] Users initiate control commands through the vehicle's infotainment system. The system then sends the command based on the current communication path: if local direct connection is available, the command is sent directly to the home gateway via UWB / Bluetooth; if local direct connection is unavailable, the command is stored in a local queue and marked as "pending transmission". Step 5: Network recovery and synchronization.

[0077] Upon detecting that the cloud network has been restored, the system reads the pending commands from the local queue, sorts them by priority, and sends them to the cloud.

[0078] Receive status feedback from the home terminal, compare it with the command execution results, and resolve conflicts according to preset rules. Update the central control screen display, prompt the user with the execution results, and clear the synchronized command queue.

[0079] The following uses the remote control of smart home devices as an example to illustrate the device remote control method of the present invention through multiple examples.

[0080] Example 1: Underground parking garage scenario (moderate network outage) When a user drove a new energy vehicle into an underground parking garage, the cellular network was completely interrupted. The vehicle detected multiple consecutive heartbeat timeouts in the cloud and determined it to be a moderate network outage.

[0081] The vehicle activates its UWB communication submodule and scans for a preset home UWB anchor point (the user has pre-configured the vehicle's UWB identity in the smart lock). After successfully scanning the lock anchor point, two-way authentication is completed using a pre-shared key, establishing a direct UWB connection channel.

[0082] Users activate the "Home Mode" command via the vehicle's infotainment system. This command is then sent directly to the smart door lock via UWB. The door lock forwards the command to the home gateway via a local wireless network (such as Wi-Fi), which then performs actions such as "turning on the living room air conditioner," "turning on the entryway light," and "turning on the water heater." Simultaneously, the command is stored in a local queue and marked for synchronization.

[0083] After the vehicle leaves the garage, the cellular network automatically recovers, processes the pending synchronization commands, and the central control screen displays "The home mode command was executed during the network outage".

[0084] Example 2: Long-distance network outage scenario (severe network outage) The user was driving in a mountainous area in the suburbs when the cellular network was interrupted, and the distance to the home was too great to establish a direct UWB connection. The vehicle detected that both the first and second communication links were unavailable, and determined it to be a severe network outage.

[0085] When a user initiates a "turn off the gas in your home" command, the command is determined to have high priority and is stored in a local queue, marked as "pending sending". Subsequently, when the user initiates a "turn on the humidifier" command, the command is determined to have low priority and is stored in the queue.

[0086] When the vehicle reaches an area with signal coverage, the first communication link is automatically restored. Commands in the queue are sent in priority order: first, the "Turn off gas" command is sent; after receiving confirmation of successful execution, the "Turn on humidifier" command is sent. The central control screen displays "Multiple commands were executed during the network outage."

[0087] Example 3: Mild network outage scenario The vehicle is in the residential parking lot. The cellular network signal is weak, but the UWB direct connection is available. The vehicle detected that the cloud communication latency exceeded the first preset threshold, but the second communication link was available, which was determined to be a minor network outage.

[0088] The system automatically switches to local direct connection mode, and the central control screen displays "Local direct connection is in use, faster response." When a user initiates a command to "turn on the living room air conditioner," the command is sent to the home gateway via UWB direct connection for execution.

[0089] Once the network is restored, it will automatically switch back to cloud control mode.

[0090] Example 4: Multi-user, multi-vehicle scenario The family has multiple members, each owning a vehicle and setting personalized control preferences. Each vehicle pre-stores the family's UWB anchor point authentication information.

[0091] When vehicle A approaches the door, it establishes a direct connection with the UWB anchor point and sends the command "Enable User A's Preset Mode" to execute the corresponding personalized settings based on the vehicle's identity identifier.

[0092] Vehicle B then approaches, establishes a UWB direct connection, and the device identifies different vehicle identification marks and executes the command to "activate B user preset mode".

[0093] This enables personalized offline direct connection control in multi-vehicle, multi-user scenarios.

[0094] Example 5: Instruction conflict resolution scenario During the network outage, the user sent a "turn off living room lights" command through the vehicle's infotainment system. This command was stored in a local queue and marked as "pending synchronization." Meanwhile, a family member manually turned on the living room lights using another device.

[0095] Once the network is restored, the "Turn off living room lights" command will be sent to the home gateway. The home gateway will then return the device's current status as "Living room lights are on (manual)".

[0096] The conflict resolution unit, based on user-preset rules (in this example, "manual operation prevails"), determines that the instruction should not be executed and records the conflict resolution result as "Instruction skipped due to manual operation". The central control screen displays the message "An instruction was not executed due to manual operation during the network outage".

[0097] Example 6: Synchronization failure scenario after network recovery Multiple control commands were cached during the vehicle's network outage. After the network was restored, an attempt was made to send the commands in the queue to the cloud and forward them to the home gateway. If the home gateway returned a "device offline" error (e.g., the water heater was not connected to the home network due to a malfunction), the execution status of the corresponding command was updated to "execution failed".

[0098] The central control screen displays prompts such as "Some commands failed to execute due to device offline status. Please check your home network." Failed commands are retained in a local queue, with the next retry time and reason for failure marked.

[0099] Once the network stabilizes, failed commands will be automatically retried. A maximum number of retries can be set (e.g., 3 times). When the maximum number of retries is exceeded, the command will be marked as "permanently failed," and the user will be notified via the central control screen or mobile device to handle it manually.

[0100] Figure 7 This is a structural block diagram of an electronic device according to an embodiment of the present invention.

[0101] like Figure 7 As shown, the electronic device 700 includes a processor 701 and a memory 703. The processor 701 and the memory 703 are connected, for example, via a bus 702. Optionally, the electronic device 700 may also include a transceiver 704. It should be noted that in practical applications, the transceiver 704 is not limited to one type, and the structure of this electronic device 700 does not constitute a limitation on the embodiments of the present invention.

[0102] Processor 701 may be a CPU (Central Processing Unit), a general-purpose processor, a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of this invention. Processor 701 may also be a combination that implements computational functions, such as including one or more microprocessor combinations, a combination of a DSP and a microprocessor, etc.

[0103] Bus 702 may include a pathway for transmitting information between the aforementioned components. Bus 702 may be a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus, etc. Bus 702 can be divided into address bus, data bus, control bus, etc. For ease of representation, Figure 7 The bus is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.

[0104] The memory 703 stores a computer program corresponding to the device remote control method of the above embodiments of the present invention. This computer program is executed by the processor 701. The processor 701 executes the computer program stored in the memory 703 to implement the content shown in the foregoing method embodiments.

[0105] Among them, electronic device 700 may be the aforementioned controller. Figure 7 The electronic device 700 shown is merely an example and should not be construed as limiting the functionality and scope of use of the embodiments of the present invention.

[0106] Figure 8 This is a structural block diagram of the device remote control system according to an embodiment of the present invention.

[0107] like Figure 8 As shown, the equipment remote control system 800 includes: an acquisition module 10, a detection and decision module 20, and a control module 30.

[0108] The acquisition module 10 is used to acquire the communication status of the vehicle, including the status of the first communication link between the vehicle and the cloud, and the status of the second communication link between the vehicle and the device. The detection and decision module 20 is used to detect the network outage level based on the communication status and determine the target control mode based on the detected network outage level. The control module 30 is used to respond to control commands and remotely control the corresponding device based on the target control mode.

[0109] It should be noted that for other specific embodiments of the device remote control system 800 of the present invention, please refer to the specific embodiments of the device remote control method described above.

[0110] The present invention also proposes a vehicle comprising: the device remote control system 800 of the above embodiments, and / or the electronic device 700 of the above embodiments.

[0111] In summary, the remote control method, system, electronic device, and vehicle provided by the embodiments of the present invention have the following beneficial effects: 1) Control continuity in network outage scenarios Even if the first communication link between the vehicle and the cloud is completely interrupted, the present invention can still execute vehicle control commands through the second communication link (such as UWB direct connection), effectively solving the pain point of "disconnection and failure" in the prior art and ensuring the availability of remote control in the absence of network.

[0112] 2) Multi-level network outage protection strategy This invention employs a differentiated, tiered response strategy based on the severity of network outages: for minor outages, priority is given to ensuring user experience by reducing response latency through local direct connection; for moderate outages, while ensuring instruction execution, instructions are queued and marked for synchronization to ensure functional integrity; for severe outages, instructions are stored locally without loss and automatically processed upon network recovery. This achieves refined adaptation to different outage scenarios.

[0113] 3) Low-latency operation experience When a vehicle approaches the vicinity of the device (such as at the doorstep of a home), control commands are sent via a local UWB direct connection. The command transmission path is shortened from the traditional three-level architecture of "vehicle → cloud → device" to a two-level direct connection of "vehicle → device", which significantly reduces transmission latency and improves the user's operation response experience.

[0114] 4) Commands are not lost during network outages. During network outages, user-issued control commands are reliably cached in a local queue. Once the network is restored, they are automatically prioritized, sent, and synchronized to the cloud. Users do not need to repeat the operation, achieving a seamless transition before and after network outages.

[0115] 5) Intelligent conflict resolution mechanism After the network is restored, the system automatically detects conflicts between cached commands and the actual state of the device (such as when a user manually operates the device through another terminal during a network outage). It then intelligently handles the conflicts according to user-preset rules (such as taking the vehicle-side command as the standard, manual operation as the standard, the latest timestamp as the standard, or push notifications as the user decides), effectively avoiding misoperations and improving state consistency in multi-terminal collaborative scenarios.

[0116] 6) Good hardware compatibility This invention can make full use of the UWB communication sub-modules already equipped in vehicles (such as those used for digital key functions) and existing UWB devices in homes (such as smart door locks), without requiring additional hardware costs, and has good compatibility and economy.

[0117] It should be noted that the logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be specifically implemented in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (such as a computer-based system, a processor-included system, or other system that can fetch and execute instructions from, an instruction execution system, apparatus, or device). For the purposes of this specification, "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transmit programs for use by, or in conjunction with, an instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of computer-readable media include: an electrical connection having one or more wires (electronic device), a portable computer disk drive (magnetic device), random access memory (RAM), read-only memory (ROM), erasable and editable read-only memory (EPROM or flash memory), fiber optic devices, and portable optical disc read-only memory (CDROM). Alternatively, the computer-readable medium may be paper or other suitable media on which the program can be printed, since the program can be obtained electronically, for example, by optically scanning the paper or other medium, followed by editing, interpreting, or otherwise processing as necessary, and then stored in a computer memory.

[0118] It should be understood that various parts of the present invention can be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods can be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented using any one or a combination of the following techniques known in the art: discrete logic circuits having logic gates for implementing logical functions on data signals, application-specific integrated circuits (ASICs) having suitable combinational logic gates, programmable gate arrays (PGAs), field-programmable gate arrays (FPGAs), etc.

[0119] In the description of this specification, references to terms such as "one embodiment," "some embodiments," "example," "specific example," or "some examples," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of the invention. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples.

[0120] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of that feature. In the description of this invention, "a plurality of" means at least two, such as two, three, etc., unless otherwise explicitly specified.

[0121] In this invention, unless otherwise explicitly specified and limited, "above" or "below" the second feature can mean that the first feature is in direct contact with the second feature, or that the first feature is in indirect contact with the second feature through an intermediate medium. Furthermore, "above," "over," and "on top" of the second feature can mean that the first feature is directly above or diagonally above the second feature, or simply that the first feature is at a higher horizontal level than the second feature. "Below," "below," and "under" the second feature can mean that the first feature is directly below or diagonally below the second feature, or simply that the first feature is at a lower horizontal level than the second feature.

[0122] Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention. Those skilled in the art can make changes, modifications, substitutions and variations to the above embodiments within the scope of the present invention.

Claims

1. A method for remote control of equipment, characterized in that, include: Obtain the communication status of the vehicle, wherein the communication status includes the status of the first communication link between the vehicle and the cloud, and the status of the second communication link between the vehicle and the device. The network outage level is detected based on the communication status, and the target control method is determined based on the detected network outage level. In response to a control command, the corresponding device of the control command is remotely controlled based on the target control method.

2. The remote control method for equipment according to claim 1, characterized in that, The step of detecting the network outage level based on the communication status and determining the target control method based on the detected network outage level includes: If the first communication link is abnormal but not disconnected, and the second communication link is available, it is determined to be a minor network outage, and the target control method is determined to be: sending the control command to the device through the second communication link; If the first communication link is disconnected and the second communication link is available, it is determined to be a moderate network outage, and the target control method is determined to be: sending the control command to the device through the second communication link, and storing the control command in a local queue and marking it as pending synchronization; If both the first and second communication links are unavailable, it is determined to be a severe network outage, and the target control method is determined to be: storing the control command in a local queue and marking it as to be sent.

3. The remote control method for equipment according to claim 2, characterized in that, The first communication link being abnormal but not disconnected means that the communication delay between the vehicle and the cloud exceeds a first threshold and / or the packet loss rate exceeds a second threshold; the first communication link being disconnected means that the communication heartbeat between the vehicle and the cloud times out more than a preset number of times.

4. The remote control method for equipment according to claim 2, characterized in that, The method further includes: In response to the first communication link returning to normal, the pending control instructions in the local queue are sorted by priority and sent to the cloud, wherein the pending control instructions include control instructions to be synchronized and control instructions to be sent; Receive the current status of the device returned by the device and compare it with the expected status of the pending control command sent to the cloud; The flag status of the control command to be processed is updated based on the comparison results.

5. The remote control method for equipment according to claim 4, characterized in that, The step of updating the flag state of the control command to be processed based on the comparison result includes: If the current state of the device is consistent with the expected state of the control instruction to be processed, then the flag state of the control instruction to be processed is updated to synchronized. If the current state of the device is inconsistent with the expected state of the control instruction to be processed, the conflict is resolved according to preset rules, and the marked state of the control instruction to be processed is updated to processed based on the conflict resolution result.

6. The remote control method for equipment according to claim 5, characterized in that, The preset rule is one of the following: The instructions from the vehicle during the network outage shall prevail; Manual operation on the device side shall prevail; The latest timestamp of the instruction or operation shall prevail; Push notifications are decided by the user.

7. The remote control method for equipment according to claim 5 or 6, characterized in that, The method further includes: The central control screen on the vehicle is controlled to display at least one of the following information: The status of the first communication link and the second communication link; The target control method; The control instructions and their marked status in the local queue; Network restoration notification; Conflict resolution notification.

8. A remote control system for equipment, characterized in that, include: The acquisition module is used to acquire the communication status of the vehicle, wherein the communication status includes the first communication link status between the vehicle and the cloud, and the second communication link status between the vehicle and the device. The detection and decision module is used to detect the network outage level based on the communication status and determine the target control method based on the detected network outage level. The control module is used to respond to control commands and remotely control the corresponding device based on the target control method.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory, characterized in that, When the computer program is executed by the processor, it implements the device remote control method as described in any one of claims 1 to 7.

10. A vehicle, characterized in that, include: The device remote control system as described in claim 8, and / or the electronic device as described in claim 9.

Images