A remote control method, apparatus, system, device and medium

Abstract

The application discloses a remote control method, device, system, equipment and medium. The method comprises the following steps: in response to a received device control instruction, sending the device control instruction to a to-be-controlled device, so that the to-be-controlled device executes a corresponding operation based on the device control instruction; displaying an execution animation corresponding to an execution component in the to-be-controlled device when the execution component executes the device control instruction in a display page; receiving a first execution state of the execution component fed back by the to-be-controlled device, and not refreshing the display page when an execution time node of the first execution state is earlier than an execution time node of a second execution state currently displayed. The application solves the technical problems that, in the prior art, network delay causes a user to think that smart home device operation is not smooth, resulting in misoperation, and seriously reduces user experience, so that the user is intuitively like real-time communication, and there is no delay display, greatly improving user experience and reducing the possibility of misoperation.

Description

Technical Field

[0001] This invention relates to the field of smart home technology, and in particular to a remote control method, device, system, equipment and medium. Background Technology

[0002] In existing technologies, smart home devices generally rely on a complex control process. Users typically need to send control commands via a client application. These commands are first transmitted to the device manufacturer's cloud. The manufacturer's cloud then forwards the command to various IoT platforms, such as Alibaba, Xiaomi, and Huawei. The IoT platform then forwards the command to the target smart device. Upon receiving the command, the device begins to perform the corresponding operation and changes its state. For example, the device might switch from standby mode to heating mode. After completing these operations, the device sends its latest state to the IoT platform. The IoT platform receives the state information and forwards it again to the manufacturer's cloud, which then forwards this state information to the user's corresponding client application. Finally, the client refreshes the display interface based on the received new state, thus completing the entire operation command process.

[0003] The core problem with this control process lies in its multiple intermediate steps. Because the control of smart devices relies on the network and requires multiple forwardings through the device manufacturer's cloud and IoT platform, there is often a delay of 4 to 6 seconds between the user sending a control command through the client and the device actually executing that command. This means that after the user operates the client (such as clicking the heater button), they need to wait for a period of time to see the client's status update. This delay leads to a mismatch between the actual operation performed by the smart home device and the display on the client, making the client feel sluggish and the operation clunky, and may even lead to accidental operations, thus severely degrading the user experience. Summary of the Invention

[0004] This invention provides a remote control method, device, system, equipment, and medium to solve the technical problem in the prior art where the mismatch between the actual operation of smart home devices and the display on the client side leads users to perceive that the smart home devices are not operating smoothly, resulting in misoperation and seriously reducing the user experience.

[0005] According to one aspect of the present invention, a remote control method is provided, applied to a client, comprising:

[0006] In response to a received device control command, the device control command is sent to the device to be controlled, so that the device to be controlled performs a corresponding operation based on the device control command;

[0007] The display page shows the execution animation of the actuator in the device to be controlled when it executes the device control command;

[0008] The system receives the first execution status of the execution component from the device to be controlled. If the execution time of the first execution status is earlier than the execution time of the currently displayed second execution status, the display page is not refreshed.

[0009] According to another aspect of the present invention, a remote control device is provided for use on a client side, comprising:

[0010] The sending module is configured to, in response to a received device control command, send the device control command to the device to be controlled, so that the device to be controlled performs a corresponding operation based on the device control command;

[0011] An animation display module is used to display the execution animation of the actuator in the device to be controlled when executing the device control command on the display page;

[0012] The control module is used to receive the first execution status of the execution component from the device to be controlled, and when the execution time node of the first execution status is earlier than the execution time node of the currently displayed second execution status, the display page is not refreshed.

[0013] According to another aspect of the present invention, a remote control system is provided, comprising: a device to be controlled and a client; wherein a wireless connection is established between the device to be controlled and the client;

[0014] Upon receiving a device control command, the client sends the device control command to the device to be controlled, so that the device to be controlled performs a corresponding operation based on the device control command. The client displays the execution animation of the execution component in the device to be controlled when executing the device control command on the display page. The client receives the first execution status of the execution component fed back by the device to be controlled. If the execution time node of the first execution status is earlier than the execution time node of the currently displayed second execution status, the display page is not refreshed.

[0015] According to another aspect of the present invention, an electronic device is provided, the electronic device comprising:

[0016] At least one processor; and

[0017] A memory communicatively connected to the at least one processor; wherein,

[0018] The memory stores a computer program that can be executed by the at least one processor, the computer program being executed by the at least one processor to enable the at least one processor to perform the remote control method according to any embodiment of the present invention.

[0019] According to another aspect of the present invention, a computer-readable storage medium is provided, the computer-readable storage medium storing computer instructions for causing a processor to execute and implement the remote control method described in any embodiment of the present invention.

[0020] The technical solution of this invention, upon receiving a device control command triggered by a user, directly sends the device control command to the device to be controlled, enabling the device to perform corresponding operations based on the command. Simultaneously, the display page shows the execution animation of the execution component in the device to be controlled as it executes the device control command. It also receives the first execution state of the execution component from the device to be controlled; if the execution time of the first execution state is earlier than the currently displayed second execution state, the display page is not refreshed. This solves the technical problem in the prior art where the mismatch between the actual execution operation of the device to be controlled and the display on the client side leads to the user perceiving the smart home device as unresponsive, resulting in misoperation and severely reducing the user experience. Therefore, the user intuitively experiences the operation as if in real-time communication, with no display delay, greatly improving the user experience and reducing the possibility of misoperation.

[0021] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of the present invention, nor is it intended to limit the scope of the invention. Other features of the invention will become readily apparent from the following description. Attached Figure Description

[0022] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0023] Figure 1 This is a flowchart of a remote control method provided in an embodiment of the present invention;

[0024] Figure 2 This is a flowchart of another remote control method provided in this embodiment of the invention;

[0025] Figure 3 This is a schematic diagram illustrating the implementation of a delayed task according to an embodiment of the present invention;

[0026] Figure 4 This is a flowchart illustrating the optimized implementation of the interaction logic of an interactive control provided in an embodiment of the present invention.

[0027] Figure 5 This is a flowchart of another remote control method provided in an embodiment of the present invention;

[0028] Figure 6 This is a schematic diagram of the structure of a remote control device provided in an embodiment of the present invention;

[0029] Figure 7 This is a structural block diagram of a remote control system provided in an embodiment of the present invention;

[0030] Figure 8 This is a structural block diagram of an electronic device provided in an embodiment of the present invention. Detailed Implementation

[0031] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0032] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0033] In one embodiment, Figure 1This is a flowchart illustrating a remote control method provided in an embodiment of the present invention. This embodiment is applicable to the remote control of smart home devices. The method can be executed by a remote control device, which can be implemented in hardware and / or software and can be configured in a client of an electronic device. For example, the client can be a third-party application (i.e., an app), a third-party mini-program, a remote control, or a central controller, etc., and is not limited thereto. The electronic device can include, but is not limited to, smart terminals with wireless communication capabilities such as smartphones and tablets. It should be noted that the remote control method in this embodiment can remotely control any smart home device.

[0034] like Figure 1 As shown, the method includes:

[0035] S110. In response to the received device control command, the device control command is sent to the device to be controlled so that the device to be controlled can perform the corresponding operation based on the device control command.

[0036] In this context, device control commands refer to instructions used to trigger and initiate the corresponding operation performed by the device to be controlled. The device to be controlled can be a smart home device remotely controlled via a client. For example, smart home devices may include, but are not limited to: smart appliances, smart lighting systems, and smart security systems. For instance, smart appliances include, but are not limited to: smart toilets, smart clothes dryers, smart washing machines, smart TVs, and smart air conditioners; smart lighting systems include, but are not limited to: smart lamps; and smart security systems include, but are not limited to: smart smoke detectors, smart cameras, and smart door locks.

[0037] Generally, remote control between the client and the device to be controlled can be achieved wirelessly, such as via WiFi or Bluetooth. In practice, the client sends device control commands to a cloud server via a command sending thread. The cloud server then forwards these commands to an IoT platform, which in turn forwards them to the device to be controlled, enabling the device to perform corresponding operations based on the commands. Upon receiving the device control commands from the client, the cloud server returns a successful reception message to the client, indicating that the task is complete and ending the command sending thread.

[0038] S120. Display the execution animation of the actuator in the device to be controlled when executing the device control command on the display page.

[0039] In this context, the actuator refers to the part of the controlled device used to perform a specific operation. Generally, the actuator can consist of hardware and software, working together to realize the function and operation of the controlled device. Of course, the actuators included will differ depending on whether the controlled device is a different smart home device. For example, if the controlled device is a smart toilet, the actuator may include at least one of the following: a flushing device, a heating device, a drying device, a deodorizing device, a sensor, and a controller. If the controlled device is a smart light fixture, the actuator may include at least one of the following: a light bulb, a drive circuit, and a communication module. If the controlled device is a smart clothes dryer, the actuator may include at least one of the following: a clothes drying rod, a motor, a sensor, a control system, and a communication module.

[0040] Execution animation refers to the animation effects displayed on the client's interface. It provides feedback to the user and displays the status, operation progress, or other relevant information of the controlled device. This can be displayed through the device's interface or other visual interfaces, allowing users to intuitively understand the device's working status and operation results. In practice, different types and forms of execution animation can be used depending on the type of smart home device and its specific design and functions. For example, it can be simple graphics, animations, or animation sequences. It should be noted that when the controlled device is not performing any operation, its current state is standby. For example, assuming the controlled device is a smart clothes dryer, and the device control command is a rise command, with a relative distance of 20 centimeters between the dryer and the top of the wall, the smart clothes dryer's current state changes from standby to rising, and the execution animation can be an animation effect showing the progress of the clothesline as it rises. For example, if the device to be controlled is a smart toilet, and the device control command is a washing and drying command, then the current state of the smart toilet is switched from standby to the active state of the washing and drying function, and the current position of the nozzle is displayed in real time. Correspondingly, the display sequence of the animations on the display interface includes: water flow animation, washing animation, drying animation, and deodorizing animation. Among them, the water flow animation is used to indicate that the smart toilet is flushing, and can display the water flowing out of the toilet, or display the water flowing in the toilet to rotate and impact, etc., to simulate the real flushing process. The cleaning animation indicates that the smart toilet is performing a cleaning operation, and can show the nozzle moving and rotating inside the toilet, or show water spraying out of the nozzle to simulate a real cleaning process; the drying animation indicates that the toilet is performing a drying operation, and can show the air vent or heating element moving on the toilet seat, or show hot air blowing out of the air vent to simulate a real drying process; the deodorizing animation indicates that the toilet is performing a deodorizing operation, and can show the air vent or deodorizing element moving inside the toilet, or show the effect of airflow to simulate a real deodorizing process.

[0041] In an exemplary embodiment, the execution animation of the execution component in the device to be controlled when executing device control commands can be displayed on the display page in real time through the page refresh thread.

[0042] S130: Receive the first execution status of the execution component from the device to be controlled. If the execution time node of the first execution status is earlier than the execution time node of the currently displayed second execution status, do not refresh the display page.

[0043] In this embodiment, the first execution state of the execution component fed back by the device under control can be received through a state receiving and judging thread. The instruction sending thread, page refresh thread, and state receiving and judging thread execute in parallel and independently. The state receiving and judging thread is used to receive the actual state and real-time location information fed back by the device under control after executing the operation corresponding to the device control instruction. The first execution state is used to characterize the actual state of the execution component in the device under control after executing the device control instruction; the second execution state is used to characterize the execution state of the execution component in the device under control currently displayed on the display page. It should be noted that the first execution state includes not only the actual state of the device under control after executing the device control instruction, but also the actual location information of the device under control after executing the device control instruction.

[0044] Generally, the first execution state and the second execution state are the same. However, in actual operation, while the device under control is executing the operation corresponding to the device control command, the user can send a new device control command to the device under control again through the client.

[0045] In one embodiment, during the page refresh process, if a new device control command is received, the method further includes: generating a new delayed refresh task based on the new device control command; if the pre-acquired delayed task to be executed and the new delayed refresh task have the same task type, the delayed task to be executed is deleted from the pre-configured task queue.

[0046] In an exemplary embodiment, if the first execution state and the second execution state are inconsistent, and the execution time node of the first execution state is earlier than the execution time node of the currently displayed second execution state, the currently displayed second execution state will still be shown on the display page. Here, a new delayed refresh task refers to a delayed refresh task corresponding to a new device control command received during the execution of the operation corresponding to the device control command by the controlled device; a delayed task to be executed refers to a delayed refresh task that the controlled device has not yet executed. In actual operation, the client can generate a new delayed refresh task based on the new device control command and compare the task type of the new delayed refresh task with that of the delayed task to be executed. If the task types are the same, the delayed task to be executed can be directly deleted from the task queue, i.e., it does not need to be executed. Delayed refresh tasks with the same task type can be understood as duplicate or repeated delayed refresh tasks. In actual operation, the task type of each delayed refresh task can be determined based on its task identifier.

[0047] In one exemplary embodiment, the device to be executed is a smart clothes drying rack. If the first received device control command is to rise to 1 / 5 of the relative position between the ground and the roof, the smart clothes drying rack executes the rising operation based on the device control command. The client displays a rising animation on the display area. The animation path of this rising animation corresponds to rising from the current position of the drying rack to 1 / 5 of the relative position between the ground and the roof. The animation display process is the animation of the drying rack moving from its current position to 1 / 5 of the relative position between the ground and the roof. During the rising process, the client receives feedback from the clothes drying rack on its current rising position status. It compares the current position status of the drying rack with the animation position status in the display area. If the time point when the clothes drying rack moves to its current position status (i.e., the first execution state in the above embodiment) is later than the animation position status (i.e., the second execution state in the above embodiment) when the clothes drying rack executes the device control command, the animation in the display area is refreshed to match the actual position status. This ensures that the displayed animation corresponds to the actual position of the drying rack, improving the user experience.

[0048] In one exemplary embodiment, if the client receives feedback from the clothes drying machine regarding the current position of the drying rack during its ascent, which is earlier than the time point of the animated position status (i.e., the progress of the action displayed in the display area is faster than the received feedback of the current position status), then the animation is not refreshed. This avoids the problem of animation stuttering and the refreshed animation lagging behind the actual position of the drying rack when the feedback of the current position is later than the actual position shown in the animation due to signal delays between smart devices.

[0049] In one exemplary embodiment, during the process of the clothes drying rack rising to 1 / 5 of the relative position between the ground and the roof based on the control command, if a new device control command is received to rise to 4 / 5 of the relative position between the ground and the roof, the smart clothes drying rack will perform the rising operation based on the device control command. If, during the rising process, a new device control command is received to rise to 3 / 5 of the relative position between the ground and the roof, the device control command at the 4 / 5 position and the corresponding delayed refresh task can be directly ignored, and the device control command at the 3 / 5 position and the corresponding delayed refresh task can be directly executed.

[0050] The technical solution of this embodiment, upon receiving a device control command triggered by a user, directly sends the device control command to the device to be controlled, enabling the device to perform corresponding operations based on the device control command. Simultaneously, the display page shows the execution animation of the execution component in the device to be controlled as it executes the device control command. It receives the first execution state of the execution component from the device to be controlled; if the execution time of the first execution state is earlier than the currently displayed second execution state, the display page is not refreshed. This solves the technical problem in the prior art where the mismatch between the actual execution operation of the device to be controlled and the display on the client side leads to the user perceiving the smart home device as not operating smoothly, resulting in misoperation and severely reducing the user experience. Therefore, it provides the user with an intuitive experience similar to real-time communication, without any delay in display, greatly improving the user experience and reducing the possibility of misoperation.

[0051] In one embodiment, Figure 2 This is a flowchart of another remote control method provided in this embodiment of the invention. This embodiment describes the case where the device control command includes multiple execution operations. Figure 2 As shown, the remote control process in this embodiment includes the following steps:

[0052] S210. In response to the received device control command, the device control command is sent to the device to be controlled so that the device to be controlled can perform the corresponding operation based on the device control command.

[0053] S220. Obtain the preset delay time and task priority of each operation to be executed in the device control command.

[0054] In one exemplary embodiment, a device control command may include multiple execution operations. In this case, to ensure the sequential execution order of each execution operation, a corresponding delayed refresh task can be created based on the preset delay time and task priority of each execution operation. The task priority characterizes the sequential execution order of each execution operation; generally, the task priority is a constant, with a smaller value indicating a higher priority. The preset delay time represents the delay time of the execution component when performing the task or operation, and is generally measured in seconds or milliseconds.

[0055] In this embodiment, the client automatically logs into the corresponding management interface on the smart home system's management platform. In the management interface, the client finds the configuration options for the execution components corresponding to the device control commands. In the configuration interface, the client can view and set parameters such as the delay time and task priority of each execution component.

[0056] S230. Determine the execution order of each execution component based on the preset delay time and task priority.

[0057] In this embodiment, each execution component is sorted according to its task priority and added to a pre-built execution queue. This execution queue can be a priority queue (e.g., a heap queue) to ensure that the highest-priority execution component executes first. Then, an execution component is retrieved from the queue and waits for a preset delay time. After the preset delay time, the execution component is executed. The execution component is then retrieved and performs its task or operation. During execution, data processing, device control, and command sending can be performed as needed. The next execution component is then retrieved from the pre-built execution queue, and this process continues until all execution components in the queue have been executed.

[0058] For example, assuming the device to be controlled is a smart clothes dryer, when the device control command is an upward command, the drying operation needs to be performed first. That is, the upward command includes two operations: upward and drying, and the drying operation has a higher priority than the upward operation. Generally, the delay time for the drying component in the smart clothes dryer to perform the drying operation is less than the delay time for the motor component in the smart clothes dryer to perform the upward operation. In this case, based on the delay times for performing the drying and upward operations, and the fact that the drying operation has a higher priority than the upward operation, a corresponding delay refresh task can be created so that when the smart clothes dryer receives the upward command, it first performs the drying operation, and only after receiving the notification that the drying operation has been completed does it perform the corresponding upward operation.

[0059] S240. Display the execution animations of the execution components in the controlled device when executing device control commands on the display page according to the execution order.

[0060] In this embodiment, the execution animations of each actuator in the controlled device are displayed sequentially on the display page according to their execution order. It can be understood that the display order of the animations on the display page matches the execution order of the actuators in the controlled device. In an exemplary embodiment, if the controlled device is a smart clothes dryer, when the device control command is a rising command, the drying operation must be performed first, followed by the rising operation. That is, the rising command includes both rising and drying operations. Correspondingly, during the drying process, the animation of the drying operation is displayed on the client's display page, and after drying is complete, a "dried" animation is displayed on the client's display page. Then, the animation path of the rising animation and its corresponding display process are displayed. The animation path of the rising animation and its corresponding display process can be found in the description of the above embodiments and will not be repeated here.

[0061] S250: Receive the first execution status of the execution component from the device to be controlled. If the execution time of the first execution status is earlier than the execution time of the currently displayed second execution status, do not refresh the display page.

[0062] In one exemplary embodiment, when the device to be controlled is a smart clothes drying rack, if the client receives the current position status (i.e., the first execution state) of the drying rack during the rising process of the smart clothes drying rack, the client compares the current position status with the animation position status (i.e., the second execution state) displayed on the client's display page. If the execution time node of the current position status is earlier than the execution time node of the animation position status, the display page is not refreshed to avoid the animation stuttering problem caused by the signal delay of the smart clothes drying rack.

[0063] S260. When the execution time of the first execution state is later than the execution time of the currently displayed second execution state, the first execution state of the execution component is displayed on the display page.

[0064] In this embodiment, when the execution time of the first execution state is later than the execution time of the second execution state, the first execution state can be understood as the latest state of the execution component in the device to be controlled. The state receiving and judging thread receives the first execution state of the execution component from the device to be controlled. If the execution time of the first execution state is later than the execution time of the second execution state, the second execution state corresponding to the execution component on the display page is refreshed to the corresponding first execution state. This ensures that the animation displayed on the client's page corresponds to the first execution state of the device to be controlled, improving the user experience.

[0065] In one exemplary embodiment, when the device to be controlled is a smart clothes drying rack, if the client receives the current position status (i.e., the first execution state) of the drying rack during the rising process of the smart clothes drying rack, the current position status is compared with the animated position status (i.e., the second execution state) displayed on the client's display page. If the execution time of the current position status is later than the execution time of the animated position status, the animated position status is refreshed to the current position status on the display page to ensure that the position status on the display page matches the actual position status of the drying rack, thereby improving the user experience.

[0066] The technical solution of this embodiment obtains the preset delay time and task priority of each execution operation in the device control command, determines the execution order of each execution component based on the preset delay time and task priority, and displays the execution animation of the execution component in the device to be controlled when executing the device control command on the display page according to the execution order. This allows users to intuitively understand the execution order of each execution component and improves the user experience.

[0067] In one embodiment, Figure 3 This is a schematic diagram illustrating the implementation of a delayed task according to an embodiment of the present invention. For example... Figure 3 As shown, the implementation process of the delayed task includes the following steps:

[0068] Step 1, Receive Delayed Task Requests: Receive specific delayed task requests, such as device status refresh, via API or internal calls.

[0069] Step 2, cancel existing delayed tasks of the same type: check existing delayed tasks by task identifier, cancel duplicate or conflicting tasks, and ensure efficient use of resources.

[0070] Step 3, Create new delayed tasks: Create new delayed tasks according to the specified delay time and priority, and arrange them into the appropriate task queue.

[0071] Step 4, Synchronize device status and update user interface: After the delayed task is executed, synchronize the status with the IoT device and update the user interface in a timely manner to ensure that the device status is accurately reflected.

[0072] By managing delayed tasks precisely, the consistency and timeliness of asynchronous operations are ensured, thereby improving the system's responsiveness.

[0073] In one embodiment, the remote control method further includes: responding to a click operation of a received interactive control, obtaining the actual interval time between the previous click and the current click of the interactive control; if the actual interval time is less than a pre-configured interval time threshold, generating and displaying a corresponding click fault pop-up window. Here, the interactive control refers to the click button displayed on the client; generally, the interactive control refers to a logical button in the client. In actual operation, the interactive controls displayed on the client's interface are related to the functions of the device being controlled. For example, when the device being controlled is a smart clothes dryer, the interactive controls may include, but are not limited to: an up button, a down button, a lighting button, and a drying button; similarly, when the device being controlled is a smart toilet, the interactive controls may include, but are not limited to: a nozzle massage button, a drying button, a seat heating button, an automatic disinfection button, and an automatic cleaning button.

[0074] The actual interval time refers to the actual time interval between the previous click and the current click of the same interactive control. The interval time threshold is used to characterize the minimum time interval required between two consecutive clicks of the same interactive control. In essence, the interval time threshold is designed to prevent frequent clicks of the same interactive control. In practice, if the actual interval time between two consecutive clicks of the same interactive control is less than the pre-configured interval time threshold, it indicates that the interactive control has been clicked frequently by the user. At this point, a click failure pop-up can be generated and displayed on the screen where the interactive control is located, thus preventing accidental or repeated clicks of the interactive control.

[0075] In one embodiment, the remote control method further includes: in response to a click operation of a received interactive control, switching the actual icon parameters of the displayed icon corresponding to the interactive control to target configuration parameters. The actual icon parameters may include, but are not limited to, actual visual elements such as icon animation, icon color, icon size, and icon shape; the target configuration parameters refer to the target visual elements to which the displayed icon needs to be switched, such as, but not limited to, the target animation corresponding to the target icon, the target color corresponding to the icon, the target size corresponding to the icon, or the target shape corresponding to the icon. During the user's click on the interactive control on the display interface, different visual elements can be used to provide the user with an intuitive interactive response.

[0076] Figure 4 This is a flowchart illustrating the optimized implementation of the interaction logic of an interactive control provided in an embodiment of the present invention. Figure 4 As shown, by setting reasonable interval thresholds and click failure pop-ups, users can avoid accidental or repeated clicks on interactive controls. Meanwhile, visual elements such as animations and color changes of the icons corresponding to the interactive controls can provide users with intuitive interactive responses. Furthermore, optimizing the rendering logic of interactive controls can prevent flickering and unnecessary highlighting, thereby reducing unnecessary redrawing, providing a smooth user experience, and ultimately improving user satisfaction.

[0077] In one embodiment, the remote control method further includes: acquiring the actual network status and / or actual device parameters of the device to be controlled in real time; generating corresponding fault prompt information based on the fault type and severity when a fault occurs in the actual network status and / or actual device parameters; and displaying the fault prompt information on a corresponding display interface through a preset display method; wherein the preset display method includes one of the following: pop-up window method and notification method. The actual network status is used to characterize the network connection status between the device to be controlled and the IoT device, for example, the actual network status includes one of the following: normal network connection and network connection interruption; the actual device parameters are parameters characterizing whether the hardware, software, and network of the device to be controlled can operate normally. Fault types may include, but are not limited to, one of the following: hardware fault, software fault, network connection problem, sensor fault, power supply problem, configuration problem, compatibility problem, and security problem. For example, hardware failures may include, but are not limited to, any of the following: physical damage to the device, circuit board damage, battery problems, etc.; software failures may include abnormalities in the device's operating system, applications, or firmware; network connectivity problems may include, but are not limited to, any of the following: unstable signal, connection interruption, etc.; sensor failures may include, but are not limited to, any of the following: temperature sensor, humidity sensor, or motion sensor, etc.; power problems may include, but are not limited to, any of the following: power adapter failure, battery lifespan exhaustion, or power cord damage, etc.; configuration problems may include, but are not limited to, issues related to network settings, account login, and device pairing; compatibility problems may include compatibility issues between different devices to be controlled; security problems may include, but are not limited to, network attacks, malware, etc. The severity of the failure is used to characterize whether the device can be used or is completely unusable.

[0078] The fault prompts provide users with appropriate error information and context to facilitate troubleshooting and improvement. In this embodiment, the actual network status and / or actual device parameters of the controlled device can be monitored in real time, and the system can promptly determine whether the controlled device is functioning correctly based on these parameters. Simultaneously, fault prompts generated according to the fault type and severity can be displayed on the interface via pop-ups or notifications, allowing users to troubleshoot and improve based on the prompts. This comprehensive error detection and user-friendly feedback enhance the system's robustness and user trust.

[0079] In one embodiment, the remote control method further includes: periodically querying the actual device status of the IoT device; and displaying the actual device status on a corresponding display interface. The actual device status characterizes the state or mode of the IoT device at a given moment. Generally, the actual device status reflects the IoT device's operating status, functional availability, and connection status with other devices or systems. For example, the actual device status of the IoT device may include, but is not limited to, one of the following: online / offline status, working / standby status, charging / discharging status, sensor data, device location, data transmission status, update status, fault status, and security status. In this embodiment, the connection parameters of the IoT device can be set through a configuration file or user input, such as network protocol, IP address and port, gateway and server information, authentication and authorization information, etc.; then, the actual device status of the IoT device is queried periodically and synchronized with the client's user interface to ensure that the IoT device can accurately reflect its status in real time. After the client receives a user's click operation, the click operation is converted into a device command and sent to the IoT device, and the user interface is updated in real time. This enables precise device control and status synchronization, achieving seamless interaction with the IoT device and improving control accuracy and response speed.

[0080] In one embodiment, Figure 5 This is a flowchart of another remote control method provided by an embodiment of the present invention. Based on the embodiments described above, this embodiment uses a smart toilet as the device to be controlled and an APP as the client to illustrate the control process of the smart toilet. When the user controls the smart toilet by clicking a button in the APP, the APP is designed with three independent threads to ensure a smooth operating experience. Figure 5 As shown, the method includes the following steps:

[0081] Firstly, the instruction sending thread: This is used to send instructions from the app to the manufacturer's cloud (i.e., cloud server). For example, when a user clicks the "nozzle massage" function in the app, the instruction sending thread can send this instruction to the manufacturer's cloud; when the cloud returns a successful receipt of the instruction, the task is completed and the thread ends. At this point, the cloud can send the instruction to the IoT platform, which in turn will send the instruction to the device.

[0082] Secondly, the page refresh thread: When a user issues a command, this page refresh thread immediately displays the activated state of the corresponding function. For example, when a user clicks the "nozzle massage" function on the app, the "nozzle massage" function is immediately activated, and the current position of the nozzle is displayed in real time.

[0083] Thirdly, the status receiving and judgment thread: This thread receives the status and real-time nozzle position from the device after executing the command. Due to inherent network latency, the device's feedback is often based on the status from 2-3 seconds ago. For example, when the device receives a "nozzle massage" command from the network platform, it immediately activates the "nozzle massage" function and simultaneously sends the activated status and the current nozzle position back to the IoT platform. The IoT platform then sends the command to the manufacturer's cloud. Finally, the app receives feedback from the cloud indicating the activated "nozzle massage" function and the real-time position. Due to inherent network latency, the position received by the app may be the device's position from 2-3 seconds ago. This status receiving and judgment thread has a delayed refresh mechanism, and its core operation is as follows:

[0084] First, upon receiving a trigger command for the nozzle massage function, the client sends the trigger command to the smart toilet. The smart toilet then executes the corresponding nozzle massage operation based on the trigger command and updates the current position status of the nozzles on the client's display page in real time.

[0085] Then, during the nozzle massage operation, if a new position state corresponding to the nozzle is received, the previously unexecuted delayed refresh task corresponding to the current position state is canceled, and a new delayed refresh task is set according to the new position state.

[0086] Finally, upon receiving the final position status of the nozzle, the final position status is compared with the position status displayed on the client's display page. If the final position status matches the position status displayed on the display page, the client's display page is not refreshed; if the final position status does not match the position status displayed on the display page, the display page is updated accordingly based on the final position status.

[0087] In one embodiment, Figure 6 This is a schematic diagram of the structure of a remote control device provided in an embodiment of the present invention. Figure 6 As shown, the device includes: a sending module 610, an animation display module 620, and a control module 630.

[0088] The sending module 610 is used to send the device control command to the device to be controlled in response to the received device control command, so that the device to be controlled can perform the corresponding operation based on the device control command.

[0089] Animation display module 620 is used to display the execution animation of the actuator in the device to be controlled when executing the device control command on the display page;

[0090] The control module 630 is used to receive the first execution status of the execution component fed back by the device to be controlled, and when the execution time node of the first execution status is earlier than the execution time node of the currently displayed second execution status, the display page is not refreshed.

[0091] In one embodiment, the remote control device further includes:

[0092] The control module 620 is further configured to display the first execution state of the execution component on the display page when the execution time node of the first execution state is later than the execution time node of the currently displayed second execution state.

[0093] In one embodiment, when the device control command includes multiple execution operations, the animation display module 620 includes:

[0094] The acquisition unit is used to acquire the preset delay time and task priority of each operation to be executed in the device control command;

[0095] The determination unit is used to determine the execution order of each execution component based on a preset delay time and task priority.

[0096] The display unit is used to display the execution animation of the execution component in the device to be controlled when executing the device control command on the display page according to the execution order.

[0097] In one embodiment, the remote control device further includes:

[0098] The first acquisition module is used to respond to the click operation of the received interactive control and acquire the actual interval time between the previous click and the current click of the interactive control;

[0099] The generation and display module is used to generate and display the corresponding click failure pop-up when the actual interval time is less than the pre-configured interval time threshold.

[0100] In one embodiment, the remote control device further includes:

[0101] The switching module is used to respond to the click operation of the received interactive control and switch the actual icon parameter of the displayed icon corresponding to the interactive control to the target configuration parameter.

[0102] In one embodiment, the remote control device further includes:

[0103] The second acquisition module is used to acquire the actual network status and / or actual device parameters of the device to be controlled in real time.

[0104] The second generation module is used to generate corresponding fault prompt information based on the fault type and severity when the actual network status and / or actual device parameters fail.

[0105] The second display module is used to display fault prompt information on the corresponding display interface through a preset display method; wherein, the preset display method includes one of the following: pop-up method and notification method.

[0106] In one embodiment, the remote control device further includes:

[0107] The query module is used to periodically query the actual device status of IoT devices;

[0108] The third display module is used to display the actual device status on the corresponding display interface.

[0109] The remote control device provided in the embodiments of the present invention can execute the remote control method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the method execution.

[0110] In one embodiment, Figure 7 This is a structural block diagram of a remote control system provided in an embodiment of the present invention. Figure 7 As shown, the remote control system in this embodiment includes: a device to be controlled 710 and a client 720; wherein, a wireless connection is established between the device to be controlled 710 and the client 720;

[0111] Upon receiving a device control command, the client 720 sends the device control command to the device to be controlled 710, so that the device to be controlled 710 performs the corresponding operation based on the device control command. The client 720 displays the execution animation of the execution component in the device to be controlled 710 when executing the device control command on the display page. The client 720 receives the first execution status of the execution component fed back by the device to be controlled 710. If the execution time node of the first execution status is earlier than the execution time node of the currently displayed second execution status, the display page is not refreshed.

[0112] In this embodiment, the device to be controlled 710 and the client 720 can be connected wirelessly, for example, via wireless communication protocols (such as WiFi, Bluetooth, or Zigbee). Of course, wired connections, cloud service connections, and direct connections can also be used. In one example, with a wired connection, an interface such as Ethernet or USB can be used. Wired connections typically offer high stability and transmission speed, but require a physical cable. In another example, with a cloud service connection, the device to be controlled can upload data to the cloud, and the client can obtain and control the device through the cloud service. Cloud service connections offer better scalability and flexibility. In yet another example, with a direct connection, a method such as Near Field Communication (NFC) or infrared can be used. Direct connections typically offer high security and convenience, but require physical proximity between the device and the client.

[0113] In one embodiment, Figure 8 This is a structural block diagram of an electronic device provided in an embodiment of the present invention, such as... Figure 8 The diagram illustrates a schematic representation of an electronic device 10 that can be used to implement embodiments of the present invention. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the invention described and / or claimed herein.

[0114] like Figure 8 As shown, the electronic device 10 includes at least one processor 11 and a memory, such as a read-only memory (ROM) 12 or a random access memory (RAM) 13, communicatively connected to the at least one processor 11. The memory stores computer programs executable by the at least one processor. The processor 11 can perform various appropriate actions and processes based on the computer program stored in the ROM 12 or loaded from storage unit 18 into the RAM 13. The RAM 13 may also store various programs and data required for the operation of the electronic device 10. The processor 11, ROM 12, and RAM 13 are interconnected via a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0115] Multiple components in electronic device 10 are connected to I / O interface 15, including: input unit 16, such as keyboard, mouse, etc.; output unit 17, such as various types of displays, speakers, etc.; storage unit 18, such as disk, optical disk, etc.; and communication unit 19, such as network card, modem, wireless transceiver, etc. Communication unit 19 allows electronic device 10 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0116] Processor 11 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. Processor 11 performs the various methods and processes described above, such as remote control methods.

[0117] In some embodiments, the remote control method may be implemented as a computer program tangibly contained in a computer-readable storage medium, such as storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed on electronic device 10 via ROM 12 and / or communication unit 19. When the computer program is loaded into RAM 13 and executed by processor 11, one or more steps of the remote control method described above may be performed. Alternatively, in other embodiments, processor 11 may be configured to perform the remote control method by any other suitable means (e.g., by means of firmware).

[0118] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), payload-programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0119] Computer programs used to implement the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when executed by the processor, the computer programs cause the functions / operations specified in the flowcharts and / or block diagrams to be performed. The computer programs may be executed entirely on a machine, partially on a machine, or as a standalone software package, partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0120] In the context of this invention, a computer-readable storage medium can be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, apparatus, or device. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination thereof. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0121] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0122] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as data servers), or computing systems that include middleware components (e.g., application servers), or computing systems that include frontend components (e.g., user computers with graphical user interfaces or web browsers through which users can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., communication networks). Examples of communication networks include local area networks (LANs), wide area networks (WANs), blockchain networks, and the Internet.

[0123] A computing system can include clients and servers. Clients and servers are generally located far apart and typically interact through a communication network. The client-server relationship is created by computer programs running on the respective computers and having a client-server relationship with each other. The server can be a cloud server, also known as a cloud computing server or cloud host, which is a hosting product within the cloud computing service system to address the shortcomings of traditional physical hosts and VPS services, such as high management difficulty and weak business scalability.

[0124] It should be understood that the various forms of processes shown above can be used, with steps reordered, added, or deleted. For example, the steps described in this invention can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this invention can be achieved, and this is not limited herein.

[0125] The specific embodiments described above do not constitute a limitation on the scope of protection of this invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this invention should be included within the scope of protection of this invention.

Claims

1. A remote control method characterized by, The method is applied to a client and comprises the following steps: sending, in response to a received device control instruction, the device control instruction to a device to be controlled, so that the device to be controlled performs corresponding operations based on the device control instruction; displaying, in a display page, an execution animation corresponding to an execution component in the device to be controlled when the execution component executes the device control instruction; receiving a first execution state of the execution component fed back by the device to be controlled, and not refreshing the display page when an execution time node of the first execution state is earlier than an execution time node of a second execution state currently displayed; when the device control instruction comprises a plurality of execution operations, the step of displaying, in the display page, the execution animation corresponding to the execution component in the device to be controlled when the execution component executes the device control instruction comprises the following steps: obtaining a preset delay time and a task priority of each execution operation in the device control instruction; determining an execution sequence corresponding to each execution component based on the preset delay time and the task priority; and displaying, in the display page, the execution animation corresponding to the execution component in the device to be controlled when the execution component executes the device control instruction according to the execution sequence.

2. The method of claim 1, wherein, The method further comprises the following steps: when the execution time node of the first execution state is later than the execution time node of the second execution state currently displayed, displaying the first execution state of the execution component in the display page.

3. The method according to any of claims 1-2, characterized in that, The method further comprises the following steps: in response to a received click operation of an interactive control, obtaining an actual interval time between a previous click and a current click of the interactive control; when the actual interval time is less than a preconfigured interval time threshold, generating and displaying a corresponding click fault pop-up window.

4. The method of claim 3, wherein, The method further comprises the following steps: in response to a received click operation of an interactive control, switching an actual icon parameter of a display icon corresponding to the interactive control to a target configuration parameter.

5. The method according to any of claims 1-2, characterized by, The method further comprises the following steps: obtaining actual network status and / or actual device parameters of the device to be controlled in real time; when the actual network status and / or the actual device parameters fail, generating corresponding fault prompt information according to a fault type and a fault severity; displaying the fault prompt information to a corresponding display interface through a preset display mode; wherein the preset display mode comprises one of the following: a pop-up window mode and a notification mode.

6. The method according to any one of claims 1-2, characterized in that, The method further comprises the following steps: timely querying actual device status of an Internet of Things device; displaying the actual device status to a corresponding display interface.

7. A remote control device, characterized in that The method is applied to a client and comprises the following steps: a sending module configured to send, in response to a received device control instruction, the device control instruction to a device to be controlled, so that the device to be controlled performs corresponding operations based on the device control instruction; an animation display module configured to display, in a display page, an execution animation corresponding to an execution component in the device to be controlled when the execution component executes the device control instruction; a control module configured to receive a first execution state of the execution component fed back by the device to be controlled, and not to refresh the display page when an execution time node of the first execution state is earlier than an execution time node of a second execution state currently displayed; When the device control instruction comprises a plurality of execution operations, the animation display module comprises: an acquisition unit configured to acquire a preset delay time and a task priority of each execution operation in the device control instruction; a determination unit configured to determine an execution order corresponding to each execution component based on the preset delay time and the task priority; and a display unit configured to display, in a display page, an execution animation corresponding to the execution component in the to-be-controlled device when the execution component executes the device control instruction, according to the execution order.

8. A remote control system characterized by, The method comprises: a to-be-controlled device and a client; wherein a wireless connection is established between the to-be-controlled device and the client; the client receives a device control instruction, sends the device control instruction to the to-be-controlled device, so that the to-be-controlled device executes a corresponding operation based on the device control instruction; the client displays, in a display page, an execution animation corresponding to an execution component in the to-be-controlled device when the execution component executes the device control instruction; and the client receives a first execution state of the execution component fed back by the to-be-controlled device, and does not refresh the display page when an execution time node of the first execution state is earlier than an execution time node of a second execution state currently displayed; when the device control instruction comprises a plurality of execution operations, the display of the execution animation corresponding to the execution component in the to-be-controlled device when the execution component executes the device control instruction in the display page comprises: acquiring a preset delay time and a task priority of each execution operation in the device control instruction; determining an execution order corresponding to each execution component based on the preset delay time and the task priority; and displaying, in a display page, an execution animation corresponding to the execution component in the to-be-controlled device when the execution component executes the device control instruction, according to the execution order.

9. An electronic device, comprising: The electronic device comprises: at least one processor; and a memory connected to the at least one processor in communication; wherein the memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor to enable the at least one processor to execute the remote control method in any one of claims 1-6.

10. A computer-readable storage medium, characterized in that, The computer readable storage medium stores computer instructions for enabling the processor to execute the remote control method in any one of claims 1-6 when executed.

Images