Robot control method and system, and client device

By determining the target direction and speed through interface sliding operations, combined with limit zones and draggable controls, the problem of users having difficulty in accurately controlling the movement of surface cleaning robots is solved, realizing omnidirectional and directional constant speed autonomous movement, improving user experience and cleaning efficiency.

WO2024230402A1PCT designated stage expired Publication Date: 2024-11-14ECOVACS HOME SERVICE ROBOTICS CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2024/087347
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-31
Filing Date
2024-04-11
Publication Date
2024-11-14

AI Technical Summary

Technical Problem

When using surface cleaning robots, users often find it difficult to precisely control the robot to move in the desired direction using remote control tools, especially when cleaning large surfaces, which requires continuous operation and leads to inconvenience.

Method used

A robot control method is provided, which determines the target direction and movement speed through sliding operations on the interface, allows users to control the robot to move in any direction, and enables autonomous movement in all directions and at a constant speed through limit zones and draggable controls.

Benefits of technology

It improves the user control experience, reduces the operational burden, lowers remote control costs, and enables robots to clean large surfaces efficiently.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024087347_14112024_PF_FP_ABST
    Figure CN2024087347_14112024_PF_FP_ABST
Patent Text Reader

Abstract

Embodiments of the present application provide a robot control method and system, and a client device. The method comprises: in response to a sliding operation in any direction in 360 degrees on an interface, determining a target direction; determining a moving speed according to an area to which the operation termination position of the sliding operation belongs in the interface; and according to the target direction, controlling a robot to adjust the posture and to move at the moving speed according to the adjusted posture. According to the technical solution provided by the present application, by means of the design that a user can perform a sliding operation in any direction on an interface, the user can control the robot to move in any direction, thereby providing an omnidirectional movement control function for the robot. In addition, according to the present solution, the moving speed is determined according to the area to which the operation termination position belongs on the interface, so that a variety of moving speed determination modes can be achieved, thereby meeting users' diverse control needs for moving speeds of robots, and improving users' control experience.
Need to check novelty before this filing date? Find Prior Art

Description

Robot control method, system and client device

[0001] Cross-references

[0002] This application claims priority from the Chinese patent applications listed in the table below, the entire contents of which are incorporated herein by reference. Technical Field

[0003] The present application relates to the field of robotics technology, and in particular to a robot control method, system, and client device. Background Art

[0004] Surface cleaning robots, such as window cleaning robots, can help users living on higher floors clean various smoother surfaces such as facade glass windows and glass doors, reduce labor costs, and reduce the risks of window and door cleaning.

[0005] When using a surface cleaning robot, users can manually control it with the help of a remote control tool to complete its work. However, currently, when users use a remote control tool, such as a corresponding application installed on a terminal, to control the surface cleaning robot, they are unable to control the robot to move in the direction they actually want it to move to perform cleaning work. Moreover, when the surface cleaning robot is used to clean large surfaces such as glass, the user often needs to keep controlling it on the corresponding application interface. Once the control is stopped, the surface cleaning robot will immediately stop working, which brings great inconvenience to the user.

[0006] Summary of the Invention

[0007] In view of the above problems, the present application provides a robot control method, system and client device that solve the above problems or at least partially solve the above problems.

[0008] In one embodiment of the present application, a robot control method is provided. The method is applicable to a client and includes:

[0009] In response to a sliding operation in any direction of 360 degrees on the interface, determining a target direction;

[0010] determining a moving speed according to the area to which the operation termination position of the sliding operation belongs in the interface;

[0011] According to the target direction, the robot is controlled to adjust its posture and move at the moving speed according to the adjusted posture.

[0012] In another embodiment of the present application, a robot control method is provided. The method is applicable to a client and includes:

[0013] In response to a sliding operation on the interface, determining a sliding distance;

[0014] Determining, based on the sliding distance, the region to which the operation termination position of the sliding operation belongs in the interface;

[0015] Determining a moving speed according to the area to which the operation termination position belongs in the interface;

[0016] Control the robot to move at the moving speed.

[0017] In another embodiment of the present application, a robot control method is provided. The method is applicable to a client and includes:

[0018] In response to a sliding operation in any direction of 360 degrees on the interface, determining a target direction;

[0019] determining a movement speed in response to a release operation after the sliding operation reaches the target area;

[0020] According to the target direction, the robot is controlled to adjust its posture and continuously move at the moving speed according to the adjusted posture.

[0021] In another embodiment of the present application, a robot control method is provided. The method is applicable to a client and includes:

[0022] On the interface, a manipulation control is displayed, wherein the manipulation control includes a limit area and a draggable control on the limit area that can be dragged in any direction;

[0023] When detecting that the draggable control is triggered to move in any direction of 360 degrees on the limit area, controlling the robot to follow the target direction corresponding to when the draggable control stops moving, adjusting the moving direction, and moving in accordance with the adjusted moving direction;

[0024] When detecting that the draggable control stops in a first area of ​​the limit zone and is released, the draggable control returns to a set position, and the robot is controlled to stop moving;

[0025] When it is detected that the draggable control stops moving in a second area in the limiting area and is released, the draggable control is locked, and the robot is controlled to maintain moving in the adjusted moving direction; wherein the second area is outside the first area.

[0026] Another embodiment of the present application provides a robot control system. The robot control system includes:

[0027] A robot for performing a work task on a surface of a work object;

[0028] The client is connected to the robot for communication and is used to implement the steps of the robot control methods provided in the present application.

[0029] Another embodiment of the present application provides a client device. The client device includes a memory and a processor; wherein,

[0030] The memory stores one or more computer instructions;

[0031] The processor, coupled to the memory, is configured to execute the one or more computer instructions to implement the steps in the robot control methods provided in the present application.

[0032] The technical solution provided by one embodiment of the present application, in response to a sliding operation in any 360-degree direction on an interface, determines the target direction and then determines the movement speed based on the area within the interface to which the sliding operation ends. The robot can then be controlled to adjust its posture according to the target direction and move at the speed according to the adjusted posture. This solution, by enabling users to slide in any direction on the interface, allows users to control the robot to move in any direction, thus providing omnidirectional movement control for the robot. Furthermore, by determining the movement speed based on the area within the interface to which the operation ends, this solution allows for a variety of movement speed determination methods, helping to meet users' diverse control needs for the robot's movement speed and improving the user's control experience.

[0033] Another embodiment of the present application provides a technical solution that, based on the sliding distance determined in response to a sliding operation on an interface, can first determine the area within the interface to which the sliding operation ended, and then determine the movement speed based on the area within the interface to which the operation ended, thereby controlling the robot to move at that speed. This solution determines the movement speed based on the area within the interface to which the operation ended, enabling multiple control options for the robot's movement speed, providing users with diverse speed control capabilities.

[0034] Another embodiment of the present application provides a technical solution that, after determining the target direction in response to a sliding operation in any direction along the 360-degree direction on the interface, and determining the moving speed in response to a release operation after the sliding operation reaches the target area, can control the robot to adjust its posture according to the target direction, and continue to move at the moving speed determined by the adjusted posture. This solution can control the robot to continue moving even if the user is not performing any operations after the user performs a sliding operation to the target area, which helps to reduce the user's operating burden, improve remote control (human-computer interaction) efficiency, and reduce remote control costs. In particular, it provides users with very friendly human-computer interaction when controlling the robot to operate on a work object with a large surface area.

[0035] In addition, a window cleaning robot is an intelligent window cleaning appliance, which is increasingly favored by users due to its flexible movement and easy operation. During the window cleaning process, the window cleaning robot relies on the negative pressure generated by the fan and the like to adsorb on the glass, and drives the window cleaning robot to move autonomously on the glass surface through the tracks installed at the bottom, thereby completing the cleaning. However, when it is necessary to adjust the direction of travel of the window cleaning robot, the process is complicated, and it is difficult to control the window cleaning robot to move in the direction desired by the user. In response to this, the present application also provides a remote control method, device, equipment, and readable storage medium for a surface cleaning robot, which can control the surface cleaning robot in 360-degree directions to any direction by operating the remote control on the APP interface, so that the surface cleaning robot can quickly move in the direction desired by the user, and the operation is simple and efficient. Specifically,

[0036] In a first aspect, an embodiment of the present application provides a remote control method for a surface cleaning robot, which is applied to an electronic device. The method includes:

[0037] In response to the instruction to enter the remote control page, a remote control page is displayed on the user interface, wherein the remote control page is provided with operable remote control controls;

[0038] The direction of travel of the surface cleaning robot is remotely controlled in response to user operation of the remote control.

[0039] In a second aspect, an embodiment of the present application provides a remote control method for a surface cleaning robot, which is applied to the surface cleaning robot, and the method includes:

[0040] Receiving a remote control instruction from an electronic device, wherein the remote control instruction is triggered by the electronic device in response to a user's operation on a remote control control, and the remote control is an operable control displayed on a remote control page of a user interface of the electronic device;

[0041] Control the direction of travel according to the remote control instructions.

[0042] In a third aspect, an embodiment of the present application provides a remote control device, comprising:

[0043] A display module, configured to display a remote control page on the user interface in response to an instruction to enter a remote control page, wherein the remote control page is provided with operable remote control controls;

[0044] The processing module is configured to remotely control the travel direction of the surface cleaning robot in response to a user's operation of the remote control control.

[0045] In a fourth aspect, an embodiment of the present application provides a remote control device, including:

[0046] A receiving module, configured to be triggered by an operation of a control, wherein the remote control control is an operable control displayed on a remote control page of a user interface of the electronic device;

[0047] The processing module is used to control the travel direction according to the remote control instruction.

[0048] In a fifth aspect, an embodiment of the present application provides an electronic device, comprising: a processor, a memory, and a computer program stored on the memory and runnable on the processor, wherein when the processor executes the computer program, the electronic device implements the method described in the first aspect or various possible implementation methods of the first aspect.

[0049] In a sixth aspect, an embodiment of the present application provides an electronic device, comprising: a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the electronic device implements the method described in the second aspect or various possible implementations of the second aspect.

[0050] In the seventh aspect, an embodiment of the present application provides a computer-readable storage medium, in which computer instructions are stored. When the computer instructions are executed by a processor, they are used to implement the method described in the first aspect or various possible implementation methods of the first aspect.

[0051] In an eighth aspect, an embodiment of the present application provides a computer-readable storage medium, in which computer instructions are stored. When the computer instructions are executed by a processor, they are used to implement the method described in the second aspect or various possible implementation methods of the second aspect.

[0052] In a ninth aspect, an embodiment of the present application provides a computer program product comprising a computing program, which, when executed by a processor, implements the method described in the first aspect or various possible implementations of the first aspect.

[0053] In the tenth aspect, an embodiment of the present application provides a computer program product comprising a computing program, which, when executed by a processor, implements the method described in the second aspect or various possible implementations of the second aspect.

[0054] The embodiments of the present application provide a method, apparatus, device, and readable storage medium for remotely controlling a surface cleaning robot. The surface cleaning robot's app is installed on an electronic device, and a user accesses the remote control page on the app and slides the remote control on the page to remotely control the direction of the surface cleaning robot. Using this solution, the surface cleaning robot's app is installed on an electronic device, and by operating the remote control on the app interface, the surface cleaning robot can be controlled to face any direction in 360 degrees, allowing the surface cleaning robot to quickly face the user's desired direction, resulting in simple and efficient operation. BRIEF DESCRIPTION OF THE DRAWINGS

[0055] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, a brief introduction will be given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0056] FIG1a is a schematic diagram of the inner and outer surfaces of a work object provided by an embodiment of the present application;

[0057] FIG1b is a schematic diagram showing the difference in directions of the inner and outer surfaces of a work object provided by an embodiment of the present application;

[0058] FIG2 is a schematic flow chart of a robot control method provided in an embodiment of the present application;

[0059] FIG3 is a schematic diagram showing a principle of entering a manual remote control interaction interface according to an embodiment of the present application;

[0060] 4a and 4b are schematic diagrams of dragging interactive control on a first area in a limited area included in a manual remote control interactive interface according to an embodiment of the present application;

[0061] FIG5a and FIG5b are schematic diagrams of a draggable control provided by an embodiment of the present application being dragged to a second area in a restricted area;

[0062] FIG6a and FIG6b are schematic diagrams of a draggable control in a locked state provided by an embodiment of the present application;

[0063] FIG7 is a schematic diagram of a graphic element on a draggable control synchronizing the orientation of a robot according to an embodiment of the present application;

[0064] 8 and 9 are schematic flow charts of a robot control method provided in an embodiment of the present application;

[0065] FIG10 is a schematic structural diagram of a robot control system provided in one embodiment of the present application;

[0066] FIG11 is a schematic structural diagram of a robot control device provided in one embodiment of the present application.

[0067] FIG12 is a schematic diagram of a scenario of a remote control method for a surface cleaning robot provided in an embodiment of the present application;

[0068] FIG13 is a bottom view of a surface cleaning robot remotely controlled by an electronic device according to an embodiment of the present application;

[0069] FIG14 is a schematic diagram of the rotation process of the three-axis acceleration sensor of the surface cleaning robot;

[0070] FIG15 is a flow chart of a remote control method for a surface cleaning robot provided in an embodiment of the present application;

[0071] FIG16 is a schematic diagram of interface changes of an electronic device in a control method of a surface cleaning robot provided in an embodiment of the present application;

[0072] FIG17 is a schematic diagram showing the relationship between angle and direction in the control method of the surface cleaning robot provided in an embodiment of the present application;

[0073] FIG18A is a schematic diagram of a user sliding a remote control control 90° in a control method for a surface cleaning robot according to an embodiment of the present application;

[0074] FIG18B is a schematic diagram of an action of the surface cleaning robot;

[0075] FIG18C is another schematic diagram of the surface cleaning robot in action;

[0076] FIG18D is another schematic diagram of the surface cleaning robot in action;

[0077] 19 is a schematic diagram of a first preset time length and a second preset time length in a surface cleaning robot control method provided by an embodiment of the present application;

[0078] FIG20A is a schematic diagram of an interface in which a user slides a remote control in different directions in succession in a method for controlling a surface cleaning robot provided by an embodiment of the present application;

[0079] FIG20B is a schematic diagram of the operation of the surface cleaning robot corresponding to FIG20A;

[0080] FIG21A is a schematic diagram of an operation of the surface cleaning robot provided by an embodiment of the present application when located at an exterior window;

[0081] FIG21B is another schematic diagram of the surface cleaning robot provided by an embodiment of the present application when located at an exterior window;

[0082] FIG22 is a flow chart of a control method for a surface cleaning robot provided in an embodiment of the present application;

[0083] FIG23 is a schematic diagram of a remote control device provided in an embodiment of the present application;

[0084] FIG24 is a schematic diagram of a remote control device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0085] Before introducing the technical solutions provided by the embodiments of the present application, some nouns or professional terms involved in the present application are briefly introduced and explained.

[0086] The "inner surface" and "outer surface" of objects such as glass windows and glass doors (also referred to as work objects below) involved in this application are relative to the user. Specifically:

[0087] An inner surface refers to the surface of an object, such as a glass window or door, that faces the user. For example, the window 2 shown in Figure 1a has a window surface 21 facing the user 1, which is the inner window (inner surface) relative to the user 1.

[0088] The exterior surface refers to the window or door surface, etc., on the opposite side of the interior surface. The exterior surface and the interior surface are two opposing, non-adjacent surfaces. Figure 1b shows an exploded schematic diagram of the surfaces of the glass window 2 in Figure 1a. As shown in Figure 1b, the exterior window (exterior surface) facing user 1 is window surface 22 on the opposite side of window surface 21 (the interior window).

[0089] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.

[0090] In some processes described in the specification, claims and the above-mentioned figures of this application, multiple operations that appear in a specific order are included. These operations may not be executed in the order in which they appear in this article or may be executed in parallel. The serial numbers of the operations, such as 101, 102, etc., are only used to distinguish between different operations, and the serial numbers themselves do not represent any order of execution. In addition, these processes may include more or fewer operations, and these operations may be executed in sequence or in parallel. It should be noted that the descriptions of "first", "second", etc. in this article are used to distinguish different modes, devices, modules, etc., and do not represent a sequence, nor do they limit "first" and "second" to different types. In addition, the embodiments described below are only some of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without making creative work are within the scope of protection of this application.

[0091] The following is a detailed description of the various embodiments provided in this application.

[0092] Figure 2 shows a flow chart of a robot control method provided by an embodiment of the present application. The execution subject of the method is a client, which can be a terminal used by the user. More specifically, the execution subject can be an application software installed on the terminal, or it can be a hardware with an embedded program integrated on the terminal, or it can be a tool software embedded in the terminal operating system, etc., which is not limited in this embodiment. Preferably, the execution subject is specifically an application software installed on the terminal that can be used for remote control of the robot. The terminal can be a smart phone, tablet computer, personal computer, smart wearable device (such as a smart bracelet), remote control, etc. that can communicate with the robot, which is not limited in this embodiment. The robot can be a surface cleaning robot for cleaning surfaces, such as a window cleaning robot, a sweeping robot, etc. As shown in Figure 2, the robot control method provided in this embodiment includes the following steps:

[0093] 101. In response to a sliding operation in any direction of 360 degrees on the interface, determine a target direction;

[0094] 102. Determine a moving speed according to the area to which the operation termination position of the sliding operation belongs in the interface;

[0095] 103. According to the target direction, control the robot to adjust its posture and move according to the adjusted posture.

[0096] In the above 101, the interface is provided by the client. The client (such as application software) often has multiple interfaces, each corresponding to different functions. The interface described above is the manual remote control interaction interface provided by the client for remotely controlling the robot. For example, the manual remote control interaction interface 5 or manual remote control interaction interface 5' shown in Figure 3. The user can enter the manual remote control interaction interface 5 or manual remote control interaction interface 5' by clicking the "manual remote control" control 31 on the main interface 3 provided by the client.

[0097] As shown in FIG3 , the manual remote control interactive interface 5 displays a control panel, which includes a limit area 51 and a draggable control 511 on the limit area 51 that can be dragged in any direction within 360 degrees. The limit area 51 can be used to limit the range within which the draggable control can be dragged, lock the draggable control, and so on. The draggable control 511 is used to at least control the direction in which the robot moves on the surface of the work object. For example, the robot's movement speed can be set to a fixed value, that is, the robot moves at a constant speed on the surface of the work object. In this case, the draggable control 511 can only be used to control the robot's movement speed. The draggable control 511 can be moved in any direction within the range defined by the limit area 51, thereby allowing the user to control the robot's omnidirectional movement by dragging the draggable control 511 in any direction within the limit area 51. That is, the sliding operation performed in any direction within the 360-degree direction on the interface described in 101 above, in other words, the touch-and-drag operation performed by the user on the draggable control 511 within the restricted area 51 along any direction within the 360-degree direction. The corresponding sensor on the execution body can be used to detect whether the draggable control 511 is touched, thereby determining whether the user has triggered a touch-and-drag operation on the draggable control within the restricted area. Specifically, when it is detected that the draggable control is touched and the position of the draggable control changes, it is determined that the user has triggered a drag operation on the draggable control within the restricted area.

[0098] In addition to being used to control the direction of the robot's movement, the above-mentioned draggable control 511 can also be used to control other variables of the robot in some other embodiments. For example, it can also be used to control the speed of the robot's movement. Specifically, the speed of the robot's movement can be controlled by combining at least one of the area where the draggable control 511 is located in the limit area 51 and the distance relative to the center of the limit area 51.

[0099] The specific implementation of controlling the direction, speed, etc. of the robot's movement through the draggable control 511 will be described in detail below and will not be repeated here.

[0100] The shapes of the restricted area 51 and the draggable control 511 shown in FIG3 are both circular. This circular shape is for illustration only. In practice, the restricted area 51 and the draggable control 511 may also be other shapes, such as rectangles (such as rounded rectangles or right-angled rectangles), ellipses, etc. In addition, the default initial display position of the draggable control 511 is the center (the exact center) of the restricted area. That is, when the user does not perform any drag operation on the draggable control, the draggable control is displayed at the center of the restricted area by default. Specifically, by default, the draggable control and the restricted area are displayed concentrically.

[0101] Based on the above, the method provided in this embodiment may further include the following steps:

[0102] 100a. A manipulation control is displayed on the interface, wherein the manipulation control includes a limit area and a draggable control on the limit area that can be dragged in any direction;

[0103] 100b. In response to the sliding operation, the draggable control moves within the restricted area according to the sliding operation;

[0104] In the above 101, when determining the target direction, it can be determined based on the operation termination position of the sliding operation. That is, an achievable solution of the above 101 "determining the target solution in response to the sliding operation" can specifically include:

[0105] 1011. Determine an operation termination position of the sliding operation;

[0106] 1012. Determine the target direction based on the operation termination position.

[0107] In specific implementation, the operation termination position of the above-mentioned sliding operation is the position of the draggable control in the restricted area when the movement stops, or the position of the draggable control in the restricted area when the user stops dragging the draggable control. Specifically, it can be determined based on the position information of the center point of the draggable control in the restricted area when dragging stops.

[0108] Among them, stopping dragging the draggable control mainly refers to the user pausing dragging the draggable control but still keeping touching the draggable control; of course, in other instances, stopping dragging the draggable control may also refer to the user ending the dragging operation of the draggable control, that is, the user is no longer touching the draggable control (or has released the above-mentioned sliding operation). In short, the user has released the draggable control, such as the case where the user drags the draggable control to the second area in the limited area and releases it as described below.

[0109] For example, as shown in FIG4 a , when the movement stops, the draggable control 511 is at a position R away from the center of the limit zone and the positive half axis of the x-axis. This position is the end position of the sliding operation.

[0110] Based on the end position of the above-mentioned sliding operation, the distance of the draggable control relative to the center of the limit zone, the area where the draggable control is located in the limit zone, the deflection angle of the draggable control relative to the reference direction, etc. can be analyzed to provide data support for the robot to determine the speed and direction of movement.

[0111] Based on the above, in one possible technical solution, the above 1012 “determining the target direction based on the operation termination position” may specifically include:

[0112] 10121. Determine, based on the operation termination position, a deflection angle of the draggable control relative to a reference direction;

[0113] 10122. Determine the target direction based on the deflection angle.

[0114] In specific implementations, the positive direction of a coordinate axis in the image coordinate system corresponding to the restricted area can be used as the reference direction described above, but is not limited to this. When determining the deflection angle of the draggable control relative to the reference direction, the deflection angle can be determined in a predetermined direction, such as a clockwise direction, with the angle between the vector formed by the line connecting the center of the restricted area and the operation end position (i.e., the position at which the draggable control stops moving) and the reference direction being used as the deflection angle.

[0115] For example, as shown in Figure 4a, the positive direction of the y-axis in the image coordinate system corresponding to the limited area (the north direction) can be used as a reference direction. When the dragging stops, the deflection angle of the draggable control relative to the positive direction of the y-axis is 90°, and the determined target direction is the positive direction of the x-axis (the right direction, that is, the east direction); or as shown in Figure 5a, if the deflection angle of the draggable control 511 relative to the reference direction is 45°, then the determined target direction is 45° east of north.

[0116] The target direction determined above can determine the direction in which the robot moves on the surface of the work object. In other words, the target direction indicated by the deflection angle of the draggable control relative to the reference direction determines the direction in which the robot moves.

[0117] The specific implementation of the above 102 will be described in detail below and will not be further described here.

[0118] In the above 103, the determined target direction can be sent to the robot so that the robot adjusts its own orientation posture according to the received target direction, and after the adjustment is completed, moves on the surface of the work object according to the adjusted orientation posture at the moving speed determined by the above step 102, thereby performing the corresponding work task.

[0119] For example, continuing to refer to Figure 4a and continuing with the examples listed in the detailed description of steps 10121 to 10122, it is assumed that the robot moves to a position on the surface of the work object 2, such as the position of the robot 200 shown by the dotted line, and the target direction received from the client is the positive direction of the x-axis (due to the right direction). At this time, the robot will adjust its own orientation posture to the due right direction. The adjusted orientation posture is such as the posture of the robot 200 shown by the solid line, and it moves on the surface of the work object 2 according to the adjusted orientation posture.

[0120] The working object can be a vertical glass window, a tiled wall, or the ground. For example, if the robot is an adsorption-type surface cleaning robot, the working object can be a vertical glass window, a tiled wall, etc.; if the robot is a sweeping robot, the working object can be the ground.

[0121] It's important to note that in addition to sending the target direction to the robot, the robot can also receive the determined movement speed and the actual surface of the object it's working on to ensure it moves in the correct direction and at the appropriate speed. The specific implementation of determining the movement speed and the actual surface corresponding to the object the robot is working on will be discussed in detail below and will not be detailed here.

[0122] The technical solution provided by this embodiment, in response to a sliding operation in any direction along the 360-degree direction on the interface, after determining the target direction, also determines the movement speed based on the area in the interface to which the operation end position of the sliding operation belongs. The robot can then be controlled to adjust its posture according to the target direction and move at the said movement speed according to the adjusted posture. This solution is designed so that the user can perform a sliding operation in any direction on the interface. Specifically, by designing a draggable control that can be dragged in any direction, the user can control the robot to move in any direction, thereby providing the robot with omnidirectional movement control function. In addition, this solution determines the movement speed based on the area on the interface to which the operation end position belongs, which can achieve a variety of movement speed determination methods, which is conducive to meeting the user's diverse control requirements for the robot's movement speed and improving the user's control experience.

[0123] Furthermore, in addition to determining the target direction based on the end position of the sliding operation to control the direction of the robot's movement, this embodiment can also determine the movement speed based on the end position of the sliding operation to control the movement speed of the robot. The movement speed can be determined in combination with the sliding distance. Based on this, in one possible technical solution, the above 102 "determining the movement speed based on the area to which the operation end position belongs on the interface" can specifically include the following steps:

[0124] S01. determining a sliding distance based on the operation termination position;

[0125] S02. Determine, based on the sliding distance, the region to which the operation termination position belongs in the interface;

[0126] S03. Determine the moving speed based on the area to which the operation termination position belongs in the interface.

[0127] In the above S01, the sliding distance refers to the distance between the operation end position of the sliding operation and the center of the limit zone. That is, the above S01 "determining the sliding distance based on the operation end position" may specifically include:

[0128] S011. Calculate the distance between the operation termination position and the center position of the limiting area to determine it as the sliding distance.

[0129] During specific implementation, a corresponding distance calculation algorithm, such as Euclidean distance, may be used to calculate the distance between the operation termination position and the center position of the limiting area.

[0130] In the above S02, since the operation termination position is the position of the draggable control on the restricted area when it stops moving, the area of ​​the draggable control in the restricted area can be first determined based on the sliding distance; the area of ​​the draggable control in the restricted area is the area on the interface to which the operation termination position belongs. That is, the above S02 "determining the area on the interface to which the operation termination position belongs based on the sliding distance" can specifically include:

[0131] S021. Determine, based on the sliding distance, the area where the draggable control is located in the limiting area;

[0132] S022: Determine the area where the draggable control is located in the limiting area as the area to which the operation termination position belongs in the interface.

[0133] Accordingly, an implementation of the above-mentioned S03 “determining the moving speed based on the area to which the operation termination position belongs in the interface” is:

[0134] S031. Determine the moving speed based on the area where the draggable control is located in the limiting area.

[0135] In specific implementation, in this embodiment, the restricted area is mainly divided into two areas. When the draggable control is in different areas, the method used to determine the movement speed of the robot to be controlled will also be different. For example, assume that the restricted area is mainly divided into a first area and a second area outside the first area. Specifically, as shown in Figure 4a, if the first area 512 is the area in the restricted area surrounded by a circle with a radius of R and the center of the restricted area as the circle, and the second area 513 is the area surrounded by a circular ring at the outermost part of the restricted area, then when the sliding distance is less than or equal to R, the first area of ​​the draggable control in the restricted area can be determined; when the sliding distance is greater than or equal to R', the second area of ​​the draggable control in the restricted area can be determined; wherein R-R'=ΔR; wherein R' represents the distance from the center of the restricted area to the inner edge line l of the second area 513.

[0136] If the draggable control is in the first area when dragging stops, the speed of the robot's movement can be determined by the distance value between the draggable control and the center of the limit area (i.e., the sliding distance mentioned above), or a preset speed value can be directly determined as the speed of the robot's movement, etc.; if the draggable control is in the second area when dragging stops, the speed of the robot's movement can be determined by the deflection angle of the draggable control relative to the reference direction, or the speed of the robot's movement can be determined according to the user's rotation angle, rotation direction, etc. of the second area, and of course, another preset speed value can be directly determined as the speed of the robot's movement, etc., which is not limited here.

[0137] Based on the above, in this embodiment, the aforementioned limiting area includes a first area and a second area outside the first area. In a specific implementation scheme, the above S031 "determining the movement speed based on the area where the draggable control is located in the limiting area" can be implemented by the steps in any of the following situations:

[0138] Case 1: If the draggable control is in the first area of ​​the limiting area, then: the moving speed is determined according to the sliding distance; or a first preset speed is determined as the moving speed.

[0139] Case 2: If the draggable control is in the second area of ​​the limited area, then: determine the moving speed based on the deflection angle; or, in response to a rotation operation on the second area, determine the moving speed based on the rotation angle and rotation direction corresponding to the rotation operation; or, determine the second preset speed as the moving speed.

[0140] In the above situation, if method 11 is adopted: determining the moving speed according to the sliding distance, then: the smaller the sliding distance, the smaller the moving speed; the larger the sliding distance, the larger the moving speed. That is, the sliding distance is proportional to the moving speed. In specific implementation, the moving speed can be determined based on the preset correspondence between distance and speed. The preset correspondence between distance and speed can be represented by a mathematical expression. The data expression can be a continuous function or a piecewise function. Among them,

[0141] When the data expression of the preset relationship between distance and speed is a continuous function, the robot's movement speed can be determined based on the ratio of the distance d (i.e., the sliding distance) of the draggable control relative to the center of the restricted area to the maximum distance D that the user can drag the draggable control in the first area; wherein, the maximum distance D that the draggable control can be dragged in the first area can be, but is not limited to, determined based on the distance of a target pixel point in the first area relative to the center of the restricted area, the target pixel point being the pixel point in the first area farthest from the center of the restricted area. In this case, the data expression of the preset relationship between distance and speed can be as follows:

[0142] Formula 1: Speed

[0143] Where V represents the maximum moving speed supported by the robot.

[0144] For example, referring to FIG4a , assuming that the first area 512 is an area in the limiting area enclosed by a circle with a radius R and a center of the limiting area, when dragging stops, the draggable control 511 is on the boundary of the first area, that is, the distance between the draggable control 511 and the center of the limiting area is R. Based on the correspondence between the preset distance and speed represented by the above formula 1, the moving speed determined for the robot is V.

[0145] In the case where the data expression of the correspondence between the preset distance and speed is a piecewise function, it can be obtained by constructing the maximum distance D of the draggable control that can be dragged on the first area in segments according to the several speed gears supported by the robot, wherein each segment corresponds to a speed gear supported by the robot. For example, assuming that the movement speed supported by the robot is divided into the following three gears: high speed (corresponding to the movement speed of V1), medium speed (corresponding to the movement speed of V2), and low speed (corresponding to the movement speed of V3), and accordingly, the maximum distance D can be divided into three segments, and the three distance segment ranges obtained by the division are as follows: 0~D1, D1~D2, D2~D, then in this case, the data expression of the correspondence between the preset distance and speed can be as follows: Formula 2:

[0146] Formula 2: Speed Among them, V1>V2>V3

[0147] The above V1, V2 and V3 represent the movement speeds supported by the robot.

[0148] If method 12 is adopted: the first preset speed is determined as the moving speed, the first preset speed can be flexibly set according to actual conditions, as long as the first preset speed does not exceed the maximum moving speed supported by the robot.

[0149] In the above situation 2, if method 21 is adopted: determining the moving speed of the robot based on the deflection angle of the draggable control relative to the reference direction, the prerequisite is that the designed second area is fixed and cannot be rotated. In this case, the deflection angle (or target direction) and the moving speed are in a one-to-one correspondence. In specific implementation, the moving speed can be determined based on the correspondence between the preset angle and the speed. The correspondence between the preset angle and the speed can be established based on the number of directions into which the direction of the second area is divided and the maximum moving speed supported by the robot; wherein, if the number of directions into which the direction of the second area is divided is N, then the circumference corresponding to the second area (360°, viewed around the center of the limit area) is divided into N parts at equal intervals, thereby dividing the direction of the second area into N directions, and each change of 360° / N angle in the second area means a change of one direction. When the above-mentioned N is infinite or N is greater than a set threshold such as 20000, it can be considered that the direction of the second area is designed to be unlimited; when N is finite and N is less than or equal to a set threshold (such as 20000, 360, 24, etc.), it can be considered that the direction of the second area is designed to be limited.

[0150] For example, referring to FIG4a or FIG5 , the second area 513 is assumed to be the area enclosed by a circular ring at the outermost portion of the limiting area. If the circumference corresponding to the second area 513 (360°, viewed around the center of the limiting area 51 (i.e., center point 0)) is equally spaced into 24 parts, that is, the direction of the second area 513 is divided into 24 directions, and each change of 15° in the second area 513 is a change in one direction. At this time, a speed value can be set for each direction of the robot based on the maximum moving speed V supported by the robot. In other words, a speed value is set every 15° in the second area 513. Specifically, the data expression for the corresponding relationship between direction and speed (i.e., angle and speed) is as follows:

[0151] Formula 3: Speed 15°*(n-1)≤θ<15°*n, where n=1, 2, ..., 24

[0152] Wherein, V is the maximum movement speed supported by the robot; the angle θ represents the deflection angle of the draggable control relative to the reference direction.

[0153] The above formula 3 can also be represented by the following Table 1:

[0154] Table 1

[0155] Based on the above formula 3, assuming that the second area 513 shown in Figure 5a is fixed, if the specific position of the draggable control 511 in the second area 513 is as shown in Figure 5a, the deflection angle of the draggable control relative to the reference direction is 45°, and the moving speed determined for the robot is (V / 24)*3.

[0156] If method 22 is adopted: the movement speed is determined based on the rotation angle and rotation direction corresponding to the rotation operation triggered on the second area, the prerequisite is that the designed second area can be rotated. In this case, after the user drags the draggable control to the first position of the second area and stops, the draggable control can be released. At this time, the draggable control will be fixed at the first position of the second area when it was released, that is, the deflection angle of the draggable control relative to the reference direction remains fixed. The user can then rotate the second area, where the rotation direction can determine whether the robot's speed is increased or decreased, and the rotation angle can determine the magnitude of the speed increase or decrease. For example, when rotating clockwise, the larger the rotation angle, the greater the movement speed; when rotating counterclockwise, the larger the rotation angle, the smaller the movement speed. That is, the deflection angle (or target direction) and the movement speed are in a one-to-many correspondence.

[0157] In specific implementation, similar to the description in the above method 21, some relevant contents of establishing a preset correspondence between angle and speed based on the number of directions in which the direction of the second area is divided and the maximum moving speed supported by the robot, in this method 22, a correspondence between a rotation angle, a rotation direction and a speed will also be established in advance based on the number of directions in which the direction of the second area is divided and the maximum moving speed supported by the robot.

[0158] For example, assuming that the second area 513 shown in FIG5a is rotatable, the baseline of the second area (the extension of the baseline passes through the center of the limit area) is used as the starting position for division in advance, and the angular range corresponding to the second area 513 (360°, viewed around the center of the limit area 51 (i.e., center point 0)) is equally spaced into 24 parts, that is, the direction of the second area 513 is divided into 24 directions. Each time the user rotates the second area 513 once, the corresponding rotation angle is 15°, that is, a change in direction. Combined with the maximum moving speed V supported by the robot, the mathematical expressions for the corresponding relationship between the rotation angle, rotation direction, and speed can be as follows:

[0159] When rotating clockwise, formula 4: speed

[0160] When rotating counterclockwise, formula 5: speed

[0161] Among them, v0 represents the initial speed corresponding to the first position of the draggable control before the user performs a rotation operation on the second area; Φ represents the rotation angle corresponding to the user's rotation operation on the second area; speed v represents the moving speed determined according to the rotation angle and the rotation angle.

[0162] It should be noted that before the user performs any rotation operation on the second area, that is, when the second area is in its default state, the second area's baseline may overlap with the reference direction. For example, the baseline may be a line passing through the center of the "lock" graphic displayed on the second area and the center of the restricted area. Furthermore, to clearly indicate to the user which direction rotating the second area will increase or decrease the robot's speed, the second area's display color may indicate this, such as clockwise rotation increasing the robot's speed and counterclockwise rotation decreasing it.

[0163] For example, after the user drags the draggable control 511 to the position of the second area shown in FIG. 5 a and releases the draggable control 511, the draggable control 511 is fixed at the position shown in FIG. 5 a. At this time, a prompt message such as "Please rotate the second area to select a movement speed for the robot" may be displayed. If the robot's initial speed is 0 at this time, and the user rotates the second area 30° clockwise as shown in FIG. 5 b, then based on Equation 4, the movement speed is determined to be V / 12, and the robot is controlled to move at a speed of V / 12 in a direction 45° north-east on the surface of the work object. Further, if the user rotates the second area another 15° clockwise because the robot feels that the speed of movement is too difficult, then based on Equation 4, the movement speed is determined to be V / 8 (i.e., V / 12 + V / 24). At this time, the robot is controlled to move at a speed of V / 8 in a direction 45° north-east, thereby increasing the robot's movement speed. Furthermore, if the user feels that the robot is moving too fast and the work execution effect is not good, the user rotates the second area 30° counterclockwise. Based on Formula 5, the movement speed can be determined to be V / 24 (i.e., V / 8-V / 12). At this time, the robot is controlled to move in the direction of 45° north-east at a movement speed of V / 24, which reduces the robot's movement speed.

[0164] If Method 23 is used, the second preset speed is determined as the movement speed. This second preset speed can be flexibly set based on actual conditions, as long as it does not exceed the robot's maximum supported movement speed. This second preset speed can be the same as or different from the first preset speed, and is not limited here. Furthermore, under Method 23, the second area can be designed to be fixed and non-rotatable.

[0165] By adopting this method 23 and the above-mentioned method 12 to determine the moving speed, the moving speed will be the same regardless of the direction in which the robot is controlled to move.

[0166] After the moving speed is determined, the determined moving speed may be sent to the robot, so that the robot moves at the moving speed when moving on the surface of the work object according to the adjusted orientation posture.

[0167] With the above content, this embodiment determines the movement speed of the robot based on the area to which the operation end position belongs on the interface, can realize multiple controls on the speed of the robot movement, and provides users with diverse speed control functions.

[0168] Furthermore, if it is detected that the user has triggered a release operation for the sliding operation at the operation termination position, that is, the user has triggered a release operation on the draggable control at the operation termination position and no longer touches the draggable control, then the robot can be controlled to stop moving or continue moving based on the sliding distance described above. Based on this, the method provided in this embodiment can also include the following steps:

[0169] S04. In response to a release operation for the sliding operation at the operation termination position, control the robot to stop moving according to the sliding distance, or control the robot to keep moving in the target direction at the moving speed.

[0170] In specific implementation, if the first area of ​​the draggable control in the limited area is determined based on the sliding distance, the draggable control will return to its initial position, that is, the center position of the limited area, when released, and the robot will stop moving; if the second area of ​​the draggable control in the limited area is determined based on the sliding distance, the draggable control can be locked when released to allow the robot to continue moving.

[0171] The specific implementation of how to lock the draggable control will be described in detail below and will not be repeated here.

[0172] Furthermore, considering that when the robot is actually performing a task on the surface of a work object, the robot may be on the inner surface or the outer surface of the work object. Currently, for different surfaces on which the robot is located, the user is often required to input different control information (such as the direction of movement) based on the actual surface on which the robot is operating, in order to ensure that the robot correctly performs the task in accordance with the control information input by the user. For example, with reference to FIG1b , if the robot (window cleaning robot) is on the outer surface 22 of the glass window and the user wants the robot to clean to the left, the user must input control information for the right direction in order for the robot to move in the correct direction. This is extremely inconsistent with the user's operating habits and makes it extremely inconvenient for the user. In this embodiment, in order to ensure that the user can directly operate the draggable control according to the inner surface perspective to control the robot's correct movement regardless of whether the robot is on the inner or outer surface of the work object, the solution provided in this embodiment displays a graphical element on an interface for the user to select the current robot view. This graphical element is used to reflect whether the robot is on the outer or inner surface of the work object. Subsequently, when controlling the movement of the robot, in addition to controlling the robot according to the control information input by the user through operating the draggable control, the robot will also be controlled in combination with the surface of the work object where the robot is located. The surface of the work object where the robot is located can be determined by monitoring the selection operation triggered by the user on the graphic elements on the interface, and the selected graphic elements can also be displayed on the draggable control, so that the graphic elements displayed on the draggable control can also express whether the robot is on the outer surface or the inner surface of the work object.

[0173] Based on the above content, the method provided in this embodiment further includes the following steps:

[0174] S11, determining the surface of the working object where the robot is located;

[0175] S12. Displaying, on the draggable control, a graphic element reflecting the surface of the working object on which the robot is located;

[0176] The surface of the work object includes at least one of the following: an inner surface facing the user and an outer surface opposite to the inner surface.

[0177] The above step S11 may be performed before responding to a touch drag operation on the draggable control. In a specific implementation, the above step S11 "determining the surface of the robot on which the robot is located" may specifically include:

[0178] S111. Display at least one graphic element; one graphic element reflects that the robot is on a surface of a work object;

[0179] S112. In response to a selection operation on the at least one graphic element, determine a selected graphic element;

[0180] S113. Determine the surface of the working object where the robot is located according to the selected graphic elements.

[0181] For example, as shown in FIG3 , after the user clicks the "manual remote control" control 31 on the main interface 3 provided by the client, the user can first switch to the selection interface 4, on which two graphic elements 42 are displayed, namely, graphic element 421 and graphic element 422. Among them, graphic element 421 represents the handle surface (top surface) of the robot with a handle that the user sees, which reflects the robot on the inner surface of the work object; graphic element 422 represents the track surface (bottom surface) of the robot that the user sees, which reflects the robot on the outer surface of the work object. Based on the robot view seen from the current perspective, the user can select a graphic element 42 that matches the robot view seen from the current perspective. Assuming that the user triggers a click operation on graphic element 421, the execution subject will switch to the manual remote control interaction interface 5 in response to the click operation, and the above two graphic elements 42 will also be displayed on the upper part of the manual remote control interaction interface 5, among which the state of graphic element 421 among the two graphic elements 42 is selected. In addition, the execution subject will determine that the robot is on the inner surface of the work object based on the selected graphic element 421; assuming that the user triggers a click operation on graphic element 422, the execution subject will switch to the manual remote control interaction interface 5' in response to the click operation, and the above two graphic elements 42 will also be displayed on the upper part of the manual remote control interaction interface 5', among which the state of graphic element 422 among the two graphic elements 42 is selected. The execution subject will determine that the robot is on the outer surface of the work object based on the selected graphic element 422.

[0182] Subsequently, if the user wants to change the robot view seen from the current perspective, the user can directly click on the graphic element 42 on the manual remote control interaction interface without returning to the selection interface 4.

[0183] Of course, in other embodiments, the selection interface 4 described above may not be provided. After the user clicks the "manual remote control" control 31 on the main interface 3 provided by the client, the user directly switches to the manual remote control interaction interface 5, and displays the two graphic elements 42 described above on the manual remote control interaction interface 5, so that the user can directly select the graphic element 42 that matches the robot view seen from the current perspective through the manual remote control interaction interface 5.

[0184] It should be noted that when the user triggers the skip operation on the selection interface 4 described in the above example, the user can switch to the matching manual remote control interaction interface based on the default view of the robot currently seen by the user. Among them, the default view of the robot currently seen by the user can be the handle surface of the robot or the track surface of the robot, which is not limited in this embodiment. Preferably, the default view currently seen by the user is the handle surface of the robot. In other words, the default view is preferably that the robot is on the inner surface of the work object. In addition, when displaying the graphic element 42, a prompt message for reminding the user to select the robot view seen from the current perspective can also be displayed near the graphic element 42. For example, referring to FIG3 , “Please select the robot perspective you currently see” can be displayed in the area above the area where the graphic element 42 is located on the selection interface 4.

[0185] In S12 above, the graphic element displayed on the draggable control reflecting the surface of the object on which the robot is working is the selected graphic element determined by executing steps S111 to S113 above. For example, continuing with the example of steps S111 to S113 above, for example, the graphic element displayed on the draggable control 511 included in the manual remote control interactive interface 5 is the selected graphic element 421.

[0186] In addition, in order to allow the user to directly understand the robot's posture information through the graphic elements on the draggable control, this embodiment can also use the robot's orientation posture information to update the posture of the graphic elements on the draggable control. That is, further, the method provided by this embodiment can also include the following steps:

[0187] S13, obtaining the orientation posture information of the robot;

[0188] S14. Update the posture of the graphic element on the draggable control according to the orientation posture information, so that the updated graphic element on the draggable control can reflect the orientation posture of the robot.

[0189] During specific implementation, the above-mentioned orientation posture information of the robot is sent by the robot, and the robot can collect its own orientation posture through sensors provided on the body.

[0190] For example, as shown in FIG7 , while the robot 200 is working on the inner surface of the work object, it adjusts its own posture according to the target direction received from the client 100. After the adjustment, the posture of the robot is oriented in the direction indicated by the arrow in the figure. After the robot adjusts, it sends the collected posture information of itself to the client 100. Then, the client 100 updates the posture of the graphic element 421 on the draggable control based on the received posture information of the robot, so that the posture of the graphic element 421 on the draggable control is synchronized with the orientation posture of the robot, so that the updated graphic element on the draggable control can reflect the posture of the robot. It should be noted that in order to make it easier to see that the posture of the graphic element 421 on the draggable control is synchronized with the orientation posture of the robot, an enlarged view of the draggable control 511 is also shown on the left side of the manual remote control interaction interface 5 in FIG7 .

[0191] Furthermore, considering that currently, manually controlling a robot to move across the surface of a work object generally requires the user to continuously operate the corresponding controls, for example, if the user wants to control the robot to continuously move upward across the surface of the work object, the user must continuously operate the control provided on the application interface for controlling the robot's upward movement. Once the control is released, the robot stops moving upward, which is extremely inconvenient for the user. To address this issue, this embodiment provides the user with two ways to control the robot through limit zones and draggable controls: one is to control the robot by manually operating the draggable controls, and the other is to lock the draggable controls to achieve constant-speed, directional control of the robot. Specifically, as shown in Figure 4a, when the robot needs to be used to clean a small surface, the user can perform real-time operations on the draggable control 511 in the first area 512 included in the limit area to control the movement of the robot. For example, the draggable control 511 can be dragged in the first area 512 in the positive direction of the x-axis (the right direction, that is, the east direction). When the dragging stops (the user keeps touching the draggable control during this period), the robot will move to the right direction of the surface where it is located; when the robot is used to clean a relatively large surface, such as a large floor-to-ceiling glass window with a height greater than a first threshold (such as 3 meters) and / or a width greater than a second threshold (such as 1.5 meters), the user can drag the draggable control 511 to the second area 513 to lock the draggable control, thereby realizing constant-speed and directional autonomous movement control of the robot, for example: Referring to Figure 5a, if the user wants the robot to continue moving in the direction of 45° north by east on the surface of the glass window to which it is adsorbed, the user can drag the draggable control 511 into the second area 513 and move it clockwise to a position with an angle of 45° relative to the positive direction of the y-axis (the reference direction, i.e., the north direction). When the draggable control 511 enters the second area 513, the lock function corresponding to the second area 513 will be activated, and the graphic elements originally displayed on the draggable control 511 for representing the robot view seen by the user (i.e., for reflecting the surface of the working object where the robot is located) will also disappear at the same time. Of course, they may not disappear, and this is not limited here. When the user releases the draggable control 511, the draggable control 511 will be in a locked state, and the robot will maintain a fixed speed in the direction of 45° north by east on the surface of the glass window to which it is adsorbed for autonomous movement. For the determination of the fixed speed, please refer to the relevant content above.

[0192] Based on the above content, when the draggable control is within the second area of ​​the limiting area, the method provided in this embodiment may further include the following steps:

[0193] S21. Update the display status of the second area to reflect that the lock control function corresponding to the second area is activated; wherein the lock control function is used to lock the draggable control to control the robot to move autonomously in a directional and constant speed.

[0194] S22. The graphic element on the draggable control that reflects the surface of the working object where the robot is located disappears or remains displayed.

[0195] In the above S21, the display state of the second area may be updated by, but is not limited to, changing the color of the second area.

[0196] For example, referring to Figure 4a, when the draggable control 511 is in the first area 512 and has not entered the second area 513, the display color of the second area 513 can be the first color to reflect that the lock control function corresponding to the second area is in an inactive state; further, as shown in Figure 5a, when the draggable control 511 is detected to enter the second area 513, the display color of the second area is updated from the first color to the second color to reflect that the lock control function corresponding to the second area is in an active state.

[0197] It should be noted that in addition to updating the display state of the second area, the display state of the first area can also be updated to reflect that the draggable control is dragged out of the first area. Specifically, the display state of the first area can be updated by, but is not limited to, changing the border color of the first area or by changing the border appearance state of the first area. For example, referring to Figures 4a and 5a, when the draggable control is in the first area, the border of the first area is visible and the border color is the third color; further, when it is detected that the draggable control is not in the first area but is dragged into the second area, the border of the first area may disappear or the border color is updated from the third color to the fourth color.

[0198] In S22 above, for example, referring to Figures 4a and 5a , when draggable control 511 enters second area 513, graphic element 421 originally displayed on draggable control 511, which depicts the robot on the inner surface of the work object, disappears. Of course, as shown in Figure 5b , graphic element 421 originally displayed on draggable control 511, which depicts the robot on the inner surface of the work object, may also remain displayed, without limitation.

[0199] In addition, under the aforementioned prerequisite (i.e., the draggable control is in the second area), the method provided in this embodiment may further include the following steps:

[0200] S23: When a release operation for the sliding operation at the operation termination position is detected, locking the draggable control, and updating the display state of the draggable control to reflect that the draggable control is in a locked state;

[0201] For detailed explanation of the release operation, please refer to the relevant content of the above step S04.

[0202] For example, referring to Figures 5a and 6a, when the second area is fixed and non-rotatable, when it is detected that the user releases the draggable control (the touch ends and the draggable control is released), the draggable control can be locked on the boundary of the first area. Specifically, based on the operation termination position, such as the position of the draggable control 511 on the second area 513 when the user releases it as shown in Figure 5a, the draggable control 511 can be locked on the boundary of the first area at a position closest to the operation termination position and on the same line (as shown in Figure 6a), so as to ensure that the deflection angle of the locked draggable control relative to the reference direction is consistent with the deflection angle of the draggable control 511 relative to the reference direction when the draggable control 511 is released. During the locking process, the display state of the draggable control can also be updated. For example, as shown in FIG6a, a lock graphic element can be added to the draggable control 511, such as a "lock" graphic, the border color of the draggable control can be updated from the fifth color to the sixth color, and an indicator indicating the deflection direction of the draggable control (such as the arrows 6 shown in FIG6a) can be displayed near the draggable control, etc., which are not limited here, as long as the updated display state of the draggable control can reflect that the draggable control is in the locked state. In addition, when the draggable control is locked, the second area 513 will also disappear.

[0203] For another example, as shown in Figures 5b and 6b, when the second area is rotatable, when it is detected that the user releases the draggable control, the draggable control can be fixed at the position corresponding to the second area where it was when it was released; in addition, the display state of the draggable control can also be updated, as shown in Figure 6b: a lock graphic element can be added to the boundary of the draggable control 511, or the graphic element originally displayed on the draggable control 511 can be updated to a lock graphic, the boundary color of the draggable control 511 can be changed, etc., which is not limited here, as long as the display state of the updated draggable control can reflect that the draggable control is in a locked state.

[0204] Based on the above example, in a specific feasible technical solution, the above “locking the draggable control” in S23 can be implemented by the following steps:

[0205] S231. Fix the draggable control at a target position on the boundary of the first region according to the operation termination position, wherein the target position is closest to the operation termination position and is on a straight line;

[0206] S232: The second area disappears.

[0207] In another specific achievable technical solution, the above-mentioned “locking the draggable control” in S23 can be implemented by the following steps:

[0208] S231′, fixing the draggable control at the operation termination position.

[0209] It should be noted here that after the draggable control is locked, a lock prompt message can be displayed on the interface, such as the text "locked in progress"; or a vibration prompt can be issued to remind the user that the draggable control is fixed (locked). In this way, the user can intuitively know that the draggable control has been fixed through the vibration prompt, and the human-computer interaction is more efficient in controlling the robot.

[0210] When the draggable control is locked, the user can unlock it by performing an operation such as clicking anywhere on the restricted area. It should be noted that if the second area is rotatable, to avoid the user mistakenly locking the second area due to the user intending to rotate it, this embodiment provides an unlocking method where the user can unlock the draggable control by performing an operation such as clicking anywhere on any area of ​​the restricted area other than the second area.

[0211] Alternatively, you can automatically unlock the draggable control once the robot has stopped moving. Once unlocked, the draggable control will return to its default position, the center of the restricted area. Additionally, if the second area is previously hidden after the draggable control is unlocked, it will reappear.

[0212] That is, the method provided in this embodiment may further include the following steps:

[0213] S24. When it is detected that the unlocking condition is met, unlock the draggable control and restore the draggable control to the center position of the second area;

[0214] S25. If the second area is in a disappeared state, make the second area visible;

[0215] Among them, satisfying the unlocking conditions includes at least one of the following: receiving the movement stop information sent by the robot, monitoring the operation triggered on the limit area (more specifically, detecting the operation triggered on the remaining area in the limit area except the second area).

[0216] In specific implementations, the reasons for the robot's movement stopping may include, but are not limited to: collision with an obstacle on the surface of the work object, failure of a sensor on the robot (such as an infrared sensor), a short circuit in the robot's wiring, etc. Obstacles on the surface of the work object can be static or dynamic. For example, if the robot is a window cleaning robot and the work object is a vertical glass window, the obstacles may include the window frame, hooks attached to the window, thick stickers, etc. For example, if the robot is a floor sweeping robot and the work object is a flat surface, the obstacles may include walls, tables and chairs, people walking, etc.

[0217] The operations triggered on the limit area can be click, long press, sliding and other operations, which are not limited here.

[0218] After determining that the unlocking conditions have been met and the draggable control is unlocked, in addition to restoring the draggable control to the center of the second area, the graphic element on the surface of the work object on which the robot is located will be redisplayed on the draggable control, and the posture of the graphic element will be synchronized with the robot's orientation, so that the graphic element on the draggable control can reflect the robot's posture. For the specific implementation of synchronizing the posture of the graphic element on the draggable control with the robot's orientation, please refer to the relevant content above and will not be detailed here. In addition, if the original second area was in a disappeared state, the second area will also reappear.

[0219] As can be seen from the above content, after the draggable control is unlocked, the interface will be restored to its original state, such as the manual remote control interaction interface 5 shown in FIG3 .

[0220] In summary, this embodiment utilizes the second area in the limit zone to lock the draggable control. After the draggable control is locked, even if the user is not performing any operation, the execution subject of this embodiment can control the robot to move continuously on the surface of the work object and perform the work task according to the direction and speed corresponding to the position after the draggable control is locked. This provides the user with a remote control robot function in any direction when using the client to remotely control the robot. In addition, it also provides an omnidirectional directional and constant speed autonomous movement function, so that the user does not need to operate the client all the time, and can also let the robot automatically move in a fixed direction and at a fixed speed on the surface of the work object, which helps to reduce the user's operating burden, improve remote control (human-computer interaction) efficiency, and reduce remote control costs, especially when controlling the robot to work on a work object with a large surface area, providing users with a very friendly human-computer interaction.

[0221] The above mainly introduces the present application solution from the perspective of providing omnidirectional control function for the robot. The following introduces the present application solution from other perspectives in combination with other embodiments.

[0222] FIG8 is a flow chart of a robot control method according to another embodiment of the present application. The method is executed by a client. For a detailed description of the client, please refer to the relevant content of other embodiments above. As shown in FIG8, the robot control method provided in this embodiment includes the following steps:

[0223] 201. In response to a sliding operation on the interface, determining a sliding distance;

[0224] 202. Determine, based on the sliding distance, the area to which the operation termination position of the sliding operation belongs in the interface;

[0225] 203. Determine a moving speed according to the area to which the operation termination position belongs in the interface;

[0226] 204. Control the robot to move at the moving speed.

[0227] For detailed description of the specific implementation of the above 201 to 204, please refer to the relevant content in other embodiments above, and will not be described in detail here.

[0228] The technical solution provided in this embodiment can determine the movement speed based on the sliding distance determined in response to the sliding operation on the interface, and then control the robot to move at this movement speed. This solution can achieve multiple control modes of the robot's movement speed based on the sliding distance, providing users with diverse speed control functions.

[0229] It should be noted here that the robot control method provided in this embodiment may include other steps in addition to the steps shown above. For specific other steps that may be included, please refer to the steps in other robot control methods provided above in this application, which will not be repeated here.

[0230] FIG9 is a flow chart of a robot control method provided in another embodiment of the present application. The execution subject of this method is a client. For a detailed description of the client, please refer to the relevant content of other embodiments above. As shown in FIG9, the robot control method provided in this embodiment includes the following steps:

[0231] 301. In response to a sliding operation in any direction of 360 degrees on the interface, determine a target direction;

[0232] 302. In response to a release operation after the sliding operation to the target area, determining a moving speed;

[0233] 303. Control the robot to adjust its posture according to the target direction, and continue to move at the moving speed according to the adjusted posture.

[0234] In the above, the sliding operation performed in any direction of 360 degrees on the interface may refer to a touch drag operation triggered by the user on the draggable control 511 in the limited area along any direction of 360 degrees in the limited area included in the interface.

[0235] The target area refers to the second area in the restricted area, and the target area is associated with a lock function. The lock function is used to lock the end position of the sliding operation when the release operation is detected. In specific implementations, the end position of the sliding operation may refer to the position of the draggable control in the target area after being dragged to the target area and released. Accordingly, locking the end position of the sliding operation can be achieved by locking the draggable control.

[0236] For detailed description of the specific implementation of the above 301 to 303, please refer to the relevant content in other embodiments above, and will not be described in detail here.

[0237] The technical solution provided by this embodiment can control the robot to adjust its posture according to the target direction and continue to move at the speed determined after the adjusted posture after the user performs a sliding operation to the target area, after determining the target direction in response to a sliding operation in any direction along the 360-degree direction on the interface, and release the sliding operation after reaching the target area. This solution can control the robot to continue moving even if the user is not performing any operations after the user performs a sliding operation to the target area. This helps to reduce the user's operational burden, improve the efficiency of remote control (human-computer interaction), and reduce the cost of remote control. In particular, it provides users with very friendly human-computer interaction when controlling the robot to operate on work objects with large surface areas.

[0238] It should be noted here that the robot control method provided in this embodiment may include other steps in addition to the steps shown above. For specific other steps that may be included, please refer to the steps in other robot control methods provided above in this application, which will not be repeated here.

[0239] Another embodiment of the present application further provides a robot control method, which is applicable to a client. Specifically, the robot control method provided in this embodiment includes the following steps:

[0240] 401. Displaying a manipulation control on the interface, wherein the manipulation control includes a limit area and a draggable control that can be dragged in any direction within the limit area;

[0241] 402. When detecting that the draggable control is triggered to move in any direction of 360 degrees on the limit area, controlling the robot to follow the target direction corresponding to when the draggable control stops moving, adjusting the moving direction, and moving according to the adjusted moving direction;

[0242] 403. When it is detected that the draggable control stops in the first area of ​​the limit zone and is released, the draggable control returns to the set position, and the robot is controlled to stop moving;

[0243] 404. Detecting that the draggable control is released when it stops in a second area of ​​the limit zone, locking the draggable control, and controlling the robot to maintain movement in the adjusted direction; wherein the second area is outside the first area.

[0244] In the above description, the draggable control being triggered refers to the draggable control being touched and dragged as described in other embodiments above. When controlling the robot to adjust its movement direction, the robot can specifically adjust its posture by following the target direction corresponding to when the draggable control stops moving, thereby achieving adjustment of the movement direction. The set position mentioned above may refer to the center position of the limit zone.

[0245] For detailed description of the specific implementation of the above 401 to 404, please refer to the relevant content in other embodiments above.

[0246] It should be noted here that the robot control method provided in this embodiment may include other steps in addition to the steps shown above. For specific other steps that may be included, please refer to the steps in other robot control methods provided above in this application, which will not be repeated here.

[0247] The following describes the technical solution provided in this application in combination with specific application scenarios, taking a window cleaning robot used to clean glass window surfaces as an example.

[0248] After the user adsorbs the window cleaning robot to a position on the inner surface of the glass window and turns on the switch, he clicks the "manual remote control" control 31 on the main interface 3 provided by the client as shown in Figure 3 to enable the manual remote control function for the window cleaning robot. First, enter the robot status selection interface 4 as shown in Figure 3, and click on the graphic element 421 used to reflect the window cleaning robot on the inner surface of the glass window according to the window cleaning robot view seen from his current perspective, and then switch to the manual remote control interaction interface 5 as shown in Figure 3.

[0249] When a user remotely controls the window-cleaning robot via the manual remote control interactive interface 5, they can touch and drag the draggable control 511 in any direction within the restricted area 51 to remotely control the window-cleaning robot's movement across the inner surface of the glass window to perform cleaning tasks. Specifically, when the draggable control 511 is dragged along the positive x-axis to the position shown in FIG. 4 a , where the draggable control 511 is within the first region of the restricted area, the window-cleaning robot adjusts its posture and moves rightward at a fixed speed across the inner surface of the glass window. Simultaneously, the graphical element 421 on the draggable control 511 synchronizes the window-cleaning robot's orientation. Furthermore, when the draggable control 511 is dragged to the position shown in Figure 4b, the draggable control 511 is still in the first area in the limit area, and the deviation angle relative to the reference direction is -45°, that is, 45° west of north, then the window cleaning robot will adjust its posture on the inner surface of the glass window to face 45° west of north, and move at a fixed speed along the adjusted direction. At the same time, the posture of the graphic element 421 on the draggable control 511 will also be updated to synchronize the orientation posture of the window cleaning robot. Furthermore, when the user drags the draggable control 511 to the position shown in FIG5a, the draggable control 511 enters the second area of ​​the restricted area, and the deflection angle relative to the reference direction is 45 degrees. At this time, the locking function of the second area is activated. When the user releases the draggable control 511, the draggable control 511 is locked and thus enters the locked state shown in FIG6a. The window cleaning robot adjusts its posture on the inner surface of the glass window so that it faces 45 degrees north-east and begins to perform directional and constant-speed autonomous movement along the adjusted orientation to perform the window cleaning task. During this period, the user does not need to keep touching the draggable control. Furthermore, when the user clicks at any position on the restricted area shown in FIG6a, the manual remote control interaction interface will be restored to the remote control interaction interface 5 shown in FIG3.

[0250] The present application also provides a robot control system. As shown in FIG10 , the system includes:

[0251] A robot 200 for performing a work task on a surface of a work object

[0252] The client 100 is connected to the robot for communication and is used to implement the steps or functions of the robot control method provided in the above-mentioned embodiments of the present application.

[0253] The specific implementation of the corresponding functions in the above client and robot can be found in the above content. In addition, in addition to the functions described above, the client can also specifically implement the functions corresponding to other steps in other embodiments above, which can also be found in the above content and will not be repeated here.

[0254] The robot may be an adsorption-type surface cleaning robot for cleaning various surfaces of work objects, such as a window cleaning robot, wherein the work object may be a vertical glass window, a tiled wall, or the like.

[0255] FIG11 shows a schematic diagram of the structure of a robot control device provided by an embodiment of the present application. The robot control device is deployed on a client. As shown in FIG11 , the robot control device includes: a determination module 61 and a control module 62; wherein,

[0256] a determination module 61 for determining a target direction in response to a sliding operation in any direction of 360 degrees on the interface; and for determining a movement speed based on the region of the interface to which the operation termination position of the sliding operation belongs;

[0257] The control module 62 is used to control the robot to adjust its posture according to the target direction and move at the moving speed according to the adjusted posture.

[0258] Furthermore, the determination module 61 , when used to determine the target direction in response to the sliding operation, is specifically configured to: determine an operation termination position of the sliding operation; and determine the target direction based on the operation termination position.

[0259] Furthermore, the above-mentioned determination module 61, when used to determine the moving speed based on the area to which the operation end position of the sliding operation belongs in the interface, is specifically used to: determine the sliding distance based on the operation end position; determine the area to which the operation end position belongs in the interface based on the sliding distance; and determine the moving speed based on the area to which the operation end position belongs in the interface.

[0260] Furthermore, the control module 62 is also configured to: in response to a release operation for the sliding operation at the operation termination position, control the robot to stop moving or control the robot to keep moving in the target direction at the moving speed according to the sliding distance.

[0261] Furthermore, the device provided in this embodiment further includes: a display module for displaying a manipulation control on an interface, wherein the manipulation control includes a limit area and a draggable control on the limit area that can be dragged in any direction; a response module for responding to the sliding operation, wherein the draggable control moves within the limit area according to the sliding operation; wherein the operation termination position is the position on the limit area where the draggable control stops moving;

[0262] Furthermore, the above-mentioned determination module 61, when used to determine the target direction based on the operation termination position, is specifically used to: determine the deflection angle of the draggable control relative to the reference direction based on the operation termination position; determine the target direction according to the deflection angle

[0263] Furthermore, the determination module 61, when used to determine the sliding distance based on the operation termination position, is specifically used to: calculate the distance between the operation termination position and the center position of the limiting area to determine the sliding distance; and, when used to determine the area to which the operation termination position belongs in the interface based on the sliding distance, is specifically used to: determine the area in the limiting area where the draggable control is located based on the sliding distance; and determine the area in the limiting area where the draggable control is located as the area in the interface to which the operation termination position belongs. And, when used to determine the movement speed based on the area to which the operation termination position belongs in the interface, is specifically used to: determine the movement speed based on the area in the limiting area where the draggable control is located.

[0264] Furthermore, the determination module 61, when used to determine the movement speed based on the area where the draggable control is located in the limiting area, is specifically used to:

[0265] If the draggable control is in the first area of ​​the limiting area, the moving speed is determined according to the sliding distance; or a first preset speed is determined as the moving speed;

[0266] If the draggable control is in the second area of ​​the limited area, the moving speed is determined according to the deflection angle; or, in response to a rotation operation on the second area, the moving speed is determined according to the rotation angle and rotation direction corresponding to the rotation operation; or, the second preset speed is determined as the moving speed; wherein, the second area is outside the first area.

[0267] Furthermore, when the draggable control is in the second area of ​​the limit zone, the device provided in this embodiment may also include: an update module, used to update the display status of the second area to reflect the activation of the lock control function corresponding to the second area; wherein, the lock control function is used to lock the draggable control to control the robot to move autonomously in a directional and constant speed; a disappearance / maintenance control module, used to make the graphic elements on the draggable control that reflect the surface of the working object where the robot is located disappear or remain displayed.

[0268] Furthermore, the device provided in this embodiment also includes: a locking module, which is used to lock the draggable control when a touch end operation on the draggable control is detected; the above-mentioned update module is also used to update the display status of the draggable control to reflect that the draggable control is in a locked state.

[0269] Furthermore, the above-mentioned locking module, when used to lock the draggable control, is specifically used to: fix the draggable control at a target position on the boundary of the first area according to the operation termination position, wherein the target position is closest to the operation termination position and is on a straight line; the second area disappears; or, fix the draggable control at the operation termination position.

[0270] Furthermore, the device provided in this embodiment also includes: an unlocking module, which is used to unlock the draggable control and restore the draggable control to the center position of the limit area when detecting that the unlocking condition is met; a display module, which is used to make the second area appear if the second area is in a disappeared state; wherein, satisfying the unlocking condition includes at least one of the following: receiving the movement stop information sent by the robot, and monitoring the operation triggered on the limit area.

[0271] Furthermore, the above-mentioned determination module 61 is also used to determine the surface of the working object where the robot is located; and the above-mentioned display module is also used to display a graphic element reflecting the surface of the working object where the robot is located on the draggable control; wherein the surface of the working object includes at least one of the following: an inner surface facing the user, and an outer surface opposite to the inner surface.

[0272] Furthermore, the above-mentioned determination module 62, when used to determine the surface of the working object where the robot is located, is specifically used to: display at least one graphic element; one graphic element is used to reflect that the robot is on a surface of the working object; in response to a selection operation on the at least one graphic element, determine the selected graphic element; based on the selected graphic element, determine the surface of the working object where the robot is located; wherein, the graphic element displayed on the draggable control is the selected graphic element.

[0273] Furthermore, the device provided in this embodiment also includes: an acquisition module 6, used to obtain the posture information of the robot; based on the posture information, updating the posture of the graphic elements on the draggable control so that the graphic elements on the draggable control can reflect the posture of the robot.

[0274] It should be noted that any steps not fully described in the robot control device provided in this embodiment may be referred to the corresponding steps in the aforementioned embodiments and will not be further elaborated here. Furthermore, in addition to the aforementioned steps, the robot control device provided in this embodiment may also include some or all of the other steps in the aforementioned embodiments, which may be referred to the corresponding steps in the aforementioned embodiments and will not be further elaborated here.

[0275] Another embodiment of the present application also provides a schematic diagram of the structure of a robot control device. The robot control device is deployed on the client. The specific structure of the robot control device is similar to the structure shown in Figure 11. Specifically, the robot control device includes: a determination module and a control module; wherein,

[0276] a determination module configured to determine a sliding distance in response to a sliding operation on the interface; and determine, based on the sliding distance, a region of the interface to which an operation termination position of the sliding operation belongs; and determine a movement speed based on the region of the interface to which the operation termination position belongs;

[0277] A control module is used to control the robot to move at the moving speed.

[0278] It should be noted that any steps not fully described in the robot control device provided in this embodiment may be referred to the corresponding steps in the aforementioned embodiments and will not be further elaborated here. Furthermore, in addition to the aforementioned steps, the robot control device provided in this embodiment may also include some or all of the other steps in the aforementioned embodiments, which may be referred to the corresponding steps in the aforementioned embodiments and will not be further elaborated here.

[0279] Another embodiment of the present application also provides a schematic diagram of the structure of a robot control device. The robot control device is deployed on the client. The specific structure of the robot control device is similar to the structure shown in Figure 11. Specifically, the robot control device includes: a determination module and a control module; wherein,

[0280] a determination module for determining a target direction in response to a sliding operation in any direction of 360 degrees on the interface; and for determining a movement speed in response to a release operation after the sliding operation reaches the target area;

[0281] The control module is used to control the robot to adjust its posture according to the target direction, and to continuously move at the moving speed according to the adjusted posture.

[0282] In the above description, the target area is an area associated with a locking function; the locking function is used to lock the operation termination position of the sliding operation when the release operation is detected.

[0283] It should be noted that any steps not fully described in the robot control device provided in this embodiment may be referred to the corresponding steps in the aforementioned embodiments and will not be further elaborated here. Furthermore, in addition to the aforementioned steps, the robot control device provided in this embodiment may also include some or all of the other steps in the aforementioned embodiments, which may be referred to the corresponding steps in the aforementioned embodiments and will not be further elaborated here.

[0284] Another embodiment of the present application also provides a schematic diagram of the structure of a robot control device. The robot control device is deployed on the client. Specifically, the robot control device includes: a display module and a detection control module; wherein,

[0285] A display module, configured to display a manipulation control on the interface, wherein the manipulation control includes a limit area and a draggable control on the limit area that can be dragged in any direction;

[0286] A detection control module, for detecting that the draggable control is triggered to move in any direction of 360 degrees on the limit zone, controlling the robot to follow the target direction corresponding to when the draggable control stops moving, adjusting the moving direction and moving in the adjusted moving direction; and also for detecting that the draggable control is released when it stops moving in a first area of ​​the limit zone, the draggable control returns to a set position, and controlling the robot to stop moving; detecting that the draggable control is released when it stops moving in a second area of ​​the limit zone, locking the draggable control, and controlling the robot to keep moving in the adjusted moving direction; wherein, the second area is outside the first area.

[0287] It should be noted that any steps not fully described in the robot control device provided in this embodiment may be referred to the corresponding steps in the aforementioned embodiments and will not be further elaborated here. Furthermore, in addition to the aforementioned steps, the robot control device provided in this embodiment may also include some or all of the other steps in the aforementioned embodiments, which may be referred to the corresponding steps in the aforementioned embodiments and will not be further elaborated here.

[0288] In addition, another embodiment of the present application provides a client device. The client device may include a memory and a processor; wherein,

[0289] The memory stores one or more computer instructions;

[0290] The processor, coupled to the memory, is configured to execute the one or more computer instructions to implement the steps in the robot control method embodiments provided in the above embodiments of the present application.

[0291] Among them, the client device can be a smart phone, computer, smart phone, tablet computer, smart wearable device (such as smart watch, glasses, etc.).

[0292] The aforementioned memory may be configured to store various other data to support operations on the client. Examples of such data include instructions for any application or method operating on the client. The memory may be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, or optical disk.

[0293] Furthermore, in addition to the memory and processor, the client device also includes other components, such as a power supply component, a communication component, a display, etc.

[0294] Another embodiment of the present application provides a computer program product (not shown in the accompanying drawings). The computer program product includes a computer program or instructions, which, when executed by a processor, enables the processor to implement the steps in the above-mentioned method embodiments.

[0295] Accordingly, an embodiment of the present application further provides a computer-readable storage medium storing a computer program, which, when executed by a computer, can implement the method steps or functions provided in the above embodiments.

[0296] In addition, other embodiments of the present application also provide a remote control method, device, equipment and readable storage medium for a surface cleaning robot, which are described in detail below.

[0297] At present, users often use hardware remote controls to remotely control surface cleaning robots. During the remote control process, the user holds the remote control to control the surface cleaning robot to "forward", "left", "right", "backward", etc. However, this remote control method requires additional hardware remote controls for the surface cleaning robot, and the remote control is easy to lose. Moreover, the hardware remote control generally includes 4 buttons, each of which is used to control a different direction. For example, the 4 buttons correspond to the four directions of "forward", "backward", "left" and "right". The hardware remote control requires the user to operate with both hands to control the front and back as well as the left and right. Moreover, in addition to the four directions of "forward", "backward", "left" and "right", the hardware remote control has no additional angle settings, resulting in the inability to remotely control the surface cleaning robot from multiple angles and sensitively, and it is difficult to control the surface cleaning robot to move in the direction desired by the user.

[0298] Furthermore, since surface cleaning robots typically use tracks as a propulsion mechanism, their forward, backward, left, and right directions are often determined by the track wheels. If the robot is initially positioned at an angle, pressing the "Forward" button will cause the robot to move in the direction of the track wheels. However, to the user, the robot will appear to be moving at an angle.

[0299] Furthermore, if the surface cleaning robot is facing diagonally downward, when the "forward" button is pressed, the surface cleaning robot moves diagonally downward, which is inconsistent with the user's expected direction and fails to achieve the desired visual effect.

[0300] Based on this, the embodiments of the present application provide a remote control method, device, equipment and readable storage medium for a surface cleaning robot. The surface cleaning robot APP is installed on an electronic device. By operating the remote control controls on the APP interface, the surface cleaning robot can be controlled in 360 degrees to move in any direction, so that the surface cleaning robot can quickly move in the direction desired by the user. The operation is simple and efficient, and the cleaning efficiency and quality are improved.

[0301] Figure 12 is a schematic diagram illustrating a method for remotely controlling a surface cleaning robot according to an embodiment of the present application. Referring to Figure 12 , an app for remotely controlling surface cleaning robot 12 is installed on electronic device 11, and the surface cleaning robot is positioned on a work surface such as a window. During cleaning, the user accesses the remote control interface via the app on electronic device 11, which displays operable remote control controls. The user controls the direction of movement of surface cleaning robot 12 by sliding the remote control controls.

[0302] Figure 13 is a bottom view of a surface cleaning robot remotely controlled by an electronic device, according to an embodiment of the present application. Referring to Figure 13 , the surface cleaning robot 200 provided in this embodiment of the present application includes a body 210 , which includes a memory and a processor 220 . The bottom of the body 210 also includes a cleaning assembly 230 for cleaning a work surface, a travel mechanism 240 for driving the surface cleaning robot, an adsorption assembly 250 for causing the surface cleaning robot to adhere to the work surface, and a drive motor 241 for driving the travel mechanism 240.

[0303] In an embodiment of the present application, an acceleration detector, such as a triaxial acceleration sensor, is further provided inside or on the surface of the body 210 to obtain triaxial acceleration data. The triaxial acceleration data is used to determine the posture of the surface cleaning robot, i.e., the initial orientation of the surface cleaning robot. The initial orientation is the orientation of the surface cleaning robot before receiving a remote control command from an electronic device such as a mobile phone with a desired angle. The default initial orientation is the direction in which the surface cleaning robot's tail is pointing toward its head before receiving the remote control command.

[0304] Figure 14 is a schematic diagram of the rotation process of the three-axis acceleration sensor of the surface cleaning robot. Table 1 is a three-axis acceleration data table.

[0305] Table 1

[0306] Referring to Figure 14 and Table 1, if the triaxial accelerometer is rotated 90 degrees counterclockwise, the position of reference point P on the triaxial accelerometer is indicated by the black filled circles ① through ④, and the triaxial acceleration data are shown in Table 1, respectively, as shown in ① through ④. In Table 1, resolution indicates the triaxial accelerometer's ability to detect the smallest change in the measured value. A higher resolution indicates a smaller minimum detectable change in the measured value.

[0307] In Table 1, ①-④ represent the readings of the three axes when the triaxial accelerometer is in a vertical position. In this position, the X-axis and Y-axis data are constantly changing, while the Z-axis data remains unchanged. In Table 1, ⑤ represents the readings of the three axes when the triaxial accelerometer is in a horizontal position with the top facing upward, and ⑥ represents the readings of the three axes when the triaxial accelerometer is in a horizontal position with the top facing downward. When the triaxial accelerometer is in positions ⑤ or ⑥, the X-axis and Y-axis data are 0, and the Z-axis data is fixed.

[0308] Referring to Figure 14 and Table 1, when the surface cleaning robot is attached to a facade, the X- and Y-axis data can be converted into the robot's current angle, or initial orientation. This allows the robot to determine the desired direction and the user's desired orientation each time it receives a remote control command from an electronic device.

[0309] The surface cleaning robot described in the embodiments of the present application may specifically be a window cleaning robot. A window cleaning robot is also known as an automatic window cleaning machine, glass cleaning robot, smart window cleaner, or intelligent window cleaner. However, the embodiments of the present application are not limited to cleaning glass; the working surface may be glass, mirrors, plastic, metal, wood, or the like.

[0310] 12 to 14 , the remote control method of the surface cleaning robot according to the embodiment of the present application will be described in detail.

[0311] FIG15 is a flow chart of a remote control method for a surface cleaning robot provided in an embodiment of the present application. This embodiment is described from the perspective of an electronic device. This embodiment includes:

[0312] 401. In response to an instruction to enter a remote control page, a remote control page is displayed on a user interface, where operable remote control controls are provided.

[0313] Users can flexibly send commands to electronic devices to enter a remote control page. In one embodiment, the electronic device has a voice recognition function that can recognize the user's voice command. Based on this, the user sends a voice command to the electronic device to enter the remote control page. For example, a user opens an app for a surface cleaning robot on an electronic device, enters the app's main interface, and sends a voice command to the electronic device saying "enter remote control mode." The electronic device then uses its voice recognition function to recognize the command to enter the remote control page and displays the remote control page on the user interface in response to the command to enter the remote control page.

[0314] In another method, the user opens the electronic device's surface cleaning robot app and enters the app's main interface. The app's main interface displays a "manual remote control" control. The user clicks the control to issue a command to enter the remote control page, and the electronic device enters the remote control page. For example, please refer to Figure 16.

[0315] Figure 16 is a schematic diagram of the interface changes of an electronic device in the control method of a surface cleaning robot provided by an embodiment of the present application. Referring to Figure 16 , the user interface displays the surface cleaning robot's app, "Surface Cleaning." The user clicks the "Surface Cleaning" app to enter the main interface. The main interface displays a "Manual Remote Control" control. The user clicks this control, sending a command to the electronic device to enter the remote control page. The electronic device jumps to the remote control page, which is provided with operable remote control controls 51.

[0316] Referring to Figure 16 , a sliding range 52 is located below the user interface. Initially, the remote control 51 is located at the center of the sliding range. A user can operate the remote control 51 with one hand, causing it to slide in any direction. The user can press the remote control 51 to slide in a straight line or a curve, thereby remotely controlling the surface cleaning robot to move in the desired direction.

[0317] In the embodiment of the present application, after entering the remote control page, if the user has not yet touched the remote control control 51, the user interface may display only the remote control control 51 without displaying the sliding range 52; or both remote control and sliding range 52 may be displayed simultaneously. If only the remote control 51 is displayed, the user interface will display the sliding range 52 when the user touches the remote control 51.

[0318] In an embodiment of the present application, the sliding range 52 and the slid remote control control 51 can be flexibly displayed. In one embodiment, when the user slides the remote control control 51, the position of the sliding range 52 remains unchanged, the remote control 51 can only slide within the sliding range 52, and no part of the remote control 51 can move out of the sliding range.

[0319] In another way, when the user slides the remote control control 51, the position of the sliding range 52 remains unchanged, the position of the remote control control 51 relative to the sliding range 52 changes, and the center of the remote control control 51 moves as far as the boundary of the sliding range 52. At this time, a part of the remote control control 51 is outside the sliding range 52.

[0320] Compared with the above-mentioned method in which only the remote control control 51 moves and the sliding range 52 does not move, in another method, when the user slides the remote control control 51, the sliding range 52 moves within a preset range, the remote control control 51 moves within the sliding range, and the remote control control 51 can only move within the sliding range.

[0321] 402. In response to a user's operation on the remote control control, remotely control a moving direction of the surface cleaning robot.

[0322] The user flexibly slides the remote control. For example, the user slides the remote control in any direction within 360 degrees. Another example is the user long-presses the remote control and slides it in a curved shape. The electronic device adjusts the direction of the surface cleaning robot based on the user's sliding operation on the remote control.

[0323] The embodiment of the present application provides a remote control method for a surface cleaning robot. The surface cleaning robot app is installed on an electronic device. The user calls up a remote control page on the app and slides the remote control controls on the remote control page to remotely control the direction of the surface cleaning robot. With this solution, the surface cleaning robot app is installed on the electronic device. By operating the remote control controls on the app interface, the surface cleaning robot can be controlled to face any direction in 360 degrees, allowing the surface cleaning robot to quickly face the user's desired direction. The operation is simple and efficient.

[0324] Typically, the work mask has two sides: one for the inner window and the other for the outer window. When the surface cleaning robot is attached to the inner window and the user is indoors, the front of the surface cleaning robot faces the user. When the surface cleaning robot is attached to the outer window and the user is indoors, the side of the surface cleaning robot with the attachment component faces the user. Unless otherwise specified, the following detailed description of the embodiments of this application uses the example of the surface cleaning robot attaching to the inner window and the user being indoors to clean the inner window.

[0325] Optionally, in the above embodiment, the electronic device responds to the user's operation of the remote control control, and in the process of remotely controlling the travel direction of the surface cleaning robot, responds to the user's sliding operation of the remote control control toward a desired angle in 360°, and remotely controls the surface cleaning robot to rotate a target angle so that the travel direction of the surface cleaning robot changes from an initial direction to a desired direction, the angle in the 360° corresponds one-to-one to the direction in the 360-degree direction of the working surface of the surface cleaning robot, the desired angle corresponds to the desired direction, and the target angle is the angle between the initial direction and the desired direction.

[0326] Figure 17 is a schematic diagram of the relationship between angles and directions in the control method for the surface cleaning robot provided by an embodiment of the present application. Referring to Figure 17, the remote control control 51 can slide toward any angle in 360 degrees. Any angle in the 360-degree direction corresponds to a certain direction in the 360-degree direction of the working surface of the surface cleaning robot, that is, the angle and direction are in a one-to-one correspondence. For example, the direction of travel corresponding to 0 degrees is shown as ① in the figure, the direction of travel corresponding to 90 degrees is shown as ② in the figure, and the direction of travel corresponding to 130° is shown as ③ in the figure. The default initial direction is the direction in which the tail of the surface cleaning robot points to the head before receiving the remote control command.

[0327] It should be noted that the directions shown in ①, ②, and ③ in the figure are only for illustrative purposes of the default initial directions, and do not mean that there are multiple surface cleaning robots on the working surface at the same time.

[0328] Next, based on the above description of the relationship between direction and angle, the remote control method of the surface cleaning robot according to the embodiment of the present application is described in detail.

[0329] Figure 18A is a schematic diagram of a user sliding a remote control 90° in a control method for a surface cleaning robot according to an embodiment of the present application. Figure 18B is a schematic diagram of one action of the surface cleaning robot. Figure 18C is a schematic diagram of another action of the surface cleaning robot.

[0330] 18A , the remote control 51 can be slid toward any angle within 360 degrees. Any angle within the 360-degree direction corresponds to a certain direction within the 360-degree direction of the working surface of the surface cleaning robot, that is, there is a one-to-one correspondence between angles and directions.

[0331] When the desired angle is 90 degrees, that is, when the user slides the remote control control 51 toward 90 degrees, the remote control control 51 moves a distance to the right and then intersects with the boundary of the sliding range, and 90° is displayed at the preset position on the remote control page, as shown in the gray filled area in the figure. At the same time, a direction cursor 53 is also displayed near the remote control control. The electronic device determines that the desired angle is 90 degrees and sends a remote control instruction to the surface cleaning robot, and the remote control instruction carries the desired angle. After receiving the remote control instruction, the surface cleaning robot determines that 90 degrees corresponds to a 90-degree direction, that is, horizontally to the right. Therefore, regardless of the initial direction, it is adjusted to 90 degrees. Alternatively, after the electronic device determines that the desired angle is 90 degrees, it determines that the desired direction is 90 degrees based on the desired angle, and then sends a remote control instruction to the surface cleaning robot, and the remote control instruction carries the desired direction.

[0332] 18B , before the surface cleaning robot receives a remote control command, its direction of travel is indicated by the dotted arrow in the figure, and the angle between the initial direction and the horizontal axis is 45 degrees. The initial direction can be calculated based on a three-axis acceleration sensor, etc.

[0333] After receiving the remote control command, the surface cleaning robot determines that the desired direction is 90 degrees. It then rotates clockwise from the initial direction by a target angle to change the direction of travel to the desired direction, which is parallel to the horizontal axis. The target angle is the angle between the initial direction and the desired direction. The target angle is 45 degrees.

[0334] 18C , before the surface cleaning robot receives a remote control command, its travel direction is indicated by the dotted arrow in the figure, with the initial direction perpendicular to the horizontal axis and at 0 degrees. The initial direction can be calculated using a three-axis acceleration sensor, etc.

[0335] After receiving the remote control command, the surface cleaning robot determines that the desired direction is 90 degrees. It then rotates clockwise from the initial direction by a target angle to change the direction of travel to the desired direction, which is parallel to the horizontal axis. The target angle is the angle between the initial direction and the desired direction. The target angle is 90 degrees.

[0336] Using this solution, by sliding the remote control control on the remote control page toward the desired angle within 360 degrees, the surface cleaning robot can be controlled to rotate from a first direction to a target angle to a second direction. The operation is simple and quick, and the purpose of accurately and quickly adjusting the direction of the surface cleaning robot can be achieved.

[0337] Optionally, in the above embodiment, the target angles are 45 degrees and 90 degrees, respectively, the desired angle is 90 degrees, and the target angle is less than or equal to 90 degrees. The electronic device remotely controls the surface cleaning robot to rotate clockwise by the target angle so that the direction of travel of the surface cleaning robot changes from the initial direction to the desired direction. When the target angle is greater than 90 degrees, the remotely controlled surface cleaning robot rotates counterclockwise by a difference angle so that the direction of travel of the surface cleaning robot changes from the initial direction to the opposite direction of the desired direction, where the difference angle is the difference between 180 degrees and the target angle. For example, please refer to Figure 18D.

[0338] Figure 18D is another schematic diagram of the surface cleaning robot in action. Referring to Figure 18D , before receiving a remote control command, the surface cleaning robot's movement direction is indicated by the dashed arrow in the figure, with the initial direction at an angle of 125 degrees to the horizontal axis. This initial direction can be calculated using, for example, a triaxial acceleration sensor.

[0339] After receiving the remote control command, the surface cleaning robot determines that the desired direction is 90 degrees. The surface cleaning robot determines that the target angle is 125 degrees, and the difference angle is 55 degrees. Therefore, the surface cleaning robot starts from the initial direction and rotates counterclockwise by the difference angle, thereby changing the direction of travel to the desired direction, which is parallel to the horizontal axis.

[0340] Additionally, when the target angle is 90 degrees, the electronic device remotely controls the surface cleaning robot to rotate clockwise or counterclockwise.

[0341] Different from the above clockwise rotation, if the default initial direction is the direction in which the tail of the surface cleaning robot points to the head, then after the target angle is rotated clockwise and the direction in which the tail of the surface cleaning robot points to the head is the desired direction, the surface cleaning robot moves in the desired direction.

[0342] After the counterclockwise rotation difference angle, the direction that the tail of the surface cleaning robot points to the head is the opposite direction of the desired direction. At this moment, in order to achieve the purpose that the surface cleaning robot advances along the desired direction, the surface cleaning robot advances backwards.

[0343] Using this solution, when the difference between the target angle and the expected angle is less than 90 degrees, the electronic device remotely controls the surface cleaning robot to rotate clockwise. When the difference between the target angle and the expected angle is greater than 90 degrees, the electronic device remotely controls the surface cleaning robot to rotate counterclockwise, so that the rotation amount of the surface cleaning robot is as small as possible, thereby improving the direction adjustment efficiency and thus improving the cleaning efficiency and quality.

[0344] Optionally, in the above embodiment, when the target angle is greater than the preset angle, the electronic device remotely controls the surface cleaning robot to rotate in place to a reference direction, and then remotely controls the surface cleaning robot to move forward and turn until the moving direction changes from the reference direction to the desired direction, the sum of the angle between the reference direction and the desired direction, and the angle between the initial direction and the reference direction is equal to the target angle, and the angle between the reference direction and the desired direction is less than or equal to the preset angle.

[0345] For example, in an embodiment of the present application, the user presses the remote control to trigger the surface cleaning robot to run, and stops pressing the touch control, and the surface cleaning robot stops running. When the user long presses the remote control, it is very likely that the finger will shake, etc., causing the desired angle to change. For example, the desired angle was originally 90 degrees, but due to the user's finger shaking, the desired angle changes to 91 degrees, 89 degrees, etc. When the target angle is relatively large and the surface cleaning robot is far from reaching the target angle, regardless of whether the user's finger shakes, that is, regardless of whether the target angle changes, the surface cleaning robot spins in place, and the process is relatively smooth and there is no jamming.

[0346] However, if the target angle is relatively large, but the surface cleaning robot has already turned more than halfway, and is in the process of turning the preset angle to reach the desired direction, if the user's finger shakes, the desired angle will change, and thus the desired direction will change. The surface cleaning robot periodically updates the desired direction, for example, every 50ms based on the most recently received desired angle. If the user's finger shakes, the expected direction will be different after each update, causing the surface cleaning robot to stop and rotate in place each time the desired direction is updated, causing the surface cleaning robot to freeze and the operation process to be unsmooth.

[0347] To this end, in an embodiment of the present application, when the target angle is greater than the preset angle, the surface cleaning robot first rotates in place until the surface cleaning robot rotates to the reference direction, that is, when the surface cleaning robot still has the preset angle left to rotate, the surface cleaning robot moves forward and turns until the direction of travel becomes the desired direction. For example, the target angle is 90 degrees. At the beginning, the surface cleaning robot rotates in place 60 degrees, and during the remaining 30 degrees, the surface cleaning robot turns and moves forward until the direction of travel changes from the reference direction to the desired direction. The angle between the initial direction and the reference direction is 90 degrees, the angle between the reference direction and the desired direction is 30 degrees, and the angle between the initial direction and the reference direction is 60 degrees.

[0348] In addition, when the target angle is relatively large, the surface cleaning robot first rotates in place and then turns while moving forward, which can prevent the position of the surface cleaning robot from changing too much.

[0349] Similarly, when the surface cleaning robot rotates counterclockwise, if the target angle is greater than a preset angle, the electronic device remotely controls the surface cleaning robot to rotate in place until the remaining angle is less than or equal to the preset angle. The electronic device then remotely controls the surface cleaning robot to move forward while turning, so that the surface cleaning robot's direction of travel changes from the initial direction to the desired direction.

[0350] With this solution, when the target angle or the difference angle is relatively large, the electronic device controls the surface cleaning robot to first rotate in place, and then turn while moving forward, to avoid jamming during the operation of the surface cleaning robot, ensure the smooth operation of the surface cleaning robot, and ensure that the position of the surface cleaning robot does not change too much before and after the direction adjustment.

[0351] Optionally, in the above embodiment, when the target angle is less than or equal to a preset angle, the surface cleaning robot is remotely controlled to move forward and turn at the same time, so that the moving direction of the surface cleaning robot changes from an initial direction to a desired direction.

[0352] Exemplarily, when the target angle is a relatively small angle such as 15 degrees, 20 degrees, or 8 degrees, the electronic device controls the surface cleaning robot to move forward and turn at the same time, so that the moving direction of the surface cleaning robot changes from the initial direction to the desired direction.

[0353] Similarly, when the surface cleaning robot rotates counterclockwise, if the difference angle is less than or equal to the preset angle, the electronic device remotely controls the surface cleaning robot to move forward and turn at the same time, so that the moving direction of the surface cleaning robot changes from the initial direction to the desired direction.

[0354] With this solution, when the target angle or the difference angle is relatively small, the electronic device controls the surface cleaning robot to move forward and turn at the same time, avoiding jamming during the operation of the surface cleaning robot and ensuring smooth operation of the surface cleaning robot.

[0355] Optionally, in the above embodiment, the electronic device responds to the user sliding the remote control control a preset distance toward a desired angle in 360° and long pressing the remote control, and the surface cleaning robot is remotely controlled to change its moving direction from an initial direction to a desired direction, and then moves along the desired direction.

[0356] For example, when a user remotely controls a surface cleaning robot, they slide the remote control to a desired angle and then press and hold the remote control until the robot's direction of travel changes to the desired direction. After the robot's direction of travel changes to the desired direction, if the user continues to press and hold the remote control, the robot will move in a straight line in the desired direction. If the user stops pressing and holding the remote control during the straight-line movement, the robot will stop moving.

[0357] With this solution, if the user keeps pressing the remote control, the surface cleaning robot will turn to the desired direction and then move forward in a straight line, realizing long-press operation and release to stop, thereby achieving the purpose of flexible control of the surface cleaning robot.

[0358] Optionally, in the above embodiment, after the user slides the remote control control a preset distance toward the desired angle in 360°, the user stops pressing the remote control control while long pressing the remote control control. The electronic device responds to the user stopping the long pressing of the remote control control. If the surface cleaning robot has not adjusted the direction of travel to the desired direction, the remote-controlled surface cleaning robot stops adjusting the direction; if the surface cleaning robot is moving in a straight line in the desired direction, the remote-controlled surface cleaning robot stops moving.

[0359] For example, the user presses and holds the remote control for a period of time and stops pressing. If the direction of travel of the surface cleaning robot has not yet become the desired direction, the surface cleaning robot pauses to stop turning; or, stops turning but moves in a straight line in the current direction, and prompts the user whether to exit the remote control, etc.

[0360] The user presses the remote control control for a period of time and stops pressing. If the direction of travel of the surface cleaning robot has become the desired direction and is moving in a straight line in the desired direction, the remote control surface cleaning robot stops moving.

[0361] With this solution, if the user stops pressing the remote control, the surface cleaning robot stops turning or moving, realizing the goal of long pressing to run and releasing to stop, thereby achieving the purpose of flexible control of the surface cleaning robot.

[0362] Optionally, in the above embodiment, in response to the user's operation of the remote control control, the electronic device sends a remote control instruction containing a desired angle to the surface cleaning robot every first preset time period starting from the user's long press of the remote control control in the process of remotely controlling the direction of travel of the surface cleaning robot. This causes the surface cleaning robot to execute the remote control instruction within a second preset time period starting from the receipt of the remote control instruction, and the second preset time period is greater than the first preset time period. If the user continues to press the remote control control within the second preset time period, the surface cleaning robot will execute the new remote control instruction each time it receives the new remote control instruction. If the user stops pressing the remote control control after sending the remote control instruction, the surface cleaning robot will stop executing the remote control instruction after executing the remote control instruction within the second preset time period starting from the receipt of the remote control instruction.

[0363] For example, the first time a user long-presses the remote control, the electronic device determines the desired angle. As the user continues to long-press the control, the electronic device periodically sends remote control commands containing the desired angle or direction to the surface cleaning robot, with a transmission period equal to a first preset duration. Each time the surface cleaning robot receives a new remote control command, it executes the command for a second preset duration. The first preset duration is less than the second preset duration. For example, the first preset duration is 10ms and the second preset duration is 20ms.

[0364] However, each time the surface cleaning robot receives a new remote control instruction, even if the running time of the previous remote control instruction (hereinafter referred to as the old remote control instruction) is less than the second preset time, the surface cleaning robot executes the new remote control instruction and restarts the timing.

[0365] After the surface cleaning robot receives a new remote control command, if the user lifts his finger to stop pressing the remote control control, the surface cleaning robot will no longer receive new remote control commands. Therefore, the surface cleaning robot will execute the last received remote control command for the second preset time period and then stop moving.

[0366] Figure 19 is a schematic diagram of the first preset time length and the second preset time length in the surface cleaning robot control method provided by an embodiment of the present application. Referring to Figure 19, when the user long-presses the remote control, the electronic device will continuously send the desired angle to the surface cleaning robot. Once the user lets go, the surface cleaning robot will not receive the remote control command carrying the desired angle and will stop running immediately, thereby achieving the effect of long-pressing to run and letting go to stop, allowing the user to accurately adjust the direction of the surface cleaning robot to the desired direction. In order to achieve the effect of letting go and stopping, the surface cleaning robot receives the remote control command and runs for the first preset time length, i.e., Xms. If the user long-presses the remote control, the electronic device will send a remote control command every Xms. Since X<Y, the surface cleaning robot's last remote control command has not run for Y milliseconds, and a new remote control command is received. Therefore, the surface cleaning robot will continue to run. When the user lets go, the surface cleaning robot will stop after running for Y milliseconds. The time of Yms is very short and the user cannot perceive it, so the effect of letting go and stopping can be achieved.

[0367] With this solution, when the user long presses the remote control control, each electronic device sends a remote control command to the surface cleaning robot for a preset duration, and the maximum operating time of the surface cleaning robot for each remote control command is the second preset duration. Since the first preset duration is less than the second preset duration, through simple duration control, the user can long press to run and release to stop, which is simple and achieves the purpose of flexible control of the surface cleaning robot.

[0368] Optionally, in the above embodiment, the electronic device responds to the user's operation of the remote control control, and in the process of remotely controlling the travel direction of the surface cleaning robot, if the user slides the remote control control toward a first angle in 360° and before the direction of the surface cleaning robot becomes a first direction corresponding to the first angle, the user slides the remote control control toward a second angle in 360°, then the electronic device responds to the user's operation of adjusting the remote control control to the second angle in 360 degrees, and remotely controls the surface cleaning robot to rotate so that the travel direction of the surface cleaning robot is a second direction corresponding to the second angle.

[0369] For example, please refer to FIG. 20A , which is a schematic diagram of an interface in which a user sequentially slides a remote control in different directions in a control method for a surface cleaning robot provided by an embodiment of the present application. Referring to FIG. 20A , initially, the desired angle is 90 degrees, meaning the user desires the surface cleaning robot to be parallel to the horizontal axis. After the user presses the remote control at 90 degrees, the angle of the remote control is adjusted to 260 degrees, meaning the first angle is 90 degrees and the second angle is 260 degrees. The first angle corresponds to a first direction, which is 90 degrees, and the second angle corresponds to a second direction, which is 260 degrees.

[0370] Figure 20B is a schematic diagram of the surface cleaning robot in motion, corresponding to Figure 20A. Referring to Figure 20B , before receiving a remote control command, the surface cleaning robot's movement direction is indicated by the dashed arrow in the figure, with the initial direction at an angle of 45 degrees to the horizontal axis. This initial direction can be calculated using, for example, a triaxial acceleration sensor.

[0371] After receiving the remote control command, the surface cleaning robot determines that the desired direction is 90 degrees and the target angle is 45 degrees. That is, starting from the initial direction, the target angle is rotated clockwise to make the direction of the surface cleaning robot the second direction.

[0372] However, after the electronic device remotely controls the surface cleaning robot to rotate 15 degrees, if it needs to rotate another 30 degrees to reach the second orientation, the user adjusts the remote control to the second angle. At this point, the angle between the surface cleaning robot and the positive direction of the horizontal axis is 30 degrees. To adjust the surface cleaning robot to the second orientation, the surface cleaning robot needs to rotate 200 degrees clockwise or 160 degrees counterclockwise, i.e., the target angle is 200 degrees.

[0373] Because the target angle is greater than 90 degrees, the electronic device remotely controls the surface cleaning robot to rotate clockwise. The difference between the target angle and 180 degrees is 20 degrees, meaning the surface angle difference is 20 degrees. Therefore, the electronic device remotely controls the surface cleaning robot to rotate 20 degrees clockwise, bringing the robot's orientation to 80 degrees. The electronic device then remotely controls the surface cleaning robot to move backward, thereby achieving the desired direction.

[0374] With this solution, the electronic device detects the user's desired angle in real time, remotely controls and updates the desired direction of the surface cleaning robot according to the desired angle in real time, making the surface cleaning robot more flexible.

[0375] In the above embodiments, the control method of the surface cleaning robot is described in detail by taking the surface cleaning robot adsorbed on the inner window as an example. Next, how to remotely control the surface cleaning robot when the surface cleaning robot is located on the outer window is described in detail.

[0376] In an embodiment of the present application, when the surface cleaning robot is located outside the window, the electronic device responds to the user's sliding operation of the remote control control toward a desired angle within the 360° angle, and remotely controls the movement direction of the surface cleaning robot from an initial direction to a mirror direction, where the angle corresponding to the mirror direction and the angle corresponding to the desired direction are a mutual angle.

[0377] For example, please refer to Figures 21A and 21B. Figure 21A is a schematic diagram of the surface cleaning robot provided by an embodiment of the present application when it is located at an exterior window. Figure 21B is another schematic diagram of the surface cleaning robot provided by an embodiment of the present application when it is located at an exterior window.

[0378] Referring to Figure 21A , when the surface cleaning robot is positioned at an exterior window and the user is indoors, the user can see, from their perspective, the suction components on the surface cleaning robot. Furthermore, the direction of travel is indicated by the dotted arrow in the figure, with the initial direction at an angle of 0 degrees to the horizontal axis. This initial direction can be calculated using, for example, a three-axis accelerometer. If the user's desired direction is 90 degrees, and if the user has not selected exterior window mode, the user slides the remote control toward 90 degrees and holds it down, as shown in Figure 18A . At this point, from the user's perspective, the surface cleaning robot will rotate 90 degrees counterclockwise, and the final direction will not be the user's desired direction.

[0379] To this end, in an embodiment of the present application, as shown in Figure 21B, the electronic device remotely controls the moving direction of the surface cleaning robot to change from an initial direction to a mirror direction, and the angle corresponding to the mirror direction and the angle corresponding to the desired direction are mutual angles, that is, the sum of the angle corresponding to the mirror direction and the angle corresponding to the desired direction is 360 degrees.

[0380] With this solution, when the surface cleaning robot is located at an outer window, the direction of travel of the surface cleaning robot is remotely controlled according to the user's desired direction, so that the direction of travel is changed to a mirror image direction of the desired direction, which is more convenient for user operation.

[0381] Optionally, in the above embodiment, the operation on the remote control control includes: a linear sliding operation of the remote control control from an initial position toward any angle within 360°, and a curved sliding operation of the remote control control from a first position to a second position, wherein the initial position is located at the center of the sliding range of the remote control control, and the first position and the second position are any two positions within the sliding range.

[0382] For example, during the first operation, the remote control is located at the center of the sliding range. At this point, the user can touch the remote control from the center and slide it in a straight line. After the user drags the remote control to slide toward a desired angle, if the user changes the desired angle, the remote control can be slid in a curve from the first position to a second position. The first position is, for example, the position of the remote control at 90 degrees in FIG. 20A , and the second position is, for example, the position of the remote control at 260 degrees in FIG. 20A .

[0383] With this solution, the user can slide the remote control in a straight line or in a curve, which is simple and flexible to operate, thereby achieving the purpose of flexible movement of the surface cleaning robot.

[0384] Optionally, in the above embodiment, when the operation on the remote control control is a curved sliding operation, the trajectory of the remote control control is an arc or a wavy line.

[0385] For example, referring to FIG. 20A again, the movement trajectory of the remote control from the first position to the second position may be an arc, a wavy line, a straight line, a broken line, etc., which is not limited in the embodiment of the present application.

[0386] With this solution, the sliding trajectory of the remote control can be an arc or a wavy line, etc., which is convenient for users to operate flexibly.

[0387] Based on the above-mentioned electronic device controlling the surface cleaning robot, the embodiment of the present application further provides a control method applied to the surface cleaning robot.

[0388] FIG22 is a flow chart of a control method for a surface cleaning robot provided in an embodiment of the present application, which is described from the perspective of the surface cleaning robot. The method includes:

[0389] 1101. Receive a remote control command from an electronic device, where the remote control command is triggered by the electronic device in response to a user's operation on a remote control control, where the remote control control is an operable control displayed on a remote control page of a user interface of the electronic device;

[0390] 1102. Control the travel direction according to the remote control instruction.

[0391] For details, please refer to the description of Figure 15 and related embodiments above, which will not be repeated here.

[0392] In the remote control method for a surface cleaning robot provided in an embodiment of the present application, a user slides a remote control control on a remote control page, and the electronic device responds to the user's operation by sending a remote control command to the surface cleaning robot. After receiving the remote control command, the surface cleaning robot controls its direction accordingly. With this solution, the user can flexibly control the surface cleaning robot's direction within a 360-degree range by operating the remote control control on the remote control page, making operation simple and efficient.

[0393] Optionally, in the above embodiment, when the surface cleaning robot controls the direction of travel according to the remote control command, in one method, if the remote control command indicates a target angle, the surface cleaning robot rotates the target angle to change the direction of travel from the initial direction to the desired direction, and then moves in a straight line along the desired direction, where the desired direction is the direction corresponding to the desired angle in 360°, and the desired angle is the direction corresponding to the user's sliding operation on the remote control control.

[0394] In another approach, since there is a one-to-one correspondence between 360-degree directions and 360-degree angles, after the user slides the remote control control on the remote control page toward the desired angle, the electronic device obtains the desired direction based on the desired angle, and sends the desired direction along with a remote control command to the surface cleaning robot. After receiving the remote control command, the surface cleaning robot determines an initial direction, then determines a rotation angle based on the initial direction and the desired direction, and rotates, thereby adjusting the direction from the initial direction to the desired direction.

[0395] The following are device embodiments of the present application, which can be used to implement the method embodiments of the present application. For details not disclosed in the device embodiments of the present application, please refer to the method embodiments of the present application.

[0396] FIG23 is a schematic diagram of a remote control device provided in an embodiment of the present application. The remote control device 1200 includes: a display module 121 and a processing module 122 .

[0397] The display module 121 is configured to display a remote control page on the user interface in response to an instruction to enter the remote control page, wherein the remote control page is provided with operable remote control controls;

[0398] The processing module 122 is configured to remotely control the direction of travel of the surface cleaning robot in response to a user's operation of the remote control control.

[0399] In a feasible implementation, the processing module 122 is used to remotely control the surface cleaning robot to rotate to a target angle in response to the user sliding the remote control control toward a desired angle in 360°, so that the moving direction of the surface cleaning robot changes from an initial direction to a desired direction, the angle in 360° corresponds one-to-one to the direction in the 360-degree direction of the working surface of the surface cleaning robot, the desired angle corresponds to the desired direction, and the target angle is the angle between the initial direction and the desired direction.

[0400] In a feasible implementation, the processing module 122 is used to remotely control the surface cleaning robot to rotate in place to a reference direction when the target angle is greater than a preset angle, and then remotely control the surface cleaning robot to move forward and turn until the moving direction changes from the reference direction to the desired direction, the sum of the angle between the reference direction and the desired direction, and the angle between the initial direction and the reference direction is equal to the target angle, and the angle between the reference direction and the desired direction is less than or equal to the preset angle.

[0401] In a feasible implementation, the processing module 122 is used to remotely control the surface cleaning robot to move forward and turn when the target angle is less than or equal to a preset angle, so that the moving direction of the surface cleaning robot changes from an initial direction to a desired direction.

[0402] In a feasible implementation, the processing module 122 is used to, when the target angle is less than 90 degrees, cause the remote-controlled surface cleaning robot to rotate clockwise the target angle so that the moving direction of the surface cleaning robot changes from the initial direction to the desired direction; when the target angle is greater than or equal to 90 degrees, cause the remote-controlled surface cleaning robot to rotate counterclockwise the difference angle so that the moving direction of the surface cleaning robot changes from the initial direction to the desired direction, and the difference angle is the difference between 180 degrees and the target angle.

[0403] In a feasible implementation, the processing module 122 is used to remotely control the surface cleaning robot to rotate so that the direction of the surface cleaning robot becomes a second direction corresponding to the second angle in response to the user adjusting the remote control to a second angle in 360 degrees after the user slides the remote control toward a first angle in 360 degrees and before the direction of the surface cleaning robot becomes a first direction corresponding to the first angle.

[0404] In a feasible implementation, the processing module 122 is used to respond to the user's operation of sliding the remote control control a preset distance toward the desired angle in 360° and long pressing it, and remotely control the surface cleaning robot to move in the desired direction after the moving direction is changed from the initial direction to the desired direction.

[0405] In a feasible implementation, the processing module 122 is also used to respond to the user stopping the long press of the remote control control. If the surface cleaning robot has not adjusted the direction of travel to the desired direction, the remote control surface cleaning robot stops adjusting the direction; if the surface cleaning robot is moving in a straight line in the desired direction, the remote control surface cleaning robot stops moving.

[0406] In a feasible implementation, the processing module 122 is used to send a remote control instruction carrying a desired angle to the surface cleaning robot once every first preset time period starting from the time the user long presses the remote control control, so that the surface cleaning robot executes the remote control instruction within a second preset time period starting from the time the user receives the remote control instruction, and the second preset time period is greater than the first preset time period; if the user continues to press the remote control control within the second preset time period, the remote control surface cleaning robot executes the new remote control instruction each time it receives a new remote control instruction; if the user stops pressing the remote control control after sending the remote control instruction, the remote control surface cleaning robot executes the remote control instruction within the second preset time period starting from the time the user receives the remote control instruction and then stops.

[0407] In a feasible implementation, the processing module 122 is used to remotely control the surface cleaning robot's moving direction from an initial direction to a mirror direction in response to a user sliding the remote control toward a desired angle within a 360° angle when the surface cleaning robot is located at an external window, and the angle corresponding to the mirror direction and the angle corresponding to the desired direction are a mutual angle.

[0408] In a feasible implementation, the operation of the remote control control includes: a linear sliding operation of the remote control control from an initial position toward any angle within 360°, and a curved sliding operation of the remote control control from a first position to a second position, wherein the initial position is located at the center of the sliding range of the remote control control, and the first position and the second position are any two positions within the sliding range.

[0409] In a feasible implementation, when the operation on the remote control control is a curved sliding operation, the trajectory of the remote control control is an arc or a wavy line.

[0410] The remote control device provided in the embodiment of the present application can execute the actions of the electronic device in the above embodiment. Its implementation principle and technical effects are similar and will not be repeated here.

[0411] FIG24 is a schematic diagram of a remote control device provided in an embodiment of the present application. The remote control device 1300 includes: a receiving module 131 and a processing module 132 .

[0412] A receiving module 131 is configured to be triggered by an operation of a control, wherein the remote control is an operable control displayed on a remote control page of a user interface of the electronic device;

[0413] Processing module 132, for controlling the direction of travel according to the remote control command.

[0414] In a feasible implementation, the processing module 132 is used to rotate the target angle to change the travel direction from the initial direction to the desired direction when the remote control instruction indicates a target angle, and then move in a straight line along the desired direction. The desired direction is the direction corresponding to the desired angle in 360°, and the desired angle is the direction corresponding to the user's sliding operation on the remote control control.

[0415] The remote control device provided in the embodiment of the present application can perform the actions of the surface cleaning robot in the above embodiment. Its implementation principle and technical effects are similar and will not be repeated here.

[0416] An embodiment of the present application also provides a computer-readable storage medium, which stores computer instructions. When the computer instructions are executed by a processor, they are used to implement the remote control method of the surface cleaning robot implemented by the above electronic device or surface cleaning robot.

[0417] An embodiment of the present application also provides a computer program product, which includes a computer program. When the computer program is executed by a processor, it implements the remote control method of the surface cleaning robot implemented by the above electronic device or surface cleaning robot.

[0418] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present application that follow the general principles of the present application and include common knowledge or customary techniques in the art not disclosed herein. The description and examples are to be considered as exemplary only, and the true scope and spirit of the present application are indicated by the following claims.

[0419] It should be understood that the present application is not limited to the exact structure described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.

[0420] It is important to note that some terms used in this application are understood to be equivalent, though they are expressed differently in different description scenarios. For example, "manual remote control interface" is equivalent to "remote control page," "manual shake" control 31 is equivalent to "operable remote control control 51," and "limited area 51" is equivalent to "sliding range 52." Furthermore, the client device described in this application is an electronic device.

[0421] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, i.e., they may be located in one location or distributed across multiple network units. Some or all of the modules may be selected based on actual needs to achieve the objectives of the present embodiment. Persons of ordinary skill in the art will be able to understand and implement the present invention without inventive effort.

[0422] Through the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a necessary general hardware platform, or of course, by hardware. Based on this understanding, the essence of the above technical solution or the part that contributes to the existing technology can be embodied in the form of a software product. The computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a magnetic disk, an optical disk, etc., and includes a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or certain parts of the embodiments.

[0423] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A robot control method, It is characterized in that Applicable to the client, the method includes: In response to a sliding operation on the interface in any direction of 360 degrees, determining a target direction; Determine the moving speed according to the area to which the operation termination position of the sliding operation belongs in the interface; According to the target direction, the robot is controlled to adjust its posture and move at the moving speed according to the adjusted posture.

2. The method according to claim 1, It is characterized in that In response to the sliding operation, determining a target direction includes: Determining an operation termination position of the sliding operation; Based on the operation termination position, the target direction is determined.

3. The method according to claim 2, It is characterized in that Determining the moving speed according to the area to which the operation termination position belongs in the interface includes: Based on the operation termination position, determining a sliding distance; Determining, according to the sliding distance, the region to which the operation termination position belongs in the interface; The moving speed is determined based on the area to which the operation termination position belongs in the interface.

4. The method according to claim 3, It is characterized in that Also includes: In response to a release operation for the sliding operation at the operation end position, the robot is controlled to stop moving or to keep moving at the moving speed in the target direction according to the sliding distance.

5. The method according to any one of claims 2 to 4, It is characterized in that Also includes: The interface displays a control, which includes a limit area and a draggable control that can be dragged in any direction on the limit area; In response to the sliding operation, the draggable control moves within the limiting area according to the sliding operation; The operation termination position is the position of the draggable control on the limiting area when the movement stops.

6. The method according to claim 5, It is characterized in that Determining the target direction based on the operation termination position includes: Based on the operation termination position, determining a deflection angle of the draggable control relative to a reference direction; The target direction is determined according to the deflection angle.

7. The method according to claim 5, It is characterized in that Based on the operation termination position, determining the sliding distance includes: Calculating the distance between the operation termination position and the center position of the limiting area to determine the sliding distance; and determining the area to which the operation termination position belongs in the interface according to the sliding distance, including: Determining, according to the sliding distance, an area where the draggable control is located in the limiting area; Determine the area where the draggable control is located in the limiting area as the area to which the operation termination position belongs in the interface; And, determining the moving speed based on the area to which the operation termination position belongs in the interface includes: The moving speed is determined based on the area where the draggable control is located in the limiting area.

8. The method according to claim 7, It is characterized in that Determining the moving speed based on the area where the draggable control is located in the limiting area includes: If the draggable control is in the first area of ​​the limiting area, the moving speed is determined according to the sliding distance; or a first preset speed is determined as the moving speed; If the draggable control is in the second area of ​​the limiting area, the moving speed is determined according to the deflection angle of the draggable control relative to the reference direction; or, in response to a rotation operation on the second area, the moving speed is determined according to the rotation angle and rotation direction corresponding to the rotation operation; or, a second preset speed is determined as the moving speed; The second area is outside the first area.

9. The method according to claim 8, It is characterized in that When the draggable control is in the second area of ​​the limiting area, the method further includes: Updating the display state of the second area to reflect that the lock control function corresponding to the second area is activated; wherein the lock control function is used to lock the draggable control to control the robot to move autonomously in a directional and constant speed; The graphic element on the draggable control that reflects the surface of the working object where the robot is located disappears or remains displayed.

10. The method according to claim 9, It is characterized in that Also includes: When a release operation for the sliding operation at the operation termination position is detected, the draggable control is locked, and a display state of the draggable control is updated to reflect that the draggable control is in a locked state.

11. The method according to claim 10, It is characterized in that Locking the draggable control includes: According to the operation termination position, the draggable control is fixed at a target position on the boundary of the first area, wherein the target position is closest to the operation termination position and is on a straight line; the second area disappears; or The draggable control is fixed at the operation termination position.

12. The method according to claim 11, It is characterized in that Also includes: When it is detected that the unlocking condition is met, unlocking the draggable control, and restoring the draggable control to the center position of the limiting area; If the second area is in a disappeared state, making the second area visible; Wherein, satisfying the unlocking condition includes at least one of the following: receiving the movement stop information sent by the robot, An operation triggered on the limit zone is monitored.

13. The method according to any one of claims 6 to 12, It is characterized in that Also includes: Determine the surface of the working object on which the robot is located; On the draggable control, displaying a graphic element reflecting a surface of a working object on which the robot is located; The surface of the work object includes at least one of the following: an inner surface facing the user and an outer surface corresponding to the inner surface.

14. The method according to claim 13, It is characterized in that Determining the surface of the working object where the robot is located includes: Display at least one graphic element; one graphic element is used to reflect that the robot is on a surface of a work object; In response to a selection operation on the at least one graphical element, determining a selected graphical element; Determining the surface of the working object where the robot is located according to the selected graphic element; Among them, the graphic element displayed on the draggable control is the selected graphic element.

15. The method according to claim 14, It is characterized in that Also includes: Acquiring posture information of the robot; According to the posture information, the posture of the graphic element on the draggable control is updated so that the graphic element on the draggable control can reflect the posture of the robot.

16. A robot control method, It is characterized in that Applicable to the client, the method includes: In response to a sliding operation on the interface, determining a sliding distance; Determining, according to the sliding distance, a region in the interface to which the operation termination position of the sliding operation belongs; Determine the moving speed according to the area to which the operation termination position belongs in the interface; The robot is controlled to move at the moving speed.

17. A robot control method, It is characterized in that Applicable to the client, the method includes: In response to a sliding operation on the interface in any direction of 360 degrees, determining a target direction; In response to a release operation after the sliding operation to the target area, determining a moving speed; According to the target direction, the robot is controlled to adjust its posture, and continues to move at the moving speed according to the adjusted posture.

18. The method according to claim 17, It is characterized in that The target area is an area associated with a locking function; the locking function is used to lock the operation termination position of the sliding operation when the release operation is detected.

19. A robot control method, It is characterized in that Applicable to the client, the method includes: On the interface, a manipulation control is displayed, wherein the manipulation control includes a limit area and a draggable control on the limit area that can be dragged in any direction; When it is detected that the draggable control is triggered to move in any direction of 360 degrees on the limit area, the robot is controlled to follow the target direction corresponding to when the draggable control stops moving, and the moving direction is adjusted and moved according to the adjusted moving direction; When it is detected that the draggable control moves and stops in a first area of ​​the limiting area and is released, the draggable control returns to a set position, and the robot is controlled to stop moving; When it is detected that the draggable control moves and stops in a second area in the limiting area and is released, the draggable control is locked, and the robot is controlled to maintain moving in the adjusted moving direction; wherein the second area is outside the first area.

20. A robot control system, It is characterized in that include: A robot for performing a work task on a surface of a work object; A client, communicatively connected to the robot, for implementing the steps of the robot control method described in any one of claims 1 to 15, or implementing the steps of the robot control method described in claim 16, or implementing the steps of the robot control method described in claim 17 or 18, or implementing the steps of the robot control method described in claim 19.

21. The system according to claim 20, It is characterized in that The robot is an adsorption-type surface cleaning robot.

22. A client device, It is characterized in that comprising a memory and a processor; wherein, The memory stores one or more computer instructions; The processor, coupled to the memory, is used to execute the one or more computer instructions to implement the steps in the robot control method described in any one of claims 1 to 15, or the steps in the robot control method described in claim 16, or the steps in the robot control method described in claim 17 or 18, or the steps in the robot control method described in claim 19.

Citation Information

Patent Citations

  • Remote control method of robot and communication terminal

    CN103309353A

  • Cleaning robot, control method and device thereof and readable storage medium

    CN114869171A

  • Interaction control method and device for object movement and electronic equipment

    CN115957503A

  • Robot control method and system and client device

    CN116350113A

  • Mobile robot and remote operation system

    JP2008070236A