Robot control method and device, robot and readable storage medium

By obtaining the trapped signal of the robot and using the image acquisition device to identify the location of the obstacle, the robot can effectively and flexibly escape operations in a narrow area, and solve the problem of low escape efficiency in the prior art.

WO2024230590A1PCT designated stage expired Publication Date: 2024-11-14MIDEA ROBOZONE TECH CO LTD

Patent Information

Application Number
PCT/CN2024/090838
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-10
Filing Date
2024-04-30
Publication Date
2024-11-14

AI Technical Summary

Technical Problem

Existing robots are inefficient in getting out of obstacles when encountering obstacles, especially in narrow areas where they cannot flexibly cope with trapped situations.

Method used

By acquiring the trapped signal of the robot, determining the field of view of the image acquisition device covers the robot, acquiring the image of the image acquisition device to identify the location of the obstacle and the trapped part, and controlling the robot to perform targeted escape movement.

Benefits of technology

Improves robotic escape efficiency and success rate, especially in narrow areas.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024090838_14112024_PF_FP_ABST
    Figure CN2024090838_14112024_PF_FP_ABST
Patent Text Reader

Abstract

Provided are a robot control method and device, a robot and a readable storage medium. The robot control method comprises: acquiring a signal indicating that a robot (1102) is trapped; determining an image acquisition device (11042), the field of view of the image acquisition device (11042) at least partially covering the robot (1102), or the image acquisition device (11042) being arranged on the robot (1102); acquiring an image of the image acquisition device (11042); and according to the image, controlling the robot (1102) to execute escape movement. According to the robot control method, when the robot (1102) is trapped, the image acquisition device (11042) acquires an image (1204) of the trapped robot (1102), the robot (1102) is controlled to escape on the basis of said image (1204), so that the escape efficiency of the robot (1102) is effectively improved.
Need to check novelty before this filing date? Find Prior Art

Description

Robot control method and device, robot and readable storage medium

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on May 5, 2023, with application number "202310496947.5" and application name "Robot control method and device, robot and readable storage medium", and the Chinese patent application filed with the China Patent Office on May 10, 2023, with application number "202310519062.2" and application name "Mobile robot control method, device, storage medium and mobile robot", the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of robotics technology, and in particular to a robot control method and device, a robot, and a readable storage medium. Background Art

[0003] With the development of robotics technology, robots are increasingly being used. During their operation, robots often become stuck, requiring them to perform certain escape maneuvers. However, existing conventional escape methods for robots have fixed escape maneuvers and low efficiency, especially in confined areas, where robots are unable to flexibly escape according to specific jamming situations.

[0004] Summary of the Invention

[0005] This application aims to solve at least one of the technical problems existing in the prior art or related art.

[0006] To this end, a first aspect of the present application is to propose a robot control method.

[0007] The second aspect of this application is to propose another robot control method.

[0008] The third aspect of this application is to propose another robot control method.

[0009] A fourth aspect of the present application is to provide a robot control device.

[0010] A fifth aspect of the present application is to provide another robot control device.

[0011] The sixth aspect of the present application is to provide another robot control device.

[0012] The seventh aspect of the present application is to provide another robot control device.

[0013] The eighth aspect of the present application is to provide a readable storage medium.

[0014] The ninth aspect of this application is to propose a robot.

[0015] The tenth aspect of this application is to propose another robot.

[0016] According to the first aspect of the present application, a robot control method is proposed, including: obtaining a trapped signal of the robot; determining an image acquisition device, the field of view of the image acquisition device at least partially covers the robot or the image acquisition device is arranged on the robot; obtaining an image from the image acquisition device; and controlling the robot to perform an escape movement according to the image.

[0017] The technical solution for the robot control method provided in this application can be implemented by a server or a robot control device, and the implementation can be determined based on actual usage requirements, and is not specifically limited here. To more clearly describe the robot control method provided in this application, the following description assumes that the implementation of the robot control method is a robot control device.

[0018] In this technical solution, the robot can be a mobile robot used in the home, such as a sweeping robot, mopping robot, or inspection robot. While performing its tasks, the robot may encounter an obstacle blocking its path. In this case, the robot will first attempt to cross the obstacle or adjust its direction to bypass it. If the robot fails to cross or bypass the obstacle multiple times, it determines that it has entered a trapped state and sends a trapped signal to the server.

[0019] Exemplarily, the trapped signal carries information such as the trapped state, location information, and identification information of the first robot.

[0020] The server can be a cloud server, a robot base station, or a device such as an intelligent gateway that establishes a wireless network connection with the robot.

[0021] After receiving the trapped signal of the robot, the server determines an image acquisition device, which may be an image acquisition device in the area where the robot is located, or an image acquisition device provided on the robot.

[0022] The server obtains the image captured by the image acquisition device, which can reflect the robot's trapped situation. Therefore, the server controls the robot to escape according to the image captured by the image acquisition device, so that the robot can perform targeted escape movements according to the trapped situation, specifically the location of the obstacle, the trapped part, etc.

[0023] Exemplarily, the image acquisition device is an image acquisition device in the area where the robot is located. The image acquisition device in the area where the robot is located is used to capture the trapped image of the robot from a third perspective. The trapped condition of the robot is determined using the trapped image from the third perspective, and the robot is controlled to perform an escape movement.

[0024] Exemplarily, the image acquisition device is an image acquisition device provided on the robot, which captures the trapped state of the robot from a first perspective through the image acquisition device on the robot, determines the trapped state of the robot based on the trapped image from the first perspective, and controls the robot to perform escape movements.

[0025] The embodiment of the present application can effectively improve the efficiency of the robot's escape by obtaining an image of the robot being trapped through an image acquisition device when the robot is trapped, and controlling the robot to escape based on the trapped image.

[0026] In some technical solutions, the step of determining the image acquisition device includes: determining the trapped area of ​​the robot based on the trapped signal; determining at least one electronic device in the trapped area, wherein the at least one electronic device is provided with an image acquisition device; the step of acquiring the image of the image acquisition device includes: controlling the electronic device to acquire the trapped image corresponding to the robot through the image acquisition device.

[0027] In some technical solutions, determining the trapped area of ​​the robot according to the trapped signal includes: determining the position information of the robot according to the trapped signal; obtaining the working map of the robot; and determining the trapped area within the working area of ​​the robot according to the position information and the working map.

[0028] In some technical solutions, determining at least one electronic device in a trapped area includes: sending a query signal to a target gateway, the target gateway is communicatively connected with multiple alternative electronic devices in the trapped area; and determining at least one electronic device from the multiple alternative electronic devices based on a device list received from the target gateway.

[0029] In some technical solutions, determining the image acquisition device includes: when the robot is equipped with an image sensor, determining the image sensor as the image acquisition device.

[0030] In some technical solutions, controlling a robot to perform an escape movement based on an image includes: sending the image to a target terminal; receiving a remote control signal sent by the target terminal; and sending the remote control signal to the robot so that the robot can perform the escape movement based on the remote control signal.

[0031] In some technical solutions, controlling a robot to perform an escape movement based on an image includes: generating a corresponding escape map based on the image; determining an escape route based on the escape map; and sending the escape route to the robot so that the robot can perform the escape movement based on the escape route.

[0032] In some technical solutions, an image acquisition device is provided on the robot, and the image includes at least chassis environment information of the robot. The chassis environment information is the image information under the chassis. The robot is controlled to perform escape movement according to the image, including: determining the robot's environmental information according to the chassis environment information; determining the robot's stuck information according to the environmental information; and controlling the robot to perform corresponding escape operations according to the stuck information.

[0033] In some technical solutions, the robot includes at least one first sensor, which is used to collect first sensor data. The robot control method also includes: determining the robot's running speed and position information based on the robot's first sensor data and / or image; when the running speed is greater than zero and the position information remains unchanged, it is determined that the robot is in a stuck state.

[0034] In some technical solutions, determining the robot's environmental information based on chassis environmental information includes: obtaining first chassis environmental information of the robot in a first time period, the first time period being before the robot is in a stuck state; and determining the robot's environmental information based on the first chassis environmental information.

[0035] In some technical solutions, the robot includes at least one second sensor, and the at least one second sensor is used to collect second sensor data, and determine the robot's environmental information based on the chassis environment information, including: obtaining the first chassis environment information of the robot in a first time period, and the first time period is before the robot is in a stuck state; obtaining the second chassis environment information and / or second sensor data when the robot is in the stuck state; determining the robot's environmental information based on the first chassis environment information, the second chassis environment information and / or the second sensor data; wherein the second sensor data includes at least one of laser sensor data and radar sensor data.

[0036] In some technical solutions, determining the stuck information of the robot based on environmental information includes: determining the obstacle information that trapped the robot based on the environmental information; and determining the stuck information based on the obstacle information.

[0037] In some technical solutions, determining the stuck information based on the obstacle information includes: determining the trapped position and / or trapped direction, movable direction and / or movable distance of the robot based on the obstacle information.

[0038] In some technical solutions, the robot is controlled to perform corresponding escape operations based on the stuck information, including: determining the movement information of the robot based on the stuck information, the movement information including the moving direction and the moving distance, the moving direction is associated with the stuck direction, and / or the moving direction is associated with the movable direction, the moving distance is associated with the stuck position, and / or the moving distance is associated with the movable distance; controlling the robot to move according to the movement information.

[0039] According to the second aspect of the present application, another robot control method is proposed, which is applied to a robot, and the method includes: when it is detected that the robot is in a trapped state, sending a trapped signal to a server; receiving a remote control signal sent by a target terminal, the remote control signal is a signal generated by the target terminal according to the received remote control input when displaying a trapped image, the trapped image is an image captured by an image acquisition device, the field of view of the image acquisition device at least partially covers the robot or the image acquisition device is set on the robot; and executing an escape movement according to the remote control signal.

[0040] In some technical solutions, after sending the trapped signal to the server, the robot control method further includes: receiving an escape route sent by the server, where the escape route is a route determined by the server based on the trapped image; and executing an escape movement according to the escape route.

[0041] According to the third aspect of the present application, another robot control method is proposed, which is applied to a terminal, and the method includes: receiving a trapped image sent by a server, where the trapped image is an image captured by an image acquisition device, and the field of view of the image acquisition device at least partially covers the robot or the image acquisition device is set on the robot; displaying the trapped image and receiving remote control input; determining a remote control signal in response to the remote control input; sending the remote control signal to the server, so that the server sends the remote control signal to the robot, so that the robot performs an escape movement according to the remote control signal.

[0042] According to the fourth aspect of the present application, a robot control device is proposed, including: an acquisition module for acquiring a trapped signal of the robot; a determination module for determining an image acquisition device, the field of view of the image acquisition device at least partially covers the robot or the image acquisition device is arranged on the robot; the acquisition module is also used to acquire an image of the image acquisition device; and a control module is used to control the robot to perform an escape movement according to the image.

[0043] According to the fifth aspect of the present application, another robot control device is proposed, which is applied to a robot and includes: a sending module for sending a trapped signal to a server when detecting that the robot is in a trapped state; a receiving module for receiving a remote control signal sent by a target terminal, the remote control signal being a signal generated by the target terminal according to the received remote control input when displaying a trapped image, the trapped image being an image captured by an image acquisition device, the field of view of the image acquisition device at least partially covering the robot or the image acquisition device being arranged on the robot; an execution module for executing an escape movement according to the remote control signal.

[0044] According to the sixth aspect of the present application, another robot control device is proposed, which is applied to a terminal, and the device includes: a receiving module for receiving a trapped image sent by a server, where the trapped image is an image captured by an image acquisition device, and the field of view of the image acquisition device at least partially covers the robot or the image acquisition device is arranged on the robot; a display module for displaying the trapped image and receiving remote control input; a determination module for determining the remote control signal in response to the remote control input; and a sending module for sending the remote control signal to the server, so that the server sends the remote control signal to the robot, so that the robot performs an escape movement according to the remote control signal.

[0045] According to the seventh aspect of the present application, another robot control device is proposed, comprising: a memory storing programs or instructions; and a processor, which implements the steps of the robot control method in any of the above technical solutions when executing the programs or instructions.

[0046] According to the eighth aspect of the present application, a readable storage medium is proposed, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the robot control method in any of the above technical solutions are implemented.

[0047] According to the nine aspects of the present application, a robot is proposed, comprising a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the robot control method in any of the above technical solutions are implemented.

[0048] According to the tenth aspect of the present application, another robot is proposed, comprising: a main body, on which an image acquisition device is provided; a chassis, connected to the main body, on which a moving mechanism is provided; the robot control device of the seventh aspect mentioned above; and / or the readable storage medium of the eighth aspect mentioned above.

[0049] In some technical solutions, the robot also includes: at least one first sensor, which is arranged on the main body and is used to collect first sensor data; and at least one second sensor, which is arranged on the main body and is used to collect second sensor data.

[0050] Additional aspects and advantages of the present application will become apparent in the following description or may be learned through practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:

[0052] FIG1 shows a schematic diagram of a flow chart of a robot control method according to an embodiment of the present application;

[0053] FIG2 shows a second flow chart of the robot control method according to an embodiment of the present application;

[0054] FIG3 shows a third flow chart of the robot control method according to an embodiment of the present application;

[0055] FIG4 shows one structural block diagram of a robot control device according to an embodiment of the present application;

[0056] FIG5 shows a second structural block diagram of the robot control device according to an embodiment of the present application;

[0057] FIG6 shows a third structural block diagram of the robot control device according to an embodiment of the present application;

[0058] FIG7 shows a fourth structural block diagram of the robot control device according to an embodiment of the present application;

[0059] FIG8 shows one structural block diagram of a robot according to an embodiment of the present application;

[0060] FIG9 shows a second structural block diagram of the robot according to an embodiment of the present application;

[0061] FIG10 shows a third structural block diagram of the robot according to an embodiment of the present application;

[0062] FIG11 is a schematic diagram showing an electronic device capturing an image of a trapped person according to an embodiment of the present application;

[0063] FIG12 shows a schematic diagram of an interface of a target terminal according to an embodiment of the present application.

[0064] Reference numerals:

[0065] 1100 trapped area, 1102 robot, 1104 electronic equipment, 11042 image acquisition device, 1200 target terminal, 1202 display interface, 1204 trapped image. DETAILED DESCRIPTION

[0066] In order to more clearly understand the above-mentioned objects, features and advantages of the present application, the present application is further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be noted that the embodiments of the present application and the features therein can be combined with each other in the absence of conflict.

[0067] In the following description, many specific details are set forth to facilitate a full understanding of the present application. However, the present application may also be implemented in other ways different from those described herein. Therefore, the scope of protection of the present application is not limited to the specific embodiments disclosed below.

[0068] 1 to 12 , the robot control method and device, robot, and readable storage medium provided in the embodiments of the present application are described in detail through specific embodiments and their application scenarios.

[0069] In one embodiment of the present application, as shown in FIG1 , the robot control method may specifically include the following steps 102 to 108:

[0070] Step 102, obtaining a trapped signal of the robot;

[0071] Step 104, determining an image acquisition device, wherein the field of view of the image acquisition device at least partially covers the robot or the image acquisition device is disposed on the robot;

[0072] Step 106, acquiring an image from the image acquisition device;

[0073] Step 108: Control the robot to perform escape motion according to the image.

[0074] The technical solution for the robot control method provided in this application can be implemented by a server or a robot control device, and the implementation can be determined based on actual usage requirements, and is not specifically limited here. To more clearly describe the robot control method provided in this application, the following description assumes that the implementation of the robot control method is a robot control device.

[0075] In the embodiments of the present application, the robot may be a robot capable of moving around the home, such as a sweeping robot, a mopping robot, or a patrol robot. When the robot is performing a task, an obstacle may block its path. In this case, the robot will first try to cross the obstacle or adjust its direction to bypass the obstacle.

[0076] If the robot fails to cross or bypass an obstacle after multiple attempts, the robot determines that it has entered a trapped state and sends a trapped signal to the server.

[0077] Exemplarily, the trapped signal carries information such as the trapped state, location information, and identification information of the first robot.

[0078] The server can be a cloud server, a robot base station, or a device such as an intelligent gateway that establishes a wireless network connection with the robot.

[0079] After receiving the trapped signal of the robot, the server determines an image acquisition device, which may be an image acquisition device in the area where the robot is located, or an image acquisition device provided on the robot.

[0080] The server obtains the image captured by the image acquisition device, which can reflect the robot's trapped situation. Therefore, the server controls the robot to escape according to the image captured by the image acquisition device, so that the robot can perform targeted escape movements according to the trapped situation, specifically the location of the obstacle, the trapped part, etc.

[0081] Exemplarily, the image acquisition device is an image acquisition device in the area where the robot is located. The image acquisition device in the area where the robot is located is used to capture the trapped image of the robot from a third perspective. The trapped condition of the robot is determined using the trapped image from the third perspective, and the robot is controlled to perform an escape movement.

[0082] Exemplarily, the image acquisition device is an image acquisition device provided on the robot, which captures the trapped state of the robot from a first perspective through the image acquisition device on the robot, determines the trapped state of the robot based on the trapped image from the first perspective, and controls the robot to perform escape movements.

[0083] The embodiment of the present application can effectively improve the efficiency of the robot's escape by obtaining an image of the robot being trapped through an image acquisition device when the robot is trapped, and controlling the robot to escape based on the trapped image.

[0084] In some embodiments of the present application, the step of determining the image acquisition device includes: determining the trapped area of ​​the robot based on the trapped signal; determining at least one electronic device in the trapped area, wherein the at least one electronic device is provided with an image acquisition device; the step of acquiring an image of the image acquisition device includes: controlling the electronic device to acquire the trapped image corresponding to the robot through the image acquisition device.

[0085] In an embodiment of the present application, when the server receives a trapped signal sent by the robot, the server determines the identity and location information of the robot based on the information carried in the trapped signal, such as determining that the robot is a sweeping robot and the trapped area is the living room.

[0086] After determining the trapped area of ​​the robot according to the trapped signal, the server searches for at least one electronic device in the trapped area, wherein the electronic device is an electronic device having an image acquisition device.

[0087] For example, the electronic device can be a home surveillance camera or a home appliance with a camera, such as a smart TV, motion-sensing game console, smart refrigerator, or smart air conditioner. The electronic device can also be other robots in the home. For example, if the robot is a sweeping robot, the electronic device can also be an untrapped mopping robot or a patrol robot.

[0088] These electronic devices form an Internet of Things (IoT) through an intelligent gateway. After determining the robot's trapped area, the server sends a query request to the home IoT through a network connection with the intelligent gateway. After successfully authenticating the server's request, the home IoT sends the server a list of electronic devices with cameras in the trapped area, such as the living room.

[0089] The server determines at least one electronic device in the trapped area that can capture the trapped situation of the robot based on the received device list, and sends an escape signal to these electronic devices via the Internet.

[0090] After receiving the escape signal, the electronic device in the trapped area first authenticates the server to determine whether the server has permission to obtain image data. After successful authentication, the electronic device captures image information of the trapped area based on the escape signal, specifically capturing an image of the trapped robot.

[0091] Figure 11 shows a schematic diagram of an electronic device capturing a trapped image according to an embodiment of the present application. As shown in Figure 11, there is an electronic device 1104 in the trapped area 1100 of the robot 1102. The electronic device 1104 is provided with an image acquisition device 11042. The electronic device 1104 captures the trapped image of the robot 1102 through the image acquisition device 11042.

[0092] Exemplarily, the escape signal carries the identification information and trapped position of the robot, and the electronic device photographs the trapped position of the robot according to the escape signal, thereby acquiring an image of the robot being trapped.

[0093] After obtaining the trapped image of the robot, the obstacle information near the robot can be determined, such as the obstacle's location, shape, height, etc. This obstacle information can help the robot plan an escape route and thus help the robot perform escape actions.

[0094] Understandably, in certain scenarios, the robot may be obstructed by obstacles, such as getting stuck under a sofa. In this case, the server can determine whether the robot is included in the images captured by electronic devices within the trapped area. If at least one electronic device can capture the robot, the server can then assist the robot in its escape based on the captured image.

[0095] If the image information captured by all electronic devices in the trapped area does not include the robot, it is determined that the robot's position is blocked. At this time, the server controls the robot to standby, and controls the electronic devices in the trapped area to stop capturing images, and sends a message to the user terminal that the robot is trapped and cannot escape on its own.

[0096] An embodiment of the present application provides a collaborative escape method based on other electronic devices in the robot's working area. The electronic devices in the trapped area collect image information of the area where the robot is located, that is, the robot's trapped image. The trapped image includes images of obstacles blocking the robot's movement, which can accurately reflect the robot's trapped situation. Therefore, by controlling the robot to perform escape movement through the trapped image, the robot's escape success rate can be effectively improved.

[0097] In some embodiments of the present application, determining the trapped area of ​​the robot according to the trapped signal includes: determining the position information of the robot according to the trapped signal; obtaining the working map of the robot; and determining the trapped area within the working area of ​​the robot according to the position information and the working map.

[0098] In the embodiments of the present application, the robot's work map can be a map created by the robot's own sensors during operation, or a preset map. The work map records the area information of the robot's work area and marks each sub-area within the work area based on preset annotation information.

[0099] Taking the robot's working area as the user's home interior as an example, the working map is a complete map of the interior, in which various sub-areas such as the living room, bedroom, kitchen, etc. are marked.

[0100] When a robot is trapped, it sends a trapped signal to the server. The server determines the robot's current location, i.e., the trapped area, based on the location information carried in the trapped signal and the robot's work map.

[0101] Taking the living room as an example, after the server determines the trapped area of ​​the robot based on the work map and the location information carried in the trapped signal, it determines at least one electronic device with an image acquisition device in the trapped area, that is, the living room, and uses the electronic device to capture the trapped image of the robot, and uses the trapped image to help the robot escape.

[0102] The embodiment of the present application determines the trapped area of ​​the robot based on the robot's work map and the position information of the robot when it is trapped, and then controls the electronic equipment in the trapped area to obtain the trapped image of the robot. The robot is controlled to escape through the trapped image, which can improve the success rate of the robot's escape.

[0103] In some embodiments of the present application, determining at least one electronic device in a trapped area includes: sending a query signal to a target gateway, the target gateway being communicatively connected with multiple alternative electronic devices in the trapped area; and determining at least one electronic device from the multiple alternative electronic devices based on a device list received from the target gateway.

[0104] In an embodiment of the present application, the target gateway may be a smart gateway in the user's home. Multiple smart home appliances, surveillance cameras, robots and other electronic devices in the user's home are all connected to the smart gateway and access the Internet through the smart gateway.

[0105] When the server receives the trapped signal sent by the robot, it identifies the target gateway in the IoT environment where the robot is located based on the robot's identity information carried in the trapped signal.

[0106] After determining the target gateway, the server sends a query signal to the target gateway. This query signal carries the server's identification information and information about the trapped area. Upon receiving the query signal, the target gateway authenticates the server based on the identification information. If authentication is successful, the target gateway uses the information about the trapped area to identify multiple candidate electronic devices connected to the target gateway that are located within the trapped area.

[0107] The candidate electronic devices are all electronic devices connected to the target gateway, such as smart lamps, smart TVs, electric curtains, motion-sensing game consoles, and inspection robots. The target gateway sends the device list of the above electronic devices to the server.

[0108] After receiving the device list, the server selects at least one electronic device with an image acquisition device from the device list, uses the at least one electronic device with the image acquisition device to capture an image of the trapped robot, and uses the trapped image to help the robot escape.

[0109] In an embodiment of the present application, a target gateway in the same home scene as the robot is used to obtain a device list of alternative electronic devices in the trapped area, and then at least one electronic device equipped with an image acquisition device is determined in the device list. The trapped image captured by the electronic device is used to help the robot escape, thereby improving the success rate of the robot's escape.

[0110] In some embodiments of the present application, the step of determining the image acquisition device further includes: when the robot is equipped with an image sensor, determining the image sensor as the image acquisition device.

[0111] In an embodiment of the present application, after the server receives the trapped signal sent by the robot, the server determines whether an image sensing device is provided on the robot.

[0112] The image acquisition device may be a robot visual sensor, such as a camera, etc. The server may send a query command to the robot, and after receiving the query command, the robot returns a corresponding query result to the server, informing the server whether it is equipped with an image sensor device.

[0113] If the robot is equipped with an image sensor, the server will identify the image sensor as an image acquisition device. The server will then use the image acquisition device on the robot to capture an image of the robot in distress. Once the image is captured, the server can determine information about obstacles near the robot, such as its location, shape, and height. This information can help the robot plan an escape route and execute escape actions.

[0114] It can be understood that the image acquisition device set on the robot can be determined as the only image acquisition device, or after the image acquisition device set on the robot is determined as the image acquisition device, at least one electronic device in the trapped area of ​​the robot can be further determined, and the image acquisition device set on the electronic device can be determined as the image acquisition device for capturing the trapped image.

[0115] In some embodiments of the present application, the steps of controlling a robot to perform an escape movement according to an image include: sending an image to a target terminal; receiving a remote control signal sent by the target terminal; and sending the remote control signal to the robot so that the robot can perform an escape movement according to the remote control signal.

[0116] In the embodiment of the present application, the target terminal is specifically a terminal held by the user, such as the user's mobile phone, remote control, tablet computer, etc.

[0117] After receiving the image of the trapped robot captured by the electronic device, the server transmits the image to the target terminal. It is understood that the image can be a real-time video stream. The server can compress the video stream file to reduce network bandwidth requirements and data consumption.

[0118] After receiving the trapped image, the target terminal displays the trapped image through the home device management application. The user can understand the specific situation of the robot being trapped through the trapped image, and according to the trapped image displayed by the target terminal, by inputting remote control commands, the remote control robot moves in the direction of avoiding obstacles, thereby achieving escape.

[0119] After receiving a remote control command from a user, the target terminal generates a corresponding remote control signal based on the desired control command and sends it to the server. The server then sends the signal to the robot, which then executes the corresponding escape motion based on the signal, such as a "forward" or "backward" signal.

[0120] Exemplarily, FIG12 shows a schematic diagram of an interface of a target terminal according to an embodiment of the present application. As shown in FIG12 , a trapped image 1204 is displayed in a display interface 1202 of the target terminal 1200 .

[0121] The embodiment of the present application controls the electronic equipment in the trapped area where the robot is located to capture the trapped image of the robot, and sends the trapped image to the target terminal held by the user, so as to help the user understand the trapped situation of the robot based on the trapped image and remotely control the robot to escape, thereby effectively improving the success rate of the robot's escape.

[0122] In some embodiments of the present application, the step of controlling the robot to perform an escape movement according to the image includes: generating a corresponding escape map according to the image; determining an escape route according to the escape map; and sending the escape route to the robot so that the robot can perform the escape movement according to the escape route.

[0123] In the embodiment of the present application, the trapped image can be image data or video stream data. After the server receives the trapped image of the robot captured by the electronic device, it uses an image recognition algorithm to identify the position of the robot and the positions of obstacles near the robot in the trapped image.

[0124] Based on the identified robot position and obstacle position, the server generates an escape map near the escape robot through a mapping algorithm. The escape map records the robot's position and posture, as well as the location information of nearby obstacles.

[0125] For example, the escape map may be grid map information including obstacle information.

[0126] After the escape map is generated, an escape route for helping the robot escape is generated through a route algorithm based on the robot position and obstacle positions recorded in the escape map.

[0127] The server sends the escape route to the robot, and the robot drives its own moving mechanism, such as driving wheels to rotate, according to the movement mode indicated by the escape route, and performs the escape movement according to the escape route.

[0128] The embodiment of the present application constructs an escape map near the robot through trapped images, and calculates an escape route suitable for the robot based on the escape map, which can effectively improve the success rate of the robot's escape.

[0129] In some embodiments of the present application, an image acquisition device is provided on the robot, and the image includes at least chassis environment information of the robot, and the chassis environment information is the image information under the chassis. The robot is controlled to perform an escape movement according to the image, including: determining the environmental information of the robot according to the chassis environment information; determining the stuck information of the robot according to the environmental information; and controlling the robot to perform corresponding escape operations according to the stuck information.

[0130] The robot control method provided in the present application can control the robot to perform corresponding escape actions based on the robot's chassis panoramic view when the robot is trapped during work, so as to achieve flexible escape of the robot.

[0131] Wherein, the robot is equipped with an image acquisition device.

[0132] Furthermore, in actual application, the robot may be provided with at least one first sensor, which may specifically be a motion sensor, and the first sensor is used to collect first sensing data, namely, the motion data of the robot.

[0133] In actual application, the above-mentioned first sensor may specifically include an odometer, a speed sensor, a SLAM (Simultaneous Localization and Mapping) device, and an IMU (Inertial Measurement Unit) device, etc., and no specific restrictions are made here.

[0134] Furthermore, the above-mentioned robots may specifically be cleaning robots, navigation robots, child companion robots, question-answering robots, and other intelligent robots with autonomous movement capabilities, and no specific restrictions are made here.

[0135] For example, in the robot control method provided in the present application, during the working process of the robot, the robot control device makes a real-time judgment on the motion state of the robot based on the first sensor data of at least one first sensor installed on the robot and / or the image captured by the image acquisition device to determine whether the robot is currently in a free moving state or a stuck state. Furthermore, during the working process of the robot, the robot control device will also control the image acquisition device installed on the robot to take a real-time picture of the robot's working environment. On this basis, when the robot control device determines that the robot's current movement is trapped, that is, when the robot is currently in a stuck state, the robot control device obtains the image captured by the image acquisition device installed on the robot, and the image includes at least the chassis environment information of the robot, and the chassis environment information is the image information under the chassis. Furthermore, the robot control device restores the current chassis working environment of the robot based on the acquired image, that is, simulates the image information under the robot chassis to determine the current working environment information of the robot.

[0136] On this basis, the robot control device analyzes and identifies the characteristics of the robot's current working environment based on the robot's current working environment information to determine the robot's specific stuck situation, such as determining the robot's stuck cause, stuck type, and stuck direction, thereby analyzing and obtaining the robot's stuck information. Based on this, the robot control device then controls the robot to perform corresponding escape actions based on the robot's actual stuck situation, thereby controlling the robot to flexibly escape. In this way, during the robot's operation, the robot's motion state is analyzed based on the robot's first sensor data and / or chassis environment information. When the robot is stuck, the robot's chassis environment is analyzed based on the robot's chassis environment information. Furthermore, combined with the robot's chassis environment characteristics, the robot's specific stuck situation is analyzed, and based on the robot's actual stuck situation, the robot is controlled to perform corresponding escape actions to escape. In this way, combined with the robot's chassis panorama, the robot is controlled to escape, which improves the flexibility of the robot's escape actions, thereby improving the robot's escape efficiency and success rate, and ensuring the reliability of the robot's operation.

[0137] The robot includes a main body and a chassis, and the image acquisition device may specifically include a first camera, which is installed in front of the main body of the robot. The front of the main body of the robot is used to indicate the main walking direction of the robot, that is, the forward direction of the robot.

[0138] On this basis, in the process of the robot control device restoring the chassis working environment of the robot according to the chassis environment information of the robot, for example, the robot control device obtains the historical environment image captured by the first camera in front of the robot's main body during the movement, and analyzes and processes the historical environment images captured by the robot at multiple time points during the historical movement. For example, the robot control device analyzes and processes the environment image of a certain period of time before the robot is stuck, thereby simulating and restoring the panoramic image of the robot when the robot is stuck, and the panoramic image includes the chassis image of the robot, thereby obtaining the working environment information of the robot.

[0139] In addition, the robot control device can also obtain the current environment image captured by the first camera when the robot is trapped, and then integrate and process the environmental data of the working environment in which the robot is located when it is trapped through the current environment image, and match and compare the integrated and processed environment data with the historical environment images collected before the robot was trapped, so as to simulate and restore the chassis image of the robot when it was trapped, so as to further ensure the authenticity and credibility of the chassis image.

[0140] Furthermore, in actual applications, the robot may also be equipped with at least one second sensor, which may be a ranging sensor, for collecting second sensor data, i.e., the robot's ranging data. In actual applications, the first sensor may include a laser sensor, a radar sensor, or the like, without limitation.

[0141] On this basis, when the robot control device restores the robot's chassis working environment based on the chassis environmental information collected by the image acquisition device, it can also use the second sensor data collected by the second sensor to simulate and restore the chassis image of the robot when it is trapped. For example, the robot control device obtains the second sensor data collected by the second sensor when the robot is trapped, and analyzes and processes the chassis environmental characteristics of the robot when it is trapped based on the second sensor data. Then, combining the analyzed chassis environmental characteristics with the robot's chassis environmental information, it simulates and restores the chassis image of the robot when it is stuck, thereby obtaining more realistic and reliable working environment information.

[0142] Furthermore, in actual applications, the image acquisition device may further include a second camera, which may be positioned below the robot chassis to capture a panoramic view of the area below the robot chassis. The second camera may also be positioned at the edge of the robot chassis to simultaneously capture the environment below the robot chassis and the robot's surroundings.

[0143] On this basis, when the robot is in a trapped state, when the image acquisition device only includes the second camera, the robot control device can specifically obtain the chassis environment information of the second camera on the robot chassis, and determine the chassis image of the robot when it is trapped based on the obtained chassis environment information; or, when the image acquisition device includes the first camera and the second camera, the robot control device can simultaneously obtain the chassis environment information of the first camera and the second camera, and then combine the chassis environment information of the two cameras to restore the chassis panoramic image and the surrounding panoramic image when the robot is trapped, thereby obtaining the robot's environmental information; or, when the robot includes the second camera and the second sensor, the robot control device can simultaneously obtain the chassis environment information of the second camera and the second sensor data of the second sensor, and then determine the robot's panoramic image when the robot is trapped by jointly analyzing the chassis environment information and the second sensor data; or, when the robot includes the first camera, the second camera and the second sensor at the same time, the robot control device can simultaneously obtain the chassis environment information of the first camera and the second camera, and obtain the second sensor data of the second sensor, and then determine the robot's panoramic image when the robot is trapped by jointly analyzing the chassis environment information and the second sensor data of the two cameras.

[0144] In actual application, the specific basis for the robot control device to simulate and restore the robot chassis image can be set by those skilled in the art according to the specific structure of the robot, and no specific limitation is made here.

[0145] In addition, in actual applications, the number of the second camera can be one or more. Specifically, if there is only one second camera, the second camera can be a panoramic camera to achieve 360° coverage of the robot chassis and surrounding environment. Furthermore, if there are multiple second cameras, the multiple second cameras can be evenly distributed around the robot chassis to achieve panoramic coverage of the robot chassis and surrounding environment.

[0146] In actual application, those skilled in the art may set the type, installation location, and number of the second camera according to actual conditions, and no specific restrictions are imposed herein.

[0147] In some embodiments of the present application, the robot includes at least one first sensor, and the at least one first sensor is used to collect first sensor data. On this basis, the above-mentioned robot control method may further specifically include: determining the position information and running speed of the robot based on the image and / or the first sensor data; when the position information remains unchanged and the running speed is greater than zero, it is determined that the robot is in a stuck state.

[0148] In this embodiment, the robot may be further provided with at least one first sensor, which may specifically be a motion sensor, and the first sensor is used to collect first sensing data, namely, motion data of the robot.

[0149] On this basis, before the robot control device restores the robot's current chassis working environment based on the acquired chassis environment information to obtain the robot's current working environment information, the robot control device will also make a real-time judgment on the robot's motion state based on the first sensor data of at least one first sensor installed on the robot and / or the chassis environment information collected by the image acquisition device to determine whether the robot is currently in a free movement state or a stuck state.

[0150] During the robot's operation, the robot control device acquires in real time first sensor data from at least one first sensor mounted on the robot and / or chassis environment information captured by an image acquisition device. Based on the acquired first sensor data and / or chassis environment information, the robot control device determines the robot's actual position information and operating speed. Based on this, the robot control device analyzes the robot's actual position information and operating speed to make a real-time judgment on the robot's motion state. For example, if the robot's position information remains unchanged but its operating speed is non-zero, the robot control device determines that the robot's current movement is trapped, i.e., it is currently in a stuck state. If the robot's operating speed is non-zero and its position information changes, the robot control device determines that the robot's current movement is free, i.e., it is currently in a free-moving state. In this way, by combining the robot's actual position information and operating speed to make a real-time judgment on the robot's motion state, it is possible to promptly determine that the robot is in a stuck state when its movement is trapped, thereby controlling the robot to perform an escape action, improving the robot's escape efficiency and ensuring the reliability of the robot's operation.

[0151] The first sensor may include an odometer, a speed sensor, a SLAM device, an IMU device, and the like.

[0152] On this basis, when the robot control device determines the robot's operating speed based on the acquired first sensor data, the robot control device may specifically determine the robot's actual operating speed using measurement information fed back by the odometer, speed sensor, or IMU device. For example, if the speed value fed back by the odometer or speed sensor is non-zero, the robot control device determines that the robot's operating speed is non-zero; or, if the angular velocity fed back by the IMU device is non-zero, the robot control device determines that the robot's wheels are rotating, thereby determining that the robot's actual operating speed is non-zero.

[0153] Furthermore, in the process of the robot control device determining the robot's position change information based on the acquired first sensor data, the robot control device may specifically determine the robot's position change information through measurement information fed back by the odometer or the SLAM device. For example, if the mileage fed back by the odometer remains unchanged, or if the coordinate values ​​fed back by the SLAM device do not change, the robot control device determines that the robot's position information has not changed; and if the mileage fed back by the odometer changes, or if the coordinate values ​​fed back by the SLAM device change, the robot control device determines that the robot's position information has changed.

[0154] Furthermore, in the process of the robot control device determining the robot's running speed based on the acquired chassis environment information, the robot control device can specifically obtain the environmental images captured by the robot at different time points in real time, and then determine the robot's driving distance through the acquired environmental images, and then determine the robot's running speed in combination with the shooting time of the environmental images.

[0155] Furthermore, when the robot control device determines the robot's position change information based on the acquired chassis environment information, the robot control device may specifically obtain real-time images of the environment captured by the robot at different time points, and then determine the difference between the different frames of the environment image by analyzing and comparing the environment images at different time points. If the difference is less than or equal to a set threshold, the robot control device determines that the robot's position information has not changed; if the difference is greater than the set threshold, the robot control device determines that the robot's position information has changed.

[0156] In some embodiments of the present application, the above-mentioned step of determining the environmental information of the robot based on the chassis environmental information may specifically include: when the robot is in a stuck state, obtaining the first chassis environmental information of the robot in a first time period; determining the environmental information of the robot based on the first chassis environmental information; wherein, the first time period is before the robot is in the stuck state.

[0157] In this embodiment, during the robot's operation, the robot control device controls an image acquisition device mounted on the robot to capture images of the robot's working environment in real time. Based on this, if the robot control device determines that the robot's current movement is stuck, i.e., that the robot is currently in a stuck state, the robot control device acquires images captured by the image acquisition device for a period of time before the robot became stuck, i.e., acquires first chassis environment information captured by the image acquisition device during a first period of time. Furthermore, the robot control device analyzes and processes the acquired first chassis environment information to simulate the image below the robot's chassis at the time of the robot's stuck state based on images captured at multiple time points during the robot's historical movement, thereby reconstructing the robot's chassis working environment and obtaining information about the robot's working environment at the time of the stuck state. In this way, by reconstructing the robot's working scene at the time of the stuck state based on historical images captured before the robot became stuck, the robot's working environment information at the time of the stuck state is obtained, ensuring the accuracy and authenticity of the working environment information, thereby ensuring the accuracy of subsequent control of the robot's escape action, improving the robot's escape efficiency and success rate, and ensuring the reliability of the robot's operation.

[0158] In some embodiments of the present application, the robot also includes at least one second sensor, and the at least one second sensor is used to collect second sensor data. On this basis, the above-mentioned steps of determining the robot's environmental information based on the chassis environment information may specifically include: when the robot is in a stuck state, obtaining the robot's first chassis environment information in a first time period; obtaining the robot's second sensor data and / or second chassis environment information; determining the robot's environmental information based on the first chassis environment information, the second sensor data and / or the second chassis environment information.

[0159] In this embodiment, the robot may also be equipped with at least one second sensor, which may specifically be a ranging sensor, for collecting second sensor data, namely, ranging data of the robot. In actual applications, the first sensor may specifically include a laser sensor and / or a radar sensor, without specific limitation. Based on this, the sensor data may specifically include laser sensor data and / or radar sensor data.

[0160] Furthermore, during the working process of the robot, the robot control device will control the image acquisition device installed on the robot to take real-time pictures of the robot's working environment.

[0161] On this basis, if the robot control device determines that the robot's current movement is stuck, that is, that the robot is currently in a stuck state, the robot control device will also obtain images captured by the image acquisition device within a period of time before the robot became stuck, that is, obtain the first chassis environment information collected by the image acquisition device during the first period of time. At the same time, the robot control device will also obtain second sensor data from at least one second sensor and / or second chassis environment information collected by the image acquisition device when the robot became stuck.

[0162] Furthermore, the robot control device analyzes and processes the acquired second sensor data and / or second chassis environment information to integrate and process the environmental data of the robot's working environment when it was trapped, and matches and compares the integrated and processed environmental data with the first chassis environment information collected before the robot was trapped, thereby restoring the chassis working environment and surrounding working environment when the robot was trapped, and obtaining the working environment information when the robot was trapped. In this way, based on the images captured before the robot was trapped and the images captured when the robot was trapped and / or the second sensor data surface, the working scene of the robot when it was trapped is restored, thereby obtaining the working environment information when the robot was trapped, ensuring the accuracy and authenticity of the working environment information, thereby ensuring the accuracy of the subsequent control of the robot to perform escape actions, improving the robot's escape efficiency and success rate, and ensuring the reliability of the robot's operation.

[0163] Among them, the above-mentioned first time period can specifically be a time period of 5 seconds, 10 seconds, 15 seconds, 20 seconds and 30 seconds before the robot is trapped. For the specific time range of the above-mentioned first time period, technical personnel in this field can set it according to actual conditions and no specific limitation is made here.

[0164] Furthermore, in the process of analyzing and processing the acquired second sensor data and / or second chassis environmental information to integrate and process the environmental data of the working environment in which the robot is trapped, the robot control device, illustratively, determines the object information and object distribution below and around the chassis of the robot when it is trapped based on the second sensor data and / or second chassis environmental information. For example, the robot control device determines the position information, size information, height information, contour information, and spacing information of the objects below and around the robot chassis. In addition, the robot control device also determines the contact information between the robot chassis and the objects below, and the contact information between the robot body and the surrounding objects, to determine whether the robot is currently in contact with the wall, or whether the robot is currently in a narrow area. In this way, by processing and analyzing the second sensor data and / or second chassis environmental information when the robot is trapped, the working scene of the robot when it is trapped can be basically restored.

[0165] On this basis, by matching and comparing the integrated environmental data with the first chassis environmental information before the robot was trapped, the integrated environmental data can be supplemented and expanded to further increase the regional scope and authenticity of the restoration of the working scene when the robot was trapped, thereby obtaining enough environmental information to ensure the accuracy of the robot's trapped information, and then ensure the accuracy of the subsequent robot's escape action.

[0166] In some embodiments of the present application, the above-mentioned step of determining the stuck information of the robot based on the environmental information may specifically include: determining the obstacle information that trapped the robot based on the environmental information; and determining the stuck information based on the obstacle information.

[0167] In this embodiment, in the process of the robot control device determining the specific stuck information of the robot based on the environmental information when the robot is trapped, illustratively, the robot control device analyzes and processes the peripheral environmental information and chassis environmental information when the robot is trapped to determine the obstacles that hinder the robot's movement and related information, and then determines the specific stuck situation of the robot based on the determined obstacles and related information, so as to analyze the reasons for the robot's stuck, the type of stuck, etc., and thus determine the robot's stuck information. In this way, based on the peripheral environment when the robot is trapped and the panoramic view of the chassis, the obstacle situation when the robot is trapped is determined, and then the actual stuck information of the robot is determined, thereby ensuring the accuracy and authenticity of the determination of the stuck information, thereby ensuring the accuracy of the subsequent control of the robot to perform the escape action, and improving the flexibility and success rate of the robot's escape.

[0168] Among them, in the process of the robot control device determining the information of obstacles that hinder the movement of the robot, the robot control device analyzes and processes the object information and object distribution under and around the chassis of the robot when it is trapped. For example, the robot control device analyzes and processes the position information, size information, height information, contour information and spacing information of objects under and around the robot chassis. Furthermore, the robot control device also analyzes and processes the contact information between the robot chassis and the objects below, and the contact information between the robot body and the surrounding objects. By comprehensively analyzing and processing the above information, the robot control device can determine the obstacles that hinder the movement of the robot and related information, and can also determine whether the current robot is in contact with the wall, and whether the robot is currently in a narrow area. In this way, it is convenient to conduct a comprehensive and accurate analysis of the actual stuck situation of the robot, and further improve the accuracy and authenticity of the determination of the stuck information.

[0169] In some embodiments of the present application, the above-mentioned step of determining the stuck information based on the obstacle information may specifically include: determining the robot's movable direction and / or movable distance, trapped position and / or trapped direction based on the obstacle information.

[0170] In this embodiment, when the robot control device determines the actual stuck state of the robot based on information about obstacles impeding the robot's movement, the robot control device illustratively analyzes the obstacle information to determine the robot's stuck position and / or stuck direction, as well as the robot's current movable direction and / or movable distance. This ensures the accuracy of the determination of the robot's specific stuck state, thereby ensuring the accuracy and flexibility of the subsequent control of the robot's escape action.

[0171] Furthermore, the movable direction is the robot's movable direction, and the movable distance may specifically include the robot's movable distance in each movable direction. This allows the robot's current movable area to be determined, further ensuring the accuracy of determining the robot's specific stuck situation and the accuracy and flexibility of subsequent control of the robot's escape maneuvers.

[0172] The obstacle information may include the obstacle's location, size, height, outline, distance between the obstacle and other objects, and contact information between the obstacle and the robot. The robot control device may analyze and process the obstacle information to determine the robot's trapped position, trapped direction, movable direction, movable distance, and other trapped information.

[0173] For example, the robot control device may determine the trapped direction and / or trapped position of the robot based on the position information of the obstacle. For example, if there is an obstacle in front of the robot, it is determined that the robot is trapped in its forward movement.

[0174] Furthermore, the robot control device can determine the robot's traversable direction based on the obstacle's position information, size information, height information, and outline information. For example, if there is an obstacle in front of the robot and the obstacle is determined to be a wall based on its size information, height information, and outline information, the robot control device determines that the robot cannot traverse the direction in front of it. Alternatively, if there is an obstacle in front of the robot and the obstacle is relatively low in height, the robot control device determines that the robot can traverse the direction in front of it.

[0175] Furthermore, the robot control device may determine the movable distance of the robot based on the size information and contour information of the obstacle, the distance information between the obstacle and other objects, the contact information between the obstacle and the robot, etc.

[0176] In actual application, the robot control device can also determine the robot's trapped position, trapped direction, movable direction, movable distance and other trapped information by comprehensively analyzing the above-mentioned obstacle information. The specific basis for determining the robot's trapped direction, movable direction and movable distance can be set by technical personnel in this field according to actual conditions, and no specific restrictions are made here.

[0177] In addition, in actual application, the robot control device can also assist in determining the running speed of the robot when performing an escape action based on the height information of the obstacle, so that the robot can successfully escape the obstacle when it overcomes the obstacle at the determined running speed.

[0178] In some embodiments of the present application, the above-mentioned step of controlling the robot to perform corresponding escape operations according to the stuck information may specifically include: determining the movement information of the robot according to the stuck information; and controlling the robot to move according to the movement information.

[0179] In this embodiment, in the process of the robot control device controlling the robot to perform corresponding escape operations to escape based on the specific stuck information when the robot is trapped, illustratively, the robot control device analyzes the specific stuck information of the robot to determine the movement information of the robot when escaping. Exemplarily, the robot control device determines the moving direction and moving distance of the robot when escaping based on the specific stuck information of the robot. On this basis, the robot control device controls the robot to move in accordance with the above-mentioned moving direction and moving distance, thereby achieving escape. In this way, based on the specific stuck information such as the trapped position and / or trapped direction, movable direction and / or movable distance when the robot is trapped, the robot's escape action is planned, which improves the flexibility and success rate of the robot's escape, thereby ensuring the reliability of the robot's work.

[0180] Among them, the above-mentioned moving direction is related to the trapped position of the robot, and / or the above-mentioned moving direction is related to the trapped direction of the robot, and the above-mentioned moving distance is related to the movable direction of the robot, and / or the above-mentioned moving distance is related to the movable distance of the robot.

[0181] Furthermore, depending on the direction in which the robot is stuck, the robot's stuck types can include forward stuck, backward stuck, left turn stuck, and right turn stuck. Based on this, when the robot control device controls the robot to perform an escape action, the robot's escape action can be adjusted accordingly based on information such as the robot's stuck direction, stuck type, and movable distance.

[0182] Furthermore, the robot control device can also set and adjust the running speed of the robot when it performs an escape action based on the height information of the obstacle that traps the robot, so that the robot can successfully escape when it overcomes the obstacle and escapes at the determined running speed.

[0183] For example, if the robot is stuck while moving forward or backward, the robot control device may control the robot to perform a dual-wheel obstacle traversal and / or alternately use its left and right wheels to traverse the obstacle. Specifically, when the robot is traversing a dual-wheel obstacle, the robot control device may first control the robot to retreat a first distance in the direction opposite to the direction of the obstacle, then increase the robot's operating speed to a first speed, and then control the robot to accelerate and travel a second distance in the direction of the obstacle.

[0184] When the robot's left and right wheels alternately traverse obstacles, the robot control device can first control the robot's right wheel to remain stationary and control the robot's left wheel to rotate by a first angle in the opposite direction of the obstacle. This then increases the robot's operating speed to a second speed and controls the robot's left wheel to accelerate toward the obstacle. The robot control device then controls the robot's left wheel to remain stationary and controls the right wheel to rotate by a first angle in the opposite direction of the obstacle. It then controls the right wheel to accelerate toward the obstacle. This cycle repeats, allowing the robot's left and right wheels to alternate, thereby achieving alternating obstacle traversal.

[0185] Furthermore, when the robot is stuck while turning left or right, the robot control device can first control the robot to rotate a second angle in the opposite direction of the trapped direction, and then increase the robot's running speed to a third speed, and control the robot to speed up and rotate in the trapped direction.

[0186] Among them, the above-mentioned first distance, second distance, first angle, second angle, first speed, second speed and third speed can be specific set fixed values. In actual application, the values ​​of the above parameters can also be set according to the actual stuck situation of the robot. No specific restrictions are made here.

[0187] In addition, in actual application, a mapping table between escape actions and jam types can be established. After the robot control device determines the jam type of the robot according to the specific jam situation of the robot, the corresponding escape action can be found through the mapping table, and the robot can be controlled to escape according to the escape action.

[0188] Furthermore, the robot control device can also judge the robot's escape result to determine whether the robot has escaped successfully. For example, in the case that the robot is stuck forward or backward, if the robot's travel distance is greater than the retreat distance, and the robot's pitch angle undergoes a change process from a positive value to a negative value, then the robot is judged to have escaped successfully. Among them, when the robot's pitch angle is a positive value, it means that the machine is in an upward tilt state when overcoming obstacles. When the robot's pitch angle is a negative value, it means that the robot has tilted down after crossing the obstacle until the robot moves to the flat ground and resumes its horizontal state. In the case that the robot is stuck when turning left or turning right, if the angle value of the robot's rotation in the direction of being trapped is greater than a first threshold value, the robot's pitch angle and roll angle are less than a second threshold value, and the robot's wheel speed is within the target range, then the robot is judged to have escaped successfully.

[0189] The specific values ​​of the first threshold, the second threshold, and the target range can be set according to actual conditions. Furthermore, the basis for determining whether the robot has successfully escaped a trap can be adjusted by those skilled in the art according to actual conditions and is not specifically limited here.

[0190] In one embodiment of the present application, another robot control method is provided. The method is applied to a robot, as shown in FIG2 , and includes:

[0191] Step 202: When the robot is detected to be in a trapped state, a trapped signal is sent to the server;

[0192] Step 204: receiving a remote control signal sent by the target terminal;

[0193] Step 206, executing an escape motion according to the remote control signal;

[0194] Among them, the remote control signal is a signal generated by the target terminal based on the received remote control input when displaying the trapped image, the trapped image is an image captured by the image acquisition device, the field of view of the image acquisition device at least partially covers the robot or the image acquisition device is set on the robot.

[0195] In the embodiments of the present application, the robot may be a robot capable of moving around the home, such as a sweeping robot, a mopping robot, or a patrol robot. When the robot is performing a task, an obstacle may block its path. In this case, the robot will first try to cross the obstacle or adjust its direction to bypass the obstacle.

[0196] If the robot fails to cross or bypass an obstacle after multiple attempts, the robot determines that it has entered a trapped state and sends a trapped signal to the server.

[0197] The server can be a cloud server, a robot base station, or a device such as an intelligent gateway that establishes a wireless network connection with the robot.

[0198] After the server receives the trapped signal sent by the robot, the server determines an image acquisition device, which may be an image acquisition device in the area where the robot is located, or an image acquisition device set on the robot.

[0199] The server obtains the image captured by the image acquisition device, which can reflect the robot's trapped situation. Therefore, the server controls the robot to escape according to the image captured by the image acquisition device, so that the robot can perform targeted escape movements according to the trapped situation, specifically the location of the obstacle, the trapped part, etc.

[0200] Exemplarily, the server determines the identity and location information of the robot based on the information carried in the trapped signal, such as determining that the robot is a sweeping robot and the trapped area is the living room.

[0201] After determining the trapped area of ​​the robot based on the trapped signal, the server searches for at least one electronic device in the trapped area, wherein the electronic device is an electronic device with an image acquisition device. The server sends an escape signal to the electronic device with the image acquisition device. The escape signal carries the robot's identification information and trapped position. The electronic device photographs the robot's trapped position based on the escape signal, thereby capturing a trapped image of the robot.

[0202] Exemplarily, the image acquisition device is an image acquisition device provided on the robot, and the image acquisition device on the robot captures the trapped condition of the robot from a first perspective, and the trapped state of the robot is determined based on the trapped image from the first perspective.

[0203] After receiving the trapped image, the server sends the trapped image to the target terminal, where the target terminal is specifically a terminal held by the user, such as the user's mobile phone, remote control, tablet computer, etc.

[0204] After receiving the trapped image, the target terminal displays the trapped image through the home device management application. The user can understand the specific situation of the robot being trapped through the trapped image, and according to the trapped image displayed by the target terminal, the user can input remote control commands to remotely control the robot to move in the direction of avoiding obstacles.

[0205] After receiving the remote control command input by the user, the target terminal generates a corresponding remote control signal based on the control command and sends the remote control signal to the server. After receiving the remote control signal, the server sends the remote control signal to the robot. The robot performs the corresponding escape movement based on the remote control signal, such as the "forward" signal or the "backward" signal.

[0206] The embodiment of the present application helps the user understand the robot's trapped situation based on the trapped image and remotely control the robot to escape from the trap, effectively improving the success rate of the robot's escape from the trap, by sending the trapped image to the target terminal held by the user.

[0207] In some embodiments of the present application, after sending a trapped signal to the server, the robot control method further includes: receiving an escape route sent by the server; executing an escape movement according to the escape route; wherein the escape route is a route determined by the server based on the trapped image.

[0208] In this embodiment, after receiving the trapped image of the robot taken by the electronic device, the server uses an image recognition algorithm to identify the position of the robot and the positions of obstacles near the robot in the trapped image.

[0209] Based on the identified robot position and obstacle locations, the server generates an escape map of the robot's vicinity using a mapping algorithm. This escape map records the robot's position and posture, as well as the location information of nearby obstacles. In some embodiments, the escape map can be generated by updating the robot's work map based on the robot's position and posture, as well as the location information of nearby obstacles.

[0210] For example, the escape map may be grid map information including obstacle information.

[0211] After the escape map is generated, an escape route for helping the robot escape is generated through a route algorithm based on the robot position and obstacle positions recorded in the escape map.

[0212] The server sends the escape route to the robot, and the robot drives its own moving mechanism, such as driving wheels to rotate, according to the movement mode indicated by the escape route, and performs the escape movement according to the escape route.

[0213] The embodiment of the present application constructs an escape map near the robot through trapped images obtained by electronic devices in the trapped area, and calculates an escape route suitable for the robot based on the escape map, which can effectively improve the success rate of the robot's escape.

[0214] In one embodiment of the present application, another robot control method is provided. The method is applied to a terminal. As shown in FIG3 , the robot control method includes:

[0215] Step 302, receiving the trapped image sent by the server;

[0216] Step 304, displaying the trapped image and receiving remote control input;

[0217] Step 306, in response to the remote control input, determining a remote control signal;

[0218] Step 308, sending the remote control signal to the server, so that the server can send the remote control signal to the robot, so that the robot can perform the escape movement according to the remote control signal;

[0219] The trapped image is an image captured by an image acquisition device, the field of view of the image acquisition device at least partially covers the robot or the image acquisition device is set on the robot.

[0220] In the embodiments of the present application, the robot may be a robot capable of moving around the home, such as a sweeping robot, a mopping robot, or a patrol robot. When the robot is performing a task, an obstacle may block its path. In this case, the robot will first try to cross the obstacle or adjust its direction to bypass the obstacle.

[0221] If the robot fails to cross or circumvent an obstacle after multiple attempts, it determines that it is trapped and sends a trapped signal to the server. Upon receiving the trapped signal, the server determines an image acquisition device, which can be an image acquisition device in the area where the robot is located or an image acquisition device installed on the robot itself.

[0222] The server obtains the image captured by the image acquisition device, which can reflect the robot's trapped situation. Therefore, the server controls the robot to escape according to the image captured by the image acquisition device, so that the robot can perform targeted escape movements according to the trapped situation, specifically the location of the obstacle, the trapped part, etc.

[0223] Exemplarily, the server determines the identity and location information of the robot based on the information carried in the trapped signal, such as determining that the robot is a sweeping robot and the trapped area is the living room.

[0224] At least one electronic device is located within the trapped area. The electronic device can be a home surveillance camera or a home appliance with a camera, such as a smart TV, motion-sensing game console, smart refrigerator, or smart air conditioner. The electronic device can also be another robot in the home. For example, if the robot is a sweeping robot, the electronic device can also be a mopping robot or patrol robot that is not trapped.

[0225] The electronic device photographs the trapped position of the robot according to the escape signal, thereby collecting the trapped image of the robot and sending the trapped image to the server.

[0226] Exemplarily, the image acquisition device is an image acquisition device provided on the robot, and the image acquisition device on the robot captures the trapped condition of the robot from a first perspective, and the trapped state of the robot is determined based on the trapped image from the first perspective.

[0227] After receiving the trapped image, the terminal displays it through the home device management application. The user can use the trapped image to understand the specific situation of the robot's trapped state. Based on the trapped image displayed by the terminal, the user can input remote control commands to remotely control the robot to move in a direction to avoid obstacles, thereby achieving escape. After the server receives the trapped image of the robot captured by the electronic device, it sends the trapped image to the terminal. It is understood that the trapped image can be a real-time video stream. The server can compress the video stream file to reduce the demand for network bandwidth and reduce data consumption.

[0228] After receiving a remote control command from the user, the terminal generates a corresponding remote control signal based on the desired control command and sends the remote control signal to the server. The server then sends the remote control signal to the robot, which then executes the corresponding escape movement based on the remote control signal, such as a "forward" or "backward" signal.

[0229] The embodiment of the present application helps the user understand the robot's trapped situation based on the trapped image and remotely control the robot to escape from the trap, effectively improving the success rate of the robot's escape from the trap, by sending the trapped image to the terminal held by the user.

[0230] In one embodiment of the present application, a robot control device is provided. As shown in FIG4 , the robot control device 400 includes:

[0231] An acquisition module 402 is used to acquire a trapped signal of the robot;

[0232] A determination module 404 is configured to determine an image acquisition device, wherein the field of view of the image acquisition device at least partially covers the robot or the image acquisition device is disposed on the robot;

[0233] The acquisition module 402 is further used to acquire images from the image acquisition device;

[0234] The control module 406 is used to control the robot to perform escape motion according to the image.

[0235] In the embodiments of the present application, the robot may be a robot capable of moving around the home, such as a sweeping robot, a mopping robot, or a patrol robot. When the robot is performing a task, an obstacle may block its path. In this case, the robot will first try to cross the obstacle or adjust its direction to bypass the obstacle.

[0236] If the robot fails to cross or bypass an obstacle after multiple attempts, the robot determines that it has entered a trapped state and sends a trapped signal to the server.

[0237] Exemplarily, the trapped signal carries information such as the trapped state, location information, and identification information of the first robot.

[0238] The server can be a cloud server, a robot base station, or a device such as an intelligent gateway that establishes a wireless network connection with the robot.

[0239] After receiving the trapped signal of the robot, the server determines an image acquisition device, which may be an image acquisition device in the area where the robot is located, or an image acquisition device provided on the robot.

[0240] The server obtains the image captured by the image acquisition device, which can reflect the robot's trapped situation. Therefore, the server controls the robot to escape according to the image captured by the image acquisition device, so that the robot can perform targeted escape movements according to the trapped situation, specifically the location of the obstacle, the trapped part, etc.

[0241] Exemplarily, the image acquisition device is an image acquisition device in the area where the robot is located. The image acquisition device in the area where the robot is located is used to capture the trapped image of the robot from a third perspective. The trapped condition of the robot is determined using the trapped image from the third perspective, and the robot is controlled to perform an escape movement.

[0242] Exemplarily, the image acquisition device is an image acquisition device provided on the robot, which captures the trapped state of the robot from a first perspective through the image acquisition device on the robot, determines the trapped state of the robot based on the trapped image from the first perspective, and controls the robot to perform escape movements.

[0243] The embodiment of the present application can effectively improve the efficiency of the robot's escape by obtaining an image of the robot being trapped through an image acquisition device when the robot is trapped, and controlling the robot to escape based on the trapped image.

[0244] In some embodiments of the present application, the determination module 404 is specifically used to: determine the trapped area of ​​the robot based on the trapped signal; determine at least one electronic device in the trapped area, wherein at least one electronic device is provided with an image acquisition device; the control module 406 is specifically used to: control the electronic device to acquire the trapped image corresponding to the robot through the image acquisition device.

[0245] In some embodiments of the present application, the determination module 404 is specifically used to: determine the position information of the robot based on the trapped signal; the acquisition module 402 is also used to: obtain the working map of the robot; the determination module 404 is also used to: determine the trapped area within the working area of ​​the robot based on the position information and the working map.

[0246] In some embodiments of the present application, the robot control device 400 also includes: a sending module 408, which is used to send a query signal to the target gateway, and the target gateway is communicatively connected with multiple alternative electronic devices in the trapped area; the determination module 404 is specifically used to: determine at least one electronic device from multiple alternative electronic devices based on the device list received from the target gateway.

[0247] In some embodiments of the present application, the determination module 404 is specifically configured to: when the robot is equipped with an image sensor, determine the image sensor as the image acquisition device.

[0248] In some embodiments of the present application, the sending module 408 is also used to: send the image to the target terminal; the robot control device 400 also includes: a receiving module 410, for receiving the remote control signal sent by the target terminal; the sending module 408 is also used to: send the remote control signal to the robot, so that the robot can perform escape movement according to the remote control signal.

[0249] In some embodiments of the present application, the robot control device 400 also includes: a generation module 412, which is used to generate a corresponding escape map based on the image; the determination module 404 is also used to: determine the escape route based on the escape map; the sending module 408 is also used to: send the escape route to the robot, so that the robot can perform escape movements according to the escape route.

[0250] In some embodiments of the present application, the image acquisition device is provided on the robot, and the image includes at least the chassis environment information of the robot, and the chassis environment information is the image information under the chassis. The determination module 404 is also used to: determine the environment information of the robot based on the chassis environment information; determine the robot's jamming information based on the environment information; the control module 406 is specifically used to: control the robot to perform corresponding escape operations based on the jamming information.

[0251] In some embodiments of the present application, the robot includes at least one first sensor, which is used to collect first sensor data. The determination module 404 is specifically used to: determine the position information and running speed of the robot based on the first sensor data and / or image; when the position information remains unchanged and the running speed is greater than zero, determine that the robot is in a stuck state.

[0252] In some embodiments of the present application, the acquisition module 402 is also used to: obtain the first chassis environment information of the robot in a first time period, and the first time period is before the robot is in a stuck state; the determination module 404 is specifically used to: determine the environmental information of the robot based on the first chassis environment information.

[0253] In some embodiments of the present application, the robot includes at least one second sensor, and the at least one second sensor is used to collect second sensor data. The acquisition module 402 is also used to: obtain the first chassis environment information of the robot in a first time period, and the first time period is before the robot is in a stuck state; obtain the second chassis environment information and / or second sensor data when the robot is in a stuck state; the determination module 404 is specifically used to: determine the environment information of the robot based on the first chassis environment information, the second chassis environment information and / or the second sensor data; wherein the second sensor data includes at least one of laser sensor data and radar sensor data.

[0254] In some embodiments of the present application, the determination module 404 is specifically used to: determine obstacle information that traps the robot based on environmental information; and determine jamming information based on the obstacle information.

[0255] In some embodiments of the present application, the determination module 404 is specifically configured to determine the trapped position and / or trapped direction, movable direction and / or movable distance of the robot according to the obstacle information.

[0256] In some embodiments of the present application, the determination module 404 is specifically used to: determine the movement information of the robot based on the trapped information; the control module 406 is specifically used to: control the robot to move according to the movement information, wherein the movement information includes the moving direction and the moving distance, the moving direction is associated with the trapped direction, and / or the moving direction is associated with the movable direction, the moving distance is associated with the trapped position, and / or the moving distance is associated with the movable distance.

[0257] In one embodiment of the present application, another robot control device is provided. The device is applied to a robot. As shown in FIG5 , the robot control device 500 includes:

[0258] The sending module 502 is used to send a trapped signal to the server when detecting that the robot is in a trapped state;

[0259] a receiving module 504 configured to receive a remote control signal sent by a target terminal, wherein the remote control signal is a signal generated by the target terminal based on a received remote control input while displaying a trapped image, wherein the trapped image is an image captured by an image acquisition device, wherein the field of view of the image acquisition device at least partially covers the robot or the image acquisition device is disposed on the robot;

[0260] The execution module 506 is used to execute the escape movement according to the remote control signal.

[0261] In the embodiments of the present application, the robot may be a robot capable of moving around the home, such as a sweeping robot, a mopping robot, or a patrol robot. When the robot is performing a task, an obstacle may block its path. In this case, the robot will first try to cross the obstacle or adjust its direction to bypass the obstacle.

[0262] If the robot fails to cross or bypass an obstacle after multiple attempts, the robot determines that it has entered a trapped state and sends a trapped signal to the server.

[0263] The server can be a cloud server, a robot base station, or a device such as an intelligent gateway that establishes a wireless network connection with the robot.

[0264] After the server receives the trapped signal sent by the robot, the server determines an image acquisition device, which may be an image acquisition device in the area where the robot is located, or an image acquisition device set on the robot.

[0265] The server obtains the image captured by the image acquisition device, which can reflect the robot's trapped situation. Therefore, the server controls the robot to escape according to the image captured by the image acquisition device, so that the robot can perform targeted escape movements according to the trapped situation, specifically the location of the obstacle, the trapped part, etc.

[0266] Exemplarily, the server determines the identity and location information of the robot based on the information carried in the trapped signal, such as determining that the robot is a sweeping robot and the trapped area is the living room.

[0267] After determining the trapped area of ​​the robot based on the trapped signal, the server searches for at least one electronic device in the trapped area, wherein the electronic device is an electronic device with an image acquisition device. The server sends an escape signal to the electronic device with the image acquisition device. The escape signal carries the robot's identification information and trapped position. The electronic device photographs the robot's trapped position based on the escape signal, thereby capturing a trapped image of the robot.

[0268] Exemplarily, the image acquisition device is an image acquisition device provided on the robot, and the image acquisition device on the robot captures the trapped condition of the robot from a first perspective, and the trapped state of the robot is determined based on the trapped image from the first perspective.

[0269] After receiving the trapped image, the server sends the trapped image to the target terminal, where the target terminal is specifically a terminal held by the user, such as the user's mobile phone, remote control, tablet computer, etc.

[0270] After receiving the trapped image, the target terminal displays the trapped image through the home device management application. The user can understand the specific situation of the robot being trapped through the trapped image, and according to the trapped image displayed by the target terminal, the user can input remote control commands to remotely control the robot to move in the direction of avoiding obstacles.

[0271] After receiving the remote control command input by the user, the target terminal generates a corresponding remote control signal based on the control command and sends the remote control signal to the server. After receiving the remote control signal, the server sends the remote control signal to the robot. The robot performs the corresponding escape movement based on the remote control signal, such as the "forward" signal or the "backward" signal.

[0272] The embodiment of the present application helps the user understand the robot's trapped situation based on the trapped image and remotely control the robot to escape from the trap, effectively improving the success rate of the robot's escape from the trap, by sending the trapped image to the target terminal held by the user.

[0273] In some embodiments of the present application, after sending the trapped signal to the server, the receiving module 504 is further used to: receive the escape route sent by the server, where the escape route is the route determined by the server based on the trapped image; the execution module 506 is further used to: execute the escape movement according to the escape route.

[0274] In one embodiment of the present application, another robot control device is provided. The device is applied to a terminal. As shown in FIG6 , the robot control device 600 includes:

[0275] A receiving module 602 is configured to receive a trapped image sent by a server, where the trapped image is an image captured by an image acquisition device, where the field of view of the image acquisition device at least partially covers the robot or the image acquisition device is disposed on the robot;

[0276] Display module 604, for displaying trapped images and receiving remote control input;

[0277] a determination module 606 for determining a remote control signal in response to the remote control input;

[0278] The sending module 608 is used to send the remote control signal to the server, so that the server sends the remote control signal to the robot, so that the robot performs the escape movement according to the remote control signal.

[0279] In the embodiments of the present application, the robot may be a robot capable of moving around the home, such as a sweeping robot, a mopping robot, or a patrol robot. When the robot is performing a task, an obstacle may block its path. In this case, the robot will first try to cross the obstacle or adjust its direction to bypass the obstacle.

[0280] If the robot fails to cross or circumvent an obstacle after multiple attempts, it determines that it is trapped and sends a trapped signal to the server. Upon receiving the trapped signal, the server determines an image acquisition device, which can be an image acquisition device in the area where the robot is located or an image acquisition device installed on the robot itself.

[0281] The server obtains the image captured by the image acquisition device, which can reflect the robot's trapped situation. Therefore, the server controls the robot to escape according to the image captured by the image acquisition device, so that the robot can perform targeted escape movements according to the trapped situation, specifically the location of the obstacle, the trapped part, etc.

[0282] Exemplarily, the server determines the identity and location information of the robot based on the information carried in the trapped signal, such as determining that the robot is a sweeping robot and the trapped area is the living room.

[0283] At least one electronic device is located within the trapped area. The electronic device can be a home surveillance camera or a home appliance with a camera, such as a smart TV, motion-sensing game console, smart refrigerator, or smart air conditioner. The electronic device can also be another robot in the home. For example, if the robot is a sweeping robot, the electronic device can also be a mopping robot or patrol robot that is not trapped.

[0284] The electronic device photographs the trapped position of the robot according to the escape signal, thereby collecting the trapped image of the robot and sending the trapped image to the server.

[0285] Exemplarily, the image acquisition device is an image acquisition device provided on the robot, and the image acquisition device on the robot captures the trapped condition of the robot from a first perspective, and the trapped state of the robot is determined based on the trapped image from the first perspective.

[0286] After receiving the trapped image, the terminal displays it through the home device management application. The user can use the trapped image to understand the specific situation of the robot's trapped state. Based on the trapped image displayed by the terminal, the user can input remote control commands to remotely control the robot to move in a direction to avoid obstacles, thereby achieving escape. After the server receives the trapped image of the robot captured by the electronic device, it sends the trapped image to the terminal. It is understood that the trapped image can be a real-time video stream. The server can compress the video stream file to reduce the demand for network bandwidth and reduce data consumption.

[0287] After receiving a remote control command from the user, the terminal generates a corresponding remote control signal based on the desired control command and sends the remote control signal to the server. The server then sends the remote control signal to the robot, which then executes the corresponding escape movement based on the remote control signal, such as a "forward" or "backward" signal.

[0288] The embodiment of the present application helps the user understand the robot's trapped situation based on the trapped image and remotely control the robot to escape from the trap, effectively improving the success rate of the robot's escape from the trap, by sending the trapped image to the terminal held by the user.

[0289] In one embodiment of the present application, another robot control device is also proposed. As shown in FIG7 , FIG7 shows a structural block diagram of a robot control device 700 provided in an embodiment of the present application. The robot control device 700 includes:

[0290] Memory 702 , where programs or instructions are stored;

[0291] Processor 704, when executing the above program or instruction, implements the steps of the robot control method in any of the above embodiments.

[0292] The robot control device 700 provided in this embodiment includes a memory 702 and a processor 704. When the program or instructions in the memory 702 are executed by the processor 704, the steps of the robot control method in any of the above embodiments are implemented. Therefore, the robot control device 700 has all the beneficial effects of the robot control method in any of the above embodiments, which will not be repeated here.

[0293] For example, the memory 702 and the processor 704 may be connected via a bus or other means. The processor 704 may include one or more processing units, and the processor 704 may be a central processing unit (CPU), a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), or other chips.

[0294] In one embodiment of the present application, a readable storage medium is provided, storing a program or instructions. When executed by a processor, the program or instructions implement the steps of the robot control method provided in any of the above-described embodiments. Therefore, the readable storage medium has all the beneficial effects of the robot control method provided in any of the above-described embodiments, and no further description is given here.

[0295] In one embodiment of the present application, a robot is proposed, as shown in FIG8 , which illustrates a block diagram of the structure of a robot 800 provided in an embodiment of the present application. The robot 800 includes a processor 802 and a memory 804. The memory 804 stores programs or instructions that can be executed on the processor 802. When executed by the processor 802, the programs or instructions implement the steps of the robot control method described in any of the aforementioned embodiments. Therefore, the robot 800 proposed in the present application possesses all the beneficial effects of the robot control method described in any of the aforementioned embodiments, and will not be further elaborated here.

[0296] In one embodiment of the present application, another robot is provided. As shown in FIG9 , FIG9 shows a block diagram of a robot 900 provided in an embodiment of the present application. The robot 900 includes a main body 902, a chassis 904, the robot control device 700 described in the above embodiment, and / or the readable storage medium described in the above embodiment.

[0297] The main body 902 is provided with an image acquisition device 906 and a robot control device 700 , and the chassis 904 is connected to the main body 902 , and the chassis 904 is provided with a moving mechanism 908 .

[0298] In actual application, the image acquisition device 906 may specifically include a first camera.

[0299] The robot 900 proposed in the embodiments of the present application includes the robot control device 700 and / or the readable storage medium of the above-mentioned embodiments. Therefore, the robot 900 has all the technical effects of the robot control device 700 and / or the readable storage medium of the above-mentioned embodiments, and will not be further described here.

[0300] In some embodiments of the present application, as shown in FIG10 , the main body 902 of the robot 900 may further be provided with at least one first sensor 910 and at least one second sensor 912. The first sensor 910 is used to collect first sensor data, and the second sensor 912 is used to collect second sensor data.

[0301] The first sensor 910 may be a motion sensor, and the first sensor data may be motion data of the robot, such as speed, mileage, acceleration, etc. The second sensor 912 may be a ranging sensor, such as a laser sensor and / or a radar sensor, and the second sensor data may be laser sensor data and / or radar sensor data.

[0302] On this basis, during the operation of robot 900, robot control device 700 determines the motion state of robot 900 in real time based on the first sensor data of at least one first sensor 910 installed on robot 900 and / or the chassis environment information collected by image acquisition device 906, to determine whether robot 900 is currently in a free movement state or a stuck state. Furthermore, during the operation of robot 900, robot control device 700 controls image acquisition device 906 installed on robot 900 to capture images of the robot's working environment in real time. On this basis, if robot control device 700 determines that the robot's current motion is stuck, that is, that the robot 900 is currently in a stuck state, the robot control device 700 obtains the chassis environment information collected by image acquisition device 906 installed on robot 900. Furthermore, based on the obtained chassis environment information, robot control device 700 restores the robot's current chassis working environment, thereby obtaining information about the robot's current working environment.

[0303] On this basis, the robot control device 700 analyzes and identifies the characteristics of the robot 900's current working environment based on the robot 900's current working environment information to determine the specific stuck situation of the robot 900, such as the cause of the stuck situation, the type of stuck situation, and the direction of the stuck situation, thereby analyzing and obtaining stuck information of the robot 900. Based on this, the robot control device 700 controls the movement of the moving mechanism 908 according to the actual stuck situation of the robot 900, thereby controlling the robot 900 to perform the corresponding escape action, thereby controlling the robot 900 to flexibly escape from the jam.

[0304] In addition, in actual application, a second camera can be installed on the chassis 904 of the above-mentioned robot 900 to shoot the chassis environment of the robot 900 through the second camera, thereby improving the accuracy of determining the environmental information of the robot 900 and further ensuring the flexibility of the robot 900 to escape from trouble.

[0305] In this specification, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance, unless otherwise expressly specified or limited. Terms such as "connect," "install," and "fix" should be interpreted broadly. For example, "connect" can refer to a fixed connection, a detachable connection, or an integral connection; it can refer to a direct connection or an indirect connection through an intermediary. Those skilled in the art will understand the specific meanings of these terms in this application based on specific circumstances.

[0306] Throughout this specification, terms such as "one embodiment," "some embodiments," and "specific embodiments" mean that the specific features, structures, materials, or characteristics described in conjunction with that embodiment or example are included in at least one embodiment or example of the present application. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.

[0307] In addition, the technical solutions between the various embodiments of the present application can be combined with each other, but it must be based on the fact that ordinary technicians in this field can implement it. When the combination of technical solutions is mutually contradictory or cannot be implemented, it should be deemed that such a combination of technical solutions does not exist and is not within the scope of protection required by this application.

[0308] The above description is merely a preferred embodiment of the present application and is not intended to limit the present application. Various modifications and variations are possible for those skilled in the art. Any modifications, equivalent substitutions, or improvements made within the spirit and principles of the present application shall be included within the scope of protection of the present application.

Claims

1. A robot control method, wherein: include: Acquiring a distress signal of the robot; Determine an image acquisition device, the field of view of the image acquisition device at least partially covers the robot or the image acquisition device is arranged on the robot; Acquire an image from the image acquisition device; as well as The robot is controlled to perform an escape movement according to the image.

2. The robot control method according to claim 1, wherein: The image acquisition device is determined, comprising: Determine a trapped area of ​​the robot according to the trapped signal; At least one electronic device is determined in the trapped area, wherein the at least one electronic device is provided with the image acquisition device; and the step of acquiring the image of the image acquisition device comprises: The electronic device is controlled to acquire the trapped image corresponding to the robot through the image acquisition device.

3. The robot control method according to claim 2, wherein: The step of determining the trapped area of ​​the robot according to the trapped signal comprises: Determine the position information of the robot according to the trapped signal; Obtaining a working map of the robot; The trapped area is determined within the working area of ​​the robot according to the position information and the working map.

4. The robot control method according to claim 2, wherein: The step of determining at least one electronic device in the trapped area includes: sending a query signal to a target gateway, the target gateway being communicatively connected to a plurality of candidate electronic devices in the trapped area; The at least one electronic device is determined from the plurality of candidate electronic devices according to the received device list sent by the target gateway.

5. The robot control method according to claim 1, wherein: The image acquisition device is determined, comprising: In the case that the robot is equipped with an image sensor, the image sensor is determined as the image acquisition device.

6. The robot control method according to any one of claims 1 to 5, wherein: The step of controlling the robot to perform an escape motion according to the image comprises: sending the image to a target terminal; Receiving a remote control signal sent by the target terminal; The remote control signal is sent to the robot so that the robot performs the escape movement according to the remote control signal.

7. The robot control method according to any one of claims 1 to 5, wherein: The step of controlling the robot to perform an escape motion according to the image comprises: generating a corresponding escape map according to the image; Determining an escape route according to the escape map; The escape route is sent to the robot so that the robot executes the escape movement according to the escape route.

8. The robot control method according to any one of claims 1 to 5, wherein: The image acquisition device is disposed on the robot, the image at least includes chassis environment information of the robot, the chassis environment information is image information below the chassis, and controlling the robot to perform escape motion according to the image includes: Determining environmental information of the robot according to the chassis environmental information; Determine the stuck information of the robot according to the environmental information; The robot is controlled to perform corresponding escape operations according to the stuck information.

9. The robot control method according to claim 8, wherein: The robot includes at least one first sensor, and the at least one first sensor is used to collect first sensor data. The robot control method also includes: Determine the running speed and position information of the robot according to the first sensing data and / or the image; When the running speed is greater than zero and the position information remains unchanged, it is determined that the robot is in a stuck state.

10. The robot control method according to claim 8, wherein: The determining the environment information of the robot according to the chassis environment information comprises: Acquire first chassis environment information of the robot in a first time period, the first time period being before the robot is in a stuck state; The environmental information of the robot is determined according to the first chassis environmental information.

11. The robot control method according to claim 8, wherein: The robot includes at least one second sensor, and the at least one second sensor is used to collect second sensor data. The determining the environment information of the robot according to the chassis environment information includes: Acquire first chassis environment information of the robot in a first time period, the first time period being before the robot is in a stuck state; Acquire the second chassis environment information and / or the second sensor data when the robot is in a stuck state; Determine the environment information of the robot according to the first chassis environment information, the second chassis environment information and / or the second sensor data; The second sensing data includes at least one of laser sensing data and radar sensing data.

12. The robot control method according to any one of claims 9 to 11, wherein: The determining the stuck information of the robot according to the environmental information includes: Determine obstacle information that traps the robot according to the environmental information; The stuck information is determined according to the obstacle information.

13. The robot control method according to claim 12, wherein: The determining the stuck information according to the obstacle information includes: The trapped position and / or trapped direction, movable direction and / or movable distance of the robot are determined according to the obstacle information.

14. The robot control method according to claim 13, wherein: The controlling the robot to perform a corresponding escape operation according to the stuck information includes: Determine movement information of the robot according to the stuck information, the movement information including a movement direction and a movement distance, the movement direction is associated with the stuck direction, and / or the movement direction is associated with the movable direction, the movement distance is associated with the stuck position, and / or the movement distance is associated with the movable distance; The robot is controlled to move according to the movement information.

15. A robot control method, applied to a robot, wherein: include: When detecting that the robot is in a trapped state, sending a trapped signal to a server; Receiving a remote control signal sent by a target terminal, wherein the remote control signal is a signal generated by the target terminal according to a received remote control input when displaying a trapped image, wherein the trapped image is an image captured by an image acquisition device, and the field of view of the image acquisition device covers the robot or the image acquisition device is arranged on the robot; The escape movement is performed according to the remote control signal.

16. The robot control method according to claim 15, wherein: After sending the trapped signal to the server, the robot control method further includes: receiving an escape route sent by the server, wherein the escape route is a route determined by the server according to the trapped image; The escape movement is performed according to the escape route.

17. A robot control method, applied to a terminal, wherein: include: Receiving a trapped image sent by a server, wherein the trapped image is an image captured by an image acquisition device, the field of view of the image acquisition device covers the robot or the image acquisition device is arranged on the robot; displaying the trapped image and receiving remote control input; In response to the remote control input, determining a remote control signal; The remote control signal is sent to the server, so that the server sends the remote control signal to the robot, so that the robot performs the escape movement according to the remote control signal.

18. A robot control device, wherein: include: An acquisition module, used to acquire the robot's trapped signal; A determination module, used for determining an image acquisition device, the field of view of which covers the robot or the image acquisition device is arranged on the robot; The acquisition module is further used to acquire the image of the image acquisition device; The control module is used to control the robot to perform escape movement according to the image.

19. A robot control device, applied to a robot, wherein: include: A sending module, used for sending a trapped signal to a server when detecting that the robot is in a trapped state; a receiving module, configured to receive a remote control signal sent by a target terminal, wherein the remote control signal is a signal generated by the target terminal according to a received remote control input when displaying a trapped image, wherein the trapped image is an image captured by an image acquisition device, and the field of view of the image acquisition device covers the robot or the image acquisition device is arranged on the robot; An execution module is used to execute the escape movement according to the remote control signal.

20. A robot control device, applied to a terminal, wherein: include: A receiving module, used for receiving a trapped image sent by a server, wherein the trapped image is an image captured by an image acquisition device, the field of view of the image acquisition device covers the robot or the image acquisition device is arranged on the robot; A display module, used to display the trapped image and receive remote control input; a determination module, configured to determine a remote control signal in response to the remote control input; The sending module is used to send the remote control signal to the server, so that the server sends the remote control signal to the robot, so that the robot performs the escape movement according to the remote control signal.

21. A robot control device, wherein: include: Memory, storing programs or instructions; A processor, wherein when executing the program or instruction, the processor implements the steps of the robot control method according to any one of claims 1 to 17.

22. A readable storage medium, wherein: The readable storage medium stores a program or instruction, and when the program or instruction is executed by a processor, the steps of the robot control method according to any one of claims 1 to 17 are implemented.

23. A robot, wherein: The robot control method comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the robot control method according to any one of claims 1 to 17 are implemented.

24. A robot, wherein: include: A main body, wherein an image acquisition device is provided on the main body; A chassis connected to the main body, wherein a moving mechanism is arranged on the chassis; The robot control device according to claim 21; and / or The readable storage medium as claimed in claim 22.

25. The robot according to claim 24, wherein: Also includes: at least one first sensor, disposed on the main body, the first sensor being used to collect first sensing data; At least one second sensor is disposed on the main body, and the second sensor is used to collect second sensing data.

Citation Information

Patent Citations

  • Detecting method for trapped floor-cleaning robot

    CN106093948A

  • Vehicle unbounding system and method

    CN108198448A

  • Sweeping control method and device for sweeping robot

    CN110338708A

  • Sweeping robot and obstacle avoidance method of the sweeping robot

    CN113397437A

  • Method and system for on-site help seeking and rescue of unmanned equipment

    CN113715843A

Cited By

  • Robot control method and device, electronic equipment and storage medium

    CN119635629A

  • Robot control method and device, electronic equipment and storage medium

    CN119635629B