Control method of cleaning robot, cleaning robot and storage medium

By obtaining image information and diner response signals when the cleaning robot reaches the target position for dual detection, the problem of the cleaning robot accidentally recycles tableware, achieving higher recycling accuracy.

CN114326716BActive Publication Date: 2024-11-22YOUDI ROBOT (WUXI) CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202111515671.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-12-10
Publication Date
2024-11-22
Estimated Expiration
2041-12-10

AI Technical Summary

Technical Problem

Existing cleaning robots are prone to misrecycling when recycling tableware, and cannot effectively distinguish whether diners have completed their meals.

Method used

By obtaining image information of the space to be cleaned when the cleaning robot reaches the target position, identifying the food residue on the tableware, and performing double detection in combination with the diner's response signal, determine whether the tableware is recycled.

Benefits of technology

It effectively reduces the wrong operations of cleaning robots, avoids the misrecycling of tableware, and improves the recycling accuracy.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114326716B_ABST
    Figure CN114326716B_ABST
Patent Text Reader

Abstract

The present invention discloses a control method of a cleaning robot, a cleaning robot and a storage medium, which are applied to the field of robot technology. By adopting a technical solution of obtaining image information corresponding to a space to be cleaned when the cleaning robot reaches a target position; identifying tableware in the image information, and determining the food residue on the tableware according to the proportion of the food in the tableware in the image information; determining whether there is a diner in the space to be cleaned according to the image information when the food residue is less than a preset food residue threshold; and recycling the tableware when there is a diner in the space to be cleaned, the problem of incorrect recycling of tableware is solved, and the technical solution of the present application is used to reduce the erroneous operation of the cleaning robot.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of robots, and in particular to a control method of a cleaning robot, a cleaning robot and a storage medium. Background Art

[0002] With the improvement of living standards, the use of cleaning robots can be seen everywhere. Cleaning robots are intelligent machines that can work semi-autonomously or fully autonomously and are widely used in various industries. Among them, cleaning robots can recycle tableware. At present, cleaning robots simply recycle tableware directly, which is prone to the phenomenon of recycling tableware by mistake. Summary of the invention

[0003] The embodiments of the present application aim to solve the problem of incorrect recycling of tableware by providing a control method for a cleaning robot, a cleaning robot and a storage medium.

[0004] The embodiment of the present application provides a control method for a cleaning robot, the control method for the cleaning robot comprising:

[0005] When the cleaning robot reaches the target position, image information corresponding to the space to be cleaned is obtained;

[0006] Identifying tableware in the image information, and determining the degree of food residue on the tableware according to the proportion of the food in the tableware in the image information;

[0007] When the food residue degree is less than a preset food residue threshold, determining whether there is a diner in the space to be cleaned according to the image information;

[0008] When there are diners in the space to be cleaned, the tableware is recovered.

[0009] In one embodiment, the step of determining the degree of food residue on the tableware according to the image information comprises:

[0010] determining a tableware detection frame according to the image information;

[0011] Determining a first proportion of the tableware detection frame in the image information, wherein the tableware detection frame includes tableware and food;

[0012] performing semantic segmentation processing on the tableware and the food in the tableware detection frame, and determining a second proportion of the food in the image information;

[0013] The food residue on the tableware is determined according to the ratio of the second proportion to the first proportion.

[0014] In one embodiment, when the cleaning robot reaches the target position, before the step of acquiring image information corresponding to the space to be cleaned, the step further includes:

[0015] The cleaning robot automatically starts based on a preset time;

[0016] Obtain the reflection signal fed back by the detection equipment and the current position information of the cleaning robot;

[0017] Determine an environment map according to the reflected signal, and determine a target position according to the environment map, wherein the environment map includes at least one target position, and each of the target positions is sorted in a preset order in the environment map;

[0018] Determining a driving path of the cleaning robot according to the current position information and the target position;

[0019] The cleaning robot is controlled to move to the target position based on the driving path, and the step of acquiring image information corresponding to the space to be cleaned is performed when the cleaning robot reaches the target position.

[0020] In one embodiment, when the cleaning robot reaches the target position, before the step of acquiring image information corresponding to the space to be cleaned, the step further includes:

[0021] Upon receiving the payment completion instruction sent by the terminal, obtaining the table number and determining the target location corresponding to the table number;

[0022] Get the current location information of the cleaning robot;

[0023] Determining a driving path of the cleaning robot according to the current position information and the target position;

[0024] The cleaning robot is controlled to move to the target position based on the driving path, and the step of acquiring image information corresponding to the space to be cleaned is performed when the cleaning robot reaches the target position.

[0025] In one embodiment, the step of controlling the cleaning robot to move to the target position based on the driving path includes:

[0026] In the process of controlling the cleaning robot to move based on the driving path, detecting whether there is an obstacle;

[0027] When there are obstacles, determine the local path based on the preset path planning method;

[0028] The cleaning robot is controlled to avoid obstacles based on the local path, and the cleaning robot is moved to the target position.

[0029] In one embodiment, the preset path planning method includes at least one of the following: an artificial potential field method or a dynamic window method.

[0030] In one embodiment, when there are diners in the space to be cleaned, the step of recovering the tableware includes:

[0031] When there is a diner in the space to be cleaned, determining whether a response signal from the diner is received;

[0032] When a response signal from the diner is received, the tableware is recovered.

[0033] In one embodiment, after the step of recovering the tableware when there are diners in the space to be cleaned, the method further includes:

[0034] When the food residue level is greater than a preset food residue threshold, the tableware recycling is prohibited;

[0035] Alternatively, when there is a diner in the space to be cleaned and no response signal from the diner is received, tableware recovery is prohibited.

[0036] In addition, to achieve the above-mentioned purpose, the present invention also provides a cleaning robot, which includes: a memory, a processor, and a control program of the cleaning robot stored in the memory and executable on the processor, and the control program of the cleaning robot implements the steps of the above-mentioned cleaning robot control method when executed by the processor.

[0037] In addition, to achieve the above-mentioned purpose, the present invention also provides a storage medium on which a control program of a cleaning robot is stored, and when the control program of the cleaning robot is executed by a processor, the steps of the above-mentioned control method of the cleaning robot are implemented.

[0038] The technical solutions of a cleaning robot control method, a cleaning robot and a storage medium provided in the embodiments of the present application adopt the method of obtaining image information corresponding to the space to be cleaned when the cleaning robot reaches the target position, and determining the food residue on the tableware according to the image information; when the food residue is less than a preset food residue threshold, it indicates that the diner may have finished the meal at this time. The technical solution of further detecting whether there is a diner in the space to be cleaned according to the image information and recycling the tableware when there is a diner in the space to be cleaned is adopted. The present application solves the problem of erroneous recycling of tableware by performing double detection of food residue and diners, thereby reducing erroneous operation of the cleaning robot. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] Figure 1 A schematic diagram of the structure of the hardware operating environment involved in the embodiment of the present invention;

[0040] Figure 2 It is a flowchart of a first embodiment of a control method for a cleaning robot according to the present invention;

[0041] Figure 3 It is a flow chart of a second embodiment of a control method for a cleaning robot according to the present invention;

[0042] Figure 4 A schematic flow chart of a third embodiment of a control method for a cleaning robot according to the present invention;

[0043] Figure 5 A schematic flow chart of a fourth embodiment of a control method for a cleaning robot according to the present invention;

[0044] Figure 6 This is the overall schematic diagram of the tableware inspection plan for this application;

[0045] Figure 7 It is a schematic diagram of the process of meal condition detection of the present invention;

[0046] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. The above-mentioned drawings are only an embodiment diagram, not the entire invention. DETAILED DESCRIPTION

[0047] In order to better understand the above technical solution, exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments described herein. On the contrary, these embodiments are provided to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0048] like Figure 1 As shown, Figure 1 It is a schematic diagram of the structure of the hardware operating environment involved in the embodiment of the present invention.

[0049] It should be noted that Figure 1 This is a structural diagram of the hardware operating environment of the cleaning robot.

[0050] like Figure 1As shown, the cleaning robot may include: a processor 1001, such as a CPU, a memory 1005, a user interface 1003, a network interface 1004, and a communication bus 1002. Among them, the communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface). The memory 1005 may be a high-speed RAM memory, or a stable memory (non-volatile memory), such as a disk memory. The memory 1005 may optionally be a storage device independent of the aforementioned processor 1001.

[0051] Those skilled in the art will understand that Figure 1 The structure of the cleaning robot shown in the figure does not constitute a limitation on the cleaning robot, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently.

[0052] like Figure 1 As shown, the memory 1005 as a storage medium may include an operating system, a network communication module, a user interface module, and a control program of the cleaning robot. The operating system is a program for managing and controlling the hardware and software resources of the cleaning robot, and the operation of the control program of the cleaning robot and other software or programs.

[0053] exist Figure 1 In the cleaning robot shown, the user interface 1003 is mainly used to connect to the terminal and communicate data with the terminal; the network interface 1004 is mainly used for the background server and communicates data with the background server; the processor 1001 can be used to call the control program of the cleaning robot stored in the memory 1005.

[0054] In this embodiment, the cleaning robot includes: a memory 1005, a processor 1001, and a control program of the cleaning robot stored in the memory and executable on the processor, wherein:

[0055] When the processor 1001 calls the control program of the cleaning robot stored in the memory 1005, the following operations are performed:

[0056] When the cleaning robot reaches the target position, image information corresponding to the space to be cleaned is obtained;

[0057] Identifying tableware in the image information, and determining the degree of food residue on the tableware according to the proportion of the food in the tableware in the image information;

[0058] When the food residue degree is less than a preset food residue threshold, determining whether there is a diner in the space to be cleaned according to the image information;

[0059] When there are diners in the space to be cleaned, the tableware is recovered.

[0060] When the processor 1001 calls the control program of the cleaning robot stored in the memory 1005, it also performs the following operations:

[0061] determining a tableware detection frame according to the image information;

[0062] Determining a first proportion of the tableware detection frame in the image information, wherein the tableware detection frame includes tableware and food;

[0063] performing semantic segmentation processing on the tableware and the food in the tableware detection frame, and determining a second proportion of the food in the image information;

[0064] The food residue on the tableware is determined according to the ratio of the second proportion to the first proportion.

[0065] When the processor 1001 calls the control program of the cleaning robot stored in the memory 1005, it also performs the following operations:

[0066] The cleaning robot automatically starts based on a preset time;

[0067] Obtain the reflection signal fed back by the detection equipment and the current position information of the cleaning robot;

[0068] Determine an environment map according to the reflected signal, and determine a target position according to the environment map, wherein the environment map includes at least one target position, and each of the target positions is sorted in a preset order in the environment map;

[0069] Determining a driving path of the cleaning robot according to the current position information and the target position;

[0070] The cleaning robot is controlled to move to the target position based on the driving path, and the step of acquiring image information corresponding to the space to be cleaned is performed when the cleaning robot reaches the target position.

[0071] When the processor 1001 calls the control program of the cleaning robot stored in the memory 1005, it also performs the following operations:

[0072] Upon receiving the payment completion instruction sent by the terminal, obtaining the table number and determining the target location corresponding to the table number;

[0073] Get the current location information of the cleaning robot;

[0074] Determining a driving path of the cleaning robot according to the current position information and the target position;

[0075] The cleaning robot is controlled to move to the target position based on the driving path, and the step of acquiring image information corresponding to the space to be cleaned is performed when the cleaning robot reaches the target position.

[0076] When the processor 1001 calls the control program of the cleaning robot stored in the memory 1005, it also performs the following operations:

[0077] In the process of controlling the cleaning robot to move based on the driving path, detecting whether there is an obstacle;

[0078] When there are obstacles, determine the local path based on the preset path planning method;

[0079] The cleaning robot is controlled to avoid obstacles based on the local path, and the cleaning robot is moved to the target position.

[0080] When the processor 1001 calls the control program of the cleaning robot stored in the memory 1005, it also performs the following operations:

[0081] The preset path planning method includes at least one of the following: an artificial potential field method or a dynamic window method.

[0082] When the processor 1001 calls the control program of the cleaning robot stored in the memory 1005, it also performs the following operations:

[0083] When there is a diner in the space to be cleaned, determining whether a response signal from the diner is received;

[0084] When a response signal from the diner is received, the tableware is recovered.

[0085] When the processor 1001 calls the control program of the cleaning robot stored in the memory 1005, it also performs the following operations:

[0086] When the food residue level is greater than a preset food residue threshold, the tableware recycling is prohibited;

[0087] Alternatively, when there is a diner in the space to be cleaned and no response signal from the diner is received, tableware recovery is prohibited.

[0088] First embodiment:

[0089] like Figure 2 As shown, in the first embodiment of the present application, the control method of the cleaning robot of the present application includes the following steps:

[0090] Step S110, when the cleaning robot reaches the target position, acquiring image information corresponding to the space to be cleaned;

[0091] Step S120, identifying the tableware in the image information, and determining the degree of food residue on the tableware according to the proportion of the food in the tableware in the image information;

[0092] Step S130, when the food residue degree is less than a preset food residue threshold, determining whether there is a diner in the space to be cleaned according to the image information;

[0093] Step S140, when there are diners in the space to be cleaned, the tableware is recovered.

[0094] In this embodiment, the cleaning robot can be used in restaurants, canteens and other areas to search and recycle tableware. Because traditional cleaning robots only recycle tableware directly when they detect that there are no diners in the space to be cleaned. If the diners only leave for a short time, the tableware may be mistakenly recycled. Therefore, the present application designs a cleaning robot control method. The cleaning robot control method avoids the phenomenon of mistaken tableware recycling by making a double judgment on the food residue on the tableware and detecting whether there are diners. In other embodiments, whether to recycle the tableware can also be determined by whether a response signal from the diner is received. Through the technical solution of the present application, it is achieved to reduce the erroneous operation of the cleaning robot.

[0095] Reference Figure 6 , Figure 6 This is an overall schematic diagram of the tableware inspection solution of this application. Before the tableware inspection, an environmental map is established. Path planning is performed based on the environmental map. In the process of moving to the target location based on the planned driving path, pedestrian obstacle avoidance is performed. After reaching the target location, the meal condition is detected. After the meal condition is detected, the corresponding inspection action is performed.

[0096] In this embodiment, the target position is the dining table position, and the target position can be pre-calibrated according to the placement position of the dining table in the dining area. The cleaning robot drives to the target position based on the planned driving path, and obtains image information of the space to be cleaned at the target position. The space to be cleaned is the dining table. The image information corresponding to the space to be cleaned can be collected by a high-definition camera device installed on the cleaning robot.

[0097] In this embodiment, after obtaining the image information corresponding to the space to be cleaned, the food residue on the tableware can be further determined according to the image information. The food residue can be the residual situation of the food on the dinner plate, that is, the proportion of the food in the dinner plate. Specifically, the image information can be input into a neural network model, and the tableware detection frame can be determined according to the image information through the neural network model. After obtaining the tableware detection frame, the first proportion of the tableware detection frame in the image information is determined, and the tableware detection frame includes tableware and food. After determining the first proportion, the tableware and food in the tableware detection frame need to be separated to further determine the food residue on the tableware. Specifically, the tableware and the food in the tableware detection frame are semantically segmented to determine the second proportion of the food in the image information. After obtaining the second proportion, the food residue on the tableware is determined according to the ratio of the second proportion to the first proportion.

[0098] For example, the area of ​​the tableware detection frame is used as the size S_c of the tableware in the image, and semantic segmentation is performed on the detected tableware and the food in it to obtain the area size S_f occupied by the food in the image. At this time, the proportion of food to tableware can be obtained R = (S_f / S_c), and R is used as an indicator of food residue. When R is less than a certain preset threshold T, the probability that the meal is completed is greater.

[0099] Optionally, the neatness of the food on the tableware may be determined based on the image information, thereby further determining the probability of the meal being completed.

[0100] In this embodiment, after determining the food residue, it is necessary to judge the food residue. Specifically, the food residue is compared with a preset food residue threshold. When the food residue is less than the preset food residue threshold, the next step is performed. Among them, the preset food residue threshold is obtained by training based on a preset food residue sample. When the food residue is less than the preset food residue threshold, it means that the probability of the meal being completed is relatively high. At this time, it is determined whether there are diners in the space to be cleaned according to the image information, and when there are diners in the space to be cleaned, the tableware is recovered. Optionally, when the food residue is less than the preset food residue threshold, the search is continued. The focal length of the high-definition camera device can be changed to obtain the second image information, and the camera field of view corresponding to the second image information is wider than the camera field of view corresponding to the image information. It is determined whether there are diners in the space to be cleaned or near the space to be cleaned by the obtained second image information. When there are diners in the space to be cleaned and near the space to be cleaned, the tableware is recovered.

[0101] Optionally, refer to Figure 7 , Figure 7 Schematic diagram of a flow chart for dining condition detection. When there is a diner in the space to be cleaned, it is determined whether a response signal from the diner is received, and the response signal may be a voice signal. For example, when the cleaning robot sends a voice signal of "Can the tableware be recycled?", if the voice signal received from the diner is "Yes", it indicates that the response signal is received. When the response signal from the diner is received, the tableware is recycled.

[0102] Optionally, when the food residue degree is greater than a preset food residue threshold, tableware recycling is prohibited; or, when there is a diner in the space to be cleaned and no response signal from the diner is received, tableware recycling is prohibited.

[0103] According to the above technical solution, this embodiment acquires image information corresponding to the space to be cleaned when the cleaning robot reaches the target position, and determines the food residue on the tableware according to the image information; when the food residue is less than a preset food residue threshold, it indicates that the diner may have finished the meal. It further detects whether there is a diner in the space to be cleaned according to the image information. When there is a diner in the space to be cleaned, the tableware is recycled. This application solves the problem of erroneous tableware recycling by performing dual detection of food residue and diners, thereby reducing erroneous operation of the cleaning robot.

[0104] Second embodiment:

[0105] like Figure 3 As shown, Figure 3 Each step in the first embodiment of the present application is located before step S110, wherein the steps before step S110 include steps S210 to S250:

[0106] Step S210, the cleaning robot starts automatically based on a preset time length;

[0107] Step S220, obtaining the reflection signal fed back by the detection device and the current position information of the cleaning robot;

[0108] Step S230, determining an environment map according to the reflected signal, and determining a target position according to the environment map, wherein the environment map includes at least one target position, and each of the target positions is sorted in a preset order in the environment map;

[0109] Step S240, determining a driving path of the cleaning robot according to the current position information and the target position;

[0110] Step S250, controlling the cleaning robot to move to the target position based on the driving path.

[0111] In this embodiment, the cleaning robot can be automatically started to perform a search by setting a preset time. The preset time can be set according to actual conditions, for example, according to business hours, meal times, etc. The cleaning robot automatically starts to perform a search based on the preset time.

[0112] In this embodiment, a radar signal can be emitted by a detection device set on the cleaning robot, and a reflection signal of the radar signal can be obtained. And the reflection signal is fed back to the cleaning robot processor. Among them, the detection device is a laser radar sensor. The current position information of the cleaning robot can be determined by matching the point cloud emitted by the laser radar sensor of the cleaning robot with the indoor environment map previously constructed using the laser radar. Specifically, after obtaining the reflection signal fed back by the detection device, the cleaning robot determines the environment map according to the reflection signal, and thus determines the target position according to the environment map. After determining the target position, the driving path of the cleaning robot can be determined according to the current position information and the target position. The robot is controlled to move to the target position based on the driving path. Among them, after receiving the reflection signal fed back by the detection device, the cleaning robot determines the environment map according to the reflection signal and in combination with the slam algorithm, and then plans a path to the target position with the minimum total cost based on the global cost map through the global path planning algorithm A* algorithm, and the target position is set to the outside of the position of each dining table, and each target position is set to a target point with a sequence, and it will move to each target point with a sequence when performing global road planning.

[0113] According to the above technical solution, this embodiment adopts a technical means that the cleaning robot moves to the target position based on the driving path after starting based on a preset time, thereby performing an inspection at the target position.

[0114] Third embodiment:

[0115] like Figure 4 As shown, Figure 4 Each step in the first embodiment of the present application is located before step S110, wherein the steps before step S110 include steps S310 to S340:

[0116] Step S310, upon receiving the payment completion instruction sent by the terminal, obtaining the table number and determining the target location corresponding to the table number;

[0117] Step S320, obtaining the current position information of the cleaning robot;

[0118] Step S330, determining a driving path of the cleaning robot according to the current position information and the target position;

[0119] Step S340: Control the cleaning robot to move to the target position based on the driving path.

[0120] In this embodiment, after the guest has confirmed payment at the front desk, the terminal sends a payment completion instruction to the cleaning robot. The cleaning robot is directed to search the designated table location. Specifically, the table number of the diners who have paid is obtained. After obtaining the table, the target location corresponding to the table number is determined. The target location and the current location information of the cleaning robot can be obtained. Thus, the driving path of the cleaning robot is determined based on the current location information and the target location. After determining the driving path of the cleaning robot, the cleaning robot is controlled to move to the target location based on the driving path.

[0121] According to the above technical solution, this embodiment adopts a technical means of starting the cleaning robot to move to the target position based on the driving path when receiving the payment completion instruction sent by the terminal, thereby performing an inspection at the target position.

[0122] Fourth embodiment:

[0123] like Figure 5 As shown, Figure 5 This is a flow chart of the fourth embodiment of the present application. Based on step S250 of the second embodiment and step S340 of the third embodiment, the fourth embodiment of the present application includes the following steps:

[0124] Step S251, detecting whether there is an obstacle in the process of controlling the cleaning robot to move based on the driving path;

[0125] Step S252, when there is an obstacle, determining a local path based on a preset path planning method;

[0126] Step S253, controlling the cleaning robot to avoid obstacles based on the local path, and moving the cleaning robot to the target position.

[0127] In this embodiment, the cleaning robot detects in real time whether there are obstacles in the process of moving to the target position based on the driving path, or in the process of patrolling. Images can be collected by a high-definition camera device set on the cleaning robot. The image is analyzed to determine whether there are obstacles in front of the cleaning robot. When there are obstacles in front of the cleaning robot, a local path is planned. The robot will perform local path planning to achieve local obstacle avoidance during the global path planning movement. Specifically, the local path is determined based on a preset path planning method. The cleaning robot is controlled to avoid obstacles based on the local path until the cleaning robot moves to the target position. Tableware is searched at the target position. Optionally, the preset path planning method includes at least one of the following: an artificial potential field method or a dynamic window method. Among them, the artificial potential field method is to design the movement of the robot in the surrounding environment as a movement in an abstract artificial gravitational field, the target position generates "gravity" on the cleaning robot, and the obstacle generates "repulsion" on the cleaning robot, and finally the movement of the cleaning robot is controlled by seeking the resultant force. The dynamic window method is a commonly used obstacle avoidance planning method. This is a method for selecting a speed that can quickly reach the target position while avoiding obstacles in the speed search space that may collide with the cleaning robot. This method searches for the optimal control speed of the cleaning robot directly in the speed space, reducing the search space to the speeds that are reachable under dynamic constraints, thereby incorporating the dynamic characteristics of the cleaning robot into the method.

[0128] According to the above technical solution, this embodiment adopts a technical means of performing local path planning and obstacle avoidance when an obstacle is detected during the movement of the cleaning robot based on the driving path, so that the cleaning robot can move smoothly to the target position.

[0129] The embodiments of the present invention provide embodiments of the control method of the cleaning robot. It should be noted that, although the logical order is shown in the flow chart, in some cases, the steps shown or described may be executed in an order different from that shown here.

[0130] Based on the same inventive concept, an embodiment of the present application also provides a storage medium, which stores a control program for a cleaning robot. When the control program for the cleaning robot is executed by a processor, it implements the various steps of controlling the cleaning robot as described above and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0131] Since the storage medium provided in the embodiments of the present application is the storage medium used to implement the method of the embodiments of the present application, based on the method introduced in the embodiments of the present application, the person skilled in the art can understand the specific structure and deformation of the storage medium, so it is not repeated here. All storage media used in the methods of the embodiments of the present application belong to the scope of protection of this application.

[0132] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0133] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0134] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0135] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0136] It should be noted that in the claims, any reference signs placed between brackets shall not be construed as limiting the claims. The word "comprising" does not exclude the presence of components or steps not listed in the claim. The word "a" or "an" preceding a component does not exclude the presence of a plurality of such components. The invention may be implemented by means of hardware comprising several different components and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means may be embodied by the same item of hardware. The use of the words first, second, and third etc. does not indicate any order. These words may be interpreted as names.

[0137] Although the preferred embodiments of the present invention have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present invention.

[0138] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. A control method for a cleaning robot, characterized in that: Applied to a cleaning robot, the control method of the cleaning robot includes: Upon receiving the payment completion instruction sent by the terminal, obtaining the table number and determining the target location corresponding to the table number; Get the current location information of the cleaning robot; Determining a driving path of the cleaning robot according to the current position information and the target position; Controlling the cleaning robot to move to the target position based on the driving path; When the cleaning robot reaches the target position, image information corresponding to the space to be cleaned is obtained; Identify the tableware in the image information, and determine a tableware detection frame according to the image information; determine a first area ratio of the tableware detection frame in the image information, wherein the tableware detection frame includes tableware and food; perform semantic segmentation processing on the tableware and the food in the tableware detection frame, and determine a second area ratio of the food in the image information; determine the food residue on the tableware according to the ratio of the second area ratio to the first area ratio; When the food residue degree is less than a preset food residue threshold, determining whether there is a diner in the space to be cleaned according to the image information; When there are diners in the space to be cleaned, reclaiming the tableware; When the food residue degree is greater than a preset food residue threshold, tableware recycling is prohibited; or, when there is a diner in the space to be cleaned and no response signal from the diner is received, tableware recycling is prohibited.

2. The method according to claim 1, characterized in that When the cleaning robot reaches the target position, before the step of obtaining image information corresponding to the space to be cleaned, the step further includes: The cleaning robot automatically starts based on a preset time; Obtain the reflection signal fed back by the detection equipment and the current position information of the cleaning robot; Determine an environment map according to the reflected signal, and determine a target position according to the environment map, wherein the environment map includes at least one target position, and each of the target positions is sorted in a preset order in the environment map; Determining a driving path of the cleaning robot according to the current position information and the target position; The cleaning robot is controlled to move to the target position based on the driving path, and the step of acquiring image information corresponding to the space to be cleaned is performed when the cleaning robot reaches the target position.

3. The method according to claim 1 or 2, characterized in that The step of controlling the cleaning robot to move to the target position based on the driving path comprises: In the process of controlling the cleaning robot to move based on the driving path, detecting whether there is an obstacle; When there are obstacles, determine the local path based on the preset path planning method; The cleaning robot is controlled to avoid obstacles based on the local path, and the cleaning robot is moved to the target position.

4. The method according to claim 3, characterized in that The preset path planning method includes at least one of the following: an artificial potential field method or a dynamic window method.

5. The method according to claim 1, characterized in that When there are diners in the space to be cleaned, the step of recovering the tableware comprises: When there is a diner in the space to be cleaned, determining whether a response signal from the diner is received; When a response signal from the diner is received, the tableware is recovered.

6. A cleaning robot, characterized in that: The cleaning robot comprises: a memory, a processor, and a control program of the cleaning robot stored in the memory and executable on the processor. When the control program of the cleaning robot is executed by the processor, the steps of the control method of the cleaning robot as described in any one of claims 1 to 5 are implemented.

7. A storage medium, characterized in that: The storage medium stores a control program of the cleaning robot, and when the control program of the cleaning robot is executed by the processor, the steps of the control method of the cleaning robot according to any one of claims 1 to 5 are implemented.