Control method and apparatus for cleaning robot, cleaning robot, and storage medium

Through image acquisition and semantic recognition technology, the cleaning robot recognizes target objects and areas, re-plans the cleaning trajectory to avoid living areas such as humans and re-sweep, solving the problem that cleaning robots in the existing technology is difficult to avoid humans and living things, and improving the problem of cleaning robots in the existing technology. Cleaning efficiency and integrity.

WO2024240087A1PCT designated stage expired Publication Date: 2024-11-28MIDEA ROBOZONE TECH CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2024/093995
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-19
Filing Date
2024-05-17
Publication Date
2024-11-28

AI Technical Summary

Technical Problem

Existing cleaning robots find it difficult to effectively avoid human and living things when encountering obstacles, affecting cleaning efficiency and interfering with human activities.

Method used

Through image acquisition devices and semantic recognition technology, the cleaning robot can identify target objects and areas, re-plan the cleaning trajectory, temporarily avoid living areas such as humans, and perform re-sweeps when appropriate to ensure cleaning integrity and efficiency.

Benefits of technology

It realizes that cleaning robots can intelligently identify and avoid their areas when detecting living objects such as human bodies, improve cleaning efficiency and integrity, and reduce interference to human activities.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024093995_28112024_PF_FP_ABST
    Figure CN2024093995_28112024_PF_FP_ABST
Patent Text Reader

Abstract

The present application provides a control method and apparatus for a cleaning robot, a cleaning robot, and a storage medium. The control method for the cleaning robot comprises: acquiring a target region, wherein a target object is located in the target region, and the target object is comprised in image data collected by the cleaning robot; on the basis of the target region, planning a first cleaning track and a second cleaning track, wherein the first cleaning track does not comprise the target region, and the second cleaning track comprises the target region; and on the basis of the first cleaning track and at least part of the second cleaning track, controlling the cleaning robot to execute a cleaning task. According to the present application, the cleaning task is executed by means of two different cleaning tracks, and it is guaranteed that the cleaning robot does not affect the activity of a user in a room in the process of executing the cleaning task, thereby improving the efficiency of cleaning the room by the cleaning robot.
Need to check novelty before this filing date? Find Prior Art

Description

Control method and device of cleaning robot, cleaning robot and storage medium

[0001] This application claims priority to Chinese patent applications with application number "202310565986.6" filed on May 19, 2023, entitled "Control method, device, cleaning robot and storage medium for cleaning robot" and application number "202310567146.3" filed on May 19, 2023, entitled "Control method, device, readable storage medium and cleaning equipment for cleaning equipment", the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the technical field of cleaning equipment, and in particular to a control method and device for a cleaning robot, a cleaning robot, and a storage medium. Background Art

[0003] With the development of intelligent cleaning technology, cleaning robots are entering more and more households, greatly reducing the labor of house cleaning.

[0004] In related technologies, cleaning robots may encounter obstacles while cleaning a room. Typically, they will circumvent the obstacles and continue cleaning the room. However, when people are performing certain activities in the room, cleaning robots have often used people as obstacles and avoided them, affecting cleaning efficiency and disrupting people's normal activities in the room.

[0005] Application Contents

[0006] This application aims to solve one of the technical problems existing in the prior art or related technologies.

[0007] To this end, the first aspect of the present application proposes a control method for a cleaning robot.

[0008] A second aspect of the present application proposes a control method for a cleaning robot.

[0009] The third aspect of the present application proposes a control method for a cleaning robot.

[0010] A fourth aspect of the present application provides a control device for a cleaning robot.

[0011] A fifth aspect of the present application provides a control device for a cleaning robot.

[0012] A sixth aspect of the present application proposes a control device for a cleaning robot.

[0013] The seventh aspect of the present application proposes a control device for a cleaning robot.

[0014] An eighth aspect of the present application proposes a computer program product.

[0015] A ninth aspect of the present application proposes a readable storage medium.

[0016] The tenth aspect of the present application proposes a cleaning robot.

[0017] In view of this, according to the first aspect of the present application, a control method for a cleaning robot is proposed, including: acquiring a target area, a target object is in the target area, and the target object is included in the image data collected by the cleaning robot; based on the target area, planning a first cleaning trajectory and a second cleaning trajectory, the first cleaning trajectory does not include the target area, and the second cleaning trajectory includes the target area; based on the first cleaning trajectory and at least part of the second cleaning trajectory, controlling the cleaning robot to perform a cleaning task.

[0018] The technical solution of the present application proposes a control method for a cleaning robot, which is used to control the cleaning robot to re-plan the cleaning trajectory of the cleaning robot when it detects living things such as human bodies, so that the re-planned cleaning trajectory temporarily skips the area where living things such as human bodies are located, and then re-sweeps the area. This enables the cleaning robot to intelligently identify areas where people are active, avoid these areas, and re-sweep the areas where people are active to ensure the integrity of the cleaning.

[0019] In this technical solution, the cleaning robot includes an image acquisition device. When the cleaning robot is driving, the image acquisition device is turned on to shoot the scene around the cleaning robot, and semantic recognition is performed on the captured image data. When the target object is identified in the image data, the cleaning robot determines the target area where the target object is located. Among them, the target object includes the human body, pets, etc. The target area includes each room in the house. Specifically, after determining that there is a target object on the driving path of the cleaning robot through image recognition, the cleaning robot determines the current target area in combination with the semantic map. The cleaning robot can determine the operating scenario of the cleaning robot through the target object and the target area, and plan the first cleaning trajectory currently being cleaned by the cleaning robot and the second cleaning trajectory for subsequent cleaning based on the operating scenario, and determine the preset time interval between the two cleanings.

[0020] It should be noted that when the cleaning robot performs re-cleaning along the second cleaning trajectory, it may only perform cleaning along a portion of the second cleaning trajectory, that is, the cleaning robot can re-clean the target area in regions and batches.

[0021] Specifically, the first cleaning trajectory is the trajectory of the cleaning robot when performing a cleaning task, that is, the trajectory of the cleaning robot when the cleaning component is activated. The first cleaning trajectory is used to clean areas other than the target area. It should be noted that when the cleaning robot performs a cleaning task according to the first cleaning trajectory, the cleaning robot may need to pass through the target area. When passing through the target area, the cleaning robot stops cleaning the target area, passes through the target area by the shortest path, and continues cleaning according to the first cleaning trajectory.

[0022] The second cleaning trajectory is the path the cleaning robot follows to clean the target area. It should be noted that while performing the second cleaning task along the second cleaning trajectory, the cleaning robot may pass through non-target areas. However, the cleaning components will not be activated in non-target areas. Therefore, the second cleaning trajectory is determined to include only the target area. That is, the cleaning robot only cleans the target area while moving along the second cleaning trajectory.

[0023] In the technical solution of the present application, the cleaning robot detects the target object and the target area where the target object is located through image recognition during driving, and plans the first cleaning trajectory of the cleaning robot based on the target area, and plans the second cleaning trajectory for re-sweeping the target area. The cleaning task is performed by two different cleaning trajectories, which ensures that the cleaning robot will not affect the user's activities in the room during the execution of the cleaning task, and improves the efficiency of the cleaning robot in cleaning the room.

[0024] According to the second aspect of the present application, a control method for a cleaning robot is proposed, including: acquiring a target area, a target object is in the target area, and the target object is included in the image data collected by the cleaning robot; based on the target area, controlling the cleaning robot to clean according to a first cleaning trajectory, and the first cleaning trajectory does not include the target area; when the cleaning robot completes at least part of the first cleaning trajectory, controlling the cleaning robot to clean according to a second cleaning trajectory, and the second cleaning trajectory includes the target area.

[0025] The technical solution of this application proposes a control method for a cleaning robot, which is used to control the cleaning robot to replan a first cleaning trajectory and a second cleaning trajectory when a living thing such as a human body is detected. The first cleaning trajectory temporarily skips the target area where the living thing such as a human body is located. After at least part of the first cleaning trajectory is completed, the cleaning is performed according to the second cleaning trajectory that includes the target area to complete the re-sweeping of the target area. This enables the cleaning robot to intelligently identify the target area where human activity occurs, avoid the target area, and then re-sweep the target area where human activity occurs to ensure the integrity of the cleaning.

[0026] In this technical solution, a cleaning robot includes an image acquisition device. While the cleaning robot is in motion, the device is activated to capture the scene around the robot and perform semantic recognition on the captured image data. If a target object is identified in the image data, the cleaning robot determines the target area where the target object is located. Target objects include humans, pets, and other objects. The target area includes each room in a house.

[0027] Specifically, the first cleaning trajectory is the driving trajectory of the cleaning robot for cleaning non-target areas, and the second cleaning trajectory is the driving trajectory of the cleaning robot for cleaning target areas.

[0028] In the technical solution of the present application, the cleaning robot detects the target object and the target area where the target object is located through image recognition during driving, and preferentially cleans the non-target area through the first cleaning trajectory. After completing at least partial cleaning along the first cleaning trajectory, it then performs cleaning based on the second cleaning trajectory.

[0029] The first cleaning trajectory of the cleaning robot is planned based on the target area, and the second cleaning trajectory is planned for re-cleaning the target area. The cleaning task is performed by two different cleaning trajectories, ensuring that the cleaning robot will not affect the user's activities in the room during the cleaning task, and improving the efficiency of the cleaning robot in cleaning the room.

[0030] In the above technical solution, when the image data collected by the cleaning robot includes a target object, determining the target area where the target object is located includes: determining the first sub-map of the target object in the semantic map based on the semantic map and image data of the cleaning robot; and determining the area corresponding to the first sub-map as the target area.

[0031] This technical solution proposes a specific process for determining a target area in a room, thereby improving the accuracy of the determined target area.

[0032] During operation, the cleaning robot constructs a semantic map of the house. This map consists of multiple submaps, each corresponding to a room in the house. When the cleaning robot identifies a target object in image data, it uses the semantic map to determine the room in which the target object is located and identifies the first submap corresponding to that room as the target area.

[0033] It should be noted that the cleaning robots plan their cleaning trajectories based on the semantic maps pre-stored in the cleaning robots. Therefore, the first sub-map in the semantic map is selected as the target area to facilitate the subsequent planning of the cleaning trajectories of the cleaning robots.

[0034] In the technical solution of the present application, the first sub-map in the semantic map is determined as the target area through image data, which can ensure the accuracy of identifying the target area and improve the convenience of subsequent planning of the cleaning trajectory of the cleaning robot.

[0035] In any of the above technical solutions, the cleaning task includes a first cleaning task and a second cleaning task; based on the first cleaning trajectory and at least part of the second cleaning trajectory, the cleaning robot is controlled to perform the cleaning task, including: when the cleaning robot completes the first cleaning task according to the first cleaning trajectory and the target area meets the preset conditions, the cleaning robot is controlled to perform the second cleaning task according to at least part of the second cleaning trajectory.

[0036] In this technical solution, after completing the first cleaning task, the cleaning robot continues to detect whether the target area meets the preset conditions. When it is detected that the target area meets the preset conditions, it determines that the second cleaning task can be started to re-sweep the target area, ensuring that the cleaning robot will not affect the target object in the target area when performing re-sweeping.

[0037] In the technical solution of the present application, the first cleaning task is for the cleaning robot to clean along the first cleaning trajectory, i.e., the cleaning task in which the cleaning robot currently cleans the non-target area. The second cleaning task is for the cleaning robot to clean along the second cleaning trajectory, i.e., the cleaning task in which the cleaning robot supplements the target area.

[0038] Specifically, when the cleaning robot is performing the first cleaning task, it continuously detects the target area through the collected image data. When the target area meets the preset conditions, it starts to perform the second cleaning task to re-scan the target area.

[0039] In the technical solution of the present application, the cleaning robot can not only plan the corresponding first cleaning trajectory and second cleaning trajectory based on the target area, but also determine whether it can start to re-sweep the target area according to the second cleaning trajectory based on whether the target area meets the preset conditions, while ensuring the timeliness of the re-sweeping and avoiding the impact of the re-sweeping on the target object in the target area.

[0040] In any of the above technical solutions, the first cleaning task includes: when the cleaning robot is driving along the first cleaning trajectory, based on the cleaning robot driving in the non-target area, controlling the operation of the cleaning component of the cleaning robot; the second cleaning task includes: when the cleaning robot is driving along at least part of the second cleaning trajectory, based on the cleaning robot driving in the target area, controlling the operation of the cleaning component of the cleaning robot.

[0041] This technical solution proposes a specific process in which the cleaning robot performs the corresponding first cleaning task and the second cleaning task through the first cleaning trajectory. Among them, the first cleaning task includes the cleaning robot traveling along the first cleaning trajectory, and turning on the cleaning component for cleaning when it does not pass through the target area, and turning off the cleaning component when it passes through the target area. The cleaning robot performs the first cleaning task to ensure the effect of cleaning the non-target area and avoid affecting the user in the target area. Among them, the second cleaning task includes the cleaning robot traveling along the second cleaning trajectory, and turning off the cleaning component when it does not pass through the target area, and turning on the cleaning component for cleaning when it passes through the target area. The cleaning robot performs the second cleaning task to ensure the effect of cleaning the target area and avoid wasting electricity by performing a second cleaning on the area that has been cleaned.

[0042] Specifically, during the cleaning process according to the first cleaning trajectory, since the target area may be located between two non-target areas, when moving from one non-target area to another non-target area, the cleaning robot needs to be navigated to pass through the target area, and the cleaning component needs to be controlled to stop running when passing through the target area to avoid the noise generated during the cleaning process affecting the user's activities in the area.

[0043] It should be noted that, when planning the first cleaning trajectory, if it is detected that the cleaning robot must pass through the target area, the shortest path through the target area is planned as the path of the first cleaning trajectory passing through the target area.

[0044] In this technical solution, when the cleaning robot performs its first cleaning task, it moves along a first cleaning trajectory and stops its cleaning components when passing through a target area. The robot plans the first cleaning trajectory based on a semantic map. It identifies a first submap corresponding to the target area and a second submap corresponding to the non-target area. The robot then plans the first cleaning trajectory based on the positional relationship between the first and second submaps, ensuring that the portion of the first cleaning trajectory that passes through the first submap is the shortest path.

[0045] In the technical solution of the present application, when the cleaning robot performs the first cleaning task and the second cleaning task, the cleaning robot cleans the areas that need to be cleaned and avoids the areas that do not need to be cleaned, trying to ensure that it does not pass through the areas that do not need to be cleaned. If the areas that do not need to be cleaned cannot be avoided, the operation of the cleaning component is stopped to reduce the impact on users in the target area, and to ensure the cleaning effect of non-target areas after the cleaning robot performs the first cleaning task.

[0046] In any of the above technical solutions, after the cleaning robot completes the first cleaning task according to the first cleaning trajectory, the method further includes:

[0047] determining a secondary cleaning area in a non-target area based on a first image captured by the cleaning robot during the execution of a first cleaning task, wherein the first image is an image of the non-target area;

[0048] Based on the secondary cleaning area, the second cleaning trajectory is updated so that the second cleaning trajectory includes the target area and the secondary cleaning area.

[0049] This technical solution proposes that while the cleaning robot is performing a first cleaning task along a first cleaning trajectory, it continuously captures first images corresponding to non-target areas. By analyzing the first images, it can determine the secondary cleaning areas within the non-target areas that require re-sweeping after the first cleaning trajectory. Based on the determined secondary cleaning areas, the cleaning robot then replans a second cleaning trajectory to ensure that the cleaning robot can clean both the target area and the secondary cleaning area when performing the second cleaning trajectory.

[0050] Specifically, the secondary cleaning area may be an incompletely cleaned area in the non-target area. That is, when the cleaning robot cleans according to the first cleaning trajectory, it determines through the first image that there is an incompletely cleaned area and determines the area as the secondary cleaning area.

[0051] In the technical solution of the present application, the cleaning robot can continuously detect the secondary cleaning area in the non-target area passed by the first cleaning trajectory while cleaning according to the first cleaning trajectory, and can update the second cleaning trajectory based on the secondary cleaning area, further ensuring the cleaning effect of the cleaning robot when performing supplementary cleaning through the second cleaning trajectory.

[0052] In any of the above technical solutions, the preset conditions include: the time after the first cleaning task is completed reaches a preset time; and / or the target object leaves the target area.

[0053] This technical solution proposes a preset condition for the cleaning robot to determine whether to start a second cleaning task to clean the target area after completing the first cleaning task. The preset condition includes that the time after the completion of the first cleaning task reaches a preset time.

[0054] This technical solution proposes that before the cleaning robot performs the second cleaning task to re-clean the target area, a preset time duration needs to be determined, that is, to ensure that the cleaning robot starts to perform the second cleaning task to re-clean the target area after completing the first cleaning task for the preset time duration, so as to avoid premature re-cleaning affecting users in the target area.

[0055] It should be noted that the preset duration can be a duration set by the user according to actual needs, or it can be a preset duration obtained by the cleaning robot through analysis of the target area and the collected image data.

[0056] Specifically, after the cleaning robot plans a first cleaning trajectory and a second cleaning trajectory based on the image data and the semantic map, it determines the preset duration between the first and second cleaning tasks. When the cleaning robot completes the first cleaning task based on the first cleaning trajectory, it returns to the station and begins counting. When the count reaches the preset duration, the cleaning robot exits the station and begins executing the second cleaning task based on the second cleaning trajectory.

[0057] It should be noted that the preset duration between two cleaning tasks is related to the target object and target area identified by the cleaning robot, that is, the cleaning robot can plan the preset duration based on the target object and target area.

[0058] The preset condition includes that the time after the first cleaning task is completed reaches a preset time. The preset condition includes that the target object leaves the target area.

[0059] In this technical solution, the cleaning robot continuously collects image data of the target area when executing the first cleaning task, and performs image recognition on the collected image data, so as to determine whether the target object has left the target area.

[0060] In the technical solution of the present application, the cleaning robot can accurately determine whether the cleaning robot can start to perform re-sweeping according to the second cleaning trajectory by judging whether the time after the completion of the first cleaning task reaches the preset time and / or judging whether the target object has left the target area. This ensures that the cleaning robot can re-sweep the target area in a timely manner, while avoiding the impact of inappropriate timing of the cleaning robot's re-sweeping on the user.

[0061] In any of the above technical solutions, when the cleaning robot completes the first cleaning task according to the first cleaning trajectory and the target area meets the preset conditions, before controlling the cleaning robot to perform the second cleaning task according to at least part of the second cleaning trajectory, it also includes: determining a preset time duration based on the area category corresponding to the target area in the semantic map of the cleaning robot, wherein the area category includes one of the kitchen area, bedroom area, living room area, washroom area, and office area.

[0062] This technical solution provides a cleaning robot that can determine the area category of the target area based on the semantic information of the target area in the semantic map, and accordingly determine the preset time interval for re-sweeping the target area, so that the preset time interval matches the current actual scene.

[0063] It should be noted that the area categories are not limited to the above, and can also be customized by the user, for example: setting living room 1, living room 2, dining room 1, dining room 2, shower room, toilet, etc.

[0064] In the embodiment of the present application, by limiting the specific content of the area category, it is ensured that the area category of the target area can be identified, and the preset duration of the corresponding interval can be accurately determined according to the area category.

[0065] It should be noted that the cleaning robot pre-stores a mapping between area categories and preset durations. After determining the area category, the cleaning robot can use this mapping to find the corresponding preset duration. Users can also customize the mapping based on their actual needs to ensure that the preset duration found based on the area category meets their needs. Preset area categories can correspond to multiple preset durations, and each preset duration can be associated with other judgment criteria, such as the current time.

[0066] In the technical solution of the present application, after identifying the target area, the cleaning robot can determine the specific area category corresponding to the target area through the semantic map, and determine the preset duration of the corresponding interval based on the area category, to ensure that the re-sweeping process matches the actual application scenario of the cleaning robot.

[0067] In any of the above technical solutions, when the cleaning robot completes the first cleaning task according to the first cleaning trajectory and the target area meets the preset conditions, before controlling the cleaning robot to perform the second cleaning task according to at least part of the second cleaning trajectory, it also includes: identifying target features in the image data; determining a preset time length based on the posture and / or parameters of the target features, wherein the target features include one of the door features, window features, and home appliance features.

[0068] This technical solution proposes that the cleaning robot identifies the posture and / or parameters of the target feature in the image data and searches for the corresponding preset time based on the posture and / or parameters.

[0069] In the technical solution of this application, the posture of the target feature includes but is not limited to the opening and closing posture of the door, the opening and closing posture of the window, the placement posture of the home appliance, etc. The parameters of the target feature include but are not limited to the size parameters of the door, the size parameters of the window, the size parameters and operating parameters of the home appliance, etc.

[0070] Specifically, after identifying a target object, the cleaning robot identifies the background area in the image data. If the image data also includes target features, the robot detects the posture and / or parameters of the target features, selecting different preset durations based on different postures. It should be noted that the target object is a living object in the image data, such as a pet or human body. The target features are the features of objects in the image data, such as doors, windows, and household appliances.

[0071] In the technical solution of the present application, the cleaning robot can analyze the actual scene in which the cleaning robot is located through the posture and / or parameters of the target features in the collected image data, and set the preset duration of the corresponding interval accordingly to ensure the success rate of the cleaning robot in performing the second cleaning task of make-up sweeping, and avoid the make-up sweeping process from having an adverse impact on users in the target area.

[0072] In any of the above technical solutions, when the cleaning robot completes the first cleaning task according to the first cleaning trajectory and the target area meets the preset conditions, before controlling the cleaning robot to perform the second cleaning task according to at least part of the second cleaning trajectory, it also includes: collecting a second image corresponding to the target area; and determining whether the target object leaves the target area based on the second image.

[0073] This technical solution proposes that before the cleaning robot performs supplementary sweeping according to the second cleaning trajectory, it uses an image acquisition device to capture a second image corresponding to the target area, performs image recognition on the second image, and determines whether the target object has left the target area, thereby achieving accurate control of whether the cleaning robot starts supplementary sweeping.

[0074] In any of the above technical solutions, before acquiring the target area, the method includes: controlling an image acquisition device of the cleaning robot to continuously acquire image data while the cleaning robot performs the third cleaning task according to the third cleaning trajectory.

[0075] This technical solution proposes that when the cleaning robot performs the corresponding third cleaning task according to the preset third cleaning trajectory after leaving the station, the image acquisition device is turned on to continuously collect image data, so as to facilitate the subsequent re-planning of the corresponding first cleaning trajectory and the second cleaning trajectory for supplementary cleaning based on the collected image data including the target object.

[0076] Specifically, before the cleaning robot leaves the station to perform the third cleaning task, it plans a corresponding third cleaning trajectory based on a pre-stored semantic map. This third cleaning trajectory can be a trajectory that cleans the entire house. After leaving the station, the cleaning robot activates its image acquisition device and continues to capture images of the surrounding environment. After acquiring image data including the target object, it promptly plans the first and second cleaning trajectories, stops the current third cleaning trajectory, and cleans the house according to the first cleaning trajectory. After the preset cleaning time, the house is cleaned again according to the second cleaning trajectory.

[0077] In the technical solution of the present application, by controlling the cleaning robot to keep the image acquisition device turned on after leaving the station, the cleaning robot can obtain the current surrounding environment in a timely manner, thereby improving the efficiency of replanning the first cleaning trajectory.

[0078] According to the third aspect of the present application, a control method for a cleaning robot is proposed, comprising: when the image data collected by the cleaning robot includes a target object, determining the first area of ​​the target object in the map; obtaining the operating status of the target device corresponding to the first area; after the cleaning robot completes cleaning the second area in the map, controlling the cleaning robot to clean the first area based on the operating status of the target device.

[0079] The technical solution of this application proposes a control method for a cleaning robot. This control method can control the cleaning robot to identify a first area where a target object is located, replan its current cleaning trajectory, temporarily avoid the first area where the target object is active, and plan a subsequent re-cleaning path for the first area. The cleaning robot can also interact with other household devices to identify the user's activity status in the first area, thereby determining whether to initiate re-cleaning of the first area, thereby preventing the cleaning robot from adversely affecting the user during re-cleaning.

[0080] In this technical solution, the cleaning robot includes an image acquisition device. When the cleaning robot is driving, the image acquisition device is turned on to photograph the scene around the cleaning robot, and semantic recognition is performed on the photographed image data. When the target object is identified in the image data, the cleaning robot can determine the first area where the target object is located in combination with the map.

[0081] It should be noted that the target object includes a human body, a pet, etc. The map includes multiple areas, each of which corresponds to a room in a house. When the cleaning robot recognizes that the image data includes the target object, it determines a first area corresponding to the area where the target object is located in the image data based on the map.

[0082] In this technical solution, the cleaning robot communicates with multiple other household devices and can obtain the location information of these connected household devices. After determining the first area where the target object is located, the cleaning robot can find the target device located in the area where the first area is located. The target device is one of the multiple other household devices connected to the cleaning robot. By exchanging data with the target device, the operating status of the target device is obtained, and based on the operating status of the target device, it is determined whether to start re-cleaning the first area. Based on the operating status of the target device in the area corresponding to the first area, the cleaning robot can estimate whether the user has left the first area, ensuring that after the cleaning robot starts re-cleaning, the re-cleaning process will not adversely affect the user's activities in the area.

[0083] It should be noted that the target object can be a human body, or a living creature such as a pet dog or cat.

[0084] In this technical solution, after finding the first area, the cleaning robot can also use the remaining areas in the map as the second area and replan the current cleaning trajectory based on the second area. The cleaning robot begins cleaning the second area according to the replanned cleaning trajectory. After cleaning is completed, the cleaning robot is controlled to re-clean the corresponding area of ​​the first area based on the operating status of the target device.

[0085] In the technical solution of the present application, the cleaning robot detects the target object through image recognition during driving, and determines the first area corresponding to the area where the target object is located. The operating status of the target device in the first area is used to determine whether to start re-sweeping the first area, so that the cleaning robot can judge and estimate the current operating scenario through the Internet of Things, and realize that the cleaning robot can avoid the area where the first area is located in the current cleaning stage, avoiding the current cleaning process from affecting the user, and can also promptly re-sweep the uncleaned area in the future, and can ensure that the re-sweeping stage will not have an adverse effect on the user's activities.

[0086] In the above technical solution, after the cleaning robot completes cleaning the second area in the map, the cleaning robot is controlled to clean the first area based on the operating status of the target device, including: determining a preset duration based on the operating status of the target device; after the cleaning robot completes cleaning the second area, the cleaning robot is controlled to clean the first area at an interval of a target duration, the target duration is associated with the preset duration and the cleaning duration, and the cleaning duration is the duration for the cleaning robot to clean the second area.

[0087] This technical solution proposes that the cleaning robot can determine the target duration of the interval between the current cleaning phase and the re-sweeping phase based on the operating status of the target equipment in the first area. While ensuring the timeliness of the re-sweeping of the first area, it can also avoid the re-sweeping phase affecting the activities of the target object in the first area.

[0088] In the technical solution of the present application, the preset duration matches the operating state of the target device, and the corresponding preset duration can be found based on the operating state of the target device by looking up a table. The target duration is the actual interval required after the cleaning robot completes cleaning the second area. Since the cleaning robot takes a certain cleaning time to clean the second area, the target duration is the duration calculated based on the preset duration and the cleaning time.

[0089] In the technical solution of the present application, a plurality of first devices in the map are screened through the first area in the map to determine the target device therein, thereby ensuring the matching of the target device with the first area. After determining the target device, the cleaning robot communicates with the target device to determine the operating status of the target device. The corresponding preset duration is determined according to the operating status, and the target duration is set in combination with the cleaning duration of the cleaning robot for cleaning the second area, thereby improving the matching degree between the target duration for determining the re-sweeping interval and the operating status of the target device corresponding to the first area, and ensuring that the cleaning robot re-sweeps the first area after the target duration, without affecting the user.

[0090] In any of the above technical solutions, after the cleaning robot completes cleaning the second area, before controlling the cleaning robot to clean the first area after a target duration, it includes: when the cleaning time is greater than or equal to the preset time, determining the target time as 0; when the cleaning time is less than the preset time, determining the difference between the preset time and the cleaning time as the target time.

[0091] In this technical solution, the cleaning time required for the cleaning robot to clean the second area is compared with the preset time, and based on the numerical relationship between the cleaning time obtained by comparison and the preset time, the target time corresponding to the required interval is set to ensure the timeliness of the cleaning robot's re-sweeping and avoid the impact of the cleaning robot on the user during the re-sweeping stage.

[0092] Specifically, the preset duration is T1, and the cleaning duration is T2. When T2 ≥ T1, it is determined that after the cleaning robot completes cleaning the second area, it will not cause adverse effects on the user if it immediately re-sweeps the first area, so the target duration of the required interval is set to 0, that is, the cleaning robot immediately re-sweeps the first area after completing cleaning the second area. When T2 < T1, in order to avoid the re-sweeping stage affecting the user, it is determined that after the cleaning robot completes cleaning the second area, it still needs to wait for a certain period of time before starting to re-sweep the first area. By calculating the difference T = T1-T2, and taking the difference T as the target duration, the cleaning robot will re-sweep the first area after completing cleaning the second area and after the target duration T.

[0093] The cleaning time is obtained by timing the cleaning robot during operation.

[0094] In the technical solution of the present application, the cleaning robot can accurately determine the target time required for the cleaning robot to complete cleaning the second area by comparing the cleaning time corresponding to the second area with the preset time, ensuring that re-cleaning of the second area after the target time will not affect the user, and also improves the timeliness of the re-cleaning.

[0095] In any of the above technical solutions, the preset duration is determined based on the operating status of the target device, including: locating multiple first devices that match the map; filtering the target device from the multiple first devices through the first area; obtaining the operating status of the target device; and determining the preset duration based on the corresponding relationship between the operating status of the target device and the preset.

[0096] This technical solution proposes a specific process of searching for a corresponding target device based on a map and setting a preset duration based on the operating status of the target device.

[0097] Specifically, the cleaning robot obtains the positioning information of other household devices. Based on the positioning information, the cleaning robot can find multiple first devices located within the map range, that is, the coordinates of the multiple first devices are all within the map. The cleaning robot can determine the target device among the multiple first devices based on the range of the first area in the map, that is, the coordinates of the target device are located within the first area. Due to the communication connection between the cleaning robot and the target device, the cleaning robot can obtain the operating status of the target device. The cleaning robot has a preset correspondence between the target device and the preset time length. After determining the target device, the cleaning robot can obtain the corresponding preset time length by searching the preset correspondence.

[0098] In some possible implementations, the cleaning robot obtains the positioning information of other household appliances, including: during the map construction process, the cleaning robot constructs an object bounding box of other household appliances, that is, the coordinate information of other household appliances is stored in the map, and the coordinate information of other household appliances is read and used as positioning information.

[0099] In some other possible implementations, the cleaning robot obtains the positioning information of other household appliances, including: the cleaning robot is communicatively connected with other household appliances, the other household appliances have positioning functions, and the cleaning robot reads the positioning information of other household appliances by communicating with other household appliances.

[0100] In the technical solution of the present application, a plurality of first devices in the map are screened through a first area in the map to determine a target device, thereby ensuring that the target device matches the first area. After determining the target device, the cleaning robot communicates with the target device to determine the operating status of the target device and sets a preset duration accordingly, thereby improving the degree of matching between the preset duration for determining the re-sweep interval and the operating status of the target device corresponding to the first area, ensuring that the cleaning robot re-sweeps the first area after the preset duration without affecting the user.

[0101] In any of the above technical solutions, the number of target devices is at least two; the preset duration is determined based on the operating status of the target device and the preset correspondence, including: obtaining the operating status and preset correspondence of at least two target devices, and determining at least two interval durations; determining the preset duration based on at least two interval durations.

[0102] This technical solution proposes that when multiple target devices are included in the first area, the cleaning robot sets corresponding preset durations according to multiple interval durations corresponding to the multiple target devices, further improving the degree of matching between the set preset durations and the actual scene.

[0103] Specifically, when the first area includes multiple target devices, the interval duration corresponding to each target device is searched based on the preset correspondence to obtain multiple interval durations. After obtaining the multiple interval durations, one of the multiple interval durations can be selected as the preset duration by screening, or the corresponding preset duration can be obtained by performing mathematical calculations on the multiple interval durations.

[0104] In the technical solution of the present application, when there are multiple target devices corresponding to the first area, the cleaning robot can integrate the interval durations corresponding to the multiple target devices to determine the corresponding preset duration, further improving the degree of matching between the preset duration and the actual scene of the first area.

[0105] In any of the above technical solutions, the preset duration is an average value of at least two interval durations; or the preset duration is a maximum value of at least two interval durations; or the preset duration is a minimum value of at least two interval durations.

[0106] This technical solution proposes multiple methods for determining a preset duration based on multiple interval durations. These methods include calculating the average of multiple interval durations and using the calculated average as the preset duration. Another method involves taking the maximum or minimum value of multiple interval durations and using that value as the preset duration.

[0107] Optionally, the user can select any of the above methods according to actual needs and determine the preset duration from multiple interval durations.

[0108] Optionally, the cleaning robot selects any of the above methods based on the first area category and determines a preset duration from multiple interval durations. That is, the preset duration is determined based on the area category corresponding to the first area and the multiple interval durations, where the preset duration includes any one of a maximum value, a minimum value, or an average value of the multiple interval durations. The area category includes at least one of a living room area, a kitchen area, and a bedroom area.

[0109] In the technical solution of the present application, by setting the preset duration to the maximum value, minimum value or average value among multiple interval durations, it is possible to further ensure that the preset duration matches the actual scene of the area corresponding to the first area, thereby ensuring the timeliness of re-scanning the area while avoiding adverse effects on the user during the re-scanning.

[0110] In any of the above technical solutions, after the cleaning robot completes cleaning the second area in the map, based on the operating status of the target device, the cleaning robot is controlled to clean the first area, including: after the cleaning robot completes cleaning the second area, based on the operating status of the target device, determining the activity status of the target object in the first area; based on the activity status of the target object in the first area meeting the preset conditions, controlling the cleaning robot to clean the first area.

[0111] This technical solution proposes that after the cleaning robot completes cleaning the second area, it continuously monitors the operating status of the target equipment in the first area and uses this information to determine whether the current supplemental cleaning will affect the target objects in the first area. If the cleaning robot determines that supplemental cleaning will not affect the target objects, it controls the cleaning robot to begin supplemental cleaning of the first area.

[0112] In the technical solution of the present application, the cleaning robot can determine the activity state of the target object based on the operating state of the target device. Specifically, the cleaning robot can find the activity state of the target object based on the operating state of the target device according to a preset mapping relationship. Exemplarily, the preset mapping relationship can be stored in a local storage area of ​​the cleaning robot or in the cloud.

[0113] In the technical solution of this application, when a first area includes multiple target devices, the target object's activity state is determined based on the operating states of the multiple target devices. This fully combines the operating states of the multiple different devices to improve the accuracy of the target object's activity state determination. The activity state meeting a preset state includes, but is not limited to, the target object leaving the first area.

[0114] In the technical solution of the present application, the cleaning robot can judge the activity status of the target object according to the operating status of the target device, and judge whether to start re-sweeping the first area accordingly, so that the cleaning robot can quickly re-sweep the first area after the target object leaves the first area, ensuring the timeliness of the re-sweeping and avoiding the impact of the re-sweeping on the target object in the first area.

[0115] In any of the above technical solutions, after the cleaning robot completes cleaning the second area in the map, based on the operating status of the target device, before controlling the cleaning robot to clean the first area, it includes: planning a fourth cleaning trajectory based on the second area; controlling the cleaning robot to travel along the fourth cleaning trajectory.

[0116] This technical solution provides a detailed process for the cleaning robot to clean the second area. This includes planning a fourth cleaning trajectory based on the second area in the map, driving the cleaning robot along the planned fourth cleaning trajectory, and monitoring the operating status of the cleaning component of the cleaning robot during driving, ensuring that the cleaning component is turned off when the cleaning robot passes through the first area, avoiding any impact on the user's activities in the first area.

[0117] Specifically, during the cleaning process according to the fourth cleaning trajectory, since the first area may be located between two second areas, when moving from one of the second areas to another second area, the cleaning robot needs to be navigated to pass through the first area, and the cleaning component is controlled to stop running when passing through the first area to avoid the noise generated during the cleaning process affecting the user's activities in the area, and the cleaning component is operated when the cleaning robot passes through the second area to clean the second area.

[0118] It should be noted that, when planning the fourth cleaning trajectory, if it is detected that the cleaning robot must pass through the first area, the shortest path through the first area is planned as the path of the fourth cleaning trajectory passing through the first area.

[0119] In the technical solution of the present application, when the cleaning robot passes through the second area, the cleaning component is kept in an on state to ensure that the cleaning robot can normally clean the second area in the house.

[0120] In any of the above technical solutions, the cleaning robot is controlled to clean according to the fourth cleaning trajectory, including: the fourth cleaning trajectory includes the first area and the second area, and when the cleaning robot is driving in the first area, the cleaning component of the cleaning robot is controlled to stop running, and when the cleaning robot is driving in the second area, the cleaning component is controlled to run; the fourth cleaning trajectory includes the second area and does not include the first area, and when the cleaning robot is controlled to drive along the fourth cleaning trajectory, the cleaning component is kept in an operating state.

[0121] This technical solution proposes that when the cleaning robot's planned fourth cleaning trajectory passes through the first and second areas, the cleaning robot turns off the cleaning component while traveling in the first area and uses the cleaning component only to clean the second area. If the cleaning robot's planned fourth cleaning trajectory passes only through the second area, the cleaning robot maintains the operation of the cleaning component while cleaning along the fourth cleaning trajectory, thereby cleaning the second area.

[0122] Specifically, when planning the fourth cleaning trajectory, the cleaning robot determines that the fourth cleaning trajectory passes through the first area. To ensure complete cleaning of the second area, if it cannot avoid the first area, the robot plans the shortest path through the first area. During the actual cleaning process, when the robot passes through the first area, the cleaning component is turned off to prevent noise from the cleaning component from disturbing the user.

[0123] In the technical solution of the present application, the cleaning robot cleans the second area and avoids the location of the first area, trying to ensure that it does not pass through the first area. If the first area cannot be avoided, the cleaning component will be stopped to reduce the impact on users in the first area and ensure the cleaning effect of the cleaning robot on the second area.

[0124] In any of the above technical solutions, the target device includes at least one of an electric rice cooker, a water heater, an air conditioner, an electric curtain, a television, a water dispenser, a hair dryer, and a washing machine.

[0125] This technical solution proposes that the target devices include at least one of: rice cookers, water heaters, air conditioners, electric curtains, televisions, water dispensers, hair dryers, and washing machines. That is, all smart IoT home devices can be used as target devices to communicate with the cleaning robot.

[0126] It should be noted that the cleaning robot can simply identify the user's activity scene in the corresponding area based on different target devices in different operating states, and set the corresponding target time.

[0127] In the technical solution of the present application, by setting different types of equipment as target devices, the accuracy of the target time determined by the target device can be improved, ensuring that after the target time of cleaning the second area is completed, when the first area is cleaned, it will not affect the activities of people in the first area.

[0128] In any of the above technical solutions, when the image data collected by the cleaning robot includes the target object, before determining that the target object is in the first area in the map, it includes: planning a fifth cleaning trajectory based on the map; controlling the cleaning robot to clean according to the fifth cleaning trajectory; and during the cleaning process of the cleaning robot, controlling the image acquisition device of the cleaning robot to continuously collect image data.

[0129] This technical solution proposes that when the cleaning robot cleans according to the preset fifth cleaning trajectory after leaving the station, the image acquisition device is turned on to continuously collect image data, so as to facilitate the subsequent re-planning of the corresponding fourth cleaning trajectory and the fifth cleaning trajectory for supplementary cleaning based on the collected image data including the target object.

[0130] Specifically, before the cleaning robot leaves the station to clean according to the preset fifth cleaning trajectory, it plans a corresponding fifth cleaning trajectory based on a pre-stored map. This fifth cleaning trajectory can be a trajectory for cleaning the entire house. After leaving the station, the cleaning robot activates the image acquisition device and continues to capture images of the surrounding environment. After collecting image data including the target object, it promptly plans the fourth and fifth cleaning trajectories, stops the current fifth cleaning trajectory, cleans the house according to the fourth cleaning trajectory, and after cleaning for a preset period of time, performs a follow-up cleaning according to the fifth cleaning trajectory.

[0131] In the technical solution of the present application, by controlling the cleaning robot to keep the image acquisition device turned on after leaving the station, the cleaning robot can obtain the current surrounding environment in a timely manner, thereby improving the efficiency of re-planning the fourth cleaning trajectory.

[0132] In any of the above technical solutions, planning the fifth cleaning trajectory based on the map includes: obtaining positioning information of the second device in the map, where the second device is a household device in operation; and planning the fifth cleaning trajectory according to the positioning information.

[0133] This technical solution proposes that the cleaning robot plans the fifth cleaning trajectory based on the positioning information of the household appliances in operation in the map before leaving the station. This ensures that the operating status of the household appliances in the house is fully considered before cleaning begins, reducing the number of times the cleaning robot replans the path after leaving the station.

[0134] Specifically, while the cleaning robot is still inside the station, it communicates with the household devices on the map to obtain the operating status of all the devices on the map. It then locates a second device that is in operation and, based on the second device's location information, plans a fifth cleaning trajectory. Based on the second device's location information, the cleaning robot can estimate the user's activity range and duration within the house, thereby planning the fifth cleaning trajectory. This trajectory avoids the user's activity range and reduces the likelihood of having to temporarily replan the fourth cleaning trajectory.

[0135] In the technical solution of the present application, the cleaning robot plans the fifth cleaning trajectory through the positioning information of the second device in operation without leaving the station, thereby reducing the possibility of the cleaning robot replanning the path during the cleaning process.

[0136] In any of the above technical solutions, the map includes any of the following: a semantic map, an image map.

[0137] In this technical solution, the map stored in the sweeper can be a semantic map or an image map.

[0138] In the technical solution of the present application, by setting the map as a semantic map or an image map, the accuracy of the cleaning trajectory automatically planned by the sweeper can be improved, thereby ensuring the cleaning effect and efficiency of the sweeper in cleaning the house based on the map.

[0139] According to the fourth aspect of the present application, a control device for a cleaning robot is proposed, including: an acquisition module for acquiring a target area, a target object is in the target area, and the target object is included in the image data collected by the cleaning robot; a planning module for planning a first cleaning trajectory and a second cleaning trajectory based on the target area, the first cleaning trajectory does not include the target area, and the second cleaning trajectory includes the target area; a control module for controlling the cleaning robot to perform a cleaning task based on the first cleaning trajectory and at least part of the second cleaning trajectory.

[0140] The technical solution of the present application proposes a control device for a cleaning robot, which is used to control the cleaning robot to re-plan the cleaning trajectory of the cleaning robot when it detects living things such as human bodies, so that the re-planned cleaning trajectory temporarily skips the area where living things such as human bodies are located, and then re-sweeps the area. This enables the cleaning robot to intelligently identify areas where people are active, avoid these areas, and re-sweep the areas where people are active to ensure the integrity of the cleaning.

[0141] In the technical solution of the present application, the cleaning robot detects the target object and the target area where the target object is located through image recognition during driving, and plans the first cleaning trajectory of the cleaning robot based on the target area, and plans the second cleaning trajectory for re-cleaning the target area. The cleaning task is performed by two different cleaning trajectories, which ensures that the cleaning robot will not affect the user's activities in the room during the cleaning process, and improves the efficiency of the cleaning robot in cleaning the room.

[0142] According to the fifth aspect of the present application, a control device for a cleaning robot is proposed, including: an acquisition module for acquiring a target area, a target object is in the target area, and the target object is included in the image data collected by the cleaning robot; a control module for controlling the cleaning robot to clean according to a first cleaning trajectory based on the target area, and the first cleaning trajectory does not include the target area; a control module for controlling the cleaning robot to clean according to a second cleaning trajectory when the cleaning robot completes at least part of the first cleaning trajectory, and the second cleaning trajectory includes the target area.

[0143] The technical solution of this application proposes a control device for a cleaning robot, which is used to control the cleaning robot to replan a first cleaning trajectory and a second cleaning trajectory when a living being such as a human body is detected. The first cleaning trajectory temporarily skips over a target area where a living being such as a human body is located. After at least part of the first cleaning trajectory is completed, the cleaning robot proceeds along a second cleaning trajectory that includes the target area, completing a re-sweep of the target area. This enables the cleaning robot to intelligently identify target areas where people are active, avoid the target areas, and then re-sweep the target areas where people are active, thereby ensuring the integrity of the cleaning process.

[0144] In this technical solution, a cleaning robot includes an image acquisition device. While the cleaning robot is in motion, the device is activated to capture the scene around the robot and perform semantic recognition on the captured image data. If a target object is identified in the image data, the cleaning robot determines the target area where the target object is located. Target objects include humans, pets, and other objects. The target area includes each room in a house.

[0145] Specifically, the first cleaning trajectory is the driving trajectory of the cleaning robot for cleaning non-target areas, and the second cleaning trajectory is the driving trajectory of the cleaning robot for cleaning target areas.

[0146] In the technical solution of the present application, the cleaning robot detects the target object and the target area where the target object is located through image recognition during driving, and preferentially cleans the non-target area through the first cleaning trajectory. After completing at least partial cleaning along the first cleaning trajectory, it then performs cleaning based on the second cleaning trajectory.

[0147] The first cleaning trajectory of the cleaning robot is planned based on the target area, and the second cleaning trajectory is planned for re-cleaning the target area. The cleaning task is performed by two different cleaning trajectories, ensuring that the cleaning robot will not affect the user's activities in the room during the cleaning task, and improving the efficiency of the cleaning robot in cleaning the room.

[0148] According to the sixth aspect of the present application, a control device for a cleaning robot is proposed, including: a determination module for determining the first area of ​​the target object in the map when the image data collected by the cleaning robot includes the target object; an acquisition module for acquiring the operating status of the target device corresponding to the first area; and a control module for controlling the cleaning robot to clean the first area based on the operating status of the target device after the cleaning robot completes cleaning the second area in the map.

[0149] The technical solution of this application proposes a control device for a cleaning robot. The control device can control the cleaning robot to identify a first area where a target object is located, replan its current cleaning trajectory to temporarily avoid the first area where the target object is active, and plan a subsequent re-cleaning path for the first area. The cleaning robot can also interact with other household devices to identify the user's activity status in the first area and thus decide whether to initiate re-cleaning of the first area, thereby preventing the cleaning robot from adversely affecting the user during re-cleaning.

[0150] In the technical solution of the present application, the cleaning robot detects the target object through image recognition during driving, and determines the first area corresponding to the area where the target object is located. The operating status of the target device in the first area is used to determine whether to start re-sweeping the first area, so that the cleaning robot can judge and estimate the current operating scenario through the Internet of Things, and realize that the cleaning robot can avoid the area where the first area is located in the current cleaning stage, avoiding the current cleaning process from affecting the user, and can also promptly re-sweep the uncleaned area in the future, and can ensure that the re-sweeping stage will not have an adverse effect on the user's activities.

[0151] According to the seventh aspect of the present application, a control device for a cleaning robot is proposed, comprising: a memory, in which programs or instructions are stored; a processor, which executes the programs or instructions stored in the memory to implement the steps of the control method for the cleaning robot in any of the above-mentioned technical solutions, thereby having all the beneficial technical effects of the control method for the cleaning robot in any of the above-mentioned technical solutions, and no further details will be given here.

[0152] According to the eighth aspect of the present application, a computer program product is proposed. When the computer program product is executed by a processor, it implements the steps of the control method of the cleaning robot in any of the above-mentioned technical solutions, and thus has all the beneficial technical effects of the control method of the cleaning robot in any of the above-mentioned technical solutions, which will not be elaborated here.

[0153] According to a ninth aspect of the present application, a readable storage medium is provided, wherein the readable storage medium stores a program or instructions. When the program or instructions are executed by a processor, the program or instructions implement the steps of the control method of the cleaning robot described in any of the above technical solutions. Therefore, all the beneficial technical effects of the control method of the cleaning robot described in any of the above technical solutions are achieved, and no further details will be given here.

[0154] According to the tenth aspect of the present application, a cleaning robot is proposed, comprising: a control device of the cleaning robot as in any of the above-mentioned technical solutions, and / or a computer program product in any of the above-mentioned technical solutions, and / or a readable storage medium in any of the above-mentioned technical solutions, and thus having all the beneficial technical effects of the control device of the cleaning robot in any of the above-mentioned technical solutions, and / or the computer program product in any of the above-mentioned technical solutions, and / or the readable storage medium in any of the above-mentioned technical solutions, which will not be elaborated on here.

[0155] Additional aspects and advantages of the present application will become apparent in the following description or may be learned through practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0156] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:

[0157] FIG1 shows one of the schematic flow charts of the control method of the cleaning robot provided in some embodiments of the present application;

[0158] FIG2 shows a second schematic flow chart of a control method for a cleaning robot provided in some embodiments of the present application;

[0159] FIG3 shows a third schematic flow chart of a control method for a cleaning robot provided in some embodiments of the present application;

[0160] FIG4 shows one of the schematic diagrams of the first planned trajectory provided in some embodiments of the present application;

[0161] FIG5 shows a second schematic diagram of a first planned trajectory provided in some embodiments of the present application;

[0162] FIG6 shows a fourth schematic flow chart of a control method for a cleaning robot provided in some embodiments of the present application;

[0163] FIG7 shows a fifth schematic flow chart of a control method for a cleaning robot provided in some embodiments of the present application;

[0164] FIG8 shows a sixth schematic flow chart of a control method for a cleaning robot provided in some embodiments of the present application;

[0165] FIG9 shows a seventh schematic flow chart of a control method for a cleaning robot provided in some embodiments of the present application;

[0166] FIG10 shows an eighth schematic flow chart of a control method for a cleaning robot provided in some embodiments of the present application;

[0167] FIG11 shows a ninth schematic flow chart of a control method for a cleaning robot provided in some embodiments of the present application;

[0168] FIG12 shows a tenth schematic flow chart of a control method for a cleaning robot provided in some embodiments of the present application;

[0169] FIG13 shows an eleventh schematic flow chart of a control method for a cleaning robot provided in some embodiments of the present application;

[0170] FIG14 shows a twelfth schematic flow chart of a control method for a cleaning robot provided in some embodiments of the present application;

[0171] FIG15 shows a thirteenth schematic flow chart of a control method for a cleaning robot provided in some embodiments of the present application;

[0172] FIG16 shows a structural block diagram of a control device of a cleaning robot provided in some embodiments of the present application;

[0173] FIG17 shows a structural block diagram of a control device of a cleaning robot provided in some embodiments of the present application;

[0174] FIG18 shows a structural block diagram of a control device of a cleaning robot provided in some embodiments of the present application;

[0175] FIG19 shows a structural block diagram of a control device of a cleaning robot provided in some embodiments of the present application;

[0176] FIG20 shows a structural block diagram of a cleaning robot provided in some embodiments of the present application. DETAILED DESCRIPTION

[0177] In order to more clearly understand the above-mentioned objectives, features and advantages of the present application, the present application is further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be noted that, in the absence of conflict, the features of this embodiment and the embodiments can be combined with each other.

[0178] In the following description, many specific details are set forth to facilitate a full understanding of the present application. However, the present application may also be implemented in other ways different from those described herein. Therefore, the scope of protection of the present application is not limited to the specific embodiments disclosed below.

[0179] The following describes a control method, device, cleaning robot, and storage medium for a cleaning robot according to some embodiments of the present application with reference to Figures 1 to 20.

[0180] According to one embodiment of the present application, as shown in FIG1 , a control method for a cleaning robot is proposed, including:

[0181] Step 102, acquiring a target area, wherein a target object is located in the target area, and the target object is included in image data collected by the cleaning robot;

[0182] In this embodiment, when the image data collected by the cleaning robot includes a target object, a target area where the target object is located is determined;

[0183] Step 104: planning a first cleaning trajectory and a second cleaning trajectory based on the target area, wherein the first cleaning trajectory does not include the target area, and the second cleaning trajectory includes the target area;

[0184] Step 106 : Control the cleaning robot to perform a cleaning task based on the first cleaning trajectory and at least a portion of the second cleaning trajectory.

[0185] In an embodiment of the present application, a control method for a cleaning robot is proposed, which is used to control the cleaning robot to re-plan the cleaning trajectory of the cleaning robot when it detects living things such as human bodies, so that the re-planned cleaning trajectory temporarily skips the area where living things such as human bodies are located, and then re-sweeps the area. This enables the cleaning robot to intelligently identify areas where people are active, avoid these areas, and re-sweep the areas where people are active to ensure the integrity of the cleaning.

[0186] In this embodiment, the cleaning robot includes an image acquisition device. During the driving process of the cleaning robot, the image acquisition device is turned on to shoot the scene around the cleaning robot, and semantic recognition is performed on the image data obtained by shooting. When the target object is identified in the image data, the cleaning robot determines the target area where the target object is located. Among them, the target object includes the human body, pets, etc. The target area includes each room in the house. Specifically, after determining that there is a target object on the driving path of the cleaning robot through image recognition, the cleaning robot determines the current target area in combination with the semantic map. The cleaning robot can determine the operating scenario of the cleaning robot through the target object and the target area, and plan the first cleaning trajectory currently being cleaned by the cleaning robot and the second cleaning trajectory for subsequent sweeping based on the operating scenario, and determine the preset time interval between the two cleanings.

[0187] It should be noted that when the cleaning robot performs re-cleaning along the second cleaning trajectory, it may only perform cleaning along a portion of the second cleaning trajectory, that is, the cleaning robot can re-clean the target area in regions and batches.

[0188] For example, while a user is cooking in the kitchen, the cleaning robot identifies the kitchen as its target area. During a follow-up sweep of the kitchen, based on the collected image data, it determines that the user is still in the kitchen, but their movements are concentrated near the integrated stove. The cleaning robot then cleans the rest of the kitchen. The second cleaning trajectory passes through the entire kitchen area, and during the follow-up sweep, the cleaning robot only follows a portion of the second cleaning trajectory. After this follow-up sweep is complete, the cleaning robot can perform a second follow-up sweep of the kitchen along the remaining portion of the second cleaning trajectory.

[0189] Specifically, the first cleaning trajectory is the trajectory of the cleaning robot when performing a cleaning task, that is, the trajectory of the cleaning robot when the cleaning component is activated. The first cleaning trajectory is used to clean areas other than the target area. It should be noted that when the cleaning robot performs a cleaning task according to the first cleaning trajectory, the cleaning robot may need to pass through the target area. When passing through the target area, the cleaning robot stops cleaning the target area, passes through the target area by the shortest path, and continues cleaning according to the first cleaning trajectory.

[0190] The second cleaning trajectory is the trajectory of the cleaning robot as it cleans the target area. It should be noted that while the cleaning robot is cleaning along the second cleaning trajectory, it may pass through non-target areas. However, the cleaning components will not be activated in non-target areas. Therefore, the second cleaning trajectory is determined to include only the target area, meaning that the cleaning robot only cleans the target area when moving along the second cleaning trajectory.

[0191] It should be noted that the cleaning robot includes a dry cleaning component and a wet cleaning component, wherein the dry cleaning component includes a roller brush component and a dust suction component, and the wet cleaning component includes a mopping component. When the cleaning robot performs a cleaning task, it selects at least one of the dry cleaning component and the wet cleaning component to operate according to the different types of dirt to clean the dirt.

[0192] In an embodiment of the present application, the cleaning robot detects the target object and the target area where the target object is located through image recognition during driving, and plans a first cleaning trajectory of the cleaning robot based on the target area, and plans a second cleaning trajectory for re-sweeping the target area. The cleaning task is performed by two different cleaning trajectories, which ensures that the cleaning robot will not affect the user's activities in the room during the cleaning process, and improves the efficiency of the cleaning robot in cleaning the room.

[0193] According to one embodiment of the present application, as shown in FIG2 , a control method for a cleaning robot is proposed, including:

[0194] Step 202: Acquire a target area, wherein the target object is located in the target area, and the target object is included in the image data collected by the cleaning robot;

[0195] Step 204: Based on the target area, control the cleaning robot to clean according to a first cleaning trajectory, where the first cleaning trajectory does not include the target area;

[0196] Step 206 : When the cleaning robot completes at least a portion of the first cleaning trajectory, control the cleaning robot to clean according to a second cleaning trajectory, where the second cleaning trajectory includes the target area.

[0197] In an embodiment of the present application, a control method for a cleaning robot is proposed, which is used to control the cleaning robot to replan a first cleaning trajectory and a second cleaning trajectory when a living being such as a human body is detected. The first cleaning trajectory temporarily skips over a target area where a living being such as a human body is located. After at least part of the first cleaning trajectory is completed, the cleaning robot is cleaned according to a second cleaning trajectory that includes the target area, completing a re-sweep of the target area. This enables the cleaning robot to intelligently identify the target area where a person is active, avoid the target area, and then re-sweep the target area where the person is active, thereby ensuring the integrity of the cleaning process.

[0198] In this embodiment, the cleaning robot includes an image acquisition device. While the cleaning robot is in motion, the image acquisition device is activated to capture the scene around the cleaning robot and perform semantic recognition on the captured image data. When a target object is identified in the image data, the cleaning robot determines the target area where the target object is located. Target objects include humans, pets, etc. The target area includes each room in a house.

[0199] Specifically, the first cleaning trajectory is the driving trajectory of the cleaning robot for cleaning non-target areas, and the second cleaning trajectory is the driving trajectory of the cleaning robot for cleaning target areas.

[0200] In an embodiment of the present application, the cleaning robot detects the target object and the target area where the target object is located through image recognition during driving, and preferentially cleans the non-target area through the first cleaning trajectory. After completing at least partial cleaning along the first cleaning trajectory, it then performs cleaning based on the second cleaning trajectory.

[0201] The first cleaning trajectory of the cleaning robot is planned based on the target area, and the second cleaning trajectory is planned for re-cleaning the target area. The cleaning task is performed by two different cleaning trajectories, ensuring that the cleaning robot will not affect the user's activities in the room during the cleaning task, and improving the efficiency of the cleaning robot in cleaning the room.

[0202] As shown in FIG3 , in the above embodiment, when the image data collected by the cleaning robot includes a target object, determining the target area where the target object is located includes:

[0203] Step 302: determining a first sub-map of the target object in the semantic map based on the semantic map and image data of the cleaning robot;

[0204] Step 304: Determine the area corresponding to the first sub-map as the target area.

[0205] This embodiment proposes a specific process for determining a target area in a room, thereby improving the accuracy of the determined target area.

[0206] During operation, the cleaning robot constructs a semantic map of the house. This map consists of multiple submaps, each corresponding to a room in the house. When the cleaning robot identifies a target object in image data, it uses the semantic map to determine the room in which the target object is located and identifies the first submap corresponding to that room as the target area.

[0207] For example, when the cleaning robot recognizes that the image data includes a target object, the semantic map is used to determine the room in which the cleaning robot is currently located. Since the image data collected by the image acquisition device are all image data near the cleaning robot, it can be determined that the cleaning robot and the target object are in the same room, and the first sub-map where the room is located is determined as the target area.

[0208] For example, when the cleaning robot recognizes that the image data includes a target object, it can identify the room corresponding to the scene where the image data was shot by performing semantic recognition on the image data, and use the first sub-map corresponding to the room in the semantic map as the target area.

[0209] It should be noted that the cleaning robots plan their cleaning trajectories based on the semantic maps pre-stored in the cleaning robots. Therefore, the first sub-map in the semantic map is selected as the target area to facilitate the subsequent planning of the cleaning trajectories of the cleaning robots.

[0210] In an embodiment of the present application, the first sub-map in the semantic map is determined as the target area through image data, which can ensure the accuracy of identifying the target area and improve the convenience of subsequent planning of the cleaning trajectory of the cleaning robot.

[0211] In any of the above embodiments, the cleaning task includes a first cleaning task and a second cleaning task; based on the first cleaning trajectory and at least part of the second cleaning trajectory, the cleaning robot is controlled to perform the cleaning task, including: when the cleaning robot completes the first cleaning task according to the first cleaning trajectory and the target area meets the preset conditions, the cleaning robot is controlled to perform the second cleaning task according to at least part of the second cleaning trajectory.

[0212] In this embodiment, after completing the first cleaning task, the cleaning robot continues to detect whether the target area meets the preset conditions. When it is detected that the target area meets the preset conditions, it determines that the second cleaning task can be started to re-sweep the target area, ensuring that the cleaning robot will not affect the target object in the target area when performing re-sweeping.

[0213] In the embodiment of the present application, the first cleaning task is a cleaning task in which the cleaning robot cleans the non-target area according to the first cleaning trajectory, and the second cleaning task is a cleaning task in which the cleaning robot cleans the target area according to the second cleaning trajectory.

[0214] Specifically, when the cleaning robot is performing the first cleaning task, it continuously detects the target area through the collected image data. When the target area meets the preset conditions, it starts to perform the second cleaning task to re-scan the target area.

[0215] Exemplarily, the target object is a user, the target area is a bedroom, and the preset condition includes that the current time period is not a rest period for the user.

[0216] Exemplarily, the target object is the user, the target area is the kitchen, and the preset condition is that the user leaves the kitchen.

[0217] Exemplarily, the target object is a pet cat, the target area is a living room, and the preset condition is that the pet cat does not enter the automatic litter box in the living room.

[0218] In an embodiment of the present application, the cleaning robot can not only plan the corresponding first cleaning trajectory and second cleaning trajectory based on the target area, but also determine whether it can start to re-sweep the target area according to the second cleaning trajectory based on whether the target area meets the preset conditions, while ensuring the timeliness of the re-sweeping, avoiding the re-sweeping from affecting the target object in the target area.

[0219] In any of the above embodiments, the first cleaning task includes: controlling the operation of a cleaning component of the cleaning robot based on the cleaning robot traveling in a non-target area during the driving of the cleaning robot along the first cleaning trajectory;

[0220] The second cleaning task includes: during the process of the cleaning robot driving along at least a portion of the second cleaning trajectory, based on the cleaning robot driving in the target area, controlling the cleaning components of the cleaning robot to operate.

[0221] In this embodiment, a specific process is proposed in which the cleaning robot performs the corresponding first cleaning task and the second cleaning task through the first cleaning trajectory. Among them, the first cleaning task includes the cleaning robot traveling along the first cleaning trajectory, and turning on the cleaning component for cleaning when it does not pass through the target area, and turning off the cleaning component when it passes through the target area. The cleaning robot performs the first cleaning task to ensure the effect of cleaning the non-target area and avoid affecting the user in the target area. Among them, the second cleaning task includes the cleaning robot traveling along the second cleaning trajectory, and turning off the cleaning component when it does not pass through the target area, and turning on the cleaning component for cleaning when it passes through the target area. The cleaning robot performs the second cleaning task to ensure the effect of cleaning the target area and avoid wasting electricity by performing a second cleaning on the area that has been cleaned.

[0222] Specifically, during the cleaning process according to the first cleaning trajectory, since the target area may be located between two non-target areas, when moving from one non-target area to another non-target area, the cleaning robot needs to be navigated to pass through the target area, and the cleaning component needs to be controlled to stop running when passing through the target area to avoid the noise generated during the cleaning process affecting the user's activities in the area.

[0223] It should be noted that, when planning the first cleaning trajectory, if it is detected that the cleaning robot must pass through the target area, the shortest path through the target area is planned as the path of the first cleaning trajectory passing through the target area.

[0224] In this embodiment, when the cleaning robot performs the first cleaning task, it moves along a first cleaning trajectory and stops the operation of the cleaning component when passing through the target area. The cleaning robot plans the first cleaning trajectory based on the semantic map. It identifies the first submap corresponding to the target area and the second submap corresponding to the non-target area. It then plans the first cleaning trajectory based on the positional relationship between the first and second submaps, ensuring that the portion of the first cleaning trajectory that passes through the first submap is the shortest path.

[0225] For example, the subpath of the first cleaning trajectory that passes through the second submap is a bow-shaped path, ensuring complete cleaning of the non-target area corresponding to the second submap. The subpath of the first cleaning trajectory that passes through the first submap includes a straight path and a curved path, ensuring that the target area corresponding to the first submap is passed in a short time.

[0226] Exemplarily, the subpath in the second cleaning trajectory that passes through the first submap is a "bow"-shaped path, which ensures the cleaning integrity of the target area corresponding to the first submap. The subpath in the second cleaning trajectory that passes through the second submap includes a straight path and a turning path, which ensures that the time taken to pass through the target area corresponding to the second submap is shorter. Specifically, when planning the first cleaning trajectory and the second cleaning trajectory, the cleaning robot determines the areas that need to be cleaned by the first cleaning trajectory and the second cleaning trajectory, wherein the area that needs to be cleaned by the first cleaning trajectory is the second submap, and the area that needs to be cleaned by the second cleaning trajectory is the first submap. The planned first cleaning trajectory and second cleaning trajectory try to avoid areas that do not need to be cleaned, to avoid cleaning areas that do not need to be cleaned, which may affect the activities of the target object and waste energy. When the first cleaning trajectory and the second cleaning trajectory cannot avoid areas that do not need to be cleaned, the shortest path through the areas that do not need to be cleaned is planned.

[0227] As shown in FIG4 , the first cleaning trajectory 402 passes through room A, room B, and room C, where room B is the target area and is located between room A and room C. The cleaning robot needs to clean room C after cleaning room A, so it passes through room B along the shortest path and stops the operation of the cleaning component when passing through room B.

[0228] As shown in Figure 5 , second cleaning trajectory 502 passes through rooms D, E, and F, where room F is a non-target area. The cleaning robot needs to clean rooms D and E. Since room F is not a necessary room for the cleaning robot to pass through during the cleaning process, the cleaning robot does not move to room F after cleaning rooms D and E. This prevents the cleaning robot from disturbing people while passing through room F.

[0229] In an embodiment of the present application, when the cleaning robot performs the first cleaning task and the second cleaning task, the cleaning robot cleans the areas that need to be cleaned and avoids the areas that do not need to be cleaned, trying to ensure that it does not pass through the areas that do not need to be cleaned. If the areas that do not need to be cleaned cannot be avoided, the operation of the cleaning component is stopped to reduce the impact on users in the target area, and also to ensure the cleaning effect of non-target areas after the cleaning robot performs the first cleaning task.

[0230] As shown in FIG6 , in any of the above embodiments, after the cleaning robot completes the first cleaning task according to the first cleaning trajectory, the method further includes:

[0231] Step 602 , determining a secondary cleaning area in a non-target area based on a first image captured by the cleaning robot during the execution of a first cleaning task, wherein the first image is an image of the non-target area;

[0232] Step 604 : Based on the secondary cleaning area, update the second cleaning trajectory so that the second cleaning trajectory includes the target area and the secondary cleaning area.

[0233] This embodiment proposes that while the cleaning robot is performing a first cleaning task along a first cleaning trajectory, it continuously captures first images corresponding to non-target areas. By analyzing the first images, it can determine secondary cleaning areas within the non-target areas that require re-sweeping after cleaning along the first cleaning trajectory. Based on the determined secondary cleaning areas, the cleaning robot then replans a second cleaning trajectory to ensure that the cleaning robot can clean both the target area and the secondary cleaning area when performing the second cleaning trajectory.

[0234] Specifically, the secondary cleaning area may be an incompletely cleaned area in the non-target area. That is, when the cleaning robot cleans according to the first cleaning trajectory, it determines through the first image that there is an incompletely cleaned area and determines the area as the secondary cleaning area.

[0235] For example, the first cleaning trajectory passes through the living room. After the cleaning robot completes cleaning the living room according to the first cleaning trajectory, the cleaning robot determines through the collected first image that there is still dirt in the living room, and then the cleaning robot determines the dirty area as the secondary cleaning area.

[0236] For example, the first cleaning trajectory passes through the kitchen. When the cleaning robot is cleaning the kitchen according to the first cleaning trajectory, the target object enters the kitchen and passes through an area that has been cleaned. The cleaning robot then determines the area passed by the target object as a secondary cleaning area through the collected first image.

[0237] In an embodiment of the present application, the cleaning robot can continuously detect the secondary cleaning area in the non-target area passed by the first cleaning trajectory while cleaning according to the first cleaning trajectory, and can update the second cleaning trajectory based on the secondary cleaning area, further ensuring the cleaning effect of the cleaning robot when performing supplementary cleaning through the second cleaning trajectory.

[0238] In any of the above embodiments, the preset conditions include: the time after the first cleaning task is completed reaches a preset time; and / or the target object leaves the target area.

[0239] This embodiment proposes a preset condition for the cleaning robot to determine whether to start a second cleaning task to re-clean the target area after completing the first cleaning task. The preset condition includes that the time after the completion of the first cleaning task reaches a preset time. This embodiment proposes that before the cleaning robot performs the second cleaning task to re-clean the target area, it is necessary to determine the preset time. That is, it is ensured that the cleaning robot starts the second cleaning task to re-clean the target area after completing the first cleaning task for the preset time, so as to avoid premature re-cleaning that affects users in the target area.

[0240] It should be noted that the preset duration can be a duration set by the user according to actual needs, or it can be a preset duration obtained by the cleaning robot through analysis of the target area and the collected image data.

[0241] Specifically, after the cleaning robot plans a first cleaning trajectory and a second cleaning trajectory based on the image data and the semantic map, it determines the preset duration between the first and second cleaning tasks. When the cleaning robot completes the first cleaning task based on the first cleaning trajectory, it returns to the station and begins counting. When the count reaches the preset duration, the cleaning robot exits the station and begins executing the second cleaning task based on the second cleaning trajectory.

[0242] For example, if the target object is a human body and the target area is a kitchen, and the current operating scenario is determined to be a user cooking in the kitchen, then the cleaning robot will clean according to the second cleaning trajectory one hour after the first cleaning trajectory. By leaving an hour between cleanings, the user can be sure to finish cooking in the kitchen, reducing the time required for the cleaning robot to detour, and preventing the cleaning robot from disrupting the user's cooking process.

[0243] For example, if the target object is a human body and the target area is a bedroom, and the current operating scenario is determined to be the user resting in the bedroom, then the cleaning robot will clean according to the second cleaning trajectory twelve hours after cleaning according to the first cleaning trajectory. By leaving twelve hours between cleanings, the cleaning robot can avoid disturbing the user's rest.

[0244] It should be noted that the preset duration between two cleaning tasks is related to the target object and target area identified by the cleaning robot, that is, the cleaning robot can plan the preset duration based on the target object and target area.

[0245] The preset condition includes that the time after the first cleaning task is completed reaches a preset time. The preset condition includes that the target object leaves the target area.

[0246] In this embodiment, the cleaning robot continuously collects image data of the target area when performing the first cleaning task, and performs image recognition on the collected image data, thereby being able to determine whether the target object has left the target area.

[0247] For example, while the cleaning robot is performing a first cleaning task along a first cleaning trajectory, it continuously collects image data corresponding to the target area and continuously identifies whether the target object in the image data is in place. When the target object leaves the target area, the cleaning robot pauses cleaning along the first cleaning trajectory and begins cleaning along the second cleaning trajectory.

[0248] Illustratively, after completing the first cleaning task according to the first cleaning trajectory, the cleaning robot collects image data corresponding to the target area, and starts cleaning according to the second cleaning trajectory when it is determined that the target object has left the target area.

[0249] For example, after completing the first cleaning task according to the first cleaning trajectory, the cleaning robot collects image data corresponding to the target area. When it detects that the target object has not left the target area, the cleaning robot returns to the station and starts timing. After the timing reaches the preset time, it starts cleaning according to the second cleaning trajectory.

[0250] In an embodiment of the present application, the cleaning robot can accurately determine whether the cleaning robot can start re-sweeping according to the second cleaning trajectory by judging whether the time after the completion of the first cleaning task reaches a preset time and / or judging whether the target object has left the target area. This ensures that the cleaning robot can re-sweep the target area in a timely manner, while avoiding the impact of inappropriate re-sweeping timing on the user.

[0251] In any of the above embodiments, when the cleaning robot completes the first cleaning task according to the first cleaning trajectory and the target area meets the preset conditions, before controlling the cleaning robot to perform the second cleaning task according to at least part of the second cleaning trajectory, the method further includes: determining a preset duration based on the area category corresponding to the target area in the semantic map of the cleaning robot, wherein the area category includes one of the kitchen area, bedroom area, living room area, washroom area, and office area. In this embodiment, the cleaning robot is able to determine the area category of the target area based on the semantic information of the target area in the semantic map, and accordingly determine the preset duration of the interval for re-sweeping the target area, so that the preset duration of the interval matches the current actual scene.

[0252] It should be noted that the area categories are not limited to the above, and can also be customized by the user, for example: setting living room 1, living room 2, dining room 1, dining room 2, shower room, toilet, etc.

[0253] In the embodiment of the present application, by limiting the specific content of the area category, it is ensured that the area category of the target area can be identified, and the preset duration of the corresponding interval can be accurately determined according to the area category.

[0254] It should be noted that the cleaning robot pre-stores a mapping between area categories and preset durations. After determining the area category, the cleaning robot can use this mapping to find the corresponding preset duration. Users can also customize the mapping based on their actual needs to ensure that the preset duration found based on the area category meets their needs. Preset area categories can correspond to multiple preset durations, and each preset duration can be associated with other judgment criteria, such as the current time.

[0255] For example, the target object in the image data is identified as a human body, the room corresponding to the target area is identified as a kitchen through the semantic map, and it is determined that the user is cooking in the kitchen at this time, so the preset time is set to 1 hour.

[0256] For example, the target object in the image data is identified as a pet dog, and the target area is identified as the living room through the semantic map. It is determined that the pet dog is eating in the living room at this time, so the preset time is set to 20 minutes.

[0257] Exemplarily, the target object in the image data is identified as a human body, and the room corresponding to the target area is identified as a bedroom through the semantic map. Combined with the current time information, for example: the current time information is 22:05, it is determined that the user is resting in the bedroom at this time, so the preset time is set to 10 hours.

[0258] In an embodiment of the present application, after identifying the target area, the cleaning robot can determine the specific area category corresponding to the target area through the semantic map, and determine the preset duration of the corresponding interval based on the area category, to ensure that the re-sweeping process matches the actual application scenario of the cleaning robot.

[0259] As shown in FIG7 , in any of the above embodiments, when the cleaning robot completes the first cleaning task according to the first cleaning trajectory and the target area meets the preset conditions, before controlling the cleaning robot to perform the second cleaning task according to at least a portion of the second cleaning trajectory, the method further includes:

[0260] Step 702, identifying target features in the image data;

[0261] Step 704, determining a preset duration based on the posture and / or parameters of the target feature;

[0262] The target feature includes one of a door feature, a window feature, and a home appliance feature.

[0263] In this embodiment, it is proposed that the cleaning robot recognizes the posture and / or parameters of the target feature in the image data, and searches for the corresponding preset time duration based on the posture and / or parameters.

[0264] In the embodiments of the present application, the posture of the target feature includes, but is not limited to, the opening and closing posture of a door, the opening and closing posture of a window, the placement posture of a home appliance, etc. The parameters of the target feature include, but are not limited to, the size parameters of the door, the size parameters of the window, the size parameters of the home appliance, and the operating parameters, etc.

[0265] Specifically, after identifying a target object, the cleaning robot identifies the background area in the image data. If the image data also includes target features, the robot detects the posture and / or parameters of the target features, selecting different preset durations based on different postures. It should be noted that the target object is a living object in the image data, such as a pet or human body. The target features are the features of objects in the image data, such as doors, windows, and household appliances.

[0266] Exemplarily, the cleaning robot detects that the image data includes a target object, and determines through image recognition that the door feature is in a closed posture, that is, the door is closed, and determines that the cleaning robot cannot enter the room temporarily, and sets the preset time to 2 hours.

[0267] Exemplarily, the cleaning robot detects that the image data includes a target object, determines through image recognition that the integrated stove is in an operating posture, and determines that the user is cooking at this time, and sets the preset time to 1 hour.

[0268] Exemplarily, the cleaning robot detects that the image data includes a target object, obtains the operating parameters of the TV in the room, determines that the TV is playing a movie, and determines that the user is watching a movie at this time, and then sets the preset duration to 3 hours.

[0269] In an embodiment of the present application, the cleaning robot can analyze the actual scene in which the cleaning robot is located through the posture and / or parameters of the target features in the collected image data, and set the preset duration of the corresponding interval accordingly to ensure the success rate of the cleaning robot in performing the second cleaning task of make-up sweeping, and avoid the make-up sweeping process from having an adverse impact on users in the target area.

[0270] In any of the above embodiments, when the cleaning robot completes the first cleaning task according to the first cleaning trajectory and the target area meets the preset conditions, before controlling the cleaning robot to perform the second cleaning task according to at least part of the second cleaning trajectory, it also includes: collecting a second image corresponding to the target area; and determining whether the target object leaves the target area based on the second image.

[0271] In this embodiment, it is proposed that before the cleaning robot performs supplementary sweeping according to the second cleaning trajectory, the image acquisition device captures a second image corresponding to the target area, performs image recognition on the second image, and determines whether the target object has left the target area, thereby achieving accurate control of whether the cleaning robot starts to perform supplementary sweeping.

[0272] In any of the above embodiments, before acquiring the target area, the method includes: controlling an image acquisition device of the cleaning robot to continuously acquire image data while the cleaning robot performs the third cleaning task according to the third cleaning trajectory.

[0273] In this embodiment, it is proposed that when the cleaning robot performs the corresponding third cleaning task according to the preset third cleaning trajectory after leaving the station, the image acquisition device is turned on to continuously collect image data, so as to facilitate the subsequent re-planning of the corresponding first cleaning trajectory and the second cleaning trajectory for supplementary cleaning based on the collected image data including the target object.

[0274] Specifically, before the cleaning robot leaves the station to perform the third cleaning task, it plans a corresponding third cleaning trajectory based on a pre-stored semantic map. This third cleaning trajectory can be a trajectory that cleans the entire house. After leaving the station, the cleaning robot activates its image acquisition device and continues to capture images of the surrounding environment. After acquiring image data including the target object, it promptly plans the first and second cleaning trajectories, stops the current third cleaning trajectory, and cleans the house according to the first cleaning trajectory. After the preset cleaning time, the house is cleaned again according to the second cleaning trajectory.

[0275] In the embodiment of the present application, by controlling the cleaning robot to keep the image acquisition device turned on after leaving the station, the cleaning robot can obtain the current surrounding environment in a timely manner, thereby improving the efficiency of replanning the first cleaning trajectory.

[0276] According to one embodiment of the present application, as shown in FIG8 , a control method for a cleaning robot is proposed, including:

[0277] Step 802: When the image data collected by the cleaning robot includes a target object, determine a first area of ​​the target object in the map;

[0278] Step 804: Obtain the operating status of the target device corresponding to the first area;

[0279] Step 806 : After the cleaning robot completes cleaning the second area in the map, based on the operating status of the target device, the cleaning robot is controlled to clean the first area.

[0280] The embodiments of the present application provide a control method for a cleaning robot. This control method enables the cleaning robot to identify a first area where a target object is located, replan its current cleaning trajectory, temporarily avoiding the first area where the target object is active, and plan a subsequent re-cleaning path for the first area. The cleaning robot can also interact with other household devices to identify the user's activity status in the first area, thereby determining whether to initiate re-cleaning of the first area, thereby preventing the cleaning robot from adversely affecting the user during re-cleaning.

[0281] In this embodiment, the cleaning robot includes an image acquisition device. When the cleaning robot is driving, the image acquisition device is turned on to capture the scene around the cleaning robot, and semantic recognition is performed on the captured image data. When a target object is identified in the image data, the cleaning robot can determine the first area where the target object is located in combination with the map.

[0282] It should be noted that the target object includes a human body, a pet, etc. The map includes multiple areas, each of which corresponds to a room in a house. When the cleaning robot recognizes that the image data includes the target object, it determines a first area corresponding to the area where the target object is located in the image data based on the map.

[0283] In this embodiment, the cleaning robot is in communication with multiple other household devices and can obtain the location information of these connected household devices. After determining the first area where the target object is located, the cleaning robot can locate the target device (one of the multiple household devices connected to the cleaning robot) located in the same area as the first area. By exchanging data with the target device, the robot can obtain the operating status of the target device and, based on this status, determine whether to initiate a re-sweep of the first area. Based on the operating status of the target device in the area corresponding to the first area, the cleaning robot can estimate whether the user has left the first area, ensuring that after the cleaning robot begins re-sweeping, the re-sweep process will not adversely affect the user's activities in the area.

[0284] For example, the cleaning robot can be connected to other household appliances through the Internet of Things, the cleaning robot can be connected to other household appliances through near-field communication technology, and the cleaning robot can be connected to other appliances through Bluetooth communication technology.

[0285] It should be noted that the target object can be a human body, or a living creature such as a pet dog or cat.

[0286] In this embodiment, after finding the first area, the cleaning robot can also use the remaining areas in the map as the second area and replan the current cleaning trajectory based on the second area. The cleaning robot begins cleaning the second area according to the replanned cleaning trajectory. After cleaning is completed, the cleaning robot is controlled to perform additional cleaning on the corresponding area of ​​the first area based on the operating status of the target device.

[0287] It should be noted that the cleaning robot includes a dry cleaning component and a wet cleaning component, wherein the dry cleaning component includes a roller brush component and a dust suction component, and the wet cleaning component includes a mopping component. When the cleaning robot performs a cleaning task, it selects at least one of the dry cleaning component and the wet cleaning component to operate according to the different types of dirt to clean the dirt.

[0288] In an embodiment of the present application, the cleaning robot detects the target object through image recognition during driving, and determines the first area corresponding to the area where the target object is located. The operating status of the target device in the first area is used to determine whether to start re-sweeping the first area, so that the cleaning robot can judge and estimate the current operating scenario through the Internet of Things, and realize that the cleaning robot can avoid the area where the first area is located in the current cleaning stage, avoiding the current cleaning process from affecting the user, and can also promptly re-sweep the uncleaned area in the future, and can ensure that the re-sweeping stage will not have an adverse effect on the user's activities.

[0289] As shown in FIG9 , in the above embodiment, after the cleaning robot completes cleaning the second area in the map, controlling the cleaning robot to clean the first area based on the operating state of the target device includes:

[0290] Step 902: Determine a preset duration based on the operating status of the target device;

[0291] Step 904, after the cleaning robot completes cleaning the second area, the cleaning robot is controlled to clean the first area after a target time interval, where the target time interval is associated with the preset time interval and the cleaning time interval, and the cleaning time interval is the time interval for the cleaning robot to clean the second area.

[0292] In this embodiment, it is proposed that the cleaning robot can determine the target duration of the interval between the current cleaning phase and the re-sweeping phase according to the operating status of the target device in the first area. While ensuring the timeliness of the re-sweeping of the first area, it can also avoid the re-sweeping phase from affecting the activities of the target object in the first area.

[0293] In the embodiment of the present application, the preset duration matches the operating state of the target device, and the corresponding preset duration can be found based on the operating state of the target device by looking up a table. The target duration is the actual interval required after the cleaning robot completes cleaning the second area. Since the cleaning robot takes a certain cleaning time to clean the second area, the target duration is the duration calculated based on the preset duration and the cleaning duration.

[0294] In an embodiment of the present application, a plurality of first devices in the map are screened through the first area in the map to determine the target device therein, thereby ensuring the matching of the target device with the first area. After determining the target device, the cleaning robot communicates with the target device to determine the operating status of the target device. The corresponding preset duration is determined according to the operating status, and the target duration is set in combination with the cleaning duration of the cleaning robot for cleaning the second area, thereby improving the matching degree between the target duration for determining the re-sweeping interval and the operating status of the target device corresponding to the first area, and ensuring that the cleaning robot re-sweeps the first area after the target duration, without affecting the user.

[0295] In any of the above embodiments, after the cleaning robot completes cleaning the second area, before controlling the cleaning robot to clean the first area after a target duration, the process includes: when the cleaning time is greater than or equal to the preset time, determining the target time to be 0; when the cleaning time is less than the preset time, determining the difference between the preset time and the cleaning time as the target time.

[0296] In this embodiment, the cleaning time required for the cleaning robot to clean the second area is compared with the preset time, and based on the numerical relationship between the cleaning time obtained by comparison and the preset time, a target time corresponding to the required interval is set to ensure the timeliness of the cleaning robot's re-sweeping and avoid the impact of the cleaning robot on the user during the re-sweeping stage.

[0297] Specifically, the preset duration is T1, and the cleaning duration is T2. When T2 ≥ T1, it is determined that after the cleaning robot completes cleaning the second area, it will not cause adverse effects on the user if it immediately re-sweeps the first area, so the target duration of the required interval is set to 0, that is, the cleaning robot immediately re-sweeps the first area after completing cleaning the second area. When T2 < T1, in order to avoid the re-sweeping stage affecting the user, it is determined that after the cleaning robot completes cleaning the second area, it still needs to wait for a certain period of time before starting to re-sweep the first area. By calculating the difference T = T1-T2, and taking the difference T as the target duration, the cleaning robot will re-sweep the first area after completing cleaning the second area and after the target duration T.

[0298] The cleaning time is obtained by timing the cleaning robot during operation.

[0299] For example, the target object is a person, the first area is the kitchen, and the target device is an integrated stove. The cleaning robot determines that the integrated stove is running and that the user is cooking in the kitchen, so it sets the preset cleaning time to 1 hour. If the cleaning robot cleans the second area for 10 minutes, it will begin a follow-up cleaning of the kitchen area corresponding to the first area 50 minutes after the cleaning is completed.

[0300] For example, the target object is a pet dog, the first area is the living room, and the target device is an automatic pet water dispenser. The cleaning robot determines that the automatic pet water dispenser is running and that the pet dog is drinking water in the living room, so it sets the preset cleaning timer to 10 minutes. If the cleaning robot's cleaning timer for the second area is 20 minutes, it will immediately begin a follow-up cleaning of the living room area corresponding to the first area after completing the cleaning.

[0301] In an embodiment of the present application, the cleaning robot can accurately determine the target time required for the cleaning robot to complete cleaning the second area by comparing the cleaning time corresponding to the second area with the preset time, ensuring that re-cleaning the second area after the target time will not affect the user, and also improves the timeliness of the re-cleaning.

[0302] As shown in FIG. 10 , in any of the above embodiments, determining the preset duration based on the operating state of the target device includes:

[0303] Step 1002, locating multiple first devices that match the map;

[0304] Step 1004: screening a target device from a plurality of first devices through the first region;

[0305] Step 1006, obtaining the operating status of the target device;

[0306] Step 1008: Determine the preset duration based on the operating state of the target device and the preset correspondence.

[0307] This embodiment proposes a specific process of searching for a corresponding target device based on a map and setting a preset duration based on the operating status of the target device.

[0308] Specifically, the cleaning robot obtains the positioning information of other household devices. Based on the positioning information, the cleaning robot can find multiple first devices located within the map range, that is, the coordinates of the multiple first devices are all within the map. The cleaning robot can determine the target device among the multiple first devices based on the range of the first area in the map, that is, the coordinates of the target device are located within the first area. Due to the communication connection between the cleaning robot and the target device, the cleaning robot can obtain the operating status of the target device. The cleaning robot has a preset correspondence between the target device and the preset time length. After determining the target device, the cleaning robot can obtain the corresponding preset time length by searching the preset correspondence.

[0309] For example, the user can set the preset duration corresponding to different target devices according to actual needs.

[0310] In some possible implementations, the cleaning robot obtains the positioning information of other household appliances, including: during the map construction process, the cleaning robot constructs an object bounding box of other household appliances, that is, the coordinate information of other household appliances is stored in the map, and the coordinate information of other household appliances is read and used as positioning information.

[0311] In some other possible implementations, the cleaning robot obtains the positioning information of other household appliances, including: the cleaning robot is communicatively connected with other household appliances, the other household appliances have positioning functions, and the cleaning robot reads the positioning information of other household appliances by communicating with other household appliances.

[0312] In an embodiment of the present application, a first area in a map is used to screen multiple first devices in the map, thereby determining a target device therein and ensuring that the target device matches the first area. After determining the target device, the cleaning robot communicates with the target device to determine the operating status of the target device and sets a preset duration accordingly. This improves the degree of matching between the preset duration for determining the re-sweep interval and the operating status of the target device corresponding to the first area, ensuring that the cleaning robot re-sweeps the first area after the preset duration without affecting the user.

[0313] As shown in FIG. 11 , in any of the above embodiments, the number of target devices is at least two; determining the preset duration according to the operating status of the target device and the preset correspondence includes:

[0314] Step 1102: Obtain the operating status of at least two target devices and a preset correspondence relationship, and determine at least two interval durations;

[0315] Step 1104: Determine a preset duration based on at least two interval durations.

[0316] In this embodiment, when multiple target devices are included in the first area, the cleaning robot sets corresponding preset durations according to multiple interval durations corresponding to the multiple target devices, further improving the degree of matching between the set preset durations and the actual scene.

[0317] Specifically, when the first area includes multiple target devices, the interval duration corresponding to each target device is searched based on the preset correspondence to obtain multiple interval durations. After obtaining the multiple interval durations, one of the multiple interval durations can be selected as the preset duration by screening, or the corresponding preset duration can be obtained by performing mathematical calculations on the multiple interval durations.

[0318] For example, the first area is the living room, where target devices include a television, air conditioner, humidifier, and massage chair. If the TV and air conditioner are both running, the robot will find two corresponding intervals: three hours for the TV and two hours for the air conditioner. The robot will then select the shorter of these intervals as its default interval, ensuring timely re-cleaning of the living room.

[0319] In an embodiment of the present application, when there are multiple target devices corresponding to the first area, the cleaning robot can integrate the interval durations corresponding to the multiple target devices to determine the corresponding preset duration, further improving the degree of matching between the preset duration and the actual scene of the first area.

[0320] In any of the above embodiments, the preset duration is an average value of at least two interval durations; or the preset duration is a maximum value of at least two interval durations; or the preset duration is a minimum value of at least two interval durations.

[0321] This embodiment proposes multiple methods for determining a preset duration based on multiple interval durations. These methods include calculating an average value of the multiple interval durations and using the calculated average value as the preset duration. These methods also include taking the maximum or minimum value of the multiple interval durations and using the maximum or minimum value as the preset duration.

[0322] Optionally, the user can select any of the above methods according to actual needs and determine the preset duration from multiple interval durations.

[0323] Optionally, the cleaning robot selects any of the above methods based on the first area category and determines a preset duration from multiple interval durations. That is, the preset duration is determined based on the area category corresponding to the first area and the multiple interval durations, where the preset duration includes any one of a maximum value, a minimum value, or an average value of the multiple interval durations. The area category includes at least one of a living room area, a kitchen area, and a bedroom area.

[0324] For example, the first area category is the living room area. Since most of the activities performed by users in the living room are related to entertainment, in order to improve the timeliness of the re-scanning, the minimum value of multiple interval durations can be used as the preset duration.

[0325] Exemplarily, the first area category is the bedroom area. Since most activities performed by users in the bedroom are related to rest, in order to avoid disturbing the user's rest, the maximum value of multiple interval durations can be used as the preset duration.

[0326] In an embodiment of the present application, by setting the preset duration to the maximum value, minimum value or average value among multiple interval durations, it is possible to further ensure that the preset duration matches the actual scene of the area corresponding to the first area, thereby ensuring the timeliness of re-scanning the area while avoiding adverse effects on the user during the re-scanning.

[0327] As shown in FIG12 , in any of the above embodiments, after the cleaning robot completes cleaning the second area in the map, based on the operating state of the target device, controlling the cleaning robot to clean the first area includes:

[0328] Step 1202 , after the cleaning robot completes cleaning the second area, determining the activity state of the target object in the first area based on the operating state of the target device;

[0329] Step 1204 : Based on the activity state of the target object in the first area meeting a preset condition, control the cleaning robot to clean the first area.

[0330] This embodiment proposes that after the cleaning robot completes cleaning the second area, it continuously obtains the operating status of the target device in the first area and, based on this information, determines whether starting a supplemental cleanup will affect the target object in the first area. If the cleaning robot determines that supplemental cleanup will not affect the target object, it controls the cleaning robot to start supplemental cleanup of the first area.

[0331] In an embodiment of the present application, the cleaning robot can determine the activity state of the target object based on the operating state of the target device. Specifically, the cleaning robot can find the activity state of the target object based on the operating state of the target device according to a preset mapping relationship. Exemplarily, the preset mapping relationship can be stored in a local storage area of ​​the cleaning robot or in the cloud.

[0332] In some possible implementations, the cleaning robot determines the cleaning power to be used for cleaning the first area based on the activity state. For example, if the cleaning robot determines, based on the operating state of the target device, that the activity state is a transition from a sleeping state to a resting state, it may control the cleaning robot to reduce the cleaning power for a supplemental cleaning in the bedroom area, thereby ensuring timely supplemental cleaning and avoiding affecting the resting user.

[0333] In an embodiment of the present application, when a first area includes multiple target devices, the target object's activity state is determined based on the operating states of the multiple target devices. By fully combining the operating states of the multiple different devices, the accuracy of determining the target object's activity state can be improved. The activity state meeting a preset state includes, but is not limited to, the target object leaving the first area.

[0334] For example, the target object is a human body, the first area is a bedroom, and the target device is a motorized curtain. After the cleaning robot finishes cleaning the second area, it detects that the motorized curtain has switched from closed to open. It determines that the user is no longer resting and that additional cleaning of the bedroom will not affect the user's rest, so it begins cleaning the bedroom.

[0335] For example, the target object is a pet cat, the first area is the living room, and the target device is an automatic cat litter box. After the cleaning robot finishes cleaning the second area, it detects that the automatic cat litter box has switched from running to standby mode, and determines that the pet cat has left the automatic litter box. At this time, cleaning the living room again will not disturb the pet cat, so it starts cleaning the living room.

[0336] In an embodiment of the present application, the cleaning robot can judge the activity status of the target object based on the operating status of the target device, and judge whether to start re-sweeping the first area accordingly, so that the cleaning robot can quickly re-sweep the first area after the target object leaves the first area, ensuring the timeliness of the re-sweep and avoiding the impact of the re-sweep on the target object in the first area.

[0337] As shown in FIG13 , in any of the above embodiments, after the cleaning robot completes cleaning the second area in the map, before controlling the cleaning robot to clean the first area based on the operating state of the target device, the process includes:

[0338] Step 1302 , planning a fourth cleaning trajectory based on the second area;

[0339] Step 1304: Control the cleaning robot to clean according to the fourth cleaning trajectory.

[0340] This embodiment provides a detailed process for the cleaning robot to clean the second area, including planning a fourth cleaning trajectory based on the second area in the map, driving the cleaning robot to follow the planned fourth cleaning trajectory, and monitoring the operating status of the cleaning component of the cleaning robot during driving, ensuring that the cleaning component is turned off when the cleaning robot passes through the first area to avoid affecting the user's activities in the first area.

[0341] Specifically, during the cleaning process according to the fourth cleaning trajectory, since the first area may be located between two second areas, when moving from one of the second areas to another second area, the cleaning robot needs to be navigated to pass through the first area, and the cleaning component is controlled to stop running when passing through the first area to avoid the noise generated during the cleaning process affecting the user's activities in the area, and the cleaning component is operated when the cleaning robot passes through the second area to clean the second area.

[0342] It should be noted that, when planning the fourth cleaning trajectory, if it is detected that the cleaning robot must pass through the first area, the shortest path through the first area is planned as the path of the fourth cleaning trajectory passing through the first area.

[0343] For example, the sub-path of the fourth cleaning trajectory passing through the second area is a "bow"-shaped path to ensure the complete cleaning of the second area. The sub-path of the fourth cleaning trajectory passing through the first area includes a straight path and a turning path to ensure that the time spent passing through the first area is relatively short.

[0344] In an embodiment of the present application, when the cleaning robot passes through the second area, the cleaning component is kept in an on state to ensure that the cleaning robot can normally clean the second area in the house.

[0345] In any of the above embodiments, controlling the cleaning robot to clean according to the fourth cleaning trajectory includes: the fourth cleaning trajectory includes the first area and the second area, and when the cleaning robot is driving in the first area, the cleaning component of the cleaning robot is controlled to stop running, and when the cleaning robot is driving in the second area, the cleaning component is controlled to run; the fourth cleaning trajectory includes the second area and does not include the first area, and when the cleaning robot is controlled to drive according to the fourth cleaning trajectory, the cleaning component is kept in an running state.

[0346] In this embodiment, when the fourth cleaning trajectory planned by the cleaning robot passes through the first and second areas, the cleaning robot turns off the cleaning component while traveling in the first area and cleans the second area only with the cleaning component. If the fourth cleaning trajectory planned by the cleaning robot passes only through the second area, the cleaning robot maintains the operation of the cleaning component while cleaning along the fourth cleaning trajectory, thereby cleaning the second area.

[0347] Specifically, when planning the fourth cleaning trajectory, the cleaning robot determines that the fourth cleaning trajectory passes through the first area. To ensure complete cleaning of the second area, if it cannot avoid the first area, the robot plans the shortest path through the first area. During the actual cleaning process, when the robot passes through the first area, the cleaning component is turned off to prevent noise from the cleaning component from disturbing the user.

[0348] In an embodiment of the present application, the cleaning robot cleans the second area and avoids the location of the first area, trying to ensure that it does not pass through the first area. If the first area cannot be avoided, the cleaning component is stopped to reduce the impact on users in the first area and ensure the cleaning effect of the cleaning robot on the second area.

[0349] In any of the above embodiments, the target device includes at least one of an electric rice cooker, a water heater, an air conditioner, an electric curtain, a television, a water dispenser, a hair dryer, and a washing machine.

[0350] In this embodiment, it is proposed that the target device includes at least one of: an electric rice cooker, a water heater, an air conditioner, an electric curtain, a television, a water dispenser, a hair dryer, and a washing machine, that is, all smart IoT home devices can be used as target devices to communicate with the cleaning robot.

[0351] It should be noted that the cleaning robot can simply identify the user's activity scenes in the corresponding area based on different target devices in different operating states, and set the corresponding preset time.

[0352] For example, the target device is a water heater in a bathroom. If the water heater operates in instant heating mode, it is determined that the user is washing in the bathroom at this time, and the preset time is set to 30 minutes.

[0353] Exemplarily, the target devices are the air conditioner and electric curtains in the bedroom. The air conditioner is in cooling state, and the electric curtains are in the pulled-up blocking state. It is determined that the user is sleeping in the bedroom, and the preset time is set to 12 hours.

[0354] For example, the target device is an electric rice cooker in the kitchen. If the electric rice cooker is running in a quick cooking mode, it is determined that the user is cooking in the kitchen at this time, and the preset time is set to 1 hour.

[0355] In an embodiment of the present application, by setting different types of devices as target devices, the accuracy of the preset time determined by the target device can be improved, ensuring that after the preset time of cleaning the second area is completed, when the first area is cleaned, it will not affect the activities of people in the first area.

[0356] As shown in FIG14 , in any of the above embodiments, when the image data collected by the cleaning robot includes a target object, determining that the target object is in the first area in the map includes:

[0357] Step 1402 , planning a fifth cleaning trajectory based on the map;

[0358] Step 1404 , controlling the cleaning robot to clean according to the fifth cleaning trajectory;

[0359] Step 1406 : During the cleaning process of the cleaning robot, control the image acquisition device of the cleaning robot to continuously acquire image data.

[0360] In this embodiment, it is proposed that when the cleaning robot cleans according to the preset fifth cleaning trajectory after leaving the station, the image acquisition device is turned on to continuously acquire image data, so as to facilitate the subsequent re-planning of the corresponding fourth cleaning trajectory and the fifth cleaning trajectory for re-sweeping based on the acquired image data including the target object.

[0361] Specifically, before the cleaning robot leaves the station to clean according to the preset fifth cleaning trajectory, it plans a corresponding fifth cleaning trajectory based on a pre-stored map. This fifth cleaning trajectory can be a trajectory for cleaning the entire house. After leaving the station, the cleaning robot activates the image acquisition device and continues to capture images of the surrounding environment. After collecting image data including the target object, it promptly plans the fourth and fifth cleaning trajectories, stops the current fifth cleaning trajectory, cleans the house according to the fourth cleaning trajectory, and after cleaning for a preset period of time, performs a follow-up cleaning according to the fifth cleaning trajectory.

[0362] In the embodiment of the present application, by controlling the cleaning robot to keep the image acquisition device turned on after leaving the station, the cleaning robot can obtain the current surrounding environment in a timely manner, thereby improving the efficiency of re-planning the fourth cleaning trajectory.

[0363] As shown in FIG15 , in any of the above embodiments, planning a fifth cleaning trajectory based on the map includes:

[0364] Step 1502: Acquire location information of a second device in the map, where the second device is a home appliance in operation;

[0365] Step 1504 : Plan a fifth cleaning trajectory based on the positioning information.

[0366] In this embodiment, it is proposed that the cleaning robot plans the fifth cleaning trajectory based on the positioning information of the household appliances in operation in the map before leaving the station, so that the operating status of the household appliances in the house is fully considered before cleaning begins, thereby reducing the number of times the cleaning robot replans the path after leaving the station.

[0367] Specifically, while the cleaning robot is still inside the station, it communicates with the household devices on the map to obtain the operating status of all the devices on the map. It then locates a second device that is in operation and, based on the second device's location information, plans a fifth cleaning trajectory. Based on the second device's location information, the cleaning robot can estimate the user's activity range and duration within the house, thereby planning the fifth cleaning trajectory. This trajectory avoids the user's activity range and reduces the likelihood of having to temporarily replan the fourth cleaning trajectory.

[0368] In any of the above embodiments, the map includes any of the following: a semantic map, an image map.

[0369] In this embodiment, the map stored in the sweeping robot may be a semantic map or an image map.

[0370] In an embodiment of the present application, by setting the map as a semantic map or an image map, the accuracy of the cleaning trajectory automatically planned by the sweeper can be improved, thereby ensuring the cleaning effect and efficiency of the sweeper in cleaning the house based on the map.

[0371] In an embodiment of the present application, the cleaning robot plans the fifth cleaning trajectory through the positioning information of the second device in operation without leaving the station, thereby reducing the possibility of the cleaning robot replanning the path during the cleaning process.

[0372] In one embodiment of the present application, as shown in FIG16 , a control device 1600 for a cleaning robot is provided, comprising:

[0373] An acquisition module 1602 is configured to acquire a target area, wherein a target object is located in the target area and the target object is included in image data collected by the cleaning robot;

[0374] A planning module 1604 is configured to plan a first cleaning trajectory and a second cleaning trajectory based on the target area, wherein the first cleaning trajectory does not include the target area, and the second cleaning trajectory includes the target area;

[0375] The control module 1606 is configured to control the cleaning robot to perform a cleaning task based on the first cleaning trajectory and at least a portion of the second cleaning trajectory.

[0376] In an embodiment of the present application, a control device for a cleaning robot is proposed, which is used to control the cleaning robot to re-plan the cleaning trajectory of the cleaning robot when it detects living things such as human bodies, so that the re-planned cleaning trajectory temporarily skips the area where living things such as human bodies are located, and then re-sweeps the area. This enables the cleaning robot to intelligently identify areas where people are active, avoid these areas, and re-sweep the areas where people are active to ensure the integrity of the cleaning.

[0377] In an embodiment of the present application, the cleaning robot detects the target object and the target area where the target object is located through image recognition during driving, and plans a first cleaning trajectory of the cleaning robot based on the target area, and plans a second cleaning trajectory for re-sweeping the target area. The cleaning task is performed by two different cleaning trajectories, which ensures that the cleaning robot will not affect the user's activities in the room during the cleaning process, and improves the efficiency of the cleaning robot in cleaning the room.

[0378] In the above embodiment, the control device 1600 of the cleaning robot further includes:

[0379] a determination module, configured to determine a first sub-map of a target object in the semantic map based on the semantic map and image data of the cleaning robot;

[0380] The determination module is used to determine the area corresponding to the first sub-map as the target area.

[0381] This embodiment proposes a specific process for determining a target area in a room, thereby improving the accuracy of the determined target area.

[0382] In an embodiment of the present application, the first sub-map in the semantic map is determined as the target area through image data, which can ensure the accuracy of identifying the target area and improve the convenience of subsequent planning of the cleaning trajectory of the cleaning robot.

[0383] In any of the above embodiments, the cleaning task includes a first cleaning task and a second cleaning task;

[0384] The control module 1606 is configured to control the cleaning robot to perform a second cleaning task according to at least a portion of a second cleaning trajectory when the cleaning robot completes the first cleaning task according to the first cleaning trajectory and the target area meets a preset condition.

[0385] In this embodiment, after completing the first cleaning task, the cleaning robot continues to detect whether the target area meets the preset conditions. When it is detected that the target area meets the preset conditions, it determines that the second cleaning task can be started to re-sweep the target area, ensuring that the cleaning robot will not affect the target object in the target area when performing re-sweeping.

[0386] In an embodiment of the present application, the cleaning robot can not only plan the corresponding first cleaning trajectory and second cleaning trajectory based on the target area, but also determine whether it can start to re-sweep the target area according to the second cleaning trajectory based on whether the target area meets the preset conditions, while ensuring the timeliness of the re-sweeping, avoiding the re-sweeping from affecting the target object in the target area.

[0387] In any of the above embodiments, the first cleaning task includes: controlling the operation of a cleaning component of the cleaning robot based on the cleaning robot traveling in a non-target area during the driving of the cleaning robot along the first cleaning trajectory;

[0388] The second cleaning task includes: during the process of the cleaning robot driving along at least a portion of the second cleaning trajectory, based on the cleaning robot driving in the target area, controlling the cleaning components of the cleaning robot to operate.

[0389] In an embodiment of the present application, when the cleaning robot performs the first cleaning task and the second cleaning task, the cleaning robot cleans the areas that need to be cleaned and avoids the areas that do not need to be cleaned, trying to ensure that it does not pass through the areas that do not need to be cleaned. If the areas that do not need to be cleaned cannot be avoided, the operation of the cleaning component is stopped to reduce the impact on users in the target area, and also to ensure the cleaning effect of non-target areas after the cleaning robot performs the first cleaning task.

[0390] In any of the above embodiments, the determination module is configured to determine the secondary cleaning area in the non-target area based on a first image captured by the cleaning robot during the performance of the first cleaning task, the first image being an image of the non-target area;

[0391] The control device 1600 of the cleaning robot includes:

[0392] The updating module is configured to update the second cleaning track based on the secondary cleaning area so that the second cleaning track includes the target area and the secondary cleaning area.

[0393] This embodiment proposes that while the cleaning robot is performing a first cleaning task along a first cleaning trajectory, it continuously captures first images corresponding to non-target areas. By analyzing the first images, it can determine secondary cleaning areas within the non-target areas that require re-sweeping after cleaning along the first cleaning trajectory. Based on the determined secondary cleaning areas, the cleaning robot then replans a second cleaning trajectory to ensure that the cleaning robot can clean both the target area and the secondary cleaning area when performing the second cleaning trajectory.

[0394] In an embodiment of the present application, the cleaning robot can continuously detect the secondary cleaning area in the non-target area passed by the first cleaning trajectory while cleaning according to the first cleaning trajectory, and can update the second cleaning trajectory based on the secondary cleaning area, further ensuring the cleaning effect of the cleaning robot when performing supplementary cleaning through the second cleaning trajectory.

[0395] In any of the above embodiments, the preset conditions include: the time after the first cleaning task is completed reaches a preset time; and / or the target object leaves the target area.

[0396] In an embodiment of the present application, the cleaning robot can accurately determine whether the cleaning robot can start re-sweeping according to the second cleaning trajectory by judging whether the time after the completion of the first cleaning task reaches a preset time and / or judging whether the target object has left the target area. This ensures that the cleaning robot can re-sweep the target area in a timely manner, while avoiding the impact of inappropriate re-sweeping timing on the user.

[0397] In any of the above embodiments, the determination module is used to determine the preset time duration based on the area category corresponding to the target area in the semantic map of the cleaning robot, wherein the area category includes one of the kitchen area, bedroom area, living room area, wash area, and office area.

[0398] In this embodiment, the cleaning robot is able to determine the area category of the target area based on the semantic information of the target area in the semantic map, and accordingly determine the preset time interval for re-sweeping the target area, so that the preset time interval matches the current actual scene.

[0399] In an embodiment of the present application, after identifying the target area, the cleaning robot can determine the specific area category corresponding to the target area through the semantic map, and determine the preset duration of the corresponding interval based on the area category, to ensure that the re-sweeping process matches the actual application scenario of the cleaning robot.

[0400] In any of the above embodiments, the control device 1600 of the cleaning robot includes:

[0401] A recognition module for identifying target features in image data;

[0402] a determination module, configured to determine a preset duration based on the posture and / or parameters of the target feature;

[0403] The target feature includes one of a door feature, a window feature, and a home appliance feature.

[0404] In this embodiment, it is proposed that the cleaning robot recognizes the posture and / or parameters of the target feature in the image data, and searches for the corresponding preset time duration based on the posture and / or parameters.

[0405] In an embodiment of the present application, the cleaning robot can analyze the actual scene in which the cleaning robot is located through the posture and / or parameters of the target features in the collected image data, and set the preset duration of the corresponding interval accordingly to ensure the success rate of the cleaning robot in performing the second cleaning task of make-up sweeping, and avoid the make-up sweeping process from having an adverse impact on users in the target area.

[0406] In any of the above embodiments, the control device 1600 of the cleaning robot includes:

[0407] An acquisition module, configured to acquire a second image corresponding to the target area;

[0408] A determination module is configured to determine whether the target object has left the target area based on the second image.

[0409] In this embodiment, it is proposed that before the cleaning robot performs supplementary sweeping according to the second cleaning trajectory, the image acquisition device captures a second image corresponding to the target area, performs image recognition on the second image, and determines whether the target object has left the target area, thereby achieving accurate control of whether the cleaning robot starts to perform supplementary sweeping.

[0410] In any of the above embodiments, the control module 1606 is configured to control the image acquisition device of the cleaning robot to continuously acquire image data while the cleaning robot performs the third cleaning task along the third cleaning trajectory.

[0411] In this embodiment, it is proposed that when the cleaning robot performs the corresponding third cleaning task according to the preset third cleaning trajectory after leaving the station, the image acquisition device is turned on to continuously collect image data, so as to facilitate the subsequent re-planning of the corresponding first cleaning trajectory and the second cleaning trajectory for supplementary cleaning based on the collected image data including the target object.

[0412] In the embodiment of the present application, by controlling the cleaning robot to keep the image acquisition device turned on after leaving the station, the cleaning robot can obtain the current surrounding environment in a timely manner, thereby improving the efficiency of replanning the first cleaning trajectory.

[0413] In one embodiment of the present application, as shown in FIG17 , a control device 1700 for a cleaning robot is provided, comprising:

[0414] An acquisition module 1702 is configured to acquire a target area, wherein a target object is located in the target area and the target object is included in image data collected by the cleaning robot;

[0415] A control module 1704 is configured to control the cleaning robot to clean according to a first cleaning trajectory based on the target area, where the first cleaning trajectory does not include the target area;

[0416] The control module 1704 is used to control the cleaning robot to clean according to the second cleaning trajectory when the cleaning robot completes at least part of the first cleaning trajectory, and the second cleaning trajectory includes the target area. In the embodiment of the present application, a control method for a cleaning robot is proposed, which is used to control the cleaning robot to re-plan the first cleaning trajectory and the second cleaning trajectory of the cleaning robot when a living thing such as a human body is detected. Among them, the first cleaning trajectory temporarily skips the target area where the human body and other living things are located, and after at least part of the first cleaning trajectory is completed, cleaning is performed according to the second cleaning trajectory including the target area to complete the re-sweeping of the target area, so that the cleaning robot can intelligently identify the target area where people are active, avoid the target area, and then re-sweep the target area where people are active to ensure the integrity of the cleaning.

[0417] In this embodiment, the cleaning robot includes an image acquisition device. While the cleaning robot is in motion, the image acquisition device is activated to capture the scene around the cleaning robot and perform semantic recognition on the captured image data. When a target object is identified in the image data, the cleaning robot determines the target area where the target object is located. Target objects include humans, pets, etc. The target area includes each room in a house.

[0418] Specifically, the first cleaning trajectory is the driving trajectory of the cleaning robot for cleaning non-target areas, and the second cleaning trajectory is the driving trajectory of the cleaning robot for cleaning target areas.

[0419] In an embodiment of the present application, the cleaning robot detects the target object and the target area where the target object is located through image recognition during driving, and preferentially cleans the non-target area through the first cleaning trajectory. After completing at least partial cleaning along the first cleaning trajectory, it then performs cleaning based on the second cleaning trajectory.

[0420] Based on the target area, the first cleaning trajectory of the cleaning robot is planned, and a second cleaning trajectory is planned for cleaning the target area. The cleaning task is performed by two different cleaning trajectories, ensuring that the cleaning robot does not affect the user's activities in the room during the cleaning task, and improving the cleaning efficiency of the cleaning robot in cleaning the room. In one embodiment of the present application, as shown in FIG18 , a control device 1800 for a cleaning robot is proposed, including:

[0421] a determination module 1802 for determining a first area of ​​the target object in the map when the image data collected by the cleaning robot includes the target object;

[0422] An acquisition module 1804 is configured to acquire an operating status of a target device corresponding to the first area;

[0423] The control module 1806 is configured to control the cleaning robot to clean the first area based on the operating status of the target device after the cleaning robot completes cleaning the second area in the map.

[0424] In an embodiment of the present application, a control device for a cleaning robot is provided. The control device can control the cleaning robot to identify a first area where a target object is located, replan its current cleaning trajectory to temporarily avoid the first area where the target object is active, and plan a subsequent re-cleaning path for the first area. The cleaning robot can also interact with other household devices to identify the user's activity status in the first area and thereby decide whether to initiate re-cleaning of the first area, thereby preventing the cleaning robot from adversely affecting the user during re-cleaning.

[0425] In an embodiment of the present application, the cleaning robot detects the target object through image recognition during driving, and determines the first area corresponding to the area where the target object is located. The operating status of the target device in the first area is used to determine whether to start re-sweeping the first area, so that the cleaning robot can judge and estimate the current operating scenario through the Internet of Things, and realize that the cleaning robot can avoid the area where the first area is located in the current cleaning stage, avoiding the current cleaning process from affecting the user, and can also promptly re-sweep the uncleaned area in the future, and can ensure that the re-sweeping stage will not have an adverse effect on the user's activities.

[0426] In any of the above embodiments, the determination module 1802 is configured to determine a preset duration based on the operating status of the target device;

[0427] The control module 1806 is used to control the cleaning robot to clean the first area after the cleaning robot completes cleaning the second area at an interval of target time. The target time is associated with the preset time and the cleaning time. The cleaning time is the time the cleaning robot cleans the second area.

[0428] In this embodiment, it is proposed that the cleaning robot can determine the target duration of the interval between the current cleaning phase and the re-sweeping phase according to the operating status of the target device in the first area. While ensuring the timeliness of the re-sweeping of the first area, it can also avoid the re-sweeping phase from affecting the activities of the target object in the first area.

[0429] In an embodiment of the present application, a plurality of first devices in the map are screened through the first area in the map to determine the target device therein, thereby ensuring the matching of the target device with the first area. After determining the target device, the cleaning robot communicates with the target device to determine the operating status of the target device. The corresponding preset duration is determined according to the operating status, and the target duration is set in combination with the cleaning duration of the cleaning robot for cleaning the second area, thereby improving the matching degree between the target duration for determining the re-sweeping interval and the operating status of the target device corresponding to the first area, and ensuring that the cleaning robot re-sweeps the first area after the target duration, without affecting the user.

[0430] In any of the above embodiments, the control device 1800 of the cleaning robot further includes:

[0431] a positioning module, configured to locate a plurality of first devices that match the map;

[0432] a screening module, configured to screen a target device from the plurality of first devices through the first area;

[0433] The acquisition module 1804 is used to obtain the operating status of the target device;

[0434] The determination module 1802 is configured to determine a preset duration according to the operating state of the target device and a preset correspondence.

[0435] This embodiment proposes a specific process of searching for a corresponding target device based on a map and setting a preset duration based on the operating status of the target device.

[0436] In an embodiment of the present application, a first area in a map is used to screen multiple first devices in the map, thereby determining a target device therein and ensuring that the target device matches the first area. After determining the target device, the cleaning robot communicates with the target device to determine the operating status of the target device and sets a preset duration accordingly. This improves the degree of matching between the preset duration for determining the re-sweep interval and the operating status of the target device corresponding to the first area, ensuring that the cleaning robot re-sweeps the first area after the preset duration without affecting the user.

[0437] In any of the above embodiments, the number of target devices is at least two;

[0438] An acquisition module 1804 is configured to acquire the operating statuses of at least two target devices and a preset correspondence relationship, and determine at least two interval durations;

[0439] The determination module 1802 is configured to determine a preset duration based on at least two interval durations.

[0440] In this embodiment, when multiple target devices are included in the first area, the cleaning robot sets corresponding preset durations according to multiple interval durations corresponding to the multiple target devices, further improving the degree of matching between the set preset durations and the actual scene.

[0441] In an embodiment of the present application, when there are multiple target devices corresponding to the first area, the cleaning robot can integrate the interval durations corresponding to the multiple target devices to determine the corresponding preset duration, further improving the degree of matching between the preset duration and the actual scene of the first area.

[0442] In any of the above embodiments, the preset duration is an average value of at least two interval durations; or the preset duration is a maximum value of at least two interval durations; or the preset duration is a minimum value of at least two interval durations.

[0443] This embodiment proposes multiple methods for determining a preset duration based on multiple interval durations. These methods include calculating an average value of the multiple interval durations and using the calculated average value as the preset duration. These methods also include taking the maximum or minimum value of the multiple interval durations and using the maximum or minimum value as the preset duration.

[0444] In an embodiment of the present application, by setting the preset duration to the maximum value, minimum value or average value among multiple interval durations, it is possible to further ensure that the preset duration matches the actual scene of the area corresponding to the first area, thereby ensuring the timeliness of re-scanning the area while avoiding adverse effects on the user during the re-scanning.

[0445] In any of the above embodiments, the determining module 1802 is configured to determine the activity state of the target object in the first area based on the operating state of the target device after the cleaning robot completes cleaning the second area;

[0446] The control module 1806 is configured to control the cleaning robot to clean the first area based on the activity state of the target object in the first area meeting a preset condition.

[0447] This embodiment proposes that after the cleaning robot completes cleaning the second area, it continuously obtains the operating status of the target device in the first area and, based on this information, determines whether starting a supplemental cleanup will affect the target object in the first area. If the cleaning robot determines that supplemental cleanup will not affect the target object, it controls the cleaning robot to start supplemental cleanup of the first area.

[0448] In an embodiment of the present application, the cleaning robot can judge the activity status of the target object based on the operating status of the target device, and judge whether to start re-sweeping the first area accordingly, so that the cleaning robot can quickly re-sweep the first area after the target object leaves the first area, ensuring the timeliness of the re-sweep and avoiding the impact of the re-sweep on the target object in the first area.

[0449] In any of the above embodiments, the control device 1800 of the cleaning robot includes:

[0450] a planning module, configured to plan a fourth cleaning trajectory based on the second area;

[0451] The control module 1806 is used to control the cleaning robot to clean according to the fourth cleaning trajectory.

[0452] This embodiment provides a detailed process for the cleaning robot to clean the second area, including planning a fourth cleaning trajectory based on the second area in the map, driving the cleaning robot to follow the planned fourth cleaning trajectory, and monitoring the operating status of the cleaning component of the cleaning robot during driving, ensuring that the cleaning component is turned off when the cleaning robot passes through the first area to avoid affecting the user's activities in the first area.

[0453] In an embodiment of the present application, when the cleaning robot passes through the second area, the cleaning component is kept in an on state to ensure that the cleaning robot can normally clean the second area in the house.

[0454] In any of the above embodiments, the control module 1806 is configured to control the cleaning component of the cleaning robot to stop operating when the cleaning robot is traveling in the first area, and to control the cleaning component to operate when the cleaning robot is traveling in the second area;

[0455] The control module 1806 is configured to control the cleaning robot to keep the cleaning component in operation during the process of driving along the fourth cleaning trajectory, when the fourth cleaning trajectory includes the second area but does not include the first area.

[0456] In this embodiment, when the fourth cleaning trajectory planned by the cleaning robot passes through the first and second areas, the cleaning robot turns off the cleaning component while traveling in the first area and cleans the second area only with the cleaning component. If the fourth cleaning trajectory planned by the cleaning robot passes only through the second area, the cleaning robot maintains the operation of the cleaning component while cleaning along the fourth cleaning trajectory, thereby cleaning the second area.

[0457] In an embodiment of the present application, the cleaning robot cleans the second area and avoids the location of the first area, trying to ensure that it does not pass through the first area. If the first area cannot be avoided, the cleaning component is stopped to reduce the impact on users in the first area and ensure the cleaning effect of the cleaning robot on the second area.

[0458] In any of the above embodiments, the target device includes at least one of an electric rice cooker, a water heater, an air conditioner, an electric curtain, a television, a water dispenser, a hair dryer, and a washing machine.

[0459] In this embodiment, it is proposed that the target device includes at least one of: an electric rice cooker, a water heater, an air conditioner, an electric curtain, a television, a water dispenser, a hair dryer, and a washing machine, that is, all smart IoT home devices can be used as target devices to communicate with the cleaning robot.

[0460] In an embodiment of the present application, by setting different types of devices as target devices, the accuracy of the preset time determined by the target device can be improved, ensuring that after the preset time of cleaning the second area is completed, when the first area is cleaned, it will not affect the activities of people in the first area.

[0461] In any of the above embodiments, the planning module is configured to plan a fifth cleaning trajectory based on the map;

[0462] A control module 1806 is used to control the cleaning robot to clean according to a fifth cleaning trajectory;

[0463] The control module 1806 is used to control the image acquisition device of the cleaning robot to continuously acquire image data during the cleaning process of the cleaning robot.

[0464] In this embodiment, it is proposed that when the cleaning robot cleans according to the preset fifth cleaning trajectory after leaving the station, the image acquisition device is turned on to continuously acquire image data, so as to facilitate the subsequent re-planning of the corresponding fourth cleaning trajectory and the fifth cleaning trajectory for re-sweeping based on the acquired image data including the target object.

[0465] In the embodiment of the present application, by controlling the cleaning robot to keep the image acquisition device turned on after leaving the station, the cleaning robot can obtain the current surrounding environment in a timely manner, thereby improving the efficiency of re-planning the fourth cleaning trajectory.

[0466] In any of the above embodiments, the acquisition module 1804 is configured to acquire location information of a second device in the map, where the second device is a home appliance in operation;

[0467] The planning module is used to plan the fifth cleaning trajectory according to the positioning information.

[0468] In this embodiment, it is proposed that the cleaning robot plans the fifth cleaning trajectory based on the positioning information of the household appliances in operation in the map before leaving the station, so that the operating status of the household appliances in the house is fully considered before cleaning begins, thereby reducing the number of times the cleaning robot replans the path after leaving the station.

[0469] In an embodiment of the present application, the cleaning robot plans the fifth cleaning trajectory through the positioning information of the second device in operation without leaving the station, thereby reducing the possibility of the cleaning robot replanning the path during the cleaning process.

[0470] In any of the above embodiments, the map includes any of the following: a semantic map, an image map.

[0471] In this embodiment, the map stored in the sweeping robot may be a semantic map or an image map.

[0472] In an embodiment of the present application, by setting the map as a semantic map or an image map, the accuracy of the cleaning trajectory automatically planned by the sweeper can be improved, thereby ensuring the cleaning effect and efficiency of the sweeper in cleaning the house based on the map.

[0473] In one embodiment of the present application, as shown in Figure 19, a control device 1900 for a cleaning robot is proposed, including: a processor 1902 and a memory 1904, in which programs or instructions are stored; the processor 1902 executes the program or instructions stored in the memory 1904 to implement the steps of the control method for the cleaning robot in any of the above embodiments, and thus has all the beneficial technical effects of the control method for the cleaning robot in any of the above embodiments, which will not be elaborated on here.

[0474] In one embodiment of the present application, a computer program product is proposed. When the computer program product is executed by a processor, it implements the steps of the control method of the cleaning robot in any of the above embodiments, and thus has all the beneficial technical effects of the control method of the cleaning robot in any of the above embodiments, which will not be elaborated here.

[0475] In one embodiment of the present application, a readable storage medium is provided. The readable storage medium stores a program or instructions. When executed by a processor, the program or instructions implement the steps of the control method for a cleaning robot as described in any of the above embodiments. Therefore, all the beneficial technical effects of the control method for a cleaning robot as described in any of the above embodiments are achieved, and no further details will be given here.

[0476] In one embodiment of the present application, as shown in Figure 20, a cleaning robot 2000 is proposed, including: a control device 1900 of the cleaning robot as in any of the above embodiments, and / or a computer program product 2002 in any of the above embodiments, and / or a readable storage medium 2004 in any of the above embodiments, and thus has all the beneficial technical effects of the control device 1900 of the cleaning robot in any of the above embodiments, and / or the computer program product 2002 in any of the above embodiments, and / or the readable storage medium 2004 in any of the above embodiments, and no further details will be given here.

[0477] It should be clarified that in the claims, specification and drawings of this application, the term "plurality" refers to two or more. Unless otherwise clearly defined, the orientation or positional relationship indicated by the terms "upper" and "lower" is based on the orientation or positional relationship shown in the drawings. It is only for the purpose of more conveniently describing this application and making the description process simpler, and is not intended to indicate or imply that the device or element referred to must have the specific orientation described, be constructed and operated in a specific orientation. Therefore, these descriptions cannot be understood as limiting this application. The terms "connect", "install", "fix" and the like should be understood in a broad sense. For example, "connection" can be a fixed connection between multiple objects, or a detachable connection between multiple objects, or an integral connection; it can be a direct connection between multiple objects, or an indirect connection between multiple objects through an intermediate medium. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood based on the specific circumstances of the above data.

[0478] In the claims, specification, and drawings of this application, the terms "one embodiment," "some embodiments," "a specific embodiment," and the like mean that the specific features, structures, materials, or characteristics described in conjunction with the embodiment or example are included in the embodiment or example of this application. In the claims, specification, and drawings of this application, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.

[0479] The above are merely preferred embodiments of the present application and are not intended to limit the present application. Those skilled in the art will readily appreciate that various modifications and variations are possible. Any modifications, equivalent substitutions, or improvements made within the spirit and principles of the present application shall be included within the scope of protection of the present application.

Claims

1. A control method for a cleaning robot, wherein: include: Acquire a target area, a target object is in the target area, and the target object is included in the image data collected by the cleaning robot; Based on the target area, planning a first cleaning trajectory and a second cleaning trajectory, wherein the first cleaning trajectory does not include the target area, and the second cleaning trajectory includes the target area; Based on the first cleaning trajectory and at least a portion of the second cleaning trajectory, the cleaning robot is controlled to perform a cleaning task.

2. A method for controlling a cleaning robot, wherein: include: Acquire a target area, a target object is in the target area, and the target object is included in the image data collected by the cleaning robot; Based on the target area, controlling the cleaning robot to clean according to a first cleaning trajectory, wherein the first cleaning trajectory does not include the target area; When the cleaning robot completes at least a portion of the first cleaning trajectory, the cleaning robot is controlled to clean according to a second cleaning trajectory, where the second cleaning trajectory includes the target area.

3. The control method of the cleaning robot according to claim 1 or 2, wherein: The acquiring the target area includes: Determine a first sub-map of the target object in the semantic map according to the semantic map of the cleaning robot and the image data; The area corresponding to the first sub-map is determined as the target area.

4. The control method of the cleaning robot according to claim 1, wherein: The cleaning task includes a first cleaning task and a second cleaning task; The controlling the cleaning robot to perform a cleaning task based on the first cleaning trajectory and at least a portion of the second cleaning trajectory includes: When the cleaning robot completes the first cleaning task according to the first cleaning trajectory and the target area meets a preset condition, the cleaning robot is controlled to perform the second cleaning task according to at least a part of the second cleaning trajectory.

5. The control method of the cleaning robot according to claim 4, wherein: The first cleaning task includes: During the driving of the cleaning robot along the first cleaning trajectory, based on the driving of the cleaning robot in a non-target area, the cleaning component of the cleaning robot is controlled to operate; the second cleaning task includes: During the process in which the cleaning robot drives along at least a portion of the second cleaning trajectory, based on the cleaning robot driving in the target area, the cleaning components of the cleaning robot are controlled to operate.

6. The control method of the cleaning robot according to claim 4, wherein: After the cleaning robot completes the first cleaning task according to the first cleaning trajectory, the method further includes: determining a secondary cleaning area in a non-target area according to a first image captured by the cleaning robot during the execution of the first cleaning task, wherein the first image is an image of the non-target area; Based on the secondary cleaning area, the second cleaning trajectory is updated so that the second cleaning trajectory includes the target area and the secondary cleaning area.

7. The control method of the cleaning robot according to any one of claims 4 to 6, wherein: The preset conditions include: The time after the first cleaning task is completed reaches a preset time; and / or The target object leaves the target area.

8. The control method of the cleaning robot according to claim 7, wherein: The method further comprises: before controlling the cleaning robot to perform the second cleaning task according to at least a portion of the second cleaning trajectory when the cleaning robot completes the first cleaning task according to the first cleaning trajectory and the target area meets the preset condition: The preset duration is determined based on an area category corresponding to the target area in the semantic map of the cleaning robot, where the area category includes one of a kitchen area, a bedroom area, a living room area, a wash area, and an office area.

9. The control method of the cleaning robot according to claim 7, wherein: The method further comprises: before controlling the cleaning robot to perform the second cleaning task according to at least a portion of the second cleaning trajectory when the cleaning robot completes the first cleaning task according to the first cleaning trajectory and the target area meets the preset condition: identifying target features in the image data; The preset duration is determined according to the posture and / or parameter of the target feature, wherein the target feature includes one of a door feature, a window feature, and a home appliance feature.

10. The control method of the cleaning robot according to claim 7, wherein: The method further comprises: before controlling the cleaning robot to perform the second cleaning task according to at least a portion of the second cleaning trajectory when the cleaning robot completes the first cleaning task according to the first cleaning trajectory and the target area meets the preset condition: A second image corresponding to the target area is acquired, and based on the second image, it is determined whether the target object has left the target area.

11. The control method of the cleaning robot according to any one of claims 1 to 10, wherein: Before obtaining the target area, the method includes: When the cleaning robot performs the third cleaning task according to the third cleaning trajectory, the image acquisition device of the cleaning robot is controlled to continuously acquire the image data.

12. A method for controlling a cleaning robot, wherein: include: In a case where the image data collected by the cleaning robot includes a target object, determining a first area of ​​the target object in the map; Acquire the operating status of the target device corresponding to the first area; After the cleaning robot completes cleaning the second area in the map, the cleaning robot is controlled to clean the first area based on the operating state of the target device.

13. The control method of the cleaning robot according to claim 12, wherein: After the cleaning robot completes cleaning the second area in the map, based on the operating state of the target device, controlling the cleaning robot to clean the first area includes: Determining a preset duration based on the operating status of the target device; After the cleaning robot completes cleaning the second area, the cleaning robot is controlled to clean the first area at a target time interval, where the target time is associated with the preset time and the cleaning time, and the cleaning time is the time the cleaning robot takes to clean the second area.

14. The control method of the cleaning robot according to claim 13, wherein: After the cleaning robot completes cleaning the second area, before controlling the cleaning robot to clean the first area for a target time period, the method includes: When the cleaning time is greater than or equal to the preset time, the target time is determined to be 0; When the cleaning time is shorter than the preset time, the difference between the preset time and the cleaning time is determined as the target time.

15. The control method of the cleaning robot according to claim 13, wherein: The determining of the preset duration based on the operating state of the target device includes: locating a plurality of first devices matching the map; Filtering a target device from among the plurality of first devices through the first area; Obtaining the operating status of the target device; The preset duration is determined according to the operating state of the target device and the preset corresponding relationship.

16. The control method of the cleaning robot according to claim 15, wherein: The number of the target devices is at least two; The determining the preset duration according to the operating state of the target device and the preset corresponding relationship includes: Obtaining the operating status of at least two of the target devices and the preset corresponding relationship, and determining at least two interval durations; The preset duration is determined according to the at least two interval durations.

17. The control method of the cleaning robot according to claim 16, wherein: The preset duration is an average value of the at least two interval durations; or The preset duration is the maximum value of the at least two interval durations; or The preset duration is the minimum value of the at least two interval durations.

18. The control method of the cleaning robot according to claim 12, wherein: After the cleaning robot completes cleaning the second area in the map, based on the operating state of the target device, controlling the cleaning robot to clean the first area includes: After the cleaning robot completes cleaning the second area, determining the activity state of the target object in the first area based on the operating state of the target device; Based on the activity state of the target object in the first area meeting a preset condition, the cleaning robot is controlled to clean the first area.

19. The control method of the cleaning robot according to any one of claims 12 to 18, wherein: After the cleaning robot completes cleaning the second area in the map, before controlling the cleaning robot to clean the first area based on the operating state of the target device, the method includes: planning a fourth cleaning trajectory based on the second area; The cleaning robot is controlled to perform cleaning according to the fourth cleaning trajectory.

20. The control method of the cleaning robot according to claim 19, wherein: The controlling the cleaning robot to perform cleaning according to the fourth cleaning trajectory comprises: The fourth cleaning track includes the first area and the second area, and when the cleaning robot travels in the first area, the cleaning component of the cleaning robot is controlled to stop running, and when the cleaning robot travels in the second area, the cleaning component is controlled to run; The fourth cleaning trajectory includes the second area but does not include the first area, and the cleaning component is kept in an operating state during the process of controlling the cleaning robot to travel along the fourth cleaning trajectory.

21. The control method of the cleaning robot according to any one of claims 12 to 18, wherein: The target device includes at least one of an electric rice cooker, a water heater, an air conditioner, an electric curtain, a television, a water dispenser, a hair dryer, and a washing machine.

22. The control method of the cleaning robot according to any one of claims 12 to 18, wherein: When the image data collected by the cleaning robot includes the target object, before determining that the target object is in the first area in the map, the method includes: Based on the map, planning a fifth cleaning trajectory; Controlling the cleaning robot to clean according to the fifth cleaning trajectory; During the cleaning process of the cleaning robot, the image acquisition device of the cleaning robot is controlled to continuously acquire the image data.

23. The control method of the cleaning robot according to claim 22, wherein: The planning of a fifth cleaning trajectory based on the map includes: Acquire positioning information of a second device in the map, where the second device is a home device in operation; The fifth cleaning trajectory is planned according to the positioning information.

24. The control method of the cleaning robot according to any one of claims 12 to 18, wherein: The map includes any of the following: a semantic map, an image map.

25. A control device for a cleaning robot, wherein: include: An acquisition module, used for acquiring a target area, a target object is located in the target area, and the target object is included in the image data collected by the cleaning robot; A planning module, configured to plan a first cleaning trajectory and a second cleaning trajectory based on the target area, wherein the first cleaning trajectory does not include the target area, and the second cleaning trajectory includes the target area; A control module is used to control the cleaning robot to perform a cleaning task based on the first cleaning trajectory and at least a part of the second cleaning trajectory.

26. A control device for a cleaning robot, wherein: include: An acquisition module, used for acquiring a target area, a target object is located in the target area, and the target object is included in the image data collected by the cleaning robot; A control module, configured to control the cleaning robot to clean according to a first cleaning trajectory based on the target area, wherein the first cleaning trajectory does not include the target area; A control module is used to control the cleaning robot to clean according to a second cleaning trajectory when the cleaning robot completes at least a part of the first cleaning trajectory, and the second cleaning trajectory includes the target area.

27. A control device for a cleaning robot, wherein: include: a determination module, configured to determine a first area of ​​the target object in the map when the image data collected by the cleaning robot includes the target object; An acquisition module, used for acquiring the operating status of a target device corresponding to the first area; A control module is used to control the cleaning robot to clean the first area based on the operating state of the target device after the cleaning robot completes cleaning the second area in the map.

28. A control device for a cleaning robot, wherein: include: A memory on which programs or instructions are stored; A processor, used to implement the steps of the control method of the cleaning robot as described in any one of claims 1 to 24 when executing the program or instructions.

29. A computer program product, wherein: When the computer program product is executed by a processor, the steps of the control method of the cleaning robot according to any one of claims 1 to 24 are implemented.

30. A readable storage medium having a program or instruction stored thereon, wherein: When the program or instruction is executed by the processor, the steps of the control method of the cleaning robot according to any one of claims 1 to 24 are implemented.

31. A cleaning robot, wherein: include: A control device for a cleaning robot as claimed in any one of claims 25 to 28; and / or A computer program product as claimed in claim 29; and / or The readable storage medium of claim 30.

Citation Information

Patent Citations

  • Mobile robot and control method and system thereof

    CN108170137A

  • Method for navigation of robot

    CN110809745A

  • Cleaning robot control method and device, cleaning robot and storage medium

    CN112168066A

  • Cleaning robot, control method, device and equipment thereof and storage medium

    CN115328172A

  • Mobile robot and controlling method of the same

    US20100228394A1