Cleaning device, cleaning system, and cleaning program

The cleaning device and system assess cleaning effectiveness by comparing pre- and post-cleaning images, allowing it to stop cleaning if dirt is spread, effectively addressing the issue of dirt spread and surface damage in conventional cleaning robots.

WO2024237144A1PCT designated stage expired Publication Date: 2024-11-21DENSO CORP
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2024/017112
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-16
Filing Date
2024-05-08
Publication Date
2024-11-21

AI Technical Summary

Technical Problem

Conventional cleaning robots may spread dirt while cleaning, leading to ineffective cleaning and potential damage to surfaces, as they do not have the capability to assess and adjust their cleaning based on the type and spread of dirt.

Method used

A cleaning device and system equipped with a self-position estimating unit, control unit, and cleaning effect determination unit that autonomously travels and assesses the cleaning effectiveness by comparing images before and after cleaning, allowing it to stop cleaning if the dirt is spread or if the surface condition worsens.

Benefits of technology

Enables the cleaning device to prevent the spread of dirt and adjust its cleaning operations, ensuring effective cleaning and surface protection by determining the cleaning effectiveness and adapting its behavior accordingly.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2024017112_21112024_PF_FP_ABST
    Figure JP2024017112_21112024_PF_FP_ABST
Patent Text Reader

Abstract

A cleaning device (10) includes an own-position estimation unit (50) for estimating a position of an own device, control units (58, 60) for controlling the own device so as to clean a floor surface in a cleaning area (14), while autonomously traveling, on the basis of the position estimated by the own-position estimation unit, and a cleaning-effect determination unit (54) for determining a cleaning effect on the basis of images of the floor surface before and after the cleaning for each small area in the cleaning area, and when it is determined by the cleaning-effect determination unit that dirt on the floor surface has deteriorated, the control unit executes control to discontinue traveling of the own device in the small area to be determined and stop the cleaning.
Need to check novelty before this filing date? Find Prior Art

Description

Cleaning equipment, cleaning systems and cleaning programs CROSS-REFERENCE TO RELATED APPLICATIONS

[0001] This application is based on Japanese Application No. 2023-081047, filed on May 16, 2023, the contents of which are incorporated herein by reference.

[0002] The present disclosure relates to a cleaning device, a cleaning system, and a cleaning program.

[0003] In recent years, autonomous cleaning robots that clean floors have been widely used. These cleaning robots are used to clean various areas, such as homes, offices, and public facilities (e.g., train stations).

[0004] For example, International Publication No. 2022 / 009391 (Patent Document 1) discloses a cleaning system comprising: a first autonomous mobile robot suitable for cleaning relatively large areas; an imaging means for photographing the entire cleaning area while the first autonomous mobile robot cleans the cleaning area in accordance with cleaning instruction information created based on layout information of the cleaning area; a generation means for generating uncleaned area information that identifies areas within the cleaning area that have not actually been cleaned by the first autonomous mobile robot by analyzing the image data generated by the imaging means; and an instruction means for instructing the first autonomous mobile robot to clean areas that have not actually been cleaned, which are identified from the uncleaned area information.

[0005] In conventional cleaning systems, such as the cleaning system described in Patent Literature 1, cleaning is considered complete when the cleaning robot passes through the cleaning area. However, depending on the type of soiling material, such as food, drink, vomit, or animal excrement, the cleaning robot's passage may actually spread the soiling.

[0006] An object of the present disclosure is to provide a cleaning device, cleaning system, and cleaning program that can choose not to clean if the device itself is spreading dirt.

[0007] A cleaning device according to a first aspect of the present disclosure comprises a self-position estimation unit that estimates the position of the device itself, a control unit that controls the device to clean the floor surface within a cleaning area while autonomously traveling based on the position estimated by the self-position estimation unit, and a cleaning effect determination unit that determines the cleaning effect for each small area within the cleaning area based on images of the floor surface before and after cleaning, and the control unit controls the cleaning device to stop traveling and cancel cleaning in the small area being determined when the cleaning effect determination unit determines that the dirt on the floor surface has worsened.

[0008] A cleaning system according to a second aspect of the present disclosure is a cleaning system comprising a cleaning device and a cleaning assistance device communicatively connected to the cleaning device and assigning a cleaning task to the cleaning device to clean a specific cleaning area, wherein the cleaning device comprises a self-position estimation unit that estimates the position of the device itself, a control unit that controls the device to clean the floor surface within the cleaning area while autonomously traveling based on the position estimated by the self-position estimation unit, and a cleaning effect determination unit that determines the cleaning effect for each small area within the cleaning area based on images of the floor surface before and after cleaning, and wherein if the cleaning effect determination unit determines that the dirt on the floor surface has worsened, the control unit controls the device to stop traveling in the small area being determined and to cease cleaning.

[0009] A cleaning program according to a third aspect of the present disclosure is a cleaning program that causes at least one processor to estimate the position of the device, control the device to clean the floor surface within a cleaning area while autonomously traveling based on the estimated position, determine the cleaning effectiveness for each small area within the cleaning area based on images of the floor surface before and after cleaning, and, if it is determined that the dirt on the floor surface has worsened, control the device to stop traveling and cancel cleaning in the small area being determined.

[0010] According to the present disclosure, a cleaning device, cleaning system, and cleaning program are provided that can select not to clean if the device itself is spreading dirt.

[0011] FIG. 1 is a schematic diagram showing an example of a configuration of a cleaning system according to a first embodiment of the present disclosure. FIG. 2 is a block diagram showing an example of a hardware configuration of a cleaning device according to the first embodiment of the present disclosure. FIG. 3 is a functional block diagram showing an example of a functional configuration of a cleaning system according to the first embodiment of the present disclosure. FIG. 4 is a flowchart showing an example of a flow of a cleaning program according to the first embodiment of the present disclosure. FIG. 5 is a flowchart showing an example of a flow of a "cleaning effect determination process" according to the first embodiment. FIG. 6 is a flowchart showing an example of a flow of a cleaning program according to a second embodiment of the present disclosure. FIG. 7 is a flowchart showing an example of a flow of a "dirt detection process" according to the second embodiment. FIG. 8 is a schematic diagram showing an example of dirt detection. FIG. 9 is a schematic diagram showing another example of dirt detection. FIG. 10 is a schematic diagram showing another example of dirt detection. FIG. 11 is a schematic diagram showing another example of dirt detection. FIG. 12 is a flowchart showing an example of a "cleaning effect determination process" according to a third embodiment of the present disclosure. FIG. 13 is a flowchart showing an example of a flow of an "additional dirt detection process" according to the third embodiment. FIG. 14 is a flowchart showing an example of a flow of a cleaning program according to a fourth embodiment of the present disclosure.

[0012] Hereinafter, an example of an embodiment of the present disclosure will be described in detail with reference to the drawings.

[0013] First Embodiment Cleaning System First, a cleaning system according to the present disclosure will be described with reference to Fig. 1. As shown in Fig. 1, the cleaning system 100 includes a cleaning device 10, which is an autonomous robot, and a cleaning assistance device 12 communicably connected to the cleaning device 10. The cleaning system 100 may include a plurality of cleaning devices 10. In this example, the cleaning device 10 1 , 10 2 , 10 3 Three cleaning devices 10 are shown. 1 , 10 2 , 10 3 When there is no need to distinguish between them, they will be collectively referred to as the cleaning device 10.

[0014] The cleaning support device 12 is located in the cleaning area 14 1 , 142 , 14 3 The cleaning task is generated for each cleaning job (hereinafter referred to as a "cleaning task") and the cleaning task is sent to the cleaning device 10. 1 , 10 2 , 10 3 Here, the cleaning device 10 1 , 10 2 , 10 3 Each of the cleaning areas 14 1 , 14 2 , 14 3 The cleaning area 14 is assigned the task of cleaning. 1 , 14 2 , 14 3 When there is no need to distinguish between them, they will be collectively referred to as cleaning area 14. Cleaning device 10 is placed in cleaning area 14 to be cleaned, and cleans the floor surface of cleaning area 14 while autonomously traveling within cleaning area 14.

[0015] In the cleaning system 100 of the present disclosure, the cleaning device 10 autonomously travels within the cleaning area 14, capturing images of the floor surface before and after cleaning, and then comparing the images to determine the cleaning effect. If the floor surface becomes dirty, the cleaning device 10 assumes that the device itself is spreading the dirt, and chooses not to clean any further.

[0016] In this embodiment, an example in which the cleaning support device 12 generates a task will be described, but the cleaning device 10 may also have a task generation function. If the cleaning device 10 has a task generation function, the cleaning support device 12 may be omitted.

[0017] (Hardware Configuration) Next, an example of the hardware configuration of the cleaning device 10 will be described with reference to Fig. 2. As shown in Fig. 2, the cleaning device 10 includes a control unit 20. The control unit 20 can be configured as a computer, and includes a processor 32, a read-only memory (ROM) 34, a random access memory (RAM) 36, a storage 38, an input / output interface (I / F) 40, and a communication interface (I / F). The processor 32, the ROM 34, the RAM 36, the storage 38, the input / output interface 40, and the communication interface 42 are connected to each other via an internal bus 44 so as to be able to communicate with each other.

[0018] The processor 32 may be configured, for example, by a CPU (Central Processing Unit), and executes various programs and controls each component. Specifically, the processor 32 reads various programs stored in the ROM 34 or the storage 38, and executes the programs using the RAM 36 as a work area. The processor 32 controls each component of the cleaning device 10 and performs various arithmetic processing in accordance with the programs.

[0019] The ROM 34 stores various programs and various data. The RAM 36 temporarily stores programs or data as a working area. The storage 38 can be configured with a recording medium such as a hard disk drive (HDD), a solid state drive (SSD), or a flash memory.

[0020] The storage 38 may store various programs including an operating system and various data necessary to operate the cleaning device 10. In this embodiment, the ROM 34 or the storage 38 stores a "cleaning program" (described later) and various data necessary to execute cleaning tasks.

[0021] The communication interface 42 may be capable of transmitting and receiving predetermined data via wireless communication based on a wireless communication standard such as Wi-Fi (registered trademark) or Bluetooth (registered trademark). The communication interface 42 allows the control unit 20 of the cleaning device 10 to communicate with other electronic devices, such as the cleaning assistance device 12 or other cleaning devices 10, via a network.

[0022] As shown in FIG. 2, the input / output interface 40 of the control unit 20 is connected to the traveling device 22, the cleaning tool 24, the camera 26, the display 28, and the notification device 30 so as to be able to send and receive data to and from the control unit 20.

[0023] The traveling device 22 includes a plurality of wheels 22A disposed on the front and rear bottom of the cleaning device 10. At least some of the wheels 22A are rotated by a driving means such as a motor (not shown), and the direction of travel is changed by a steering means that can control the orientation of at least some of the wheels 22A, thereby realizing autonomous traveling of the cleaning device 10.

[0024] The cleaning tool 24 is provided at an appropriate location on the cleaning device 10 and enables cleaning of the floor surface while the cleaning device 10 is autonomously traveling. The cleaning tool 24 includes at least a vacuum cleaner capable of sucking up dust and dirt from the floor surface. The cleaning tool 24 may further include a cloth or the like capable of wiping, such as wet wiping or dry wiping. The cleaning tool 24 may also include a robot arm to which a predetermined cleaning tool can be attached or which can grasp a cleaning tool. The cleaning tool 24 may also include a dust sensor 24A built in.

[0025] Each cleaning device 10 may be equipped with a plurality of different types of cleaning tools 24. In this case, different cleaning tools 24 may be used depending on the type of dirt. Furthermore, each of the plurality of cleaning devices 10 may be equipped with the same type of cleaning tool 24, or may be equipped with different types of cleaning tools 24. When each cleaning device 10 is equipped with different types of cleaning tools 24, cleaning using the most appropriate cleaning means can be easily performed, for example, by changing the cleaning device 10 that performs cleaning depending on the type of dirt.

[0026] The camera 26 is a device that captures images of the surroundings of the cleaning device 10 and the floor surface. The cleaning device 10 estimates its own position from the surrounding conditions captured by the camera 26. The cleaning device 10 also captures images of the floor surface before and after cleaning. For example, the cameras 26 may be installed in front of and behind the cleaning device 10 to capture images of the floor surface before and after cleaning. For example, the camera 26 installed in the front of the cleaning device 10 captures an image of the floor surface in front of the cleaning device 10 before cleaning (for example, the camera 26 installed in the front of the cleaning device 10 in FIG. 1 ). 2 1 ). After passing through the floor surface and cleaning, a camera 26 installed at the rear of the cleaning device 10 captures an image of the floor surface after cleaning behind the cleaning device 10 (for example, see the cleaning device 10 in FIG. 1 ). 3 (See figure below.)

[0027] A two-dimensional camera using an imaging element such as a charge coupled device (CCD) sensor or a complementary metal oxide semiconductor (CMOS) sensor can be used as the camera 26. Alternatively, a three-dimensional camera such as a stereo camera, structured light, or a camera with a depth sensor such as a time of flight (ToF) sensor can be used as the camera 26.

[0028] Although the camera 26 is exemplified here, object detection means other than a camera may be used to estimate the self-position of the cleaning device 10 and to detect dirt, as described below. For example, instead of or in addition to the camera 26, radar (e.g., a millimeter wave sensor) or LiDAR (Laser Imaging Detection and Ranging) that detects the distance and direction to objects around the vehicle, sonar that detects objects around the vehicle using sound waves, or a GPS (Global Positioning System) may be used. Furthermore, the self-position may be estimated using a digital map such as a GIS (Geographic Information System).

[0029] The display 28 is a device for displaying various types of information to the user, etc. For example, messages to people in the vicinity can be displayed on the display 28. The display 28 may be installed in any position on the cleaning device 10. As the display 28, a well-known display device such as a liquid crystal display (LCD) or an organic electro-luminescent display (OLED) can be used.

[0030] The notification device 30 is a device for notifying people in the vicinity of various information by making sounds or turning on lamps. The notification device 30 may be installed at any position on the cleaning device 10. The notification device 30 may be provided with a speaker for outputting sound, a lamp for outputting light, or the like.

[0031] Although detailed description will be omitted, the cleaning support device 12 is, for example, a server device located in the cloud. The cleaning support device 12 can be configured as a cloud server capable of providing XaaS (X as a Service). The cleaning support device 12 includes a control device, a storage device, and a communication interface. The control device of the cleaning support device 12 can be configured as a computer, similar to the control unit 20 of the cleaning device 10.

[0032] (Functional Configuration) Next, the functional configuration of the cleaning device 10 will be described with reference to Fig. 3. The cleaning device 10 includes a self-location estimation unit 50, a dirt detection unit 52, a cleaning effectiveness determination unit 54, a cleaning feasibility determination unit 56, a travel control unit 58, a cleaning control unit 60, and a notification control unit 62. Of the functional units illustrated above, the cleaning device 10 of the present disclosure is primarily composed of the self-location estimation unit 50, the cleaning effectiveness determination unit 54, and the cleaning control unit 60. Note that components other than the self-location estimation unit 50, the dirt detection unit 52, the cleaning effectiveness determination unit 54, and the cleaning feasibility determination unit 56 may be collectively referred to as the "control unit."

[0033] The self-position estimation unit 50 is a functional unit that estimates the position of the cleaning device 10. In this embodiment, the self-position is estimated from the surrounding conditions captured by the camera 26 and map information of the cleaning area 14. The self-position estimation unit 50 can also detect the traveling speed of the cleaning device 10 from changes in the position of the device over time.

[0034] The dirt detection unit 52 is a functional unit that detects dirt on the floor surface of a portion of the cleaning area 14 before cleaning and detects the type and state of the dirt. In this embodiment, the dirt detection unit 52 detects dirt on the floor surface of the cleaning area 14 before cleaning by comparing an image of the floor surface of the cleaning area 14 that has been taken in advance and is clean with an image of the floor surface of the cleaning area 14 that has been taken immediately before cleaning.

[0035] The cleaning effect determination unit 54 is a functional unit that, after cleaning, determines the cleaning effect for a portion of the area within the cleaning area 14 based on images of the floor surface before and after cleaning. In this embodiment, the cleaning effect determination unit 54 compares an image of the floor surface of the cleaning area 14 taken before cleaning with an image of the floor surface of the cleaning area 14 taken after cleaning, and determines the cleaning effect based on whether the dirt on the floor surface has worsened.

[0036] The cleaning feasibility determination unit 56 is a functional unit that determines, before cleaning, whether or not it is possible to clean the floor surface of a portion of the cleaning area 14. The cleaning feasibility determination unit 56 calculates the cleanability of the dirt detected by the dirt detection unit 52, and determines whether or not the cleaning device 10 can clean the dirt based on the calculated cleanability.

[0037] The travel control unit 58 is a functional unit that controls the travel device 22 based on the location of the device itself estimated by the self-location estimation unit 50 to cause the cleaning device 10 to travel autonomously. The cleaning control unit 60 is a functional unit that controls the position of the cleaning tool 24 and the like to clean the floor surface within the cleaning area 14. In this embodiment, if the cleaning effect determination unit 54 determines that the dirt on the floor surface has worsened, the cleaning device 10 is controlled to stop traveling in the small area being determined and to stop cleaning.

[0038] In this embodiment, the operating modes include a "cleaning mode" in which the cleaning device 10 performs cleaning while autonomously traveling, and a "non-cleaning mode" in which the cleaning device 10 performs autonomous traveling without cleaning. The cleaning control unit 60 transitions the operating mode from the non-cleaning mode to the cleaning mode when cleaning starts. Furthermore, the cleaning control unit 60 transitions the operating mode from the cleaning mode to the non-cleaning mode when the cleaning effect determination unit 54 determines that the dirt on the floor surface has worsened. In the cleaning mode, the traveling control unit 58 and the cleaning control unit 60 cooperate to control the cleaning device 10.

[0039] The notification control unit 62 is a functional unit that notifies various information to the outside when, for example, a cleaning task is stopped. The notification control unit 62 controls the notification device 30 to notify people in the vicinity of the various information. The notification control unit 62 also causes the various information to be transmitted to the cleaning assistance device 12 or other cleaning devices 10 via the communication interface 42.

[0040] The cleaning support device 12 also includes a task generation unit 66 and a dirt information accumulation unit 68. The task generation unit 66 is a functional unit that generates tasks to be executed by each cleaning device 10, specifically, cleaning tasks that include the details of the cleaning work. The cleaning task may include information such as the cleaning area to be cleaned, the target degree of cleaning, and the cleaning tool 24 to be used. The dirt information accumulation unit 68 is a functional unit that stores the dirt information transmitted from each cleaning device 10 in a storage device in association with the location on a map of the cleaning area 14.

[0041] The respective functional units of the cleaning device 10 are realized by the processor 32 of the control unit 20 executing a "cleaning program" described below.

[0042] <Cleaning Program> Next, the "cleaning program" will be described with reference to Fig. 4. The "cleaning program" is executed by the processor 32 of the control unit 20. The "cleaning program" is started when the cleaning device 10 receives a cleaning task from the cleaning support device 12. Here, the cleaning area 14 is divided into multiple small areas, and the cleaning effect is determined for each small area.

[0043] First, in step S100, processor 32 switches the operating mode of cleaning device 10 to a cleaning mode for cleaning floor surfaces. Next, in step S102, processor 32 moves cleaning device 10 to the next small area. When cleaning begins, it moves to the small area where cleaning will start. Cleaning device 10 acquires surrounding images from camera 26 and moves to the desired location while estimating its own position from the surrounding images.

[0044] Next, in step S104, processor 32 causes camera 26 to capture an image of the floor surface in a small area in front of cleaning device 10 before cleaning, acquires an image of the floor surface before cleaning, and stores the acquired image in RAM 36. Next, in step S114, processor 32 causes cleaning device 10 to travel and clean the small area. Next, in step S116, processor 32 causes camera 26 to capture an image of the floor surface in a small area behind cleaning device 10 after cleaning, acquires an image of the floor surface after cleaning, and stores the acquired image in RAM 36.

[0045] Next, in step S118, the processor 32 executes a "cleaning effect determination process" to determine the cleaning effect in the small area that has been cleaned.

[0046] The "cleaning effect determination process" will now be described with reference to Figure 5. First, in step S200, the processor 32 acquires an image of the floor surface before cleaning from the RAM 36. Next, in step S202, the processor 32 acquires an image of the floor surface after cleaning from the RAM 36. Next, in step S204, the processor 32 compares the images of the floor surface before and after cleaning. Here, the images of the floor surface before and after cleaning are converted into images seen from above (Top View) so that the images can be compared regardless of the angle from which they were captured, and the two converted images are compared.

[0047] Next, in step S206, processor 32 determines whether the cleaning has caused the stain on the floor surface to become larger than before cleaning. For example, a difference image is extracted by subtracting the image of the floor surface before cleaning from the image of the floor surface after cleaning, and if new stains are added as the difference image, it can be determined that the stain has become larger.

[0048] In addition to scattering of dust, dirt can also be spread by tire marks left by the cleaning device 10 as it moves through the cleaning area 14. For example, the heavy cleaning device 10 passing over carpet or flooring can cause severe wear and tear that cannot be repaired even after a certain period of time.

[0049] If the stain has spread (YES in step S206), the process proceeds to step S208. In step S208, processor 32 determines that the stain has worsened and ends the routine. On the other hand, if the stain has not spread (NO in step S206), the process ends the routine without determining that the stain has worsened.

[0050] Returning now to the description of FIG. 4 , next, in step S120, the processor 32 determines whether the condition of the floor surface in the small area has worsened as a result of cleaning. If it is determined that the condition has worsened in the above-described "cleaning effect determination process," it is assumed that the condition of the floor surface has worsened. If the condition of the floor surface has not worsened (NO in step S120), the process proceeds to step S122. On the other hand, if the condition of the floor surface has worsened (YES in step S120), the process proceeds to step S126.

[0051] If the floor condition has not deteriorated, in step S122, the processor 32 determines whether there is a next small area. If there is a next small area (YES in step S122), the process returns to step S102 and repeats the procedures of steps S102 to S122. That is, the processor 32 causes the cleaning device 10 to continue cleaning. If there is no next small area (NO in step S122), in the following step S124, the processor 32 sends a cleaning task completion notification to the cleaning support device 12 and ends the routine.

[0052] If the condition of the floor surface has worsened, in step S126, processor 32 transitions the operating mode of cleaning device 10 to a non-cleaning mode in which floor cleaning is not performed. That is, processor 32 causes cleaning device 10 to stop cleaning. In the following step S128, processor 32 performs a "task stop process" for when the cleaning task is stopped midway, and then ends the routine.

[0053] The "task cancellation process" may include stopping the movement of the cleaning device 10 or notifying the surrounding area. Methods for notifying the surrounding area include sounding a sound or turning on a lamp. The processor 32 may also send a cleaning task cancellation notice to the cleaning support device 12.

[0054] As described above, in the first embodiment, the cleaning area 14 is divided into multiple small areas and the cleaning effect is determined for each small area, so even if the cleaning device 10 is actually spreading dirt, it is possible to detect that the condition of the floor surface in the small area has worsened compared to before cleaning.

[0055] Furthermore, in the first embodiment, if a deterioration in the condition of the floor surface is detected in a small area, the cleaning device 10 is caused to stop cleaning in that small area, so that cleaning can be stopped before dirt spreads over a wide area within the cleaning area.

[0056] [Second Embodiment] In the second embodiment, a "dirt detection process" is executed before cleaning to determine whether the dirt is cleanable. If the dirt is uncleanable, cleaning is stopped before cleaning the small area. Since the other configurations are the same as those of the first embodiment, a description of the common parts will be omitted and only the differences will be described.

[0057] Next, the "cleaning program" according to the second embodiment will be described with reference to Fig. 6. The "cleaning program" according to the second embodiment is the same as the "cleaning program" according to the first embodiment shown in Fig. 4, except that steps S106 to S110 are added.

[0058] First, in step S100, processor 32 switches the operating mode of cleaning device 10 to a cleaning mode for cleaning the floor surface. Next, in step S102, processor 32 moves cleaning device 10 to the next small area. Next, in step S104, processor 32 causes camera 26 to capture an image of the floor surface in the small area before cleaning in front of cleaning device 10, obtains an image of the floor surface before cleaning, and stores the obtained image in RAM 36.

[0059] Next, in step S106, the processor 32 executes a "dirt detection process" to detect dirt on the floor surface before cleaning. The "dirt detection process" will be described in detail later. Next, in step S108, the processor 32 calculates the cleanability of the dirt detected in step S106. Next, in step S110, the processor 32 determines whether the cleaning device 10 is capable of cleaning based on the cleanability calculated in step S108. If cleaning is possible (YES in step S110), the process proceeds to step S114. On the other hand, if cleaning is not possible (NO in step S110), the process proceeds to step S126.

[0060] Next, in step S114, processor 32 causes cleaning device 10 to travel and clean the small area. Next, in step S116, processor 32 causes camera 26 to capture an image of the floor surface in the cleaned small area behind cleaning device 10, obtains an image of the floor surface after cleaning, and stores the obtained image in RAM 36.

[0061] Next, in step S118, processor 32 executes a "cleaning effect determination process" to determine the cleaning effect in the cleaned small area. Next, in step S120, processor 32 determines whether the floor condition in the small area has worsened as a result of cleaning. If the floor condition has not worsened, the process proceeds to step S122. On the other hand, if the floor condition has worsened, the process proceeds to step S126.

[0062] If the floor condition has not deteriorated, in step S122, the processor 32 determines whether there is a next small area. If there is a next small area, the process returns to step S102 and repeats the procedures of steps S102 to S122. If there is not a next small area, in the following step S124, the processor 32 sends a cleaning task completion notification to the cleaning support device 12 and ends the routine.

[0063] If the condition of the floor surface deteriorates or if cleaning is determined to be impossible before cleaning, in step S126, the processor 32 switches the operating mode of the cleaning device 10 to a non-cleaning mode in which floor cleaning is not performed. In the following step S128, the processor 32 performs task cancellation processing and ends the routine.

[0064] 6, if it is determined in step S110 that cleaning is impossible before cleaning, the non-cleaning mode is entered, but as shown by the dotted arrow, the uncleanable small area may be skipped and the cleaning device 10 may move to the next small area. In this case, it is preferable to find a route that bypasses the uncleanable small area and move the cleaning device 10 to the next small area via the bypass route.

[0065] (Dirt Detection Process) Now, with reference to Figure 7, the "dirt detection process" in step S106 of Figure 6 will be described. First, in step S300, the processor 32 acquires a reference image stored in advance. The reference image is an image of the relevant small area captured in a clean state. Next, in step S302, the processor 32 acquires an image of the floor surface before cleaning from the RAM 36. Next, in step S304, the processor 32 converts the image into an image seen from above and compares the image of the floor surface before cleaning with the reference image.

[0066] Next, in step S306, the processor 32 determines whether or not there is dirt. The processor 32 also determines the type of dirt. Here, the type of dirt refers to the type of substance that makes up the dirt (hereinafter referred to as "dirty substance"). Types of dirty substance include dust, paper scraps, sand, mud, shoe prints, rainwater, food, drink, vomit, animal excrement, etc.

[0067] The type of soiling substance, i.e., the soiling substance class, is determined by an image recognition method that utilizes the characteristics of the soiling (e.g., color, area, shape, whether it is liquid or solid, etc.). For example, if it is a three-dimensional object, it is determined to be solid, and if it is not a three-dimensional object, it is determined to be liquid. Specifically, for an image that resembles a reference image of food scattered on the floor, the soiling substance is determined to be food.

[0068] If there is dirt (YES in step S306), the process proceeds to step S308. In step S308, the processor 32 records the dirty location. On the other hand, if there is no dirt (NO in step S306), there is no need to record the dirty location, so step S308 is skipped and the process proceeds to step S310. Next, in step S310, the dirt detection result is output and the routine ends. If dirt is detected, the dirt detection result includes the presence or absence of dirt, the location of the dirt, the type of dirt, etc. The dirt detection result is transmitted to the cleaning support device 12, for example, by being included in a cleaning task completion notification or cancellation notification.

[0069] Here, specific examples of stain detection will be shown. (Example 1) Fig. 8(A) shows a reference image 80B. The reference image 80B is an image of a clean carpet. Fig. 8(B) shows an image 80A of the floor surface before cleaning. The image 80A of the floor surface before cleaning reflects a stain 82 caused by a drink being spilled on the carpet. In this case, by obtaining a difference image between the reference image 80B and the image 80A of the floor surface before cleaning, the stain 82 is detected as a change from the reference image 80B.

[0070] (Example 2) FIG. 9A shows a reference image 80B taken in the first time period. 1 9B shows a reference image 80B taken in the second time period. 2 The storage 38 of the cleaning device 10 stores a reference image 80B for each time period in advance. FIG. 9C shows an image 80A of the floor surface before cleaning, taken in the second time period. The reference image 80B taken in the second time period 2 In this case, in order to prevent the shadow 84 from being mistakenly detected as dirt, a reference image 80B taken at the same time is used. 2 is compared with an image 80A of the floor surface before cleaning. By obtaining a difference image between the two images, only the stain 82 is detected.

[0071] (Example 3) Fig. 10(A) shows a reference image 80B. Fig. 10(B) shows an image 80A of the floor surface before cleaning. A shadow 86 of a person caused by sunlight or lighting is projected onto the image 80A of the floor surface before cleaning. In the case of a shadow 86 of a person or a moving object such as a curtain, the boundary between the shadow 86 and its surrounding area moves over time. In this case, to prevent the shadow 86 from being mistakenly detected as dirt, the reference image 80B is compared with images 80A of the floor surface before cleaning taken at multiple times. If the difference image between the two images changes over time, the difference image is determined to be a shadow 86 and is excluded from the dirt.

[0072] Although the above describes an example in which shadows or human figures are identified and eliminated during image comparison, the influence of shadows or human figures can also be eliminated using other methods. For example, images may be captured from a position or angle that does not project shadows or human figures. Furthermore, the image capture area may be illuminated with a light source during image capture so that shadows or human figures are not projected.

[0073] In addition, the position of a surrounding light source such as sunlight or lighting may be identified to estimate the direction and shape of a shadow or human figure, and the estimated shadow or human figure may be removed by image processing. In addition, if the shadow of the cleaning device is projected when the camera 26 is installed at the rear of the cleaning device 10, the cleaning device 10 may move back by one area and take an image with the camera 26 installed at the front of the cleaning device 10.

[0074] (Cleaning Degree) Here, the calculation of the cleaning degree in step S108 in Fig. 6 and the criteria for determining whether cleaning is possible in step S110 in Fig. 6 will be described. In the second embodiment, the cleaning degree is calculated for dirt detected in the dirt detection process before cleaning. The cleaning degree is calculated based on the result of the classification of the dirt substance.

[0075] In this embodiment, the cleanability is determined in advance according to the class of soiling material, such as "possible" for dust and paper scraps, "somewhat difficult" for sand, mud, shoe prints, and rainwater, and "difficult" for food, drink, vomit, and animal excrement. The determination of whether or not cleaning is possible is made by determining a threshold value for the calculated cleanability, such as determining that a cleanability of "somewhat difficult" or higher is possible. In this case, food, drink, vomit, and animal excrement have a cleanability of "difficult," and are determined to be impossible to clean. The cleanability may also be expressed numerically, such as "possible / 80% or higher," "somewhat difficult / 50% to less than 80%," or "difficult / less than 50%."

[0076] (Cleaning Effect Determination Process) Here, the "cleaning effect determination process" in the second embodiment will be described. The flow of the "cleaning effect determination process" is the same as the "cleaning effect determination process" in the first embodiment shown in Fig. 5. However, when comparing images in step S204 and determining whether the dirt has expanded in step S206, the dirt detection result obtained in the "dirt detection process" in step S106 in Fig. 6 can be taken into consideration.

[0077] In step S204, the processor 32 acquires the dirt detection results and compares the images of the floor surface before and after cleaning. In step S206, the processor 32 considers the dirt detection results and determines whether the cleaning has expanded the area of ​​the dirt detected before cleaning. For example, if an area of ​​the same color as the dirt detected by the dirt detection process expands around the dirt, it can be determined that the dirt has expanded. Furthermore, if the shape of the dirt detected by the dirt detection process changes, it can be determined that the dirt has expanded by being stepped on.

[0078] As described above, the second embodiment can achieve the same effects as the first embodiment.

[0079] In addition, in the second embodiment, dirt is detected before cleaning, and it is determined whether the detected dirt can be cleaned or not, and the cleaning device 10 is caused to stop cleaning in that small area, thereby preventing the dirt from spreading within the cleaning area in advance.

[0080] In the second embodiment, the presence or absence of dirt, the location of the dirt, and the type of dirt are detected before cleaning, so dirt can be reliably cleaned. In addition, in the dirt detection, false detection of dirt can be prevented by excluding shadows of objects and people.

[0081] Furthermore, in the second embodiment, the detection result of the dirt is taken into consideration when determining the cleaning effect, so it is possible to more accurately determine whether the dirt is spreading.

[0082] In this embodiment, the processor 32 performs the dirt detection process, calculates the cleanability, and determines whether cleaning is possible before cleaning. Alternatively or in addition, the processor 32 may perform the dirt detection process, calculate the cleanability, and determine whether cleaning is possible before the floor condition deteriorates and the process proceeds to step S126. Then, even if the floor condition deteriorates, the processor 32 may have the cleaning device 10 clean the same area again if it is determined that cleaning is possible.

[0083] [Third Embodiment] In the second embodiment, the "cleaning effect determination process" was performed taking into account the dirt detection results obtained in the "dirt detection process." In contrast, in the third embodiment, if the dirt detection results are taken into account and the shape of the dirt has changed, it is possible that the dirt has been crushed, so the "crush detection process" is performed. Since the other configurations are the same as in the second embodiment, a description of the common parts will be omitted and only the differences will be described.

[0084] (Cleaning Effect Determination Process) Here, the "cleaning effect determination process" in the third embodiment will be described with reference to Fig. 11. First, in step S400, the processor 32 acquires an image of the floor surface before cleaning from the RAM 36. Next, in step S402, the processor 32 acquires an image of the floor surface after cleaning from the RAM 36. Next, in step S404, the processor 32 acquires the dirt detection result and compares the images of the floor surface before and after cleaning.

[0085] Next, in step S406, processor 32 considers the dirt detection result and determines whether the shape of the dirt on the floor surface has changed since cleaning. If the shape of the dirt has changed (YES in step S406), the process proceeds to step S408. On the other hand, if the shape of the dirt has not changed (NO in step S406), the routine ends without making a worsening determination. Next, in step S408, processor 32 executes a "crush detection process" to detect whether the dirt has been crushed.

[0086] The "crush detection process" will now be described with reference to Figure 12. First, in step S500, the processor 32 calculates the friction coefficient μ of the floor surface in the small area being cleaned and stores the calculated value in the RAM 36. The friction coefficient of the floor surface can be calculated from the travel speed of the cleaning device 10. For example, when oily dirt is crushed, the floor surface becomes slippery, the travel speed increases, and the friction coefficient decreases. Furthermore, when sticky dirt is crushed, the friction of the floor surface increases, the travel speed decreases, and the friction coefficient increases.

[0087] Next, in step S502, processor 32 compares the friction coefficient of the small area being cleaned with the previous friction coefficient to determine whether the friction coefficient of the floor surface has changed. The previous friction coefficient can be, for example, the friction coefficient of the immediately previous small area or the average value of the friction coefficients of the small areas that have already been cleaned. If the friction coefficient has changed (YES in step S502), it is determined that dirt has been crushed, and the routine proceeds to step S504. On the other hand, if the friction coefficient has not changed (NO in step S502), it is determined that dirt has not been crushed, and the routine ends.

[0088] Next, in step S504, processor 32 moves cleaning device 10 back along the path traveled to the position where the crush occurred. Next, in step S506, processor 32 causes camera 26 to capture an image of the floor surface at the position where the crush occurred, acquires an image of the floor surface, and stores the acquired image in RAM 36. Next, in step S508, processor 32 determines the class of the soiling substance from the captured image, calculates the cleanability based on the class determination result, and ends the routine. In other words, the type of soiling that was crushed is identified, and the cleanability is calculated according to the type of soiling.

[0089] Returning now to the description of FIG. 11 , next, in step S410, processor 32 determines whether dirt has been crushed. If there is a change in the coefficient of friction, it is determined that dirt has been crushed. If dirt has not been crushed (NO in step S410), the routine ends without making a deterioration determination. On the other hand, if dirt has been crushed (YES in step S410), the process proceeds to step S412.

[0090] Next, in step S412, the processor 32 determines whether the cleaning device 10 is capable of cleaning based on the cleanability calculated in the "tread detection process." If cleaning is possible (YES in step S412), the routine ends without making a deterioration determination. For example, if the trampled substance is "paper waste," it is estimated that the substance has been cleaned even if the shape of the stain has changed from before cleaning. On the other hand, if cleaning is not possible (NO in step S412), the process proceeds to step S414. In step S414, the processor 32 determines that the condition has worsened and ends the routine.

[0091] As described above, the third embodiment can provide the same effects as the first and second embodiments.

[0092] In the third embodiment, the dirt detected by the "dirt detection process" is detected as being crushed when the shape of the dirt changes. If the dirt is crushed, the process returns to the location where the crush occurred and identifies the type of dirt, allowing for more appropriate measures to be taken against the crushed dirt.

[0093] In addition, in the third embodiment, the type of dirt that has been crushed is identified and a determination is made as to whether cleaning is possible again, allowing for more careful assessment of deterioration. This reduces the number of cases where cleaning is stopped, and improves cleaning efficiency compared to when a deterioration determination is made uniformly when the dirt has spread.

[0094] [Fourth Embodiment] In the first embodiment, if the cleaning effect determination result shows no deterioration, cleaning of that small area is considered complete and the cleaning process moves on to the next small area. In contrast, in the fourth embodiment, the detection value of the dust sensor is also acquired, and if dust is found floating in the air, cleaning of that small area is considered incomplete and cleaning of that small area is restarted. Since the configuration other than this is the same as the first embodiment, only the differences will be described.

[0095] The "cleaning program" according to the fourth embodiment will be described with reference to Fig. 13. The "cleaning program" according to the fourth embodiment has the same flow as the "cleaning program" shown in Fig. 4, except for the addition of steps S130 and S132. Therefore, the same reference numerals are used for common parts, and their description will be omitted.

[0096] In step S120, processor 32 determines whether the floor condition in the small area has worsened as a result of cleaning. If the floor condition has not worsened (NO in step S120), the process proceeds to step S130. On the other hand, if the floor condition has worsened (YES in step S120), the process proceeds to step S126.

[0097] If the floor condition has not deteriorated, the detection value of dust sensor 24A is obtained in step S130. Next, in step S132, it is determined whether the detection value of dust sensor 24A is equal to or less than the allowable value. If the detection value of dust sensor 24A is equal to or less than the allowable value (YES in step S132), the process proceeds to step S122. On the other hand, if the detection value of dust sensor 24A exceeds the allowable value (NO in step S132), the process returns to step S114 and the cleaning is repeated.

[0098] Although the floor surface is clean after cleaning, if there is dust floating in the air, the dust will fall onto the floor surface and make the floor dirty. In this case, the processor 32 determines that cleaning is incomplete and causes the cleaning device 10 to continue cleaning. Alternatively, or in addition to this, the processor 32 may send to the cleaning assistance device 12 the detection value of the dust sensor or information indicating that further cleaning is required.

[0099] As described above, the fourth embodiment can achieve the same effects as the first embodiment. Furthermore, in the fourth embodiment, cleaning continues until the detection value of the dust sensor falls below the allowable value, so the floor surface can be substantially cleaned.

[0100] Fifth Embodiment The fifth embodiment is processing on the cleaning support device 12 side. In the second embodiment, the presence or absence of dirt, the location of the dirt, and the type of dirt are transmitted to the cleaning support device 12 as dirt detection results. The dirt detection results may also include captured images of the floor and wall surfaces. The dirt information storage unit 68 of the cleaning support device 12 plots and stores the presence or absence of dirt, the location of the dirt, and the type of dirt on a map such as a bird's-eye view of the cleaning area 14. In this way, dirt information is accumulated for each cleaning area 14.

[0101] According to the map stored in the dirt information storage unit 68, it is possible to store locations that are prone to getting dirty for each cleaning area 14. For example, areas near the entrances and exits of rooms are more prone to getting dirty than other areas. Therefore, the cleaning support device 12 can generate the next cleaning task taking into account the locations that are prone to getting dirty. Furthermore, by providing the cleaning device 10 with dirt information about the cleaning area 14 along with the cleaning task, cleaning of the cleaning area 14 becomes easier.

[0102] Furthermore, as a result of the accumulation of dirt information, information on dirt, damage, and deterioration over time is also accumulated. Examples of dirt, damage, and deterioration over time include when dirt is not completely removed and leaves stains, when scratches or ruts remain, when the carpet surface becomes rough due to friction, and when the floor surface becomes sunburned due to sunlight. If dirt information continues for a certain period of time for the same location in the cleaning area 14, it is estimated that dirt, damage, and deterioration over time have occurred. For this reason, maintenance information indicating the need for maintenance such as replacing carpets or wallpaper, i.e., maintenance information for the equipment installed in the cleaning area, may be generated and sent to an administrator or another cleaning device 10.

[0103] <Modifications> The configurations of the cleaning device, cleaning system, and cleaning program described in the above embodiment are merely examples, and it goes without saying that the configurations may be modified within the scope of the gist of the present disclosure.

[0104] The controller and method described herein may be implemented by a special-purpose computer having a processor programmed to perform one or more functions embodied in a computer program. Alternatively, the apparatus and method described herein may be implemented by a special-purpose computer having a processor configured with dedicated hardware logic circuits. Alternatively, the apparatus and method described herein may be implemented by one or more special-purpose computers configured by a combination of a processor executing a computer program and one or more hardware logic circuits. Furthermore, the computer program may be stored as instructions executed by a computer on a computer-readable non-transitory storage medium.

[0105] [Notes] The features of the present disclosure are as follows. (Note 1) A cleaning device (10) comprising: a self-position estimation unit (50) that estimates its own position; a control unit (58, 60) that controls the device to clean a floor surface within a cleaning area (14) while autonomously traveling based on the position estimated by the self-position estimation unit; and a cleaning effect determination unit (54) that determines cleaning effect for each small area within the cleaning area based on images of the floor surface before and after cleaning, wherein the control unit controls the device to stop traveling in the small area to be determined and to stop cleaning if the cleaning effect determination unit determines that floor surface dirt has worsened. (Note 2) The cleaning device according to Note 1, wherein the cleaning effect determination unit determines that floor surface dirt has worsened if floor surface dirt in the small area to be determined has increased compared to before cleaning. (Supplementary Note 3) The cleaning device according to Supplementary Note 1 or Supplementary Note 2, further comprising a notification device (30) for notifying the outside that cleaning will be stopped, and the control unit, when canceling cleaning, activates the notification device to notify the outside that cleaning will be stopped. (Supplementary Note 4) The cleaning device according to any one of Supplementary Note 1 to Supplementary Note 3, further comprising a dirt detection unit (52) that detects dirt on the floor surface of the small area to be cleaned before cleaning, and the dirt detection unit identifies the presence or absence of dirt, the location of the dirt, and the type of dirt from an image of the floor surface of the small area to be cleaned. (Supplementary Note 5) The cleaning device according to Supplementary Note 4, wherein the dirt detection unit detects dirt on the floor surface of the small area to be cleaned by comparing an image of the clean floor surface of the small area to be cleaned with an image of the floor surface immediately before cleaning. (Supplementary Note 6) The cleaning device according to Supplementary Note 4 or Supplementary Note 5, wherein the dirt detection unit detects dirt on the floor surface of the small area to be cleaned by excluding shadows of objects and people projected on the floor surface from dirt on the floor surface.(Supplementary Note 7) The cleaning device according to any one of Supplementary Notes 4 to 6, further comprising a cleaning feasibility determination unit (56) that determines whether or not the floor surface of a small area to be cleaned can be cleaned before cleaning, wherein the cleaning feasibility determination unit calculates a cleanability of the small area to be cleaned from the type of dirt identified by the dirt detection unit, and determines that cleaning of the small area to be cleaned is impossible if the calculated cleanability is equal to or less than a predetermined threshold, and the control unit performs control to stop cleaning of the small area to be cleaned that is determined to be impossible to clean by the determination unit. (Supplementary Note 8) The cleaning device according to Supplementary Note 7, wherein the cleaning feasibility determination unit calculates a cleanability degree corresponding to the type of dirt identified by the dirt detection unit based on a predetermined relationship between the type of dirt and the cleanability degree. (Supplementary Note 9) The cleaning device according to any one of Supplementary Notes 4 to 8, wherein the cleaning effect determination unit determines that the dirt on the floor surface has worsened if the range of dirt has expanded from the position of the dirt identified by the dirt detection unit in the small area to be determined compared to before cleaning. (Supplementary Note 10) The cleaning device according to any one of Supplementary Notes 4 to 8, wherein the cleaning effect determination unit determines that the dirt on the floor surface has worsened if it detects that uncleanable dirt has been trampled on. (Supplementary Note 11) The cleaning device according to Supplementary Note 10, wherein the cleaning effect determination unit detects that the dirt has been trampled on based on a change in the coefficient of friction of the floor surface if the shape of the dirt in the small area to be determined compared to the position of the dirt identified by the dirt detection unit is different from that before cleaning. (Supplementary Note 12) The cleaning device according to Supplementary Note 10, wherein the cleaning effect determination unit identifies the type of dirt that has been trampled on from an image of the trampled dirt, and determines that the trampled dirt is uncleanable if the cleanability corresponding to the identified type of dirt is equal to or less than a threshold. (Appendix 13) The cleaning device according to Appendix 1, further comprising a dust sensor (24A) that detects dust in the air, wherein the control unit controls the device to repeatedly clean the small area to be judged until the detection value detected by the dust sensor becomes equal to or less than a predetermined allowable value, regardless of the judgment result of the cleaning effect judgment unit.(Supplementary Note 14) A cleaning system (100) comprising a cleaning device and a cleaning assistance device (12) communicatively connected to the cleaning device and assigning a cleaning task of cleaning a specific cleaning area to the cleaning device, wherein the cleaning device comprises a self-position estimation unit that estimates a position of the device itself, a control unit that controls the device itself to clean a floor surface within the cleaning area while autonomously traveling based on the position estimated by the self-position estimation unit, and a cleaning effect determination unit that determines cleaning effect for each small area within the cleaning area based on images of the floor surface before and after cleaning, and when the cleaning effect determination unit determines that the dirt on the floor surface has worsened, the control unit controls the device to stop traveling and stop cleaning in the small area to be determined. (Supplementary Note 15) The cleaning system of Supplementary Note 14, wherein the cleaning device further includes a dirt detection unit that detects dirt on the floor surface of small areas to be cleaned before cleaning, the cleaning device transmits dirt information for each small area of ​​the cleaning area detected by the dirt detection unit to the cleaning support device, and the cleaning support device accumulates the dirt information received from the cleaning device in a dirt information accumulation unit (68) for each small area of ​​the cleaning area. (Supplementary Note 16) The cleaning system of Supplementary Note 15, wherein the cleaning support device generates at least one of the cleaning task and maintenance information for equipment included in the cleaning area based on the dirt information accumulated in the dirt information accumulation unit. (Supplementary Note 17) A cleaning program that causes at least one processor (32) to estimate a position of the device, control the device to clean the floor surface within the cleaning area while autonomously traveling based on the estimated position, determine cleaning effectiveness for each small area within the cleaning area based on images of the floor surface before and after cleaning, and, if it is determined that the dirt on the floor surface has worsened, control the device to stop traveling of the device in the small area to be determined and abort cleaning.

Claims

1. A cleaning device (10) comprising: a self-position estimation unit (50) that estimates the position of the device itself; a control unit (58, 60) that controls the device to clean the floor surface within a cleaning area (14) while autonomously traveling based on the position estimated by the self-position estimation unit; and a cleaning effect determination unit (54) that determines the cleaning effect for each small area within the cleaning area based on images of the floor surface before and after cleaning, wherein when the cleaning effect determination unit determines that the dirt on the floor surface has worsened, the control unit controls the device to stop traveling in the small area being determined and to cease cleaning.

2. The cleaning device according to claim 1, wherein the cleaning effect assessment unit assesses that the dirt on the floor surface has worsened if the dirt on the floor surface in the small area to be assessed has increased compared to before cleaning.

3. A cleaning device as described in claim 1 or claim 2, further comprising a notification device (30) for notifying the outside that cleaning is to be stopped, wherein the control unit, when stopping cleaning, activates the notification device to notify the outside that cleaning is to be stopped.

4. A cleaning device as described in any one of claims 1 to 3, further comprising a dirt detection unit (52) that detects dirt on the floor surface of the small area to be cleaned before cleaning, wherein the dirt detection unit identifies the presence or absence of dirt, the location of the dirt, and the type of dirt from an image of the floor surface of the small area to be cleaned.

5. A cleaning device as described in claim 4, wherein the dirt detection unit detects dirt on the floor surface of the small area to be cleaned by comparing an image of the clean floor surface of the small area to be cleaned with an image of the floor surface immediately before cleaning.

6. A cleaning device as described in claim 4 or claim 5, wherein the dirt detection unit detects dirt on the floor surface of the small area to be cleaned by excluding shadows of objects and people projected onto the floor surface from dirt on the floor surface.

7. A cleaning device as described in any one of claims 4 to 6, further comprising a cleaning feasibility determination unit (56) which determines whether or not the floor surface of the small area to be cleaned can be cleaned before cleaning, wherein the cleaning feasibility determination unit calculates the cleanability of the small area to be cleaned from the type of dirt identified by the dirt detection unit, and determines that cleaning of the small area to be cleaned is impossible if the calculated cleanability is below a predetermined threshold, and the control unit controls to stop cleaning of the small area to be cleaned that is determined to be impossible to clean by the cleaning feasibility determination unit.

8. A cleaning device as described in claim 7, wherein the cleaning feasibility determination unit calculates the degree of cleanability corresponding to the type of dirt identified by the dirt detection unit based on a predetermined relationship between the type of dirt and the degree of cleanability.

9. A cleaning device as claimed in any one of claims 4 to 8, wherein the cleaning effect assessment unit assesses that the dirt on the floor surface has worsened if the range of dirt in the small area to be assessed has expanded from the position of dirt identified by the dirt detection unit compared to before cleaning.

10. A cleaning device as claimed in any one of claims 4 to 8, wherein the cleaning effect determination unit determines that the dirt on the floor surface has worsened if it detects that uncleanable dirt has been trampled on.

11. The cleaning device of claim 10, wherein the cleaning effect assessment unit detects the crushing of dirt based on a change in the friction coefficient of the floor surface when the shape of the dirt in the small area to be assessed differs from that before cleaning based on the position of the dirt identified by the dirt detection unit.

12. The cleaning device according to claim 10, wherein the cleaning effectiveness determination unit identifies the type of the crushed dirt from an image of the crushed dirt, and if the cleanability corresponding to the identified type of dirt is below a threshold value, determines that the crushed dirt is an uncleanable dirt.

13. A cleaning device as described in claim 1, further comprising a dust sensor (24A) for detecting dust in the air, wherein the control unit controls the device to repeatedly clean the small area that is the subject of judgment until the detection value detected by the dust sensor falls below a predetermined tolerance value, regardless of the judgment result of the cleaning effectiveness judgment unit.

14. A cleaning system (100) comprising a cleaning device and a cleaning assistance device (12) communicatively connected to the cleaning device and assigning a cleaning task to the cleaning device to clean a specific cleaning area, wherein the cleaning device comprises: a self-position estimation unit that estimates a position of the cleaning device; a control unit that controls the cleaning device to clean the floor surface within the cleaning area while autonomously traveling based on the position estimated by the self-position estimation unit; and a cleaning effect determination unit that determines cleaning effect for each small area within the cleaning area based on images of the floor surface before and after cleaning, and when the cleaning effect determination unit determines that the dirt on the floor surface has worsened, the control unit controls the cleaning device to stop traveling and cancel cleaning in the small area to be determined.

15. The cleaning system described in claim 14, further comprising a dirt detection unit that detects dirt on the floor surface of small areas to be cleaned before cleaning, the cleaning device transmits dirt information for each small area of ​​the cleaning area detected by the dirt detection unit to the cleaning support device, and the cleaning support device accumulates the dirt information received from the cleaning device in a dirt information accumulation unit (68) for each small area of ​​the cleaning area.

16. A cleaning system as described in claim 15, wherein the cleaning support device generates at least one of the cleaning task and maintenance information for equipment in the cleaning area based on the dirt information stored in the dirt information storage unit.

17. A cleaning program which causes at least one processor (32) to estimate its own position, control the device to clean the floor surface within a cleaning area while autonomously traveling based on the estimated position, judge the cleaning effect for each small area within the cleaning area based on images of the floor surface before and after cleaning, and control the device to stop traveling of the device and abort cleaning in the small area to be judged if it is judged that the dirt on the floor surface has worsened.

Citation Information

Patent Citations

  • Floor processor autonomously moving in environment

    JP2020030825A

  • Floor treatment by an autonomous mobile robot

    JP2021503334A

  • Mobile robot and control method of mobile robots

    US20220211236A1