Determination device, robot, and program

The determination device and robot system optimize travel routes based on floor analysis and history to reduce the visibility of ruts, addressing the issue of rut formation in robot travel.

JP2024169226APending Publication Date: 2024-12-05SOKEN CO LTD +1
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
JP2023086519
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-25
Publication Date
2024-12-05

AI Technical Summary

Technical Problem

Existing technologies do not effectively address the issue of ruts caused by robots repeatedly traveling in a predetermined area, which can become noticeable over time.

Method used

A determination device and robot system that utilizes a processor to analyze floor surface information and travel history to determine a travel route that minimizes the visibility of ruts by dispersing or avoiding them based on floor material, color, and pattern.

Benefits of technology

The system effectively reduces the visibility of ruts by optimizing travel routes to minimize their impact on the floor surface, enhancing the robot's operation in various environments.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024169226000001_ABST
    Figure 2024169226000001_ABST
Patent Text Reader

Abstract

To provide a determination device, a robot, and a program capable of making ruts caused by robot movement less noticeable.SOLUTION: A determination device 20 acquires, from an image-taking device, a taken image of a floor surface 72 of a predetermined area 70 where a robot 10 moves, detects floor surface information related to the floor surface 72 from the taken image, acquires movement history information 36B for the movement of the robot in an area 74 in the past, and determines a moving route of the robot 10 to the destination 74 in the area 70 based on the floor surface information and the movement history information 36B.SELECTED DRAWING: Figure 5
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to a determination device, a robot, and a program. [Background technology]

[0002] Conventionally, there are known technologies for reducing the impact on floor surfaces caused by the movement of robots that are routinely used in specific areas such as restaurants and offices. For example, Patent Document 1 discloses a technology that makes it difficult for roller marks to remain on carpeted floor surfaces after a cleaning robot has moved. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2004-062577 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, the technology described in Patent Document 1 does not take into consideration the tracks that are created when the robot travels repeatedly within a given area. Therefore, with the technology described in Patent Document 1, the tracks created by the robot's travel can be conspicuous in some cases.

[0005] The present disclosure has been made in consideration of the above circumstances, and aims to provide a determination device, a robot, and a program that can make ruts caused by a robot's movement less noticeable. [Means for solving the problem]

[0006] In order to achieve the above-mentioned object, the determination device disclosed herein is a determination device that determines a driving route of a robot traveling in a specified area, and has at least one processor, wherein the processor obtains from an imaging device an image of the floor surface of the specified area in which the robot is traveling, detects floor surface information related to the floor surface from the image, obtains driving history information of when the robot has previously traveled in the specified area, and determines the driving route of the robot to a destination within the specified area based on the floor surface information and the driving history information.

[0007] In addition, the robot disclosed herein is a robot that travels within a predetermined area and has at least one processor, which obtains from an imaging device an image of the floor surface (floor surface) of the predetermined area in which the robot travels, detects floor surface information relating to the floor surface from the image, obtains driving history information from when the robot has traveled within the predetermined area in the past, determines a driving route to a destination within the predetermined area based on the floor surface information and the driving history information, and controls the driving of the main body based on the determined driving route.

[0008] In addition, the program disclosed herein is intended to cause at least one processor provided in a decision device that determines the driving route of a robot driving in a specified area to execute processing including obtaining from an imaging device an image of the floor surface of the specified area in which the robot is driving, detecting floor surface information related to the floor surface from the image, obtaining driving history information of when the robot has previously driven in the specified area, and determining the driving route of the robot to a destination based on the floor surface information and the driving history information. Effect of the Invention

[0009] According to the present disclosure, it is possible to make the tracks caused by the robot's movement less noticeable. [Brief description of the drawings]

[0010] [Figure 1]FIG. 1 is a configuration diagram illustrating an example of a configuration of a robot according to an embodiment. [Diagram 2] FIG. 2 is a configuration diagram illustrating an example of a hardware configuration of a determination device according to an embodiment. [Diagram 3] FIG. 2 is a functional block diagram illustrating an example of a configuration of a determination device according to an embodiment. [Figure 4A] FIG. 13 is a diagram for explaining a case where the travel routes are not dispersed. [Figure 4B] FIG. 13 is a diagram for explaining a case where a travel route is dispersed. [Diagram 5] 4 is a flowchart illustrating an example of a flow of a driving route determination process executed in the determination device of the embodiment. [Figure 6A] FIG. 13 is a diagram for explaining a dispersion route. [Figure 6B] FIG. 13 is a diagram for explaining a non-distributed route. [Figure 7] FIG. 11 is a configuration diagram illustrating another example of the configuration of the robot according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. Note that the technology of the present disclosure is not limited to the embodiments.

[0012] The configuration of a robot 10 according to the present embodiment will be described with reference to Fig. 1. As shown in Fig. 1, the robot 10 according to the present disclosure has four wheels 14 provided on the bottom of a main body 12, and is capable of moving by rotating the wheels 14. Note that in this embodiment, the "robot" refers to an autonomous device capable of moving autonomously. Examples of such a robot 10 include a cleaning robot and a food delivery robot.

[0013] As shown in FIG. 1, the robot 10 includes a control device 11, a camera 16, an IMU (Inertial Measurement Unit) 17, a battery 18, and a decision device 20.

[0014] The camera 16 has a function of capturing an image of the floor surface of the area where the robot 10 travels and outputting the image data obtained as a captured image. The camera 16 of this embodiment is an example of the imaging device of the present disclosure. It is preferable that the camera 16 is capable of capturing an image of a wide range, and more specifically, it is preferable that the camera 16 is capable of capturing an image of a wider range of the floor surface where the robot 10 will travel. It is preferable that the camera 16 is capable of capturing a colored image so that the color of the floor surface can be identified from the captured image.

[0015] The IMU 17 is a sensor that detects the movement of the robot 10 and is used to detect the tracks traveled by the robot 10. For example, the IMU 17 detects the acceleration and yaw rate of the main body 12 and outputs the detection results. The IMU 17 of this embodiment is an example of a movement detection sensor of the present disclosure.

[0016] The battery 18 has a function of supplying power to each part of the robot 10, such as the control device 11, the camera 16, the IMU 17, and the decision device 20.

[0017] The control device 11 has a function of controlling the entire robot 10. The control device 11 also has a function of controlling the driving of the wheels 14 so as to make the robot 10 travel along the travel route determined by the determination device 20.

[0018] The determination device 20 has a function of determining a travel route of the robot 10 to the destination. The determination device 20 will be described in detail with reference to the drawings. First, an example of the hardware configuration of the determination device 20 will be described with reference to FIG. 2. As shown in FIG. 2, the determination device 20 includes a CPU (Central Processing Unit) 30, a ROM (Read Only Memory) 31, a RAM (Random Access Memory) 32, a storage unit 34, a user I / F (Interface) 37, and a communication I / F 38. The CPU 30, the ROM 31, the RAM 32, the storage unit 34, the user I / F 37, and the communication I / F 38 are connected to each other via a bus 39 such as a system bus or a control bus so that various information can be exchanged between them.

[0019] The CPU 30 of the present embodiment is an example of a processor of the present disclosure. The processor here refers to a processor in a broad sense, and includes a general-purpose processor (e.g., a CPU) or a dedicated processor (e.g., a graphics processing unit (GPU), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), a programmable logic device, etc.).

[0020] The storage unit 34 stores various programs such as a travel route determination program 35. The travel route determination program 35 of the present embodiment is an example of a program of the present disclosure. The travel route determination program 35 may be stored in the storage unit 34 by being recorded in a recording medium such as a non-volatile non-transitory recording medium, or distributed via a network and appropriately installed in the determination device 20. Examples of non-volatile non-transitory recording media include a CD-ROM (Compact Disc Read Only Memory), a magneto-optical disk, a HDD, a DVD-ROM (Digital Versatile Disc Read Only Memory), a flash memory, a memory card, and the like.

[0021] Further, the storage unit 34 stores route search information 36A (described in detail later), travel history information 36B (described in detail later), and map information 36C. The map information 36C is map information that indicates the arrangement of desks and the like in the area in which the robot 10 travels. Therefore, in the determination device 20 of the present embodiment, the map information 36C is stored for each area in which the robot 10 is expected to travel. Note that, in the present embodiment, a form in which the map information 36C is stored in advance in the storage unit 34 of the determination device 20 will be described, but the map information 36C may not be stored in advance in the storage unit 34. For example, when the robot 10 travels, the map information 36C corresponding to the area in which the robot 10 travels may be acquired from the outside via the communication I / F 38, or the map information 36C may be generated in the determination device 20 from an image captured by the camera 16.

[0022] Examples of such a storage unit 34 include a hard disk drive (HDD), a solid state drive (SSD), and a secure digital (SD) card.

[0023] The user I / F 37 includes an input device such as a keyboard for the user to input information, and an output device for outputting information to the user. In this embodiment, a touch panel display that integrates the input device and the output device is used as an example of the user I / F 37.

[0024] The communication I / F 38 has a function for communicating with the control device 11, the camera 16, and the IMU 17 via a network (not shown). Note that the communication with the control device 11, the camera 16, and the battery 18 may be wireless communication such as WiFi (registered trademark) or Bluetooth (registered trademark), or may be wired communication. Note that the communication I / F 38 may be capable of communicating with an external device.

[0025] The functions of the determination device 20 will be described with reference to Fig. 3. As shown in Fig. 3, the determination device 20 includes a photographed image acquisition unit 40, a travel history information acquisition unit 42, a floor information detection unit 44, and a travel route determination unit 50.

[0026] The photographed image acquisition unit 40 has a function of causing the camera 16 to photograph the floor surface of the area in which the robot 10 travels, and acquiring image data obtained by photographing as a photographed image from the camera 16. The photographed image acquisition unit 40 outputs the acquired photographed image to the floor surface information detection unit 44.

[0027] The travel history information acquisition unit 42 has a function of acquiring travel history information 36B when the robot 10 has traveled in the area in the past. Here, the robot that has traveled in the past is not limited to the robot 10 itself, and may include robots other than the robot 10. The robots other than the robot 10 are not limited to the same type of robot as the robot 10, and may be other types of robots. For example, if the robot 10 is a cleaning robot, the robot other than the robot 10 may be a food delivery robot. In this embodiment, when the symbol "robot" is not attached, it collectively refers to general robots that can travel, including the robot 10. That is, the travel history information 36B is information that accumulates the tracks that the robot has traveled in the past as history. In this embodiment, the "tracks" refer to the tracks made by the wheels when the robot traveled, and follow the route that the robot traveled. The "tracks" may leave some kind of trace, such as scratches or dirt, on the floor surface, but may not leave any trace. The travel history information 36B in this embodiment is information representing tracks identified according to the travel route when the robot actually traveled, regardless of the presence or absence of traces. The travel history information acquisition unit 42 outputs the acquired travel history information 36B to the floor surface information detection unit 44.

[0028] The floor surface information detection unit 44 has a function of detecting floor surface information from the captured image acquired by the camera 16. "Floor surface information" is information related to the floor surface. In this embodiment, "floor surface information" is information that indicates at least one of the material of the floor surface, the dirt on the floor surface, the pattern on the floor surface, and the color of the floor surface.

[0029] As shown in FIG. 3, the floor surface information detection unit 44 of this embodiment includes a material identification unit 46, a color state detection unit 47, and a rut detection unit 48. The material identification unit 46 has a function of identifying the material of the floor surface from the captured image. Examples of floor surface materials include carpet, stone, tile, board, tatami, concrete, and mortar. In the case of a carpet, it is preferable to identify, for example, the length of the pile, the direction of the pile such as grain / reverse grain, and the degree of clogging. In the case of stone, it is preferable to identify the type of stone such as marble and granite. In the case of tiles, it is preferable to identify, for example, the size of the tile. In the case of boards, it is preferable to identify the type of the tile such as cedar and cypress. In addition, the material of the floor surface and the type of information to be identified are not limited to these. In addition, the method by which the material identification unit 46 identifies the material of the floor surface from the captured image is not particularly limited. For example, the material identification unit 46 may use a captured image as an input and identify the material of the floor surface using a learning model such as a DNN (Deep Neural Network) trained with learning data in which the material of the floor surface is the correct answer. The material identification unit 46 outputs the identification result of the material of the floor surface to the travel route determination unit 50.

[0030] The color condition detection unit 47 has a function of identifying the color condition of the floor surface from the captured image. In this embodiment, the "color condition of the floor surface" refers to the dirt condition of the floor surface, the pattern of the floor surface, and the color of the floor surface. The "dirt on the floor surface" also includes so-called tire marks caused by the wheels of the robot. The "pattern of the floor surface" is not limited to a pattern intentionally drawn on the floor surface, but also includes a pattern caused by the grain of the floor boards and a marble pattern made of marble. The "color of the floor surface" is not limited to the color of the entire floor surface, but also includes local colors. Therefore, the detection result of the color condition of the floor surface by the color condition detection unit 47 is, for example, a "black and white lattice pattern of 30 cm square". Note that the color condition of the floor surface is not limited to the above. In addition, the method by which the color condition detection unit 47 identifies the color condition of the floor surface from the captured image is not particularly limited. A known image analysis method may be applied, or a learning model may be used to identify the color condition of the floor surface. The color condition detection unit 47 outputs the detection result of the color condition of the floor surface to the travel route determination unit 50.

[0031] The track detection unit 48 has a function of detecting tracks left on the floor surface from the captured image and the travel history information 36B. Even if the robot travels on the floor surface, there are cases where no tracks are left on the floor surface. For example, if the floor surface is carpeted, the tracks may disappear if the direction of the pile is adjusted after the robot travels. Therefore, the track detection unit 48 detects tracks left on the floor surface by comparing the past robot travel history information 36B with the captured image in which the current state of the floor surface is captured. The track detection unit 48 outputs the track detection result to the travel route determination unit 50.

[0032] The travel route determination unit 50 has a function of determining a travel route of the robot 10 to the destination. As an example, in this embodiment, the destination is input by a user through the user I / F 37. The travel route determination unit 50 acquires the destination input through the user I / F 37.

[0033] As shown in Fig. 3, the travel route determination unit 50 includes a shortest route search unit 52, a rut optimum route search unit 54, a loss calculation unit 56, and a determination unit 58. The shortest route search unit 52 has a function of searching for the shortest route from the current location to the destination by referring to the map information 36C. When traveling back and forth between the current location and the destination, the same travel route is often used for the outbound and return journeys. The shortest route search unit 52 outputs the shortest route as a search result to the loss calculation unit 56.

[0034] The optimal track route search unit 54 has a function of searching for a route that optimizes the tracks that the robot 10 leaves on the floor surface as it travels.

[0035] In order to optimize the tracks, there are cases where it is preferable to distribute the travel of the robot 10 and cases where it is preferable not to distribute the travel. First, a case where it is preferable to distribute the travel of the robot 10 will be described with reference to the drawings. FIG. 4A shows an example in which the robot 10 distributes its travel and makes two round trips on the floor surface 72 of the area 70 between the current location and the destination 74. In the example shown in FIG. 4A, a total of four tracks are generated on the floor surface 72, including tracks 80-1 and 80-3 generated on the outbound route to the destination 74 and tracks 80-2 and 80-4 generated on the return route. In this embodiment, the term "distributing the travel" is not limited to cases where the entirety of the tracks generated by the travel does not overlap, but also includes cases where some of the tracks overlap and cases where the tracks intersect, but refers to a case where there are many non-overlapping parts overall.

[0036] On the other hand, Fig. 4B shows an example in which the robot 10 makes two round trips on the floor surface 72 of the area 70 between the current location and the destination 74 without dispersing its travel. In the example shown in Fig. 4B, the ruts 80-1 and 80-3 made on the outbound journey to the destination 74 and the ruts 80-2 and 80-4 made on the return journey all overlap in their entirety, so that only one rut is made. Note that in this embodiment, "not dispersing its travel" does not mean that the ruts made by the travel all overlap, but also means that some of the ruts do not overlap, but means that there is a large amount of overlap overall.

[0037] In this embodiment, it is determined in advance whether it is better to spread out the travel of the robot 10, i.e., the tracks, or not, depending on the material of the floor surface, the color condition of the floor surface, etc. Examples of cases where it is better to spread out the travel of the robot 10, i.e., the tracks, include a case where it is better to avoid areas that have been damaged over time due to past travel, a case where the pile direction of a carpet is to be uniform, a case where the pattern of the floor surface is uneven, and a case where there is a large bias in the past travel history.

[0038] On the other hand, a case where it is better not to spread the path of the robot 10, i.e., the tracks, can be mentioned, for example, when the color of a part of the floor surface includes a part where dirt caused by the robot 10 moving is not noticeable, and the part can be used as a moving route. Another example is when the wheels 14 of the robot 10 are dirty, and the dirt on the wheels 14 spreads on the floor surface as the robot 10 moves, or the dirt on the floor surface becomes noticeable.

[0039] In addition, the driving route of the robot 10, i.e., the driving route that disperses the tracks (hereinafter referred to as the "dispersed route"), is often longer than the driving route of the robot 10, i.e., the driving route that does not disperse the tracks (hereinafter referred to as the "non-dispersed route").

[0040] In this way, whether the route should be a branching route or a non-branching route depending on the material of the floor surface, the color state of the floor surface, and the like is determined in advance as route search information 36A.

[0041] The route search information 36A is information that indicates the correspondence between floor surface information and branching routes / non-branching routes. The route search information 36A of this embodiment also includes information on which floor surface information is to be prioritized among multiple types of floor surface information. For example, in a state where a branching route is associated with the floor surface material identified from the captured image and a non-branching route is associated with the floor surface color, if the floor surface color is prioritized over the floor surface material, the non-branching route will be determined as the travel route.

[0042] In this embodiment, as described above, the route search information 36A is stored in advance in the storage unit 34, but the present invention is not limited to this embodiment, and the route search information 36A may be acquired from an external source via the communication I / F 38. The rut optimal route search unit 54 refers to the route search information 36A and the driving history information 36B to determine whether the branched route or the previous non-branched route is to be a candidate for the driving route. The rut optimal route search unit 54 outputs the search result, that is, the candidate for the driving route with the optimized rut, to the loss calculation unit 56.

[0043] The loss calculation unit 56 calculates the loss for each of the shortest route output from the shortest route search unit 52 and the candidate travel route with the optimized rut output from the rut optimum route search unit 54. Here, the "loss" represents at least one of the power consumption, the urgency of the task of the robot 10, etc., but is not limited to this. The loss calculation unit 56 outputs the result of the loss calculation for the shortest route and the result of publishing the loss for the candidate travel route to the determination unit 58.

[0044] The determination unit 58 compares the loss calculation result of the shortest route with the loss calculation result of the candidate travel route, and determines the route with the smaller loss as the final travel route. The determination unit 58 outputs the determined travel route to the control device 11.

[0045] As a result, the control device 11 travels to the destination 74 according to the travel route determined by the determination device 20. When the robot 10 travels back and forth between the current location and the destination 74, first, a travel route from the current location to the destination 74 is derived, and then the destination 74 may be set as the current location and the original current location, in other words, the starting point of the robot 10, may be set as the destination to determine the travel route again.

[0046] 3, the determination device 20 includes a measurement value acquisition unit 60, a track identification unit 62, and a memory control unit 64. The measurement value acquisition unit 60 acquires the detection result of the IMU 17 as a measurement value of the sensor. The measurement value acquisition unit 60 outputs the acquired measurement value to the track identification unit 62.

[0047] The track identification unit 62 has a function of identifying tracks traveled by the robot 10 based on the measurement values. In this embodiment, in consideration of cases where the robot 10 does not travel along the travel route determined by the above-mentioned determination unit 58, for example, when the robot 10 hits an obstacle and the travel route is deviated, the actual movement of the robot 10 is detected in this manner, and tracks that have actually occurred on the floor surface 72 are identified. The track identification unit 62 outputs information representing the identified track to the memory control unit 64.

[0048] The memory control unit 64 updates the driving history information 36B with information representing the ruts identified by the rut identification unit 62.

[0049] Next, the travel route determination process executed by the determination device 20 will be described with reference to Fig. 5. By executing the travel route determination program 35 by the CPU 30 of the determination device 20, the CPU 30 functions as the photographed image acquisition unit 40, the travel history information acquisition unit 42, the travel route determination unit 50, the measurement value acquisition unit 60, the rut identification unit 62, and the memory control unit 64, and the travel route determination process shown in Fig. 5 is executed.

[0050] 5, the floor surface information detection unit 44, as described above, identifies the destination where the robot 10 travels. Note that the area 70 where the robot 10 travels may be determined in advance, or may be identified in the same manner as the destination when the destination is identified.

[0051] In the next step S102, the photographed image acquisition unit 40 acquires a photographed image from the camera 16 as described above.

[0052] In the next step S104, the driving history information acquisition unit 42 acquires the driving history information 36B from the storage unit 34 as described above.

[0053] In the next step S106, the material identification unit 46 identifies the material of the floor surface 72 from the captured image, as described above.

[0054] In the next step S108, the color condition detection unit 47 detects the condition of the floor surface 72 from the captured image as described above.

[0055] In the next step S110, the track detection unit 48 detects tracks remaining on the floor surface 72 from the captured image and the driving history information 36B, as described above.

[0056] In the next step S112, the shortest route search unit 52 searches for the shortest route from the current location of the robot 10 to the destination by referring to the map information 36C, as described above.

[0057] In the next step S114, the rut optimum route search unit 54 searches for a divergent route or a non-divergent route that optimizes the ruts by referring to the route search information 36A as described above, and selects the optimized route as a candidate for the travel route. For example, when the floor surface pattern is uneven, a divergent route 82 is selected as a candidate for the travel route, as shown in FIG. 6A. The travel route 82 shown in FIG. 6A does not overlap with past ruts 80, and the travel route is divergent. For example, when the floor surface pattern includes dark and light colors, a divergent route 82 that avoids the light-colored floor surface 72-1 as much as possible and travels on the dark-colored floor surface 72-2 is selected as a candidate for the travel route, as shown in FIG. 6B. The travel route 82 shown in FIG. 6B overlaps with past ruts 80, and past ruts 80 also overlap with each other, and the travel route is non-divergent.

[0058] In the next step S116, the loss calculation unit 56 calculates the respective losses of the shortest route obtained in step S112 and the candidate travel route obtained in step S114, as described above.

[0059] In the next step S118, the determination unit 58 compares the losses calculated in step S116 as described above, and determines the final driving route based on the comparison result.

[0060] As described above, for example, when the floor surface 72 is completely white, if the risk of soiling by the wheels 14 of the robot 10 is low, the shortest route is determined as the final travel route. On the other hand, when the risk of soiling is high, a certain route is determined as the final travel route so as not to spread the soil all over. Also, for example, in the case of a carpet with a pattern, if the color of the pattern is similar to the mark of the wheels 14 or the color of the soiling by the wheels 14, a route that travels on the floor surface 72 of that color is determined as the final travel route. Or, even if the color of the pattern is not similar to the mark of the wheels 14 or the color of the soiling by the wheels 14, a route that travels on the floor surface 72 of a color close to the color characteristics is determined as the final travel route. On the other hand, if there is no color close to the same color, the final travel route is determined as in the case where the floor surface 72 is completely white. Also, for example, when the pattern of the floor surface 72 is uneven, even if the color of the pattern is not similar to the mark of the wheels 14 or the color of the soiling by the wheels 14, a route that travels on the floor surface 72 of a color close to the color characteristics is determined as the final travel route. On the other hand, if there is no similar color, the final travel route is determined in the same manner as when the floor surface 72 is pure white.

[0061] In the next step S120, the determination unit 58 outputs the travel route determined in step S118 to the control device 11, as described above.

[0062] By performing the process of step S120, the control device 11 controls the robot 10 to travel along the travel route.

[0063] Therefore, in the next step S122, the measurement value acquisition unit 60 determines whether or not the robot 10 has started running based on the detection result of the IMU 17. Until the robot 10 starts running, the determination in step S122 is negative. On the other hand, when the robot 10 starts running, the determination in step S122 is positive, and the process proceeds to step S124.

[0064] In step S124, the measurement value acquisition unit 60 starts recording the acquired measurement values, that is, the detection results of the IMU 17.

[0065] In the next step S126, the measurement value acquisition unit 60 determines whether or not the robot 10 has finished traveling based on the detection result of the IMU 17. As an example, the measurement value acquisition unit 60 of this embodiment determines that the robot 10 has finished traveling when a predetermined end condition is satisfied. Examples of the end condition include when the robot 10 has reached the destination 74 or when a user has instructed the robot 10 to stop moving. Until the end condition is satisfied, the determination in step S126 is negative. On the other hand, when the end condition is satisfied, the determination in step S126 is positive, and the process proceeds to step S128.

[0066] In step S128, the measurement value acquisition unit 60 ends the recording of the detection results of the IMU 17 that began in step S124 above.

[0067] In the next step S130, the track identification unit 62 identifies the track along which the robot 10 has traveled, as described above, based on the stored detection results of the IMU 17. Note that once the identification of the track has been completed, the stored detection results of the IMU 17 may be deleted.

[0068] In the next step S132, the memory control unit 64 adds the track identified in step S130 to the driving history information 36B stored in the memory unit 34, as described above. When the process of step S130 ends, the driving route determination process shown in FIG. 5 ends.

[0069] As described above, the determination device 20 of this embodiment obtains a captured image obtained by having the camera 16 capture an image of the floor surface 72 of the area 70, detects floor surface information related to the floor surface 72 from the captured image, obtains driving history information 36B of when the robot has previously traveled through the area 74, and determines a driving route for the robot 10 to the destination 74 within the area 70 based on the floor surface information and the driving history information 36B. Therefore, according to the determination device 20, since a driving route is determined in accordance with the floor surface information, it is possible to make ruts caused by the robot's driving less noticeable.

[0070] The technology of the present disclosure is not limited to the above embodiment, and for example, as shown in Fig. 7, the robot 10 may include a pressure sensor 19 that detects pressure on a floor surface 72. Since the ruts that form on the floor surface 72 vary depending on the pressure applied to the floor surface 72, the final travel route may be determined according to the pressure detected by the pressure sensor 19, for example, by setting a floor surface made of a hard material on which ruts are less likely to remain as the travel route. In this case, it is preferable that the material identification unit 46 detects the hardness of the material, i.e., the hardness of the floor surface 72, as the condition of the floor surface together with the material.

[0071] In the above embodiment, the robot 10 is provided with the determination device 20, but the determination device 20 may be provided outside the robot 10. The determination device 20 may determine the travel route of each of the multiple robots 10.

[0072] In the above embodiment, the final travel route is determined based on the result of comparing the loss of the candidate high school route among the dispersion route and the non-dispersion route with the shortest route, but the method of determining the final travel route is not limited to the embodiment. For example, when the user instructs which of the dispersion route, the non-dispersion route, and the shortest route should be the final travel route, the determination device 20 may determine the instructed travel route.

[0073] The control unit and the method described herein may be implemented by a special-purpose computer having a processor programmed to execute one or more functions embodied in a computer program. Alternatively, the device and the method described herein may be implemented by a special-purpose computer having a processor configured by dedicated hardware logic circuits. Alternatively, the device and the method described herein may be implemented by one or more special-purpose computers configured by a combination of a processor that executes a computer program and one or more hardware logic circuits. The computer program may also be stored in a computer-readable non-transitory tangible recording medium as instructions to be executed by the computer.

[0074] <Additional Notes> Regarding the technology of the present disclosure, the following is disclosed.

[0075] (Appendix 1) A determination device (20) for determining a travel route of a robot (10) traveling in a predetermined area, At least one processor (30), The processor, acquiring, from a photographing device (16), a photographed image of a floor surface (72) in the predetermined area on which the robot travels; Detecting floor surface information relating to the floor surface from the captured image; Acquire travel history information (36B) of the robot when it has traveled through the specified area in the past; A travel route of the robot to a destination within the predetermined area is determined based on the floor surface information and the travel history information. decision device.

[0076] (Appendix 2) The processor, Based on the floor surface information and the travel history information, the travel route of the robot is determined to be either a dispersion route in which tracks caused by the travel of the robot are dispersed, or a non-dispersion route in which the tracks are not dispersed. 2. The determination apparatus of claim 1.

[0077] (Appendix 3) The processor, Derive the shortest route to the destination; Based on the floor surface information and the travel history information, the travel route of the robot is determined to be one of a dispersion route in which tracks caused by the travel of the robot are dispersed, a non-dispersion route in which the tracks are not dispersed, and the shortest route. 2. The determination apparatus of claim 1.

[0078] (Appendix 4) The processor, Identifying, as a travel route candidate, either a dispersion route in which tracks caused by the travel of the robot are dispersed, or a non-dispersion route in which the tracks are not dispersed, based on the floor surface information and the travel history information; Derive the shortest route to the destination; A travel route of the robot is determined to be either one of the travel route candidates or the shortest route based on a loss caused by the travel of the robot. 2. The determination apparatus of claim 1.

[0079] (Appendix 5) The floor surface information is information that represents at least one of the material of the floor surface, the dirt on the floor surface, the pattern of the floor surface, and the color of the floor surface. 5. The determination device of claim 1 ,

[0080] (Appendix 6) The processor, Detecting track marks remaining on the floor surface from the captured image and the driving history information 6. The determination device of claim 1 ,

[0081] (Appendix 7) The processor, acquiring a detection result from a pressure sensor that detects a pressure of the robot on the floor surface; The driving route is determined based on the detection result. 7. The determination device of claim 1 ,

[0082] (Appendix 8) The processor, obtaining a detection result from a movement detection sensor (17) that detects the movement of the robot; Identifying the tracks traveled by the robot from the detection result; The identified track is added to the driving history information. 8. The determination device of claim 1 ,

[0083] (Appendix 9) A robot that travels in a predetermined area, At least one processor; The processor, Obtaining a photographed image of a floor surface of the predetermined area in which the vehicle is traveling from a photographing device; Detecting floor surface information relating to the floor surface from the captured image; Acquire travel history information of the robot when it has traveled through the specified area in the past; determining a driving route to a destination within the predetermined area based on the floor surface information and the driving history information; The travel of the main body is controlled based on the determined travel route. robot.

[0084] (Appendix 10) At least one processor of a determination device for determining a travel route of a robot traveling in a predetermined area acquiring, from a photographing device, a photographed image of a floor surface of the predetermined area in which the robot travels; Detecting floor surface information relating to the floor surface from the captured image; Acquire travel history information of the robot when it has traveled through the specified area in the past; determining a travel route of the robot to a destination based on the floor surface information and the travel history information; A program for executing a process including the above.

[0085] (Appendix 11) A recording medium storing a program executable by at least one processor included in a determination device for determining a travel route of a robot traveling in a predetermined area, acquiring, from a photographing device, a photographed image of a floor surface of the predetermined area in which the robot travels; Detecting floor surface information relating to the floor surface from the captured image; Acquire travel history information of the robot when it has traveled through the specified area in the past; determining a travel route of the robot to a destination based on the floor surface information and the travel history information; The purpose of the present invention is to execute a process including the steps of: Recording medium. [Explanation of symbols]

[0086] 10 robot, 11 control device, 16 camera, 17 IMU, 20 determination device, 30 CPU, 35 travel route determination program, 36B travel history information, 40 photographed image acquisition unit, 44 floor surface information detection unit, 46 material identification unit, 47 color condition detection unit, 48 rut detection unit, 50 travel route determination unit, 52 shortest route search unit, 54 rut optimal route search unit, 56 loss calculation unit, 58 determination unit, 60 measurement value acquisition unit, 62 rut identification unit, 64 memory control unit

Claims

1. A determination device (20) for determining a travel route of a robot (10) traveling in a predetermined area (70), comprising: At least one processor (30), The processor, Obtaining a photographed image of a floor surface (72) in the predetermined area on which the robot travels from a photographing device (16); Detecting floor surface information relating to the floor surface from the captured image; Acquire travel history information (36B) of the robot when it has traveled through the specified area in the past; Based on the floor surface information and the travel history information, a travel route of the robot to a destination (74) within the specified area is determined. decision device.

2. The processor, Based on the floor surface information and the travel history information, the travel route of the robot is determined to be either a dispersion route in which tracks caused by the travel of the robot are dispersed, or a non-dispersion route in which the tracks are not dispersed. The determination device of claim 1 .

3. The processor, Derive the shortest route to the destination; Based on the floor surface information and the travel history information, the travel route of the robot is determined to be one of a dispersion route in which tracks caused by the travel of the robot are dispersed, a non-dispersion route in which the tracks are not dispersed, and the shortest route. The determination device of claim 1 .

4. The processor, Identifying, as a travel route candidate, either a dispersion route in which tracks caused by the travel of the robot are dispersed, or a non-dispersion route in which the tracks are not dispersed, based on the floor surface information and the travel history information; Derive the shortest route to the destination; A travel route of the robot is determined to be either one of the travel route candidates or the shortest route based on a loss caused by the travel of the robot. The determination device of claim 1 .

5. The floor surface information is information that represents at least one of the material of the floor surface, the dirt on the floor surface, the pattern of the floor surface, and the color of the floor surface. The determination device of claim 1 .

6. The processor, Detecting track marks remaining on the floor surface from the captured image and the driving history information The determination device of claim 1 .

7. The processor, acquiring a detection result from a pressure sensor that detects a pressure of the robot on the floor surface; The driving route is determined based on the detection result. The determination device of claim 1 .

8. The processor, Obtaining a detection result from a movement detection sensor (17) that detects the movement of the robot; Identifying the tracks traveled by the robot from the detection result; The identified track is added to the driving history information. The determination device of claim 1 .

9. A robot that travels in a predetermined area, At least one processor; The processor, Obtaining a photographed image of a floor surface of the predetermined area in which the vehicle is traveling from a photographing device; Detecting floor surface information relating to the floor surface from the captured image; Acquire travel history information of the robot when it has traveled through the specified area in the past; determining a driving route to a destination within the predetermined area based on the floor surface information and the driving history information; The travel of the main body is controlled based on the determined travel route. robot.

10. At least one processor of a determination device for determining a travel route of a robot traveling in a predetermined area acquiring, from a photographing device, a photographed image of a floor surface of the predetermined area in which the robot travels; Detecting floor surface information relating to the floor surface from the captured image; Acquire travel history information of the robot when it has traveled through the specified area in the past; A travel route of the robot to a destination is determined based on the floor surface information and the travel history information. A program for executing a process including the above.

Citation Information

Patent Citations

  • Electronic device, route determination method, and computer program

    JP2018160008A

  • Autonomous travel system

    JP2021157374A

  • Carpet grain detecting device and mobile robot using the same

    JP2004062577A