Autonomous traveling system, method for controlling travel of autonomous traveling robot, and program
The autonomous running system addresses the issue of inaccurate floor distance measurement and obstacle detection by incorporating reflectance-based correction mechanisms, enhancing navigation accuracy and obstacle detection.
Patent Information
- Application Number
- JP2023081069
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-16
- Publication Date
- 2024-11-28
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing autonomous robots face challenges in accurately measuring floor distances and detecting obstacles due to changes in floor surface reflectance, which can lead to inaccurate navigation and obstacle detection.
An autonomous running system that includes a robot equipped with a reflectance information input mechanism, a sensor information acquisition unit, a self-position calculation unit, a distance calculation unit, a correction value storage unit, and a correction unit to adjust floor distance measurements based on reflectance, enhancing obstacle detection accuracy.
The system improves the accuracy of obstacle detection and navigation by correcting floor distance measurements based on reflectance, ensuring precise obstacle avoidance and effective travel planning.
Smart Images

Figure 2024165155000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to an autonomous driving system, a driving control method for an autonomous driving robot, and a program. [Background technology]
[0002] For example, Patent Document 1 discloses a technology in which multiple optical distance sensors mounted on the front of a mobile robot measure the distance to a floor surface, and detect obstacles on the floor surface based on changes in the distance measurement results. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Patent No. 7002791 Summary of the Invention [Problem to be solved by the invention]
[0004] However, if the material or color of the floor surface changes, the reflectance also changes, so that it may not be possible to accurately measure the distance to the floor surface, and it may also not be possible to accurately detect obstacles.
[0005] Therefore, the present disclosure provides an autonomous driving system, a driving control method for an autonomous driving robot, and a program that can improve the accuracy of obstacle detection. [Means for solving the problem]
[0006] An autonomous driving system according to one aspect of the present disclosure is an autonomous driving system equipped with an autonomous driving robot that autonomously drives on a floor, and includes a reception unit to which reflectance information regarding the reflectance at a predetermined point on the floor surface of the floor is input, a driving unit that drives the main body, a sensor information acquisition unit that acquires sensor information including a positional relationship between objects around the autonomous driving robot and the autonomous driving robot, a self-position calculation unit that calculates a self-position, which is the current position of the autonomous driving robot on a map of the floor based on the positional relationship, a distance calculation unit that calculates a floor distance, which is the distance from the front of the autonomous driving robot to the floor surface, based on the sensor information, a correction value memory unit that stores a ranging correction value corresponding to the reflectance information, and a correction unit that obtains the ranging correction value at the predetermined point by comparing the reflectance information input to the reception unit with the ranging correction value stored in the correction value memory unit, and corrects the floor distance based on the ranging correction value.
[0007] In addition, a driving control method for an autonomous driving robot according to one aspect of the present disclosure is a driving control method for an autonomous driving robot that autonomously drives on a floor, and includes an input step for inputting reflectance information regarding the reflectance at a predetermined point on the floor surface of the floor, a sensor information acquisition step for acquiring sensor information including a positional relationship between objects around the autonomous driving robot and the autonomous driving robot, a self-position calculation step for calculating a self-position, which is the current position of the autonomous driving robot on a map of the floor based on the positional relationship, a floor distance calculation step for calculating a floor distance, which is the distance from the front of the autonomous driving robot to the floor surface, based on the sensor information, a correction value storage step for storing a ranging correction value corresponding to the reflectance, and a correction step for obtaining the ranging correction value at the predetermined point by comparing the reflectance information input in the input step with the ranging correction value stored in the correction value storage step, and correcting the floor distance based on the ranging correction value.
[0008] The present disclosure may be realized as a program for causing a computer to execute the method for controlling traveling of an autonomous robot. Also, the present disclosure may be realized as a non-transitory recording medium such as a CD-ROM having the program recorded thereon and readable by a computer. Also, the present disclosure may be realized as information, data, or signals indicating the program. And, the program, information, data, and signals may be distributed via a communication network such as the Internet. Effect of the Invention
[0009] The autonomous driving system, and the method and program for controlling driving of an autonomous driving robot disclosed herein can improve the accuracy of obstacle detection. [Brief description of the drawings]
[0010] [Figure 1] FIG. 1 is a block diagram showing an example of a functional configuration of an autonomous driving system according to the first embodiment. [Diagram 2] FIG. 2 is a perspective view of the autonomous mobile robot in the first embodiment as viewed obliquely from above. [Diagram 3] FIG. 3 is a bottom view showing the external appearance of the autonomous mobile robot in the first embodiment as viewed from the rear side. [Figure 4] FIG. 4 is a plan view showing an example of a floor map created by the map management unit according to the first embodiment. [Diagram 5] FIG. 5 is an explanatory diagram showing a distance measurement mechanism in the obstacle sensor according to the first embodiment. [Figure 6] FIG. 6 is an explanatory diagram showing an example of a correction value map in which distance measurement correction values according to the first embodiment are stored. [Figure 7] FIG. 7 is an explanatory diagram showing an example of a correction value map in which distance measurement correction values according to the first embodiment are stored. [Figure 8] FIG. 8 is a flowchart showing the flow of the distance measurement correction value acquisition method according to the first embodiment. [Figure 9]FIG. 9 is a flowchart showing the flow of the cruise control method according to the first embodiment. [Figure 10] FIG. 10 is an explanatory diagram showing an example of a change in floor surface distance according to the first embodiment. [Figure 11] FIG. 11 is an explanatory diagram illustrating an example in which a correction value map is displayed on a presentation unit of an information terminal according to the first embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0011] Hereinafter, an embodiment of an autonomous driving system and the like according to the present disclosure will be described in detail with reference to the drawings. Note that each of the embodiments described below is a preferred specific example of the present disclosure. Therefore, the numerical values, shapes, materials, components, arrangement and connection of the components, steps, order of steps, and the like shown in the following embodiments are merely examples and are not intended to limit the present disclosure. Furthermore, among the components in the following embodiments, components that are not described in the independent claims are described as optional components.
[0012] The accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.
[0013] In addition, each drawing is a schematic diagram and is not necessarily a precise illustration. In addition, in each drawing, the same reference numerals are used for substantially the same configurations, and duplicated explanations may be omitted or simplified.
[0014] In addition, in the following embodiments, the autonomous mobile robot moving across a floor may be described as being viewed from vertically above as a top view, and as being viewed from vertically below as a bottom view.
[0015] (Embodiment 1) [Autonomous Driving System] [1. Configuration] First, a description will be given of the configuration of the autonomous driving system in embodiment 1. Fig. 1 is a block diagram showing an example of the functional configuration of the autonomous driving system according to embodiment 1.
[0016] The autonomous driving system 300 is a system including an autonomous driving robot 100 that autonomously travels on a floor. The autonomous driving system 300 travels on the floor with obstacles removed, stores distance measurement correction values in association with the reflectance at a predetermined point on the floor surface, and creates a travel plan using the distance measurement correction values. The travel plan includes the travel route and travel speed of the autonomous driving robot.
[0017] The floor is a floor on which the autonomous mobile robot 100 travels, and may be, for example, a floor partitioned by walls, windows, or partitions, or may be a part of the floor. Furthermore, the floor is not limited to being inside a building, and may be present on a ship or outdoors.
[0018] In this embodiment, the autonomous mobile robot 100 is a cleaning robot equipped with a cleaning function, but is not limited to a cleaning robot. The autonomous mobile robot 100 may be any robot that autonomously travels on a floor, and may be, for example, a mopping robot that wipes and cleans floor surfaces, a floor leveling robot, a lawnmower robot, a disinfection robot that disinfects floor surfaces with ultraviolet light or a disinfectant, a hammering inspection robot, or an exploration robot that explores objects on or underground.
[0019] 1, an autonomous driving system 300 includes, for example, an autonomous driving robot 100 and an information terminal 200. Each component will be described below.
[0020] [1-1. Autonomous robot] First, the autonomous mobile robot 100 will be described with reference to Figs. 1 to 3. Fig. 2 is a perspective view of the autonomous mobile robot 100 in the first embodiment as seen obliquely from above. Fig. 3 is a bottom view showing the appearance of the autonomous mobile robot 100 in the first embodiment as seen from the rear side. Below, an example in which the autonomous mobile robot 100 is a cleaning robot will be described, but this is merely one example and the autonomous mobile robot is not limited to this example.
[0021] As shown in FIG. 1 to FIG. 3, the autonomous mobile robot 100 includes, for example, a main body 101 on which various components are mounted, a position sensor 102, a communication unit 110, a control unit 120, a storage unit 130, a sensor unit 140, a notification unit 150, a traveling unit 160, and a cleaning unit 170. The traveling unit 160 includes, for example, wheels 161 for moving the main body 101. The cleaning unit 170 includes, for example, a side brush 171 and a main brush 172 for cleaning up dirt present on a floor. The control unit 120 processes various information related to the operation of the autonomous mobile robot 100. The control unit 120 includes a traveling control unit 131 for controlling the traveling unit 160, and a cleaning control unit 132 for controlling the cleaning unit 170. The main body 101 is a housing that houses the traveling unit 160, the cleaning unit 170, the control unit 120, and the like.
[0022] The running unit 160 causes the autonomous mobile robot 100 to run based on instructions from the running control unit 131. The running unit 160 has wheels 161 that run on a floor, a running motor (not shown) that applies torque to the wheels 161, and a housing (not shown) that accommodates the running motor. The autonomous mobile robot 100 may also be an opposed two-wheel type that has casters 162 as auxiliary wheels. In this case, the running unit 160 independently controls the rotation of each of the wheels 161 of the pair of running units, thereby allowing the autonomous mobile robot 100 to run freely in directions such as forward, backward, left turn, and right turn.
[0023] Based on instructions from the cleaning control unit 132, the cleaning unit 170 sucks up dust on the floor through suction port 173 (see FIG. 3) and collects the sucked dust inside the main body 101 inside the main body 101. The cleaning unit 170 includes a brush rotation motor (not shown) that rotates the side brushes 171 and the main brush 172, a suction motor (not shown) that sucks up dust through the suction port 173, a power transmission unit (not shown) that transmits power to these motors, and a storage unit (not shown) that stores the sucked dust.
[0024] The travel control unit 131 controls the travel unit 160 so that the autonomous mobile robot 100 travels according to a travel plan. More specifically, the travel control unit 131 performs information processing for controlling the operation of the travel unit 160 based on the travel plan. For example, the travel control unit 131 derives control conditions for the travel unit 160 based on information such as a floor step map and the self-position in addition to the travel plan, and generates a control signal for controlling the operation of the travel unit 160 based on the control conditions. The travel control unit 131 outputs the generated control signal to the travel unit 160. Note that details such as the derivation of the control conditions for the travel unit 160 are the same as those of conventional autonomous mobile robots, and therefore will not be described.
[0025] The cleaning control unit 132 controls the cleaning unit 170 so that the autonomous mobile robot 100 cleans according to the cleaning plan. More specifically, the cleaning control unit 132 performs information processing for controlling the operation of the cleaning unit 170 based on the cleaning plan. For example, the cleaning control unit 132 derives control conditions for the cleaning unit 170 based on information such as a floor step map and the self-position in addition to the cleaning plan, and generates a control signal for controlling the operation of the cleaning unit 170 based on the control conditions. The cleaning control unit 132 outputs the generated control signal to the cleaning unit 170. Note that details such as the derivation of the control conditions for the cleaning unit 170 are the same as those of a conventional autonomous mobile cleaning robot, and therefore will not be described here.
[0026] The position sensor 102 acquires the positional relationship between the main body 101 and objects around the main body 101. For example, the position sensor 102 is disposed in the center of the upper surface of the main body 101, and acquires the positional relationship including the distance and direction between the autonomous mobile robot 100 and objects including walls around the autonomous mobile robot 100. The position sensor 102 may be, for example, a LiDAR (Light Detection And Ranging) that emits light and acquires the positional relationship (for example, the distance and direction from the autonomous mobile robot to an object) based on the light reflected by an obstacle, or a laser range finder. The position sensor 102 may also have one or two optical scanning axes to perform two-dimensional or three-dimensional measurement of a predetermined area around the autonomous mobile robot 100.
[0027] The sensor unit 140 detects objects around the autonomous mobile robot 100 and acquires sensing data related to the detected objects. For example, as shown in Fig. 2 and Fig. 3, the sensor unit 140 includes an obstacle sensor 141, an encoder 143, and a floor sensor 144.
[0028] The obstacle sensor 141 is a sensor that detects an obstacle present in front of the main body 101 (specifically, in the traveling direction). The obstacle is an object other than a wall that divides a floor, is present in the traveling direction of the autonomous mobile robot 100, and obstructs the traveling of the autonomous mobile robot 100. In this embodiment, an optical 3D distance measuring sensor is used for the obstacle sensor 141, for example. The obstacle sensor 141 has a light emitting unit 141a arranged in the center of the front side surface of the main body 101, and light receiving units 141b arranged on both sides of the light emitting unit 141a, and the light receiving units 141b receive the light emitted from the light emitting unit 141a and reflected by the obstacle, thereby being able to detect the distance to the obstacle, the position of the obstacle, and the like.
[0029] The encoder 143 is provided on the traveling unit 160 and is a sensor that detects the rotation angle of each of a pair of wheels 161 rotated by a traveling motor.
[0030] Floor sensors 144 are installed at multiple locations on the bottom surface of main body 101 and detect whether or not a floor surface is present.
[0031] The autonomous mobile robot 100 may be equipped with sensors other than the above-mentioned sensors. For example, the autonomous mobile robot 100 may be equipped with a camera that captures images of the surroundings of the autonomous mobile robot 100, an acceleration sensor that detects the acceleration when the autonomous mobile robot 100 travels, and an angular velocity sensor that detects the angular velocity when the autonomous mobile robot 100 turns. The autonomous mobile robot 100 may also be equipped with a dust amount sensor that measures the amount of dust accumulated on the floor surface. The autonomous mobile robot 100 may also be equipped with a contact sensor that detects the displacement of a bumper (not shown) to detect a collision with an obstacle.
[0032] The communication unit 110 is a communication circuit for the autonomous mobile robot 100 to communicate with the information terminal 200 via the network 10. For example, the communication unit 110 transmits information to be presented to the user to the information terminal 200. The communication unit 110 may include a communication circuit for communicating via a wide area communication network and a communication circuit for communicating via a local communication network. The communication unit 110 is, for example, a wireless communication circuit for performing wireless communication. There is no particular limitation on the communication standard of the communication performed by the communication unit 110.
[0033] The communication unit 110 may perform short-distance wireless communication with the information terminal 200. In this case, the communication unit 110 includes a communication circuit for performing short-distance wireless communication. The communication standard for short-distance wireless communication is, but is not limited to, BLE (Blutooth (registered trademark) Low Energy) or Wi-Fi (registered trademark).
[0034] The control unit 120 performs various information processing for controlling the operation of the autonomous mobile robot 100. Specifically, the control unit 120 is realized by a processor, a microcomputer, or a dedicated circuit. The control unit 120 may also be realized by a combination of two or more of a processor, a microcomputer, or a dedicated circuit. The functions of the control unit 120 are realized by hardware such as a microcomputer or a processor constituting the control unit 120 executing a computer program (software) stored in the storage unit 130.
[0035] The control unit 120 includes, as functional components, a sensor information acquisition unit 121, a self-position calculation unit 122, a map management unit 123, a distance calculation unit 124, a correction value storage unit 125, a correction unit 126, an obstacle detection unit 127, a travel plan creation unit 128, a travel control unit 131, and a cleaning control unit 132. These functions will be specifically described in an operation example.
[0036] The sensor information acquisition unit 121 acquires sensor information including the positional relationship between the autonomous mobile robot 100 and objects around the autonomous mobile robot 100. The positional relationship is measured by the above-mentioned position sensor 102 and sensor unit 140. The sensor information is sensing data of various sensors equipped in the autonomous mobile robot 100, and includes, in addition to the positional relationship, for example, the distance to an obstacle detected by the above-mentioned obstacle sensor 141, the position of the obstacle, and each rotation angle of the pair of wheels 161 detected by the encoder 143.
[0037] The self-position calculation unit 122 calculates the self-position, which is the current position of the autonomous mobile robot 100 on the map of the floor, based on the positional relationship between the autonomous mobile robot 100 and objects around the autonomous mobile robot 100.
[0038] The map management unit 123 creates a map of the floor based on the above positional relationship and the self-position. Fig. 4 is a plan view showing an example of a map of the floor created by the map management unit 123 according to the first embodiment. The dot-hatched area in Fig. 4 is an area in which the autonomous mobile robot 100 can travel. The hatching adjacent to the dot-hatched area indicates a wall.
[0039] The distance calculation unit 124 acquires information about the obstacle detected by the obstacle sensor 141 (for example, the distance and position of the obstacle, etc.), and calculates the position of the obstacle on the map of the floor based on the acquired information and the self-position calculated by the self-position calculation unit 122. The distance calculation unit 124 also calculates the floor distance, which is the distance from the front of the autonomous mobile robot 100 to the floor surface F of the floor, based on the sensor information. The sensor information also includes the detection result of the obstacle sensor 141, and the distance calculation unit 124 calculates the floor distance based on this detection result.
[0040] Fig. 5 is an explanatory diagram showing the distance measurement mechanism of the obstacle sensor 141 according to the first embodiment. As shown in Fig. 5, the light irradiated from the light-emitting unit 141a contains a component of light L that is inclined with respect to the horizontal direction so that the light approaches the floor surface F of the floor as it moves toward the front of the main body 101. Based on the reflected light of this light L received by the light-receiving unit 141b, the distance calculation unit 124 can calculate the floor surface distance from the light-emitting unit 141a to the floor surface F. The start point of the floor surface distance is the light-emitting unit 141a, and the end point is the reflection position of the light L on the floor surface F (distance measurement position T).
[0041] Incidentally, the reference distance from the light-emitting unit 141a to the floor surface F can be geometrically determined from the angle of view, mounting height, angle, etc. of the light-emitting unit 141a of the obstacle sensor 141, or can be determined by actual measurement.
[0042] In other words, when there is no obstacle in front of the main body 101, the distance calculation unit 124 calculates the floor distance from the front of the main body 101 to the floor surface based on the detection result of the obstacle sensor 141, and the value is equal to the reference distance.
[0043] On the other hand, when an obstacle is present at a position closer than the reference distance from the main body 101, the distance calculation unit 124 calculates the distance from the front of the main body 101 to the obstacle based on the detection result of the obstacle sensor 141. In other words, when the calculated distance is shorter than the reference distance, it is detected that there is an obstacle in front of the main body 101.
[0044] Here, as shown in FIG. 5, when the autonomous mobile robot 100 is traveling on a floor surface F1 that is lighter in color than the floor surface F, the reflectance is also high and a larger amount of reflected light is incident on the light receiving unit 141b. Therefore, even if there is no obstacle closer than the reference distance from the main body 101, the calculation result by the distance calculation unit 124 is shorter than the reference distance, and the obstacle is erroneously detected as being present. The graph in FIG. 5 illustrates a case in which the floor surface distance (14 cm) calculated on the light-colored floor surface F1 is shorter than the reference distance (20 cm) and falls below the avoidance start distance (15 cm) at which avoidance of the obstacle is started. In other words, the autonomous mobile robot 100 performs an avoidance operation even though there is no obstacle. In order to suppress such erroneous detection, the autonomous mobile robot 100 of this embodiment is provided with a correction value storage unit 125 and a correction unit 126.
[0045] The correction value storage unit 125 stores a distance measurement correction value corresponding to the reflectance at a predetermined point on the floor surface. The distance measurement correction value is acquired during or after the map of the floor is created, and the autonomous mobile robot 100 is caused to travel so as to fill in the entire surface of the floor surface with obstacles removed from the floor surface. At this time, the distance calculation unit 124 constantly calculates the floor surface distance. The correction value storage unit 125 stores the difference between the floor surface distance at each distance measurement position T and the reference distance as the distance measurement correction value. In other words, the correction value storage unit 125 stores the distance measurement correction value in association with a point (each distance measurement position T) that is away from the self-position on the map by the floor surface distance.
[0046] For example, in the graph of Figure 5, the difference between the floor distance (14 cm) and the reference distance (20 cm) is +6 cm, so +6 cm is the distance measurement correction value. The distance measurement correction value is a value that depends on the reflectance of the floor. In other words, it can be said that the distance measurement correction value is a value that corresponds to the reflectance at each distance measurement position T (predetermined position) on the floor. Factors that cause fluctuations in floor reflectance include not only the brightness or darkness of the floor color, but also the floor material and surface roughness.
[0047] 6 and 7 are explanatory diagrams showing an example of a correction value map in which distance measurement correction values according to the first embodiment are stored. In Fig. 6, distance measurement correction values (numerical values in the figure) are recorded for each range having a certain degree of size. In Fig. 7, the map is divided into a grid, and distance measurement correction values (numerical values in the figure) are recorded for each grid (for example, 5 cm x 5 cm).
[0048] The correction unit 126 corrects the floor distance calculated by the distance calculation unit 124 based on the distance measurement correction value stored in the correction value storage unit 125. The correction by the correction unit 126 is performed during driving after the correction value map is created. The correction unit 126 corrects the floor distance calculated at each distance measurement position T during driving based on the distance measurement correction value at the distance measurement position T. For example, in the example of the graph in Fig. 5, the floor distance at the distance measurement position T (14 cm) is corrected based on the distance measurement correction value at the distance measurement position T (+6 cm), and the corrected floor distance is set to 20 cm.
[0049] The obstacle detection unit 127 uses the floor distance corrected by the correction unit 126 to detect the approach of the autonomous mobile robot 100 to an obstacle.
[0050] The travel plan creation unit 128 creates a travel plan for the autonomous mobile robot 100 to travel on the floor, based on a map of the floor and its own position.
[0051] For example, when the autonomous mobile robot 100 is a cleaning robot, the travel plan creation unit 128 may further create a cleaning plan. The cleaning plan includes a cleaning order for cleaning a plurality of cleaning areas within an area, a travel path and a cleaning mode in each cleaning area, etc. The cleaning mode is, for example, a combination of the travel speed of the autonomous mobile robot 100, the suction strength for sucking up dirt on the floor surface, and the rotation speed of the brush.
[0052] When the autonomous mobile robot 100 is traveling according to the travel plan and an obstacle is detected by the obstacle sensor 141, the travel plan creation unit 128 may change the travel plan based on the approach to the obstacle detected by the obstacle detection unit 127. In this case, the travel plan creation unit 128 includes a route that goes around the obstacle in the travel plan. This causes the travel control unit 131 to control the travel unit 160 to avoid the obstacle.
[0053] The storage unit 130 is a storage device in which computer programs executed by the control unit 120 and the like are stored. The storage unit 130 can also temporarily store information that needs to be stored due to information processing performed by the communication unit 110 and the control unit 120. The storage unit 130 is realized by, for example, an HDD (Hard Disk Drive), but may also be realized by a semiconductor memory. The storage unit 130 may have the function of a correction value storage unit.
[0054] The reception unit (not shown) receives instructions from the user (more specifically, input operation of instructions by the user). The reception unit may be realized by, for example, a touch panel, a display panel, a hardware button, or a microphone. The touch panel may be, for example, a capacitive touch panel or a resistive touch panel. The display panel has a function of displaying images and a function of receiving manual input from the user, and receives input operations to a numeric keypad image or the like displayed on a display panel such as a liquid crystal panel or an organic EL panel. The microphone receives voice input from the user.
[0055] The notification unit 150 notifies the user of information. The information may be at least one of a travel plan for the floor and the travel result of the autonomous mobile robot 100 based on the travel plan. The travel result may be, for example, the travel trajectory of the autonomous mobile robot 100, the amount of dirt cleaned by the autonomous mobile robot 100, and obstacles detected during travel. The notification unit 150 is realized, for example, by at least one of a speaker, a lamp, and a display panel. The speaker outputs sound or voice. The lamp lights up or blinks. The display panel is, for example, a liquid crystal panel or an organic EL panel, and displays an image. The notification unit 150 may notify the information terminal 200 used by the user of the above information.
[0056] [1-2. Information terminal] Next, the information terminal 200 will be described. The information terminal 200 shown in Fig. 1 is, for example, a portable information terminal such as a smartphone or tablet terminal used by a user (so-called portable information terminal), but may also be a stationary information terminal such as a personal computer. The information terminal 200 may also be a dedicated terminal for the autonomous driving system 300. The information terminal 200 includes a communication unit 210, a control unit 220, a storage unit 230, a reception unit 240, and a presentation unit 250. Each configuration will be described below.
[0057] The communication unit 210 is a communication circuit for the information terminal 200 to communicate with the autonomous mobile robot 100 via the network 10. The communication unit 210 may include a communication circuit for communicating via a wide area communication network and a communication circuit for communicating via a local communication network. The communication unit 210 is, for example, a wireless communication circuit for performing wireless communication. There is no particular limitation on the communication standard for the communication performed by the communication unit 210.
[0058] The control unit 220 controls the display of images on the reception unit 240, and performs processing to identify instructions input by a user (for example, voice recognition processing in the case of voice input), etc. The control unit 220 may be realized by, for example, a microcomputer or a processor.
[0059] The storage unit 230 is a storage device that stores dedicated application programs and the like to be executed by the control unit 220. The storage unit 230 is realized by, for example, a semiconductor memory.
[0060] The receiving unit 240 receives a user's instruction (more specifically, an input operation of the instruction by the user). More specifically, the receiving unit 240 receives an input operation performed to transmit the user's instruction to the autonomous mobile robot 100.
[0061] The reception unit 240 may be realized by, for example, a touch panel, a display panel, a hardware button, or a microphone. The touch panel may be, for example, a capacitive touch panel or a resistive touch panel. The display panel has a function of displaying images and a function of accepting manual input from the user, and accepts input operations to a numeric keypad image or the like displayed on a display panel such as a liquid crystal panel or an organic electroluminescence panel. The microphone accepts voice input from the user.
[0062] The presentation unit 250 presents information to the user. More specifically, the presentation unit 250 may present information output by the notification unit 150 of the autonomous mobile robot 100 to the user. The presentation unit 250 may also present at least one of the floor distance corrected by the correction unit 126, the distance measurement correction value stored in the correction value storage unit 125, and the reflectance information to the user. The reflectance information is information on the reflectance of the floor, such as the brightness and darkness of the color of the floor, the material of the floor, and the surface roughness. The presentation unit 250 may display the corrected floor distance, the distance measurement correction value, and the reflectance information together with a map. The presentation unit 250 may be realized, for example, by a display panel, or may be realized by a display panel and a speaker. The display panel is, for example, a liquid crystal panel or an organic EL panel. The speaker outputs sound or audio.
[0063] [2. Operation] Next, the operation of the autonomous driving system 300 according to the first embodiment will be described with reference to the drawings.
[0064] First, a method for acquiring a distance measurement correction value will be described. Fig. 8 is a flowchart showing a flow of the method for acquiring a distance measurement correction value according to the first embodiment. The method for acquiring a distance measurement correction value is an example of a correction value acquisition step. The method for acquiring a distance measurement correction value is executed after removing obstacles from the floor surface.
[0065] 8, in step S10, the driving control unit 131 controls the driving unit 160 to drive the autonomous mobile robot 100 so as to fill the floor surface. At this time, the sensor information acquisition unit 121 acquires sensor information including the positional relationship between the autonomous mobile robot 100 and objects around the autonomous mobile robot 100. In addition, the self-position calculation unit 122 calculates the self-position, which is the current position of the autonomous mobile robot 100 on the map of the floor, based on the positional relationship in the sensor information acquired by the sensor information acquisition unit 121.
[0066] In step S11, the distance calculation unit 124 constantly calculates the floor distance based on the sensor information, thereby acquiring the floor distance at each distance measurement position T.
[0067] In step S12, the correction value storage unit 125 obtains and stores the difference between the floor distance at each distance measurement position T and the reference distance as a distance measurement correction value.
[0068] In step S13, the map management unit 123 records the distance measurement correction value at each distance measurement position T on the map to create a correction value map. This correction value map may be displayed on the notification unit 150, or may be sent from the communication unit 110 to the communication unit 210 of the information terminal 200 and displayed on the presentation unit 250. By visually checking this display, the user can intuitively grasp the distance measurement correction value at each distance measurement position T.
[0069] In step S14, the traveling control unit 131 controls the traveling unit 160 to return the autonomous traveling robot 100 to the initial position.
[0070] Next, a method of controlling driving during normal driving (cleaning) will be described. Fig. 9 is a flowchart showing the flow of the driving control method according to the first embodiment.
[0071] As shown in Fig. 9, in step S20, the travel control unit 131 controls the travel unit 160 to travel the autonomous mobile robot 100 so as to fill the floor surface, and the cleaning control unit 132 controls the cleaning unit 170 to perform a cleaning operation. At this time, the sensor information acquisition unit 121 acquires sensor information including the positional relationship between the autonomous mobile robot 100 and objects around the autonomous mobile robot 100. In addition, the self-position calculation unit 122 calculates the self-position, which is the current position of the autonomous mobile robot 100 on the map of the floor, based on the positional relationship in the sensor information acquired by the sensor information acquisition unit 121. Step S20 is an example of a sensor information acquisition step and a self-position calculation step.
[0072] In step S21, the distance calculation unit 124 constantly calculates the floor distance based on the sensor information, thereby acquiring the floor distance at each ranging position T. Step S21 is an example of a floor distance calculation step. At this time, there may be ranging positions T at which the floor distance cannot be acquired accurately due to walls existing on the floor. As a countermeasure to this, the distance calculation unit 124 recognizes the positions of the walls from a map in advance, and replaces the floor distance at positions near the walls with a reference distance.
[0073] In step S22, the correction unit 126 corrects the floor distance calculated by the distance calculation unit 124 in step S21, based on the distance measurement correction value stored in the correction value storage unit 125. The correction unit 126 corrects the floor distance calculated at each distance measurement position T during traveling, based on the distance measurement correction value at the corresponding distance measurement position T. Step S22 is an example of a correction step.
[0074] In step S23, the obstacle detection unit 127 detects the approach of the autonomous mobile robot 100 to an obstacle using the floor distance corrected by the correction unit 126. FIG. 10 is an explanatory diagram showing an example of the fluctuation of the floor distance according to the first embodiment. In FIG. 10, the change in the floor distance over time is shown by a bar graph. The dashed line in the bar graph is the distance measurement correction value. That is, the bar graphs G1 and G2 show the floor distance on a floor surface where correction was not required, and the bar graphs G3 to G7 show the floor distance on a floor surface where correction is required. In either case, the bar graphs G1 to G7 are the reference distances.
[0075] Here, when the light of the light emitting unit 141a is reflected by an obstacle, the reflected light is not affected by the reflectance of the floor surface. Therefore, immediately after detecting an obstacle (bar graph G6), the corrected floor distance increases sharply from the reference distance. The amount of change is approximately equal to the distance measurement correction value. The obstacle detection unit 127 recognizes this sharp change and determines that an obstacle has been detected. Thereafter, when the autonomous mobile robot 100 approaches the obstacle, the corrected floor distance gradually decreases (bar graph G7). However, since the distance measurement correction value has been added, the distance to the obstacle cannot be obtained accurately. Therefore, the obstacle detection unit 127 obtains the distance that the autonomous mobile robot 100 has actually traveled since detecting the obstacle, and obtains the distance from the autonomous mobile robot 100 to the obstacle. Specifically, the obstacle detection unit 127 obtains the distance from the autonomous mobile robot 100 to the obstacle based on the difference between the corrected floor distance immediately after detecting the obstacle and the corrected floor distance thereafter. Alternatively, the obstacle detection unit 127 obtains the distance from the autonomous mobile robot 100 to the obstacle by calculating the actual distance traveled by the autonomous mobile robot 100 based on the detection results of the encoder 143 immediately after detecting the obstacle.
[0076] If the distance from the autonomous mobile robot 100 to the obstacle is less than the avoidance start distance, the obstacle detection unit 127 determines that the autonomous mobile robot 100 has approached the obstacle and proceeds to step S24. On the other hand, if the distance from the autonomous mobile robot 100 to the obstacle is equal to or greater than the avoidance start distance, the obstacle detection unit 127 determines that the autonomous mobile robot 100 has not approached the obstacle and proceeds to step S25. The avoidance start distance is a value (e.g., 15 cm) smaller than the reference distance.
[0077] In step S24, the traveling control unit 131 controls the traveling unit 160 so as to avoid the obstacle, and the process proceeds to step S25. As a result, the autonomous traveling robot 100 travels so as to avoid the obstacle. At this time, the map management unit 123 writes the avoidance point into the correction value map.
[0078] In step S25, the correction value storage unit 125 compares the difference between the floor distance and the reference distance at each distance measurement position T at the current time with the distance measurement correction value at each distance measurement position T recorded in the correction value map. This comparison is not performed between immediately after the detection of the obstacle and the avoidance start distance. If there is no difference, the correction value storage unit 125 proceeds to step S26, and if there is a difference, the correction value storage unit 125 updates and records the difference as a new distance measurement correction value, and proceeds to step S26. This makes it possible to update the distance measurement correction value in response to a change in the reflectance of the floor surface due to aging deterioration, a change in the floor surface to another floor surface, and the like. At this time, the map management unit 123 also updates the correction value map to the new distance measurement correction value for the distance measurement position T for which the new distance measurement correction value was acquired.
[0079] In step S26, the traveling control unit 131 determines whether or not the cleaning has been completed, and if not completed, the process proceeds to step S20, and if completed, the process proceeds to step S27.
[0080] In step S27, the traveling control unit 131 controls the traveling unit 160 to return the autonomous traveling robot 100 to the initial position.
[0081] [Example of presentation to users] Next, a description will be given of an example of presenting information to a user of the autonomous driving system 300. More specifically, the presentation unit 250 of the information terminal 200 displays, for example, a correction value map and presents it to the user.
[0082] Fig. 11 is an explanatory diagram showing an example of a correction value map displayed on the presentation unit 250 of the information terminal 200 according to the first embodiment. As shown in Fig. 11, in the correction value map, reflectance information regarding the reflectance of each range on the floor surface is shown by different dot hatching. A distance measurement correction value is displayed in each range, and the avoidance point R is also displayed by a dot. Although not shown in Fig. 11, when the avoidance point R is located at the boundary between each range, it can be seen that there is a high possibility that erroneous avoidance has been performed due to differences in reflectance.
[0083] Although the presentation unit 250 displays the reflectance information and the distance measurement correction value, it may also display the floor distance. Furthermore, correction instruction information for correcting the various pieces of information (at least one of the floor distance, the distance measurement correction value, and the reflectance information) presented by the presentation unit 250 may be input to the reception unit 240 of the information terminal 200. The input correction instruction information is output from the communication unit 210 to the communication unit 110 of the autonomous mobile robot 100. Based on the correction instruction information, the control unit 120 may update the various pieces of information. This makes it possible to manually correct the various pieces of information.
[0084] The correction value map may also be displayed and presented in the notification unit 150 of the autonomous mobile robot 100. In this case, the notification unit 150 is also an example of a presentation unit. In this case, correction instruction information may be input to a reception unit (not shown) of the autonomous mobile robot 100.
[0085] [3. Effects, etc.] As described above, according to this embodiment, the correction unit 126 corrects the floor distance based on the distance measurement correction corresponding to the reflectance at a predetermined point on the floor, so the floor distance can be corrected taking into account changes in the floor material, color, etc. Therefore, the floor distance from the autonomous mobile robot 100 to the floor can be measured more accurately, and the accuracy of obstacle detection can also be improved.
[0086] In addition, the autonomous mobile robot 100 avoids obstacles based on the detection results of the obstacle detection unit using the corrected floor distance, so the accuracy of the avoidance operation is also improved.
[0087] In addition, correction instruction information for correcting the various pieces of information (at least one of the floor distance, the distance measurement correction value, and the reflectance information) presented by the presentation unit 250 is input to the reception unit 240 of the information terminal 200, so that the user can manually correct the various pieces of information while visually checking the contents presented by the presentation unit 250.
[0088] Furthermore, since the presentation unit 250 presents the avoidance point R in association with the distance measurement correction value, the user can determine whether or not the avoidance has been performed correctly while visually checking the presented content.
[0089] The correction value storage unit 125 stores a distance measurement correction value in association with a point (distance measurement position T) that is a distance from the self-position on the map by the floor distance. In other words, since the distance measurement position T and the distance measurement correction value are associated with each other, not with the self-position of the autonomous mobile robot 100, the distance measurement correction value corresponding to the reflectance of the floor can be accurately associated and stored.
[0090] (Embodiment 2) In the second embodiment, a case will be described in which reflectance information regarding the reflectance at a predetermined point on the floor surface is input to the receiving unit 240 of the information terminal 200. In this case, the correction value storage unit 125 stores a distance measurement correction value corresponding to the reflectance information. Therefore, when the reflectance information is input to the receiving unit 240, the method of acquiring the distance measurement correction value described in the first embodiment can be omitted.
[0091] Specifically, the user photographs the floor surface with a camera provided in the information terminal 200. The reception unit 240 receives the RGB values at each point on the floor surface from the image of the floor surface as reflectance information. That is, reflectance information related to the reflectance at a predetermined point on the floor surface is input to the reception unit 240 (input step). Note that the RGB values at each point may be manually input by the user to the reception unit 240. In addition to the RGB values, brightness, saturation, etc. may be used as reflectance information.
[0092] On the other hand, the correction value storage unit 125 stores in advance distance measurement correction values corresponding to each RGB value (correction value storage step). The distance measurement correction values corresponding to each RGB value can be obtained by various simulations, experiments, empirical rules, and the like.
[0093] The correction unit 126 obtains a distance measurement correction value at a specified point by comparing the reflectance information input to the receiving unit 240 with the distance measurement correction value stored in the correction value memory unit 125, and corrects the floor distance based on the distance measurement correction value (correction step).
[0094] In this way, the correction unit 126 obtains a distance measurement correction value at a predetermined point by comparing the reflectance information input to the reception unit 240 with the distance measurement correction value stored in the correction value storage unit 125, and corrects the floor distance based on the distance measurement correction value, so that the floor distance can be corrected taking into consideration changes in the material and color of the floor. Therefore, the floor distance from the autonomous mobile robot 100 to the floor can be measured more accurately, and the accuracy of obstacle detection can also be improved. In particular, since the reflectance information is input by the reception unit 240, the method of obtaining the distance measurement correction value required in the first embodiment can be omitted.
[0095] (others) Although the embodiments have been described above, the present disclosure is not limited to the above embodiments. For example, in the above embodiments, the autonomous driving system 300 may be realized by a single device or by multiple devices. For example, the autonomous driving system 300 may be realized as a single device corresponding to the autonomous driving robot 100. When the autonomous driving system 300 is realized by multiple devices, the components (particularly functional components) of the autonomous driving system 300 may be distributed in any way among the multiple devices. For example, in the above embodiments, the functional components of the autonomous driving robot 100 may be provided by the information terminal 200 or a server (not shown).
[0096] Furthermore, the method of communication between the devices in the above-described embodiment is not particularly limited. In addition, a relay device (not shown) may be involved in the communication between the devices.
[0097] In the above embodiment, the process executed by a specific processing unit may be executed by another processing unit. The order of multiple processes may be changed, or multiple processes may be executed in parallel.
[0098] In the above embodiment, each component may be realized by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory.
[0099] Furthermore, each component may be realized by hardware. For example, each component may be a circuit (or an integrated circuit). These circuits may form a single circuit as a whole, or each may be a separate circuit. Furthermore, each of these circuits may be a general-purpose circuit, or a dedicated circuit.
[0100] Furthermore, the general or specific aspects of the present invention may be realized as a system, an apparatus, a method, an integrated circuit, a computer program, or a computer-readable recording medium such as a CD-ROM, or may be realized as any combination of a system, an apparatus, a method, an integrated circuit, a computer program, and a recording medium.
[0101] For example, the present disclosure may be realized as the autonomous driving robot 100, the information terminal 200, or a server (not shown) according to the above-described embodiment. Furthermore, the present disclosure may be realized as a driving control method for the autonomous driving robot 100 executed by a computer such as the autonomous driving system 300, or as a program for causing a computer to execute such a driving control method for the autonomous driving robot 100. The present disclosure may be realized as a computer-readable non-transitory recording medium on which such a program is recorded.
[0102] In addition, the present disclosure also includes forms obtained by applying various modifications to each embodiment that a person skilled in the art may conceive, or forms realized by arbitrarily combining the components and functions of each embodiment within the scope that does not deviate from the spirit of the present disclosure.
[0103] [Note] The above description of the embodiments and the like discloses the following techniques.
[0104] (Technology 1) An autonomous driving system including an autonomous driving robot that autonomously drives on a floor, a reception unit to which reflectance information regarding the reflectance at a predetermined point on the floor surface is input; A running unit that runs the main body; a sensor information acquisition unit that acquires sensor information including a positional relationship between an object around the autonomous robot and the autonomous robot; a self-position calculation unit that calculates a self-position, which is a current position of the autonomous mobile robot on a map of the floor, based on the positional relationship; a distance calculation unit that calculates a floor distance, which is a distance from a front portion of the autonomous mobile robot to the floor surface, based on the sensor information; a correction value storage unit that stores a distance measurement correction value corresponding to the reflectance information; a correction unit that acquires the distance measurement correction value at the predetermined point by comparing the reflectance information input to the reception unit with the distance measurement correction value stored in the correction value storage unit, and corrects the floor distance based on the distance measurement correction value. Autonomous driving system.
[0105] (Technology 2) an obstacle detection unit that detects an approach of an obstacle using the floor distance; A travel control unit controls the travel unit so as to avoid the obstacle based on a detection result by the obstacle detection unit. The autonomous driving system described in Technology 1.
[0106] (Technology 3) A presentation unit is provided for presenting a map along which the autonomous robot travels; the presentation unit presents at least one of the floor distance corrected by the correction unit, the distance measurement correction value stored in the correction value storage unit, and the reflectance information; correction instruction information for correcting at least one of the floor distance, the distance measurement correction value, and the reflectance information presented by the presentation unit is input to the reception unit. The autonomous driving system described in Technology 2.
[0107] (Technology 4) the presentation unit presents an avoidance point where the autonomous mobile robot has avoided the obstacle in association with the distance measurement correction value. The autonomous driving system described in Technology 3.
[0108] (Technology 5) A map management unit that manages a map on which the autonomous mobile robot travels; The correction value storage unit storing the distance measurement correction value in association with a point on the map that is distant from the self-position by the floor distance; The autonomous driving system according to any one of the first to fourth techniques.
[0109] (Technology 6) A method for controlling a traveling motion of an autonomous traveling robot that travels autonomously on a floor, comprising the steps of: An input step of inputting reflectance information regarding the reflectance at a predetermined point on the floor surface of the floor; a sensor information acquisition step of acquiring sensor information including a positional relationship between an object around the autonomous mobile robot and the autonomous mobile robot; a self-position calculation step of calculating a self-position, which is a current position of the autonomous mobile robot on a map of the floor, based on the positional relationship; a floor distance calculation step of calculating a floor distance, which is a distance from a front part of the autonomous mobile robot to the floor surface, based on the sensor information; a correction value storage step of storing a distance measurement correction value corresponding to the reflectance; a correction step of acquiring the distance measurement correction value at the predetermined point by comparing the reflectance information input in the input step with the distance measurement correction value stored in the correction value storage step, and correcting the floor distance based on the distance measurement correction value. A method for controlling the movement of an autonomous robot.
[0110] (Technology 7) A method for causing a computer to execute the autonomous robot running control method described in Technical 6. program. [Industrial Applicability]
[0111] The present disclosure is widely applicable to autonomously running robots. [Explanation of symbols]
[0112] 10 Network 100 Autonomous Robot 101 Main unit 102 Position Sensor 110 Communications Department 120 Control section 121 Sensor information acquisition unit 122 Self-position calculation unit 123 Map Management Department 124 Distance Calculation Unit 125 Correction value memory unit 126 Correction Unit 127 Obstacle detection unit 128 Driving Plan Creation Department 130 Storage section 131 Driving control unit 132 Cleaning control section 140 Sensor section 141 Obstacle Sensor 141a Light emitting part 141b Light receiving section 143 Encoder 144 Floor Sensor 150 Notification Department 160 Running part 161 Wheels 162 Caster 170 Cleaning Department 171 Side Brush 172 Main Brush 173 Suction port 200 Information terminal 210 Communications Department 220 Control section 230 Storage section 240 Reception 250 Presentation section 300 Autonomous Driving System F, F1 floor L light R Avoidance point T Range measurement position
Claims
1. An autonomous driving system including an autonomous driving robot that autonomously drives on a floor, a reception unit to which reflectance information regarding the reflectance at a predetermined point on the floor surface of the floor is input; A running unit that runs the main body; a sensor information acquisition unit that acquires sensor information including a positional relationship between an object around the autonomous robot and the autonomous robot; a self-position calculation unit that calculates a self-position, which is a current position of the autonomous mobile robot on a map of the floor, based on the positional relationship; a distance calculation unit that calculates a floor distance, which is a distance from a front portion of the autonomous mobile robot to the floor surface, based on the sensor information; a correction value storage unit that stores a distance measurement correction value corresponding to the reflectance information; a correction unit that acquires the distance measurement correction value at the predetermined point by comparing the reflectance information input to the reception unit with the distance measurement correction value stored in the correction value storage unit, and corrects the floor distance based on the distance measurement correction value. Autonomous driving system.
2. an obstacle detection unit that detects an approach of an obstacle using the floor distance; A travel control unit controls the travel unit so as to avoid the obstacle based on a detection result by the obstacle detection unit. The autonomous driving system according to claim 1 .
3. A presentation unit is provided for presenting a map along which the autonomous robot travels; the presentation unit presents at least one of the floor distance corrected by the correction unit, the distance measurement correction value stored in the correction value storage unit, and the reflectance information; correction instruction information for correcting at least one of the floor distance, the distance measurement correction value, and the reflectance information presented by the presentation unit is input to the reception unit. The autonomous driving system according to claim 2 .
4. the presentation unit presents an avoidance point where the autonomous mobile robot has avoided the obstacle in association with the distance measurement correction value. The autonomous driving system according to claim 3 .
5. A map management unit that manages a map on which the autonomous mobile robot travels; The correction value storage unit storing the distance measurement correction value in association with a point on the map that is distant from the self-position by the floor distance; The autonomous driving system according to any one of claims 1 to 4.
6. A method for controlling a traveling motion of an autonomous traveling robot that travels autonomously on a floor, comprising the steps of: An input step of inputting reflectance information regarding the reflectance at a predetermined point on the floor surface of the floor; a sensor information acquisition step of acquiring sensor information including a positional relationship between an object around the autonomous mobile robot and the autonomous mobile robot; a self-position calculation step of calculating a self-position, which is a current position of the autonomous mobile robot on a map of the floor, based on the positional relationship; a floor distance calculation step of calculating a floor distance, which is a distance from a front part of the autonomous mobile robot to the floor surface, based on the sensor information; a correction value storage step of storing a distance measurement correction value corresponding to the reflectance; a correction step of acquiring the distance measurement correction value at the predetermined point by comparing the reflectance information input in the input step with the distance measurement correction value stored in the correction value storage step, and correcting the floor distance based on the distance measurement correction value. A method for controlling the movement of an autonomous robot.
7. A method for causing a computer to execute the autonomous robot running control method according to claim 6. program.
Citation Information
Patent Citations
Information processing device and mobile robot
JP7002791B2
Cited By
Single-point laser ranging precision compensation method and system, storage medium and equipment
CN121114978A
