Movable body

The moving object navigates using visually recognizable guide lines and switches virtual paths to avoid obstacles, addressing the challenges of dynamic environments and guide line obstacles without relying on SLAM or GPS.

JP2024168091APending Publication Date: 2024-12-05DAIHEN CORP
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023084499
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-23
Publication Date
2024-12-05

AI Technical Summary

Technical Problem

In dynamic environments like factories where the layout frequently changes, conventional methods such as SLAM and GPS struggle to accurately guide mobile objects, and obstacles on guide lines hinder movement.

Method used

A moving object that uses visually recognizable guide lines on the floor, equipped with an image acquisition unit, conversion unit, detection unit, and control unit to navigate along parallel virtual lines, switching to avoid obstacles by changing virtual lines when detected.

Benefits of technology

Enables obstacle avoidance and efficient movement along guide lines by switching virtual paths, allowing the object to navigate around dynamic obstacles and maintain a safe distance from the guide line, reducing the need for precise positioning systems.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024168091000001_ABST
    Figure 2024168091000001_ABST
Patent Text Reader

Abstract

To solve the problem in which: a movable body moving along guidance lines cannot continue the movement when an obstacle is present on the guidance lines.SOLUTION: A movable body 1 comprises: an image acquisition unit 12 that acquires a photographed image of the front of the movable body 1; an image conversion unit 13 that converts the photographed image into a plane image of the photographed image seen from above; a detection unit 14 that detects, in the plane image, a guidance line provided on the floor and visually recognizable; an obstacle detection unit 15 that detects an obstacle on the front of the movable body 1; a moving mechanism 16; and a movement control unit 17 that controls the moving mechanism 16 so that the movable body 1 moves along one of two virtual lines that are parallel to the detected guidance line and separated from the guidance line by a first distance and a second distance, respectively. When an obstacle is detected, the movement control unit 17 changes the virtual lone along which the movable body 1 moves. Consequently, even when an obstacle is present on the front of the movable body, the movable body can avoid the obstacle.SELECTED DRAWING: Figure 1A
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a moving object that moves using visually recognizable guiding lines provided on a floor surface. [Background technology]

[0002] Conventionally, in an automatic guided vehicle or the like, the self-location is estimated using SLAM (Simultaneous Localization and Mapping) (for example, see Patent Document 1). In a moving environment in which the layout does not change much, the use of SLAM makes it possible to realize a desired movement while appropriately estimating the self-location. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-047671 Summary of the Invention [Problem to be solved by the invention]

[0004] On the other hand, in a mobile environment where the layout changes frequently, such as a factory, it is difficult to move using SLAM. In addition, it is difficult to control movement using a global positioning system (GPS) inside a building such as a factory. In addition, it is possible to move a mobile object along a guide line set on the floor, but there is a problem that if an obstacle is present on the guide line, the movement cannot be continued.

[0005] The present invention has been made to solve the above-mentioned problems, and has an object to provide a moving body that can avoid obstacles when moving using a guide wire. [Means for solving the problem]

[0006] In order to achieve the above-mentioned object, a moving body according to one embodiment of the present invention is a moving body that moves using visually recognizable guiding lines provided on a floor surface, and is equipped with an image acquisition unit that acquires a captured image of the area in front of the moving body, an image conversion unit that converts the captured image into a planar image viewed from above, a detection unit that detects the guiding lines in the planar image, a moving mechanism that moves the moving body, a movement control unit that controls the moving mechanism so that the moving body moves along one of two virtual lines that are parallel to the guiding lines detected by the detection unit and are separated from the guiding lines by a first and second distance, respectively, and an obstacle detection unit that detects an obstacle in front of the moving body, and the movement control unit changes the virtual line along which the moving body moves when an obstacle is detected by the obstacle detection unit. Effect of the Invention

[0007] According to one aspect of the present invention, when a moving body detects an obstacle while moving along one of a first or second virtual line parallel to a visually recognizable guiding line provided on the floor surface, the moving body can avoid the obstacle by switching the virtual line along which the moving body is moving. [Brief description of the drawings]

[0008] [Figure 1A] FIG. 2 is a block diagram showing the configuration of a moving body according to an embodiment of the present invention; [Figure 1B] FIG. 4 is a block diagram showing another configuration of the moving body according to the embodiment; [Diagram 2] FIG. 13 shows an example of a marker in the embodiment. [Figure 3A] FIG. 2 is a plan view showing a moving area of ​​a moving body in the embodiment; [Figure 3B] FIG. 2 is a plan view showing a moving area of ​​a moving body in the embodiment; [Figure 4A] FIG. 13 is a diagram showing an example of parameters in the embodiment; [Figure 4B] FIG. 13 is a diagram showing another example of parameters in the embodiment. [Diagram 5] FIG. 13 shows an example of a captured image in the embodiment. [Figure 6]FIG. 2 shows an example of a planar image in the embodiment. [Figure 7] FIG. 2 is a diagram for explaining obstacle avoidance in the embodiment; [Figure 8] FIG. 13 is a diagram for explaining stop control using a marker in the embodiment. [Figure 9] A flowchart showing the operation of a moving body according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] The moving body according to the present invention will be described below using an embodiment. In the following embodiments, components and steps with the same reference numerals are the same or equivalent, and repeated description may be omitted. When the moving body according to this embodiment detects an obstacle while moving along one of a first and a second virtual line parallel to a visually recognizable guiding line provided on the floor surface, the moving body avoids the obstacle by switching the moving virtual line.

[0010] 1A is a block diagram showing the configuration of a moving body 1 according to this embodiment. The moving body 1 according to this embodiment moves using visually recognizable guide lines provided on the floor surface, and includes a storage unit 11, an image acquisition unit 12, an image conversion unit 13, a detection unit 14, an obstacle detection unit 15, a movement mechanism 16, and a movement control unit 17. The use of the moving body 1 is not particularly limited, and the moving body 1 may be, for example, a moving body that performs transportation, or may be a moving body for other uses such as security and cleaning.

[0011] Guiding lines are provided on the floor surface of the moving environment of the moving body 1. The floor surface of the moving environment is usually preferably horizontal. The guiding lines may be provided, for example, to guide the moving body 1, or may be used for other purposes, such as dividing lines for dividing a passageway for people or a driving area for a forklift. The guiding lines may be, for example, tape-like such as vinyl tape attached to the floor surface, or may be provided by applying paint to the floor surface. The guiding lines are preferably lines of a certain width, for example. The guiding lines are visually recognizable. That is, the guiding lines are detectable in an image. The guiding lines are preferably a color different from that of the floor surface in order to be visually recognizable. The guiding lines may be, for example, straight lines or curved lines. In this embodiment, the case where the guiding lines are straight lines will be mainly described.

[0012] A marker may be arranged on the guiding line. The marker being arranged on the guiding line may mean, for example, that at least a part of the marker is present on the guiding line. When a plurality of markers are arranged on the guiding line, the plurality of markers may be, for example, all the same markers, or may include different markers. In this embodiment, the former case will be mainly described, and the latter case will be described later. It is preferable that the marker has a predetermined shape. This is to enable the marker to be detected in a planar image to be described later. As will be described later, when the marker is detected by the Hough transform, the marker may be, for example, circular. In addition, the marker may be, for example, one whose orientation can be specified. The marker may be, for example, an arrow shape, and may have a plurality of regions, and the orientation may be specified using a specific position of the region, for example, a center of gravity, and may include a figure indicating the orientation, such as an arrow.

[0013] In this embodiment, the case where the marker 3 shown in FIG. 2 is used will be mainly described. The marker 3 shown in FIG. 2 is circular and divided into two semicircular regions 3a and 3b by a straight line passing through the center. For example, the region 3a may be blue and the region 3b may be white. Also, for example, the direction of a vector starting from the center of the circular marker 3 and ending at the center of gravity of the region 3a may be the direction of the marker 3. FIG. 3A is a plan view showing an example of a situation in a factory where the marker 3 is placed on a guide line 5. In FIG. 3A, the guide line 5 is a dividing line for dividing a passage for people near an object 7 in the factory from a travel area for a forklift. Since the moving object 1 temporarily stops at the position of a virtual stop line that is in a predetermined positional relationship with the marker, the marker may be placed near a position where the moving object 1 is to be stopped, for example, near a branch point of the guide line where the direction of the moving object 1 is changed.

[0014] The storage unit 11 stores a set of parameters such as the first and second distances L1 and L2 indicating the distance between the guiding line and the first and second virtual lines, the third distance L3 indicating the distance between the marker and the virtual stop line, and the travel angle θ after stopping at the virtual stop line. This set of parameters may be, for example, the one shown in FIG. 4A. The set of parameters shown in FIG. 4A may be a set of parameters corresponding to one movement from the start of movement from the departure point or after resuming movement after stopping at the stop line until stopping at the next stop line. In this case, a plurality of sets of parameters may be stored in the storage unit 11, and the movement of the moving object 1 may be performed according to them. Details of these parameters will be described later.

[0015] The process by which information is stored in the storage unit 11 is not important. For example, information may be stored in the storage unit 11 via a recording medium, information transmitted via a communication line or the like may be stored in the storage unit 11, or information inputted via an input device may be stored in the storage unit 11. The storage unit 11 is preferably realized by a non-volatile recording medium, but may also be realized by a volatile recording medium. The recording medium may be, for example, a semiconductor memory, a magnetic disk, an optical disk, or the like.

[0016] The image acquisition unit 12 acquires a captured image of the area in front of the moving object 1. The image acquisition unit 12 may be, for example, an optical device such as a camera that captures an image, or may acquire an image captured by an optical device such as a camera. In this embodiment, a case where the image acquisition unit 12 is a camera will be mainly described. The captured image may be, for example, a color image, or a black and white or grayscale image. When at least one of the guiding line and the marker has a color other than black and white, it is preferable that the captured image is a color image. It is preferable that the image acquisition unit 12 repeats acquisition of the captured image. The image acquisition unit 12 may, for example, repeatedly acquire the captured image periodically or irregularly. The image acquisition unit 12 may also acquire, for example, a video. In this case, one frame constituting the video may be considered to be a captured image.

[0017] The optical axis of the camera for capturing the captured image is preferably usually directed forward in the traveling direction of the moving body 1. The optical axis may extend, for example, horizontally, or may be directed toward the floor so that the depression angle is a positive value. Even in the latter case, it is preferable that the captured image also includes a distant area in the traveling direction. This is to enable detection of markers in distant positions. FIG. 5 is a diagram showing an example of a captured image captured when the moving body 1 is in the position shown in FIG. 3A. As shown in FIG. 5, the captured image is an image with perspective.

[0018] The image conversion unit 13 converts the photographed image acquired by the image acquisition unit 12 into a planar image viewed from above. The planar image may be, for example, an image viewed in a direction perpendicular to the floor surface, for example, in the vertical direction. The image conversion unit 13 may convert the photographed image into a planar image by homography conversion, for example. Note that a method for converting a photographed image into a planar image is well known, and detailed description thereof will be omitted. FIG. 6 is a diagram showing an example of a planar image obtained by converting the photographed image shown in FIG. 5. As shown in FIG. 6, the planar image becomes an image without perspective. The image conversion unit 13 may convert each of the photographed images acquired repeatedly into a planar image, for example.

[0019] The detection unit 14 detects the guiding line in the planar image acquired by the image conversion unit 13. As an example, the detection unit 14 may detect the guiding line in the planar image by a Hough transform. For example, when the guiding line is a straight line, the detection unit 14 may perform a Hough transform to detect the straight line. The detection unit 14 may perform a thinning process on the planar image and then perform a Hough transform. This is because a guiding line is usually a line having a width, and a thinner line is more suitable for detection by a Hough transform than a line having a width. The thinning process may be, for example, an image process in which a line having a width is thinned by narrowing the line width, or may be edge detection. As the former thinning process, for example, algorithms such as Tamura, Hilditch, and Zhang-Suen, which thin an image after binarizing it, are known. In the latter edge detection, the edges on both sides of the width direction of the guiding line are usually detected, but edge detection may be performed so that only one edge is left, for example. In order to retain only one edge, for example, when detecting an edge using a differential value such as a brightness value, only pixels whose differential value is greater than a positive threshold value may be detected as edges, and pixels whose differential value is less than a negative threshold value may not be detected as edges.

[0020] Also, when the captured image is a color image, the detection unit 14 may, for example, convert the color planar image into a grayscale image and then perform thinning processing and guiding line detection processing. When converting to a grayscale image, the detection unit 14 may, for example, convert to grayscale such that the color of the guiding line is a reference color, and the greater the difference between the color and the reference color, the greater the difference between the pixel value of the reference color. For example, when converting to 8-bit grayscale, the pixel value of the reference color may be set to 0, and the greater the difference between the color and the reference color, the closer the pixel value to 255. In this way, it becomes possible to more appropriately detect the guiding line in the converted grayscale planar image.

[0021] The detection unit 14 may detect a marker arranged on the guiding line detected in the planar image. The detection unit 14 may detect the marker by, for example, a Hough transform in the planar image, or may detect the marker by template matching. In the planar image, the resolution becomes lower as the area becomes farther from the moving body 1. Therefore, in the Hough transform, it may be difficult to detect a marker located farther from the moving body 1, but in the case of template matching, a marker located farther from the moving body 1 can be more reliably detected. From this viewpoint, it is preferable to detect the marker by template matching. In addition, when the size of the marker is determined, the marker can be detected by using a template image of a predetermined size corresponding to the marker. In addition, since the marker is arranged on the guiding line, the detection unit 14 may detect the marker by template matching only within a predetermined range based on the detected guiding line. In the case where the marker has a color other than black and white, for example, even if the detection of the guiding line is performed using the above-mentioned grayscale image, the detection of the marker may be performed using a color planar image. Detecting a marker may mean, for example, identifying the position of the marker in the planar image. Furthermore, the detection unit 14 may identify the orientation of the marker in addition to the position of the marker in the planar image.

[0022] The obstacle detection unit 15 detects an obstacle in front of the moving body 1. When the moving body 1 is moving along a first virtual line parallel to the guiding line, the obstacle detection unit 15 may detect, for example, an obstacle with which the moving body 1 may collide when moving along the first virtual line. The obstacle with which the moving body 1 may collide when moving along the first virtual line may be, for example, an obstacle present on the first virtual line. When the moving body 1 is moving along a second virtual line parallel to the guiding line, the obstacle detection unit 15 may detect, for example, an obstacle with which the moving body 1 may collide when moving along the second virtual line. The obstacle with which the moving body 1 may collide when moving along the second virtual line may be, for example, an obstacle present on the second virtual line.

[0023] The obstacle detection unit 15 may detect an obstacle using, for example, a photographed image or a planar image, or may detect an obstacle using a sensing result by another sensor such as a distance sensor. In the latter case, the obstacle detection unit 15 may also have, for example, that sensor. The distance sensor may be, for example, a laser sensor, an ultrasonic sensor, a distance sensor using microwaves, or a distance sensor using a stereo image captured by a stereo camera. The laser sensor may be, for example, a laser range sensor (laser range scanner). The distance sensor may be, for example, a sensor that measures the distance to an object around the moving body 1 in one or more directions. The obstacle detection unit 15 may detect an object as an obstacle when it is found to exist in a predetermined area near the moving body 1 by, for example, a photographed image, a planar image, or a sensing result by another sensor such as a distance sensor.

[0024] The moving mechanism 16 moves the moving body 1. In this embodiment, the moving mechanism 16 is mainly described as a mechanism that moves the moving body 1 on a floor surface. The moving mechanism 16 may or may not be capable of moving the moving body 1 in all directions. Being capable of moving in all directions means being capable of moving in any direction. The moving mechanism 16 may have, for example, a running part (for example, wheels, etc.) and a driving means (for example, a motor, an engine, etc.) that drives the running part. In addition, when the moving mechanism 16 is capable of moving the moving body 1 in all directions, the running part may be an omnidirectional wheel (for example, an omniwheel, a mecanum wheel, etc.). As the moving mechanism 16, a known one can be used, and therefore a detailed description thereof will be omitted.

[0025] The movement control unit 17 controls the movement mechanism 16 so that the moving object 1 moves along one of the two virtual lines. In this embodiment, a case where the two virtual lines include a first and a second virtual line will be mainly described. The first and second virtual lines are parallel to the guiding line detected by the detection unit 14 and are separated from the guiding line by a first and a second distance, respectively. The virtual lines are lines that do not exist in the movement area of ​​the moving object 1, that is, lines that cannot be seen with the naked eye in the real environment.

[0026] The movement control unit 17 can know the position of the guiding line in the local coordinate system of the moving body 1 by the detection result of the guiding line in the planar image. Therefore, the movement control unit 17 can know the positions in the local coordinate system of a first virtual line that is a first distance away from the guiding line and a second virtual line that is a second distance away from the guiding line by using the position of the guiding line and a set of parameters stored in the storage unit 11. As a result, the movement control unit 17 can realize the movement of the moving body 1 along the first or second virtual line. For example, when the parameters are as shown in FIG. 4A, the first virtual line 6a may be a line that is a first distance L1 away from the guiding line 5, and the second virtual line 6b may be a line that is a second distance L2 away from the guiding line 5, as shown in FIG. 7. As an example, when the distances L1 and L2 are positive values, the virtual line may be on the right side of the traveling direction, and when the distances L1 and L2 are negative values, the virtual line may be on the left side of the traveling direction. In the latter case, the distance between the virtual line and the first and second virtual lines may be equal to the absolute values ​​of the distances L1 and L2, respectively. One of the first and second virtual lines 6a and 6b may overlap with the guiding line, for example. It is preferable that the first and second virtual lines 6a and 6b are spaced apart enough that, for example, when an obstacle exists on one virtual line, the moving body 1 can avoid the obstacle by moving along the other virtual line. As an example, the first and second virtual lines 6a and 6b may be spaced apart by more than the width in the direction perpendicular to the traveling direction of the moving body 1. In FIG. 7, the guiding line 5 is shown as a thin solid line for convenience of explanation, but as shown in FIG. 3, the guiding line 5 is usually a line having a width. The same applies to FIG. 8 described later.

[0027] The movement along the first virtual line 6a may be, for example, the movement of the moving object 1 on the first virtual line 6a. The movement on the first virtual line 6a may be, for example, the movement in which the first virtual line 6a is present in the center of the planar image in the left-right direction. The movement along the second virtual line 6b may be similar. When the planar image includes a plurality of guiding lines, the movement control unit 17 may perform movement control so that the moving object 1 moves along the first or second virtual line 6a, 6b parallel to the guiding line extending in the traveling direction of the moving object 1.

[0028] The movement control unit 17 changes the virtual line along which the moving body 1 moves when an obstacle is detected by the obstacle detection unit 15. For example, as shown in FIG. 7, when an obstacle 8 is detected while the moving body 1 is moving along the first virtual line 6a, the movement control unit 17 may control the movement mechanism 16 so that the moving body 1 moves along the second virtual line 6b. In this case, when an obstacle that is an obstacle in the movement along the first virtual line is detected by the obstacle detection unit 15, the movement control unit 17 may set the virtual line along which the moving body 1 moves to the second virtual line, and when an obstacle that is an obstacle in the movement along the first virtual line is not detected by the obstacle detection unit 15, the movement control unit 17 may set the virtual line along which the moving body 1 moves to the first virtual line. Then, the movement control unit 17 may perform movement control so that the moving body 1 moves along the set virtual line. When an obstacle 8 is detected during the moving along the first virtual line 6a, the moving body 1 may change the virtual line along which the moving body 1 moves, as shown by the arrow A1 in FIG. 7, for example. As an example, the change of the virtual line may be performed by performing movement control with a point on the virtual line to which the moving object 1 is to move and which is located a predetermined distance ahead of the current position of the moving object 1 as the target position. The change of the virtual line may be performed by moving in a direction perpendicular to the virtual line. Also, during the movement along the second virtual line 6b, after the obstacle 8 that would be an obstacle in the movement along the first virtual line 6a is no longer detected, that is, after the obstacle 8 has been avoided, the movement control unit 17 may control the movement mechanism 16 so that the moving object 1 moves along the first virtual line 6a. In this case, as an example, the virtual line to be moved may be changed as shown by the arrow A2 in FIG. 7. The change of the virtual line may also be performed by moving in a direction perpendicular to the virtual line. In this case, the moving object 1 moves preferentially along the first virtual line 6a, and moves along the second virtual line 6b only when it is necessary to avoid the obstacle.

[0029] On the other hand, the movement control unit 17 may change the virtual line along which the moving body 1 moves only when an obstacle is detected by the obstacle detection unit 15, for example. In this case, when an obstacle is detected while the moving body 1 is moving along the first virtual line 6a, the movement control unit 17 may change the virtual line along which the moving body 1 moves and perform movement control so as to move along the second virtual line 6b, and thereafter, the movement along the second virtual line 6b may be continued until a new obstacle is detected. Also, when an obstacle is detected while the moving body 1 is moving along the second virtual line 6b, the movement control unit 17 may change the virtual line along which the moving body 1 moves and perform movement control so as to move along the first virtual line 6a, and thereafter, the movement along the first virtual line 6a may be continued until a new obstacle is detected.

[0030] In addition, if the obstacle detection unit 15 detects both an obstacle that will hinder movement along the first virtual line and an obstacle that will hinder movement along the second virtual line, the obstacle cannot be avoided by changing the virtual line, so the movement control unit 17 may, for example, stop the moving body 1 and notify the manager of the moving body 1 that movement is not possible due to the obstacle.

[0031] In addition, when a marker is detected by the detection unit 14, the movement control unit 17 may control the movement mechanism 16 so that the moving body 1 stops at a virtual stop line that is in a predetermined positional relationship with the detected marker. In this case, as an example, the movement mechanism 16 may be controlled so that the moving body 1 stops at a virtual stop line that is in a predetermined positional relationship with the marker. For example, when the parameters are as shown in FIG. 4A, as shown in FIG. 8, the virtual stop line 9 may be a line that is a distance L3 away from the center of the marker 3 and extends in a direction perpendicular to the guiding line. As an example, when the distance L3 is a positive value, the virtual stop line 9 may be located forward of the marker 3 in the traveling direction, and when the distance L3 is a negative value, the virtual stop line 9 may be located on the near side of the marker 3 in the traveling direction, i.e., on the rear side. In the latter case, the distance between the marker 3 and the virtual stop line 9 may be a distance equal to the absolute value of the distance L3. As an example, stopping at the imaginary stop line may be stopping the moving body 1 so that the front end of the moving body 1 is on the imaginary stop line 9, as in the moving body 1 shown by the dashed line in FIG.

[0032] Also, the stop at the virtual stop line may be, for example, a temporary stop, or a long-term stop, for example, a stop when the destination is reached. Also, as an example, if the orientation of the marker 3 coincides with the traveling direction of the moving body 1, the moving body 1 stops according to the marker 3, and if not, the moving body 1 does not need to stop according to the marker 3. In this case, it is preferable that the orientation of the marker is also specified. Note that, when the moving body 1 stops beyond the position of the marker 3 as shown in FIG. 8, the marker 3 will not be included in the planar image at the time when the moving body 1 stops. Therefore, for example, the movement control unit 17 may specify the position of the virtual stop line 9 in the local coordinate system of the moving body 1 according to the marker 3 detected in the planar image, update the position of the specified virtual stop line 9 in the local coordinate system according to the movement of the moving body 1, and control the movement mechanism 16 so that the moving body 1 stops when the position of the virtual stop line 9 becomes a predetermined position. For example, when the mounting position of a camera that captures an image on the moving body 1 and the angle of view of the camera are known, the movement control unit 17 can specify the position of the marker 3 in the local coordinate system of the moving body 1 by using the position of the detected marker 3 in the planar image. Therefore, the movement control unit 17 can specify the position of the virtual stop line 9 in the local coordinate system by using the position of the marker 3 in the local coordinate system. For example, the movement control unit 17 may update the position of the virtual stop line 9 using a movement direction and a movement distance according to a movement instruction, or may use a movement direction and a movement distance according to the amount of rotation of the wheels acquired by an encoder of the movement mechanism 16 or the like.

[0033] In addition, the storage unit 11 may store a set of parameters similar to the set of parameters shown in FIG. 4A for each guide line along which the moving body 1 moves. Then, when starting movement according to a certain guide line, the movement control unit 17 may read out the first and second distances L1 and L2 included in the set of parameters corresponding to that guide line from the storage unit 11, and perform movement control so that the moving body 1 moves along a first or second virtual line that is separated from the detected guide line by the first or second distance L1 or L2. In addition, when a marker is detected in the planar image, the movement control unit 17 may read out the third distance L3 included in the set of parameters from the storage unit 11, and perform movement control so that the moving body 1 stops at a virtual stop line that is separated from the detected marker by the distance L3. In addition, after the stop, the movement control unit 17 may read out the travel angle θ after stopping included in the set of parameters from the storage unit 11, and start movement according to the next guide line after rotating the travel direction by the travel angle θ in the local coordinate system. In addition, in the movement according to the next guiding line, movement control may be performed using a set of parameters corresponding to the next guiding line stored in the storage unit 11. Therefore, when the movement according to the last set of parameters stored in the storage unit 11 is completed, the moving body 1 may be considered to have reached the destination. The multiple sets of parameters stored in the storage unit 11 may be considered to be, for example, information instructing the movement of the moving body 1. In addition, when the moving body 1 can move in any direction, the movement control unit 17 may start moving according to the next guiding line in the direction of the travel angle θ without rotating the travel direction after stopping according to the detected marker, for example. In addition, the set of parameters may also include parameters other than those shown in FIG. 4A. For example, the set of parameters may include a parameter indicating the stop time when the moving body 1 stops at the virtual stop line, and the movement control unit 17 may perform movement control so that the moving body 1 stops for the time of the parameter indicating the stop time.

[0034] Next, the operation of the moving object 1 will be described with reference to the flowchart of FIG. (Step S101) The image acquisition unit 12 judges whether or not to acquire a photographed image. If the photographed image is to be acquired, the process proceeds to step S102. If not, the process of step S101 is repeated until it is determined that the photographed image is to be acquired. The image acquisition unit 12 may, for example, periodically determine that the photographed image is to be acquired.

[0035] (Step S102) The image acquisition unit 12 acquires a captured image. The image acquisition unit 12 may acquire the captured image by, for example, photographing an image, or may acquire the captured image by receiving a photographed image. The captured image may be stored in a recording medium (not shown) or the like.

[0036] (Step S103) The image conversion unit 13 converts the captured image into a planar image. The image conversion unit 13 may convert all captured images into planar images, or may convert some captured images into planar images. This is because, when captured images are captured frequently, it is not necessary to convert all captured images into planar images. The planar image may be stored in a recording medium (not shown) or the like.

[0037] (Step S104) The detection unit 14 performs a thinning process on the planar image. This thinning process may be performed after the planar image is converted into a grayscale image as described above.

[0038] (Step S105) The detection unit 14 detects guiding lines in the planar image after the thinning process.

[0039] (Step S106) The obstacle detection unit 15 judges whether or not an obstacle that will be an impediment to movement along the first virtual line has been detected. If an obstacle has been detected, the process proceeds to step S107, and if not, the process proceeds to step S108.

[0040] (Step S107) The movement control unit 17 sets the virtual line along which the moving object 1 moves as the second virtual line. Note that if this setting has already been performed, it is not necessary to perform the setting again.

[0041] (Step S108) The movement control unit 17 sets the virtual line along which the moving object 1 moves as the first virtual line. Note that if this setting has already been performed, it is not necessary to perform the setting again.

[0042] (Step S109) The movement control unit 17 judges whether or not a virtual stop line is set. If a virtual stop line is set, the process proceeds to step S113, and if not, the process proceeds to step S110.

[0043] (Step S110) The detection unit 15 detects markers on the guiding line detected in step S105 in a planar image that has not been subjected to thinning processing.

[0044] (Step S111) The movement control unit 17 judges whether or not a marker has been detected in step S110. If a marker has been detected, the process proceeds to step S112, and if not, the process proceeds to step S113.

[0045] (Step S112) The movement control unit 17 sets a virtual stop line that has a predetermined positional relationship with the marker. This setting may be, for example, setting of the virtual stop line in the local coordinate system of the moving object 1.

[0046] (Step S113) The movement control unit 17 controls the movement mechanism 16 so that the moving body 1 moves along the virtual line. For example, when the virtual line along which the moving body 1 moves is set to the first virtual line, the movement control unit 17 may perform movement control so that the moving body 1 moves along the first virtual line. In this case, for example, when the moving body 1 is not currently on the first virtual line, the movement control unit 17 may perform movement control so that the moving body 1 moves to the first virtual line. Also, for example, when the virtual line along which the moving body 1 moves is set to the second virtual line, the movement control unit 17 may perform movement control so that the moving body 1 moves along the second virtual line. In this case, for example, when the moving body 1 is not currently on the second virtual line, the movement control unit 17 may perform movement control so that the moving body 1 moves to the second virtual line. Also, for example, when a virtual stop line is set, the movement control unit 17 may perform control so that the moving body 1 stops at the position of the virtual stop line. The movement control unit 17 may update the position of the virtual stop line in the local coordinate system of the moving body 1 according to the movement of the moving body 1, for example. The movement control unit 17 may also perform movement control such that, after stopping the moving body 1 at the virtual stop line, the moving body 1 starts moving in the direction of the travel angle after stopping. Then, the process returns to step S101. By repeatedly performing the movement control in step S113, the moving body 1 can perform the desired movement.

[0047] Note that the order of the processes in the flowchart of Fig. 9 is an example, and the order of the steps may be changed as long as the same results can be obtained. In addition, in the flowchart of Fig. 9, the process ends when the power is turned off or an interrupt is issued to end the process.

[0048] Next, the operation of the moving body 1 according to this embodiment will be described using a specific example. In this specific example, a set of parameters corresponding to one movement shown in FIG. 4A and a plurality of sets of parameters corresponding to subsequent movements are stored in the storage unit 11. The moving body 1 moves along a guide line 5 in a factory shown in FIG. 3A. The movement control unit 17 sequentially reads out sets of parameters corresponding to each guide line from the departure point to the destination stored in the storage unit 11 to control the movement.

[0049] When the moving object 1 starts moving, first, the image acquisition unit 12 acquires a photographed image and passes the acquired photographed image to the image conversion unit 13 (steps S101 and S102). The photographed image is assumed to be, for example, the one shown in FIG. 5. Upon receiving the photographed image, the image conversion unit 13 converts the photographed image into a planar image viewed from above and passes it to the detection unit 14 and the obstacle detection unit 15 (step S103). The planar image is, for example, the one shown in FIG. 6.

[0050] When the planar image is received, the detection unit 14 performs a thinning process on the planar image, detects guiding lines in the planar image that has been subjected to the thinning process, and passes the detection results of the guiding lines to the obstacle detection unit 15 and the movement control unit 17 (steps S104 and S105). In FIG. 6, there are two guiding lines 5 extending in the traveling direction, but the detection result of the left guiding line 5 that is located closer to the center in the left-right direction of the planar image may be passed to the obstacle detection unit 15, etc. When the detection result of the guiding lines is received, the obstacle detection unit 15 reads out the first distance L1 included in the set of parameters corresponding to the guiding line currently moving from the storage unit 11, and uses the first distance L1 to identify a first virtual line that is separated from the detected guiding line by the first distance L1, and uses the planar image received from the image conversion unit 13 to determine whether an obstacle exists on the first virtual line (step S106). In this case, it is assumed that no obstacle exists. Then, the movement control unit 17 sets the virtual line along which the moving object 1 moves as the first virtual line (step S108).

[0051] Furthermore, since the movement control unit 17 has not set a virtual stop line in the local coordinate system of the moving object 1, the movement control unit 17 sends an instruction to the detection unit 14 to detect a marker (step S109). Upon receiving the instruction, the detection unit 14 detects a marker present on the detected guiding line in the planar image received from the image conversion unit 13 (step S110). More specifically, the detection unit 14 identifies the position of the marker in the planar image and sends the identification result to the movement control unit 17. In the case of the planar image shown in FIG. 6, the position of the marker 3 present on the guiding line 5 is sent to the movement control unit 17.

[0052] Thereafter, the movement control unit 17 judges whether the marker is detected (step S111). For example, the movement control unit 17 may judge that the marker is detected when the position of the detected marker in the planar image is received from the detection unit 14, and may judge that the marker is not detected when the position of the marker is not received. In the case of the planar image shown in FIG. 6, the marker 3 is detected, so the movement control unit 17 reads out the third distance L3 included in the set of parameters corresponding to the currently moving guide line from the storage unit 11, and sets a virtual stop line in a predetermined positional relationship with the marker in the local coordinate system using the third distance L3 (step S112). Note that the position of this virtual stop line in the local coordinate system is updated as appropriate according to the movement of the moving object 1.

[0053] Further, the movement control unit 17 uses the detection result of the guiding line received in advance to control the movement mechanism 16 so that the moving body 1 moves along a virtual line parallel to the guiding line. Here, since the virtual line along which the moving body 1 moves is set as the first virtual line, the movement control unit 17 reads out the first distance L1 included in the set of parameters corresponding to the guiding line along which the moving body 1 is currently moving from the storage unit 11, and uses the first distance L1 to identify a first virtual line that is separated from the detected guiding line by the first distance L1, and controls the movement mechanism 16 so that the moving body 1 moves along the first virtual line (step S113). Furthermore, when the moving body 1 reaches the virtual stop line, the movement control unit 17 performs movement control to stop the moving body 1. After the stop, the movement control unit 17 may read out the travel angle θ after the stop included in the set of parameters corresponding to the guiding line along which the moving body 1 is currently moving from the storage unit 11, and perform movement control to start moving in the direction of the angle. The new movement control may be performed using the next parameter set of the parameter set used up to the stop position, that is, the parameter set corresponding to the new guiding line. Furthermore, if an obstacle is detected during movement along the first virtual line (step S106), settings for movement along a second virtual line are performed (step S107), and movement control may be performed so that the moving body 1 moves along the second virtual line (step S113). By repeatedly performing such movement control each time a photographed image is acquired, the moving body 1 moves to the destination according to multiple sets of parameters stored in the storage unit 11.

[0054] As described above, according to the moving body 1 of this embodiment, since the moving body 1 can move using the guiding line, it is not necessarily required to have a configuration for acquiring the self-position. Also, when moving using the guiding line, the detected obstacle can be avoided by switching the moving virtual line. In this way, by avoiding the obstacle using the virtual line, the moving range of the moving body 1 when avoiding the obstacle can be limited, and the moving body 1 can be prevented from performing unexpected operations when avoiding the obstacle. Also, since the moving body 1 of this embodiment can set the position of the virtual line parallel to the guiding line by a parameter, the moving body 1 does not necessarily have to move on the guiding line. For example, even if a division line or the like provided near an object in a factory is used as the guiding line, the moving body 1 can be made to move to a position slightly away from the object. Also, the first and second distances can be changed for each guiding line. For example, the first and second distances can be set to large values ​​for the guiding line provided near the object, and the first and second distances can be set to small values ​​for the guiding line provided away from the object.

[0055] Also, when an obstacle is detected while the moving body 1 is moving along the first virtual line, movement control is performed so that the moving body 1 moves along the second virtual line, and after avoiding the obstacle, movement control is performed so that the moving body 1 moves again along the first virtual line, so that the moving body 1 moves preferentially along the first virtual line. Also, by changing the virtual line along which the moving body 1 moves only when an obstacle is detected, the number of times the virtual line is changed can be reduced, and efficient movement can be achieved.

[0056] Furthermore, when a marker is detected in a planar image, movement control is performed so that the moving body 1 stops in a predetermined positional relationship with the detected marker, thereby making it possible to stop the moving body 1 using the marker. Therefore, by arranging the marker on the guiding line, it becomes possible to stop the moving body 1 at a desired position.

[0057] In the present embodiment, the case where the multiple markers arranged on the guiding line are all the same has been mainly described, but this is not necessarily the case. Different types of markers may be arranged on the guiding line. The different types of markers may be distinguishable from one another by, for example, color, shape, pattern, or the like. In this case, for example, the stop time may be determined for each type of marker, and the third distance may be determined for each type of marker. When the stop time is determined for each type of marker, the movement control unit 17 may perform movement control so that the vehicle stops for the stop time corresponding to the type of marker when stopping according to the marker detected in the planar image. Also, when the third distance is determined for each type of marker, the movement control unit 17 may specify the position of the virtual stop line according to the third distance corresponding to the type of marker when stopping according to the marker detected in the planar image. In this case, the set of parameters stored in the storage unit 11 may not include the third distance.

[0058] In addition, in this embodiment, when the movement control unit 17 performs movement control so as to change the virtual line along which the moving body 1 moves only when an obstacle is detected, the obstacle detection unit 15 may acquire the detection frequency of an obstacle per unit time or per unit distance for each of the two virtual lines. The unit time may be, for example, one minute or ten minutes. The unit distance may be, for example, 10 meters or 100 meters. The obstacle detection unit 15 may acquire, for example, the detection frequency of an obstacle during movement along the first virtual line and the detection frequency of an obstacle during movement along the second virtual line. Then, the movement control unit 17 may control the movement mechanism 16 so that the moving body 1 moves along a virtual line with a lower obstacle detection frequency at the start of movement. For example, if the second virtual line has a lower obstacle detection frequency, the movement control unit 17 may first perform movement control so that the moving body 1 moves along the second virtual line when starting movement. In this way, the number of times an obstacle is detected during movement along a virtual line can be reduced, and as a result, the number of times the virtual line is changed can be reduced, thereby realizing more efficient movement. The acquisition of the detection frequency and the movement control using the detection frequency may be performed, for example, for each guide line, that is, for each set of parameters. For example, the obstacle detection unit 15 may record at least one of the moving distance for each virtual line and the moving time for each virtual line, and the number of times an obstacle is detected for each virtual line, and calculate the detection frequency of an obstacle per unit time or per unit distance using them. Also, for example, the movement control unit 17 may perform movement control so as to move along one of the first and second virtual lines using the detection frequency of an obstacle corresponding to the guide line when starting movement according to the guide line after a temporary stop according to the detected marker.

[0059] Furthermore, even if the moving body 1 stops in response to a detected marker, if the marker is not detected appropriately, the moving body may continue moving more than necessary. Therefore, in order to improve safety, an upper limit distance for one movement may be set. In this case, the movement control unit 17 may be configured not to perform continuous movement beyond the set upper limit distance. In this way, even if the marker is overlooked, the moving body 1 will stop at a position at least the set distance away.

[0060] In addition, in the present embodiment, the case where the stop control is performed according to the detected marker has been mainly described, but this is not necessarily the case. In this case, the marker may not be placed on the guiding line. When the marker is not placed on the guiding line, the moving body 1 may further include a distance acquisition unit 18 as shown in FIG. 1B. The distance acquisition unit 18 acquires the moving distance of the moving body 1. The distance acquisition unit 18 may acquire the moving distance according to the amount of rotation of the wheels acquired by, for example, an encoder of the moving mechanism 16. Then, the moving control unit 17 may use the moving distance acquired by the distance acquisition unit 18 to control the moving mechanism so that the moving body 1 stops when the moving distance according to the guiding line, that is, the moving distance along the virtual line, becomes a predetermined value. In this case, for example, as shown in FIG. 3B, the marker may not be placed on the guiding line 5. In addition, the fourth distance L4, which is the moving distance in the movement according to the guiding line 5a in FIG. 3B, may be included in the set of parameters used when moving according to the guiding line 5a, as shown in FIG. 4B. In this case, for example, when the moving body 1 moves according to the guiding line 5a, the moving body 1 stops when the moving distance reaches the fourth distance L4. As shown in FIG. 3B, the fourth distance L4 may be, for example, the distance in the longitudinal direction of the guiding line 5a. In this case, for example, when the moving body 1 moves from the lower end to the upper end of the guiding line 5a in FIG. 3B, the moving body 1 stops at the position of the upper end of the guiding line 5a. In addition, in this case, the distance acquisition unit 18 may acquire, for example, the moving distance in the longitudinal direction of the guiding line. In this way, the moving distance acquired can be the same whether or not the virtual line is changed during the movement according to the guiding line. In this case, FIG. 4B is a set of parameters corresponding to one movement, and a similar set of parameters may be stored in the storage unit 11 for each guiding line. In FIG. 4B, the parameters other than the fourth distance are the same as the set of parameters in FIG. 4A, and the description thereof will be omitted. Further, the movement control unit 17 may perform movement control so that the moving object 1 stops at a branch point of the guide line, for example.In this case, for example, a set of parameters used in the movement between branch points of the guiding line may be stored in the storage unit 11 in the order of the movement of the moving object 1.

[0061] In addition, in the present embodiment, the case where the guiding line is a straight line has been mainly described, but the guiding line may be a curved line. For example, the curved guiding line may be a curved guiding line with a constant curvature. In this case, the detection unit 14 can also detect the curved guiding line with a constant curvature by, for example, the Hough transform.

[0062] In addition, when detecting guiding lines using a Hough transform, the result of the Hough transform may be unstable. In order to avoid such a situation, a process for stabilizing the result may be performed. The process for stabilizing the result of the Hough transform may be, for example, filtering using a Kalman filter or the like, or may be weighted addition for removing outliers or reducing the influence of the outliers.

[0063] Also, the first distance and the second distance in the set of parameters may be determined randomly within a predetermined range, for example, each time a movement corresponding to the set of parameters is performed. In this way, even when the moving body 1 moves according to the same guiding line, the moving body 1 moves along a random virtual line each time. When the moving body 1 moves along the same route every time, ruts may be formed on the floor surface, but by performing such random movement, the formation of such ruts can be reduced.

[0064] In addition, when a planar image includes a plurality of guiding lines, guiding lines other than the one currently being used for the movement of the moving body 1 may be detected, and the moving body 1 may move in accordance with a different guiding line by mistake when moving in accordance with a certain guiding line. In order to avoid such inappropriate movement, the detection object 14 may detect guiding lines only in the vicinity of the guiding line currently being used for the movement.

[0065] Furthermore, when the moving body 1 is capable of moving in multiple directions, such as an omnidirectional dolly, the image acquisition unit 12 may be able to acquire captured images of the area ahead in each of the multiple moving directions. In this case, for example, the moving body 1 may be provided with a camera for capturing captured images in each of the multiple directions. The image acquisition unit 12 may then acquire captured images of the area ahead in the moving direction according to the current moving direction.

[0066] In addition, in the above embodiments, each process or function may be realized by centralized processing in a single device or a single system, or may be realized by distributed processing in multiple devices or multiple systems.

[0067] In the above embodiment, each component may be configured by dedicated hardware, or a component that can be realized by software may be realized by executing a program. For example, each component may be realized by a program execution unit such as a CPU reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory. During execution, the program execution unit may execute the program while accessing a storage unit or a recording medium. The program may be executed by being downloaded from a server or the like, or may be executed by reading a program recorded on a predetermined recording medium (for example, an optical disk, a magnetic disk, a semiconductor memory, etc.). The program may be used as a program constituting a program product. The computer that executes the program may be single or multiple. That is, centralized processing may be performed, or distributed processing may be performed.

[0068] The above-mentioned embodiments are merely examples for specifically implementing the present invention, and are not intended to limit the technical scope of the present invention. The technical scope of the present invention is indicated by the claims, not by the description of the embodiments, and is intended to include modifications within the literal scope of the claims and the scope of equivalent meanings. [Explanation of symbols]

[0069] REFERENCE SIGNS LIST 1 moving object, 3 marker, 5, 5a guiding line, 6a first virtual line, 6b second virtual line, 8 obstacle, 11 memory unit, 12 image acquisition unit, 13 image conversion unit, 14 detection unit, 15 obstacle detection unit, 16 movement mechanism, 17 movement control unit, 18 distance acquisition unit

Claims

1. A moving object that moves using visually recognizable guiding lines provided on a floor surface, an image acquisition unit that acquires a captured image of a scene ahead of the moving object; an image conversion unit that converts the captured image into a planar image viewed from above; A detection unit that detects a guiding line in the planar image; A moving mechanism that moves the moving body; a movement control unit that controls the movement mechanism so that the moving body moves along one of two virtual lines that are parallel to the guiding line detected by the detection unit and are separated from the guiding line by a first distance and a second distance, respectively; an obstacle detection unit that detects an obstacle ahead of the moving object, The movement control unit changes a virtual line along which the moving body moves when an obstacle is detected by the obstacle detection unit.

2. the two virtual lines include a first virtual line and a second virtual line; 2. The moving body according to claim 1, wherein the movement control unit controls the movement mechanism so that the moving body moves along the second virtual line when an obstacle is detected while the moving body is moving along the first virtual line, and controls the movement mechanism so that the moving body moves along the first virtual line after avoiding the obstacle.

3. The moving body according to claim 1 , wherein the movement control unit changes the virtual line along which the moving body moves only when an obstacle is detected by the obstacle detection unit.

4. the obstacle detection unit obtains an obstacle detection frequency per unit time or per unit distance for each of the two virtual lines; The moving body according to claim 3 , wherein the movement control unit controls the moving mechanism so that, at the start of movement, the moving body moves along a virtual line along which the obstacle is less frequently detected.

5. The detection unit also detects a marker arranged on the guiding line detected in the planar image, 5. The moving body according to claim 1, wherein the movement control unit controls the moving mechanism so that, when the marker is detected, the moving body stops so as to be in a predetermined positional relationship with the detected marker.

6. A distance acquisition unit that acquires a travel distance of the moving object, 5. The moving body according to claim 1, wherein the movement control unit uses the movement distance acquired by the distance acquisition unit to control the movement mechanism so that the moving body stops when the movement distance according to the guide line reaches a predetermined value.

Citation Information

Patent Citations

  • Control system and control method of automatic guided vehicle

    JP2021047671A