Robot management system and position recovery method
The robot management system addresses the challenge of position recovery for autonomous mobile robots by employing a camera and guidance system to utilize marker codes, enabling accurate navigation and expanding operational range within predetermined areas.
Patent Information
- Application Number
- PCT/JP2024/015934
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-31
- Filing Date
- 2024-04-23
- Publication Date
- 2024-12-05
AI Technical Summary
Autonomous mobile robots face challenges in recovering their position and direction when RFID tags are not available, leading to difficulties in maintaining accurate navigation within predetermined areas.
A robot management system equipped with a camera, positioning system, and guidance system that uses markers with codes to facilitate position recovery by guiding the robot to a predetermined position and acquiring recovery position and direction information from the marker codes.
Enables autonomous mobile robots to effectively recover from position loss states to position recognition states by using markers with associated recovery information, improving navigation accuracy and expanding the operational range within predetermined areas.
Smart Images

Figure JP2024015934_05122024_PF_FP_ABST
Abstract
Description
Robot management system and position recovery method
[0001] The present disclosure relates to a robot management system and a position recovery method, and more particularly to a robot management system and a position recovery method for an autonomous mobile robot.
[0002] Patent Document 1 describes a robot position control device that, when an autonomous mobile robot loses its position, reads position information from surrounding RFID tags to restore the position of the autonomous mobile robot.
[0003] In the robot position control device of Patent Document 1, if there is no RFID tag in the vicinity (if the robot is located in a place where radio waves from an RFID tag cannot reach), it is difficult to restore the position.
[0004] Japanese Patent Application Laid-Open No. 2007-249735
[0005] An object of the present disclosure is to provide a robot management system and a position recovery method that can facilitate position recovery of an autonomous mobile robot.
[0006] A robot management system according to one aspect of the present disclosure includes an autonomous mobile robot equipped with a camera, a positioning system, and a guidance system including a memory unit. The autonomous mobile robot moves autonomously while recognizing its own position and direction within a predetermined area. The positioning system measures the position of the autonomous mobile robot within the predetermined area. A marker with a code attached is provided at a predetermined position within the predetermined area. Recovery position information and recovery direction information correspond to the code. The recovery position information and recovery direction information are information for the autonomous mobile robot to recover from a position-lost state to a position-aware state. The position-lost state is a state in which the autonomous mobile robot at least misrecognizes its own position, and the position-aware state is a state in which the autonomous mobile robot recognizes its own position and direction. The memory unit stores marker position information indicating the predetermined position, and when the guidance system determines that the autonomous mobile robot is in the position-lost state, it guides the autonomous mobile robot toward the predetermined position based on the marker position information and the positioning results obtained by the positioning system. The autonomous mobile robot includes a position recovery unit that, after being guided by the guidance system, recovers the autonomous mobile robot from the position loss state to the position recognition state by acquiring the recovery position information and the recovery direction information corresponding to the codes attached to the markers included in the captured image based on the captured image taken by the camera.
[0007] A position recovery method according to one aspect of the present disclosure is a position recovery method for an autonomous mobile robot equipped with a camera recovering from a position loss state to a position-aware state. The autonomous mobile robot autonomously moves while recognizing its own position and direction within a predetermined area. The position loss state is a state in which the autonomous mobile robot at least misrecognizes its own position, and the position-aware state is a state in which the autonomous mobile robot recognizes its own position and direction. A marker with a code attached is provided at a predetermined position within the predetermined area. The code is associated with recovery position information and recovery direction information for recovering the autonomous mobile robot from the position loss state to the position-aware state. The position recovery method includes a guiding step and a position recovery step for the marker. In the guiding step, if it is determined that the autonomous mobile robot is in the position loss state, the autonomous mobile robot is guided toward the predetermined position based on marker position information indicating the predetermined position and a positioning result related to the positioning of the autonomous mobile robot. In the position recovery step, after guidance by the guidance step, the autonomous mobile robot is recovered from the position loss state to the position recognition state by obtaining the recovery position information and the recovery direction information corresponding to the code attached to the marker included in the captured image based on the captured image taken by the camera.
[0008] FIG. 1 is a conceptual diagram of a robot management system according to an embodiment of the present disclosure. FIG. 2 is a block diagram of the robot management system. FIG. 3 is a flowchart illustrating part of the processing of an autonomous mobile robot constituting the robot management system. FIG. 4 is a flowchart illustrating another part of the processing. FIG. 5 is a flowchart illustrating a position recovery processing included in the processing. FIG. 6 is a flowchart illustrating processing of a guidance system constituting the robot management system. FIG. 7A is a perspective view illustrating an adjustment operation of the autonomous mobile robot, and FIG. 7B is a top view showing a state in which the autonomous mobile robot is at a return position and facing the return direction as a result of the adjustment operation.
[0009] (1) Overview In this embodiment, a position recovery method that can facilitate recovery of an autonomous mobile robot 1 from a position loss state to a position recognition state, and the robot management system 100 that realizes such a position recovery method, are described in a robot management system 100 that includes an autonomous mobile robot 1 equipped with an onboard camera 11 and a positioning system 20 including a surveillance camera 3, as shown in FIGS. 1 and 2 .
[0010] The position loss state is a state in which the autonomous mobile robot 1 at least misrecognizes its own position. In the position loss state, the autonomous mobile robot 1 often also misrecognizes its own direction, but it may also recognize its own direction and misrecognize only its own position. The position recognition state is a state in which the autonomous mobile robot 1 recognizes its own position and its own direction.
[0011] (1-1) Autonomous Mobile Robot The autonomous mobile robot 1 moves autonomously while recognizing its own position and direction within a predetermined area (for example, area A1 shown in FIG. 1; hereinafter, this may be simply referred to as "area A1") (i.e., in a position-aware state).
[0012] Note that area A1 is usually indoors, but may also be an outdoor area or a facility that includes both indoor and outdoor areas.
[0013] (1-2) Positioning System The positioning system 20 measures the position of the autonomous mobile robot 1 within the area A1. The positioning system 20 in this embodiment measures the position using an image (monitoring image) from the monitoring camera 3.
[0014] (1-3) Marker and Code In this embodiment, a marker M1 is provided at a predetermined position (hereinafter, sometimes referred to as the "marker position") within the area A1. A code C1 is attached to the marker M1. The code C1 is associated with recovery position information and recovery direction information. The recovery position information and recovery direction information are information for the autonomous mobile robot 1 to recover from a position loss state to a position recognition state.
[0015] The recovery position information is information indicating the position of the autonomous mobile robot 1 itself (for example, the recovery position Ps shown in Figures 7A and 7B: described below) when the autonomous mobile robot 1 reads the code C1 attached to the marker M1 based on the image captured by the onboard camera 11, and the recovery direction information is information indicating the direction of the autonomous mobile robot 1 when reading the code C1 (for example, the recovery direction Dr shown in Figure 7B: described below).
[0016] (1-4) Guidance System The robot management system 100 further includes a guidance system 30. The guidance system 30 includes a storage unit 22. The storage unit 22 stores marker position information indicating the above-mentioned predetermined positions (marker positions).
[0017] (1-5) Position Recovery Unit The autonomous mobile robot 1 includes a position recovery unit 121. The position recovery unit 121 mainly cooperates with the guidance system 30 to realize a position recovery method using the marker M1.
[0018] (1-6) Position recovery method The position recovery method using the marker M1 includes steps S21 to S27 (guidance step) shown in FIG. 6 and step S11 shown in FIG. 4 (S111 to S117 shown in FIG. 5: position recovery step).
[0019] (1-6-1) Guidance Step In the guidance steps (S21 to S27), when the guidance system 30 determines that the autonomous mobile robot 1 has lost its position, it performs a process (guidance process) to guide the autonomous mobile robot 1 toward the marker position based on the marker position information and the positioning results from the positioning system 20.
[0020] In this embodiment, the autonomous mobile robot 1 itself determines whether or not it has lost its position. If the autonomous mobile robot 1 determines that it has lost its position, it transmits a loss signal indicating that it has lost its position to the guidance system 30. In response to receiving the loss signal from the autonomous mobile robot 1, the guidance system 30 performs guidance processing.
[0021] However, the determination of whether the autonomous mobile robot 1 is in a position loss state may be made by, for example, the guidance system 30 (see modified example).
[0022] (1-6-2) Position recovery step In the position recovery step (S11, S111 to S117), the position recovery unit 121 performs a process (position recovery process) to recover the autonomous mobile robot 1 from a position loss state to a position recognition state by acquiring recovery position information and recovery direction information corresponding to the code attached to the marker M1 based on the image captured by the camera 11 after guidance by the guidance system 30.
[0023] (1-7) Advantages of the Robot Management System and Position Recovery Method As described above, in the robot management system and position recovery method of this embodiment, when the autonomous mobile robot 1 loses its position, the guidance system 30 guides the autonomous mobile robot 1 toward a predetermined position (marker position) where the marker M1 is located. After being guided to the marker position, the autonomous mobile robot 1 reads the code C1 attached to the marker M1 to obtain recovery position information and recovery direction information, thereby easily recovering its position.
[0024] (2) Implementation Means The robot management system 100 and position recovery method described above are implemented using, for example, an autonomous mobile robot 1, a server 2, a surveillance camera 3, a communication device 4, and a plurality of markers M1, as shown in Fig. 1. In other words, this embodiment aims to implement the robot management system 100 and position recovery method while utilizing existing equipment such as the surveillance camera 3 and the communication device 4.
[0025] 1, the server 2 is provided outside the area A1 and is communicably connected to the surveillance camera 3 via a wired LAN or the like. However, the server 2 may be provided within the area A1, or may communicate with the surveillance camera 3 wirelessly.
[0026] The server 2 is capable of wireless communication via the communication device 4 with the autonomous mobile robot 1 that moves autonomously within the area A1.
[0027] The server 2 cooperates with the surveillance camera 3 to realize the functions of a positioning system 20. The server 2 also cooperates with a communication unit 15 (described later) of the autonomous mobile robot 1 to realize the functions of a guidance system 30.
[0028] (2-2) Surveillance Camera and Communication Device The surveillance camera 3 and communication device 4 are each installed within a predetermined area A1. The positions of the surveillance camera 3 and communication device 4 within the area A1 are known, and the position information of the surveillance camera 3 and the communication device 4 is stored in, for example, the storage unit 22 of the server 2.
[0029] The surveillance camera 3 in this embodiment is a stereo camera, similar to the onboard camera 11, and is capable of positioning using parallax. However, the surveillance camera 3 may be each of a plurality of monocular cameras arranged within the area A1, in which case positioning based on the parallax between a plurality of surveillance images corresponding to the plurality of monocular cameras is possible.
[0030] The surveillance camera 3 may be a camera with a lower resolution and a lower frame rate than the onboard camera 11. In other words, the resolution of the positioning results of the positioning system 20 (position information based on the surveillance image of the surveillance camera 3) may be lower than the resolution of the position information based on the image captured by the onboard camera 11 (self-position information and self-direction information for the autonomous movement of the autonomous mobile robot 1).
[0031] The communication device 4 is, for example, a repeater that relays wireless signals (radio waves) sent and received between the autonomous mobile robot 1 and the server 2, or a wireless LAN access point that allows each of the autonomous mobile robot 1 and the server 2 to connect to a wireless LAN.
[0032] In this embodiment, positioning by the positioning system 20 is performed based on the surveillance image from the surveillance camera 3, but in addition to or instead of this, positioning may be performed based on the received signal strength of the wireless signal transmitted and received between the autonomous mobile robot 1 and the communication device 4. In this case, the communication device 4 measures the received signal strength of the wireless signal from the autonomous mobile robot 1 and outputs the measurement result to the positioning system 20. The positioning system 20 may perform positioning based on the measurement result from the communication device 4, or based on the surveillance image from the surveillance camera 3 and the measurement result from the communication device 4.
[0033] (2-3) On-board camera As shown in Fig. 2, the autonomous mobile robot 1 is equipped with an on-board camera 11. As shown in Figs. 1, 7A and 7B, the on-board camera 11 is fixed to the head of the autonomous mobile robot 1 so that its optical axis faces the front (forward) of the autonomous mobile robot 1. Therefore, the on-board camera 11 captures an image within a predetermined angle of view centered on the front of the autonomous mobile robot 1 (i.e., the optical axis of the on-board camera 11).
[0034] The onboard camera 11 of this embodiment is a stereo camera having two lenses arranged on the left and right, and is capable of distance measurement using the parallax between two captured images corresponding to the two lenses. In this case, the optical axis of the onboard camera 11 (the optical axis of the entire stereo camera) is a straight line that passes through the midpoint between the two center points corresponding to the two lenses and is parallel to each of the two optical axes corresponding to the two lenses. For example, as shown in Figures 7A and 7B, when the onboard camera 11 is facing the marker M1, a straight line along the recovery direction Dr corresponds to the optical axis of the onboard camera 11.
[0035] In this embodiment, the term "facing directly" preferably refers to facing directly in the left-right and up-down directions, but it is sufficient to face directly in at least the left-right direction. In other words, when performing the return process, the mounted camera 11 only needs to face the marker M1 directly in the left-right direction, and does not need to face the marker M1 directly in the up-down direction.
[0036] (2-4) Autonomous movement using an onboard camera The autonomous mobile robot 1 moves autonomously to a destination based at least on, for example, an image captured by the onboard camera 11, its own position information and its own direction information, map information corresponding to a specified area A1, and position information (destination information) corresponding to the destination.
[0037] The map information includes route information relating to a route within a predetermined area A1, a plurality of pieces of position image information (a set of pairs of position information and surrounding images) corresponding to a plurality of points along the route, and the like.
[0038] (2-5) Self-Location Information and Self-Orientation Information Self-location information and self-orientation information are acquired based on the captured image captured by the onboard camera 11 and map information (particularly position image information). That is, the autonomous mobile robot 1 detects its own position and its own orientation based on the captured image captured by the onboard camera 11 and the position image information, etc., and acquires self-location information and self-orientation information. Note that, when detecting its own position and its own orientation, for example, the positioning results obtained by the positioning system 20 using the monitoring images from the monitoring camera 3 may also be used. The positioning results obtained by the positioning system 20 using the monitoring images from the monitoring camera 3 have relatively lower resolution than the position information based on the captured image from the onboard camera 11, but are position information covering a wider range.
[0039] (2-6) Multiple Markers The multiple markers M1 are arranged at different positions within the area A1. Note that the marker M1 described in the overview corresponds to each of the multiple markers M1. The predetermined position (marker position) described above is any one of multiple predetermined positions (marker positions) corresponding to the multiple markers M1. Furthermore, the marker position information described above is any one of multiple pieces of marker position information corresponding to the multiple markers M1.
[0040] The guidance system 30 guides the position-lost autonomous mobile robot 1 toward one of a plurality of predetermined positions that is closest to the autonomous mobile robot 1. As a result, the position-lost autonomous mobile robot 1 is guided to the nearest marker M1 of the plurality of markers M1. The nearest marker M1 is the marker M1 that is closest to the autonomous mobile robot 1 among the plurality of markers M1.
[0041] In this way, by guiding the autonomous mobile robot 1 toward the nearest marker M1 among the multiple markers M1, it is possible to shorten the guidance time by the guidance system 30. It is also possible to expand the range in which the autonomous mobile robot 1 can move autonomously (particularly, the range in which it can recover even if it loses its position).
[0042] (2-7) QR Code (registered trademark: the same applies hereinafter) and Adjustment Image In this embodiment, the code C1 described above is a QR code (hereinafter referred to as "QR code C1").
[0043] Each of the plurality of markers M1 (hereinafter simply referred to as "marker M1") is provided with a QR code C1 and an adjustment image Fi, as shown in Fig. 1. The adjustment image Fi will be described later.
[0044] Attaching the QR code C1 and the adjustment image Fi (hereinafter referred to as "QR code C1, etc.") to the marker M1 can be done, for example, by printing or engraving the QR code C1, etc. directly onto the marker M1, or by attaching a sheet on which the QR code C1, etc. is printed to the marker M1.
[0045] The marker M1 is, for example, a rectangular thin plate as shown in Fig. 1. The QR code C1 and the like are attached to one main surface (front surface) of the marker M1. The marker M1 is placed at a predetermined position (marker position) within a predetermined area A1 so that the front surface is perpendicular to the floor surface and the normal from the front surface faces the recovery direction Dr.
[0046] Alternatively, the marker M1 may be attached to an appropriate location within the area A1 (for example, the outer wall of a specific building, etc.), and the position of the attached marker M1 may be defined as a predetermined position (marker position), and the direction opposite to the normal from the surface of the marker M1 may be defined as the recovery direction Dr.
[0047] The recovery position Ps is a position that is a predetermined distance dC away from the center of the marker M1 (code C1) thus positioned or attached along the normal direction from the surface of the marker M1 (the direction opposite to the recovery direction Dr).
[0048] The marker M1 is preferably provided so that the height from the floor of the QR code C1 and the like attached to the marker M1 is the same as the height from the floor of the onboard camera 11 of the autonomous mobile robot 1. However, the height of the marker M1 may be different from the height of the onboard camera 11 as long as it is possible to capture an image of the marker M1 with the onboard camera 11, and thus to perform an adjustment operation based on the adjustment image Fi in the captured image, and to read the QR code C1 in the captured image.
[0049] (3) Details As shown in FIG. 2 , the robot management system 100 includes an autonomous mobile robot 1, a positioning system 20, and a guidance system 30.
[0050] (3-1) Autonomous Mobile Robot As shown in FIG. 2, the autonomous mobile robot 1 includes an onboard camera 11, a processing unit 12, a storage unit 13, a driving unit 14, and a communication unit 15.
[0051] (3-1-1) Processing Unit The processing unit 12 performs various types of processing. The various types of processing are, for example, processing by the position recovery unit 121 (position recovery processing) described below. The various types of processing also include processing such as detecting the position and direction of the autonomous mobile robot 1 based on images captured by the onboard camera 11 (position and direction detection processing), and controlling the driving unit 14 based on the detection results of the position and direction detection processing (self-position information and self-direction information). Furthermore, the processing unit 12 also performs various judgments described in the flowcharts.
[0052] (3-1-2) Storage Unit The storage unit 13 stores various types of information. The various types of information include, for example, self-position information and self-direction information. The self-position information and self-direction information are usually the detection results of the position / direction detection process. In other words, the processing unit 12 detects the position and direction of the autonomous mobile robot 1, and the storage unit 13 stores the self-position information indicating the position detected by the processing unit 12 and the self-direction information indicating the direction detected by the processing unit 12.
[0053] However, the self-position information and self-direction information stored in the storage unit 13 can be updated with the results of reading the QR code C1 included in the captured image (restoration position information and restoration direction information).
[0054] The storage unit 13 also stores, for example, captured images, map information, destination information, route information, and the like.
[0055] (3-1-3) Driving Unit The driving unit 14 includes, for example, a battery, a pair of motors, left and right wheels, etc. Under the control of the processing unit 12, the driving unit 14 supplies power from the battery to each of the pair of motors and independently drives the left and right wheels, thereby realizing the autonomous movement of the autonomous mobile robot 1.
[0056] (3-1-4) Communication Unit The communication unit 15 performs wireless communication with the communication unit 23 on the server 2 side via the communication device 4 .
[0057] (3-1-5) Position Restoration Unit The processing unit 12 includes a position restoration unit 121. The position restoration unit 121 performs position restoration processing after guidance by the guidance system 30.
[0058] (3-1-5a) Position Restoration Processing The position restoration processing is a processing for restoring the autonomous mobile robot 1 from a position loss state to a position recognition state.
[0059] The position recovery process is a process for recovering the autonomous mobile robot 1 from a position-lost state to a position-recognized state by, for example, acquiring recovery position information and recovery direction information associated with the QR code C1 attached to the marker M1 included in the captured image based on the captured image taken by the onboard camera 11. Acquiring the recovery position information and recovery direction information means, for example, reading the recovery position information and recovery direction information embedded in the QR code C1.
[0060] Alternatively, identification information for identifying the marker M1 may be embedded in the QR code C1 (for example, a barcode or other code), and a set of pairs of the identification information, recovery position information, and recovery direction information may be stored in the storage unit 22 of the server 2. In this case, acquiring the recovery position information and recovery direction information means reading the identification information embedded in the QR code C1 and acquiring, from the storage unit 22, the recovery position information and recovery direction information stored in association with the read identification information.
[0061] (3-1-5b) Adjustment Operation After being guided by the guidance system 30, the position recovery unit 121 causes the autonomous mobile robot 1 to perform an adjustment operation based on the captured image taken by the onboard camera 11. The adjustment operation is an operation in which the autonomous mobile robot 1 adjusts at least one of its own position and orientation so that the QR code C1 attached to the marker M1 included in the captured image can be read. In this way, the autonomous mobile robot 1 adjusts its position and orientation using the captured image by the onboard camera 11, thereby making it possible to read the QR code C1 included in the captured image.
[0062] The adjustment operation in this embodiment is an operation of adjusting the position and direction of the autonomous mobile robot 1 via the drive unit 14 so that the autonomous mobile robot 1 faces the recovery direction Dr corresponding to the recovery direction information at the recovery position Ps corresponding to the recovery position information. However, if the autonomous mobile robot 1 is already at the recovery position Ps corresponding to the recovery position information and facing the recovery direction Dr corresponding to the recovery direction information immediately after being guided by the guidance system 30, there is no need to perform the adjustment operation.
[0063] Based on the image captured by the onboard camera 11, the position recovery unit 121 adjusts at least one of the position and direction of the autonomous mobile robot 1 via the drive unit 14 so that the autonomous mobile robot 1 faces the recovery direction Dr corresponding to the recovery direction information at the recovery position Ps corresponding to the recovery position information.
[0064] This makes it possible to improve the consistency between the recovery position information and the recovery direction information of the position and direction of the autonomous mobile robot 1. In other words, it becomes possible to achieve or improve the degree of consistency between the position and direction of the autonomous mobile robot 1 and the recovery position Ps and recovery direction Dr corresponding to the recovery position information and the recovery direction information.
[0065] (3-1-5c) Adjustment Image The position recovery unit 121 causes the autonomous mobile robot 1 to perform an adjustment operation using the adjustment image Fi included in the captured image taken by the onboard camera 11. The adjustment image Fi is an image for causing the autonomous mobile robot 1 to perform the adjustment operation.
[0066] The adjustment images Fi are, for example, a pair of images FiL and FiR as shown in Fig. 7A. The pair of images FiL and FiR are arranged on the surface of the marker MI at positions symmetrical to each other with the QR code C1 in between. Each of the pair of images FiL and FiR has a square shape of the same size.
[0067] Note that the symmetrical positions do not necessarily have to be completely symmetrical, but may be any positions that can be considered to be symmetrical. For example, if the difference between the distance from the QR code C1 to one of the pair of images FiL and FiR (e.g., image FiL) and the distance from the QR code C1 to the other of the pair of images FiL and FiR (e.g., image FiR) is equal to or less than a threshold, the positions may be considered to be symmetrical.
[0068] However, the shape of each of the pair of images FiL and FiR may be, for example, a circle, an ellipse, a polygon other than a rectangle, or the like, and the type of shape is not important. Furthermore, in this embodiment, since it is sufficient to measure the distances dL and dR from the mounted camera 11 to each of the pair of images FiL and FiR, the pair of images FiL and FiR may have different shapes and may be different sizes.
[0069] The distance from the mounted camera 11 to the image FiL is the distance from the midpoint between the two center points corresponding to the two lenses to the center point of the image FiL (the same applies to the distance from the mounted camera 11 to the image FiR and the distance from the mounted camera 11 to the QR code C1).
[0070] The recovery position Ps is the position of the autonomous mobile robot 1 immediately after the position recovery unit 121 has performed the position recovery process. The recovery direction Dr is the direction of the autonomous mobile robot 1 immediately after the position recovery unit 121 has performed the position recovery process.
[0071] In this way, the captured image includes a pair of images FiL and FiR that are positioned symmetrically on either side of the QR code C1, which makes it possible to further facilitate the adjustment operation. Note that although the adjustment operation can be performed based on the QR code C1 included in the captured image, the use of a pair of images FiL and FiR that have a larger left-right distance apart than the QR code C1 makes it possible to facilitate the adjustment operation.
[0072] (3-1-6) Specific Method of Acquiring Recovery Position Information and Recovery Direction Information In this embodiment, the onboard camera 11 outputs a video. The captured image described above is one of a plurality of still images that constitute the video output from the onboard camera 11. The position recovery unit 121 sequentially determines whether or not the plurality of still images satisfy a predetermined condition, and acquires recovery position information and recovery direction information based on the still image corresponding to the point in time when it is determined that the predetermined condition is satisfied.
[0073] (3-1-7) Predetermined Conditions The predetermined conditions are conditions related to the positional relationship between the camera 11 and the marker M1. In this way, by reading the QR code C1 using a still image that satisfies the predetermined conditions based on the video from the camera 11, it is possible to improve the consistency of the position and direction of the autonomous mobile robot 1 with the recovery position information and recovery direction information.
[0074] (3-1-7a) Facing Condition The predetermined conditions include a facing condition, which is a condition that the camera 11 faces the QR code C1 attached to the marker M1.
[0075] The position recovery unit 121 determines that, among the multiple still images that make up the video, i.e., the multiple still images that are sequentially output from the mounted camera 11, the still image that corresponds to the point in time when the distances dL and dR (see Figure 7A) from the mounted camera 11 to each of the pair of images FiL and FiR attached to the marker M1 are equal (dL = dR) satisfies the facing condition.
[0076] In this embodiment, the on-board camera 11 is a stereo camera, and distances dL and dR from the on-board camera 11 to each of a pair of images FiL and FiR of the surface of the marker M1 are calculated based on the parallax between two captured images corresponding to the two lenses. Then, a still image for which the calculated two distances dL and dR match each other is determined to satisfy the facing condition.
[0077] In this way, by using a still image that satisfies the facing condition from among the multiple still images that make up the video, it is possible to improve the consistency of the direction of the autonomous mobile robot 1 with the recovery direction information.
[0078] (3-1-7b) Distance Condition The predetermined conditions further include a distance condition, which is a condition that the autonomous mobile robot 1 (mounted camera 11) is located at a predetermined distance dC from the QR code C1 attached to the marker M1.
[0079] The predetermined distance dC is the distance between the autonomous mobile robot 1 (mounted camera 11) and the QR code C1 attached to the marker M1 immediately after the position recovery unit 121 performs the position recovery process, as shown in Figures 7A and 7B.
[0080] The distance between the autonomous mobile robot 1 (mounted camera 11) and the QR code C1 attached to the marker M1 is the distance between the position indicated by the self-position information (self-position) and the position indicated by the marker position information (marker position), and the distance between the self-position and the marker position is calculated based on the self-position information and the marker position information.
[0081] For still images that are determined to satisfy the facing conditions, the position recovery unit 121 calculates the distance from the autonomous mobile robot 1 (mounted camera 11) to the QR code C1 attached to the marker M1 based on at least one of the distances dL and dR from the autonomous mobile robot 1 (mounted camera 11) to each of the pair of images FiL and FiR attached to the marker M1.
[0082] The distances dL and dR from the mounted camera 11 to each of the pair of images FiL and FiR attached to the marker M1 can be calculated, for example, based on the distance between the two lenses that make up the mounted camera 11, which is a stereo camera, and the parallax between the two captured images corresponding to the two lenses.
[0083] Furthermore, the distance from the autonomous mobile robot 1 (mounted camera 11) to the QR code C1 attached to the marker M1 can be calculated, for example, based on the angle formed between the direction from the midpoint between the two center points corresponding to the two lenses (in the example of Figures 7A and 7B, the point corresponding to the recovery position Ps) toward one of the images FiL and FiR (e.g., image FiL) and the direction of the optical axis of the mounted camera 11, and the distance dL from the midpoint (Ps) to the image FiL. Note that the direction toward image FiL is the direction toward the center point of image FiL (the same applies to the direction toward image FiR and the direction toward QR code C1).
[0084] Then, if the difference between the calculated distance (the distance from the mounted camera 11 to the QR code C1) and the distance between the specified position (marker position) indicated by the marker position information and the recovery position Ps indicated by the recovery position information is less than or equal to a threshold value, the position recovery unit 121 determines that the distance condition is further satisfied (the mounted camera 11 is located at a specified distance dC away from the QR code C1).
[0085] In this way, by using a still image that satisfies the facing condition and distance condition, it is possible to improve the consistency of the position of the autonomous mobile robot 1 with the recovery position information.
[0086] 2, the positioning system 20 includes a server 2 and a monitoring camera 3. The guidance system 30 includes the server 2 and a communication unit 15.
[0087] (3-2-1) Server The server 2 includes a processing unit 21, a storage unit 22, and a communication unit 23.
[0088] The storage unit 22 stores various types of information. The various types of information include, for example, recovery position information and recovery direction information. The various types of information also include map information. Note that the map information stored in the storage unit 22 on the server 2 side does not need to be the same as the map information stored in the storage unit 13 of the autonomous mobile robot 1, and for example, it does not need to include position image information.
[0089] The communication unit 23 performs wireless communication with the communication unit 15 on the autonomous mobile robot 1 side via the communication device 4 .
[0090] The processing unit 21 performs various types of processing, such as positioning processing and guidance processing.
[0091] (3-2-1a) Positioning Process The processing unit 21 performs positioning process based on the monitoring images from the monitoring camera 3. The positioning process is a process for determining the position of the autonomous mobile robot 1. The monitoring camera 3, which is a stereo camera, outputs two captured images corresponding to the two lenses. The processing unit 21 performs positioning process using the parallax between the two captured images from the monitoring camera 3, and acquires position information of the autonomous mobile robot 1.
[0092] The processing unit 21 outputs the position information thus acquired to the guidance system 30. In this way, the function of the positioning system 20 described above is realized.
[0093] (3-2-1b) Guidance Processing Furthermore, when the autonomous mobile robot 1 loses its own position, the processing unit 21 performs guidance processing via the communication unit 23 and the communication unit 15 on the autonomous mobile robot 1 side.
[0094] The guidance process is a process of guiding the autonomous mobile robot 1 that has lost its position toward the marker M1 (particularly the nearest marker).
[0095] When the communication unit 23 receives a loss signal from the autonomous mobile robot 1, the processing unit 21 identifies, from among the multiple pieces of marker position information corresponding to the multiple markers M1, marker position information that is closest to the position information from the positioning system 20, and generates a guidance signal to the marker position indicated by the identified marker position information. The processing unit 21 then transmits the generated guidance signal to the autonomous mobile robot 1 via the communication unit 23. In the autonomous mobile robot 1, the communication unit 15 receives the guidance signal, and the processing unit 12 realizes movement based on the guidance signal via the drive unit 14.
[0096] Furthermore, when the processing unit 21 determines, based on the position information and marker position information from the positioning system 20, that the autonomous mobile robot 1 is not approaching the marker M1 (for example, moving away from the marker M1), it transmits a direction correction instruction (for example, an instruction to reverse the movement direction) to the autonomous mobile robot 1 via the communication unit 23. In the autonomous mobile robot 1, the communication unit 15 receives the direction correction instruction, and the processing unit 12 corrects the movement direction (for example, performs an operation to reverse the movement direction) via the drive unit 14.
[0097] Furthermore, when it is determined that the autonomous mobile robot 1 has reached the vicinity of the marker M1 based on the position information and marker position information from the positioning system 20, the processing unit 21 transmits a position recovery instruction to the autonomous mobile robot 1 via the communication unit 23. In the autonomous mobile robot 1, the communication unit 15 receives the position recovery instruction, and the position recovery unit 121 performs position recovery using the marker M1. This realizes the function of the guidance system 30.
[0098] (4) Operation Example The autonomous mobile robot 1 operates according to the flowcharts of Figures 3 and 4. The processes of Figures 3 and 4 are started in response to the activation of the robot management system 100 and are ended in response to the halting of operation.
[0099] 3 and 4, first, the processing unit 12 acquires an image (captured image) from the onboard camera 11 (step S1). Note that a moving image is output from the onboard camera 11, and in step S1, one of a plurality of still images constituting the moving image is acquired sequentially.
[0100] Next, the processing unit 12 detects the position and direction of the autonomous mobile robot 1 (position and direction detection process) (step S2) based on the captured image acquired in step S1 and the map information (position image information) stored in the storage unit 13. Next, the processing unit 12 updates the self-position information and self-direction information stored in the storage unit 13 based on the detection results of step S2 (step S3).
[0101] Next, the processing unit 12 determines whether or not the autonomous mobile robot 1 has lost its position (step S4) based on the self-position information and self-direction information stored in the memory unit 13 and the map information stored in the memory unit 13. If it is determined that the autonomous mobile robot 1 has not lost its position (No in step S4), the processing proceeds to step S12.
[0102] If it is determined in step S4 that the autonomous mobile robot 1 has lost its position (Yes), the processing unit 12 transmits a loss signal to the guidance system 30 (server 2) via the communication unit 15 (step S5).
[0103] Next, the processing unit 12 determines whether the communication unit 15 has received a guidance signal (step S6). If it is determined that the communication unit 15 has not received a guidance signal (No in step S6), the processing proceeds to step S8.
[0104] If it is determined in step S6 that the communication unit 15 has received the guidance signal (Yes), the processing unit 12 realizes movement based on the guidance signal via the drive unit 14 (step S7). Then, the processing returns to step S6.
[0105] If it is determined in step S6 that the communication unit 15 has not received a guidance signal (No), the processing unit 12 determines whether the communication unit 15 has received a direction correction instruction (step S8). If it is determined that the communication unit 15 has not received a direction correction instruction (No in step S8), the processing proceeds to step S10.
[0106] If it is determined in step S8 that the communication unit 15 has received the direction correction instruction (Yes), the processing unit 12 corrects the direction via the drive unit 14 (step S9). As a result, the movement direction of the autonomous mobile robot 1 is corrected (flipped) to, for example, the opposite direction. Thereafter, the processing returns to step S6.
[0107] If it is determined in step S8 that the communication unit 15 has not received a direction correction instruction (No), the processing unit 12 determines whether the communication unit 15 has received a position recovery instruction (step S10). If it is determined that the communication unit 15 has not received a position recovery instruction (No in step S10), the processing returns to step S6.
[0108] If it is determined in step S10 that the communication unit 15 has received the position recovery instruction (Yes), the position recovery unit 121 performs position recovery (position recovery processing) using the marker M1 (step S11). The position recovery processing will be described later. Then, the processing proceeds to step S12.
[0109] In step S12, the processing unit 12 performs autonomous movement via the driving unit 14 based on the self-position information and self-direction information stored in the storage unit 13, and the map information stored in the storage unit 13. Thereafter, the processing returns to step S6.
[0110] The position recovery process in step S11 is executed, for example, according to the flowchart of FIG.
[0111] First, the position recovery unit 121 acquires an image (captured image) from the onboard camera 11 (step S111). In step S111, one of a plurality of still images constituting the video output from the onboard camera 11 is sequentially acquired.
[0112] Next, the position recovery unit 121 determines whether or not the captured image acquired in step S111 (hereinafter, sometimes simply referred to as the "captured image") includes a pair of images FiL and FiR (presence or absence of a pair of images FiL and FiR) (step S112). If it is determined that the pair of images FiL and FiR does not exist (No in step S112), the process proceeds to step S115.
[0113] If it is determined in step S112 that a pair of images FiL and FiR exists (Yes), the position recovery unit 121 determines whether the captured image satisfies the facing condition based on the pair of images FiL and FiR (step S113).If it is determined that the captured image does not satisfy the facing condition (No in step S113), the process proceeds to step S115.
[0114] If it is determined in step S113 that the captured image satisfies the facing condition (Yes), the position recovery unit 121 determines whether the captured image satisfies the distance condition (step S114). If it is determined that the captured image does not satisfy the distance condition (No in step S114), the process proceeds to step S115. If it is determined that the captured image satisfies the distance condition (Yes in step S114), the process proceeds to step S116.
[0115] In step S115, the position recovery unit 121 adjusts at least one of the position and direction via the drive unit 14. This adjusts at least one of the position of the autonomous mobile robot 1 to approach the recovery position Ps and the direction of the autonomous mobile robot 1 to approach the recovery direction Dr. Then, the process returns to step S111.
[0116] If it is determined in step S114 that the captured image satisfies the distance condition (Yes), the position recovery unit 121 reads the QR code C1 using the captured image (step S116). This reads the recovery position information and recovery direction information associated with the QR code C1. At this time, the autonomous mobile robot 1 is facing the recovery direction Dr at the recovery position Ps.
[0117] Next, the position recovery unit 121 updates the self-position information and self-orientation information stored in the memory unit 13 based on the results of the readout in step S116 (step S117). In this way, the self-position information and self-orientation information are updated to recovery position information and recovery direction information, and as a result, the position and orientation of the autonomous mobile robot 1 become consistent with the recovery position information and recovery direction information. This allows the position of the autonomous mobile robot 1 to be recovered. Thereafter, the process returns to the upper-level flowchart (see FIGS. 3 and 4).
[0118] The guidance system 30 (server 2) operates according to the flowchart of Fig. 6. The process of Fig. 6 starts when the robot management system 100 is started and ends when the operation is stopped. In the flowchart of Fig. 6, it is assumed that the positioning results of the positioning system 20 are output to the guidance system 30 as needed.
[0119] First, the guidance system 30 determines (step S21) whether or not the communication unit 23 has received a loss signal from the autonomous mobile robot 1. If it is determined that the communication unit 23 has not received a loss signal from the autonomous mobile robot 1 (No in step S21), the processing returns to step S21.
[0120] If it is determined in step S21 that the communication unit 23 has received a loss signal from the autonomous mobile robot 1 (Yes), the guidance system 30 identifies the marker M1 from the multiple markers M1 that is closest to the autonomous mobile robot 1 (step S22). In detail, the guidance system 30 identifies, from the multiple pieces of marker position information corresponding to the multiple markers M1, the marker position information that is closest to the position information from the positioning system, and sets the marker M1 corresponding to the identified marker position information as the nearest marker M1.
[0121] Next, the guidance system 30 generates a guidance signal to the nearest marker M1 (hereinafter, sometimes simply referred to as "marker M1") identified in step S22, and transmits the generated guidance signal to the autonomous mobile robot 1 (step S23).
[0122] Next, the guidance system 30 determines whether the autonomous mobile robot 1 has approached the marker M1 based on the positioning result from the positioning system 20 and the marker position information corresponding to the marker M1 (step S24). If it is determined that the autonomous mobile robot 1 has not approached the marker M1 (No in step S24), the guidance system 30 transmits a direction change instruction to the autonomous mobile robot 1 (step S25). Then, the process returns to step S23.
[0123] If it is determined in step S24 that the autonomous mobile robot 1 has approached the marker M1 (Yes), the guidance system 30 determines whether the autonomous mobile robot 1 has reached the vicinity of the marker M1 (step S26).If it is determined that the autonomous mobile robot 1 has not reached the vicinity of the marker M1 (No in step S26), the process returns to step S23.
[0124] If it is determined in step S26 that the autonomous mobile robot 1 has reached the vicinity of the marker M1 (Yes), the guidance system 30 transmits a position recovery instruction to the autonomous mobile robot 1 (step S27). Thereafter, the process returns to step S21.
[0125] (5) Modification In this modification, the number of markers M1 placed in the area A1 may be 1. When the number of markers M1 is 1, step S22 is omitted in the flowchart of FIG.
[0126] The QR code C1 attached to the marker M1 is not limited to a QR code, and may be, for example, a barcode or other code. The code C1 may be any image (such as a uniquely identifiable design) that is unique within the area A1, and may be, for example, a road sign or a corporate logo attached to a building.
[0127] The marker M1 is, for example, a landmark such as a specific structure (such as a building) or a specific natural object (such as a tree), and the unique shape of the landmark may function as the code C1 included in the captured image.
[0128] The onboard camera 11 may be rotatably attached to the head or another part of the autonomous mobile robot 1. For example, the onboard camera 11 may be capable of capturing images of the front, back, left, and right of the autonomous mobile robot 1 when the autonomous mobile robot 1 is stopped. In this case, too, when the autonomous mobile robot 1 performs an adjustment operation, it is preferable to fix the optical axis of the onboard camera 11 so that it faces forward (front) of the autonomous mobile robot 1 in order to facilitate the adjustment operation. However, as long as the onboard camera 11 faces the marker M1 directly, the main body of the autonomous mobile robot 1 does not necessarily have to face the marker M1 directly.
[0129] The onboard camera 11 is not limited to a stereo camera, and may be a monocular camera having a single lens. In this case, the pair of images FiL and FiR are located symmetrically on either side of the QR code C1 and have congruent shapes. That is, the pair of images FiL and FiR have a common shape and a common size. The type of common shape does not matter. For example, if the sizes of the pair of images FiL and FiR are equal (congruent) in a captured image, the captured image may be determined to satisfy the facing condition. Furthermore, if the size of one of the pair of images FiL and FiR (e.g., image FiL) is a predetermined size in a captured image determined to satisfy the facing condition, the captured image may also be determined to satisfy the distance condition.
[0130] The autonomous mobile robot 1 may further include a beacon transmitter, and the communication device 4 may further include a scanner function that receives an identification signal (radio wave) from the beacon transmitter (alternatively, the positioning system 20 may include a scanner instead of the monitoring camera 3, or the monitoring camera 3 may further include a scanner function). In this case, the positioning system 20 may receive the identification signal (radio wave) from the beacon transmitter included in the autonomous mobile robot 1 with the scanner, and perform positioning based on information such as the received signal strength of the received identification signal.
[0131] The determination of whether the autonomous mobile robot 1 is in a position loss state may be made by the guidance system 30 (server 2). In this case, the autonomous mobile robot 1 may transmit its own position information to the guidance system 30 (server 2), and the guidance system 30 (server 2) may determine whether the autonomous mobile robot 1 is in a position loss state based on the own position information from the autonomous mobile robot 1 and the positioning result from the positioning system 20.
[0132] The autonomous mobile robot 1 may have part of the positioning function and guidance function of the server 2. In this case, one of the communication unit 15 on the autonomous mobile robot 1 side and the communication unit 23 on the server 2 side (for example, the communication unit 23) is excluded from the configuration of the autonomous mobile robot 1, and the other (for example, the communication unit 15) performs wireless communication with the surveillance camera 3. Furthermore, by further mounting a group of sensors including motion sensors such as an acceleration sensor and a gyroscope, and a geomagnetic sensor, in addition to the onboard camera 11 on the autonomous mobile robot 1, the autonomous mobile robot 1 may realize more of the positioning function and guidance function of the guidance system 30 without the server 2.
[0133] (6) Summary A robot management system (100) according to a first aspect includes an autonomous mobile robot (1) equipped with a camera (11), a positioning system (20), and a guidance system (30) including a memory unit (22). The autonomous mobile robot (1) moves autonomously while recognizing its own position and direction within a predetermined area (A1). The positioning system (20) determines the position of the autonomous mobile robot (1) within the predetermined area (A1). A marker (M1) bearing a code (C1) is provided at a predetermined position within the predetermined area (A1). The code (C1) is associated with recovery position information and recovery direction information. The recovery position information and recovery direction information are information for the autonomous mobile robot (1) to recover from a position loss state to a position recognition state. The position loss state is a state in which the autonomous mobile robot (1) at least misrecognizes its own position, and the position recognition state is a state in which the autonomous mobile robot (1) recognizes its own position and direction. The storage unit (22) stores marker position information indicating a predetermined position for the marker (M1), and the guidance system (30), when determining that the autonomous mobile robot (1) is in a position-lost state, guides the autonomous mobile robot (1) toward the predetermined position based on the marker position information and the positioning results from the positioning system. The autonomous mobile robot (1) is equipped with a position recovery unit (121). After guidance by the guidance system (30), the position recovery unit (121) recovers the autonomous mobile robot (1) from the position-lost state to a position-recognized state by acquiring, based on an image captured by the camera (11), recovery position information and recovery direction information associated with a code (C1) attached to the marker (M1) included in the captured image.
[0134] According to this aspect, when the autonomous mobile robot (1) loses its position, the guidance system (30) guides the autonomous mobile robot (1) toward the marker (M1), and the autonomous mobile robot (1) reads the code (C1) attached to the marker (M1) to obtain recovery position information and recovery direction information, thereby facilitating the autonomous mobile robot (1) to recover its position.
[0135] In the robot management system (100) according to the second aspect, in the first aspect, the position recovery unit (121) causes the autonomous mobile robot (1) to perform an adjustment operation based on an image captured by the camera (11) so as to be able to read a code (C1) attached to a marker (M1) included in the captured image. The adjustment operation is an operation for adjusting at least one of its own position and its own direction.
[0136] According to this aspect, the autonomous mobile robot (1) adjusts its position and direction using the image captured by the camera (11), thereby making it possible to read the code (C1) based on the image of the code (C1) contained in the captured image.
[0137] In the robot management system (100) according to the third aspect, in the first or second aspect, the position recovery unit (121) causes the autonomous mobile robot (1) to perform an adjustment operation based on an image captured by the camera (11) so that the autonomous mobile robot (1) faces a recovery direction (Dr) corresponding to the recovery direction information at a recovery position (Ps) corresponding to the recovery position information. The adjustment operation is an operation for adjusting at least one of its own position and its own direction.
[0138] According to this aspect, it is possible to improve the consistency of the position and direction of the autonomous mobile robot (1) with the recovery position information and recovery direction information.
[0139] In the robot management system (100) according to the fourth aspect, in the third aspect, an adjustment image (Fi) is further attached to the marker (M1). The adjustment image (Fi) is an image for causing the autonomous mobile robot (1) to perform an adjustment operation. The position recovery unit (121) causes the autonomous mobile robot (1) to perform an adjustment operation based on the captured image taken by the camera (11) using the adjustment image (Fi) included in the captured image.
[0140] According to this aspect, the captured image includes an adjustment image, which makes it possible to facilitate the adjustment operation.
[0141] In the robot management system (100) according to the fifth aspect, in the fourth aspect, the adjustment image (Fi) is a pair of images (FiL and FiR). The pair of images (FiL and FiR) are arranged in symmetrical positions with the code (C1) in between.
[0142] According to this aspect, the captured image includes a pair of images (FiL and FiR) arranged symmetrically on either side of the cord (C1), which makes it possible to further facilitate the adjustment operation.
[0143] In the robot management system (100) according to the sixth aspect, in the fifth aspect, the camera (11) outputs a video. The captured image is one of a plurality of still images that constitute the video. The position recovery unit (121) sequentially determines whether the plurality of still images satisfy a predetermined condition, and acquires recovery position information and recovery direction information based on the still image corresponding to the point in time when it is determined that the predetermined condition is satisfied. The predetermined condition is a condition regarding the positional relationship between the camera (11) and the marker (M1).
[0144] According to this aspect, by reading the code (C1) using a still image that satisfies predetermined conditions based on video from the camera (11), it is possible to improve the consistency of the position and direction of the autonomous mobile robot (1) with the recovery position information and recovery direction information.
[0145] In the robot management system (100) according to the seventh aspect, in the sixth aspect, the predetermined condition includes a facing condition. The facing condition is that the camera (11) faces a code (C1) attached to the marker (M1). The position recovery unit (121) determines that, among the multiple still images, a still image corresponding to a time when the distances (dL and dR) from the camera (11) to the pair of images (FiL and FiR) attached to the marker (M1) are equal (dL = dR) satisfies the facing condition.
[0146] According to this aspect, by using a still image that satisfies the facing condition, it is possible to improve the consistency of the direction of the autonomous mobile robot (1) with the recovery direction information.
[0147] In the robot management system (100) according to the eighth aspect, in the seventh aspect, the predetermined condition further includes a distance condition. The distance condition is a condition that the camera (11) is located a predetermined distance away from the code (C1) attached to the marker (M1). For a still image determined to satisfy the facing condition, the position recovery unit (121) calculates the distance from the camera (11) to the code (C1) attached to the marker (M1) based on at least one of the distances (dL and dR) from the camera (11) to each of the pair of images (FiL and FiR) attached to the marker (M1). Then, the position recovery unit (121) determines that the distance condition is further satisfied when the difference between the calculated distance and the distance between the predetermined position indicated by the marker position information and the recovery position indicated by the recovery position information is equal to or less than a threshold.
[0148] According to this aspect, by using a still image that satisfies the distance condition, it is possible to improve the consistency of the position of the autonomous mobile robot (1) with the recovery position information.
[0149] In a robot management system (100) according to a ninth aspect, in any of the first to eighth aspects, a plurality of markers (M1) are provided within a predetermined area (A1). The marker (M1) is any one of the plurality of markers (M1). The predetermined position is any one of a plurality of predetermined positions corresponding to the plurality of markers (M1). The guidance system (30) guides the autonomous mobile robot (1) in a position-lost state toward the predetermined position closest to the autonomous mobile robot (1) among the plurality of predetermined positions.
[0150] According to this aspect, it is possible to shorten the guidance time by the guidance system (30), and it is also possible to expand the range in which the autonomous mobile robot (1) can move autonomously (particularly, the range in which it can recover even if it loses its position).
[0151] In a robot management system (100) according to a tenth aspect, in any one of the first to ninth aspects, the camera (11) is an on-board camera (11). The positioning system (20) includes at least one of a surveillance camera (3) and a communication device (4). The surveillance camera (3) is installed within a predetermined area (A1). The communication device (4) is installed within the predetermined area and performs at least one of transmission and reception of radio waves between the autonomous mobile robot (1).
[0152] According to this aspect, the positioning system (20) and the guidance system (30) can be realized by utilizing existing facilities.
[0153] A position recovery method according to an eleventh aspect is a position recovery method for an autonomous mobile robot (1) equipped with a camera (11) recovering from a position loss state to a position recognition state. The autonomous mobile robot (1) autonomously moves while recognizing its own position and direction within a predetermined area (A1). The position loss state is a state in which the autonomous mobile robot (1) at least misrecognizes its own position, and the position recognition state is a state in which the autonomous mobile robot (1) recognizes its own position and direction. A marker (M1) bearing a code (C1) is provided at a predetermined position within the predetermined area (A1). The code (C1) is associated with recovery position information and recovery direction information for recovering the autonomous mobile robot (1) from the position loss state to the position recognition state. The position recovery method includes guiding steps (S21 to S27) and position recovery steps (S11, S111 to S117) for the marker (M1). In the guidance steps (S21 to S27), when it is determined that the autonomous mobile robot (1) is in a position loss state, the autonomous mobile robot (1) is guided toward a predetermined position based on marker position information indicating a predetermined position and a positioning result related to the positioning of the autonomous mobile robot (1). In the position recovery steps (S11, S111 to S117), after guidance in the guidance steps (S21 to S27), the autonomous mobile robot (1) is recovered from the position loss state to a position recognition state by acquiring recovery position information and recovery direction information corresponding to a code (C1) attached to a marker (M1) included in the captured image based on an image captured by the camera (11).
[0154] According to this aspect, when the autonomous mobile robot (1) loses its position, the autonomous mobile robot (1) is guided toward the marker (M1), and the autonomous mobile robot (1) reads the code (C1) attached to the marker (M1) to obtain recovery position information and recovery direction information, thereby facilitating the position recovery of the autonomous mobile robot (1).
[0155] 100 Robot management system 1 Autonomous mobile robot 11 On-board camera (camera) 121 Position recovery unit 22 Memory unit 3 Surveillance camera 4 Communication device 20 Positioning system 30 Guidance system M1 Marker C1 Code Fi Adjustment image FiL and FiR Pair of images Dr Recovery direction Ps Recovery position dC Predetermined distance dL and dR Distance to each of the pair of images
Claims
1. An autonomous mobile robot having a camera, which moves autonomously by recognizing its own position and direction within a specified area; a positioning system which measures the position of the autonomous mobile robot within the specified area; and a guidance system which includes a memory unit which stores marker position information indicating the specified position for a marker which is provided at a specified position within the specified area and which is provided with a code corresponding to recovery position information and recovery direction information for recovering from a position loss state in which the autonomous mobile robot at least misrecognizes its own position to a position recognition state in which the autonomous mobile robot recognizes its own position and direction, and which guides the autonomous mobile robot towards the specified position based on the marker position information and the positioning result by the positioning system when it is determined that the autonomous mobile robot is in the position loss state; a position recovery unit that recovers the autonomous mobile robot from the position lost state to the position recognition state by acquiring, after guidance by the guidance system, the recovery position information and the recovery direction information that correspond to the code attached to the marker included in the captured image based on the captured image taken by the camera.
2. A robot management system as described in claim 1, wherein the position recovery unit causes the autonomous mobile robot to perform an adjustment operation to adjust at least one of its own position and its own orientation based on the image captured by the camera so as to enable reading of the code attached to the marker contained in the captured image.
3. A robot management system as described in claim 1 or 2, wherein the position recovery unit causes the autonomous mobile robot to perform an adjustment operation to adjust at least one of its own position and its own orientation based on the image captured by the camera so that the autonomous mobile robot faces a recovery direction corresponding to the recovery orientation information at a recovery position corresponding to the recovery position information.
4. A robot management system as described in claim 3, wherein the marker is further provided with an adjustment image for causing the autonomous mobile robot to perform the adjustment operation, and the position recovery unit causes the autonomous mobile robot to perform the adjustment operation using the adjustment image contained in the captured image based on the image captured by the camera.
5. A robot management system according to claim 4, wherein the adjustment images are a pair of images arranged in symmetrical positions with the cord in between.
6. A robot management system as described in claim 5, wherein the camera outputs a video, the captured image is one of a plurality of still images constituting the video, and the position recovery unit sequentially determines whether the plurality of still images satisfy a predetermined condition regarding the positional relationship between the camera and the marker, and obtains the recovery position information and the recovery direction information based on the still image corresponding to the point in time when it is determined that the predetermined condition is satisfied.
7. A robot management system as described in claim 6, wherein the predetermined conditions include a facing condition that the camera is directly facing the code attached to the marker, and the position recovery unit determines that a still image among the multiple still images corresponding to a point in time when the distance from the camera to each of the pair of images attached to the marker is equidistant satisfies the facing condition.
8. A robot management system as described in claim 7, wherein the specified condition further includes a distance condition that the camera is located at a position a specified distance away from the code affixed to the marker, and the position recovery unit, for a still image determined to satisfy the facing condition, calculates a distance from the camera to the code affixed to the marker based on at least one of the distances from the camera to each of the pair of images affixed to the marker, and judges that the distance condition is further satisfied when a difference between the calculated distance and the distance between the specified position indicated by the marker position information and the recovery position corresponding to the recovery position information is equal to or less than a threshold value.
9. A robot management system as described in any one of claims 1 to 8, wherein a plurality of markers are provided within the specified area, the marker is any one of the plurality of markers, the specified position is any one of a plurality of specified positions corresponding to the plurality of markers, and the guidance system guides the autonomous mobile robot in the position loss state toward a specified position among the plurality of specified positions that is closest to the autonomous mobile robot.
10. A robot management system as claimed in any one of claims 1 to 9, wherein the camera is an on-board camera, and the positioning system includes at least one of a surveillance camera installed within the specified area, and a communication device installed within the specified area for at least one of transmitting and receiving radio waves between the autonomous mobile robot.
11. A position recovery method for recovering an autonomous mobile robot, which is equipped with a camera and moves autonomously by recognizing its own position and direction within a specified area, from a position lost state in which the autonomous mobile robot at least misrecognizes its own position to a position recognized state in which the autonomous mobile robot recognizes its own position and its own direction, comprising: a guiding step of guiding the autonomous mobile robot toward a marker, which is provided at a specified position within the specified area and is provided with a code corresponding to recovery position information and recovery direction information for recovering the autonomous mobile robot from the position lost state to the position recognized state, when it is determined that the autonomous mobile robot is in the position lost state, based on marker position information indicating the specified position and a positioning result related to the positioning of the autonomous mobile robot; and a position recovery step of recovering the autonomous mobile robot from the position lost state to the position recognized state by acquiring, after guidance by the guiding step, the recovery position information and the recovery direction information corresponding to the code attached to the marker included in the captured image, based on an image captured by the camera, to recover the autonomous mobile robot from the position lost state to the position recognized state.
Citation Information
Patent Citations
Robot location controller and robot self-location restoration method
JP2007249735A
Automated carrier guiding system and automated carrier guiding method
JP2020135497A
