MOBILE ROBOT, CONTROL METHOD FOR MOBILE ROBOT, AND CONTROL PROGRAM

By controlling the orientation of a mobile robot's head to match its movement direction and using sensors to predict collisions, the robot ensures safe and secure navigation, addressing unpredictability and fear associated with omnidirectional movement.

JP7595899B2Active Publication Date: 2024-12-09TOKYO ROBOTICS INC

Patent Information

Application Number
JP2020080556
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2020-04-30
Publication Date
2024-12-09
Estimated Expiration
2040-04-30

AI Technical Summary

Technical Problem

Human-collaborative mobile robots with omnidirectional movement mechanisms can cause unpredictability and fear due to unannounced direction changes, leading to potential collisions and discomfort among nearby individuals.

Method used

Equipping the mobile robot with an omnidirectional movable cart and a head that can be controlled to face in the direction of movement or potential collision, using sensors and algorithms to predict and adjust its orientation, and incorporating audio warnings to ensure safe navigation.

Benefits of technology

The solution provides a sense of security to nearby individuals by clearly indicating the robot's movement direction and encouraging evacuation, reducing the likelihood of collisions and psychological discomfort.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007595899000001
    Figure 0007595899000001
  • Figure 0007595899000002
    Figure 0007595899000002
  • Figure 0007595899000003
    Figure 0007595899000003
Patent Text Reader

Abstract

To provide a mobile robot that includes an omnidirectional movement carrier and does not make people around the robot cautious, instead, builds a feeling of safety.SOLUTION: A mobile robot that moves with an omnidirectional movement carrier part includes: a head part installed to a robot body part and including a face part at the front surface; drive means for driving the head part; and a head part control unit for controlling the drive means. The head part control unit controls the drive means to orient the face part in a movement direction when the robot starts moving or a prescribed time before moving.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to, for example, a mobile robot. [Background technology]

[0002] In recent years, robots have been applied to various places, not only factories and warehouses, but also commercial buildings, airports, nursing homes, etc. For example, Patent Document 1 discloses a collaborative mobile robot that autonomously navigates in a work area shared with humans in a factory. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6412179 Summary of the Invention [Problem to be solved by the invention]

[0004] Incidentally, human-collaboration mobile robots often adopt an omnidirectional mobile platform that enables movement in all directions as a mobility mechanism in order to accommodate movement in narrow passages and passing by people, etc. However, since it is difficult to predict the direction of movement of an omnidirectional mobile platform, people nearby may become wary of the robot's movements.

[0005] The present invention has been made to solve the above-mentioned technical problems, and its object is to provide a mobile robot equipped with an omnidirectional mobile cart that gives a sense of security to people nearby without making them feel wary. [Means for solving the problem]

[0006] The above-mentioned technical problems can be solved by a mobile robot or the like having the following configuration.

[0007] In other words, the mobile robot of the present invention is a mobile robot that moves using an omnidirectional mobile carriage, and is equipped with a head with a face facing forward, a drive means for driving the head, and a head control unit for controlling the drive means, and the head control unit has the function of controlling the drive means to face the face in the direction of movement when the mobile robot starts to move or a predetermined time before it starts to move.

[0008] According to such a configuration, the mobile robot turns its face in the direction of movement when it starts to move or a predetermined time before it starts to move, thereby notifying people nearby that it will move and the direction of movement, thereby making it possible to avoid collisions with people due to unannounced movement and to give people a sense of security without making them feel wary of the unannounced movement.

[0009] The head control unit may be configured to orient the face toward a new direction of movement when changing the direction of movement of the mobile robot or a predetermined time before changing the direction of movement.

[0010] According to such a configuration, the mobile robot turns its face toward the new moving direction when it changes its moving direction (course change) or a predetermined time before it changes its course, so that it is possible to avoid collision with a person due to an unannounced course change and to give a sense of security to a person without making him / her feel wary of the unannounced course change.

[0011] The predetermined time may be changed depending on the moving speed of the mobile robot.

[0012] According to such a configuration, a changeable predetermined time can be provided between the timing of driving the head and the timing of starting to move or change course from a stopped position, so that natural head movement can be adjusted according to, for example, the speed of movement, thereby realizing natural head movement.

[0013] The driving means may include a vertical rotation shaft for driving the head to rotate in the left and right direction.

[0014] According to this configuration, by controlling the rotation of the vertical rotation axis, it is possible to realize rotational driving of the head in the left and right directions.

[0015] The robot may further include a movement path setting unit that sets a movement path, a detection unit that detects the position of a person's head, and a collision judgment unit that judges whether or not the mobile robot will collide with the person if it moves along the movement path in a movement direction from a current location within a predetermined distance from the mobile robot, and if the collision judgment unit judges that the mobile robot will collide with the person, the head control unit may turn the face unit toward the person's head.

[0016] According to this configuration, the mobile robot can turn its face toward the head of a person with whom it is predicted that the robot will collide when moving, thereby not only notifying the person of the direction of movement but also encouraging them to take evasive action to avoid a collision.

[0017] The driving means may further include a horizontal rotation shaft for driving the head in an up and down direction.

[0018] With this configuration, by controlling the rotation of the horizontal rotation axis, it is possible to realize head movements such as looking up and down, so that the face can be turned towards the head of a person who is in a higher or lower position than the mobile robot's head.

[0019] The image sensor may further be included, and the detection unit may detect the position of the person's head based on image data detected by the image sensor.

[0020] According to such a configuration, the position of a person's head can be easily detected using various algorithms (software) that analyze image data.

[0021] The vehicle may further include a person identification unit that identifies a person predicted to collide first when the collision determination unit determines that the vehicle will collide with multiple people, and when the collision determination unit determines that the vehicle will collide with multiple people, the head control unit may direct the face unit toward the head of the person identified by the person identification unit.

[0022] With this configuration, even if there are multiple people with whom the mobile robot is predicted to collide when it moves, the people identified in the same order as human behavior principles can be prompted to evacuate sequentially and without any discomfort.

[0023] The robot may further include a movement control unit that controls the movement of the mobile robot, and if an obstacle including a person is detected on the movement path while the robot is moving, the movement control unit may slow down or stop the mobile robot.

[0024] With this configuration, even if the mobile robot encounters a person while moving, it can be urged to retreat safely with plenty of time to spare.

[0025] The device may further include a speaker and an alarm control unit that outputs a predetermined sound using the speaker, and the alarm control unit may output the predetermined sound if the collision determination unit determines that a collision will occur with the person even after a certain time has elapsed after the head control unit turns the face unit toward the person's head.

[0026] According to such a configuration, the speaker can be used to appeal to the human sense of hearing, so that the evacuation can be urged more strongly and clearly.

[0027] It may further comprise one or more arms having a manipulator mechanism.

[0028] With this configuration, it is possible to realize a mobile manipulator that has a function of notifying the user of its upcoming movement and / or a function of prompting the user to retreat.

[0029] The present invention can also be conceived as a method. That is, the method for controlling a mobile robot according to the present invention is a method for controlling a mobile robot that is equipped with a head having a face facing forward and a driving means for driving the head, and that moves by an omnidirectional mobile carriage, and includes a head control step of controlling the driving means, in which the driving means is controlled to face the face in the direction of movement when the mobile robot starts to move or a predetermined time before the start of movement.

[0030] The present invention can also be conceived as a computer program. That is, the control program for a mobile robot according to the present invention is a control program for a mobile robot that has a head with a face facing forward and a drive means for driving the head, and that moves by an omnidirectional mobile carriage, and includes a head control step for controlling the drive means, in which the drive means is controlled to orient the face in the direction of movement when the mobile robot starts to move or a predetermined time before the start of movement. Effect of the Invention

[0031] According to the present invention, a mobile robot equipped with an omnidirectional mobile cart can give nearby people a sense of security without making them feel wary. [Brief description of the drawings]

[0032] [Figure 1] FIG. 1 is a schematic diagram of a mobile robot according to a first embodiment. [Diagram 2] FIG. 2 is a schematic diagram showing the external appearance of the mobile robot of the first embodiment. [Diagram 3] FIG. 3 is a diagram illustrating the head of the mobile robot. [Figure 4] FIG. 4 is a flowchart illustrating the head drive control in the first embodiment. [Diagram 5] FIG. 5 is a diagram illustrating the operation related to the head driving process. [Figure 6] FIG. 6 is a schematic diagram of a mobile robot according to the second embodiment. [Figure 7] FIG. 7 is a flowchart illustrating head drive control in the second embodiment. [Figure 8] FIG. 8 is a diagram for explaining a collision determination processing method. [Figure 9] FIG. 9 is a diagram for explaining the operation related to the human-adaptive head driving process. [Figure 10] FIG. 10 is a diagram for explaining a situation in which the human-adaptive head driving process is executed. [Figure 11] FIG. 11 is a diagram for explaining a situation in which the human-adaptive head driving process is not executed. [Figure 12] FIG. 12 is a flowchart illustrating the details of the movement process according to the second embodiment. [Figure 13] FIG. 13 is a diagram illustrating the collision determination process executed during movement. [Figure 14] FIG. 14 is a diagram illustrating the identification process performed by the person identification unit. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0033] First Embodiment 1 to 3 are diagrams illustrating a configuration example of a mobile robot 100 according to a first embodiment of the present invention. The mobile robot 100 of this embodiment is a robot that is assumed to move within a working area shared with humans, and may be applied, for example, to a mobile manipulator having a function of picking up parts in a factory and transporting them to a predetermined location, or a service robot that guides customers such as travelers in facilities such as an airport. In this embodiment, an example will be described in which the mobile robot 100 is applied to a substantially human-shaped mobile manipulator equipped with a head 30 and an arm 40 having a manipulator mechanism as shown in FIG. 2.

[0034] As shown in FIG. 1, the mobile robot 100 of this embodiment includes a controller 1 that functions as a control device for controlling the operation of the mobile robot 100 , a movement mechanism driving means 2 , and a head driving means 3 .

[0035] The controller 1 of this embodiment has functional units such as a movement path setting unit 11, a movement control unit 12, and a head direction control unit 13. The controller 1 is an information processing device configured by connecting, for example, a central processing unit (CPU) as a processor, a read-only memory (ROM) and a random access memory (RAM) as storage media, an input / output interface (I / O interface), and the like via a bus. In addition, the ROM included in the controller 1 stores a program (control program) for executing each function of each of the above-mentioned functional units. That is, the controller 1 is configured to realize the functions of each of the functional units such as the movement path setting unit 11, the movement control unit 12, and the head direction control unit 13 by executing various programs stored in the storage medium. Note that the above-mentioned configurations of the processor and storage medium constituting the controller 1 are examples, and in addition to or instead of these, a GPU, a flash memory, a hard disk, storage, and the like may be included. In addition, the functions of each of the above-mentioned functional units do not necessarily have to be realized only by the controller 1, and may be realized by a plurality of controllers appropriately selected for each functional unit, individually or in cooperation with each other. The functions of each functional unit of the controller 1 will be described below.

[0036] The movement path setting unit 11 sets a path (movement path) along which the mobile robot 100 is to move. Specifically, the movement path setting unit 11 sets a path generated by so-called path planning, which plans a path from a predetermined position to a destination based on map information (map data) of a working area, as the movement path of the mobile robot 100. The predetermined position here may be a predetermined position that has been determined in advance, or may be the current position of the mobile robot 100. There is no particular limitation on the specific method by which the mobile robot 100 generates a movement path from the predetermined position to the destination, and a known method used in existing mobile robots such as mobile manipulators may be appropriately adopted. However, the movement path to be set does not necessarily have to be generated by the controller 1. The movement path setting unit 11 may set a path to a destination acquired, for example, via wireless communication, as the movement path of the mobile robot 100.

[0037] The movement control unit 12 controls the movement mechanism driving means 2 to move the mobile robot 100 along the movement path set by the movement path setting unit 11. The movement mechanism driving means 2 will be described later with reference to FIG.

[0038] The head direction control unit 13 controls the head driving means 3 to drive the head 30 (see FIG. 2) provided in the mobile robot 100. Specifically, the head direction control unit 13 controls the direction in which the head 30 faces forward via the head driving means 3. Details of the head driving means 3 will be described later with reference to FIG. 2.

[0039] FIG. 2 is a diagram for explaining the configuration of the mobile robot 100, and mainly shows an example of the external appearance of the mobile robot 100. As shown in FIG.

[0040] As shown in the figure, the mobile robot 100 of this embodiment has a roughly humanoid shape and is composed of a robot main body unit 10, a mobile cart 20 that supports the robot main body unit 10, a head unit 30 provided at the upper end of the robot main body unit 10, and arms 40 extending from the front of the robot main body unit 10.

[0041] The mobile cart 20 that supports the robot main body 10 is an omnidirectional mobile cart that has the function of moving on the surface (floor surface) on which the mobile robot 100 is placed. An omnidirectional mobile cart is a cart that is equipped with, for example, multiple omni-wheels as drive wheels and is configured to be able to move in all directions. An omnidirectional mobile cart may also be called an omnidirectional mobile cart, omnidirectional mobile cart, or omnidirectional cart. Also, while an omnidirectional mobile cart has the characteristic of being able to move in all directions 360 degrees and move freely even in narrow passages, it does not determine the direction of movement from the direction in which the drive wheels are facing, as is the case with ordinary carts. Z As a result, it is difficult to predict the direction of movement of the moving cart 20. 20a Inside, three drive wheels 20b And the drive wheel 20band a moving mechanism driving means 2 for driving the moving mechanism via a belt or the like. The moving mechanism driving means 2 in this embodiment is composed of one or more motors, and hereinafter the moving mechanism driving means 2 will also be referred to as the motor 2.

[0042] In the roughly humanoid mobile robot 100, the head 30 may be provided at the upper end of the robot main body 10 as a configuration equivalent to a human head (part above the neck). The head 30 is desirably configured so that its front side can be recognized as a face when viewed by a human. The head 30 is configured so that the direction in which the front faces can be controlled. Specifically, the mobile robot 100 of this embodiment is equipped with one or more head driving means 3 (actuators 3), and is configured so that the direction of the front side can be controlled by moving the head via the head driving means 3. In the following, the front side of the head 30 is referred to as the face 31.

[0043] The mobile robot 100 of this embodiment has a head driving means 3 (servo motor 3a) that has a vertical rotation axis that rotates the head 30 in a horizontal direction (left and right direction) relative to the floor surface and enables the head 30 to be rotated left and right. This allows the mobile robot 100 to rotate only the head 30 left and right relative to the vertical direction. However, the arrangement of the servo motor 3a is not limited to the arrangement shown in the figure, and may be changed as appropriate as long as the orientation of the face 31 can be moved left and right. For example, the servo motor 3a may be provided to rotate the robot main body 10 left and right relative to the moving cart 20. In this case, the servo motor 3a can change the orientation of the face 31 by rotating the head 30 together with the robot main body 10 left and right relative to the vertical direction.

[0044] The mobile robot 100 may also have a head driving means 3 (servo motor 3b) that has a horizontal rotation axis for driving the head 30 in the vertical direction relative to the floor surface and enables the head 30 to look up and down. This allows the mobile robot 100 to move the face 31 in the vertical direction as well.

[0045] FIG. 3 is a diagram for more specifically explaining a configuration example of the head 30 of this embodiment. The shape of the head 30 is not particularly limited as long as the front side can be recognized as the face 31. For example, it is desirable that the face 31 has a structural feature that is visible only in the front part of the head 30 so that the front side can be easily recognized as the face 31. For example, as shown in FIG. 3(a), a configuration corresponding to two eyes imitating a human face is provided only in the front side of the head 30, so that the front side can be easily recognized as the face 31. Also, as shown in FIG. 3(b), a characteristic part (part indicated by a thick arrow) made of, for example, a transparent member or the like is provided in the front side of the head 30, so that the front side can be easily recognized as the face 31. Also, although not shown, in the head 30 having a substantially oval shape, for example, only the front side may be made flat.

[0046] As shown in the figure, the head 30 may be attached to the robot body 10 via a structure (neck) corresponding to a human neck, or may be directly attached to the upper end of the robot body 10. That is, the servo motors 3a and 3b may be attached to the neck or to the head 30. An external environment recognition means (detection means) such as a sensor or a camera for recognizing the surrounding environment of the mobile robot 100 may be provided on the front part of the head 30, for example, the part corresponding to the eyes shown in FIG. 3(a) or the part made of a transparent member shown in FIG. 3(b). The external environment recognition means may be configured as a structure for the mobile robot 100 to travel autonomously and / or as the detection means 4 described later in the second embodiment.

[0047] As shown in Fig. 2, the mobile robot 100 has an arm 40 on the front side of the robot main body 10. The arm 40 has a manipulator mechanism, and a gripping mechanism 41 for gripping an object to be transported is provided at the tip corresponding to the free end. However, the shape, number, and arrangement of the arm 40 are not limited to the embodiment shown in the figure, and may be changed appropriately depending on the purpose. For example, the mobile robot 100 may be configured as a dual-arm robot having arms 40 on both sides of the robot main body 10.

[0048] The above is an example of the configuration of the mobile robot 100 of this embodiment. Note that the mobile robot 100 may also include other components necessary for controlling the operation of the mobile robot 100, such as other actuators for driving the arms 40, a battery serving as a power source, etc., which are omitted in Fig. 2.

[0049] Next, the operation of the mobile robot 100 will be described with reference to FIGS.

[0050] 4 is a flowchart for explaining the head drive control performed by the mobile robot 100 of this embodiment. A control program for executing the processes described below with reference to the illustrated flowchart is stored in a storage medium provided in the controller 1.

[0051] In step S11, the controller 1 executes a task acquisition process. The task acquisition process is a process for acquiring information necessary for the mobile robot 100 to generate a movement path to be set by a movement path setting process (S12) described later. In the task acquisition process, the controller 1 acquires, for example, identification information (part ID) of a part to be picked, location information (e.g., location coordinates) of a destination, and the like. There is no limitation on the acquisition method, and the information may be acquired using a known wireless communication technology, or may be configured to be acquired via information input means (e.g., a touch panel, etc.) not shown.

[0052] In step S12, the controller 1 (movement path setting unit 11) sets a path generated according to information acquired by the task acquisition process as the movement path of the mobile robot 100. For example, when a part ID is acquired by the task acquisition process, the movement path setting unit 11 sets a path from the current location to the destination, which is generated with the location where the part specified by the part ID is placed, as the movement path. Once the movement path to the destination is set, head drive processing is then executed (S13).

[0053] In step S13, the controller 1 (head direction control unit 13) executes a head driving process to control the direction in which the face 31 faces. The head driving process in this step is executed simultaneously when the mobile robot 100 starts moving, or a predetermined time before the start of movement. The predetermined time here may be set appropriately, for example, immediately before the start of movement (for example, within 1 second), or may be set to a relatively long time (for example, 3 seconds or more).

[0054] In the head drive process (S13), the head direction control unit 13 controls the servo motor 3a so that the face 31 faces the moving direction. Then, at the same time that the face 31 starts to face the moving direction, or when the above-mentioned predetermined time has elapsed since the start of the movement, the movement process (S14) is executed.

[0055] Here, the operation of the mobile robot 100 when executing the head driving process will be described with reference to FIG.

[0056] FIG. 5 is a diagram for explaining the operation of the mobile robot 100 when performing the head drive process. This diagram shows the operation of the mobile robot 100 functioning as a mobile manipulator from picking up a part to just before starting to move. FIG. 5(a) shows the mobile robot 100 picking up a part and a person (worker) working next to the mobile robot 100. FIG. 5(b) shows the mobile robot 100 stopping after finishing picking up the part. At this time, the mobile robot 100 may execute a movement path setting process (S12) to set a movement path. The arrow shown is part of the set movement path and indicates the most recent movement direction of the mobile robot 100 (movement direction from the current position).

[0057] Here, if the mobile robot 100 starts moving without performing head drive processing, there is a risk that a worker in the direction of movement will be unable to avoid the mobile robot 100 suddenly moving toward him / her and will be hit by it. Even if a collision is avoided, in a situation where the mobile robot 100 that may suddenly move toward him / her is nearby, he / she will be wary of the next action of the mobile robot 100, and the psychological burden of this may decrease work efficiency. The mobile robot 100 of this embodiment is configured to eliminate such a risk by performing head drive processing to notify nearby people of the next action.

[0058] FIG. 5(c) shows a state in which the mobile robot 100 executes the head drive process and faces the face 31 in the direction of movement. By executing the head drive process, the mobile robot 100 can indicate the direction of movement to nearby people and give advance notice of the upcoming movement. This allows the mobile robot 100 to urge people to retreat from the movement path, thereby avoiding collisions with people. In addition, by letting workers and the like know that the mobile robot 100 faces the face 31 in the direction of movement when or before it starts moving, it is possible to give a sense of security to people in a shared work area without making them feel wary of the robot suddenly moving in their direction.

[0059] If the direction of the face 31 in the stopped state before starting to move matches the moving direction, the mobile robot 100 may start moving without executing the head drive process, but the face 31 may be once moved in any direction, for example, up, down, left, or right, and then turned to face the moving direction. In this way, even if the direction of the face 31 in the stopped state matches the moving direction, the mobile robot 100 can notify people nearby that it will move by moving the head 30. The above is the details of the operation related to the head drive process (S13). Returning to the flowchart of FIG. 4, the explanation will be continued below.

[0060] In step S14, the controller 1 (movement control unit 12) executes a movement process for moving the mobile robot 100 to the destination. In the movement process, the movement control unit 12 controls the motor 2 to move the automatic robot 100 to the destination along a set movement route. A specific method for moving the mobile robot 100 to the destination is not particularly limited, and various known methods may be appropriately adopted. For example, the mobile robot 100 may be configured to realize autonomous movement (autonomous running) to the destination by controlling the motor 2 while performing known self-position estimation such as odometry and scan matching based on a route planned by path planning and pre-stored map data.

[0061] The mobile robot 100 may be configured to execute the head drive process even while moving (during the movement process). That is, the controller 1 (head direction control unit 13) may execute the head drive process so that the face 31 faces the changed movement direction when changing the movement direction or a predetermined time before changing the movement direction while the mobile robot 100 is moving. The predetermined time may be set appropriately, for example, according to the current movement speed of the mobile robot 100. For example, the faster the movement speed, the shorter the predetermined time may be set. In this case, the predetermined time from executing the head drive process while moving to starting to change course is set shorter than the predetermined time from executing the head drive process when the movement speed is zero, i.e., when the robot is stopped, to starting to move. In this way, by making the predetermined time variable according to the movement speed of the mobile robot 100, the movement of the head 30 can be adjusted according to the movement speed of the mobile robot 100, so that the natural movement of the head 30 without discomfort can be realized while giving a sense of security to people around.

[0062] In this way, the mobile robot 100 can change its moving direction and notify nearby people of the changed moving direction not only when starting to move from a stopped state but also during movement, depending on the direction of the face 31. When the mobile robot 100 reaches the destination, the moving process ends.

[0063] The above is the details of the head drive control performed by the mobile robot 100 of the first embodiment. Note that the flowchart shown in Fig. 4 is an example for explaining the head drive control of this embodiment, and does not necessarily have to be executed exactly as shown in the figure. For example, the task acquisition process and the movement path setting process do not have to be executed before the head drive process.

[0064] The above is the details of the mobile robot 100 of the first embodiment. As described above, the mobile robot 100 faces the face 31 in the direction of movement, and therefore can notify people nearby of the direction of movement in advance. As a result, the mobile robot 100 can give people sharing the same space a sense of security without making them wary of the movement of the mobile robot 100.

[0065] <Second embodiment> The mobile robot 200 of the second embodiment will be described below. The mobile robot 200 differs from the first embodiment mainly in that it is configured to be able to detect the positions of people present in the vicinity, particularly the positions of people's heads. The differences from the mobile robot 100 will be mainly described below with reference to Figs. 6 to 14. Note that a description of the same configuration as the mobile robot 100 will be omitted.

[0066] 6 is a diagram illustrating the configuration of a mobile robot 200. As illustrated, the mobile robot 200 of this embodiment further includes a detection means 4, and a human detection unit 21 and a collision prediction unit 22 as functional units of a controller 1, in addition to the components of the mobile robot 100 of the first embodiment.

[0067] The detection means 4 detects obstacles present in the surrounding environment of the mobile robot 200. The obstacles here are mainly people. The detection means 4 includes at least one of a sensor (image sensor, lidar, laser scanner, etc.), a stereo camera, etc. The detection means 4 in this embodiment is composed of an image sensor, and the detection means 4 is also referred to as a sensor 4 below. The image sensor is a sensor having an image sensor that converts light detected through an optical system into an electric signal, and the type of the image sensor is not particularly limited. The sensor 4 is configured to be able to detect obstacles present in the surrounding environment including at least the front, and may be provided, for example, in a part corresponding to the human eye configured in the face part 31 shown in FIG. 3(a). In addition, a sensor 4 capable of detecting all directions, such as a so-called 360-degree camera, may be provided, for example, on the top of the head 30. The sensor 4 in this embodiment detects image data capable of recognizing the position and posture of a person present in the surroundings including at least the front of the mobile robot 100, and transmits the detection data (image data) to the controller 1.

[0068] The human detection unit 21 detects the position and posture of a person based on image data acquired by the sensor 4. The posture detected here does not necessarily have to be the posture of the entire body, but it is sufficient that at least the position of the person's head can be determined. As a method for detecting the position and posture of a person based on image data, various known methods can be adopted, but in this embodiment, a method is adopted in which the position and posture of a person is detected by detecting the skeleton (bones) of the person from the image data. This method is also called a bone model, bone detection, etc. By adopting such a method, the human detection unit 21 can easily detect the position of the head of a person in the vicinity of the mobile robot 200.

[0069] The collision prediction unit 22 predicts whether or not the mobile robot 200 will collide with a person when the mobile robot 200 moves along a set movement path. As a method for predicting a collision between the mobile robot 200 and a person, various known methods may be appropriately adopted. A specific example of the collision prediction adopted in this embodiment will be described later with reference to FIG. 8.

[0070] The above is the main configuration of the mobile robot 200. The operation of the mobile robot 200 will be described below with reference to Figs.

[0071] 7 is a flowchart for explaining the head drive control performed by the mobile robot 200 of the second embodiment. A control program for executing the processes described below with reference to the illustrated flowchart is stored in a storage medium provided in the controller 1.

[0072] Steps S21 to S23 are executed when the mobile robot 200 starts moving along a set moving path, or when the mobile robot 200 is in a stopped state before starting to move.

[0073] In step S21, the controller 1 (collision prediction unit 22) executes a collision determination process for predicting whether or not the moving robot 200 will collide with a person. The collision determination process will be described in detail with reference to FIG.

[0074] FIG. 8 is a diagram for explaining the collision determination process performed by the collision prediction unit 22 of this embodiment. In FIG. 8, the mobile robot 200 and the person 300 detected by the person detection unit 21 are shown. The dotted arrow extending from the mobile robot 200 indicates the set movement route. The solid arrow extending from the mobile robot 200 indicates the most recent movement direction of the mobile robot 200. The most recent movement direction indicates the movement direction from the current position on the set movement route, and is generally indicated by a straight line starting from the current position. In other words, the most recent movement direction is the direction from the current position toward the first direction change point (first waypoint) on the movement route.

[0075] The collision determination process of this embodiment is performed by regarding the mobile robot 200 and the person 300 as simple two-dimensional figures projected onto the floor surface from above, and determining whether or not the two-dimensional figures interfere with each other. As illustrated in FIG. 8, the mobile robot 200 is represented by a series of circles projected corresponding to each link of the mobile cart 20 and the arm 40, for example. The person 300 is represented by a circle taking into consideration the area that spreads horizontally when the arms are stretched horizontally. Note that the outer edge of the projected two-dimensional figure, i.e., the diameter of the circle, does not necessarily have to match the maximum horizontal width of the mobile robot 200 as seen from above, and the maximum horizontal width of the person 300 when both arms are stretched horizontally. The projected two-dimensional figure may be adjusted as appropriate, for example, by making it slightly wider to provide some margin, or by making it narrower in consideration of a realistic range of movement.

[0076] Moreover, the circle corresponding to the mobile robot 200 is generated along the moving path during which the mobile robot 200 moves a predetermined distance or a predetermined time. In FIG. 8, circles corresponding to the mobile robot 200 moving in the most recent moving direction along the moving path within a predetermined distance indicated by a dotted circle are shown in chronological order. As shown in the figure, the above-mentioned predetermined distance in this embodiment may be set to a distance equal to or less than the moving distance in the most recent moving direction (the distance from the current location to the first waypoint). In this figure, the current circle corresponding to the mobile robot 200 is indicated as (t), and the circles generated in chronological order along the moving path are indicated as (t+1) and (t+2). Then, the collision prediction unit 22 calculates whether or not the circle corresponding to the mobile robot 200 and the circle corresponding to the person 300 will come into contact (interfere) within a predetermined distance from the mobile robot 200. Whether or not there will be contact can be easily calculated based on, for example, the center-to-center distance between the circles and the radius of each circle. This allows the collision prediction unit 22 to predict that the mobile robot 200 may collide with the person 300 at (t+2), for example, as shown in the figure.

[0077] The predetermined distance indicated by the dotted circle in the figure, i.e., the distance range of collision prediction based on the current location, may be adjusted as appropriate according to the moving speed of the mobile robot 200, etc. Also, the generation interval of the two-dimensional figures indicated by (t+1) and (t+2) in the figure may be adjusted as appropriate considering the moving speed of at least one of the mobile robot 200 and the person 300, the sampling frequency when the detection unit 21 detects the person 300, etc. Note that the collision determination method of generating the above-mentioned two-dimensional figure as the collision verification figure is one example and is not limited to this. The collision prediction unit 22 may adopt other known collision determination methods of generating a three-dimensional figure as the collision verification figure. In this case, each link of the mobile robot 200 and the person 300 may be represented by a three-dimensional sphere or polygon mesh as the collision verification figure.

[0078] The above is the details of the collision determination process (S21) performed by the collision prediction unit 22. Hereinafter, the explanation will be continued by returning to the flowchart of FIG.

[0079] If it is determined by the collision determination process that there will be no collision with a person (S21, NO judgment), the process of step S22 is executed to perform head drive processing. The head drive processing in this step is similar to the head drive processing described above in the first embodiment (S13, see FIG. 5(c)). Once the head drive processing is executed, the process proceeds to the subsequent movement processing (S24) to move along the set movement path. On the other hand, if it is determined that there will be a collision with a person (YES judgment), the person-responsive head drive processing of step S23 is executed.

[0080] In step S23, the controller 1 (head direction control unit 13) executes a person-adaptive head driving process. The person-adaptive head driving process is a process executed for a person who is determined to collide with the mobile robot 200 if the mobile robot 200 moves in the moving direction from the current location (the most recent moving direction) within a predetermined distance from the current location of the mobile robot 200.

[0081] Fig. 9 is a diagram illustrating the human-responsive head drive process (S23) that is executed when starting to move from a stopped state. As shown in Fig. 9, in the human-responsive head drive process (S23), the head direction control unit 13 controls the head drive means 3 to orient the face 31 toward the head of a person determined to collide. To orient the face 31 upward as shown in the figure, the head direction control unit 13 only needs to control the drive of the servo motor 3b.

[0082] Here, the cases where the mobile robot 200 in a stopped state faces a person's head and where it does not face the face 31 when it starts to move will be summarized using Figures 10 and 11. Figures 10 and 11 show the mobile robot 200, a moving path indicated by a dotted arrow extending from the mobile robot 200, an immediate moving direction indicated by a solid arrow extending from the mobile robot 200, a predetermined distance from the mobile robot 200 indicated by a dotted circle, and a person.

[0083] FIG. 10 is a diagram for explaining a situation in which the face 31 is directed toward a person's head. As shown in FIG. 10(a), if a person is within a predetermined distance and in the immediate moving direction on the moving path, it is expected that the robot will collide with the person, so the robot 200 directs the face 31 toward the person's head. Also, as shown in FIG. 10(b), even if the person is in a position that is shifted from the immediate moving direction on the moving path, the robot 200 directs the face 31 toward the person's head if the person is within a predetermined distance and in a position where the robot 200 is expected to collide with the person if the robot 200 moves in the immediate moving direction. This allows the robot 200 to give a notice of the moving action to the person with whom it is expected that the robot will collide, and to encourage the person to move away from the moving path.

[0084] On the other hand, Fig. 11 is a diagram for explaining a situation in which the face 31 is not directed toward the person's head. In Fig. 11(a) and Fig. 11(b), the person is not within the predetermined range and it is not predicted that the mobile robot 200 will collide with the person, so the mobile robot 200 does not direct the face 31 toward the person's head, regardless of whether the person is in the immediate moving direction or not. Also, in Fig. 11(c) and Fig. 11(d), although a person is within the predetermined range, it is predicted that there will be no collision because the possibility of the mobile robot 200 approaching the person even if the mobile robot 200 moves in the immediate moving direction is low, so the mobile robot 200 does not direct the face 31 toward the person's head.

[0085] When the human-responsive head drive process (S23) is executed, the processes from step S21 to step S23 are repeatedly executed until there are no more people predicted to collide with, that is, until the people determined to collide with by the previous collision determination process (S21) move away from the movement path, etc. During this time, the mobile robot 200 can continue to urge the person to move away from the immediate direction of movement by keeping the face 31 facing the person's head and continuing to apply silent pressure.

[0086] However, while the processes from step S21 to step S23 are repeated, it is not necessary to keep the face 31 facing the person's head. For example, if the person with whom a collision is predicted does not move away for a certain period of time, the mobile robot 200 may perform a conspicuous action such as shaking the head 30 from side to side so that the person with whom a collision is predicted notices the advance warning action of the mobile robot 200 more quickly. The mobile robot 200 may also be provided with a notification means (not shown) and configured to use the notification means to more directly appeal to the person with whom a collision is predicted to move away from the moving path.

[0087] For example, the mobile robot 200 may further include a speaker as an alarm means, and a functional unit (alarm means control unit) of the controller 1 that controls the alarm means. The mobile robot 200 may be configured to output a predetermined sound from the speaker if it continues to be determined that the mobile robot 200 will collide with a person even after a certain period of time has elapsed after the face unit 31 has been turned toward the person's head by the human-responsive head driving process (S23). The predetermined sound here may be, for example, a warning sound such as a buzzer sound, or a voice such as "Excuse me, I'm moving" or "I'm passing by." This allows the mobile robot 200 to give a clearer and stronger advance notice of its movement to the person with whom it is predicted that it will collide.

[0088] When there is no one predicted to collide with (S21, NO judgement), the face portion 31 is turned in the movement direction (S22), and a movement process is executed to move along the movement path (S24).

[0089] Above, we have explained the human-responsive head drive control of the second embodiment. Next, the movement process of step S24 shown in Fig. 7 will be explained in detail with reference to Fig. 12.

[0090] 12 is a flowchart explaining the movement process performed by the mobile robot 200 of the second embodiment. The movement process explained in this flowchart is executed continuously while the mobile robot 200 moves to the destination along the set movement route. Note that a control program for executing the process explained below with reference to the illustrated flowchart is stored in a storage medium provided in the controller 1.

[0091] In step S221, the controller 1 (collision prediction unit 22) executes a collision determination process. The collision determination process may be the same as the method described above in the first embodiment (see FIG. 8). However, the collision determination process executed in this step may be executed as follows, taking into consideration that the collision determination process is executed while the mobile robot 200 is moving.

[0092] Fig. 13 is a diagram particularly illustrating the collision determination process executed while the mobile robot 200 is moving. Fig. 13 shows the mobile robot 200, a moving path indicated by a dotted arrow extending from the mobile robot 200, an immediate moving direction indicated by a solid arrow extending from the mobile robot 200, a predetermined distance from the mobile robot 200 indicated by a dotted circle, a deceleration start area indicated by a dashed-dotted circle, and a person.

[0093] When the human detection unit 21 detects a person on the movement path, the movement control unit 12 during movement may execute a process (deceleration process) to decelerate or stop the movement of the moving robot 200. The dashed-dotted circle shown in Fig. 13(a) is a circle illustrating a deceleration start area (deceleration start distance) set to execute the deceleration process when a person is detected.

[0094] Then, after the deceleration process has been performed, if a person is detected on the movement path within a predetermined range and in the immediate direction of movement (see FIG. 13(b)), the head direction control unit 13 executes a person-responsive head drive process (S23). This allows the robot to safely urge the person to move away from the movement path before a collision occurs, even if the robot encounters a person while moving. The size of the deceleration start area and the degree of deceleration, including stopping, may be appropriately adjusted taking into account the movement speeds of the mobile robot 200 and the person, etc. The deceleration process may also be performed when some obstacle that may impede the movement of the mobile robot 200 is detected, not just when a person is detected within the deceleration area.

[0095] Returning to step S221 in Fig. 12, the description will continue. If it is determined in step S221 that there will be no collision with a person (determination of NO), the processing from step S221 to step S222 is repeatedly executed until the destination is reached. If it is determined that there will be a collision with a person (determination of YES), the processing of step S223 is executed.

[0096] In step S223, the controller 1 judges whether or not there are multiple people judged to collide by the collision judgment process. If there is only one person (NO judgment), the controller 1 executes a person-responsive head drive process (S225) to turn the face unit 31 toward the head of the person predicted to collide. On the other hand, if there are multiple people (YES judgment), the controller 1 executes a person identification process (S224) to identify the person to which the face unit 31 is to be turned.

[0097] Fig. 14 is a diagram for explaining the person identification process. Fig. 14 shows the moving robot 200, a moving path indicated by a dotted arrow extending from the moving robot 200, a moving direction indicated by a solid arrow extending from the moving robot 200, a predetermined distance from the moving robot 200 indicated by a dotted circle, and a plurality of people including person A and person B.

[0098] Both person A and person B shown in FIG. 14 are people with whom the robot is predicted to collide. In this way, when there are multiple people with whom the robot is predicted to collide when the robot 200 moves in the immediate moving direction, the head 30 is controlled to turn the face 31 toward the head of the person with whom the robot is predicted to collide first. That is, in the person identification process, the controller 1 identifies the person with whom the robot is predicted to collide first when the robot 200 moves. Specifically, the person (person A) closest to the robot 200 is identified as the person with whom the robot is predicted to collide first. However, the moving speed and moving direction of the person may be taken into consideration when identifying the person with whom the robot is predicted to collide first. In this case, for example, when the person A is slowly moving away from the robot 200 while the person B is quickly approaching the robot 200, the person B may be identified as the person with whom the robot is predicted to collide first. When the person to whom the face 31 is turned is identified by the person identification process, the process of step S225 is executed.

[0099] In step S225, the controller 1 (head direction control unit 13) executes person-responsive head drive processing to orient the face unit 31 toward the person's head. The person-responsive head drive processing here is similar to the processing described in step S23 of Fig. 7 (see Fig. 9, etc.). Then, when there is no longer a person with whom a collision is predicted (S221, NO judgment), the processing from step S221 to step S222 is repeatedly executed until the destination is reached.

[0100] Then, when the mobile robot 200 arrives at the destination, the controller 1 (movement control unit 12) stops the movement of the mobile robot 200, and the movement process ends. In this way, when the mobile robot 200 predicts that it will collide with a person if it moves in the immediate direction of movement, it can directly appeal to the person that the mobile robot 200 will move by turning the face unit 31 toward the person's head, and can more strongly urge the person to move away from the movement path.

[0101] The above is the details of the head drive control and movement processing performed by the mobile robot 200 of the second embodiment. Note that the flowcharts shown in Fig. 7 and Fig. 12 are examples for explaining the head drive control and movement processing of this embodiment, and are not limited to being executed exactly as shown. As described above, the head drive control of this embodiment at least determines whether or not there will be a collision with a person while stopped or moving, and if it is determined that there will be a collision with a person, human-responsive head drive processing is performed, and may be modified as appropriate.

[0102] For example, the head drive process (S22) shown in FIG. 7 may be executed before the collision determination process (S21). In particular, if the sensor 4 is provided on the face 31 and configured to detect only people in front of the head 30, the head drive process (S22) for directing the face 31 in the moving direction may be executed before the collision determination process (S21) is executed. 2 7.) is preferably executed. Also, for example, the series of flows (S223, S224) of the person identification process shown in FIG. 12 may be executed after the YES determination in step S21 in FIG.

[0103] The above is the details of the mobile robot 200 of the second embodiment. As described above, the mobile robot 200 turns the face 31 toward the head of a person with whom it is predicted to collide when it moves, and therefore not only can it notify people nearby of its direction of movement, but also urge them to retreat to avoid a collision. As a result, the mobile robot 200 can eliminate any sense of caution that people sharing the same space may have toward the movement of the mobile robot 200, and can provide a sense of security.

[0104] Although the embodiments of the present invention have been described above, the above embodiments merely show some of the application examples of the present invention, and the technical scope of the present invention is not limited to the specific configurations of the above embodiments. Moreover, the above embodiments can be appropriately combined within a range where no contradiction occurs.

[0105] For example, the configuration of the mobile robots 100 and 200 shown in Fig. 2 may be modified as appropriate as long as they are equipped with at least the head 30 and are configured to be movable by the omnidirectional mobile carriage unit (mobile carriage 20). For example, the mobile robots 100 and 200 do not need to be equipped with the robot main body unit 10. In this case, the head 30 may be configured to be directly mounted on the mobile carriage 20. [Industrial Applicability]

[0106] The present invention can be used at least in industries that manufacture mobile robots and the like. [Explanation of symbols]

[0107] 1 Controller 2. Moving mechanism drive means 3 Head drive means 4. Detection Methods 10 Robot body 11. Movement route setting section 12 Movement control section 13 Head direction control unit (head control unit) 20 Mobile trolley (omnidirectional mobile trolley) 21 Person detection unit (detection unit) 22 Collision Prediction Section 30 head 40 Arm 100 Mobile robot (first embodiment) 200 Mobile robot (second embodiment) 300 people

Claims

1. A mobile robot that moves by an omnidirectional mobile platform, A head with the face facing forward; A driving means for driving the head; A head control unit that controls the driving means, the head control unit controls the driving means to orient the face in a new moving direction a predetermined time before the moving direction is changed during the movement of the mobile robot; A mobile robot, wherein the predetermined time is changed according to a moving speed of the mobile robot.

2. 2. The mobile robot according to claim 1, wherein said driving means includes a vertical rotation shaft for driving said head to rotate in the left and right directions.

3. A movement route setting unit that sets a movement route; A detection unit for detecting the position of a person's head; a collision determination unit that determines whether or not the mobile robot will collide with the person when the mobile robot moves along the movement path in a movement direction from a current location within a predetermined distance from the mobile robot, 3. The mobile robot according to claim 1, wherein, when the collision determination unit determines that the mobile robot will collide with the person, the head control unit turns the face unit toward the head of the person instead of controlling the drive means by the head control unit.

4. 4. The mobile robot according to claim 3, wherein said driving means further comprises a horizontal rotation shaft for driving said head in an up and down direction.

5. Further comprising an image sensor; 5. The mobile robot according to claim 3, wherein the detection unit detects a position of the person's head based on image data detected by the image sensor.

6. a determination unit that determines a person who is predicted to collide with the person first when the collision determination unit determines that a collision will occur with a plurality of the people; 6. The mobile robot according to claim 3, wherein, when the collision determination unit determines that the mobile robot will collide with a plurality of the people, the head control unit directs the face unit toward the heads of the people identified by the identification unit.

7. A movement control unit for controlling the movement of the mobile robot is further provided.

7. The mobile robot according to claim 3, wherein when an obstacle including the person is detected on the movement path while the mobile robot is moving, the movement control unit slows down or stops the mobile robot.

8. A speaker and and a notification control unit that outputs a predetermined sound using the speaker.

8. The mobile robot according to claim 3, wherein the notification control unit outputs a predetermined sound when the collision determination unit determines that the mobile robot will collide with the person even after a certain time has elapsed after the head control unit turns the face unit toward the person's head.

9. The mobile robot of claim 1 , further comprising one or more arms having a manipulator mechanism.

10. A head with the face facing forward; a driving means for driving the head, and a control method for a mobile robot that moves by an omnidirectional mobile carriage, comprising: A head control step of controlling the driving means, In the head control step, the driving means is controlled to orient the face in a new moving direction before a predetermined time period during which the moving direction of the mobile robot is changed, A method for controlling a moving robot, wherein the predetermined time is changed depending on a moving speed of the moving robot.

11. A head with the face facing forward; a driving means for driving the head, and a control program for a mobile robot that moves by an omnidirectional mobile carriage, comprising: A head control step of controlling the driving means, In the head control step, the driving means is controlled to orient the face in a new moving direction before a predetermined time period during which the moving direction of the mobile robot is changed, A control program for a mobile robot, wherein the predetermined time is changed according to a moving speed of the mobile robot.

Citation Information

Patent Citations

  • Flow rate adjusting device for liquid

    JP1989012179A

  • Travelling controller for crawler type car

    JP1995119178A

  • Autonomous mobile device

    JP2007334500A

  • Moving device, moving method and program

    JP2011204145A

  • Mobile human interface robot

    JP2013537487A

Cited By

  • Control device, control system, control method, and program

    US20240123619A1