Tracking robot, tracking system, and drone
The tracking robot system, featuring a drone and autonomous robot body, addresses the challenge of tracking escaping objects by using detection and control units to autonomously navigate and mark targets, enhancing tracking efficiency and accuracy.
Patent Information
- Application Number
- PCT/JP2024/016870
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-01-15
- Filing Date
- 2024-05-02
- Publication Date
- 2024-11-28
AI Technical Summary
Conventional tracking systems fail to effectively track suspicious objects that escape or move away, as they lack the capability to autonomously follow and identify targets over varying environments.
A tracking robot system comprising a drone capable of launching a tracking mark, a robot body that can autonomously travel and take off/land, and a management device, which uses detection units and control units to autonomously navigate and track suspicious objects using a network connection for communication and coordination.
Enables accurate and efficient tracking of suspicious objects by launching a tracking mark and using autonomous navigation, improving the ability to identify and follow targets even if they escape or move within complex environments.
Smart Images

Figure JP2024016870_28112024_PF_FP_ABST
Abstract
Description
Tracking robots, tracking systems, and drones
[0001] Disclosed embodiments relate to a tracking robot, a tracking system, and a drone.
[0002] Conventionally, a system has been known in which, when a vehicle is threatened with harm, a drone is launched from the vehicle and photographs the vehicle and its surroundings using a camera mounted on the drone (see, for example, Patent Document 1).
[0003] Japanese Patent Application Laid-Open No. 2020-93618
[0004] Conventional techniques have a problem in that, for example, if a suspicious object is detected and then escapes, it is not possible to track the suspicious object.
[0005] The present invention has been made in view of the above, and has an object to track a suspicious object.
[0006] A tracking robot according to one aspect of the embodiment includes a drone capable of tracking a suspicious object and emitting a tracking mark toward the suspicious object, a robot main body from which the drone can take off and land and which is capable of autonomous travel, a detection unit that detects the situation around the robot main body, and a control unit that controls the drone and causes the main body to autonomously travel in accordance with the situation detected by the detection unit. When a suspicious object is detected, the control unit launches the drone from the robot main body and emits a tracking mark from the drone toward the suspicious object.
[0007] According to one aspect of the embodiment, a suspicious object can be tracked.
[0008] FIG. 1 is a diagram illustrating an overview of a tracking system according to a first embodiment. FIG. 2 is a diagram illustrating an overview of a tracked robot according to the first embodiment. FIG. 3 is a functional block diagram illustrating an overview of a control device for a tracked robot according to the first embodiment. FIG. 4 is a functional block diagram illustrating an overview of a management device according to the first embodiment. FIG. 5 is a flowchart illustrating control processing for a short-range drone according to the first embodiment. FIG. 6 is a flowchart illustrating control processing for a long-range drone according to the first embodiment. FIG. 7A is a diagram illustrating an example of flight of a long-range drone before a tracking mark is emitted. FIG. 7B is a diagram illustrating an example of flight of a long-range drone after a tracking mark has been attached to a suspicious object. FIG. 8 is a diagram illustrating an example of a computer hardware configuration that functions as a mobile object control device. FIG. 9 is a diagram illustrating an overview of a tracked robot according to a second embodiment. FIG. 10 is a block diagram illustrating an overview of a control device for a short-range drone. FIG. 11 is a flowchart illustrating processing executed by a microcomputer of a short-range drone according to the second embodiment. FIG. 12A is a diagram illustrating an example of flight of a long-range drone before a tracking mark is emitted. FIG. 12B is a diagram illustrating an example of flight of a long-range drone after a tracking mark has been attached to a suspicious object. FIG. 12C is a diagram showing an example of flight of a long-range drone after a tracking mark has been attached to a suspicious target. FIG. 13 is a diagram showing an outline of a tracked robot according to a third embodiment. FIG. 14 is a flowchart explaining a travel switching process according to the third embodiment. FIG. 15 is a diagram showing an outline of a tracked robot according to a fourth embodiment. FIG. 16 is a rear view of the tracked robot according to the fourth embodiment as seen from behind. FIG. 17 is a functional block diagram showing an outline of a control device for a tracked robot according to the fourth embodiment. FIG. 18 is a diagram showing an example of movement information. FIG. 19 is a flowchart showing a control process procedure for the robot main body executed by the control device. FIG. 20 is a diagram explaining an outline of a tracked robot according to a fifth embodiment.
[0009] The present invention will be described below through embodiments, but the following embodiments do not limit the scope of the invention as claimed. Furthermore, not all of the combinations of features described in the embodiments are necessarily essential to the solution of the invention.
[0010] First Embodiment A tracking system 1 according to a first embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram showing an outline of the tracking system 1 according to the first embodiment.
[0011] The tracking system 1 includes a tracking robot 2, a long-range drone 3, and a management device 4. The tracking robot 2, the long-range drone 3, and the management device 4 are connected via a network N. For example, a plurality of tracking robots 2 and a plurality of long-range drones 3 may be provided.
[0012] The network N is, for example, a mobile communication network such as LTE (Long Term Evolution), 5G, etc. The tracked robot 2 and the long-range drone 3 may be connected via the network N.
[0013] Next, the tracked robot 2 will be described with reference to Fig. 2. Fig. 2 is a diagram showing an outline of the tracked robot 2 according to the first embodiment.
[0014] The tracking robot 2 includes a robot body 10, a short-range drone 11, a detection unit 12, and a control device 13. The tracking robot 2 is capable of autonomous driving, and when a suspicious object is detected, it tracks the suspicious object. The suspicious object may be, for example, a person behaving suspiciously or the perpetrator of a crime. Furthermore, the suspicious object is not limited to a person, but may also be a vehicle carrying a person behaving suspiciously.
[0015] The robot main body 10 is, for example, a humanoid robot. The robot main body 10 includes a torso 10a, legs 10b, arms 10c, and a head 10d. The legs 10b, arms 10c, and head 10d are movably attached to the torso 10a. Note that the robot main body 10 is not limited to a humanoid robot. The robot main body 10 is provided with a drive mechanism such as a motor that moves each part, such as the legs 10b, arms 10c, and head 10d. The robot main body 10 can run by moving the legs 10b.
[0016] A base unit 15 is provided on the back of the body unit 10a, from which the short-range drone 11 can take off and land. The base unit 15 is equipped with a charging device that charges the battery of the short-range drone 11. The base unit 15 may also be equipped with a replacement battery for the short-range drone 11.
[0017] The short-range drone 11 is an example of a mobile object. The short-range drone 11 is a multicopter equipped with an airframe 23 capable of autonomous flight and multiple (e.g., four) rotary propellers 24, and performs unmanned autonomous flight. The short-range drone 11 is also powered by a battery.
[0018] The short-range drone 11 includes a camera 20 and a tracking mark 21. The tracking mark 21 is emitted from the short-range drone 11. The short-range drone 11 includes a launcher that launches the tracking mark 21.
[0019] For example, when the tracking mark 21 is projected at a suspicious object, it adheres to the suspicious object. For example, the tracking mark 21 is provided with a magnet. For example, if the suspicious object is a vehicle, the tracking mark 21 adheres to the suspicious object by magnetic force. The tracking mark 21 may be adhesive.
[0020] The tracking mark 21 has, for example, a positioning device. The positioning device is, for example, a Global Navigation Satellite System (GNSS), and can receive radio waves from navigation satellites orbiting in the sky to determine position and time. The positioning device also has a communication module that transmits its own detected position information. The position information of the tracking mark 21 detected by the positioning device is transmitted to the management device 4 via the network N. The position information of the tracking mark 21 detected by the positioning device is transmitted to the control device 13 via the network N. When the tracking mark 21 is attached to a suspicious object, the position of the suspicious object is detected based on the position information transmitted from the positioning device.
[0021] The tracking mark 21 may also be a ball containing fluorescent paint. The ball containing fluorescent paint explodes when it hits a suspicious object, and the fluorescent paint adheres to the suspicious object. The short-range drone 11 may be equipped with multiple types of tracking marks 21.
[0022] In this way, the short-range drone 11 can emit the tracking mark 21 toward the suspicious target. This allows the tracking robot 2 to track the suspicious target by tracking the tracking mark 21. Therefore, the tracking robot 2 can easily identify the suspicious target, making it easier to track the suspicious target and accurately identifying the suspicious target. Therefore, the tracking robot 2 can improve the tracking ability of the suspicious target.
[0023] The short-range drone 11 includes a communication module for wireless communication via the network N. The short-range drone 11 also includes various sensors such as an acceleration sensor, a gyro sensor, and an optical sensor.
[0024] The short-range drone 11 also has a positioning device 22 for measuring its own position. The positioning device 22 is, for example, a GNSS. The position information of the short-range drone 11 detected by the positioning device 22 may be transmitted to the management device 4 via the network N. The position information of the short-range drone 11 detected by the positioning device 22 may be transmitted to the control device 13 via the network N. The short-range drone 11 also has a computer (for example, a microcomputer) that executes a flight control function, an attitude control function for controlling its attitude, and the like.
[0025] The short-range drone 11 acquires information about the first flight path from the control device 13 via the communication module. The information about the first flight path includes position information (e.g., latitude, longitude, and altitude) about the first flight path. The first flight path is a flight path for tracking a suspicious target.
[0026] The short-range drone 11 transmits images captured by the camera 20 to the management device 4 via the communication module. The short-range drone 11 transmits images captured by the camera 20 to the control device 13 via the communication module. The short-range drone 11 acquires information regarding the launch signal of the tracking mark 21 from the control device 13 via the communication module.
[0027] When a suspicious object is detected, the short-range drone 11 launches from the base unit 15 of the robot main body 10. The short-range drone 11 acquires information about a first flight path and flies along the first flight path to track the suspicious object. The short-range drone 11 performs image processing based on images captured by the camera 20 and flies along the first flight path while avoiding obstacles. When a signal to launch a tracking mark 21 is acquired, the short-range drone 11 launches the tracking mark 21. The short-range drone 11 launches the tracking mark 21 toward the suspicious object.
[0028] The detection unit 12 is provided, for example, in the head 10d of the robot main body 10. The detection unit 12 may also be provided in the torso 10a of the robot main body 10, etc. The detection unit 12 detects the situation around the robot main body 10. The detection unit 12 includes, for example, a high-sensitivity camera capable of 360-degree sensing, LiDAR (light detection and ranging), a thermal camera, radar, etc. The detection unit 12 may include sensors for vision recognition, fine sound, ultrasound, vibration, infrared, ultraviolet, electromagnetic waves, etc. A plurality of detection units 12 may be provided. The detection unit 12 may be multiple types of sensors, etc.
[0029] The detection unit 12 also includes a positioning device. The positioning device is, for example, a GNSS. The positioning device detects the position of the robot main body 10. Information about the detected position of the robot main body 10 is transmitted to the management device 4 via the network N.
[0030] 3, the control device 13 includes a communication unit 30, a storage unit 31, and a control unit 32. Fig. 3 is a functional block diagram showing an outline of the control device 13 of the tracked robot 2 according to the first embodiment.
[0031] The communication unit 30 is wirelessly connected to the network N. The communication unit 30 transmits and receives information to and from the management device 4 via the network N. The communication unit 30 transmits various pieces of information detected by the detection unit 12 to the management device 4. The communication unit 30 receives images captured by the camera 20 of the short-range drone 11. The communication unit 30 receives position information of the tracking mark 21 from the positioning device of the tracking mark 21.
[0032] The storage unit 31 is realized by, for example, a semiconductor memory element such as a random access memory (RAM) or a flash memory, or a storage device such as a hard disk drive (HDD), a solid state drive (SSD), an optical disk, etc. The storage unit 31 stores various programs and various data.
[0033] The control unit 32 is a controller and includes, for example, a microcomputer having a CPU (Central Processing Unit), ROM (Read Only Memory), RAM, input / output ports, etc., and various other circuits. The control unit 32 may also be configured with hardware such as an integrated circuit, for example, an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). The control unit 32 includes a suspicious object detection unit 35, a drone control unit 36, and a robot control unit 37.
[0034] The suspicious object detection unit 35 detects a suspicious object. The suspicious object detection unit 35 detects a suspicious object based on various information detected by the detection unit 12. For example, the suspicious object detection unit 35 performs predetermined image processing on an image captured by a high-sensitivity camera provided on the tracking robot 2 to detect a suspicious object. For example, the suspicious object detection unit 35 may detect a suspicious object based on the detection result of an infrared sensor. The suspicious object detection unit 35 may detect a suspicious object using a suspicious object detection model in AI (Artificial Intelligence).
[0035] The drone control unit 36 controls the short-range drone 11 and the long-range drone 3. The drone control unit 36 sets a first flight path for the short-range drone 11. The drone control unit 36 sets a first flight path for tracking a detected suspicious target. The drone control unit 36 sets the first flight path based on the current position information of the tracked robot 2 and the position information where the suspicious target was detected. For example, the drone control unit 36 sets the first flight path based on the current position information of the tracked robot 2, the direction in which the suspicious target was detected relative to the tracked robot 2, and the distance from the tracked robot 2 to the suspicious target.
[0036] The drone control unit 36 sets a second flight path for the long-range drone 3. The drone control unit 36 sets a second flight path for tracking the detected suspicious object. The drone control unit 36 sets the second flight path based on the position information of the station where the long-range drone 3 is waiting and the position information of the tracking mark 21. The drone control unit 36 may set the second flight path based on the position information of the long-range drone 3 and the position information of the tracking mark 21.
[0037] The drone control unit 36 may set the first flight path and the second flight path based on the predicted escape route of the suspicious subject. The predicted escape route is generated, for example, by an escape route prediction model. The escape route prediction model predicts the escape route of the suspicious subject based on the position information of the tracking robot 2, the position information of the tracking mark 21, map information, traffic information, etc. when the suspicious subject is detected. The escape route prediction model includes the position information of the tracking mark 21, for example, historical information about the position of the tracking mark 21.
[0038] For example, the escape route prediction model may be a text generation model (a so-called AI chat engine) and may be interpreted as an algorithm and calculation for automatic text-based dialogue processing. Text generation models are publicly known, as disclosed in, for example, Japanese Patent Application Laid-Open No. 2018-081444 and chatGPT (Internet search <URL: https: / / openai.com / blog / chatgpt>), and therefore a detailed description thereof will be omitted. Such a text generation model is configured using a large language model (LLM).
[0039] For example, the drone control unit 36 generates a sentence such as "A suspicious person is fleeing from east to west at the intersection of ABC Town DD. What escape route is possible?" using a language generation model based on the position information of the tracking mark 21. Then, by inputting the generated sentence into an escape route prediction model, a sentence such as "The suspicious person is likely heading toward ABC Town EF" is generated. In this case, the drone control unit 36 sets a first flight route and a second flight route toward "ABC Town EF."
[0040] By setting the first flight path and the second flight path based on the predicted escape route of the suspicious subject, the short-range drone 11 and the long-range drone 3 can get to the destination of the suspicious subject in advance. The predicted escape route may be set by the management device 4.
[0041] The set first flight path is transmitted to the short-range drone 11. Upon receiving the first flight path, the short-range drone 11 takes off from the base unit 15, flies along the first flight path, and tracks the suspicious object.
[0042] The set second flight path is transmitted to the long-range drone 3. Upon receiving the second flight path, the long-range drone 3 takes off from the waiting station, flies along the second flight path, and tracks the suspicious object.
[0043] The drone control unit 36 generates a launch signal for the tracking mark 21 of the short-range drone 11. For example, the drone control unit 36 calculates the distance to the suspicious target from an image captured by the camera 20 of the short-range drone 11. Then, if the distance to the suspicious target is equal to or less than a predetermined distance, the drone control unit 36 generates a launch signal for launching the tracking mark 21 toward the suspicious target. The generated launch signal is transmitted to the short-range drone 11. As a result, the tracking mark 21 is launched toward the suspicious target.
[0044] The robot control unit 37 sets a travel route for the robot body 10. The travel route includes a preset security route. The robot control unit 37 causes the robot body 10 to travel autonomously along the travel route. The robot control unit 37 causes the robot body 10 to travel autonomously in accordance with the situation detected by the detection unit 12. The robot control unit 37 causes the robot body 10 to travel autonomously by controlling the drive of the legs 10b and arms 10c of the robot body 10. The robot control unit 37 controls the drive of the legs 10b and arms 10c of the robot body 10 based on various information detected by the detection unit 12, for example, so that the robot body 10 travels while avoiding obstacles.
[0045] Furthermore, for example, when a suspicious object is detected, the robot control unit 37 sets a travel route to track the suspicious object. The robot control unit 37 sets a travel route to track the suspicious object, for example, based on the position information of the robot main body 10 and the position information where the suspicious object was detected. For example, the robot control unit 37 sets a travel route to track the suspicious object based on the current position information of the robot main body 10, the direction in which the suspicious object was detected relative to the robot main body 10, and the distance from the robot main body 10 to the suspicious object.
[0046] In addition, after the short-range drone 11 takes off, the robot control unit 37 sets a travel route to track the suspicious object based on the position information of the robot main body 10 and the position information of the tracking mark 21.
[0047] When a suspicious subject is detected, the robot control unit 37 may set a travel route to track the suspicious subject based on the predicted escape route of the suspicious subject. By setting the travel route of the robot main body 10 based on the predicted escape route of the suspicious subject, the robot main body 10 can get to the destination of the suspicious subject in advance.
[0048] Returning to Figure 1, the long-range drone 3 is an example of a moving object. The long-range drone 3 is, for example, a multicopter equipped with multiple rotary propellers, similar to the short-range drone 11, and performs unmanned autonomous flight. The short-range drone 11 is powered by a battery.
[0049] The long-range drone 3 has a longer flight distance than the short-range drone 11. The flight distance is the distance that can be flown on a single charge. The long-range drone 3 waits at a preset station. For example, the long-range drone 3 is equipped with a large battery to have a longer flight distance than the short-range drone 11. For example, the long-range drone 3 is larger than the short-range drone 11. The long-range drone 3 may be, for example, an airplane-type drone.
[0050] The long-range drone 3 is equipped with a camera, similar to the short-range drone 11. The long-range drone 3 is not equipped with a tracking mark, unlike the short-range drone 11. Note that the long-range drone 3 may be equipped with a tracking mark, similar to the short-range drone 11.
[0051] The long-range drone 3 includes a communication module for wireless communication via the network N. The long-range drone 3 also includes various sensors such as an acceleration sensor, a gyro sensor, and an optical sensor.
[0052] The long-range drone 3 also has a positioning device 39 (see FIG. 1 ) for measuring its own position. The positioning device 39 is, for example, a GNSS. The position information of the long-range drone 3 detected by the positioning device 39 may be transmitted to the management device 4 via the network N. The position information of the long-range drone 3 detected by the positioning device 39 may be transmitted to the control device 13 via the network N. The long-range drone 3 also has a computer (for example, a microcomputer) that executes a flight control function, an attitude control function for controlling its attitude, and the like.
[0053] The long-range drone 3 acquires information about the second flight path from the control device 13 via the communication module. The information about the second flight path includes position information (e.g., latitude, longitude, and altitude) of the second flight path.
[0054] The long-range drone 3 may fly so as to take over the tracking of the suspicious target by the short-range drone 11. The long-range drone 3 may track the suspicious target simultaneously with the short-range drone 11.
[0055] The long-range drone 3 transmits images taken by the camera to the management device 4 via the communication module. The long-range drone 3 transmits images taken by the camera to the control device 13 via the communication module.
[0056] When a suspicious object is detected, the long-range drone 3 takes off from the waiting station. The long-range drone 3 acquires information about the second flight path and flies along the second flight path to track the suspicious object. The long-range drone 3 performs image processing based on images captured by the camera and flies along the second flight path while avoiding obstacles.
[0057] The ability to track a suspicious target can be improved by tracking the suspicious target using the short-range drone 11 and the long-range drone 3. For example, indoors, tracking can be performed using the short-range drone 11, which is smaller than the long-range drone 3, and if the suspicious target escapes outdoors, tracking can be performed using the long-range drone 3.
[0058] The management device 4 is, for example, a server device. The management device 4 may also be a cloud server. As shown in Fig. 4, the management device 4 includes a communication unit 40, a storage unit 41, and a control unit 42. Fig. 4 is a functional block diagram showing an outline of the management device 4 according to the first embodiment.
[0059] The management device 4 collects, from the tracking robot 2 that detected the suspicious object, various types of information detected by the detection unit 12 of the tracking robot 2. The management device 4 also collects, from tracking robots 2 different from the tracking robot 2 that detected the suspicious object, various types of information detected by the detection unit 12. The management device 4 also collects, from multiple long-range drones 3, position information of each long-range drone 3.
[0060] The management device 4 may generate information regarding the travel path of the tracked robot 2. The management device 4 may also generate information regarding the first flight path of the short-range drone 11. The management device 4 may also generate information regarding the second flight path of the long-range drone 3.
[0061] The communication unit 40 is connected to the network N by wire or wirelessly. The communication unit 40 transmits and receives information to and from the control device 13 of the tracked robot 2, the short-range drone 11, and the long-range drone 3 via the network N.
[0062] The communication unit 40 receives various information detected by the detection unit 12 from the control device 13 of the tracked robot 2. The communication unit 40 receives images captured by the camera 20 from the short-range drone 11. The communication unit 40 receives position information from the short-range drone 11, the tracking mark 21, and the long-range drone 3. The communication unit 40 receives images captured by the camera from the long-range drone 3.
[0063] The storage unit 41 is realized by, for example, a semiconductor memory element such as a RAM or a flash memory, or a storage device such as an HDD, an SSD, an optical disk, etc. Various programs and various data are stored in the storage unit 41. For example, the storage unit 41 stores various information detected by the detection unit 12 of each tracked robot 2.
[0064] The control unit 42 is a controller and includes, for example, a microcomputer having a CPU, ROM, RAM, input / output ports, etc., and various circuits. The control unit 42 may also be configured with hardware such as an integrated circuit, for example, an ASIC, an FPGA, etc.
[0065] The control unit 42 may generate information regarding the travel route of the robot main body 10. For example, the control unit 42 generates information regarding the travel route of the robot main body 10 using a sentence generation model (a so-called AI chat engine). As described above, the sentence generation model may be interpreted as an algorithm and calculation for automatic dialogue processing using text.
[0066] The control unit 42 generates a question about the suspicious object from various pieces of information detected by the detection unit 12 of the tracked robot 2. First, the control unit 42 generates a question using, for example, a language generation model.
[0067] For example, if movement is detected by the infrared sensor of the tracking robot 2, the following question will be generated: "The infrared sensor detected this movement. Is this movement a suspicious person? From a criminal's perspective, what action would they take next?"
[0068] By inputting such a question into the sentence generation model, the control unit 42 generates a sentence such as, "There is a high possibility that this person is a suspicious person. If he senses the presence of a person, he will take action to run away." The generated sentence is transmitted to the tracked robot 2 as information regarding the travel route, and the tracked robot 2 sets a travel route so as to approach the person presumed to be a suspicious person at a low speed.
[0069] Also, for example, if a sound is detected by a sensor that detects minute sounds in the tracked robot 2, a question such as "I can hear a beep from 2 meters away. What sound is this?" is generated.
[0070] When such a question is input to the sentence generation model, the control unit 42 generates a sentence such as, for example, "An alarm is sounding." The generated sentence is transmitted to the tracked robot 2 as information regarding the travel route, and the tracked robot 2 recognizes the target as suspicious and sets a travel route to approach the suspicious target via, for example, the shortest route.
[0071] The control unit 42 may similarly generate information regarding the travel route of the tracked robot 2 based on other information detected by the detection unit 12 of the tracked robot 2. The control unit 42 may generate information regarding the travel route of the tracked robot 2 based on information obtained by a high-sensitivity camera capable of 360-degree sensing, LiDAR, a thermal camera, radar, etc. The control unit 42 may generate information regarding the travel route of the tracked robot 2 based on information obtained by sensors such as vision recognition, ultrasonic waves, vibrations, ultraviolet rays, and electromagnetic waves.
[0072] Similarly, information regarding the travel route of the tracked robot 2 may be generated based on a plurality of pieces of information detected by the detection unit 12 of the tracked robot 2. The control unit 42 may set the travel route of the tracked robot 2.
[0073] By generating information about the travel route of the tracked robot 2 using the document generation model, the tracked robot 2 can, for example, accurately determine a suspicious object and can move the tracked robot 2 closer to the suspicious object without being noticed by the suspicious object. Therefore, for example, the tracked robot 2 can improve the hit rate of the tracking mark 21 emitted from the short-range drone 11. In this way, by generating information about the travel route of the tracked robot 2 using the document generation model, the ability of the tracked robot 2 and the like to track suspicious objects can be improved.
[0074] The control unit 42 may also generate information about at least one of the first flight path of the short-range drone 11 and the second flight path of the long-range drone 3. For example, the control unit 42 generates information about the first flight path using a sentence generation model.
[0075] For example, if the tracking robot 2 detects a suspicious object, the suspicious object is a car, and the license plate number of the suspicious object is detected as "AA-BB," the control unit 42 uses the language generation model to create a sentence such as "Take a picture of the car with the license plate number AA-BB." The control unit 42 then inputs the generated sentence into a sentence generation model to generate information regarding the first flight path. For example, the control unit 42 generates a flight program for the short-range drone 11 that captures a picture of the car with the license plate number "AA-BB" using the camera 20 of the short-range drone 11 and tracks the car with the license plate number "AA-BB." The control unit 42 then generates the generated flight program as information regarding the first flight path. The generated information regarding the first flight path is transmitted to the short-range drone 11, causing the short-range drone 11 to fly in a manner that tracks the car with the license plate number "AA-BB." The image captured by the camera 20 of the short-range drone 11 is transmitted to the management device 4.
[0076] For example, by using a document generation model to generate information regarding the first flight path of the short-range drone 11, the ability of the short-range drone 11 to track suspicious objects can be improved.
[0077] The generation of information regarding the travel path of the tracked robot 2 using the sentence generation model may be performed by the tracked robot 2.
[0078] Next, the control process of the short-range drone 11 according to the embodiment will be described with reference to Fig. 5. Fig. 5 is a flowchart illustrating the control process of the short-range drone 11 according to the first embodiment. The control process of the short-range drone 11 is executed by the control device 13 of the tracking robot 2.
[0079] The control unit 32 acquires various pieces of information detected by the detection unit 12 (S100). The control unit 32 determines whether a suspicious object has been detected based on the acquired various pieces of information (S101). For example, the control unit 32 detects a suspicious object by performing predetermined image processing on an image captured by a high-sensitivity camera.
[0080] If a suspicious object is not detected (S101: No), the control unit 32 ends this processing. If a suspicious object is detected (S101: Yes), the control unit 32 sets a first flight path for the short-range drone 11 (S102).
[0081] The control unit 32 transmits the first flight path to the short-range drone 11 (S103). As a result, the short-range drone 11 takes off from the base unit 15 of the tracked robot 2.
[0082] The control unit 32 acquires the image captured by the camera 20 of the short-range drone 11 (S104).
[0083] The control unit 32 determines whether the distance to the suspicious target is equal to or less than a predetermined distance (S105). If the distance to the suspicious target is greater than the predetermined distance (S105: No), the control unit 32 continues tracking the suspicious target and acquires an image captured by the camera 20 of the short-range drone 11 (S104).
[0084] If the distance to the suspicious target is equal to or shorter than the predetermined distance (S105: Yes), the control unit 32 generates a signal to emit the tracking mark 21 (S106). The control unit 32 transmits the generated emission signal to the short-range drone 11 (S107). As a result, the tracking mark 21 is emitted from the short-range drone 11 toward the suspicious target.
[0085] Next, the control process of the long-range drone 3 according to the embodiment will be described with reference to Fig. 6. Fig. 6 is a flowchart illustrating the control process of the long-range drone 3 according to the first embodiment. The control process of the long-range drone 3 is executed by the control device 13 of the tracking robot 2.
[0086] The control unit 32 acquires various pieces of information detected by the detection unit 12 (S200). The control unit 32 determines whether or not a suspicious object has been detected based on the acquired various pieces of information (S201).
[0087] If a suspicious object is not detected (S201: No), the control unit 32 ends this processing. If a suspicious object is detected (S201: Yes), the control unit 32 sets a second flight path for the long-range drone 3 (S202).
[0088] The control unit 32 transmits the second flight path to the short-range drone 11 (S203). As a result, the long-range drone 3 takes off from the station.
[0089] The long-range drone 3 flies based on the position information of the tracking mark 21. Therefore, as shown in Fig. 7A, when the short-range drone 11 has not emitted a tracking mark 21 at the suspicious target C, the long-range drone 3 tracks the short-range drone 11 and flies so as to approach the suspicious target C. Then, as shown in Fig. 7B, when the tracking mark 21 is emitted from the short-range drone 11 and attached to the suspicious target C, the long-range drone 3 flies so as to track the suspicious target C. Fig. 7A is a diagram showing an example of the flight of the long-range drone 3 before the tracking mark 21 is emitted. Fig. 7B is a diagram showing an example of the flight of the long-range drone 3 after the tracking mark 21 has attached to the suspicious target C.
[0090] The camera that captures images for detecting and tracking a suspicious object is not limited to a camera installed on the tracking robot 2, etc. For example, if the suspicious object is indoors, a camera on another indoor robot or a surveillance camera installed in the room may be used as the camera that captures images for detecting and tracking a suspicious object. Also, if the suspicious object is outdoors, an outdoor surveillance camera may be used as the camera that captures images for detecting and tracking a suspicious object. That is, for example, the tracking robot 2 may detect a suspicious object based on images taken by a camera on another indoor robot, an indoor surveillance camera, and an outdoor surveillance camera.
[0091] The tracking robot 2 includes a short-range drone 11, a robot main body 10, a detection unit 12, and a control unit 32. The short-range drone 11 is capable of tracking a suspicious object and emitting a tracking mark 21 toward the suspicious object. The robot main body 10 is capable of launching and landing the short-range drone 11 and of autonomous travel. The detection unit 12 detects the situation around the robot main body 10. The control unit 32 controls the drone and causes the robot main body 10 to autonomously travel in accordance with the situation detected by the detection unit 12. When a suspicious object is detected, the control unit 32 launches the short-range drone 11 from the robot main body 10 and causes the short-range drone 11 to emit a tracking mark 21 toward the suspicious object.
[0092] As a result, the tracking robot 2 can track the suspicious object by tracking the tracking mark 21. Therefore, the tracking robot 2 can easily identify the suspicious object, making it easier to track the suspicious object and accurately identifying the suspicious object. Therefore, the tracking robot 2 can improve the tracking ability of the suspicious object.
[0093] The tracking mark 21 acquires the position information of the tracking mark 21 and transmits the position information of the tracking mark 21.
[0094] This allows the tracking robot 2 to track the suspicious target based on the position information of the tracking mark 21. For example, even if the tracking robot 2 loses sight of the suspicious target due to an obstacle or the like, it can find the suspicious target based on the position information of the tracking mark 21, thereby improving the tracking ability of the suspicious target.
[0095] The position information of the tracking mark 21 is transmitted to the long-range drone 3, which has a longer flight distance than the short-range drone 11. The long-range drone 3 flies to track the suspicious target based on the position information of the tracking mark 21.
[0096] This allows the long-range drone 3 to continuously track suspicious objects for a long period of time.
[0097] 8 is a diagram schematically illustrating an example of a computer hardware configuration that functions as the tracked robot 2 or the management device 4. A program installed on the computer 1200 can cause the computer 1200 to function as one or more "parts" of the device according to the present embodiment, or to perform operations or one or more "parts" associated with the device according to the present embodiment, and / or to perform a process or steps of the process according to the present embodiment. Such a program may be executed by the CPU 1212 to cause the computer 1200 to perform specific operations associated with some or all of the blocks in the flowcharts and block diagrams described herein.
[0098] The computer 1200 according to this embodiment includes a CPU 1212, a RAM 1214, and a graphics controller 1216, which are interconnected by a host controller 1210. The computer 1200 also includes input / output units such as a communication interface 1222, a storage device 1224, a DVD drive, and an IC card drive, which are connected to the host controller 1210 via an input / output controller 1220. The DVD drive may be a DVD-ROM drive, a DVD-RAM drive, or the like. The storage device 1224 may be a hard disk drive, a solid state drive, or the like. The computer 1200 also includes input / output units such as a ROM 1230 and a keyboard, which are connected to the input / output controller 1220 via an input / output chip 1240.
[0099] The CPU 1212 operates according to programs stored in the ROM 1230 and the RAM 1214, thereby controlling each unit. The graphics controller 1216 acquires image data generated by the CPU 1212 into a frame buffer or the like provided in the RAM 1214 or into the graphics controller 1216 itself, and causes the image data to be displayed on the display device 1218.
[0100] The communication interface 1222 communicates with other electronic devices via a network. The storage device 1224 stores programs and data used by the CPU 1212 in the computer 1200. The DVD drive reads programs or data from a DVD-ROM or the like and provides them to the storage device 1224. The IC card drive reads programs and data from an IC card and / or writes programs and data to an IC card.
[0101] The ROM 1230 stores therein a boot program or the like that is executed by the computer 1200 upon activation, and / or programs that depend on the hardware of the computer 1200. The input / output chip 1240 may also connect various input / output units to the input / output controller 1220 via a USB port, a parallel port, a serial port, a keyboard port, a mouse port, etc.
[0102] The programs are provided by a computer-readable storage medium such as a DVD-ROM or an IC card. The programs are read from the computer-readable storage medium, installed in the storage device 1224, RAM 1214, or ROM 1230, which are also examples of computer-readable storage media, and executed by the CPU 1212. Information processing described in these programs is read by the computer 1200, and brings about cooperation between the programs and the various types of hardware resources described above. An apparatus or a method may be configured by implementing operations or processing of information in accordance with the use of the computer 1200.
[0103] For example, when communication is performed between computer 1200 and an external device, CPU 1212 may execute a communication program loaded into RAM 1214 and instruct communication interface 1222 to perform communication processing based on the processing described in the communication program. Under the control of CPU 1212, communication interface 1222 reads transmission data stored in a transmission buffer area provided in RAM 1214, storage device 1224, a DVD-ROM, or a recording medium such as an IC card, and transmits the read transmission data to a network, or writes received data received from the network to a reception buffer area or the like provided on the recording medium.
[0104] Furthermore, the CPU 1212 may cause all or a necessary portion of a file or database stored in an external recording medium such as the storage device 1224, a DVD drive (DVD-ROM), an IC card, etc. to be read into the RAM 1214, and may perform various types of processing on the data on the RAM 1214. The CPU 1212 may then write back the processed data to the external recording medium.
[0105] Various types of information, such as various types of programs, data, tables, and databases, may be stored on the recording medium and may undergo information processing. The CPU 1212 may perform various types of processing on data read from the RAM 1214, including various types of operations, information processing, conditional judgment, conditional branching, unconditional branching, information search / replacement, etc., as described throughout this disclosure and specified by the instruction sequences of the programs, and write the results back to the RAM 1214. The CPU 1212 may also search for information in a file, database, etc. on the recording medium. For example, if multiple entries, each having an attribute value of a first attribute associated with an attribute value of a second attribute, are stored on the recording medium, the CPU 1212 may search for an entry whose attribute value of the first attribute matches a specified condition from among the multiple entries, read the attribute value of the second attribute stored in the entry, and thereby obtain the attribute value of the second attribute associated with the first attribute that satisfies a predetermined condition.
[0106] The above-described programs or software modules may be stored in a computer-readable storage medium on or near the computer 1200. A recording medium such as a hard disk or RAM provided in a server system connected to a dedicated communication network or the Internet can also be used as a computer-readable storage medium, thereby providing the programs to the computer 1200 via the network.
[0107] The blocks in the flowcharts and block diagrams in the present embodiments may represent stages of a process in which an operation is performed or "parts" of a device responsible for performing the operation. Particular stages and "parts" may be implemented by dedicated circuitry, programmable circuitry provided with computer-readable instructions stored on a computer-readable storage medium, and / or a processor provided with computer-readable instructions stored on a computer-readable storage medium. The dedicated circuitry may include digital and / or analog hardware circuits, and may include integrated circuits (ICs) and / or discrete circuits. The programmable circuitry may include reconfigurable hardware circuits, such as field programmable gate arrays (FPGAs) and programmable logic arrays (PLAs), including AND, OR, XOR, NAND, NOR, and other logical operations, flip-flops, registers, and memory elements.
[0108] A computer-readable storage medium may include any tangible device capable of storing instructions that are executed by an appropriate device, such that a computer-readable storage medium having instructions stored thereon comprises an article of manufacture, including instructions that can be executed to create means for performing the operations specified in the flowcharts or block diagrams. Examples of computer-readable storage media may include electronic, magnetic, optical, electromagnetic, and semiconductor storage media. More specific examples of computer-readable storage media may include floppy disks, diskettes, hard disks, random access memories (RAMs), read-only memories (ROMs), erasable programmable read-only memories (EPROMs or flash memories), electrically erasable programmable read-only memories (EEPROMs), static random access memories (SRAMs), compact disc read-only memories (CD-ROMs), digital versatile discs (DVDs), Blu-ray discs, memory sticks, integrated circuit cards, and the like.
[0109] The computer readable instructions may include either assembler instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state-setting data, or source or object code written in any combination of one or more programming languages, including object-oriented programming languages such as Smalltalk®, JAVA®, C++, etc., and conventional procedural programming languages such as the “C” programming language or similar programming languages.
[0110] Computer-readable instructions may be provided locally or over a local area network (LAN), a wide area network (WAN) such as the Internet, to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, or programmable circuitry, such that the processor or programmable circuitry executes the computer-readable instructions to generate means for performing the operations specified in the flowcharts or block diagrams. Examples of processors include computer processors, processing units, microprocessors, digital signal processors, controllers, microcontrollers, etc.
[0111] Second Embodiment Here, differences from the first embodiment will be mainly described, and descriptions of the same configurations and processes as those in the first embodiment will be omitted.
[0112] The tracked robot 2 will be described with reference to Fig. 9. Fig. 9 is a diagram showing an outline of the tracked robot 2 according to the second embodiment.
[0113] The short-range drone 11 of the tracking robot 2 further includes a warning light 25, an alarm 26, and a control device 27. The warning light 25 is, for example, a flashing red light. The alarm 26 is, for example, a speaker that emits a siren sound. The alarm 26 can, for example, emit an audio message to warn people. The warning light 25 and the alarm 26 are controlled by the control device 27.
[0114] The microcomputer included in the short-range drone 11 has the function of recognizing surrounding obstacles and suspicious subjects through image recognition processing based on images captured by the camera 20. Furthermore, the microcomputer included in the short-range drone 11 controls the illumination of the warning light 25 and the sound output of the alarm 26.
[0115] For example, the drone control unit 36 of the control device 13 generates a sentence such as "A suspicious person is fleeing from east to west at the intersection of ABC Town DD. What escape route is possible?" using a language generation model based on the position information of the tracking mark 21. The generated sentence is then input into an escape route prediction model, thereby generating a sentence such as "The suspicious person is likely heading toward ABC Town EF." In this case, the drone control unit 36 sets a first flight route and a second flight route that head toward "ABC Town EF," tracks the suspicious person, and blocks the suspicious person's escape direction.
[0116] By setting the first flight path and the second flight path based on the predicted escape route of the suspicious subject, the short-range drone 11 and the long-range drone 3 can get ahead of the suspicious subject's destination and block the suspicious subject's escape direction.
[0117] In addition, the drone control unit 36 may be configured to set a first flight path and a second flight path that fly along a flight path that chases the suspicious object toward the flight position of the other drone when a suspicious object is detected while the other drone is flying.
[0118] In this case, the other drone is either the short-range drone 11 or the long-range drone 3. This allows the drone control unit 36 to corner the suspicious target using multiple short-range drones 11 and long-range drones 3, thereby preventing the suspicious target from escaping.
[0119] Furthermore, the drone control unit 36 may be configured to set a first flight path and a second flight path that fly along a flight path that drives the suspicious target into a dead end when a suspicious target is detected. In this way, the drone control unit 36 can prevent the suspicious target from escaping by driving the short-range drone 11 and the long-range drone 3 into a dead end.
[0120] The drone control unit 36 may also be configured to acquire the location of a police vehicle from the police. In this case, the drone control unit 36 acquires location information of the nearest police station, police box, and police station (e.g., nearest to the fleeing suspicious subject) from stored map information.
[0121] The drone control unit 36 then sets a first flight path and a second flight path that will drive the suspicious subject to the nearest police station, police box, or police post, as well as the location of any police vehicles traveling nearby.
[0122] As a result, the drone control unit 36 can prevent the suspicious subject from escaping by using the short-range drone 11 and the long-range drone 3 to chase the suspicious subject to the nearest police station, police box, or police post, or to the location of a police vehicle traveling nearby.
[0123] 1 includes an airframe, multiple (e.g., four) rotary wing propellers, a camera, warning lights, an alarm, and a control device, similar to the short-range drone 11. The camera, warning lights, alarm, and control device included in the long-range drone 3 are the same as the camera 20, warning lights 25, alarm 26, and control device 27 included in the short-range drone 11, respectively.
[0124] When the short-range drone 11 and the long-range drone 3 detect a suspicious target during tracking, they turn on (blink) the warning lights 25 so that the suspicious target moves in the opposite direction from the direction toward the aircraft 23. Furthermore, when the short-range drone 11 and the long-range drone 3 detect a suspicious target during tracking, they cause the alarm 26 to sound an alarm (for example, a siren sound) so that the suspicious target moves in the opposite direction from the direction toward the aircraft 23.
[0125] This allows the short-range drone 11 and the long-range drone 3 to intercept the suspicious subject and then guide the suspicious subject to a location where it cannot escape. For example, the short-range drone 11 and the long-range drone 3 can guide and corner the suspicious subject to the flight location of another drone, a dead end, the nearest police station, police box, police post, or the location of a nearby police vehicle.
[0126] Furthermore, when the short-range drone 11 and the long-range drone 3 detect a suspicious target during tracking, for example, while tracking the suspicious target, they alert nearby residents to the suspicious target using the alarm 26. For example, the short-range drone 11 and the long-range drone 3 can emit an audio message such as "A suspicious target is fleeing. Please do not leave your home" using the alarm 26. This allows the short-range drone 11 and the long-range drone 3 to protect the safety of nearby residents.
[0127] Next, the control device 27 of the short-range drone 11 will be described with reference to Fig. 10. Fig. 10 is a block diagram showing an outline of the control device 27 of the short-range drone 11. The control device of the long-range drone 3 has the same configuration as the control device 27 of the short-range drone 11, except that it does not control the launch of the tracking mark 21. Therefore, a duplicated description of the configuration of the control device of the long-range drone 3 will be omitted here.
[0128] As shown in FIG. 10, the control device 27 includes a communication unit 50, a storage unit 51, and a microcomputer 52.
[0129] The communication unit 50 is wirelessly connected to the network N. The communication unit 50 transmits and receives information to and from the tracked robot 2 and the management device 4 via the network N. The communication unit 50 receives a launch signal for the tracking mark 21 and a first flight path from the tracked robot 2 or the management device 4. In the case of the long-range drone 3, the communication unit receives a second flight path from the tracked robot 2 or the management device 4.
[0130] Furthermore, the communication unit 50 transmits images captured by the camera 20 and the position information of the short-range drone 11 to the tracked robot 2 and the management device 4. In the case of the long-range drone 3, the communication unit transmits the position information of the long-range drone 3 to the tracked robot 2 and the management device 4.
[0131] The storage unit 51 is realized by, for example, a semiconductor memory element such as RAM or flash memory, or a storage device such as an HDD, SSD, or optical disk. Various programs and various data are stored in the storage unit 51. For example, information on a first flight path is stored in the storage unit 51. In the case of the long-range drone 3, information on a second flight path is stored in the storage unit.
[0132] The microcomputer 52 is a controller and includes, for example, a microcomputer having a CPU, ROM, RAM, input / output ports, etc., and various circuits. The microcomputer 52 may also be configured with hardware such as an integrated circuit, for example, an ASIC or FPGA. The microcomputer 52 includes a suspicious object detection unit 53 and a flight control unit 54.
[0133] The suspicious target detection unit 53 detects a suspicious target. For example, the suspicious target detection unit 53 performs predetermined image processing on an image captured by the camera 20 to detect a suspicious target. Furthermore, if the short-range drone 11 is equipped with an infrared sensor, the suspicious target detection unit 53 or the suspicious target detection unit 35 may detect a suspicious target based on the detection result of the infrared sensor. The suspicious target detection unit 53 may detect a suspicious target using a suspicious target detection model in AI.
[0134] The flight control unit 54 controls the short-range drone 11 to autonomously fly along the first flight path received from the tracking robot 2 and track the suspicious target. When the suspicious target detection unit 53 detects a suspicious target, the flight control unit 54 causes the warning light 25 to flash, and further causes the alarm 26 to sound an alarm and alert nearby residents. When the flight control unit 54 detects the suspicious target in advance at the suspicious target's destination, it may start causing the alarm 26 to sound an alarm and alert nearby residents.
[0135] Furthermore, the flight control unit 54 may be configured to set the first flight path by itself by performing processing similar to that of the drone control unit 36 of the tracking robot 2. In this case, the flight control unit 54 sets the first flight path for tracking the detected suspicious target. The flight control unit 54 sets the first flight path based on the current position information of the short-range drone 11 and the position information where the suspicious target was detected. For example, the flight control unit 54 sets the first flight path based on the position information of the short-range drone 11, the direction in which the suspicious target was detected relative to the short-range drone 11, and the distance from the short-range drone 11 to the suspicious target.
[0136] The flight control unit 54 may set the first flight path based on the predicted escape path of the suspicious subject. The predicted escape path is generated, for example, by an escape path prediction model. The escape path prediction model predicts the escape path of the suspicious subject based on the position information of the short-range drone 11 at the time the suspicious subject is detected, the position information of the tracking mark 21, map information, traffic information, etc. The position information of the tracking mark 21 includes, for example, historical information about the position of the tracking mark 21. Furthermore, in the case of a microcomputer in the long-range drone 3, the flight control unit included in the microcomputer may be configured to set the second flight path by itself using a procedure similar to that of the flight control unit 54 of the short-range drone 11.
[0137] Next, the processing executed by the microcomputer 52 of the short-range drone 11 according to the second embodiment will be described with reference to Fig. 11. Fig. 11 is a flowchart illustrating the processing executed by the microcomputer 52 of the short-range drone 11 according to the second embodiment.
[0138] The microcomputer 52 determines whether or not the first flight path has been received from the tracked robot 2 (step S301). If the microcomputer 52 determines that the first flight path has not been received (step S301: No), the microcomputer 52 ends this processing.
[0139] When the microcomputer 52 determines that the first flight path has been received (step S301: Yes), the microcomputer 52 performs flight control along the first flight path (step S302). Thereafter, the microcomputer 52 determines whether or not a launch signal for the tracking mark 21 has been received from the tracking robot 2 (step S303).
[0140] If the microcomputer 52 determines that a launch signal has not been received (step S303: No), it repeats the determination of step S303 while performing flight control along the first flight path until a launch signal is received.
[0141] If the microcomputer 52 determines that it has received the emission signal (step S303: Yes), it emits the tracking mark 21 (step S304). After that, the microcomputer 52 determines whether or not a suspicious object has been detected (step S305).
[0142] If the microcontroller 52 determines that no suspicious object has been detected (step S305: No), it repeats the determination of step S305 while performing flight control along the first flight path until it detects a suspicious object.
[0143] If the microcomputer 52 determines that a suspicious object has been detected (step S305: Yes), it causes the warning light 25 to flash and the alarm 26 to emit an alarm sound and a message to warn local residents (step S306), and then ends the processing.
[0144] In addition, in the case where the microcomputer 52 itself is configured to set the first flight path, the microcomputer 52 first determines whether or not a suspicious object has been detected, and if it determines that a suspicious object has not been detected, ends the current processing. Then, if it determines that a suspicious object has been detected, the microcomputer 52 determines and sets the first flight path. Thereafter, the microcomputer 52 executes the processing of steps S302 to S306 shown in FIG. 11.
[0145] In addition, in the case of the microcomputer of the long-range drone 3, the microcomputer replaces the first flight path in the flowchart shown in Figure 11 with the second flight path, omits the processing of steps S303 to S304, and then executes the processing.
[0146] In addition, if the microcomputer of the long-range drone 3 itself is configured to set the second flight path, the microcomputer first determines whether a suspicious object has been detected, and if it determines that a suspicious object has not been detected, ends the current process. If the microcomputer determines that a suspicious object has been detected, it determines and sets the second flight path. Thereafter, the microcomputer 52 performs flight control along the second flight path and executes the processes of steps S305 to S306 shown in FIG. 11.
[0147] The long-range drone 3 flies based on the position information of the tracking mark 21. Therefore, as shown in Fig. 12A, when the short-range drone 11 has not emitted a tracking mark 21 at the suspicious target C, the long-range drone 3 tracks the short-range drone 11 and flies so as to approach the suspicious target C. Then, as shown in Fig. 12B, when the tracking mark 21 is emitted from the short-range drone 11 and attached to the suspicious target C, the long-range drone 3 flies so as to track the suspicious target C. Fig. 12A is a diagram showing an example of the flight of the long-range drone 3 before the tracking mark 21 is emitted. Fig. 12B is a diagram showing an example of the flight of the long-range drone 3 after the tracking mark 21 has attached to the suspicious target C.
[0148] The short-range drone 11 and the long-range drone 3 then track the suspicious target C and, as shown in Figure 12C, get ahead of the suspicious target's destination and block the direction of travel of the suspicious target C. When the short-range drone 11 and the long-range drone 3 detect the suspicious target C, they cause the warning lights 25 to flash and the alarm 26 to emit an alarm sound and a message to alert local residents.
[0149] In this way, the short-range drone 11 and the long-range drone 3 chase the suspicious object C in the opposite direction to the direction toward the short-range drone 11 and the long-range drone 3.
[0150] The short-range drone 11 and the long-range drone 3 then fly a flight path that will drive the suspicious target C to, for example, the flight location of another drone, a dead end, the nearest police station, police box, or police post, or the location of a nearby police vehicle. This allows the short-range drone 11 and the long-range drone 3 to prevent the suspicious target from escaping. However, if the flight distance from the location where the suspicious target C was first detected to getting ahead of the suspicious target C's destination is longer than the flight distance of the short-range drone 11, only the long-range drone 3 will get ahead of the suspicious target C's destination.
[0151] The short-range drone 11 and the long-range drone 3 each include an autonomously flyable airframe 23, a suspicious target detection unit 53, and a flight control unit 54. The suspicious target detection unit 53 detects a suspicious target. When a suspicious target is detected, the flight control unit 54 autonomously flies the airframe 23 so that the airframe 23 tracks the suspicious target and flies a flight path that blocks the target's escape route. This allows the short-range drone 11 and the long-range drone 3 to get ahead of the suspicious target's destination and block the target's escape route.
[0152] The short-range drone 11 and the long-range drone 3 are further equipped with warning lights 25. When a suspicious object is detected, the flight control unit 54 turns on the warning lights 25 so that the suspicious object moves in the opposite direction from the direction toward the aircraft 23. This allows the short-range drone 11 and the long-range drone 3 to chase the suspicious object in the opposite direction from the direction toward the short-range drone 11 and the long-range drone 3.
[0153] The short-range drone 11 and the long-range drone 3 further include an alarm 26. When a suspicious object is detected, the flight control unit 54 causes the alarm 26 to sound an alarm so that the suspicious object moves in the opposite direction from the direction toward the aircraft 23. This allows the short-range drone 11 and the long-range drone 3 to chase the suspicious object in the opposite direction from the direction toward the short-range drone 11 and the long-range drone 3.
[0154] When a suspicious object is detected, the flight control unit 54 alerts nearby residents to the suspicious object using an alarm, allowing the short-range drone 11 and the long-range drone 3 to protect the safety of nearby residents along the suspicious object's escape route.
[0155] When a suspicious target is detected, the flight control unit 54 autonomously flies the aircraft 23 along a flight path that chases the suspicious target toward the flight position of another drone. This allows the short-range drone 11 and the long-range drone 3 to corner the suspicious target with multiple short-range drones 11 and long-range drones 3, thereby preventing the suspicious target from escaping.
[0156] When a suspicious target is detected, the flight control unit 54 autonomously flies the aircraft 23 along a flight path that drives the suspicious target into a dead end. This allows the short-range drone 11 and the long-range drone 3 to drive the suspicious target into a dead end, thereby preventing the suspicious target from escaping.
[0157] The flight control unit 54 autonomously flies the aircraft 23 along a flight path that chases the suspicious target toward at least one of the nearest police station, police box, or police post, and the location of a nearby police vehicle. This allows the short-range drone 11 and the long-range drone 3 to prevent the suspicious target from escaping by chasing the suspicious target toward the nearest police station, police box, or police post, or the location of a nearby police vehicle.
[0158] The tracking system 1 includes a short-range drone 11, a long-range drone 3, and a tracking robot 2. The tracking robot 2 includes a robot main body 10, a suspicious object detection unit 35, a drone control unit 36, and a robot control unit 37. The robot main body 10 is capable of launching and landing the short-range drone 11 and autonomously traveling. The suspicious object detection unit 35 detects suspicious objects around the robot main body 10. The drone control unit 36 controls the short-range drone 11 and the long-range drone 3 to track the suspicious object detected by the suspicious object detection unit 35. The robot control unit 37 causes the robot main body 10 to autonomously travel so as to track the suspicious object detected by the suspicious object detection unit 35. This enables the tracking system 1 to prevent the suspicious object from escaping.
[0159] Third Embodiment Here, differences from the above-described embodiments will be mainly described, and descriptions of the same configurations and processes as the above-described embodiments will be omitted.
[0160] The tracked robot 2 according to the third embodiment will be described with reference to Fig. 13. Fig. 13 is a diagram showing an outline of the tracked robot 2 according to the third embodiment.
[0161] The robot body 10 of the tracked robot 2 further includes rollers 14. The rollers 14 are provided on the legs 10b. Specifically, the rollers 14 are provided on the lower ends of the legs 10b. A plurality of rollers 14 are provided for each leg 10b. For example, four rollers 14 are provided for each leg 10b. However, the number of rollers 14 for each leg 10b is not limited to this.
[0162] The rollers 14 can rotate relative to the legs 10b. For example, the rollers 14 rotate when rotation generated by a motor is transmitted to the rollers 14. The rotation of the rollers 14 enables the robot body 10 to move.
[0163] The roller 14 may have a speed reduction mechanism such as a gear. The leg 10b is provided with a locking mechanism that can lock the roller 14 so that it does not rotate. For example, the locking mechanism locks the rotation axis of the roller 14.
[0164] The locking mechanism locks the roller 14 so that it does not rotate relative to the leg 10b, for example, by engaging a claw with a gear provided on the rotation shaft of the roller 14. When the engagement between the gear and the claw is released, the roller 14 can rotate relative to the leg 10b. Note that the above-described locking mechanism is an example and is not limited to this.
[0165] The robot body 10 can move by a first movement or a second movement. The first movement is a movement method in which the legs 10b move. The second movement is a movement method in which the rollers 14 rotate.
[0166] In the first travel, the roller 14 is locked by the locking mechanism so as not to rotate relative to the leg 10b, and in the second travel, the roller 14 is released from the locking mechanism.
[0167] This allows the tracked robot 2 to stabilize its running during the first run.
[0168] The traveling speed in the second traveling mode is faster than the traveling speed in the first traveling mode. That is, the moving speed of the robot body 10 by the rollers 14 is faster than the traveling speed of the robot body 10 by the movement of the legs 10b.
[0169] As a result, when a suspicious object is detected, the tracked robot 2 can track the suspicious object by running in the second running mode. Therefore, the tracked robot 2 can catch up with the suspicious object early, for example. Therefore, the tracked robot 2 can improve the tracking ability of the suspicious object.
[0170] The arm 10c has fingers 10e at its tip. For example, five fingers 10e are provided at the tip of the arm 10c. Each finger 10e can be bent by a driving mechanism such as a motor.
[0171] The robot control unit 37 of the control device 13 controls the driving of the legs 10b, rollers 14, and arms 10c of the robot body 10, thereby causing the robot body 10 to travel autonomously. Based on various information detected by the detection unit 12, the robot control unit 37 controls the driving of the legs 10b, rollers 14, and arms 10c of the robot body 10, for example, so that the robot body 10 travels while avoiding obstacles.
[0172] The robot control unit 37 switches the running method of the robot body 10. The robot control unit 37 switches the running method of the robot body 10 between a first running method using the movement of the legs 10b and a second running method using the rotation of the rollers 14.
[0173] This allows the tracked robot 2 to track a suspicious object while switching the running method, thereby improving the trackability of the tracked robot 2 for the suspicious object.
[0174] For example, when no suspicious object is detected, the robot control unit 37 sets the travel method of the robot body 10 to the first travel. When the robot control unit 37 causes the robot body 10 to travel in the first travel mode, the robot control unit 37 locks the rollers 14 by the locking mechanism so that they do not rotate.
[0175] When it is necessary to make the robot body 10 travel at a speed faster than the first travel, the robot control unit 37 sets the travel method of the robot body 10 to the second travel. For example, when a suspicious object is detected and the suspicious object is to be tracked, the robot control unit 37 sets the travel method of the robot body 10 to the second travel.
[0176] When the robot main body 10 is made to travel in the second traveling mode, the robot control unit 37 stops the movement of the leg 10b. For example, the robot control unit 37 sets the leg 10b to a predetermined position. The predetermined position is a position set in advance, and is a position where the robot main body 10 assumes a posture suitable for traveling in the second traveling mode by rotation of the rollers 14. For example, the predetermined position is a position where the center of gravity of the robot main body 10 is at a height that is less than half the total length of the tracked robot 2. For example, the predetermined position is a position where the robot main body 10 assumes a crouching posture. In addition, the robot control unit 37 releases the locking mechanism and rotates the rollers 14.
[0177] Even when the robot control unit 37 starts tracking a suspicious object, for example, when the robot main body 10 goes up and down stairs or overcomes a step, the robot control unit 37 sets the running method of the robot main body 10 to the first running.
[0178] Here, an example has been described in which the running mode of the robot body 10 is switched between the first running mode and the second running mode depending on whether a suspicious object is detected, but the present invention is not limited to this. For example, the robot body 10 may mainly run using the second running mode, and may run using the first running mode when ascending or descending stairs or climbing over steps. The conditions for switching the running mode of the robot may be configurable.
[0179] Next, the travel switching process according to the third embodiment will be described with reference to Fig. 14. Fig. 14 is a flowchart illustrating the travel switching process according to the third embodiment. The travel switching process is executed by the control device 13 of the tracked robot 2.
[0180] The control unit 32 acquires various pieces of information detected by the detection unit 12 (S400). The control unit 32 determines whether a suspicious object has been detected based on the acquired various pieces of information (S401). For example, the control unit 32 detects a suspicious object by performing predetermined image processing on an image captured by a high-sensitivity camera.
[0181] If no suspicious object is detected (S401: No), the control unit 32 sets the traveling method of the robot body 10 to the first traveling method (S402).
[0182] When a suspicious object is detected (S401: Yes), the control unit 32 sets the traveling method of the robot body 10 to the second traveling method (S403).
[0183] The tracking robot 2 comprises a short-range drone 11, a robot main body 10, a detection unit 12, and a control unit 32. The short-range drone 11 is capable of detecting suspicious objects. The robot main body 10 is capable of launching and landing the short-range drone 11 and of autonomous travel. The detection unit 12 detects the situation around the robot main body 10. The control unit 32 controls the short-range drone 11 and causes the robot main body 10 to travel autonomously in accordance with the situation detected by the detection unit 12. The robot main body 10 comprises a body 10a, legs 10b, and rollers 14. The legs 10b are movably attached to the body 10a. The rollers 14 are provided on the legs 10b and move the robot main body 10. The control unit 32 is capable of switching between a first travel mode using the movement of the legs 10b and a second travel mode using the rollers 14.
[0184] This allows the tracked robot 2 to track a suspicious object while switching the running method, thereby improving the trackability of the tracked robot 2 for the suspicious object.
[0185] Furthermore, the movement speed of the robot body 10 during the second running is faster than the movement speed of the robot body 10 during the first running.
[0186] As a result, when a suspicious object is detected, the tracked robot 2 can track the suspicious object by traveling in the second traveling mode. Therefore, the tracked robot 2 can catch up with the suspicious object early, for example. Therefore, the tracked robot 2 can improve the tracking ability of the suspicious object.
[0187] When the robot body 10 is caused to travel in the first travel mode, the control unit 32 locks the rollers 14 so that they do not rotate.
[0188] This allows the tracked robot 2 to stabilize its running during the first run.
[0189] The short-range drone 11 can emit a tracking mark 21 toward a suspicious object.
[0190] As a result, the tracking robot 2 can track the suspicious object by tracking the tracking mark 21. Therefore, the tracking robot 2 can easily identify the suspicious object, making it easier to track the suspicious object and accurately identifying the suspicious object. Therefore, the tracking robot 2 can improve the tracking ability of the suspicious object.
[0191] Fourth Embodiment Here, differences from the above-described embodiments will be mainly described, and descriptions of the same configurations and processes as the above-described embodiments will be omitted.
[0192] The tracked robot 2 according to the fourth embodiment will be described with reference to Fig. 15. Fig. 15 is a diagram showing an outline of the tracked robot 2 according to the fourth embodiment.
[0193] For ease of explanation, Figure 15 and Figure 16 (described later) illustrate a three-dimensional Cartesian coordinate system in which mutually orthogonal X-, Y-, and Z-axis directions are defined, with the positive Z-axis direction being the vertically upward direction. In the following, the positive X-axis direction may be referred to as the "right," the negative X-axis direction as the "left," the positive Y-axis direction as the "forward," and the negative Y-axis direction as the "rearward." Therefore, in the following description, the X-axis direction may be referred to as the left-right direction, the Y-axis direction as the front-rear direction, and the Z-axis direction as the up-down direction (vertical direction).
[0194] The robot body 10 of the tracked robot 2 is provided with a battery 100. The robot body 10 is powered by the battery 100. The battery 100 may be, for example, a secondary battery such as a lithium ion battery or a lead battery, but is not limited to these.
[0195] The configuration of the battery 100 will now be described in detail with reference to Fig. 16. Fig. 16 is a rear view of the tracked robot 2 according to the fourth embodiment as seen from behind. Note that, for the sake of simplicity, Fig. 16 omits the illustration of the short-range drone 11, the arm 10c, and the like. For ease of understanding, Fig. 16 also shows the interior of the base unit 15 in a see-through manner.
[0196] 16 , the battery 100 is housed (stored) inside the base unit 15. That is, the base unit 15 functions as a storage unit (storage section) that stores the battery 100. Note that, although an example in which the base unit 15 stores the battery 100 is shown here, the present invention is not limited to this, and for example, a configuration may be adopted in which a storage section for the battery 100 is provided separately from the base unit 15.
[0197] The battery 100 is configured to be movable relative to the robot main body 10. For example, the battery 100 is attached to a mounting base 110. The mounting base 110 is fixed inside the base unit 15. The mounting base 110 is provided with a movement mechanism (not shown) for moving the battery 100. This movement mechanism allows the battery 100 to move freely on the mounting base 110, specifically, to move freely in the left-right direction (X-axis direction).
[0198] As the movement mechanism, a rack and pinion mechanism driven by the driving force of a motor, or a ball screw mechanism driven by the driving force of a motor, etc. can be used, but these are merely examples and are not limiting.
[0199] 16, a position at or near the center in the left-right direction of the robot main body 10 is set as the reference position, and the battery 100 at the reference position is indicated by a solid line. The state in which the battery 100 has moved leftward from the reference position is indicated by a dashed line (see arrow A1). The state in which the battery 100 has moved rightward from the reference position is indicated by a two-dot chain line (see arrow A2).
[0200] As described above, in the tracked robot 2 according to the fourth embodiment, the battery 100 moves relative to the robot body 10, thereby moving the center of gravity B of the robot body 10. Specifically, since the battery 100 is relatively heavy, moving the battery 100 leftward from the reference position moves the center of gravity B of the robot body 10 leftward (see arrow C1). Also, moving the battery 100 rightward from the reference position moves the center of gravity B of the robot body 10 rightward (see arrow C2). The movement control for moving the battery 100 described above is executed when the robot body 10 is running, which will be described later.
[0201] The battery 100 is an example of a moving part that moves relative to the robot main body 10. While the example shown here is the battery 100 as the moving part, the moving part is not limited to this, and may be anything else, such as a weight, as long as it can move the center of gravity B. Also, while Figure 16 shows an example in which the center of gravity B of the robot main body 10 is located near the bottom of the trunk 10a, this is merely an example and is not limiting.
[0202] Next, the control device 13 (see Fig. 15) will be described with reference to Fig. 17. Fig. 17 is a functional block diagram showing an outline of the control device 13 of the tracked robot 2 according to the fourth embodiment.
[0203] The storage unit 31 of the control device 13 stores curve information 31a and movement information 31b.
[0204] The curve information 31a is information about curved roads included in the travel route along which the robot body 10 travels. The curve information 31a includes, for example, information about the shape of the curved road, information about the position of the curved road, etc. The information about the shape of the curved road includes, for example, the curvature of the curved road, which indicates the degree of the curve of the curved road.
[0205] The movement information 31b is information relating to the movement of the battery 100 described above. The movement information 31b will be described with reference to Fig. 18. Fig. 18 is a diagram showing an example of the movement information 31b. As shown in Fig. 18, the movement information 31b includes information such as "curvature of a curved road" and "movement distance."
[0206] "Curvature of curved road" is information indicating the curvature of a curved road. "Large" in "Curvature of curved road" indicates, for example, that the curve is relatively sharp on the curved road and the curvature is greater than a predetermined range. "Medium" in "Curvature of curved road" indicates, for example, that the curve is medium on the curved road and the curvature is within a predetermined range. "Small" in "Curvature of curved road" indicates, for example, that the curve is relatively gentle on the curved road and the curvature is smaller than the predetermined range. The above-mentioned predetermined range is set to a range indicating that the curve is medium.
[0207] "Movement distance" is information indicating the distance that the battery 100 has moved from the reference position. "Long" in "Movement distance" indicates that the distance that the battery 100 has moved from the reference position is relatively long, in other words, that the battery 100 has moved a relatively long distance from the reference position. "Medium" in "Movement distance" indicates that the distance that the battery 100 has moved from the reference position is medium, in other words, that the battery 100 has moved a medium distance from the reference position. "Short" in "Movement distance" indicates that the distance that the battery 100 has moved from the reference position is relatively short, in other words, that the battery 100 has moved a relatively short distance from the reference position.
[0208] In the example of Figure 18, if the curvature of the curved road is "large," it indicates that the travel distance of the battery 100 is "long." Also, if the curvature of the curved road is "medium," it indicates that the travel distance of the battery 100 is "medium." Also, if the curvature of the curved road is "small," it indicates that the travel distance of the battery 100 is "short."
[0209] 18 shows an example in which the curvature of the curved road in the travel information 31b is divided into three stages, but this is not limited to this and may be divided into, for example, two stages or four or more stages. Also, the travel distance in the travel information 31b may be constant regardless of the curvature of the curved road.
[0210] The travel path of the robot body 10 described above may include a curved road. When the robot body 10 travels on a curved road, the robot control unit 37 according to the fourth embodiment moves the battery (movement unit) 100 to move the center of gravity B (see FIG. 16 ) of the robot body 10. This improves the travel performance of the robot body 10.
[0211] Specifically, after setting a travel route, the robot control unit 37 determines whether the travel route includes a curved road. If the robot control unit 37 determines that the travel route includes a curved road, it acquires curve information about the curved road from map information or the like, and stores the acquired information as curve information 31a in the storage unit 31. The robot control unit 37 may acquire the map information and curve information from an external server, or may acquire information that has been previously stored in the storage unit 31.
[0212] Next, the robot control unit 37 reads out the curve information 31a and movement information 31b from the storage unit 31, and determines the movement distance of the battery 100 when the robot body 10 travels on a curved road.
[0213] For example, if the curvature of the curved road, which indicates the shape of the curved road in the curve information 31a, is greater than a predetermined range (if "large" in the movement information 31b), the robot control unit 37 determines the travel distance of the battery 100 to be a relatively long value ("long" in the movement information 31b). Also, if the curvature of the curved road is within a predetermined range (if "medium" in the movement information 31b), the robot control unit 37 determines the travel distance of the battery 100 to be a medium value ("medium" in the movement information 31b). Also, if the curvature of the curved road is smaller than the predetermined range (if "small" in the movement information 31b), the robot control unit 37 determines the travel distance of the battery 100 to be a relatively short value ("short" in the movement information 31b).
[0214] When the robot body 10 travels on a curved road, the robot control unit 37 moves the battery 100 to move the center of gravity B of the robot body 10. In detail, when the robot body 10 travels on a curved road, the robot control unit 37 moves the battery 100 from the reference position toward the inside of the curved road by the determined movement distance, thereby moving the center of gravity B of the robot body 10.
[0215] Specifically, the robot control unit 37 moves the battery 100 to the left from the reference position when the robot body 10 is traveling on a curved road that turns left, and moves the battery 100 to the right from the reference position when the robot body 10 is traveling on a curved road that turns right.
[0216] In this embodiment, the movement of the battery 100 is controlled as described above, so that the robot body 10 can turn while moving the center of gravity B to the inside of the curved road. This makes it possible to stabilize the posture of the robot body 10 when traveling on a curved road, thereby improving the traveling performance of the robot body 10.
[0217] Furthermore, when the robot body 10 travels around a curved road in the first travel state or the second travel state, the robot control unit 37 moves the battery 100 to move the center of gravity B of the robot body 10, but this is not limited to this. For example, the robot control unit 37 may control the movement of the battery 100 only when the robot body 10 travels around a curved road in the first travel state, or may control the movement of the battery 100 only when the robot body 10 travels around a curved road in the second travel state. In other words, the robot control unit 37 may control the movement of the battery 100 when the robot body 10 travels around a curved road in at least one of the first travel state and the second travel state.
[0218] The travel distance of the battery 100 may be set to be different between the first and second travels. Specifically, as described above, the travel speed during the second travel is faster than the travel speed during the first travel. Therefore, even when the robot body 10 travels along the same curved road, for example, the travel distance of the battery 100 during the second travel may be set to be longer than the travel distance of the battery 100 during the first travel, so that the center of gravity B during the second travel is moved further than during the first travel. This makes it possible to further stabilize the posture of the robot body 10 when traveling along a curved road depending on the travel state (here, the first travel or the second travel), thereby further improving the traveling performance of the robot body 10.
[0219] Next, the control processing procedure of the robot main body 10 executed by the control device 13 of the tracked robot 2 will be described with reference to Fig. 19. Fig. 19 is a flowchart showing the control processing procedure of the robot main body 10 executed by the control device 13.
[0220] 19 , the control unit 32 of the control device 13 acquires various pieces of information detected by the detection unit 12 (step S500). The control unit 32 determines whether a suspicious object has been detected based on the acquired various pieces of information (step S501). For example, the control unit 32 detects the suspicious object by performing predetermined image processing on an image captured by a high-sensitivity camera.
[0221] If no suspicious object is detected (step S501: No), the control unit 32 sets the traveling method of the robot body 10 to the first traveling mode (step S502).
[0222] If a suspicious object is detected (step S501: Yes), the control unit 32 sets the traveling method of the robot body 10 to the second traveling method (step S503).
[0223] Next, the control unit 32 sets a travel route for the robot body 10 (step S504). If a suspicious object has been detected, the control unit 32 sets a travel route so as to track the suspicious object.
[0224] Next, the control unit 32 determines whether the set travel route includes a curved road (step S505). If the control unit 32 determines that the travel route does not include a curved road (step S505: No), the control unit 32 skips the subsequent processing.
[0225] On the other hand, if the control unit 32 determines that the travel route includes a curved road (step S505: Yes), the control unit 32 acquires curve information for the curved road (step S506). Next, the control unit 32 determines the travel distance of the battery 100 based on the shape of the curved road in the curve information (step S507).
[0226] Next, the control unit 32 determines whether the robot body 10 is traveling on a curved road (step S508). If the control unit 32 determines that the robot body 10 is not traveling on a curved road (step S508: No), the control unit 32 repeats the processing of step S508. If the control unit 32 determines that the robot body 10 is traveling on a curved road (step S508: Yes), the control unit 32 executes movement control of the battery 100 (step S509). For example, the control unit 32 controls the battery 100 to move from the reference position toward the inside of the curved road by the movement distance determined in step S507, thereby moving the center of gravity position B of the robot body 10.
[0227] As described above, the tracking robot 2 according to the embodiment includes a short-range drone 11 (an example of a drone), a robot body 10, a battery 100 (an example of a moving unit), a detection unit 12, and a control unit 32. The short-range drone 11 is configured to be able to track a suspicious object. The robot body 10 is configured to enable the short-range drone 11 to take off and land and to travel autonomously. The battery 100 is provided on the robot body 10 and is configured to be movable relative to the robot body 10. The detection unit 12 detects the situation around the robot body 10. The control unit 32 controls the short-range drone 11 and causes the robot body 10 to travel autonomously in accordance with the situation detected by the detection unit 12. When the robot body 10 travels on a curved road, the control unit 32 moves the battery 100 to move the center of gravity B of the robot body 10. This improves the traveling performance of the robot body 10 traveling on a curved road.
[0228] The moving part is the battery 100. As a result, even with a simple configuration using the battery 100 provided in the robot body 10, the center of gravity of the robot body 10 can be moved by moving the battery 100.
[0229] The robot body 10 also includes a trunk 10a, legs 10b, and rollers 14. The legs 10b are movably attached to the trunk 10a. The rollers 14 are attached to the legs 10b and move the robot body 10. The control unit 32 can switch between a first traveling mode using the movable legs 10b and a second traveling mode using the rollers 14. When the robot body 10 travels around a curved road in at least one of the first traveling mode and the second traveling mode, the control unit 32 moves the battery 100 to shift the center of gravity of the robot body 10. This allows the robot body 10 to stabilize its posture when traveling around a curved road depending on its traveling mode (e.g., first traveling mode, second traveling mode), thereby further improving the traveling performance of the robot body 10.
[0230] Furthermore, the control unit 32 acquires curve information relating to the shape of curved roads included in the travel route of the robot body 10, and determines the travel distance of the battery 100 based on the shape of the curved road in the acquired curve information. This makes it possible to determine the travel distance of the battery 100 in accordance with the shape of the curved road, thereby making it possible to further stabilize the posture of the robot body 10 when traveling on a curved road, and further improving the travel performance of the robot body 10.
[0231] Furthermore, the tracking route of the suspicious object is generated using a sentence generation model, which makes it possible to generate, for example, a driving route including the tracking route with high accuracy.
[0232] Fifth Embodiment Here, the following description will focus on differences from the above-described embodiments, and will omit descriptions of the same configurations and processes as the above-described embodiments. In the fifth embodiment, a tracking robot 60 is different from the tracking robot 2 of the above-described embodiments.
[0233] As shown in Fig. 20, the tracked robot 60 includes a robot main body 61, a short-range drone 11, a detection unit 12, and a control device 13. Fig. 20 is a diagram illustrating an outline of the tracked robot 60 according to the fifth embodiment.
[0234] The robot body 61 includes a trunk 61a, legs 61b, arms 61c, and a head 61d. The trunk 61a includes an upper body 61e and a storage section 61f.
[0235] Arms 61c and head 61d are movably attached to upper body 61e. Storage section 61f is provided below upper body 61e. Upper body 61e may be movably attached to storage section 61f. For example, upper body 61e is attached to storage section 61f so as to be rotatable in the front-to-back and left-to-right directions. Furthermore, upper body 61e may be attached so as to be rotatable around a virtual axis in the up-down direction.
[0236] The storage portion 61f is formed in a box shape. The storage portion 61f is formed to be open at the top. That is, the storage portion 61f has a bottom 61g and is formed to be recessed from top to bottom.
[0237] The storage section 61f stores the short-range drone 11. The short-range drone 11 takes off and lands in the storage section 61f. Specifically, the short-range drone 11 takes off and lands on the bottom 61g of the storage section 61f.
[0238] The legs 61b are movably attached to the storage portion 61f. Three or more legs 61b are provided. Specifically, four legs 61b are provided. The four legs 61b are provided at one each of the left and right ends on the front side and one each of the left and right ends on the rear side.
[0239] Rollers 62 are provided at the lower ends of the legs 61b. For example, one roller 62 is provided for each leg 61b. However, the number of rollers 62 for each leg 61b is not limited to this. The rotation speed of each roller 62 can be controlled individually. For example, the rotation speed of each roller 62 can be controlled to be the same.
[0240] Furthermore, the rotation speed of at least some of the rollers 62 can be controlled to be different from the rotation speed of the other rollers 62. For example, by making the rotation speed of the left roller 62 slower than the rotation speed of the right roller 62, the robot body 61 can turn left.
[0241] The rotation direction of each roller 62 can be controlled individually. The robot body 61 may be configured such that the steering angle of the legs 61b or the rollers 62 can be changed.
[0242] The robot body 61 can move in a first direction and a second direction using the four legs 61b.
[0243] The arms 61c are movably attached to the upper body 61e. One arm 61c is provided at each of the left and right ends of the upper body 61e. That is, two arms 61c are provided. However, the number of arms 61c is not limited to this. For example, one arm 61c may be provided on the upper body 61e, or three or more arms 61c may be provided.
[0244] In the robot main body 61, motors are provided as joints connecting the various parts at locations where the various parts are movably connected, for example, at locations corresponding to the joints of a human being. The various parts are moved by the motors, thereby realizing various movements of the robot main body 61. The motors can also absorb vibrations of the robot main body 61.
[0245] Furthermore, detection sensors such as gyroscopes that detect the movement of each part are provided at the locations where each part is movably connected, so that the vibrations and movements of each part can be detected by the detection sensors.
[0246] The robot control unit 37 (see Figure 3) controls each motor according to various information detected by the detection unit 12 and the detection results of detection sensors such as gyroscopes, and can, for example, control the weight shift of the robot main body 61 and adjust the balance of the robot main body 61.
[0247] It should be noted that the use of the robot body 61 is not limited to the tracking system 1. The robot body 61 may be, for example, a cart robot that collects packages (items) in a warehouse. The packages are stored in the storage section 61f. The robot body 61 picks up a specified package (item) from a shelf in the warehouse and transports it to a specified delivery location. The robot body 61 may also transport packages within a building, for example, an office building.
[0248] Although the present invention has been described above using embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. It will be apparent to those skilled in the art that various modifications and improvements can be made to the above embodiments. It is clear from the claims that such modifications and improvements can also be included within the technical scope of the present invention.
[0249] It should be noted that the order of execution of each process, such as operations, procedures, steps, and stages, in the devices, systems, programs, and methods shown in the claims, specifications, and drawings is not specifically stated as "before," "prior to," etc., and that the processes can be performed in any order unless the output of a previous process is used in a subsequent process. Even if the operational flow in the claims, specifications, and drawings is described using "first," "next," etc. for convenience, this does not mean that the processes must be performed in this order.
[0250] REFERENCE SIGNS LIST 1 Tracking system 2, 60 Tracked robot 3 Long-range drone 4 Management device 10, 61 Robot body 10a, 61a Body 10b, 61b Legs 11 Short-range drone 12 Detection unit 13 Control device 14, 62 Roller 20 Camera 21 Tracking mark 32 Control unit 35 Suspicious object detection unit 36 Drone control unit 37 Robot control unit 61f Storage unit
Claims
1. A tracking robot comprising: a drone capable of tracking a suspicious target and firing a tracking mark at the suspicious target; a robot body from which the drone can take off and land and which can travel autonomously; a detection unit which detects the situation around the robot body; and a control unit which controls the drone and causes the robot body to travel autonomously in accordance with the situation detected by the detection unit, wherein when the suspicious target is detected, the control unit launches the drone from the robot body and fires the tracking mark from the drone towards the suspicious target.
2. The tracked robot according to claim 1, wherein the tracking mark acquires position information of the tracking mark and transmits the position information of the tracking mark.
3. The tracking robot described in claim 1, wherein the position information of the tracking mark is transmitted to a tracking drone having a longer flight distance than the drone, and the tracking drone flies to track the suspicious subject based on the position information of the tracking mark.
4. The tracking robot described in claim 1, wherein the control unit controls the robot body and at least one of the drone to track the suspicious subject based on a predicted escape route predicted from the position information of the tracking mark.
5. The tracked robot of claim 1, wherein at least one piece of information regarding the travel path of the robot body, the flight path of the drone, and the flight path of a tracking drone having a longer flight distance than the drone is generated by a sentence generation model.
6. A tracking system comprising: a tracking robot according to any one of claims 1 to 5; and a tracking drone having a longer flight distance than the drone.
7. A drone comprising: an aircraft capable of autonomous flight; a suspicious object detection unit that detects a suspicious object; and a flight control unit that, when the suspicious object is detected, causes the aircraft to fly autonomously so as to track the suspicious object and fly a flight path that blocks the object's escape route.
8. A tracking robot comprising: a drone capable of tracking a suspicious target; a robot body capable of autonomously moving and from which the drone can take off and land; a detection unit that detects the situation around the robot body; and a control unit that controls the drone and causes the robot body to autonomously move in accordance with the situation detected by the detection unit, wherein the robot body comprises a torso, legs movably attached to the torso, and rollers attached to the legs for moving the robot body, and the control unit is capable of switching between a first movement caused by movement of the legs and a second movement caused by the rollers.
9. A tracking robot comprising: a drone capable of tracking a suspicious object; a robot body capable of autonomously moving and from which the drone can take off and land; a moving unit provided on the robot body and movable relative to the robot body; a detection unit that detects the situation around the robot body; and a control unit that controls the drone and causes the robot body to autonomously move in accordance with the situation detected by the detection unit, wherein the control unit moves the moving unit to move the center of gravity of the robot body when the robot body travels on a curved road.
Citation Information
Patent Citations
User support system, user support program, and user support method
JP2018081444A
Air-ground cooperative unmanned detection system
CN117073639A
Robot dog
JP2010046742A
Flight altitude control device, unmanned aerial vehicle, flight altitude control method, and flight altitude control program
JP2017138947A
Security system
JP2018018161A
