Tracking robot and tracking system

The tracking robot system, with a drone and autonomous robot body, addresses the challenge of tracking escaping suspicious objects by launching a tracking mark, ensuring continuous and effective engagement.

JP2024168710APending Publication Date: 2024-12-05SOFTBANK GROUP CORP
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023085606
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-24
Publication Date
2024-12-05

AI Technical Summary

Technical Problem

Conventional systems fail to effectively track suspicious objects that attempt to escape after detection.

Method used

A tracking robot equipped with a drone that can launch a tracking mark towards the suspicious object, a robot body capable of autonomous movement, and a detection unit to control the drone's flight path, allowing it to autonomously track and engage the target.

Benefits of technology

Enables effective tracking of suspicious objects by launching a tracking mark, improving the ability to follow and identify the object even if direct line of sight is lost.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024168710000001_ABST
    Figure 2024168710000001_ABST
Patent Text Reader

Abstract

To track a suspicious target.SOLUTION: A tracking robot according to an embodiment comprises: a drone capable of tracking a suspicious target and firing a tracking mark toward the suspicious target; a robot main body on which the drone can take off and land, and which can move autonomously; a detection unit which detects a situation around the robot main body; and a control unit which controls the drone and makes the robot main body autonomously move according to the situation detected by the detection unit. The control unit launches the drone from the robot main body when the suspicious target is detected, and the control unit fires the tracking mark from the drone toward the suspicious target.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The disclosed embodiments relate to a tracked robot and a tracking system. [Background technology]

[0002] Conventionally, there is known a system in which, when a vehicle is harmed, a drone takes off from the vehicle and photographs the vehicle and its surroundings with a camera mounted on the drone (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-93618 A Summary of the Invention [Problem to be solved by the invention]

[0004] Conventional techniques have a problem in that, for example, when a suspicious object is detected and then escapes, the suspicious object cannot be tracked.

[0005] The present invention has been made in consideration of the above, and has an object to track a suspicious target. [Means for solving the problem]

[0006] A tracking robot according to one aspect of an embodiment includes a drone capable of tracking a suspicious object and emitting a tracking mark toward the suspicious object, a robot body capable of autonomously moving and from which the drone can take off and land, a detection unit that detects the situation around the robot body, and a control unit that controls the drone and causes the body to autonomously move in response to the situation detected by the detection unit. When a suspicious object is detected, the control unit launches the drone from the robot body and emits a tracking mark from the drone toward the suspicious object. Effect of the Invention

[0007] According to one aspect of the embodiment, a suspicious object may be tracked. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing an outline of a tracking system according to an embodiment. [Diagram 2] FIG. 2 is a diagram illustrating an outline of a tracked robot according to an embodiment. [Diagram 3] FIG. 3 is a functional block diagram showing an outline of a control device of a tracked robot according to an embodiment. [Figure 4] FIG. 4 is a functional block diagram illustrating an overview of a management device according to an embodiment. [Diagram 5] FIG. 5 is a flowchart illustrating a control process of the short-range drone according to the embodiment. [Figure 6] FIG. 6 is a flowchart illustrating a control process for a long-range drone according to the embodiment. [Figure 7A] FIG. 7A is a diagram showing an example of a flight of a long-range drone before a tracking mark is emitted. [Figure 7B] FIG. 7B is a diagram showing an example of the flight of a long-range drone after a tracking mark has been attached to a suspicious target. [Figure 8] FIG. 8 is a diagram illustrating an example of a computer hardware configuration that functions as a mobile object control device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] The present invention will be described below through embodiments, but the following embodiments do not limit the scope of the invention according to the claims. In addition, not all of the combinations of features described in the embodiments are necessarily essential to the solution of the invention.

[0010] A tracking system 1 according to an embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram showing an outline of the tracking system 1 according to an embodiment.

[0011] The tracking system 1 includes a tracking robot 2, a long-range drone 3, and a management device 4. The tracking robot 2, the long-range drone 3, and the management device 4 are connected via a network N. For example, a plurality of tracking robots 2 and a plurality of long-range drones 3 are provided.

[0012] The network N is, for example, a mobile communication network such as LTE (Long Term Evolution), 5G, etc. The tracked robot 2 and the long-range drone 3 may be connected via the network N.

[0013] Next, the tracked robot 2 will be described with reference to Fig. 2. Fig. 2 is a diagram showing an outline of the tracked robot 2 according to the embodiment.

[0014] The tracking robot 2 includes a robot body 10, a short-range drone 11, a detection unit 12, and a control device 13. The tracking robot 2 is capable of autonomous driving, and when a suspicious object is detected, it tracks the suspicious object. Suspicious objects include, for example, a person who is behaving suspiciously and the perpetrator of a crime. In addition, the suspicious object is not limited to a person, and may be a vehicle carrying a person who is behaving suspiciously.

[0015] The robot body 10 is, for example, a humanoid robot. The robot body 10 includes a torso 10a, legs 10b, arms 10c, and a head 10d. The legs 10b, arms 10c, and head 10d are movably attached to the torso 10a. The robot body 10 is not limited to a humanoid robot. The robot body 10 is provided with a driving mechanism such as a motor that moves each part, such as the legs 10b, arms 10c, and head 10d.

[0016] A base unit 15 from which the short-range drone 11 can take off and land is provided on the back of the body unit 10a. The base unit 15 includes a charging device that charges the battery of the short-range drone 11. The base unit 15 may also include a replacement battery for the short-range drone 11.

[0017] The short-range drone 11 is an example of a moving object. The short-range drone 11 is a multicopter equipped with multiple (for example, four) rotor propellers, and performs unmanned autonomous flight. The short-range drone 11 is also powered by a battery.

[0018] The short-range drone 11 includes a camera 20 and a tracking mark 21. The tracking mark 21 is launched from the short-range drone 11. The short-range drone 11 includes a launching device that launches the tracking mark 21.

[0019] For example, when the tracking mark 21 is projected toward a suspicious object, it adheres to the suspicious object. For example, the tracking mark 21 is provided with a magnet. For example, when the suspicious object is a vehicle, the tracking mark 21 adheres to the suspicious object by magnetic force. The tracking mark 21 may have adhesive properties.

[0020] The tracking mark 21 has, for example, a positioning device. The positioning device is, for example, a Global Navigation Satellite System (GNSS), and can receive radio waves from navigation satellites orbiting in the sky to perform positioning and timing. The positioning device also includes a communication module that transmits its own detected position information. The position information of the tracking mark 21 detected by the positioning device is transmitted to the management device 4 via the network N. The position information of the tracking mark 21 detected by the positioning device is transmitted to the control device 13 via the network N. When the tracking mark 21 is attached to a suspicious object, the position of the suspicious object is detected based on the position information transmitted from the positioning device.

[0021] The tracking mark 21 may be a ball containing fluorescent paint. The ball containing fluorescent paint explodes when it hits a suspicious object, and the fluorescent paint adheres to the suspicious object. The short-range drone 11 may be provided with multiple types of tracking marks 21.

[0022] The short-range drone 11 includes a communication module for performing wireless communication via the network N. The short-range drone 11 also includes various sensors such as an acceleration sensor, a gyro sensor, and an optical sensor.

[0023] The short-range drone 11 also has a positioning device 22 for measuring its own position. The positioning device 22 is, for example, a GNSS. Position information of the short-range drone 11 detected by the positioning device 22 may be transmitted to the management device 4 via the network N. Position information of the short-range drone 11 detected by the positioning device 22 may be transmitted to the control device 13 via the network N. The short-range drone 11 also has a computer (for example, a microcomputer) that executes a flight control function, an attitude control function for controlling the attitude, and the like.

[0024] The short-range drone 11 acquires information about the first flight route from the control device 13 via the communication module. The information about the first flight route includes position information (e.g., latitude, longitude, and altitude) of the first flight route. The first flight route is a flight route for tracking a suspicious target.

[0025] The short-range drone 11 transmits images captured by the camera 20 to the management device 4 via the communication module. The short-range drone 11 transmits images captured by the camera 20 to the control device 13 via the communication module. The short-range drone 11 acquires information about the emission signal of the tracking mark 21 from the control device 13 via the communication module.

[0026] When a suspicious target is detected, the short-range drone 11 launches from the base unit 15 of the robot body 10. The short-range drone 11 acquires information about the first flight path, and flies along the first flight path to track the suspicious target. The short-range drone 11 executes image processing based on an image captured by the camera 20, and flies along the first flight path while avoiding obstacles. When a signal to launch the tracking mark 21 is acquired, the short-range drone 11 launches the tracking mark 21. The short-range drone 11 launches the tracking mark 21 toward the suspicious target.

[0027] The detection unit 12 is provided, for example, in the head 10d of the robot body 10. The detection unit 12 may be provided in the torso 10a of the robot body 10, etc. The detection unit 12 detects the surrounding situation of the robot body 10. The detection unit 12 includes, for example, a high-sensitivity camera capable of 360-degree sensing, a LiDAR (light detection and ranging), a thermo camera, and a radar. The detection unit 12 may include sensors for vision recognition, fine sound, ultrasonic waves, vibration, infrared rays, ultraviolet rays, electromagnetic waves, etc. A plurality of detection units 12 may be provided. The detection unit 12 may be a plurality of types of sensors, etc.

[0028] The detection unit 12 also includes a positioning device. The positioning device is, for example, a GNSS. The positioning device detects the position of the robot main body 10. Information on the detected position of the robot main body 10 is transmitted to the management device 4 via the network N.

[0029] As shown in Fig. 3, the control device 13 includes a communication unit 30, a storage unit 31, and a control unit 32. Fig. 3 is a functional block diagram showing an outline of the control device 13 of the tracked robot 2 according to the embodiment.

[0030] The communication unit 30 is wirelessly connected to the network N. The communication unit 30 transmits and receives information to and from the management device 4 via the network N. The communication unit 30 transmits various information detected by the detection unit 12 to the management device 4. The communication unit 30 receives images captured by the camera 20 of the short-range drone 11. The communication unit 30 receives position information of the tracking mark 21 from the positioning device of the tracking mark 21.

[0031] The storage unit 31 is realized by, for example, a semiconductor memory element such as a random access memory (RAM) or a flash memory, or a storage device such as a hard disk drive (HDD), a solid state drive (SSD), an optical disk, etc. The storage unit 31 stores various programs and various data.

[0032] The control unit 32 is a controller and includes, for example, a microcomputer having a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM, an input / output port, and various other circuits. The control unit 32 may also be configured with hardware such as an integrated circuit, for example, an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). The control unit 32 includes a suspicious object detection unit 35, a drone control unit 36, and a robot control unit 37.

[0033] The suspicious target detection unit 35 detects a suspicious target. The suspicious target detection unit 35 detects a suspicious target based on various information detected by the detection unit 12. For example, the suspicious target detection unit 35 performs a predetermined image processing on an image captured by a high-sensitivity camera provided on the tracking robot 2 to detect a suspicious target. For example, the suspicious target detection unit 35 may detect a suspicious target according to a detection result by an infrared sensor. The suspicious target detection unit 35 may detect a suspicious target using a suspicious target detection model in AI (Artificial Intelligence).

[0034] The drone control unit 36 ​​controls the short-range drone 11 and the long-range drone 3. The drone control unit 36 ​​sets a first flight path for the short-range drone 11. The drone control unit 36 ​​sets a first flight path for tracking a detected suspicious target. The drone control unit 36 ​​sets the first flight path based on the current position information of the tracking robot 2 and the position information in which the suspicious target was detected. For example, the drone control unit 36 ​​sets the first flight path based on the current position information of the tracking robot 2, the direction in which the suspicious target was detected relative to the tracking robot 2, and the distance from the tracking robot 2 to the suspicious target.

[0035] The drone control unit 36 ​​sets a second flight path for the long-range drone 3. The drone control unit 36 ​​sets a second flight path for tracking the detected suspicious target. The drone control unit 36 ​​sets the second flight path based on the position information of the station where the long-range drone 3 is waiting and the position information of the tracking mark 21. The drone control unit 36 ​​may set the second flight path based on the position information of the long-range drone 3 and the position information of the tracking mark 21.

[0036] The drone control unit 36 ​​may set the first flight path and the second flight path based on the predicted escape route of the suspicious target. The predicted escape route is generated, for example, by an escape route prediction model. The escape route prediction model predicts the escape route of the suspicious target from the position information of the tracking robot 2, the position information of the tracking mark 21, map information, traffic information, etc., when the suspicious target is detected. The position information of the tracking mark 21 includes, for example, historical information on the position of the tracking mark 21.

[0037] For example, the escape route prediction model can use MapGPT. For example, the escape route prediction model is a text generation model (so-called AI chat engine), and may be interpreted as an algorithm and calculation for automatic dialogue processing by text. The text generation model is, for example, described in JP 2018-081444 A and chatGPT (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ) and thus detailed description thereof will be omitted. Such a sentence generation model is configured using a large language model (LLM).

[0038] For example, the drone control unit 36 ​​generates a sentence such as "A suspicious person is fleeing from east to west at the intersection of ABC town DD. What escape route is possible?" using a language generation model based on the position information of the tracking mark 21. Then, the generated sentence is input to an escape route prediction model, whereby a sentence such as "The suspicious person is likely to head to EF in ABC town" is generated. In this case, the drone control unit 36 ​​sets a first flight route and a second flight route toward "EF in ABC town."

[0039] By setting the first flight path and the second flight path based on the predicted escape route of the suspicious subject, the short-range drone 11 and the long-range drone 3 can get to the suspicious subject's destination in advance.

[0040] The set first flight path is transmitted to the short-range drone 11. The short-range drone 11 that receives the first flight path takes off from the base unit 15, flies along the first flight path, and tracks the suspicious target.

[0041] The set second flight path is transmitted to the long-range drone 3. The long-range drone 3 that receives the second flight path departs from the waiting station, flies along the second flight path, and tracks the suspicious target.

[0042] The drone control unit 36 ​​generates a launch signal for the tracking mark 21 of the short-range drone 11. For example, the drone control unit 36 ​​calculates the distance to the suspicious target from an image captured by the camera 20 of the short-range drone 11. Then, when the distance to the suspicious target is equal to or less than a predetermined distance set in advance, the drone control unit 36 ​​generates a launch signal for launching the tracking mark 21 toward the suspicious target. The generated launch signal is transmitted to the short-range drone 11. As a result, the tracking mark 21 is launched toward the suspicious target.

[0043] The robot control unit 37 sets a travel route for the robot body 10. The travel route includes a preset security route. The robot control unit 37 makes the robot body 10 travel autonomously along the travel route. The robot control unit 37 makes the robot body 10 travel autonomously in accordance with the situation detected by the detection unit 12. The robot control unit 37 makes the robot body 10 travel autonomously by controlling the drive of the legs 10b and the arms 10c of the robot body 10. The robot control unit 37 controls the drive of the legs 10b and the arms 10c of the robot body 10 based on various information detected by the detection unit 12, for example, so that the robot body 10 travels while avoiding obstacles.

[0044] Also, for example, when a suspicious object is detected, the robot control unit 37 sets a travel route to track the suspicious object. The robot control unit 37 sets a travel route to track the suspicious object, for example, based on the position information of the robot main body 10 and the position information where the suspicious object was detected. For example, the robot control unit 37 sets a travel route to track the suspicious object, based on the current position information of the robot main body 10, the direction in which the suspicious object was detected relative to the robot main body 10, and the distance from the robot main body 10 to the suspicious object.

[0045] In addition, after the short-range drone 11 takes off, the robot control unit 37 sets a travel route to track the suspicious target based on the position information of the robot body 10 and the position information of the tracking mark 21.

[0046] When a suspicious target is detected, the robot control unit 37 may set a travel route to track the suspicious target based on the predicted escape route of the suspicious target. By setting the travel route of the robot body 10 based on the predicted escape route of the suspicious target, the robot body 10 can get to the destination of the suspicious target in advance.

[0047] Returning to FIG. 1, the long-range drone 3 is an example of a moving object. The long-range drone 3 is, for example, a multicopter equipped with multiple rotor propellers, similar to the short-range drone 11, and performs unmanned autonomous flight. The short-range drone 11 is powered by a battery.

[0048] The long-range drone 3 has a longer flight distance than the short-range drone 11. The flight distance is the distance that the drone can fly on a single charge. The long-range drone 3 waits at a preset station. For example, the long-range drone 3 has a large battery to have a longer flight distance than the short-range drone 11. For example, the long-range drone 3 is larger than the short-range drone 11. The long-range drone 3 may be, for example, an airplane type.

[0049] The long-range drone 3 includes a camera, similar to the short-range drone 11. Unlike the short-range drone 11, the long-range drone 3 does not include a tracking mark. Note that the long-range drone 3 may include a tracking mark, similar to the short-range drone 11.

[0050] The long-range drone 3 includes a communication module for performing wireless communication via the network N. The long-range drone 3 also includes various sensors such as an acceleration sensor, a gyro sensor, and an optical sensor.

[0051] The long-range drone 3 also has a positioning device 39 (see FIG. 1) for measuring its own position. The positioning device 39 is, for example, a GNSS. Position information of the long-range drone 3 detected by the positioning device 39 may be transmitted to the management device 4 via the network N. Position information of the long-range drone 3 detected by the positioning device 39 may be transmitted to the control device 13 via the network N. The long-range drone 3 also has a computer (for example, a microcomputer) that executes a flight control function, an attitude control function for controlling the attitude, and the like.

[0052] The long-range drone 3 acquires information about the second flight route from the control device 13 via the communication module. The information about the second flight route includes position information (for example, latitude, longitude, and altitude) of the second flight route.

[0053] The long-range drone 3 may fly so as to take over the tracking of the suspicious target by the short-range drone 11. The long-range drone 3 may track the suspicious target simultaneously with the short-range drone 11.

[0054] The long-range drone 3 transmits images captured by the camera to the management device 4 via the communication module. The long-range drone 3 transmits images captured by the camera to the control device 13 via the communication module.

[0055] When a suspicious object is detected, the long-range drone 3 takes off from the waiting station. The long-range drone 3 acquires information about the second flight path, and flies along the second flight path to track the suspicious object. The long-range drone 3 performs image processing based on the image captured by the camera, and flies along the second flight path while avoiding obstacles.

[0056] The ability to track a suspicious target can be improved by tracking the suspicious target using the short-range drone 11 and the long-range drone 3. For example, indoors, tracking can be performed using the short-range drone 11, which is smaller than the long-range drone 3, and if the suspicious target escapes outdoors, tracking can be performed using the long-range drone 3.

[0057] The management device 4 is, for example, a server device. The management device 4 may be a cloud server. As shown in Fig. 4, the management device 4 includes a communication unit 40, a storage unit 41, and a control unit 42. Fig. 4 is a functional block diagram showing an outline of the management device 4 according to the embodiment.

[0058] The management device 4 collects various information detected by the detection unit 12 of the tracking robot 2 from the tracking robot 2 that detected the suspicious target. The management device 4 also collects various information detected by the detection unit 12 from a tracking robot 2 different from the tracking robot 2 that detected the suspicious target. The management device 4 also collects position information of each long-range drone 3 from multiple long-range drones 3.

[0059] The management device 4 may generate information regarding the travel path of the tracked robot 2. The management device 4 may also generate information regarding the first flight path of the short-range drone 11. The management device 4 may also generate information regarding the second flight path of the long-range drone 3.

[0060] The communication unit 40 is connected to the network N by wire or wirelessly. The communication unit 40 transmits and receives information between the control device 13 of the tracked robot 2, the short-range drone 11, and the long-range drone 3 via the network N.

[0061] The communication unit 40 receives various information detected by the detection unit 12 from the control device 13 of the tracked robot 2. The communication unit 40 receives images captured by the camera 20 from the short-range drone 11. The communication unit 40 receives position information from the short-range drone 11, the tracking mark 21, and the long-range drone 3. The communication unit 40 receives images captured by the camera from the long-range drone 3.

[0062] The storage unit 41 is realized by, for example, a semiconductor memory element such as a RAM or a flash memory, or a storage device such as a HDD, an SSD, an optical disk, etc. The storage unit 41 stores various programs and various data, etc. For example, the storage unit 41 stores various information detected by the detection unit 12 of each tracked robot 2, etc.

[0063] The control unit 42 is a controller and includes, for example, a microcomputer and various circuits having a CPU, a ROM, a RAM, an input / output port, etc. The control unit 42 may also be configured with hardware such as an integrated circuit, for example, an ASIC or an FPGA.

[0064] The control unit 42 may generate information regarding the travel route of the robot body 10. For example, the control unit 42 generates information regarding the travel route of the robot body 10 by a sentence generation model (a so-called AI chat engine). The sentence generation model may be interpreted as an algorithm and calculation for automatic dialogue processing by text, as described above.

[0065] The control unit 42 generates a question about the suspicious target from various pieces of information detected by the detection unit 12 of the tracked robot 2. First, the control unit 42 generates a question by, for example, a language generation model.

[0066] For example, if movement is detected by the infrared sensor of the tracked robot 2, the following question is generated: "The infrared sensor has detected this movement. Is this a suspicious person? From a criminal's perspective, what action would they take next?"

[0067] By inputting such a question into the sentence generation model, the control unit 42 generates a sentence such as, for example, "This person is likely to be a suspicious person. If he senses the presence of a person, he will take action to run away." The generated sentence is transmitted to the tracking robot 2 as information regarding the travel route, and the tracking robot 2 sets a travel route so as to approach the person presumed to be a suspicious person at a low speed.

[0068] Also, for example, when sound is detected by a sensor for detecting minute sounds in the tracked robot 2, a question such as "I can hear a beep from 2 meters away. What sound is this?" is generated.

[0069] When such a question is input to the sentence generation model, the control unit 42 generates a sentence such as, for example, "An alarm is sounding." The generated sentence is transmitted to the tracking robot 2 as information regarding the travel route, and the tracking robot 2 recognizes the target as a suspicious object and sets a travel route to approach the suspicious object via, for example, the shortest route.

[0070] The control unit 42 may similarly generate information regarding the travel route of the tracked robot 2 based on other information detected by the detection unit 12 of the tracked robot 2. The control unit 42 may generate information regarding the travel route of the tracked robot 2 based on information obtained by a high-sensitivity camera capable of 360-degree sensing, a LiDAR, a thermal camera, a radar, and the like. The control unit 42 may generate information regarding the travel route of the tracked robot 2 based on information obtained by sensors such as vision recognition, ultrasonic waves, vibrations, ultraviolet rays, and electromagnetic waves.

[0071] Similarly, information regarding the travel route of the tracking robot 2 may be generated based on a plurality of pieces of information detected by the detection unit 12 of the tracking robot 2. The control unit 42 may set the travel route of the tracking robot 2.

[0072] By generating information on the travel route of the tracking robot 2 by the document generation model, the tracking robot 2 can, for example, accurately determine a suspicious object and can move the tracking robot 2 closer to the suspicious object without being noticed by the suspicious object. Therefore, for example, the tracking robot 2 can improve the hit rate of the tracking mark 21 emitted from the short-range drone 11. In this way, by generating information on the travel route of the tracking robot 2 by the document generation model, the tracking ability of the tracking robot 2 and the like to track the suspicious object can be improved.

[0073] The control unit 42 may also generate information about at least one of the first flight path of the short-range drone 11 and the second flight path of the long-range drone 3. For example, the control unit 42 generates information about the first flight path by a sentence generation model.

[0074] For example, if a suspicious object is detected by the tracking robot 2, the suspicious object is a car, and "AA-BB" is detected as the license plate number of the suspicious object, the control unit 42 creates a sentence such as "Take a picture of the car with the license plate number AA-BB" using a language generation model. Then, the control unit 42 generates information about the first flight path by inputting the generated sentence into a sentence generation model. For example, the control unit 42 generates a flight program for the short-range drone 11 that takes a picture of the car with the license plate number "AA-BB" using the camera of the short-range drone 11 and tracks the car with the license plate number "AA-BB". Then, the control unit 42 generates the generated flight program as information about the first flight path. The generated information about the first flight path is transmitted to the short-range drone 11, so that the short-range drone 11 flies to track the car with the license plate number "AA-BB". The image captured by the camera of the short-range drone 11 is transmitted to the management device 4.

[0075] For example, by using a document generation model to generate information regarding the first flight path of the short-range drone 11, the short-range drone 11 can improve its ability to track suspicious objects.

[0076] The generation of information regarding the travel path of the tracked robot 2 using the sentence generation model may be executed by the tracked robot 2.

[0077] Next, the control process of the short-range drone 11 according to the embodiment will be described with reference to Fig. 5. Fig. 5 is a flowchart illustrating the control process of the short-range drone 11 according to the embodiment. The control process of the short-range drone 11 is executed by the control device 13 of the tracking robot 2.

[0078] The control unit 32 acquires various information detected by the detection unit 12 (S100). The control unit 32 determines whether or not a suspicious object has been detected based on the acquired various information (S101). For example, the control unit 32 detects a suspicious object by performing a predetermined image processing on an image captured by a high-sensitivity camera.

[0079] If no suspicious object is detected (S101: No), the control unit 32 ends this process. If a suspicious object is detected (S101: Yes), the control unit 32 sets a first flight path for the short-range drone 11 (S102).

[0080] The control unit 32 transmits the first flight path to the short-range drone 11 (S103). As a result, the short-range drone 11 takes off from the base unit 15 of the tracking robot 2.

[0081] The control unit 32 acquires an image captured by the camera 20 of the short-range drone 11 (S104).

[0082] The control unit 32 determines whether the distance to the suspicious object is equal to or less than a predetermined distance (S105). If the distance to the suspicious object is greater than the predetermined distance (S105: No), the control unit 32 continues tracking the suspicious object and acquires an image captured by the camera 20 of the short-range drone 11 (S104).

[0083] If the distance to the suspicious target is equal to or shorter than the predetermined distance (S105: Yes), the control unit 32 generates a launch signal for the tracking mark 21 (S106). The control unit 32 transmits the generated launch signal to the short-range drone 11 (S107). This causes the short-range drone 11 to launch the tracking mark 21 toward the suspicious target.

[0084] Next, the control process of the long-range drone 3 according to the embodiment will be described with reference to Fig. 6. Fig. 6 is a flowchart illustrating the control process of the long-range drone 3 according to the embodiment. The control process of the long-range drone 3 is executed by the control device 13 of the tracking robot 2.

[0085] The control unit 32 acquires various pieces of information detected by the detection unit 12 (S200). The control unit 32 determines whether or not a suspicious object has been detected based on the acquired various pieces of information (S201).

[0086] If no suspicious object is detected (S201: No), the control unit 32 ends this process. If a suspicious object is detected (S201: Yes), the control unit 32 sets a second flight route for the long-range drone 3 (S202).

[0087] The control unit 32 transmits the second flight path to the short-range drone 11 (S203). This causes the long-range drone 3 to take off from the station.

[0088] The long-range drone 3 flies based on the position information of the tracking mark 21. Therefore, as shown in FIG. 7A, when the short-range drone 11 does not emit the tracking mark 21 to the suspicious target C, the long-range drone 3 tracks the short-range drone 11 and flies so as to approach the suspicious target C. Then, as shown in FIG. 7B, when the tracking mark 21 is emitted from the short-range drone 11 and attached to the suspicious target C, the long-range drone 3 flies so as to track the suspicious target C. FIG. 7A is a diagram showing an example of flight of the long-range drone 3 before the tracking mark 21 is emitted. FIG. 7B is a diagram showing an example of flight of the long-range drone 3 after the tracking mark 21 is attached to the suspicious target C.

[0089] The camera that captures images for detecting and tracking a suspicious object is not limited to a camera provided on the tracking robot 2, etc. The camera that captures images for detecting and tracking a suspicious object may be, for example, a camera of another robot in the room or a surveillance camera provided in the room when the suspicious object is indoors. Also, the camera that captures images for detecting and tracking a suspicious object may be, for example, an outdoor surveillance camera when the suspicious object is outdoors. That is, for example, the tracking robot 2 may detect a suspicious object based on images captured by a camera of another robot in the room, the indoor surveillance camera, and the outdoor surveillance camera.

[0090] The tracking robot 2 includes a short-range drone 11, a robot body 10, a detection unit 12, and a control unit 32. The short-range drone 11 can track a suspicious target and emit a tracking mark 21 toward the suspicious target. The robot body 10 is capable of launching and landing the short-range drone 11 and running autonomously. The detection unit 12 detects the situation around the robot body 10. The control unit 32 controls the drone and causes the robot body 10 to run autonomously according to the situation detected by the detection unit 12. When a suspicious target is detected, the control unit 32 launches the short-range drone 11 from the robot body 10 and causes the short-range drone 11 to fire a tracking mark 21 toward the suspicious target.

[0091] As a result, the tracking robot 2 can track the suspicious object by tracking the tracking mark 21. Therefore, the tracking robot 2 can easily identify the suspicious object, making it easier to track the suspicious object and accurately identifying the suspicious object. Therefore, the tracking robot 2 can improve the tracking ability of the suspicious object.

[0092] The tracking mark 21 acquires position information of the tracking mark 21 and transmits the position information of the tracking mark 21.

[0093] This allows the tracking robot 2 to track the suspicious target based on the position information of the tracking mark 21. For example, even if the tracking robot 2 loses sight of the suspicious target due to an obstacle or the like, it can find the suspicious target based on the position information of the tracking mark 21, thereby improving the trackability of the suspicious target.

[0094] The position information of the tracking mark 21 is transmitted to the long-range drone 3, which has a longer flight distance than the short-range drone 11. The long-range drone 3 flies so as to track the suspicious target based on the position information of the tracking mark 21.

[0095] This enables the long-range drone 3 to continuously track suspicious objects for long periods of time.

[0096] 8 is a diagram showing an example of a computer hardware configuration that functions as the tracked robot 2 or the management device 4. A program installed on the computer 1200 can cause the computer 1200 to function as one or more "parts" of the device according to the present embodiment, or to execute operations or one or more "parts" associated with the device according to the present embodiment, and / or to execute a process or steps of the process according to the present embodiment. Such a program can be executed by the CPU 1212 to cause the computer 1200 to execute specific operations associated with some or all of the blocks of the flowcharts and block diagrams described herein.

[0097] The computer 1200 according to this embodiment includes a CPU 1212, a RAM 1214, and a graphic controller 1216, which are connected to each other by a host controller 1210. The computer 1200 also includes input / output units such as a communication interface 1222, a storage device 1224, a DVD drive, and an IC card drive, which are connected to the host controller 1210 via an input / output controller 1220. The DVD drive may be a DVD-ROM drive, a DVD-RAM drive, etc. The storage device 1224 may be a hard disk drive, a solid state drive, etc. The computer 1200 also includes input / output units such as a ROM 1230 and a keyboard, which are connected to the input / output controller 1220 via an input / output chip 1240.

[0098] The CPU 1212 operates according to a program stored in the ROM 1230 and the RAM 1214, thereby controlling each unit. The graphic controller 1216 acquires image data generated by the CPU 1212 into a frame buffer or the like provided in the RAM 1214 or into itself, and causes the image data to be displayed on the display device 1218.

[0099] The communication interface 1222 communicates with other electronic devices via a network. The storage device 1224 stores programs and data used by the CPU 1212 in the computer 1200. The DVD drive reads programs or data from a DVD-ROM or the like and provides them to the storage device 1224. The IC card drive reads programs and data from an IC card and / or writes programs and data to an IC card.

[0100] The ROM 1230 stores therein a boot program or the like that is executed by the computer 1200 upon activation, and / or a program that depends on the hardware of the computer 1200. The input / output chip 1240 may also connect various input / output units to the input / output controller 1220 via a USB port, a parallel port, a serial port, a keyboard port, a mouse port, and the like.

[0101] The programs are provided by a computer-readable storage medium such as a DVD-ROM or an IC card. The programs are read from the computer-readable storage medium, installed in the storage device 1224, the RAM 1214, or the ROM 1230, which are also examples of computer-readable storage media, and executed by the CPU 1212. Information processing described in these programs is read by the computer 1200, and brings about cooperation between the programs and the various types of hardware resources described above. An apparatus or method may be constructed by implementing operations or processing of information according to the use of the computer 1200.

[0102] For example, when communication is performed between the computer 1200 and an external device, the CPU 1212 may execute a communication program loaded in the RAM 1214 and instruct the communication interface 1222 to perform communication processing based on the processing described in the communication program. Under the control of the CPU 1212, the communication interface 1222 reads transmission data stored in a transmission buffer area provided in the RAM 1214, the storage device 1224, a DVD-ROM, or a recording medium such as an IC card, and transmits the read transmission data to the network, or writes reception data received from the network to a reception buffer area or the like provided on the recording medium.

[0103] Furthermore, the CPU 1212 may cause all or a necessary portion of a file or database stored in an external recording medium such as the storage device 1224, a DVD drive (DVD-ROM), an IC card, etc. to be read into the RAM 1214, and perform various types of processing on the data on the RAM 1214. The CPU 1212 may then write back the processed data to the external recording medium.

[0104] Various types of information, such as various types of programs, data, tables, and databases, may be stored in the recording medium and undergo information processing. The CPU 1212 may perform various types of processing on the data read from the RAM 1214, including various types of operations, information processing, conditional judgment, conditional branching, unconditional branching, information search / replacement, etc., as described throughout this disclosure and specified by the instruction sequence of the program, and write back the results to the RAM 1214. The CPU 1212 may also search for information in a file, database, etc. in the recording medium. For example, when a plurality of entries each having an attribute value of a first attribute associated with an attribute value of a second attribute are stored in the recording medium, the CPU 1212 may search for an entry whose attribute value of the first attribute matches a specified condition from among the plurality of entries, read the attribute value of the second attribute stored in the entry, and thereby obtain the attribute value of the second attribute associated with the first attribute that satisfies a predetermined condition.

[0105] The above-mentioned programs or software modules may be stored in a computer-readable storage medium on the computer 1200 or in the vicinity of the computer 1200. In addition, a recording medium such as a hard disk or a RAM provided in a server system connected to a dedicated communication network or the Internet can be used as a computer-readable storage medium, thereby providing the programs to the computer 1200 via the network.

[0106] The blocks in the flowcharts and block diagrams in the present embodiment may represent stages of a process in which an operation is performed or "parts" of an apparatus responsible for performing the operation. Particular stages and "parts" may be implemented by dedicated circuitry, programmable circuitry provided with computer readable instructions stored on a computer readable storage medium, and / or a processor provided with computer readable instructions stored on a computer readable storage medium. The dedicated circuitry may include digital and / or analog hardware circuits, and may include integrated circuits (ICs) and / or discrete circuits. The programmable circuitry may include reconfigurable hardware circuits, such as, for example, field programmable gate arrays (FPGAs), programmable logic arrays (PLAs), and the like, including AND, OR, XOR, NAND, NOR, and other logical operations, flip-flops, registers, and memory elements.

[0107] A computer-readable storage medium may include any tangible device capable of storing instructions that are executed by a suitable device, such that a computer-readable storage medium having instructions stored thereon comprises an article of manufacture that includes instructions that can be executed to create means for performing the operations specified in the flowcharts or block diagrams. Examples of computer-readable storage media may include electronic storage media, magnetic storage media, optical storage media, electromagnetic storage media, semiconductor storage media, and the like. More specific examples of computer-readable storage media may include floppy disks, diskettes, hard disks, random access memories (RAMs), read-only memories (ROMs), erasable programmable read-only memories (EPROMs or flash memories), electrically erasable programmable read-only memories (EEPROMs), static random access memories (SRAMs), compact disk read-only memories (CD-ROMs), digital versatile disks (DVDs), Blu-ray disks, memory sticks, integrated circuit cards, and the like.

[0108] The computer readable instructions may include either assembler instructions, Instruction Set Architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or source or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk®, JAVA®, C++, etc., and conventional procedural programming languages ​​such as the “C” programming language or similar programming languages.

[0109] Computer readable instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, or to a programmable circuit, either locally or over a local area network (LAN), a wide area network (WAN), such as the Internet, etc., to cause the processor of the general purpose computer, special purpose computer, or other programmable data processing apparatus, or to a programmable circuit, to execute the computer readable instructions to generate means for performing the operations specified in the flowcharts or block diagrams. Examples of processors include computer processors, processing units, microprocessors, digital signal processors, controllers, microcontrollers, etc.

[0110] Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. It is clear to those skilled in the art that various modifications or improvements can be made to the above embodiments. It is clear from the claims that such modifications or improvements can also be included in the technical scope of the present invention.

[0111] It should be noted that the order of execution of each process, such as operations, procedures, steps, and stages, in the devices, systems, programs, and methods shown in the claims, specifications, and drawings is not specifically stated as "before" or "prior to," and that the process may be performed in any order unless the output of a previous process is used in a later process. Even if the operational flow in the claims, specifications, and drawings is described using "first," "next," etc. for convenience, it does not mean that the process must be performed in this order. [Explanation of symbols]

[0112] 1. Tracking System 2 Tracking Robot 3. Long-range drone 4 Management device 10 Robot body 11 Short-range drones 12 Detection section 13 Control device 20 Camera 21 Tracking Mark 32 Control section 35 Suspicious object detection unit 36 Drone control unit 37 Robot control unit

Claims

1. A drone capable of tracking a suspicious object and emitting a tracking mark toward the suspicious object; A robot body capable of autonomous travel and capable of launching and landing the drone; A detection unit that detects a situation around the robot body; a control unit that controls the drone and causes the robot body to autonomously travel in accordance with the situation detected by the detection unit; Equipped with The control unit of the tracking robot launches the drone from the robot body when the suspicious object is detected, and emits the tracking mark from the drone toward the suspicious object.

2. The tracked robot according to claim 1 , wherein the tracking mark acquires position information of the tracking mark and transmits the position information of the tracking mark.

3. The position information of the tracking mark is transmitted to a tracking drone having a longer flight distance than the drone, The tracking robot according to claim 1 , wherein the tracking drone flies to track the suspicious object based on position information of the tracking mark.

4. The tracking robot according to claim 1 , wherein the control unit controls the robot body and at least one of the drone to track the suspicious subject based on a predicted escape route predicted from the position information of the tracking mark.

5. The tracked robot of claim 1 , wherein at least one piece of information regarding the travel path of the robot body, the flight path of the drone, and the flight path of a tracking drone having a longer flight distance than the drone is generated by a sentence generation model.

6. A tracking robot according to any one of claims 1 to 5; A tracking drone with a longer flight distance than the drone. A tracking system comprising:

Citation Information

Patent Citations

  • Vehicle security device

    JP2020093618A