Information processing device, information processing method, and program

Abstract

This information processing device governs a process performed by a base station that is capable of directly and wirelessly communicating with a moving body having a camera within a communication network for direct wireless communication. A warning information acquisition unit acquires prescribed warning information from a terminal that is connected within the communication network in a manner that enables direct communication. A calculation unit calculates, on the basis of the warning information, a first index indicating the possibility that an event to be guarded against is occurring. If the first index is equal to or greater than a first threshold value, a calculation unit identifies, on the basis of the warning information, a guard region in which it is possible that the aforementioned event is occurring, and then outputs, to the moving body, a movement control signal for indicating that the identified guard region is to be imaged.

Description

Information processing device, information processing method, and program

[0001] The present disclosure relates to an information processing device, an information processing method, and a program.

[0002] Systems have been developed that monitor a predetermined area by acquiring traffic information and the like from mobile objects.

[0003] The traffic signal system described in the patent document 1 is configured to communicate with a computing network through a communication system. A mobile device is also configured to communicate with the computing network through the communication system. The computing network then adaptively controls the traffic signal system using the location of the mobile device.

[0004] The control system described in Patent Document 2 includes a security device, a mobile object, and a control device. The security device detects an abnormality that occurs in a monitored area. The mobile object hurries to the location where the abnormality occurred and photographs the location to confirm the abnormality. The control device is connected to each mobile object and the security device via a communication network. Based on a report from the security device, the control device searches for a mobile object that can appropriately photograph the location of the abnormality from among multiple mobile objects monitoring the monitored area, and instructs the mobile object found as a result of the search to photograph the location of the abnormality via the communication network.

[0005] The system described in Patent Document 3 installs an IP camera capable of capturing video near an intersection where traffic lights are installed, performs a moving object extraction process on the captured images at predetermined intervals, obtains speed information of the extracted moving objects, and detects abnormal traffic conditions. If an abnormal traffic condition is detected, the system forcibly changes the traffic light status of the traffic light, for example, to red via the traffic light control panel.

[0006] JP-T-2020-502718 A JP-A-2019-179527 JP-A-2005-309705

[0007] However, the above-mentioned technology may perform processing as if an abnormality has occurred even when no abnormality actually has occurred, and there is also a risk that an abnormality may not be accurately detected even when it has occurred.

[0008] In view of the above-described problems, the present disclosure aims to provide an information processing device and the like that can suitably monitor the status of a predetermined area.

[0009] The information processing device according to the present disclosure controls processing performed by a base station capable of direct wireless communication with a mobile body having a camera within a communication range of the direct wireless communication. The information processing device includes an alert information acquisition unit, a calculation unit, and a control unit. The alert information acquisition unit acquires predetermined alert information from a terminal connected to the mobile body within the communication range so as to be able to communicate directly. The calculation unit calculates a first index indicating the possibility that an event requiring vigilance has occurred based on the alert information. If the first index is equal to or greater than a first threshold, the control unit identifies, based on the alert information, an alert area where the event may have occurred, and outputs a movement control signal to the mobile body to instruct the mobile body to photograph the identified alert area.

[0010] The information processing method according to the present disclosure is one in which a computer capable of direct wireless communication with a mobile body having a camera within a communication range of the direct wireless communication executes the following process: The computer acquires predetermined warning information from a terminal connected to the mobile body within the communication range so as to be able to communicate directly; The computer calculates a first index indicating the possibility that an event requiring vigilance has occurred based on the warning information; If the first index is equal to or greater than a first threshold, the computer identifies, based on the warning information, a warning area in which the event may have occurred, and outputs a movement control signal to the mobile body to instruct the mobile body to photograph the identified warning area.

[0011] A program according to the present disclosure causes a computer capable of direct wireless communication with a mobile body having a camera within a communication range of direct wireless communication to execute the following process: The computer acquires predetermined warning information from a terminal connected to the mobile body so as to be able to communicate directly within the communication range. The computer calculates a first index indicating the possibility that an event requiring caution has occurred based on the warning information. If the first index is equal to or greater than a first threshold, the computer identifies, based on the warning information, a warning area in which the event may have occurred, and outputs a movement control signal to the mobile body to instruct the mobile body to photograph the identified warning area.

[0012] According to the present disclosure, it is possible to provide an information processing device, an information processing method, and a program that suitably monitor the status of a predetermined area.

[0013] FIG. 1 is a block diagram of an information processing device according to an embodiment. FIG. 2 is a flowchart of an information processing method according to an embodiment. FIG. 3 is a diagram of the vicinity of a base station including an information processing device according to an embodiment. FIG. 4 is a block diagram of an information processing system according to an embodiment. FIG. 5 is a block diagram of a signal pole including an information processing device. FIG. 6 is a block diagram of a mobile object according to an embodiment. FIG. 7 is a block diagram of a communication terminal according to an embodiment. FIG. 8 is a flowchart of an information processing method according to an embodiment. FIG. 9 is a block diagram of an information processing system according to an embodiment. FIG. 10 is a block diagram of a mobile object according to an embodiment. FIG. 11 is a block diagram of a management terminal according to an embodiment. FIG. 12 is a block diagram illustrating a hardware configuration of a computer.

[0014] The present invention will be described below through embodiments of the invention, but the invention according to the claims is not limited to the following embodiments. Furthermore, not all of the configurations described in the embodiments are necessarily essential means for solving the problems. For clarity of explanation, the following description and drawings have been omitted and simplified as appropriate. In each drawing, the same elements are assigned the same reference numerals, and duplicate explanations are omitted as necessary.

[0015] <First Embodiment> Hereinafter, this embodiment will be described with reference to the drawings. FIG. 1 is a block diagram of an information processing device 10 according to the first embodiment. The information processing device 10 controls processing performed by a base station capable of direct wireless communication with a mobile object having a camera within a communication range of the direct wireless communication. The information processing device 10 may be configured by a circuit including a calculation device associated with the base station. The information processing device 10 may also be a computer connected to the base station.

[0016] The base station is connected to a mobile object within its communication range via direct wireless communication. The mobile object has a camera and is configured to be able to transmit image data to the base station. The information processing device 10 mainly comprises an alert information acquisition unit 11, a calculation unit 12, and a control unit 13.

[0017] The warning information acquisition unit 11 acquires predetermined warning information from a terminal that is directly connected to the base station within the communication range. A terminal that is directly connected to the base station is any terminal that can directly communicate wirelessly with the base station. The predetermined warning information is information indicating the possibility that an event such as an accident has occurred. The predetermined warning information may be image data or audio, or may be other data indicating the presence or absence of vibration, heat, wind, rain, etc. Alternatively, the predetermined warning information may indicate the degree of vibration, heat, wind, rain, etc.

[0018] The calculation unit 12 calculates a first index indicating the possibility that an event requiring caution has occurred based on the warning information. That is, the calculation unit 12 can calculate an index indicating the probability that an event requiring caution, such as an accident, has occurred from the warning information. Alternatively, the calculation unit 12 can calculate an index indicating whether or not an event requiring caution, such as an accident, has occurred from the warning information. The first index calculated by the calculation unit 12 may be, for example, a binary index or an index with three or more values.

[0019] More specifically, for example, when the warning information acquisition unit 11 acquires image data as warning information, the calculation unit 12 may recognize people or vehicles present in the image data. In this case, the calculation unit 12 may calculate the first index, for example, from a state in which an abnormal crowd has formed in the image data. Alternatively, when the warning information acquisition unit 11 acquires a value from an acceleration sensor of a vehicle as warning information, the calculation unit 12 may calculate the first index when the value from the acceleration sensor exceeds a preset value. In this case, the vehicle may transmit the vehicle identification number or vehicle location information together with the acceleration sensor value.

[0020] When the first index is equal to or greater than a first threshold, the control unit 13 identifies a warning area where the event may have occurred based on the warning information. The first threshold is a value set for identifying whether the event related to the warning information is likely to be an accident or the like. In other words, when the first index is less than the first threshold, the information processing device 10 determines that an accident or the like has not occurred. On the other hand, when the first index is equal to or greater than the first threshold, the information processing device 10 determines that an accident or the like may have occurred.

[0021] When the control unit 13 determines from the acquired warning information that there is a possibility that an accident or the like has occurred, it identifies a warning area. In this case, the control unit 13 may identify the source of the acquired warning information as the warning area. Alternatively, the control unit 13 may identify an area where a predetermined event is likely to have occurred by analyzing image data.

[0022] The control unit 13 also outputs a movement control signal to the mobile body to instruct it to photograph the identified security area. The movement control signal includes information about the location of the security area. The movement control signal may also include information about the moving path of the mobile body and the location of the moving target. More specifically, for example, when the warning information acquisition unit 11 acquires image data as warning information and the image data shows an abnormal crowd, the control unit 13 identifies the area of ​​the crowd as a security area and outputs a movement control signal to instruct the mobile body to approach the crowd and photograph it. Alternatively, when the warning information acquisition unit 11 acquires a value from an acceleration sensor of a vehicle as warning information, the calculation unit 12 calculates a first index because the acceleration sensor value exceeds a predetermined value. In this case, the control unit 13 identifies the location of the vehicle that transmitted the high acceleration sensor value based on the information transmitted by the vehicle and identifies the identified location as the security area. The control unit 13 also outputs a movement control signal to instruct the mobile body to photograph the identified security area.

[0023] The configuration of the information processing device 10 has been described above. With the above-described configuration, the information processing device 10 can acquire information about the security area using a mobile object. That is, the information processing device 10 can acquire information that allows the information processing device 10 to appropriately determine whether or not an accident or the like has occurred in the security area. Therefore, the information processing device 10 can appropriately monitor whether or not a predetermined event has occurred within a predetermined communication range.

[0024] Fig. 2 is a flowchart of the information processing method executed by the information processing device 10 according to the first embodiment. The flowchart shown in Fig. 2 starts when the information processing device 10 detects the acquisition of warning information, for example.

[0025] First, the warning information acquisition unit 11 of the information processing device 10 acquires predetermined warning information from a terminal that is directly connected to the information processing device 10 within the communication range (step S11).

[0026] Next, the calculation unit 12 of the information processing device 10 calculates a first index indicating the possibility that an event requiring vigilance has occurred, based on the acquired alert information (step S12).

[0027] Next, the control unit 13 of the information processing device 10 determines whether the calculated first index is equal to or greater than a first threshold (step S13). If it is determined that the first index is equal to or greater than the first threshold (step S13: YES), the information processing device 10 proceeds to step S14. On the other hand, if it is not determined that the first index is equal to or greater than the first threshold (step S13: NO), the information processing device 10 ends the series of processes.

[0028] In step S14, the control unit 13 of the information processing device 10 identifies a security area where an event may have occurred. Furthermore, the control unit 13 outputs a movement control signal to the mobile object to instruct the mobile object to photograph the identified security area (step S14). After outputting the movement control signal to the mobile object, the information processing device 10 ends the series of processes.

[0029] The above describes the information processing method executed by the information processing device 10. Through such processing, the information processing device 10 can acquire information on alert areas where an event such as an accident may have occurred.

[0030] The information processing device 10 may include a processor and a storage device (not shown). The storage device of the information processing device 10 may include a storage device including a nonvolatile memory such as a flash memory or an SSD. In this case, the storage device of the information processing device 10 stores a computer program (hereinafter simply referred to as a program) for executing the image processing method described above. The processor also loads the computer program from the storage device into a buffer memory such as a DRAM (Dynamic Random Access Memory) and executes the program.

[0031] Each component of the information processing device 10 may be implemented using dedicated hardware. Furthermore, some or all of the components may be implemented using general-purpose or dedicated circuits, processors, or a combination thereof. These may be implemented using a single chip or multiple chips connected via a bus. Some or all of the components of each device may be implemented using a combination of the above-mentioned circuits and programs. Furthermore, a CPU (Central Processing Unit), GPU (Graphics Processing Unit), FPGA (Field-Programmable Gate Array), or the like may be used as the processor. The description of the components described herein may also be applied to other devices or systems described below in this disclosure.

[0032] As described above, according to the present embodiment, it is possible to provide an information processing device, an information processing method, and a program that suitably monitor the status of a predetermined area.

[0033] <Second Embodiment> A second embodiment will be described below. Fig. 3 is a diagram of the vicinity of a base station including an information processing device according to the second embodiment. Fig. 3 shows the situation within a communication range R11. The communication range R11 is a range within which a base station 110 installed at an intersection where vehicles and people pass by can directly communicate wirelessly with a predetermined terminal. A signal pole 120, a traffic signal 121, a mobile object 200, a vehicle 300, and a communication terminal 310 exist in the communication range R11.

[0034] The signal pole 120 mainly comprises a base station 110, a traffic signal 121, a drone port 122, and a camera 123. The base station 110 is capable of direct wireless communication with the traffic signal 121, the mobile object 200, and the communication terminal 310. The base station 110 is also communicably connected to the traffic signal 121, the drone port 122, and the camera 123 via wire or wirelessly. The drone port 122 may have a function of supplying power to the mobile object 200.

[0035] The traffic signal 121 is communicably connected to the base station 110 and can be controlled by the base station 110. The traffic signal 121 may have a separate control device that is different from the base station 110. In this case, the base station 110 controls the traffic signal 121 when it determines that an event such as an accident has occurred.

[0036] The mobile object 200 is an autonomous flying object equipped with a camera capable of capturing images of the ground scenery in the air within the communication range R11. In this disclosure, the autonomous flying object may be referred to as a drone. The mobile object 200 is one embodiment of the mobile object in this disclosure. The mobile object 200 is parked at the drone port 122 so that it can take off and land, and moves to the periphery of the surveillance area R21 upon receiving instructions from the base station 110.

[0037] Vehicle 300 is an automobile traveling on a road. Vehicle 300 includes a terminal capable of direct wireless communication with base station 110. Vehicle 300 is also in contact with another vehicle behind it. Vehicle 300 has a sensor that detects contact with another vehicle, and is configured to be able to transmit data from this sensor to base station 110.

[0038] The communication terminal 310 is a terminal with a communication function carried by the person P01. The communication terminal 310 is, for example, a mobile phone, a tablet, a smartphone, a laptop computer, etc. The communication terminal 310 may also be eyeglasses or a wristwatch with a communication function.

[0039] In the above situation, the base station 110 may acquire warning information from the camera 123, the vehicle 300, and the communication terminal 310. The base station 110 may also acquire warning information from the moving object 200. The communication range R11 shown in Fig. 3 includes an alert area R21. An accident involving the vehicle 300 has occurred in the alert area R21.

[0040] In this case, for example, vehicle 300 transmits data regarding the impact caused by contact with another vehicle as warning information. Base station 110 receives and acquires the warning information transmitted by vehicle 300. In response, base station 110 identifies alert area R21 and outputs a movement control signal to mobile unit 200 instructing it to photograph alert area R21. Mobile unit 200 receives the movement control signal from base station 110, moves to the periphery of alert area R21, and photographs alert area R21. Image data photographed and generated by mobile unit 200 can be transmitted to base station 110. If base station 110 determines that an accident has occurred based on the image data received from mobile unit 200, it can control traffic signal 121. In this case, for example, base station 110 controls traffic signal 121 so as not to increase traffic volume in alert area R21.

[0041] 4 is a block diagram of an information processing system 100 according to the second embodiment. The information processing system 100 includes each component in the communication range R11 shown in FIG. 3. That is, the information processing system 100 mainly includes a base station 110, a traffic signal 121, a camera 123, and a mobile object 200. The information processing system 100 may also include a vehicle 300 and a communication terminal 310 present in the communication range R11.

[0042] The base station 110 is communicatively connected to the traffic signal 121, the camera 123, the mobile object 200, the vehicle 300, and the communication terminal 310 present in the communication range R11. The base station 110 can acquire warning information from the camera 123, the mobile object 200, the vehicle 300, and the communication terminal 310 present in the communication range R11. The base station 110 can also control the traffic signal 121 using the information acquired from each component. Similarly, the base station 110 can control the mobile object 200 using the information acquired from each component.

[0043] Vehicle 300 may include communication terminal 310. In this case, vehicle 300 may be equipped with communication terminal 310. Vehicle 300 may also be integrated with communication terminal 310. In other words, vehicle 300 may be one embodiment of communication terminal 310.

[0044] Fig. 5 is a block diagram of a signal pole 120 including an information processing device 10. The signal pole 120 shown in Fig. 5 corresponds to the signal pole 120 in Fig. 3. The signal pole 120 mainly includes a traffic signal 121, a drone port 122, a camera 123, and a base station 110.

[0045] The traffic signal 121 is configured to display a traffic signal in response to an instruction from the base station 110. The traffic signal 121 may be configured to be linked with traffic signals outside the communication range R11. The drone port 122 may have a function to supply power to the mobile object 200 and a function to detect the presence or absence of the mobile object 200. The camera 123 captures images of the scenery around the signal pole 120 and generates image data. The camera 123 may be configured to be capable of tilting, panning, and zooming. The camera 123 supplies the captured and generated image data to the base station 110.

[0046] The base station 110 is configured to be able to communicate with a predetermined terminal present in the communication area R11. The base station 110 is, for example, a computer or server to which a technology called multi-access edge computing (MEC) is applied. The base station 110 mainly includes a communication unit 111 and an information processing device 10. The communication unit 111 communicates with communication terminals present in the communication area R11. The communication unit 111 includes, for example, a wireless communication antenna and a signal processing circuit for transmitting signals received from the information processing device 10. The base station 110 may further include communication means for communicating with outside the communication area R11, such as the Internet or a public communication line.

[0047] Next, the information processing device 10 according to this embodiment will be described. The warning information acquisition unit 11 according to this embodiment acquires warning information from the communication terminal 310 by directly communicating wirelessly with the communication terminal 310 that is moving with a vehicle or person present within the communication range of the base station 110. This allows the information processing device 10 to acquire warning information regarding various events that occur within the communication range R11.

[0048] The warning information acquisition unit 11 according to this embodiment acquires, as warning information, image data captured by a camera 123 installed on a signal pole 120. This allows the information processing device 10 to acquire warning information from the installed camera 123 by utilizing the system of the signal pole 120. In other words, the base station 110 is configured to be additionally installable on a signal pole 120 on which a surveillance camera is installed.

[0049] When image data of the alert area R21 is acquired from the mobile object 200, the calculation unit 12 according to this embodiment uses the acquired image data to calculate a second index indicating the possibility that a predetermined event, such as an accident, has occurred. The second index indicates a higher possibility of the occurrence of a predetermined event, such as an accident, than the first index described above. That is, for example, the second index indicates that a predetermined event, such as an accident, has almost certainly occurred. Specifically, for example, the second index indicates a case in which the image data of the alert area R21 includes an image of a traffic accident. By using the second index, the information processing device 10 can more accurately determine the situation in the alert area R21.

[0050] In this case, when the second index is equal to or greater than a second threshold value that is higher than the first threshold value, the control unit 13 may output a traffic control signal to the traffic light 121 to inhibit vehicles or people from entering the alert area R21. This allows the information processing device 10 to appropriately process events in the alert area.

[0051] In this case, the control unit 13 may determine that no event such as an accident has occurred in the alert area R21 when the second index is less than the second threshold value. In this way, the information processing device 10 according to the present embodiment can appropriately process events in the alert area.

[0052] In addition to the configuration described in the first embodiment, the information processing device 10 includes a storage unit 14. The storage unit 14 may store, for example, a program for performing the functions according to the present disclosure. The storage unit 14 may also store a first threshold value, a second threshold value, and the like used by the control unit 13.

[0053] The control unit 13 according to this embodiment outputs a movement control signal to the moving object 200. This allows the information processing device 10 to move the moving object 200 to the alert area R21 or near the alert area R21. The information processing device 10 also allows the moving object 200 to capture a picture of the scenery in the alert area R21. The control unit 13 may acquire image data of an image captured by a camera 203 attached to the signal pole 120 as warning information, and calculate a first index from the image data of the camera 203. In this case, the control unit 13 outputs a movement control signal to the moving object 200 when, for example, the first index is equal to or greater than a first threshold value.

[0054] When the first index is equal to or greater than a second threshold higher than the first threshold, the control unit 13 may output a traffic control signal to the traffic signal 121 present within the communication range to issue a signal to inhibit vehicles or people from entering the alert area R21. This allows the information processing device 10 to inhibit the situation from worsening when a predetermined event occurs.

[0055] The control unit 13 may output a traffic control signal to a traffic signal 121 attached to a signal pole 120 within the communication range, thereby enabling the information processing device 10 to control the movement of vehicles and the like.

[0056] The control unit 13 may output to the mobile object 200 a movement control signal instructing the mobile object 200 to photograph the alert area R21 from a position closer than the distance between the signal pole 120 and the alert area R21. This enables the information processing device 10 to appropriately grasp the situation in the alert area R21 and determine whether an event such as an accident has occurred.

[0057] The control unit 13 may instruct the mobile object 200 to capture an image of the surveillance area R21 from a position away from the straight line connecting the signal pole 120 and the surveillance area R21. This allows the information processing device 10 to acquire, from the image data captured by the mobile object 200, information that cannot be acquired from image data captured by a camera installed on the signal pole 120, for example.

[0058] When the control unit 13 identifies a caution object related to an event based on an image captured in the alert area R21, the control unit 13 may instruct the moving body 200 to capture an image of the caution object. Here, the caution object is, for example, the body of a vehicle involved in an accident. Alternatively, the caution object may be a person. In this case, the caution object is the body of a person involved in an accident, etc. This allows the information processing device 10 to preferably acquire the state of an event such as an accident.

[0059] The control unit 13 may also use the identified warning information and the position information of the mobile body 200 to estimate the timing at which the warning object will arrive at the traffic signal 121 within the communication range, and output a traffic control signal to the traffic signal 121 to display a traffic signal indicating "stop" based on the estimated timing. This allows the information processing device 10 to appropriately control the movement of vehicles, etc., and prevent the event from worsening. In this case, the control unit 13 may estimate the timing at which the warning object will arrive at the traffic signal 121 from an image captured by the camera 203 installed on the signal pole 120. The control unit 13 may also estimate the timing at which the warning object will arrive at the traffic signal 121 by linking the above-mentioned configurations.

[0060] When the identified attention object moves, the control unit 13 may instruct the moving body 200 to track and photograph the attention object. This allows the information processing device 10 to preferably acquire the state of an event such as an accident.

[0061] 6 is a block diagram of a mobile object 200 according to the second embodiment. The mobile object 200 mainly includes a location information acquisition unit 201, a communication unit 202, a camera 203, a mobile object control unit 204, a drive unit 205, and a storage unit 206.

[0062] The location information acquisition unit 201 acquires location information of the mobile object 200 using, for example, a location information acquisition system that uses GNSS (Global Navigation Satellite System) or Wi-Fi radio waves. The communication unit 202 has a function for directly communicating wirelessly with the base station 110. That is, the communication unit 202 may include, for example, an antenna, a modulation circuit, a demodulation circuit, etc. The camera 203 includes an objective lens and an image sensor for capturing images of the scenery around the traffic light pole 120, and generates image data. The camera 203 provides the generated image data to the information processing device 10.

[0063] The mobile object control unit 204 includes a calculation device such as a CPU or MCU, and controls each component of the mobile object 200. That is, for example, the mobile object control unit 204 exchanges information with the base station 110 via the communication unit 202, and issues instructions to each component of the mobile object 200 in response to the information. The drive unit 205 includes a motor for rotating a propeller, which is the means of movement of the mobile object 200. The storage unit 206 includes a non-volatile memory such as a flash memory or an SSD, and stores identification information of the mobile object 200, etc.

[0064] 7 is a block diagram of a communication terminal 310 according to the second embodiment. The communication terminal 310 mainly includes a location information acquisition unit 311, a communication unit 312, a camera 313, an impact detection unit 314, an interface unit 315, and a terminal control unit 316.

[0065] The location information acquisition unit 311 acquires location information of the mobile object 200 using, for example, a location information acquisition system that uses GNSS or Wi-Fi radio waves. The communication unit 312 includes an antenna, circuitry, and the like for performing direct wireless communication with the base station 110. The camera 313 takes images in response to operations by the user operating the communication terminal 310. The impact detection unit 314 includes an acceleration sensor, and detects that the communication terminal 310 has received an impact when it detects acceleration equal to or greater than a predetermined value. The interface unit 315 may include buttons and switches that accept operations by the user operating the communication terminal 310.

[0066] The terminal control unit 316 includes a calculation device such as a CPU or MCU, and controls each component of the communication terminal 310. The terminal control unit 316 also executes programs stored in the storage unit 317. The storage unit 317 includes a non-volatile memory, and stores at least the programs for performing the functions according to this embodiment.

[0067] With the above-described configuration, the communication terminal 310 transmits predetermined warning information to the base station 110. The warning information may indicate, for example, that the communication terminal 310 has received an impact of a predetermined value or greater. Alternatively, the warning information may be image data generated by the camera 313. The warning information may include a signal indicating that the information is warning information.

[0068] Next, a process executed by the information processing device 10 according to the second embodiment will be described with reference to Fig. 8. Fig. 8 is a flowchart of an information processing method according to the second embodiment.

[0069] First, the warning information acquisition unit 11 of the information processing device 10 acquires predetermined warning information from a terminal that is directly connected to the information processing device 10 within the communication range (step S21).

[0070] Next, the calculation unit 12 of the information processing device 10 calculates a first index indicating the possibility that an event requiring vigilance has occurred, based on the acquired alert information (step S22).

[0071] Next, the control unit 13 of the information processing device 10 determines whether the calculated first index is equal to or greater than the second threshold (step S23). If it is determined that the first index is equal to or greater than the second threshold (step S23: YES), the information processing device 10 proceeds to step S28. On the other hand, if it is not determined that the first index is equal to or greater than the second threshold (step S23: NO), the information processing device 10 proceeds to step S24.

[0072] In step S24, the control unit 13 determines whether the first index is equal to or greater than the first threshold (step S24). If it is determined that the first index is equal to or greater than the first threshold (step S24: YES), the information processing device 10 proceeds to step S25. On the other hand, if it is not determined that the first index is equal to or greater than the first threshold (step S24: NO), the information processing device 10 ends the series of processes.

[0073] In step S25, the control unit 13 identifies the alert area and outputs a movement control signal to the moving object 200 to photograph the alert area (step S25). Next, the information processing device 10 acquires image data from the moving object 200, and the calculation unit 12 calculates the second index using the acquired image data (step S26).

[0074] Next, the control unit 13 determines whether the second index is equal to or greater than the second threshold (step S27). If the control unit 13 determines that the second index is equal to or greater than the second threshold (step S27: YES), the information processing device 10 proceeds to step S28. On the other hand, if the control unit 13 does not determine that the second index is equal to or greater than the second threshold (step S27: NO), the information processing device 10 ends the series of processes.

[0075] In step S28, the control unit 13 outputs a traffic control signal related to the alert area to the traffic signal 121 (step S28).

[0076] Although the second embodiment has been described above, the second embodiment is not limited to the above. For example, there may be two or more moving bodies 200. Instead of or in addition to a drone, the moving body 200 may be a robot or an autonomous vehicle that moves on the ground.

[0077] In step S27, if the second index is, for example, equal to or greater than the first index and less than the second index, and it is difficult to clearly determine whether or not to output a traffic control signal, the information processing device 10 may instruct the mobile object 200 to again photograph the alert area R21. In addition, at this time, the information processing device 10 may instruct the mobile object 200 to change the photographing position and then photograph the alert area R21 again.

[0078] The threshold value used by the control unit 13 in step S27 may be a third threshold value different from the second threshold value. That is, the threshold value used in step S23 to determine whether or not to output a traffic control signal for the alert area may be different from the threshold value used in step S27.

[0079] Although the second embodiment has been described above, the information processing system 100 according to this embodiment is not limited to the above-described configuration. For example, the signal pole 120 and the base station 110 may not be integrated but may be configured as separate entities. The signal pole 120 may not have the drone port 122. The signal pole 120 may not have the camera 123. According to this embodiment, it is possible to provide an information processing device, an information processing method, and a program that suitably monitor the situation in a predetermined area.

[0080] <Third Embodiment> Next, a third embodiment will be described. Fig. 9 is a block diagram of an information processing system according to the third embodiment. The information processing system 100 according to this embodiment is connected to a network N1 outside the communication range R11, and is communicatively connected to a management terminal 400 via this network N1. The information processing system 100 according to this embodiment also has a mobile unit 210 instead of the mobile unit 200. The mobile unit 210 differs from the mobile unit 200 in that it has a predetermined interface unit.

[0081] The control unit 13 included in the base station 110 according to this embodiment outputs at least a part of the warning information to the management terminal 400 that manages the control unit 13. This allows the information processing device 10 to notify the management terminal 400 via the network N1 of the possibility that an event such as an accident has occurred.

[0082] Furthermore, when the mobile object 210 collects sound from the security area R21 and supplies the sound to the control unit 13, the control unit 13 outputs at least a portion of the sound data to the management terminal 400. This allows the information processing device 10 to communicate details of the event to the administrator. The control unit 13 may also output the sound data supplied to the control unit 13 by the management terminal 400 to the mobile object 200. This allows the information processing device 10 to issue warnings, calls, etc. to the security area.

[0083] In the above-described situation, a person P02 has collapsed in communication range R11 shown in Figure 9. The base station 110 identifies a security area R22, and a mobile object 210 approaches the security area R22. The management terminal 400 allows the administrator P03 to communicate with a person (person P02) in communication range R11 via the network N1, the base station 110, and the mobile object 210.

[0084] The mobile unit 210 will be described with reference to Fig. 10. Fig. 10 is a block diagram of the mobile unit 210 according to the third embodiment. The mobile unit 210 differs from the mobile unit 200 in that it has an interface unit 207.

[0085] The interface unit 207 is a means for notifying information to people in the vicinity of the mobile object 210. The interface unit 207 is, for example, a speaker. The interface unit 207 may have a display or an LED (light-emitting diode) instead of or in addition to a speaker. This allows the mobile object 210 to notify people in the vicinity of the mobile object 210 of information supplied from the management terminal 400 via the base station 110.

[0086] The interface unit 207 may also include a microphone that captures audio around the mobile object 210. This allows the mobile object 210 to supply the audio of people around the mobile object 210 to the management terminal 400 via the base station 110. Alternatively, the mobile object 210 can supply audio from the surveillance area R22 to the management terminal 400 via the base station 110.

[0087] Next, the management terminal 400 will be described with reference to Fig. 11. Fig. 11 is a block diagram of the management terminal 400 according to the third embodiment. The management terminal 400 mainly includes a communication unit 401, an interface unit 402, a control unit 403, and a storage unit 404.

[0088] The communication unit 401 connects the management terminal 400 to the network N1 so that they can communicate with each other. The interface unit 402 includes information input devices such as a keyboard, mouse, and microphone that are used by the administrator P03 using the management terminal 400 to operate the management terminal 400. The interface unit 402 also includes a display, speaker, and other devices for presenting information to the administrator P03. In other words, the administrator P03 using the management terminal 400 in this embodiment can communicate with a person P02 present near the mobile object 210 via the interface unit 402. The control unit 403 includes a computing device for controlling each component of the management terminal 400. The storage unit 404 includes non-volatile memory that stores programs and the like that enable the management terminal 400 to perform the functions related to this embodiment.

[0089] This completes the description of embodiment 3. According to this embodiment, it is possible to provide an information processing device, an information processing method, and a program that suitably monitor the status of a predetermined area.

[0090] The above-described program can be stored and supplied to a computer using various types of non-transitory computer-readable media. Non-transitory computer-readable media include various types of tangible recording media. Examples of non-transitory computer-readable media include magnetic recording media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (e.g., magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, CD-R / Ws, and semiconductor memories (e.g., mask ROMs, PROMs (Programmable ROMs), EPROMs (Erasable PROMs), flash ROMs, and RAMs (Random Access Memory)). The program may also be supplied to a computer by various types of temporary computer-readable media. Examples of temporary computer-readable media include electrical signals, optical signals, and electromagnetic waves. The temporary computer-readable media can be supplied to a computer via wired communication paths such as electric wires and optical fibers, or via wireless communication paths.

[0091] <Example of Hardware Configuration> Hereinafter, a case will be described in which each functional configuration of the update information generation device and static information management device according to the present disclosure is realized by a combination of hardware and software.

[0092] FIG. 12 is a block diagram illustrating an example hardware configuration of a computer. The update information generation device and static information management device of the present disclosure can realize the above-described functions by a computer 500 including the hardware configuration shown in the figure. The computer 500 may be a portable computer such as a smartphone or tablet terminal, or a stationary computer such as a PC. The computer 500 may be a dedicated computer designed to realize each device, or may be a general-purpose computer. The computer 500 can realize desired functions by installing a specified application.

[0093] The computer 500 has a bus 502, a processor 504, a memory 506, a storage device 508, an input / output interface (I / F) 510, and a network interface (I / F) 512. The bus 502 is a data transmission path for the processor 504, the memory 506, the storage device 508, the input / output interface 510, and the network interface 512 to transmit and receive data to and from each other. However, the method of connecting the processor 504 and the like to each other is not limited to bus connection.

[0094] The processor 504 is a processor such as a CPU, a GPU, an FPGA, etc. The memory 506 is a main storage device realized using a RAM (Random Access Memory) or the like.

[0095] The storage device 508 is an auxiliary storage device realized using a hard disk, an SSD, a memory card, a ROM (Read Only Memory), etc. The storage device 508 stores programs for realizing desired functions. The processor 504 reads the programs into the memory 506 and executes them to realize the respective functional components of each device.

[0096] The input / output interface 510 is an interface for connecting the computer 500 with input / output devices. For example, the input / output interface 510 is connected to an input device such as a keyboard and an output device such as a display device.

[0097] The network interface 512 is an interface for connecting the computer 500 to a network.

[0098] Although the present invention has been described above with reference to the embodiments, the present invention is not limited to the above. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the invention.

[0099] Some or all of the above embodiments may be described as, but are not limited to, the following supplementary notes. (Supplementary Note 1) An information processing device that controls processing performed by a mobile body having a camera within a communication range of direct wireless communication and a base station capable of direct wireless communication, comprising: a warning information acquisition unit that acquires predetermined warning information from a terminal connected to the mobile body so as to be able to communicate directly within the communication range; a calculation unit that calculates a first index that indicates a possibility that an event requiring caution has occurred based on the warning information; and a control unit that, when the first index is equal to or greater than a first threshold, identifies a warning area where the event may have occurred based on the warning information and outputs a movement control signal to the mobile body to instruct the mobile body to photograph the identified warning area. (Supplementary Note 2) The control unit outputs the movement control signal to the mobile body, which is an autonomous flying object having a camera that can photograph scenery on the ground in the air. (Supplementary Note 3) The information processing device according to Supplementary Note 1, wherein the warning information acquisition unit acquires the warning information from a communication terminal that moves with a vehicle or a person present within the communication range by performing direct wireless communication with the communication terminal. (Supplementary Note 4) The information processing device according to Supplementary Note 1, wherein the warning information acquisition unit acquires image data captured by a camera attached to the signal pole as the warning information. (Supplementary Note 5) The information processing device according to any one of Supplements 1 to 4, wherein the control unit outputs a traffic control signal to a traffic signal present within the communication range, for issuing a signal to inhibit vehicles or people from entering the alert area, when the first indicator is equal to or greater than a second threshold higher than the first threshold. (Supplementary Note 6) The information processing device according to Supplementary Note 5, wherein the control unit outputs the traffic control signal to the traffic signal attached to a signal pole within the communication range. (Supplementary Note 7) The information processing device according to Supplementary Note 6, wherein, when image data capturing the alert area is acquired from the moving object, the calculation unit calculates a second index indicating a possibility that the event has occurred based on the image data, and the control unit outputs the traffic control signal to the traffic signal to inhibit vehicles or people from entering the alert area, when the second indicator is equal to or greater than a second threshold higher than the first threshold.(Supplementary Note 8) The information processing device according to Supplementary Note 5 when Supplementary Note 4 is subordinate, wherein the control unit outputs the movement control signal to the moving body instructing it to photograph the security area from a position closer than the distance between the signal pole and the security area. (Supplementary Note 9) The information processing device according to Supplementary Note 7, wherein the control unit instructs the moving body to photograph the security area from a position away from a straight line connecting the signal pole and the security area. (Supplementary Note 10) The information processing device according to Supplementary Note 1, wherein, when a caution object related to the event is identified based on an image photographed in the security area, the control unit instructs the moving body to photograph the caution object. (Supplementary Note 11) The information processing device according to Supplementary Note 10, wherein, when the identified caution object moves, the control unit instructs the moving body to track and photograph the caution object. (Supplementary Note 12) The information processing device according to Supplementary Note 1, wherein the control unit outputs at least a part of the caution information to a management terminal that manages the control unit. (Supplementary Note 13) The information processing device according to Supplementary Note 12, wherein, when the moving object collects sound in the surveillance area and supplies it to the control unit, the control unit outputs at least a portion of the sound data to the management terminal. (Supplementary Note 14) The information processing device according to Supplementary Note 13, wherein the control unit outputs the sound data supplied from the management terminal to the control unit to the moving object. (Supplementary Note 15) The information processing device according to Supplementary Note 10, wherein the control unit estimates the timing at which the attention object will arrive at a traffic signal within the communication range based on the identified warning information and position information of the moving object, and outputs a traffic control signal to the traffic signal to display a traffic signal indicating "stop" based on the estimated timing. (Supplementary Note 16) An information processing method, in which a computer capable of direct wireless communication with a mobile body having a camera within a communication range of direct wireless communication acquires predetermined warning information from a terminal connected for direct communication within the communication range, calculates a first index indicating the possibility that an event requiring vigilance has occurred based on the warning information, and, if the first index is equal to or greater than a first threshold, identifies a warning area in which the event may have occurred based on the warning information, and outputs a movement control signal to the mobile body to instruct it to photograph the identified warning area.(Supplementary Note 17) A program that causes a computer to execute an information processing method in which a computer capable of direct wireless communication with a mobile body having a camera within a communication range of direct wireless communication acquires specified warning information from a terminal that is directly connected within the communication range and is capable of direct communication; calculates a first index that indicates the possibility that an event that requires vigilance has occurred based on the warning information; and, if the first index is equal to or greater than a first threshold, identifies a warning area in which the event may have occurred based on the warning information, and outputs a movement control signal to the mobile body to instruct it to photograph the identified warning area.

[0100] Some or all of the elements (e.g., configurations and functions) described in Supplementary Notes 2 to 15 that are dependent on Supplementary Note 1 may also be dependent on Supplementary Notes 16 and 17 in the same dependency relationship as Supplementary Notes 2 to 15. Some or all of the elements described in any Supplementary Note may be applied to various hardware, software, recording means for recording software, systems, and methods.

[0101] This application claims priority based on Japanese Patent Application No. 2023-019536, filed February 10, 2023, the disclosure of which is incorporated herein by reference in its entirety.

[0102] The present disclosure can be used, for example, in a safety management device for a traffic network in a predetermined area.

[0103] DESCRIPTION OF SYMBOLS 10 Information processing device 11 Warning information acquisition unit 12 Calculation unit 13 Control unit 14 Memory unit 100 Information processing system 110 Base station 111 Communication unit 120 Signal pole 121 Traffic signal 122 Drone port 123 Camera 200 Mobile body 201 Position information acquisition unit 202 Communication unit 203 Camera 204 Mobile body control unit 205 Drive unit 206 Memory unit 207 Interface unit 210 Mobile body 300 Vehicle 310 Communication terminal 311 Position information acquisition unit 312 Communication unit 313 Camera 314 Impact detection unit 315 Interface unit 316 Terminal control unit 400 Management terminal 401 Communication unit 402 Interface unit 403 Control unit 404 Memory unit R11 Communication range R21 Security area R22 Security area N1 Network P01 Person P02 Person P03 Administrator

Claims

1. An information processing device that controls processing performed by a mobile object having a camera within a communication range of direct wireless communication and a base station capable of the direct wireless communication, a warning information acquisition means for acquiring predetermined warning information from a terminal connected to the communication area so as to be directly communicable; a calculation means for calculating a first index indicating a possibility that an event requiring caution has occurred based on the warning information; and a control means for, when the first index is equal to or greater than a first threshold, identifying an alert area in which the event may have occurred based on the warning information, and outputting a movement control signal to the moving body to instruct the moving body to photograph the identified alert area. Information processing device.

2. the control means outputs the movement control signal to the moving body, which is an autonomous flying object having a camera capable of photographing scenery on the ground in the air. The information processing device according to claim 1 .

3. the warning information acquisition means acquires the warning information from a communication terminal that moves together with a vehicle or a person present in the communication range by performing the direct wireless communication with the communication terminal; The information processing device according to claim 1 .

4. The warning information acquisition means acquires, as the warning information, image data captured by a camera installed on a signal pole within the communication range. The information processing device according to claim 1 .

5. When the first indicator is equal to or greater than a second threshold value that is higher than the first threshold value, the control means outputs a traffic control signal to a traffic signal present within the communication range to issue a signal to inhibit vehicles or persons from entering the alert area. The information processing device according to any one of claims 1 to 4.

6. the control means outputs the traffic control signal to the traffic signal provided on a signal pole within the communication range. The information processing device according to claim 5 .

7. the calculation means, when acquiring image data of the alert area from the moving object, calculates a second index indicating a possibility that the event has occurred based on the image data; the control means outputs the traffic control signal to the traffic signal so as to inhibit a vehicle or a person from entering the alert area when the second indicator is equal to or greater than the second threshold which is higher than the first threshold. The information processing device according to claim 6 .

8. the control means outputs the movement control signal to the moving body instructing the moving body to photograph the surveillance area from a position closer than the distance between the signal pole and the surveillance area.

6. An information processing apparatus according to claim 5 when claim 4 is dependent thereon.

9. A computer capable of direct wireless communication with a mobile object having a camera within a communication range of the direct wireless communication, acquiring predetermined warning information from a terminal that is directly connected within the communication range and is capable of communicating with the terminal, calculating a first index indicating a possibility that an event requiring caution has occurred based on the warning information; If the first index is equal to or greater than a first threshold, a warning area in which the event may have occurred is identified based on the warning information, and a movement control signal is output to the moving body to instruct the moving body to photograph the identified warning area. Information processing methods.

10. A computer capable of direct wireless communication with a mobile object having a camera within a communication range of the direct wireless communication, acquiring predetermined warning information from a terminal that is directly connected within the communication range and is capable of communicating with the terminal, calculating a first index indicating a possibility that an event requiring caution has occurred based on the warning information; If the first index is equal to or greater than a first threshold, a warning area in which the event may have occurred is identified based on the warning information, and a movement control signal is output to the moving body to instruct the moving body to photograph the identified warning area. A program that causes a computer to execute an information processing method.