Control device, control method, and program

Abstract

A control device (10) comprises an image processing unit (110), a movement path estimation unit (120), and a control unit (140). The image processing unit (110) processes an image to detect occurrence of a given event. The movement path estimation unit (120) specifies an object, which is a person and / or a vehicle involved in the event, and estimates an estimated movement path of the object. The control unit (140) controls a device to guide the object along the estimated movement path. The controlled device is, for example, a traffic light included in a traffic system.

Description

[Technical field]

[0001] The present invention relates to a control device, a control method, and a program. [Background technology]

[0002] In recent years, image processing has been used in various fields. For example, Patent Document 1 describes a method of receiving license plate information from a vehicle recognition camera installed on a road and predicting the travel range of a pre-registered wanted vehicle using the license plate information. Patent Document 1 further describes a method of slowing down the travel of the wanted vehicle by controlling traffic lights within the travel range.

[0003] Furthermore, Patent Document 2 describes a method of extracting an image that satisfies the conditions necessary to prove a specific traffic violation from a plurality of images captured continuously from a single camera.

[0004] Furthermore, Patent Document 3 describes that when location information of the surveillance camera 2 capturing the fleeing vehicle is obtained, the image from the surveillance camera 2 from which the location information was obtained is analyzed to determine the fleeing direction of the fleeing vehicle. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2008-52464 A [Patent Document 2] JP 2016-130931 A [Patent Document 3] JP 2020-108106 A Summary of the Invention [Problem to be solved by the invention]

[0006] If the direction of travel of a vehicle or person can be determined, a person who is familiar with the surrounding road conditions can estimate the route of travel of the vehicle or person. However, the actual route of travel of the vehicle or person may differ from the estimated route.

[0007] One example of an objective of the present invention is to increase the likelihood that the actual movement path of a vehicle or person will match the estimated movement path. [Means for solving the problem]

[0008] According to a first aspect of the present invention, there is provided an image processing means for detecting the occurrence of a specific event by processing an image; A movement path estimation means for identifying an object that is a person and / or a vehicle involved in the specific event and estimating an estimated movement path of the object; control means for controlling an apparatus to guide the object according to the estimated movement path; A control device is provided comprising:

[0009] Furthermore, according to the present invention, there are also provided a control method performed by the above-mentioned control device, and a program required for implementing the above-mentioned control device. Effect of the Invention

[0010] According to the present invention, the likelihood that the actual movement path of a vehicle or person will match the estimated movement path is increased. [Brief description of the drawings]

[0011] [Figure 1] FIG. 2 is a diagram for explaining a usage environment of the control device according to the embodiment. [Diagram 2] FIG. 2 is a diagram illustrating an example of a functional configuration of a control device. [Diagram 3] FIG. 2 is a diagram illustrating an example of an image generated by an imaging device. [Figure 4] FIG. 11 is a diagram showing an example of a screen displayed on the first terminal. [Diagram 5] FIG. 2 is a diagram illustrating an example of a hardware configuration of a control device. [Figure 6] 4 is a flowchart showing a first example of processing performed by the control device. [Figure 7] 11 is a flowchart showing a second example of the process performed by the control device. [Figure 8] 11 is a flowchart illustrating a third example of the process performed by the control device. [Figure 9] 11 is a flowchart illustrating a fourth example of a process performed by the control device. [Figure 10] 13 is a flowchart showing a fifth example of a process performed by the control device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In all the drawings, the same components are given the same reference numerals and the description will be omitted as appropriate.

[0013] 1 is a diagram for explaining a usage environment of a control device 10 according to an embodiment. The control device 10 is used together with a plurality of imaging devices 30, a plurality of first devices 40, and a center device 70 of a traffic control system.

[0014] The imaging device 30 captures images of vehicles and people passing on a road at a predetermined frame rate and transmits the generated images to the control device 10. The first device 40 is a device arranged in a city, and is, for example, at least a part of a traffic control system (for example, a traffic light) that controls the movement of people and / or vehicles. The imaging device 30 may capture images while a specific event described later may occur. For example, when an intersection is included in the imaging range of the imaging device 30 and a traffic light is installed at this intersection, the imaging device 30 may obtain control information of the traffic light from the center device 70 and set a period for capturing images using the control information. As an example, the imaging device 30 captures images while the traffic light is red. Such control is possible by obtaining information indicating the lighting state of the traffic light from the center device 70.

[0015] The center device 70 controls traffic by controlling at least a part of the first device 40. The center device 70 also stores the congestion status of each road and the average travel speed at each point. The center device 70 may further store an estimate of the time required to travel between two points (hereinafter, referred to as the expected travel time).

[0016] The control device 10 detects the occurrence of a predetermined event (hereinafter, referred to as a specific event) by processing the image acquired from the imaging device 30. The specific event is, for example, but not limited to, a traffic violation. The control device 10 also identifies a person and / or a vehicle (hereinafter, referred to as an object 60) involved in the specific event. If the object 60 is a vehicle, the control device 10 reads an identifier (hereinafter, referred to as license plate information) written on the license plate of the vehicle. If the object 60 is a person, the control device 10 generates a feature amount (for example, a feature amount of a face and / or a clothing) of the person. Furthermore, the control device 10 estimates an estimated movement path of the object 60, and controls the first device 40 via the center device 70 to guide the object 60 according to the estimated movement path. This control increases the probability that the object 60 moves according to the estimated movement path.

[0017] Furthermore, multiple second devices 50 are placed in the city. The second devices 50 are, for example, light-emitting devices such as rotating lights, displays, or output devices such as speakers. The control device 10 causes the second devices 50 located on the estimated movement route to perform a predetermined output. This allows people located around the second devices 50 to recognize that the position of the second devices 50 is included in the estimated movement route.

[0018] Also, there are multiple people (hereinafter referred to as "investigators") in the city who should investigate the target 60. The investigation executors are, for example, police officers, but may also be private security guards. Each of the multiple investigation executors carries a portable first terminal 20. The first terminal 20 is a smartphone, a tablet terminal, or a wearable terminal. The control device 10 transmits information about the target 60 and information about the estimated escape route to at least some of the first terminals 20.

[0019] At this time, the control device 10 may set a specific point included in the estimated escape route as a location where the target 60 should stay (hereinafter referred to as a stay point). In this case, the control device 10 controls at least one first device 40 via the center device 70 so that the target 60 stays at the stay point. In addition, the control device 10 sets a recommended travel route from the current location of the survey executor to the stay point, and transmits this recommended travel route to the first terminal 20 carried by the survey executor.

[0020] Additionally, there are multiple people (hereinafter referred to as "collaborators") in the city who should cooperate with the survey executor. The collaborators are, for example, civilians. The second terminal 22 is carried by the collaborators. The control device 10 identifies collaborators who are near the staying point, and transmits information indicating the staying point to the second terminal 22 of the collaborator (there may be multiple collaborators). This allows the collaborators to recognize the location of the staying point. Note that at least some of the collaborators may not have the second terminal 22. In this case, the control device 10 notifies the collaborators by controlling the second device 50.

[0021] 2 is a diagram showing an example of a functional configuration of the control device 10. The control device 10 includes an image processing unit 110, a travel route estimation unit 120, and a control unit 140. The control device 10 can also acquire various information stored in the center device 70 and various information stored in the information storage unit 180.

[0022] The information storage unit 180 stores various information necessary for the processing performed by the control device 10. Examples of information stored in the information storage unit 180 include map information, information on each of a plurality of investigation executors, information on each of a plurality of collaborators, license plate information of wanted vehicles, and characteristic quantities of criminal suspects. Information on investigation executors is, for example, name, information required for communication with the first terminal 20, and current location. Information on collaborators is, for example, name, information required for communication with the second terminal 22, and current location. Note that the information storage unit 180 may be a part of the control device 10.

[0023] The image processing unit 110 detects the occurrence of a specific event by processing the image generated by the imaging device 30 in real time. The specific event may be, for example, a traffic violation, but may also be "the presence of a wanted vehicle and / or a suspect", a collision between vehicles, a collision between a vehicle and a person or animal, or an unreasonable cut-in by a vehicle. When the specific event is a traffic violation, the image processing unit 110 detects the occurrence of a traffic violation by processing a plurality of images that are consecutive in time (for example, a plurality of frame images that constitute a video) or by comparing an image generated by the imaging device 30 with an image in a normal state. Examples of traffic violations that are specific events include, but are not limited to, ignoring traffic signals, crossing a stop line, violation of a stop sign, violation of a right turn (or left turn) prohibition, and speeding. In addition, when the specific event is "the presence of a wanted vehicle and / or a suspect", the image processing unit 110 determines that the specific event has occurred if the above-mentioned license plate information (or the feature amount of the target 60) is stored in the information storage unit 180.

[0024] In addition, the image processing unit 110 may continue to process images generated by multiple imaging devices 30 in real time, and continue to recognize the current location of the object 60 by using the processing results and the license plate information (or the features of the object 60).

[0025] The movement route estimation unit 120 identifies the target 60 and estimates an estimated movement route of the target 60. For example, the movement route estimation unit 120 identifies a plurality of possible escape routes using the occurrence point and occurrence time of a specific event, and the movement direction of the target 60. The movement route estimation unit 120 then selects an estimated movement route from the plurality of possible escape routes using the congestion status and average movement speed of each road acquired from the center device 70. Note that these processes may be performed using a rule base, or may be performed using a model generated by machine learning.

[0026] The control unit 140 controls devices (e.g., the first device 40) installed in the city to guide the target 60 along the estimated movement path. For example, the control unit 140 continues to acquire the current position of the target 60 from the image processing unit 110. Then, when the current position of the target 60 approaches an intersection, the control unit 140 controls a traffic light (one example of the first device 40) installed at the intersection so that the target 60 advances along the estimated movement path at the intersection. For example, if the estimated movement path indicates going straight through the intersection, the control unit 140 controls the traffic light so that the target 60 can go straight (or can only go straight) when the target 60 reaches the intersection. Also, if the estimated movement path indicates turning right (or left) at the intersection, the control unit 140 controls the traffic light so that the target 60 can turn right (or left) (or can only turn right (or left)) when the target 60 reaches the intersection.

[0027] The control device 10 further includes an importance specifying unit 130, a location setting unit 150, a first information transmitting unit 160, and a second information transmitting unit 170.

[0028] The importance specifying unit 130 specifies the importance of a specific event.

[0029] For example, the image processing unit 110 may generate information required to generate this importance by processing the image generated by the imaging device 30. An example of this information is the license plate information and the feature amount of the target 60 (e.g., a person) described above. In this case, the importance identification unit 130 increases the importance of the specific event above a reference value when the license plate information (or feature amount) generated by the image processing unit 110 is stored in the information storage unit 180, and otherwise sets the importance of the specific event to the reference value. Furthermore, the importance identification unit 130 increases the importance of the specific event above a reference value when the feature amount of a person generated by the image processing unit 110 is stored in the information storage unit 180, and otherwise sets the importance of the specific event to the reference value.

[0030] Also, the image processing unit 110 may directly generate the importance. In this case, the importance identification unit 130 acquires this importance. For example, when the specific event is a traffic violation, the information storage unit 180 can store the importance in advance for each type of traffic violation. The image processing unit 110 generates the importance by identifying the type of traffic violation and reading out the importance corresponding to this type from the information storage unit 180. At this time, depending on the type of traffic violation, the degree of the traffic violation (for example, the amount of excess speed in the case of a speeding violation) may be identified. In this case, the importance increases as the degree of the traffic violation increases.

[0031] Then, the control unit 140 may control the above-mentioned device (for example, the first device 40) only when at least one of the importance and the estimated movement route satisfies a criterion.

[0032] For example, the control unit 140 may control the above-mentioned device (e.g., the first device 40) only when the importance is equal to or higher than a reference level. Furthermore, the control unit 140 may control the above-mentioned device only when a predetermined area is included in the estimated movement route. Here, information specifying the predetermined area is stored in the information storage unit 180. The predetermined area is, for example, an area where safety should be particularly emphasized, or an area with a large number of people (e.g., a high population density). Furthermore, the control unit 140 may control the above-mentioned device only when the importance is equal to or higher than a reference level and the predetermined area is included in the estimated movement route.

[0033] When the estimated movement route includes a predetermined area, the movement route estimation unit 120 may reset the estimated movement route so as to bypass the area. In this case, the control unit 140 controls the first device 40 so that the target 60 bypasses the predetermined area.

[0034] The point setting unit 150 sets the above-mentioned staying point on the estimated movement route. For example, the point setting unit 150 sets an intersection where the required time from the position where the specific event occurred is within a reference range as the staying point. The setting of the staying point may be performed, for example, on a rule basis, or may be performed using a model generated by machine learning.

[0035] Then, the control unit 140 controls a device (e.g., the first device 40) as necessary so that the movement of the object 60 is delayed (or the object 60 is stopped) at the staying point. For example, the control unit 140 continues to acquire the current position of the object 60 from the image processing unit 110. Then, when the current position of the object 60 approaches the staying point, the control unit 140 displays a no-progress message on a traffic light located at the staying point or a traffic light located immediately after the staying point on the estimated movement route.

[0036] Furthermore, the control unit 140 selects a second device 50 whose position based on the stay point satisfies a criterion. As an example, if the stay point is an intersection and the second device 50 is installed at this intersection, the control unit 140 selects this second device 50. As another example, the control unit 140 selects a second device 50 within a predetermined distance (sometimes forward and sometimes backward) from the stay point on the estimated movement route. case The control unit 140 then performs processing to cause the selected second device 50 to perform a predetermined output. For example, the control unit 140 transmits a signal to the second device 50 to perform a predetermined output. In this manner, a person near the staying point can recognize that the location has been set as the staying point.

[0037] The first information transmission unit 160 selects from the multiple survey executors who should survey the target 60 this time. For example, the first information transmission unit 160 estimates the time when the target 60 will arrive at the staying point. The first information transmission unit 160 also reads out the current location of each of the multiple survey executors from the information storage unit 180. Then, using these current locations and the information stored in the center device 70, the first information transmission unit 160 selects a survey executor who is expected to reach the staying point by this estimated time.

[0038] Then, the first information transmission unit 160 generates information indicating a recommended movement route from the current location of the selected survey executor to the stay point (hereinafter, referred to as recommended route information) using the current location of the survey executor, the location of the stay point, the average movement speed of the survey executor, and information stored in the center device 70 (information indicating the congestion state of the sidewalk), and transmits this recommended route information to the first terminal 20 of the survey executor. At this time, the first information transmission unit 160 may transmit information indicating the estimated movement route of the target 60 and information identifying the target 60 to the first terminal 20. The information identifying the target 60 is, for example, license plate information and / or an image obtained by cropping the target 60 from an image generated by the imaging device 30.

[0039] The second information transmission unit 170 acquires the current location of each of the above-mentioned multiple helpers, i.e., multiple people who should cooperate with the survey executor, from the information storage unit 180. Then, the second information transmission unit 170 identifies a person from the multiple helpers whose current location meets a criterion, and transmits at least one of information indicating the location of the stay point and information about the target 60 to the second terminal 22 of the identified helper.

[0040] Here, the above-mentioned criteria regarding the current location of the collaborator are set based on, for example, the estimated movement route. As an example, the second information transmission unit 170 uses information stored in the center device 70 to calculate the time when the target 60 is expected to arrive at each point on the estimated movement route. Then, the second information transmission unit 170 selects, from among the multiple collaborators, a person who is estimated to be able to reach any point on the estimated movement route before the target 60. As another example, the second information transmission unit 170 may select, from among the multiple collaborators, a person who is within a predetermined distance (for example, within 100 m) from the staying point. As yet another example, the second information transmission unit 170 may select, from among the multiple collaborators, a person who is estimated to be able to reach the staying point before the target 60.

[0041] Moreover, the “information related to the target 60” transmitted to the second terminal 22 is information that identifies the target 60. An example of the information that identifies the target is license plate information and / or an image in which the target 60 is cropped from the image generated by the imaging device 30.

[0042] 3 is a diagram showing an example of an image generated by the imaging device 30. In the example shown in this figure, the imaging device 30 includes an intersection in its imaging range. The stopping position of the target 60, a vehicle, is beyond the stop line. The image processing unit 110 detects this violation by processing the image.

[0043] 4 is a diagram showing an example of a screen displayed on the first terminal 20. In the example shown in this figure, the first terminal 20 displays a map. This map includes the current location of the target 60, the estimated movement route of the target 60, a stay point 62, and the current location and recommended movement route of the survey executor who carries the first terminal 20. The current location of the target 60 and the current location of the survey executor are repeatedly updated. Accordingly, the estimated movement route and recommended movement route may also be updated.

[0044] 5 is a diagram showing an example of a hardware configuration of the control device 10. The control device 10 includes a bus 1010, a processor 1020, a memory 1030, a storage device 1040, an input / output interface 1050, and a network interface 1060.

[0045] The bus 1010 is a data transmission path for transmitting and receiving data among the processor 1020, memory 1030, storage device 1040, input / output interface 1050, and network interface 1060. However, the method of connecting the processor 1020 and the like to each other is not limited to bus connection.

[0046] The processor 1020 is implemented by a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or the like.

[0047] The memory 1030 is a main storage device realized by a RAM (Random Access Memory) or the like.

[0048] The storage device 1040 is an auxiliary storage device realized by a hard disk drive (HDD), a solid state drive (SSD), a memory card, a read only memory (ROM), or the like. The storage device 1040 stores program modules that realize each function of the control device 10 (e.g., the image processing unit 110, the travel route estimation unit 120, the importance identification unit 130, the control unit 140, the location setting unit 150, the first information transmission unit 160, and the second information transmission unit 170). The processor 1020 loads each of these program modules onto the memory 1030 and executes them, thereby realizing each function corresponding to the program module.

[0049] The input / output interface 1050 is an interface for connecting the control device 10 to various input / output devices.

[0050] The network interface 1060 is an interface for connecting the control device 10 to a network. This network is, for example, a LAN (Local Area Network) or a WAN (Wide Area Network). The network interface 1060 may connect to the network wirelessly or by wire. The control device 10 may communicate with the first terminal 20, the second terminal 22, the imaging device 30, the second device 50, and the center device 70 via the network interface 1060.

[0051] 6 is a flowchart showing a first example of processing performed by the control device 10. The imaging device 30 generates images at a predetermined frame rate. This frame rate is, for example, 0.5 frames / second or more and 10 frames / second or less. The multiple imaging devices 30 transmit images to the control device 10 in real time. The control device 10 then performs the processing shown in this figure every time it acquires an image. Therefore, when the imaging device 30 captures an image while the traffic light is red, the processing shown in this figure is performed on the image when the traffic light is red.

[0052] Furthermore, when the specific event is "the stopping position of a vehicle or person crossing the stop line," an image processing device may be provided between the imaging device 30 and the control device 10. This image processing device may determine in real time whether or not an image shows that the stopping position of a vehicle or person crosses the stop line, and transmit the image to the control device 10 only when the stopping position crosses the stop line.

[0053] Furthermore, the process shown in this figure does not have to be performed at a specific time, in a specific time period, or in a specific weather condition. The specific time, in a specific time period, and in a specific weather condition are, for example, a timing / weather condition (e.g., rain) when the roads in the city targeted by the control device 10 are expected to be congested. This timing may be, for example, a commuting time or a school commuting time, or a time when a specific event is taking place.

[0054] When an image is acquired, the image processing unit 110 of the control device 10 processes the image. The processing performed here is at least a process for detecting a specific event. In addition, the image processing unit 110 processes the image to generate other necessary information. Specific examples of the information generated here are as described with reference to FIG. 2 (step S10).

[0055] Furthermore, the image processing unit 110 stores the acquired image in the information storage unit 180 by linking it to the identification information of the imaging device 30 that generated the image and the generation time of the image. At this time, the image processing unit 110 may store the image in the information storage unit 180 by linking it to information indicating that a specific event was detected (e.g., a flag) and the type of the specific event (e.g., the details of a traffic violation). This allows the user of the control device 10 to easily search for an image in which a specific event was detected and to consider the specific event using the searched image. Furthermore, if the specific event is a traffic violation, the police officer or the center device 70 can take action regarding the traffic violation (a process of notifying the violator of the payment of a fine).

[0056] When the image processing unit 110 detects a specific event (step S20: Yes), the movement path estimation unit 120 estimates an estimated movement path (step S30). An example of a method for estimating an estimated movement path is as described with reference to FIG.

[0057] Then, the control unit 140 controls the first device 40 to a state different from normal so that the target 60 moves along the estimated movement path (step S40). An example of the control performed here is as described with reference to FIG. 2. Note that, when the type of the specific event satisfies the criteria, instead of or in addition to controlling the first device 40, the control unit 140 may operate the second device 50 located within a predetermined range from the location where the specific event was detected. Such control is performed, for example, when the specific event is "the vehicle as the target 60 deviating from the lane."

[0058] Thereafter, the control unit 140 may identify the imaging devices 30 that include the estimated movement path in their imaging ranges, and change the imaging modes of these imaging devices 30. For example, the control unit 140 may increase the frame rate of the imaging devices 30, or may increase the magnification during imaging within a range in which the road that is the estimated movement path does not deviate from the imaging range. The control unit 140 may continue to acquire the current position of the target 60 from the image processing unit 110, and further control the first device 40 according to this current position. As an example, when it is desired to slow down the movement speed of the target 60 (for example, when the movement speed of the target 60 is faster than expected), the control unit 140 controls the first device 40 so that the time required on the estimated movement path becomes longer. Also, when it is desired to speed up the movement speed of the target 60 (for example, when the movement speed of the target 60 is slower than expected), the control unit 140 controls the first device 40 so that the time required on the estimated movement path becomes shorter. This process may be performed in each of the second and subsequent examples described later.

[0059] Furthermore, the movement path estimation unit 120 may periodically update the estimated movement path using the current position and the movement history of the target 60. In this case, the control unit 140 updates the content of the control shown in step S40 every time the estimated movement path is updated.

[0060] After a predetermined time has elapsed, the control unit 140 ends the control shown in step S40.

[0061] 7 is a flowchart showing a second example of the processing performed by the control device 10. In this figure, the prerequisites and steps S10 to S30 are the same as those in the example shown in FIG.

[0062] After the movement path estimation unit 120 estimates the estimated movement path (step S30), the importance identification unit 130 identifies the importance. An example of a method for identifying the importance is as described with reference to FIG. 2. Then, if the importance meets a criterion, for example, if it exceeds a criterion value (step S102: Yes), the control unit 140 controls the first device 40 so that the target 60 moves along the estimated movement path (step S104). At this time, the control unit 140 may change the control content of the first device 40 depending on the magnitude of the importance. For example, the control unit 140 controls the first device 40 so that the movement speed of the target 60 on the recommended movement path slows down (for example, so that the state in which the target 60 cannot move in the traveling direction at an intersection is extended) as the importance increases.

[0063] Furthermore, if the importance does not satisfy the criteria (step S102: No), the control unit 140 controls a device other than the first device 40 that is the control target in step S104, for example, the second device 50, and causes the second device 50 to perform a predetermined output (step S106). The second device 50 that is the target 60 here is, for example, the second device 50 located within a predetermined range from the point where the specific event occurred.

[0064] According to the example shown in the figure, the control device 10 does not control the first device 40 for minor events, so the occurrence of traffic congestion and the like is reduced. In addition, since the second device 50 performs output, people around the second device 50 and the driver of the vehicle as the target 60 can recognize that a specific event has been detected.

[0065] In addition, in step S106 of FIG. 7, the control unit 140 may control the unmanned aerial vehicle to track the target 60 instead of the second device.

[0066] The importance identification unit 130 may also update the importance using the movement of the target 60 while it is moving along the estimated movement path. This movement is identified, for example, by the image processing unit 110 processing an image including the target 60. For example, the importance identification unit 130 increases the importance when the vehicle as the target 60 is meandering, when the number of lane changes per unit time is equal to or greater than a reference value, or when the speed of the vehicle is greater than the speed of other surrounding vehicles by equal to or greater than a reference value. Then, the control unit 140 performs the processes from step S102 onward again using the updated importance.

[0067] FIG. 8 is a flowchart showing a third example of the process performed by the control device 10. The process shown in this figure is similar to the example shown in FIG. 7, except that instead of steps S100 to S102, it is determined whether or not a predetermined area is included in the estimated moving route (step S101). In detail, the control unit 140 performs the process shown in step S104 when the estimated moving route includes a predetermined area (step S101: Yes). Furthermore, the control unit 140 performs the process shown in step S106 when the estimated moving route does not include a predetermined area (step S101: No). As described above, specific examples of the predetermined area are areas where safety is particularly important, or areas with a large number of people (for example, high population density).

[0068] In addition, in step S104 in FIG. 7 and FIG. 8, the control unit 140 may further perform processes shown in steps S200 to S204 described later.

[0069] 9 is a flowchart showing a fourth example of the process performed by the control device 10. In the example shown in this figure, the control device 10 sets a staying point.

[0070] In this figure, steps S10 to S30 are the same as the example shown in FIG. 6. After the travel route estimation unit 120 estimates the estimated travel route (step S30), the point setting unit 150 sets a stay point (step S200). An example of a method for setting the stay point is as described with reference to FIG. 2. Then, the first information transmission unit 160 sets a recommended travel route (step S202). An example of a method for setting the recommended travel route is as described with reference to FIG. 2. Then, the first information transmission unit 160 transmits recommended route information indicating this recommended travel route to the first terminal 20. At this time, the first information transmission unit 160 may further transmit estimated route information indicating the estimated travel route and information identifying the target 60 (for example, license plate information and / or an image obtained by cropping the target 60 from an image generated by the imaging device 30) to the first terminal 20 (step S204). The first terminal 20 displays the received information.

[0071] Here, the first information transmission unit 160 may display a button on the first terminal 20 for inputting information indicating whether the survey executor is available or not. In this case, the first terminal 20 transmits the input result of this button to the control device 10. This allows the control device 10 to determine whether the survey executor corresponding to the specific event has been determined or not.

[0072] Furthermore, the location setting unit 150 may repeatedly transmit information indicating the current location of the target 60 to the first terminal 20. In this case, the first terminal 20 updates the information indicating the current location of the target 60 repeatedly.

[0073] Thereafter, the travel route estimation unit 120 controls the first device 40 in the same manner as in the example shown in FIG. 6 (step S40).

[0074] Thereafter, the first information transmission unit 160 may continue to acquire the current location of the target 60 from the image processing unit 110, and may further notify the first terminal 20 according to this current location. For example, if the moving speed of the target 60 is faster or slower than expected, the first information transmission unit 160 transmits information indicating that to the first terminal 20.

[0075] Fig. 10 is a flowchart showing a fifth example of the process performed by the control device 10. The example shown in this figure is similar to the example shown in Fig. 9, except that instead of steps S202 and S204, a second device 50 near the staying point is identified, and a signal is transmitted to the second device 50 to cause the second device 50 to perform a predetermined output (step S210). Note that an example of the method of identifying the second device 50 to be the transmission destination is as described using Fig. 2.

[0076] In addition, in this figure, the processes shown in steps S202 and S204 in FIG. 9 may be performed between steps S200 and S210, or between steps S210 and S40.

[0077] As described above, according to this embodiment, by using the control device 10, it is possible to increase the possibility that the actual movement path of a vehicle or person will match the estimated movement path.

[0078] Although the embodiments of the present invention have been described above with reference to the drawings, these are merely examples of the present invention, and various configurations other than those described above can also be adopted.

[0079] In addition, in the flowcharts used in the above description, multiple steps (processes) are described in order, but the order of execution of the steps performed in each embodiment is not limited to the order described. In each embodiment, the order of the steps shown in the figures can be changed to the extent that the content is not affected. In addition, the above-mentioned embodiments can be combined to the extent that the content is not contradictory.

[0080] A part or all of the above-described embodiments can be described as, but are not limited to, the following supplementary notes. 1. An image processing means for detecting the occurrence of a specific event by processing an image; A movement path estimation means for identifying an object that is a person and / or a vehicle involved in the specific event and estimating an estimated movement path of the object; control means for controlling an apparatus to guide the object according to the estimated movement path; A control device comprising: 2. In the control device according to the above item 1, The device is at least part of a transportation system that controls the movement of people and / or vehicles. 3. In the control device according to 1 or 2 above, The control means controls the device when at least one of the importance of the specific event and the estimated movement path satisfies a criterion. 4. In the control device according to the above item 3, The image processing means processes the image to generate information required to generate the importance level or the importance level. 5. In the control device according to the above item 3, The control device, wherein the criterion is that a particular area is included in the estimated travel route. 6. In the control device according to any one of 1 to 5 above, a point setting means for setting a stay point on the estimated movement path, the stay point being a position where the target should stay; The control means controls the device so that the object stays at the stay point. 7. The control device according to claim 6, a control device comprising: a first information transmission means for generating recommended route information indicating a recommended route from a current location of a survey person who is to survey the target to the staying point, and transmitting the recommended route information to a terminal carried by the survey person. 8. The control device according to claim 6 or 7, A control device comprising a second information transmission means for identifying a target person whose current location meets a criterion, and transmitting at least one of information indicating the location of the stay point and information regarding the target to a terminal carried by the target person. 9. In the control device according to any one of claims 6 to 8, The control means identifies a target device that is an output device whose position based on the stay point satisfies a criterion, and performs processing to cause the target device to perform a predetermined output. 10. An image processing means for detecting the occurrence of a specific event by processing an image; A movement path estimation means for identifying an object that is a person and / or a vehicle involved in the specific event and estimating an estimated movement path of the object; an importance specifying means for specifying the importance of the specific event; A control means for controlling at least a part of a traffic system for controlling the movement of people and / or vehicles on a road; Equipped with The control means When the importance level satisfies a criterion, the estimated movement path is used to control the at least part of the vehicle. A control device that controls another device different from the at least some of the devices when the importance does not satisfy a criterion. 11. The control device according to claim 10, The control device, wherein the other device is an output device located on the estimated movement path. 12. In the control device according to claim 10, The control device, wherein the other device is an unmanned aerial vehicle. 13. The computer: image processing for detecting an occurrence of a specific event by processing the image; A movement path estimation process for identifying an object that is a person and / or a vehicle involved in the specific event and estimating an estimated movement path of the object; a control process for controlling an apparatus to guide the object according to the estimated movement path; A control method for performing the above. 14. In the control method according to claim 13, The method of control, wherein the device is at least part of a transportation system that controls the movement of people and / or vehicles. 15. In the control method according to 13 or 14 above, The control method, wherein the computer controls the device when at least one of the importance of the specific event and the estimated movement route satisfies a criterion in the control process. 16. In the control method according to claim 15, A control method in which the computer generates the importance or information required to generate the importance by processing the image in the image processing. 17. In the control method according to claim 15, A control method, wherein the criterion is that a particular area is included in the estimated travel path. 18. In the control method according to any one of claims 13 to 17, The computer further comprises: performing a point setting process for setting a stay point on the estimated movement path, the stay point being a position where the target should stay; A control method, in which the control process controls the device so that the target stays at the stay point. 19. In the control method according to claim 18, The computer further comprises: A control method that generates recommended route information indicating a recommended route from the current location of a survey person who is to survey the target to the staying point, and performs a first information transmission process to transmit the recommended route information to a terminal carried by the survey person. 20. In the control method according to 18 or 19 above, The computer further comprises: A control method that identifies a target person whose current location meets a criterion, and performs a second information transmission process to transmit at least one of information indicating the location of the stay point and information regarding the target to a terminal carried by the target person. 21. In the control method according to any one of claims 18 to 20, The control method includes, in the control process, identifying a target device that is an output device whose position based on the stay point satisfies a criterion, and performing a process to cause the target device to perform a specified output. 22. The computer image processing for detecting an occurrence of a specific event by processing the image; A movement path estimation process for identifying an object that is a person and / or a vehicle involved in the specific event and estimating an estimated movement path of the object; an importance specification process for specifying the importance of the specific event; a control process for controlling at least a part of a traffic system for controlling the movement of people and / or vehicles on roads; Do the following: In the control process, the computer When the importance level satisfies a criterion, the estimated movement path is used to control the at least part of the vehicle. A control method for controlling devices other than the at least some of the devices when the importance does not satisfy a criterion. 23. In the control method according to claim 22, A control method, wherein the other device is an output device located on the estimated movement path. 24. In the control method according to claim 22, A control method, wherein the other device is an unmanned aerial vehicle. 25. To the computer, an image processing function for detecting the occurrence of a specific event by processing an image; A movement path estimation function that identifies an object that is a person and / or a vehicle involved in the specific event and estimates an estimated movement path of the object; a control function for controlling an apparatus to guide the object according to the estimated movement path; A program that performs the following. 26. In the program according to 25 above, The device is at least part of a transportation system that controls the movement of people and / or vehicles. 27. In the program according to 25 or 26 above, The control function is a program that controls the device when at least one of the importance of the specific event and the estimated movement route satisfies a criterion. 28. In the program according to 27 above, The image processing function is a program that processes the image to generate information required for generating the importance or the importance. 29. In the program according to 27 above, The program, wherein the criterion is that a particular area is included in the estimated travel route. 30. In the program according to any one of the above 25 to 29, the computer further has a point setting function for setting a stay point on the estimated movement path, the stay point being a position where the target should stay; The control function is a program that controls the device so that the object stays at the stay point. 31. In the program according to claim 30, The computer further comprises: a program having a first information transmission function that generates recommended route information indicating a recommended route from the current location of a survey person who is to survey the target to the staying point, and transmits the recommended route information to a terminal carried by the survey person. 32. In the program according to 30 or 31 above, The computer further comprises: A program that identifies a target person whose current location meets a criterion, and provides a terminal carried by the target person with a second information transmission function that transmits at least one of information indicating the location of the stay point and information about the target. 33. In the program according to any one of the above items 30 to 32, The control function is a program that identifies a target device that is an output device whose position based on the dwell point satisfies a criterion, and performs processing to cause the target device to perform a specified output. 34. To the computer, an image processing function for detecting the occurrence of a specific event by processing an image; A movement path estimation function that identifies an object that is a person and / or a vehicle involved in the specific event and estimates an estimated movement path of the object; an importance specification function for specifying the importance of the specific event; a control function for controlling at least a part of a traffic system that controls the movement of people and / or vehicles on a road; Let them have The control function is When the importance level satisfies a criterion, the estimated movement path is used to control the at least part of the vehicle. A program for controlling another device different from the at least part of the devices when the importance does not satisfy a criterion. 35. In the program according to 34 above, The other device is an output device located on the estimated movement path. 36. In the program according to 34 above, The program, wherein the other device is an unmanned aerial vehicle.

[0081] This application claims priority based on Japanese Patent Application No. 2021-067690, filed on April 13, 2021, the disclosure of which is incorporated herein in its entirety. [Explanation of symbols]

[0082] 10 Control device 20 Terminal 1 22 Terminal 2 30 Imaging device 40 1st device 50 2nd device 60 Target 70 Central Equipment 110 Image processing section 120 Movement path estimation unit 130 Importance Identification Section 140 Control section 150 Location setting section 160 First Information Transmission Unit 170 Second Information Transmission Unit 180 Information storage section

Claims

1. an image processing means for processing an image to detect the occurrence of a specific event; A movement path estimation means for identifying an object that is a person and / or a vehicle involved in the specific event and estimating an estimated movement path of the object; control means for controlling traffic lights to guide the object along the estimated path of movement; Equipped with The specific event includes at least one of a traffic violation, the presence of a wanted vehicle and / or a suspect, a vehicle-to-vehicle collision, a vehicle-to-person or animal collision, and a vehicle making an unreasonable cut-off; Control device.

2. 2. The control device according to claim 1, The control means controls the traffic light when the importance of the specific event is equal to or higher than a standard, or when the estimated travel route includes an area that is predetermined based on the importance of safety and population density.

3. 3. The control device according to claim 2, The image processing means processes the image to generate information required to generate the importance level or the importance level.

4. The control device according to any one of claims 1 to 3, a point setting means for setting a stay point on the estimated movement path, the stay point being a position where the target should stay; A control device, wherein the control means controls the traffic light so that the object stays at the stay point.

5. 5. The control device according to claim 4, The control device is provided with a first information transmission means for generating recommended route information indicating a recommended travel route from a current location of a survey maker, who is a person who should survey the target, to the staying point, and transmitting the recommended route information to a terminal carried by the survey maker.

6. The control device according to claim 4 or 5, The control device is provided with a second information transmission means for identifying a target person who is a person located at a location within a predetermined distance from the staying point or a person located at a location closer to the staying point than the current location of a survey executor who is to survey the target, and for transmitting to a terminal carried by the target person at least one of information indicating the location of the staying point as a location to which the target person should move and information regarding the target.

7. The computer image processing for detecting an occurrence of a specific event by processing the image; A movement path estimation process for identifying an object that is a person and / or a vehicle involved in the specific event and estimating an estimated movement path of the object; a control process for controlling a traffic light to guide the object according to the estimated movement path; Do the following: The specific event includes at least one of a traffic violation, the presence of a wanted vehicle and / or a suspect, a vehicle-to-vehicle collision, a vehicle-to-person or animal collision, and a vehicle making an unreasonable cut-off; Control methods.

8. On the computer, an image processing function for detecting the occurrence of a specific event by processing an image; A movement path estimation function that identifies an object that is a person and / or a vehicle involved in the specific event and estimates an estimated movement path of the object; a control function for controlling a traffic light to guide the object according to the estimated movement path; Let them do so, The specific event includes at least one of a traffic violation, the presence of a wanted vehicle and / or a suspect, a vehicle-to-vehicle collision, a vehicle-to-person or animal collision, and a vehicle making an unreasonable cut-off; program.

Images