Server, monitoring method, and program

A server system addresses the limitations of simple telephone notifications by automatically generating and transmitting detailed information about highway events, enhancing communication efficiency and enabling effective traffic management.

JP7756584B2Active Publication Date: 2025-10-20MITSUBISHI HEAVY IND MACHINERY SYST LTD
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2022045233
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2022-03-22
Publication Date
2025-10-20
Estimated Expiration
2042-03-22

AI Technical Summary

Technical Problem

Conventional methods for communicating information about highway events, such as accidents, are limited in scope and range, primarily relying on simple telephone notifications that do not allow for detailed information transmission to multiple locations.

Method used

A server system that acquires text information from surveillance cameras, extracts relevant images, estimates event locations and attributes, predicts traffic impacts, generates detailed incident information, and transmits it to multiple bases automatically.

Benefits of technology

Enables simultaneous transmission of detailed information about highway events to multiple locations, reducing the time and labor required for manual reporting and providing actionable countermeasures to mitigate traffic impacts.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007756584000001
    Figure 0007756584000001
  • Figure 0007756584000002
    Figure 0007756584000002
  • Figure 0007756584000003
    Figure 0007756584000003
Patent Text Reader

Abstract

To provide a server capable of simultaneously transmitting detailed information on an event occurred on a highway to a plurality of bases related to the event.SOLUTION: A server includes: an acquisition unit configured to acquire text information related to an event that has occurred on a highway; an image extraction unit configured to extract an image related to the event; a place estimation unit configured to estimate an occurrence point of the event; an attribution estimation unit configured to estimate attribution of the event; an influence prediction unit configured to predict influence on a traffic state caused by the event based on the occurrence point and the estimation information of the attribution; an incident information generation unit configured to generate incident information including the text information, the image related to the event, the estimation information of the occurrence point and the attribution, and prediction results of the influence; and a transmission processing unit configured to transmit the incident information to a base related to the event.SELECTED DRAWING: Figure 3
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present disclosure relates to a server, a monitoring method, and a program. [Background technology]

[0002] As a means of notifying the occurrence of an accident or other incident on the road, for example, Patent Document 1 describes a technology in which, when an accident or other incident is detected, streetlights are turned on in a warning color to notify vehicles traveling nearby.

[0003] Additionally, currently, on expressways (including toll roads), when a supervisor in a traffic control room discovers an accident via a surveillance camera or the like, he or she notifies the management center at the location where the accident occurred (for example, the toll booth monitoring room) by telephone. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Publication No. 2020-87883 Summary of the Invention [Problem to be solved by the invention]

[0005] However, with conventional technology, only simple information about the accident is communicated by telephone, which limits the amount of information and the range of information that can be communicated.

[0006] The present disclosure has been made in consideration of such problems, and provides a server, a monitoring method, and a program that can simultaneously transmit detailed information about an event that occurs on a highway to multiple locations related to the event. [Means for solving the problem]

[0007] According to one aspect of the present disclosure, the server includes an acquisition unit that acquires text information regarding an event that has occurred on a highway; an image extraction unit that extracts images related to the event from images captured by surveillance cameras on the highway based on the text information; a location estimation unit that estimates a location where the event occurred based on the text information and images related to the event; an attribute estimation unit that estimates attributes of the event based on the text information and images related to the event; an impact prediction unit that predicts an impact on traffic conditions caused by the event based on the estimated information of the occurrence location and the attributes; an incident information generation unit that generates incident information including the text information, images related to the event, the estimated information of the occurrence location and the attributes, and the predicted results of the impact; and a transmission processing unit that transmits the incident information to a base related to the event.

[0008] According to one aspect of the present disclosure, a monitoring method includes the steps of: acquiring text information regarding an event that has occurred on a highway; extracting images related to the event from images captured by surveillance cameras on the highway based on the text information; estimating a location where the event occurred based on the text information and images related to the event; estimating attributes of the event based on the text information and images related to the event; predicting an impact on traffic conditions caused by the event based on the estimated information on the occurrence location and the attributes; generating incident information including the text information, images related to the event, the estimated information on the occurrence location and the attributes, and the predicted results of the impact; and transmitting the incident information to a base related to the event.

[0009] According to one aspect of the present disclosure, the program causes a server to perform the following steps: acquiring text information regarding an event that has occurred on a highway; extracting images related to the event from images captured by surveillance cameras on the highway based on the text information; estimating a location where the event occurred based on the text information and images related to the event; estimating attributes of the event based on the text information and images related to the event; predicting an impact on traffic conditions caused by the event based on estimated information on the occurrence location and the attributes; generating incident information including the text information, images related to the event, estimated information on the occurrence location and the attributes, and the predicted results of the impact; and transmitting the incident information to a base related to the event. [Effects of the Invention]

[0010] According to the server, monitoring method, and program disclosed herein, detailed information about an event that has occurred on a highway can be simultaneously transmitted to multiple locations related to the event. [Brief explanation of the drawings]

[0011] [Figure 1] 1 is a diagram illustrating an overall configuration of a monitoring system according to an embodiment of the present disclosure. [Figure 2] FIG. 2 is a diagram illustrating a functional configuration of a terminal device according to an embodiment of the present disclosure. [Figure 3] FIG. 2 is a diagram illustrating a functional configuration of a server according to an embodiment of the present disclosure. [Figure 4] 1 is a first flowchart illustrating an example of processing of a monitoring system according to an embodiment of the present disclosure. [Figure 5] FIG. 2 is a first diagram for explaining a function of a server according to an embodiment of the present disclosure. [Figure 6] FIG. 2 is a second diagram for explaining the function of the server according to an embodiment of the present disclosure. [Figure 7]FIG. 3 is a third diagram for explaining the function of a server according to an embodiment of the present disclosure. [Figure 8] FIG. 10 is a diagram illustrating an example of a simulation result according to an embodiment of the present disclosure. [Figure 9] FIG. 10 is a diagram illustrating an example of incident information according to an embodiment of the present disclosure. [Figure 10] 10 is a second flowchart illustrating an example of processing of the monitoring system according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0012] A monitoring system 1 according to an embodiment of the present disclosure will be described below with reference to FIGS.

[0013] (Overall composition) FIG. 1 is a diagram showing the overall configuration of a monitoring system according to an embodiment of the present disclosure. The monitoring system 1 according to this embodiment is a system for collecting information on events that occur on expressways (including toll roads) and transmitting the information to each base station. As shown in Fig. 1, the monitoring system 1 includes a terminal device 10 installed at each base station and a server 20.

[0014] The terminal device 10 is a computer operated by an operator stationed at each base, such as a traffic control room, a toll booth monitoring room, a road operator's office, or a maintenance base. The terminal device 10 transmits summary information about events, such as accidents and congestion, discovered by the operators at each base to the server 20. The terminal device 10 also presents detailed information about the events received from the server 20 to the operator.

[0015] The traffic control room is a facility where a monitor (operator) is stationed to monitor the entire expressway for accidents, congestion, etc., using images from surveillance cameras 31 that capture images at various points on the expressway (toll gates, main roads, ramps, etc.).

[0016] Toll booth monitoring rooms are installed in each section of the expressway and are facilities where staff (operators) are stationed to monitor each toll booth and respond to any problems that may arise, using footage from surveillance cameras 31 installed at toll booths within the area.

[0017] A road operator's office is a facility where road operator staff (operators) are stationed.

[0018] Maintenance bases are facilities established in each section of the expressway where maintenance personnel (operators) are stationed to carry out construction and maintenance of the expressway.

[0019] The server 20 is communicably connected to the terminal devices 10 at each base via an internal network for monitoring the expressway. The server 20 analyzes the events that have occurred on the expressway from the summary information received from the terminal devices 10, generates detailed information, and transmits it to the terminal devices 10 at each base related to the events.

[0020] The server 20 is also connected to an internal system 30 via an internal network and can refer to various databases (DBs) held by the internal system 30. The DBs held by the internal system 30 include, for example, a maintenance plan DB, a road structure information DB, a past information DB, and an image DB. The maintenance plan DB records plans for expressway maintenance (construction, inspection, cleaning, etc.). The road structure information DB records characteristic information about each section of the expressway. The characteristic information includes, for example, information such as the distance of each section, the number of lanes, the shape (slope, curves, etc.), and connecting roads (general roads, other expressways). The past information DB records performance information about events that have occurred on the expressway in the past. The image DB stores images captured by a surveillance camera 31.

[0021] Furthermore, the server 20 may be able to switch between connection to an internal network and connection to an external network (Internet) using a switch SW. In this case, the server 20 is connected to an external system 40 via the external network and can refer to various DBs held by the external system 40. The DBs held by the external system 40 include, for example, a weather information DB, an event information DB, and a traffic information DB. The weather information DB records the current weather and weather forecasts for each area. The event information DB records information about events held near expressways, such as the location of the event, the date and time (duration) of the event, and traffic regulations associated with the event. The traffic information DB records traffic information (information on accidents, congestion, regulations, etc.) for expressways and general roads collected by external systems other than the monitoring system 1.

[0022] (Functional configuration of terminal device) FIG. 2 is a diagram illustrating a functional configuration of a terminal device according to an embodiment of the present disclosure. As shown in FIG. 2, the terminal device 10 includes a processor 11, a memory 12, a storage 13, a communication interface 14, a display unit 15, and an operation reception unit 16.

[0023] The processor 11 operates in accordance with a predetermined program to function as a text information generating section 110 and a correction information generating section 111.

[0024] The text information generating unit 110 generates text information that outlines an event that has occurred on the expressway, based on the content input by the operator via the operation receiving unit 16. The text information includes, for example, the approximate date and time of the event (e.g., "around 9 o'clock"), the location of the event (e.g., "area A on Route 5"), and the details of the event (e.g., "a large truck rollover accident has occurred"). The text information generated by the text information generating unit 110 is transmitted to the server 20.

[0025] The correction information generation unit 111 generates correction information by adding or correcting the information received from the server 20, based on the content input by the operator via the operation reception unit 16. The correction information generated by the correction information generation unit 111 is transmitted to the server 20.

[0026] The memory 12 has a memory area necessary for the operation of the processor 11 .

[0027] The storage 13 is a so-called auxiliary storage device, such as a hard disk drive (HDD) or a solid state drive (SSD).

[0028] The communication interface 14 is an interface for transmitting and receiving various information (signals) to and from external devices (such as the server 20, the internal system 30, and the monitoring camera 31).

[0029] The display unit 15 is a display device (such as a liquid crystal display) for displaying images captured by the surveillance camera 31 and the like.

[0030] The operation reception unit 16 is an input device (keyboard, mouse, etc.) that receives operations from an operator. The display unit 15 and the operation reception unit 16 may be integrated into a touch panel.

[0031] (Server functional configuration) FIG. 3 is a diagram illustrating a functional configuration of a server according to an embodiment of the present disclosure. As shown in FIG. 3, the server 20 includes a processor 21, a memory 22, a storage 23, and a communication interface 24.

[0032] By operating in accordance with a predetermined program, the processor 11 performs the functions of an acquisition unit 210, an image extraction unit 211, a location estimation unit 212, an attribute estimation unit 213, an impact prediction unit 214, a proposal unit 215, an incident information generation unit 216, and a transmission processing unit 217.

[0033] The acquisition unit 210 acquires text information relating to an incident that has occurred on a highway from the terminal device 10. In this embodiment, the text information is input by the operator of the terminal device 10 who discovered the incident.

[0034] The image extraction unit 211 extracts images related to the event represented by the text information from among the images captured by the surveillance camera 31 (images stored in the image DB of the internal system 30). For example, the image extraction unit 211 extracts images that match keywords (occurrence date and time, occurrence location, occurrence content) included in the text information.

[0035] The location estimation unit 212 estimates the location where the event occurred based on the text information and the extracted image related to the event.

[0036] The attribute estimation unit 213 estimates the attributes of the event based on the text information and the extracted image related to the event. The attributes are information that indicates the type of the event, such as "accident," "traffic jam (due to external factors such as an accident)," or "natural traffic jam." The attributes may also indicate the scale of the event, such as "traffic jam of more than X km" or "traffic jam of less than X km."

[0037] The impact prediction unit 214 predicts the impact on traffic conditions caused by the event based on the estimated information on the occurrence location and attributes. For example, if the attribute is "natural congestion," the impact prediction unit 214 predicts the extent (distance, section) of the congestion. Also, for example, if the attribute is "accident," the impact prediction unit 214 predicts the extent (distance, section) of the congestion predicted to occur due to the accident, whether road closures will be necessary, and whether congestion will occur on other expressways and general roads connected to the expressway where the accident occurred.

[0038] The proposing unit 215 proposes countermeasures to reduce the impact caused by the event.

[0039] The incident information generation unit 216 generates incident information including text information, an image related to the event, estimated information on the occurrence location and attributes, and a predicted result of the impact. The incident information generation unit 216 may also generate incident information including a countermeasure proposed by the proposal unit 215.

[0040] The transmission processing unit 217 transmits the incident information to the terminal device 10 at a base related to the event. The base related to the event is a toll booth monitoring room located within a predetermined range from the point where the event occurred, a maintenance base responsible for maintaining the area including the point where the event occurred, a road operator's office for the expressway, a traffic control room, etc.

[0041] The memory 22 has a memory area necessary for the operation of the processor 21 .

[0042] The storage 23 is a so-called auxiliary storage device, such as a hard disk drive (HDD) or a solid state drive (SSD).

[0043] The communication interface 24 is an interface for transmitting and receiving various information (signals) to and from external devices (such as the terminal device 10, the internal system 30, and the external system 40).

[0044] The predetermined programs executed by the processor 11 of the terminal device 10 and the processor 21 of the server 20 are stored in a computer-readable recording medium. Computer-readable recording media include magnetic disks, optical magnetic disks, CD-ROMs, DVD-ROMs, and semiconductor memories. The computer programs may be distributed to computers via communications lines, and the computers that receive the programs may execute them. The programs may also be programs for implementing some of the functions described above. Furthermore, the programs may be so-called differential files (differential programs) that can implement the functions described above in combination with programs already stored in the computer system. The same applies to the processors of the servers and devices described below.

[0045] 1 shows an example in which the server 20 is configured by one computer, but this is not limiting. In other embodiments, the server 20 may be configured by multiple computers (for example, a web server, an AP server, a DB server, an analysis server, etc.).

[0046] (Monitoring system processing flow) FIG. 4 is a first flowchart illustrating an example of processing of the monitoring system according to an embodiment of the present disclosure. Hereinafter, with reference to FIG. 4, the flow of processing in which the monitoring system 1 generates incident information and distributes it to each terminal device 10 will be described.

[0047] Suppose that a monitor (operator) in a traffic control room discovers from the video of the surveillance camera 31 that an accident has occurred at a certain point on the expressway. The monitor then inputs information about the discovered event (accident) via the operation reception unit 16 of the terminal device 10. The text information generation unit 110 of the terminal device 10 generates text information in accordance with the monitor's input operation (step S100). The text information includes the approximate date and time of the incident, the location of the incident, and the details of the incident, such as, for example, "Around 9:00, a large truck rollover accident occurred in Area A on Route 5." The text information generation unit 110 also transmits the generated text information to the server 20. Note that the generation and transmission of the text information may be performed by a terminal device 10 at another base (a toll gate monitoring room, a road operator's office, or a maintenance base).

[0048] The acquisition unit 210 of the server 20 acquires text information from the terminal device 10 in the traffic control room (step S101).

[0049] Next, the image extraction unit 211 of the server 20 performs a process of extracting images relating to the accident reported in the text information (step S102).

[0050] FIG. 5 is a first diagram for explaining the function of the server according to an embodiment of the present disclosure. As shown in Fig. 5, in the process S102 of extracting an image, the image extraction unit 211 first executes a process of extracting keywords included in the text information (step S102A). For example, the image extraction unit 211 refers to a dictionary DB 30A for keyword extraction in the internal system 30 to extract keywords included in the text information. In the example of Fig. 5, "9 o'clock," "Route 5," "Area A," "Large truck," "rollover," etc. are extracted as keywords. Note that the dictionary DB 30A for keyword extraction may be included in the server 20, not in the internal system 30.

[0051] Next, the image extraction unit 211 performs a process of extracting images related to the accident based on the extracted keywords (step S102B). For example, the image extraction unit 211 uses a machine-learned image extraction model to extract images that match the extracted keywords from among the images of each surveillance camera 31 stored in the image DB 30B of the internal system 30.

[0052] The location estimation unit 212 of the server 20 then estimates the exact location of the accident based on the extracted image (step S103). At this time, the location estimation unit 212 acquires information (installation location, shooting direction, etc.) about the surveillance camera 31 that captured the extracted image from the surveillance camera information DB 30C of the internal system 30, and detects the position of the object (the "overturned large truck" in the example of FIG. 5) included in the extracted image to estimate its physical coordinates (latitude, longitude). The location estimation unit 212 also determines a specific location (address, latitude, longitude) on the expressway map data based on the estimated coordinates and map data about the vicinity of the camera installation location read from the map DB 30D of the internal system 30.

[0053] The attribute estimation unit 213 of the server 20 estimates the attributes of the event (accident) reported in the text information based on the image extracted by the image extraction unit 211 (step S104). For example, the attribute estimation unit 213 uses a machine-learned event attribute determination model to estimate the attributes of the event (information indicating the type such as "accident" or "traffic jam", information indicating the scale such as "large-scale traffic jam" or "crowding") from the features included in the extracted image. Furthermore, if the attribute estimation unit 213 can further detect detailed information such as a vehicle fire from the features of the extracted image, it may further add an attribute such as "suspected fire".

[0054] Next, the effect prediction unit 214 of the server 20 predicts the effect of traffic conditions caused by the event (accident) reported in the text information (step S105).

[0055] FIG. 6 is a second diagram for explaining the function of the server according to an embodiment of the present disclosure. 6, the impact prediction unit 214 inputs various types of information related to the accident read from each DB of the internal system 30 to the machine-learned impact prediction model. Based on the input information, the impact prediction model outputs prediction results of the impact details of the accident (for example, traffic congestion and road closures caused by the accident) and the scope of the impact (for example, the range to which the traffic congestion will spread).

[0056] For example, the impact prediction unit 214 reads map information and road characteristic information (such as the number of lanes, road shape, and connected roads) around the accident site from the map DB 30D and road structure information DB 30E, and inputs these into the impact prediction model. The impact prediction unit 214 also reads plan information, such as construction, inspection, and cleaning, planned around the accident site from the maintenance plan DB 30F, and inputs this information into the impact prediction model. Furthermore, the impact prediction unit 214 reads records of past events that are similar to the attributes of the current accident (such as "accident," "large truck rollover accident," and "suspected fire"), as well as records of events that occurred around the accident site, from the past information DB 30G, and inputs these records into the impact prediction model. This allows the impact prediction unit 214 to accurately predict the impact of an accident based on the road shape of the accident site, maintenance plans, and past cases.

[0057] The impact prediction unit 214 may further input information relating to the vicinity of the accident location read from each DB of the external system 40 into the impact prediction model. For example, the impact prediction unit 214 inputs current and future weather information read from the weather information DB 40A, event information (such as the location and date and time) read from the event information DB 40B, and traffic information (traffic information on other expressways and general roads connecting to the expressway where the accident occurred) read from the traffic information DB 40C into the impact prediction model. This allows the impact prediction unit 214 to accurately predict whether the impact caused by the accident will further change due to external factors such as weather, events, and traffic conditions on other roads.

[0058] Next, the proposing unit 215 creates a countermeasure plan for reducing the impact predicted by the impact predicting unit 214 (step S106).

[0059] FIG. 7 is a third diagram for explaining the function of the server according to an embodiment of the present disclosure. For example, as shown in FIG. 7, the proposal unit 215 creates one or more (N) countermeasure proposals based on the impact prediction results by the impact prediction unit 214, map information and road structure information around the accident site read from the map DB 30D and road structure information DB 30E, and information on past events similar to the current accident.

[0060] For example, when a traffic jam occurs or is predicted to occur, the proposing unit 215 proposes a method for controlling the flow of vehicles onto and off the expressway so as to alleviate the traffic jam, taking into account the predicted affected area. For example, if the proposing unit 215 predicts, using a known optimization algorithm or the like, that if X% of the vehicles traveling in the affected area of ​​the expressway take a detour route (a route that passes through another expressway), the time for the congestion to be resolved will be M minutes earlier, the proposing unit 215 will create a countermeasure proposal such as a Y% discount on the toll for this detour route. Furthermore, when similar past event information includes performance data of past countermeasures, the proposing unit 215 may create a countermeasure proposal based on these past countermeasures.

[0061] Furthermore, the proposing unit 215 may perform a simulation to predict to what extent the predicted impact will be reduced when the created countermeasure plan is implemented (step S107).

[0062] FIG. 8 is a diagram illustrating an example of a simulation result according to an embodiment of the present disclosure. As shown in FIG. 8, the proposing unit 215 has created a countermeasure plan 1 to reduce the traffic volume on the expressway where the accident occurred by discounting the toll for the detour route in order to eliminate the impact (traffic congestion) predicted due to the accident. The proposing unit 215 predicts how much the traffic congestion caused by the accident will be reduced after a predetermined time (e.g., 30 minutes, 60 minutes, or 90 minutes) if the countermeasure plan 1 is implemented. Furthermore, the proposing unit 215 may create a predicted map D1 in which the predicted results are superimposed on map information, as in the example of FIG. 8. The proposing unit 215 predicts the degree of reduction in impact for each of the created countermeasure plans 1 to N.

[0063] Next, the incident information generating unit 216 generates incident information to which detailed information of the event (accident) reported in the text information is added (step S108).

[0064] FIG. 9 is a diagram illustrating an example of incident information according to an embodiment of the present disclosure. As shown in Fig. 9, incident information D2 includes text information, estimated attributes and incident location, and predicted impacts. Incident information D2 may further include countermeasures and simulation results (predicted impact reduction levels). The simulation results may include a predicted diagram D1 shown in Fig. 8.

[0065] In addition, when the impact prediction unit 214 predicts the impact of an accident, if it uses past event information from the past information DB30G, maintenance plan information from the maintenance plan DB30F, weather information from the weather information DB40A, event information from the event information DB40B, traffic information from the traffic information DB40C, etc., the incident information generation unit 216 may add this information to the incident information D2 as reference information.

[0066] In addition, the incident information generation unit 216 adds information such as an identification flag to each piece of information included in the incident information D2 so that it is possible to distinguish between the text information entered by the person who discovered the accident (for example, a monitor in a traffic control room) and the information (estimated information, predicted information) automatically added by the server 20.

[0067] Next, the transmission processing unit 217 transmits the incident information D2 to each base station related to the accident (step S109). For example, the transmission processing unit 217 may be a toll gate monitoring room (e.g., toll gate monitoring room B) located within a predetermined range from the point where the accident occurred, a maintenance base responsible for maintaining the area including the point where the accident occurred, a road operator's office for the expressway, and a traffic control room. Each related base station may be registered in advance, or may be determined at the time of transmission based on pre-registered conditions. The transmission processing unit 217 transmits the incident information D2 to the terminal devices 10 at these base stations.

[0068] Furthermore, the terminal device 10 at each base receives incident information D2 from the server 20 (step S110). The received incident information is displayed on the display unit 15 and notified to an operator at each base. For example, the display unit 15 displays the incident information D2 in a table format as shown in FIG. 9. Furthermore, the display unit 15 may display text information entered by the person who discovered the accident differently from information added by the server 20, based on an identification flag attached to each piece of incident information. For example, in the example of FIG. 9, the display unit 15 underlines the information added by the server 20 so that it can be distinguished from text information entered by the person who discovered the accident.

[0069] FIG. 10 is a second flowchart illustrating an example of processing of the monitoring system according to an embodiment of the present disclosure. Furthermore, the incident information D2 generated by the server 20 may be confirmed and corrected by an operator at each base. Here, the flow of the process of correcting and retransmitting the incident information D2 will be described with reference to FIG.

[0070] For example, suppose an employee (operator) at a road operator's office checks the incident information D2 generated by the server 20 and adds or modifies the information. The employee inputs the information to be added or modified into the incident information D2 via the operation reception unit 16 of the terminal device 10. For example, suppose the server 20 predicted that the accident's impact range would only affect toll gate B (a toll gate monitored by toll gate monitoring room B). However, suppose the employee, referring to the incident information D2, determines that the accident may also affect toll gate C (a toll gate monitored by toll gate monitoring room C). In this case, the employee modifies the predicted impact result by adding "toll gate C" via the operation reception unit 16 of the terminal device 10. The employee may also further modify the impact prediction result by adding toll gate monitoring room C to the destination of the incident information D2. When the modification information generation unit 111 of the terminal device 10 receives the addition or modification operation from the employee (step S200), it generates modification information for the incident information D2 (step S201). Furthermore, the correction information generating unit 111 transmits the correction information to the server 20.

[0071] Next, the acquisition unit 210 of the server 20 acquires the correction information from the terminal device 10 of the road operator's office (step S202). Then, the incident information generation unit 216 of the server 20 corrects and updates the incident information D2 based on the acquired correction information (step S203).

[0072] In addition, the transmission processing unit 217 of the server 20 retransmits the updated incident information D2 to the previous destinations (terminal devices 10 at the toll gate monitoring room B, road operator office, maintenance base, and traffic control room) and the newly added destination (terminal device 10 at the toll gate monitoring room C) (step S204).

[0073] When the terminal device 10 at each base receives the updated incident information D2 from the server 20 (step S205), it displays this on the display unit 15 and notifies the operator.

[0074] Note that the operator of each base station may check the incident information D2 and, if he or she determines that the incident information D2 may be made public, may further perform an operation of transmitting a request for public disclosure to the server 20. When the transmission processing unit 217 of the server 20 receives a request for public disclosure from at least one terminal device 10, it transmits the incident information D2 to the external system 40. The external system 40 makes the incident information D2 public to users of the traffic road, for example, via a traffic information providing site or a traffic information providing application of a road operator.

[0075] (Action, effect) As described above, the server 20 of the monitoring system 1 according to this embodiment includes an acquisition unit 210 that acquires text information entered by the discoverer about an event that occurred on a highway; an image extraction unit 211 that extracts images related to the event from images taken by the monitoring cameras 31 on the highway based on the text information; a location estimation unit 212 that estimates the location where the event occurred based on the text information and the extracted images; an attribute estimation unit 213 that estimates the attributes (type, scale, etc.) of the event based on the text information and the extracted images; an impact prediction unit 214 that predicts the impact on traffic conditions caused by the event based on the estimated information on the location and attributes of the event; an incident information generation unit 216 that generates incident information D2 that includes the text information, images, the estimated information on the location and attributes of the event, and the predicted impact results; and a transmission processing unit 217 that transmits the incident information D2 to the terminal device 10 at the base related to the event.

[0076] In this way, the server 20 can automatically search for images from the surveillance cameras 31 that captured an incident (such as an accident or traffic jam) based on simple text information entered by the person who discovered the incident, and automatically generate incident information D2 including detailed information and transmit it to each base station simultaneously. This allows the server 20 to significantly reduce the time-consuming and labor-intensive work of the person who discovered the incident, such as checking the footage from each surveillance camera 31 and communicating the information to each base station by phone.

[0077] The server 20 further includes a proposal unit 215 that proposes countermeasures to reduce the impact caused by the event.

[0078] In this way, the server 20 can notify the operators at each base of the occurrence of an event and convey possible countermeasures to the event, allowing the operators to quickly take measures to reduce the impact of the event by referring to the countermeasures proposed by the server 20.

[0079] Furthermore, the proposing unit 215 further predicts the degree to which the impact will be reduced when the proposed countermeasures are implemented.

[0080] This allows the server 20 to inform the operator at each base of the extent to which the impact of the event (such as traffic congestion) can be reduced if the proposed countermeasure is implemented. This makes it easier for the operator to select and implement the countermeasure that can reduce the impact more effectively, for example, when there are multiple proposed countermeasures.

[0081] Furthermore, when correction information is received from at least one base, the incident information generation unit 216 corrects and updates the incident information D2.

[0082] In this way, the server 20 can provide accurate incident information that has been confirmed and corrected by the operators at each base.

[0083] As described above, several embodiments according to the present disclosure have been described, but all of these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope of the invention and its equivalents as defined in the claims, as well as in the scope and spirit of the invention.

[0084] <Additional Notes> The server, the monitoring method, and the program described in the above-described embodiment can be understood, for example, as follows.

[0085] (1) According to a first aspect of the present disclosure, a server (20) includes an acquisition unit (210) that acquires text information related to an event that has occurred on a highway, an image extraction unit (211) that extracts, based on the text information, images related to the event from among images captured by a surveillance camera (31) on the highway, a location estimation unit (212) that estimates a location where the event has occurred based on the text information and the image related to the event, an attribute estimation unit (213) that estimates attributes of the event based on the text information and the image related to the event, an impact prediction unit (214) that predicts an impact on traffic conditions caused by the event based on the estimated information on the occurrence location and attributes, an incident information generation unit (216) that generates incident information including the text information, images related to the event, the estimated information on the occurrence location and attributes, and the predicted impact, and a transmission processing unit (217) that transmits the incident information to a base related to the event.

[0086] In this way, the server can automatically search for images from the surveillance cameras that captured an incident (such as an accident or traffic jam) based on simple text information entered by the person who discovered the incident, and automatically generate incident information including detailed information and transmit it to each base station simultaneously. This allows the server to significantly reduce the time-consuming and labor-intensive work of the person who discovered the incident, such as checking the footage from each surveillance camera 31 and communicating the information to each base station by phone.

[0087] (2) According to a second aspect of the present disclosure, the server (20) according to the first aspect further includes a proposal unit (215) that proposes countermeasures to reduce the impact caused by the event, and the incident information generation unit (216) generates incident information that further includes the countermeasures.

[0088] In this way, the server can notify operators at each base of the occurrence of an event and convey possible countermeasures to the event, allowing the operators to quickly take measures to reduce the impact of the event by referring to the countermeasures proposed by the server.

[0089] (3) According to the third aspect of the present disclosure, in the server (20) according to the second aspect, the proposing unit (215) further predicts the degree of reduction in the impact when the proposed countermeasure is implemented.

[0090] This allows the server to inform operators at each base of the extent to which the impact of an event (such as traffic congestion) can be reduced if the proposed countermeasures are implemented. This makes it easier for operators to select and implement the countermeasure that will most likely reduce the impact, for example, when there are multiple proposed countermeasures.

[0091] (4) According to a fourth aspect of the present disclosure, in a server (20) relating to any one of the first to third aspects, an incident information generation unit (216) corrects and updates the incident information when correction information is received from a base.

[0092] In this way, the server can provide accurate incident information that has been confirmed and corrected by operators at each location.

[0093] (5) According to a fifth aspect of the present disclosure, a monitoring method includes the steps of: acquiring text information about an event that has occurred on a highway; extracting, based on the text information, images related to the event from among images captured by a surveillance camera on the highway; estimating a location where the event occurred based on the text information and the images related to the event; estimating attributes of the event based on the text information and the images related to the event; predicting an impact on traffic conditions caused by the event based on the estimated information on the occurrence location and attributes; generating incident information including the text information, images related to the event, the estimated information on the occurrence location and attributes, and the predicted impact; and transmitting the incident information to a base station related to the event.

[0094] (6) According to a sixth aspect of the present disclosure, the program causes a server to execute the following steps: acquiring text information about an event that occurred on a highway; extracting images related to the event from images captured by surveillance cameras on the highway based on the text information; estimating a location where the event occurred based on the text information and the images related to the event; estimating attributes of the event based on the text information and the images related to the event; predicting an impact on traffic conditions caused by the event based on the estimated information on the occurrence location and attributes; generating incident information including the text information, images related to the event, the estimated information on the occurrence location and attributes, and the predicted impact; and transmitting the incident information to a location related to the event. [Explanation of symbols]

[0095] 1. Surveillance System 10 Terminal Equipment 11 processors 110 Text information generation unit 111 Correction information generation section 12 Memory 13. Storage 14 Communication Interface 15 Display section 16 Operation reception section 20 servers 21 processors 210 Acquisition Department 211 Image Extraction Unit 212 Location Estimation Department 213 Attribute estimation section 214 Impact Prediction Department 215 Proposal Department 216 Incident Information Generation Unit 217 Transmission processing unit 22 Memory 23 Storage 24 Communication Interface 30 Internal Systems 31 Surveillance Camera 40 External Systems

Claims

1. An acquisition unit that acquires text information regarding an event that occurred on a highway; an image extraction unit that extracts images related to the event from images captured by surveillance cameras on the expressway based on the text information; a location estimation unit that estimates a location where the event occurred based on the text information and an image related to the event; an attribute estimation unit that estimates an attribute of the event based on the text information and an image related to the event; an impact prediction unit that predicts an impact on a traffic state caused by the event based on the estimated information on the occurrence point and the attribute; an incident information generation unit that generates incident information including the text information, an image related to the event, estimated information on the occurrence point and the attributes, and a predicted result of the impact; a transmission processing unit that transmits the incident information to a base related to the event; Equipped with the incident information generation unit corrects and updates the incident information when correction information is received from the base; server.

2. a proposal unit that proposes a countermeasure plan to reduce an impact caused by the event; the incident information generation unit generates the incident information further including the countermeasure plan. The server of claim 1 .

3. The proposing unit further predicts a degree of reduction in the impact when the countermeasure proposal is implemented. The server of claim 2.

4. A step in which a server acquires text information regarding an event that has occurred on a highway; The server extracts images related to the event from images captured by surveillance cameras on the expressway based on the text information; the server estimating a location of the event based on the text information and an image associated with the event; the server estimating attributes of the event based on the text information and an image associated with the event; a step in which the server predicts an impact on a traffic state caused by the event based on the estimated information of the occurrence point and the attribute; generating, by the server, incident information including the text information, an image related to the event, estimated information of the occurrence point and the attribute, and a predicted result of the impact; the server transmitting the incident information to a location related to the event; and the step of generating the incident information includes, when correction information is received from the base, correcting and updating the incident information. Monitoring method.

5. obtaining text information about an incident occurring on a highway; extracting images related to the event from images captured by surveillance cameras on the expressway based on the text information; estimating a location of the event based on the text information and an image associated with the event; estimating attributes of the event based on the text information and an image associated with the event; predicting an impact on a traffic state caused by the event based on the estimated information of the occurrence point and the attribute; generating incident information including the text information, an image related to the event, estimated information of the occurrence point and the attribute, and a predicted result of the impact; transmitting the incident information to a location associated with the event; A program that causes a server to execute the step of generating the incident information includes, when correction information is received from the base, correcting and updating the incident information. program.

Citation Information

Patent Citations

  • Traffic flow monitoring system

    JP2000163685A

  • Itv image processing system

    JP2002208085A

  • Traffic control apparatus

    JP2005267269A

  • Toll collection system and toll collection method

    JP2009064052A

  • Street light system

    JP2020087883A