Road monitoring system, road monitoring device, road monitoring method and program

Abstract

To provide a road monitoring system which improves efficiency of road monitoring, a road monitoring device, a road monitoring method and a program.SOLUTION: A road monitoring system 100 comprises a detection section 122 and a processing section 134. The detection section 122 processes an image, which is obtained by shooting a road, thereby detecting a road state which is a state of an object on the road. The processing section 134 performs any processing of notification processing for performing a notification of the road state satisfying a first reference in accordance with notification setting relating to the notification based on whether or not a second reference is satisfied in a case where the road state satisfies the first reference and change-related processing relating to a change of the notification setting. The second reference is a reference relating to a discrimination result of whether or not the road state satisfies the first reference.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a road monitoring system, a road monitoring device, a road monitoring method, and a program.

Background Art

[0002] Various technologies have been proposed for discriminating events occurring on a road and notifying a user.

[0003] For example, in the road abnormality determination system described in Patent Document 1, a probe car device provided in a probe car detects road state information Irc, and the road state information Irc is transmitted from the probe car to a data analysis server provided in a vehicle operation center.

[0004] The data analysis server described in Patent Document 1 analyzes the road state information Irc, determines whether an abnormality has occurred on the road, and when it is determined that an abnormality has occurred on the road, displays the determination result and the road state information Irc on an operator terminal. The operator views the road state information Irc displayed on the operator terminal, determines whether the road is abnormal, and further determines whether passage is impossible when it is determined that the road is abnormal. Patent Document 1 describes that examples of the types of road abnormalities include natural traffic jams, presence of fallen objects, lane restrictions due to traffic accidents, lane restrictions due to road construction, and the like.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] However, generally speaking, events such as the road anomalies described in Patent Document 1 can persist for a certain period of time. Therefore, in the technology described in Patent Document 1, there is a risk that the data analysis server may repeatedly determine that the same event on the road is an anomaly, and that determination result may continue to be displayed on the operator terminal.

[0007] In such cases, even if the data analysis server's judgment is correct, the operator may end up repeatedly checking known road anomalies based on the display, potentially reducing the efficiency of road monitoring.

[0008] One example of the object of the present invention is to provide a road monitoring system, road monitoring device, road monitoring method, and program that solve the above-mentioned problems and improve the efficiency of road monitoring. [Means for solving the problem]

[0009] According to one aspect of the present invention, A detection means that detects the road condition, which is the state of objects on the road, by processing images of the road, The system includes processing means that, when the road conditions satisfy the first criterion, performs either a notification process that sends a notification in accordance with the notification settings for notifications of road conditions satisfying the first criterion, based on whether or not the second criterion is satisfied, or a change-related process for changing the notification settings for the notification, The second criterion is a criterion relating to the determination result of whether or not the road condition satisfies the first criterion. A road monitoring system will be provided.

[0010] According to one aspect of the present invention, A road condition acquisition means that acquires condition information including road conditions, which are the state of objects on the road, The system includes processing means that, when the road conditions satisfy the first criterion, performs either a notification process that sends a notification in accordance with the notification settings for notifications of road conditions satisfying the first criterion, based on whether or not the second criterion is satisfied, or a change-related process for changing the notification settings for the notification, The second criterion is a criterion relating to the determination result of whether or not the road condition satisfies the first criterion. Road monitoring equipment will be provided.

[0011] According to one aspect of the present invention, One or more computers, We obtain state information including the road condition, which is the state of objects on the road. If the road condition satisfies the first criterion, then, based on whether or not the second criterion is met, either a notification process is performed to send a notification in accordance with the notification settings for notifications regarding road conditions that satisfy the first criterion, or a change-related process is performed to change the notification settings for the notification. The second criterion is a criterion relating to the determination result of whether or not the road condition satisfies the first criterion. Road monitoring methods are provided.

[0012] According to one aspect of the present invention, On one or more computers, We obtain state information including the road condition, which is the state of objects on the road. When the road conditions meet the first criterion, the system is designed to perform either a notification process, which sends a notification according to the notification settings for notifications regarding road conditions that meet the first criterion, or a change-related process, which involves changing the notification settings for the notification. A program is provided in which the second criterion is a criterion for determining whether the road condition satisfies the first criterion. [Effects of the Invention]

[0013] According to one aspect of the present invention, it becomes possible to improve the efficiency of road monitoring. [Brief explanation of the drawing]

[0014] [Figure 1] It is a diagram showing an overview of the road monitoring system according to Embodiment 1. [Figure 2] It is a diagram showing an overview of the road monitoring device according to Embodiment 1. [Figure 3] It is a flowchart showing an overview of the road monitoring method according to Embodiment 1. [Figure 4] It is a diagram showing a configuration example of the road monitoring system according to Embodiment 1. [Figure 5] It is a diagram showing a configuration example of the image information according to Embodiment 1. [Figure 6] It is a diagram showing a functional configuration example of the image processing device according to Embodiment 1. [Figure 7] It is a diagram showing a configuration example of the state information according to Embodiment 1. [Figure 8] It is a diagram showing a functional configuration example of the road monitoring device according to Embodiment 1. [Figure 9] It is a diagram showing a functional configuration example of the processing unit according to Embodiment 1. [Figure 10] It is a diagram showing an example of the notification setting according to Embodiment 1. [Figure 11] It is a diagram showing a physical configuration example of the imaging device according to Embodiment 1. [Figure 12] It is a diagram showing a physical configuration example of the image processing device according to Embodiment 1. [Figure 13] It is a flowchart showing an example of the imaging process according to Embodiment 1. [Figure 14] It is a diagram showing an example of the road R to be imaged. [Figure 15] It is a diagram showing an example of the image information IMD including the image IM1 of the road R illustrated in FIG. 14. [Figure 16] It is a flowchart showing an example of the image processing according to Embodiment 1. [Figure 17] It is a diagram showing an example of the state information STD generated in step S123. [Figure 18]This flowchart shows an example of the monitoring process according to Embodiment 1. [Figure 19] This figure shows an example of a notification screen according to Embodiment 1. [Figure 20] This figure shows an example of the first confirmation screen according to Embodiment 1. [Figure 21] This figure shows an example of the functional configuration of the processing unit according to Embodiment 2. [Figure 22] This figure shows an example of the notification change rules related to Embodiment 2. [Figure 23] This flowchart shows an example of the monitoring process according to Embodiment 2. [Figure 24] This figure shows an example of the modified notification settings according to Embodiment 2. [Figure 25] This figure shows an example of the functional configuration of the processing unit according to Embodiment 3. [Figure 26] This flowchart shows an example of the monitoring process according to Embodiment 3. [Figure 27] This figure shows an example of the second confirmation screen according to Embodiment 3. [Figure 28] This figure shows an example configuration of a road monitoring system according to Embodiment 4. [Figure 29] This figure shows an example of the functional configuration of the processing unit according to Embodiment 5. [Figure 30] This figure shows an example of notification settings according to Embodiment 5. [Figure 31] This flowchart shows an example of the notification setting process according to Embodiment 5. [Figure 32] This flowchart shows an example of the monitoring process according to Embodiment 5. [Modes for carrying out the invention]

[0015] Embodiments of the present invention will be described below with reference to the drawings. In all drawings, similar components are denoted by the same reference numerals, and their descriptions are omitted where appropriate.

[0016] <Embodiment 1> (overview) Figure 1 is a diagram showing an overview of the road monitoring system 100 according to Embodiment 1. The road monitoring system comprises a detection unit 122 and a processing unit 134.

[0017] The detection unit 122 detects the road condition, which is the state of objects on the road, by processing images of the road. The processing unit 134, when the road condition meets the first criterion, performs either a notification process, which sends a notification according to the notification settings for notifications of road conditions that meet the first criterion, or a change-related process, which changes the notification settings, based on whether the second criterion related to the determination result of whether the road condition meets the first criterion is met.

[0018] This road monitoring system 100 makes it possible to improve the efficiency of road monitoring.

[0019] Figure 2 is a diagram showing an overview of the road monitoring device 103 according to Embodiment 1. The road monitoring device 103 is an example of a device that constitutes the road monitoring system 100. The road monitoring device 103 comprises a road condition acquisition unit 131 and the processing unit 134 described above.

[0020] The road condition acquisition unit 131 acquires condition information, including the road condition, which is the condition of objects on the road. As described above, when the road condition satisfies the first criterion, the processing unit 134 performs either a notification process, which sends a notification according to the notification settings for notifications of road conditions that satisfy the first criterion, or a change-related process, which changes the notification settings, based on whether the second criterion related to the determination result of whether the road condition satisfies the first criterion is met.

[0021] This road monitoring device 103 makes it possible to improve the efficiency of road monitoring.

[0022] Figure 3 is a flowchart showing an overview of the road monitoring method according to Embodiment 1.

[0023] The road condition acquisition unit 131 acquires condition information, including the road condition, which is the condition of objects on the road (step S131).

[0024] If the road condition meets the first criterion, the processing unit 134 performs either a notification process to send a notification according to the notification settings for notification of road conditions that meet the first criterion, or a change-related process for changing the notification settings, based on whether the second criterion regarding the determination result of whether the road condition meets the first criterion is met (step SA).

[0025] This road monitoring method makes it possible to improve the efficiency of road monitoring.

[0026] The following describes a detailed example of the road monitoring system 100 according to Embodiment 1.

[0027] (detail) Figure 4 shows an example configuration of the road monitoring system 100 according to Embodiment 1. The road monitoring system 100 is a system that detects objects on the road by processing images of the road and supports the user in monitoring the road based on the detection results.

[0028] As shown in Figure 4, the road monitoring system 100 comprises a camera 101, an image processing device 102, and a road monitoring device 103.

[0029] The imaging device 101, the image processing device 102, and the road monitoring device 103 are connected to each other via a network N, which is configured, for example, by wire, wireless, or a combination thereof, and can send and receive information from each other via the network N.

[0030] (Example of functional configuration of imaging device 101) The imaging device 101 photographs a predetermined location on the road and generates an image. The imaging device 101 generates image information including the generated image and transmits it to the image processing device 102.

[0031] The imaging device 101 takes images at a predetermined frequency (frame rate), for example. In this case, the image is, for example, a frame image taken at the predetermined frame rate. The image may be in color or monochrome, and the number of pixels may be selected as appropriate.

[0032] Figure 5 shows an example of the configuration of image information according to Embodiment 1. The image information is information in which image-related information is associated with an image generated by the imaging device 101. The image-related information includes, for example, image identification information, imaging device identification information, shooting date, and shooting location.

[0033] Image identification information is information used to identify image information. This information will also be referred to as "Image ID (Identification)" below.

[0034] The imaging device identification information is information used to identify the imaging device 101. The imaging device identification information will also be referred to as the "imaging ID" below.

[0035] The shooting date is information indicating when the photograph was taken. For example, the shooting date consists of the year, month, day, and time. The time may be expressed in predetermined increments such as 1 / 10th of a second or 1 / 100th of a second.

[0036] The shooting location is information indicating the place where the image was taken. For example, the shooting location is information indicating the location where the shooting device 101 is installed, and consists of the latitude and longitude of that location. The shooting location may be acquired using the position detection function if the shooting device 101 is equipped with a position detection function, or it may be set in advance by the installer or the like. The position detection function is a function that detects the position of the shooting device 101 using GPS (Global Positioning System) or the like.

[0037] The shooting location is not limited to the installation location of the shooting device 101; for example, it may be information indicating the range that the shooting device 101 captures, in which case it may consist of the latitude and longitude of the location. Furthermore, the image information only needs to include images of the road, and does not need to include one or more other pieces of information.

[0038] (Example of functional configuration of the image processing device 102) Figure 6 shows an example of the functional configuration of the image processing device 102 according to Embodiment 1. The image processing device 102 is a device that detects road conditions by processing images of roads that have been photographed. The image processing device 102 includes an image acquisition unit 121, a detection unit 122, and a road condition transmission unit 123.

[0039] The image acquisition unit 121 acquires image information from the shooting device 101. As a result, the image acquisition unit 121 acquires at least the image generated by the shooting device 101, that is, the image of the road.

[0040] The detection unit 122 detects road conditions by processing images acquired by the image acquisition unit 121. The detection unit 122 generates condition information including the detected road conditions.

[0041] Road conditions refer to the state of objects on the road.

[0042] Objects on the road include, for example, one or more vehicles, fallen objects, etc. Vehicles include, for example, one or more passenger cars, trucks, trailers, construction vehicles, emergency vehicles, motorcycles, bicycles, etc. Fallen objects include things that have fallen onto the road from vehicles, etc., and things that have been blown onto the road by wind, etc.

[0043] The road condition includes the presence or absence of objects on the road. If there are objects on the road, the road condition includes object identification information and object condition for each object. The presence or absence of objects on the road may be represented by a flag indicating their presence or absence, the number of objects on the road, or by whether or not the object identification information is included in the road condition.

[0044] Object identification information is information used to identify objects on a road. This information will also be referred to as "object ID" below.

[0045] The object state is the state of each object. The items included in the object state may differ in some or all ways depending on the type of object.

[0046] For example, the physical state of a vehicle (vehicle state) may be one or more of the following: the vehicle's position, direction of travel, speed, movement path (trajectory), and attributes of the vehicle. The attributes of a vehicle may be one or more of the following: the type of vehicle, size, color, and license plate number. The type of vehicle may be one or more of the following: a passenger car, truck, trailer, construction vehicle, emergency vehicle, motorcycle, or bicycle.

[0047] For example, the object state of a falling object (falling object state) may be one or more of the following: the position of the falling object, the direction of movement, the speed of movement, the path of movement, and the attributes of the falling object. The attributes of a falling object may be one or more of the following: the type of falling object, the size of the falling object, and the color of the falling object. The type of falling object may be one or more of the following: wood, packaged goods, etc.

[0048] Figure 7 shows an example of the configuration of state information according to Embodiment 1. State information is information in which state-related information is associated with a road condition. State-related information includes an image used to detect the associated road condition and image-related information associated with the image in the image information.

[0049] The status information only needs to include the detected road conditions, and does not need to include one or more other pieces of information.

[0050] The road condition transmission unit 123 transmits the generated condition information to the image processing device 102.

[0051] (Example of functional configuration of road monitoring device 103) Figure 8 shows an example of the functional configuration of the road monitoring device 103 according to Embodiment 1. The road monitoring device 103 is a device that supports the user in monitoring roads based on road conditions. The road monitoring device 103 is installed, for example, in a monitoring center that monitors roads.

[0052] As shown in Figure 8, the road monitoring device 103 includes a road condition acquisition unit 131, a first discrimination unit 132, a second discrimination unit 133, a processing unit 134, and a display unit 135.

[0053] The road condition acquisition unit 131 acquires condition information from the image processing device 102.

[0054] The first discrimination unit 132 determines whether the road condition included in the status information meets the first criterion.

[0055] The first criterion is a criterion defined in relation to road conditions. The first discrimination unit 132 detects predetermined events on the road by determining whether or not the first criterion is met. In other words, the event is a road condition that satisfies the first criterion.

[0056] The types of events include, for example, one or more of the following: (1) traffic congestion, (2) driving in the wrong direction, (3) driving slowly, (4) stopping, (5) falling objects, and (6) erratic driving. The events exemplified here are examples of abnormal events on typical roads, but are not limited to these.

[0057] Examples of the first criterion for each type of event are given below. The first criterion is not limited to the examples below and may be modified as appropriate.

[0058] (1) The first criterion for congestion is, for example, a line of vehicles consisting of vehicles traveling at a slow speed or vehicles that repeatedly stop and start, which is longer than a predetermined distance and continues for a predetermined duration. Here, slow speed means traveling at or below a predetermined speed.

[0059] (2) The first criterion for a vehicle driving in the wrong direction consists of, for example, (2-A) and (2-B) below: (2-A) that the direction of travel is predetermined for the road in question or for each lane that makes up the road. (2-B) that the direction of travel of the vehicle and the direction of travel of the road or lane on which the vehicle is traveling differ by more than a predetermined angle (for example, 90 degrees).

[0060] For example, if both (2-A) and (2-B) are satisfied, the first discrimination unit 132 determines that the first criterion is met (i.e., the vehicle is driving in the wrong direction). If at least one of (2-A) and (2-B) is not satisfied, the first discrimination unit 132 determines that the first criterion is not met.

[0061] (3) The first criterion for low-speed driving of a vehicle is, for example, that the vehicle is traveling at or below a predetermined speed for a predetermined duration or longer. The predetermined speed here may be the same as, or different from, the predetermined speed defined for low-speed driving in traffic congestion (1).

[0062] (4) The first criterion for stopping a vehicle is, for example, that the vehicle is stopped for a specified period of time or longer (the vehicle's position is within a specified range).

[0063] (5) The first criterion for falling objects is, for example, (5-A) the presence of objects other than vehicles on the road. Another example is (5) the first criterion for falling objects is (5-B) the temporary lane changes of more than a specified number of vehicles to a common area.

[0064] A temporary lane change refers to changing lanes and then returning to the original lane within a predetermined distance or time. Generally, vehicles will move to avoid fallen objects, so it is presumed that fallen objects are located in an area that multiple vehicles will commonly avoid. Therefore, fallen objects can be detected using (5-B).

[0065] The first criterion for detecting falling objects may be either (5-A) or (5-B), or both (5-A) and (5-B) may be used. When both are used, for example, if both or either (5-A) and (5-B) are satisfied, the first discrimination unit 132 determines that the first criterion is satisfied (i.e., a falling object has occurred). If neither (5-A) nor (5-B) is satisfied, the first discrimination unit 132 determines that the first criterion is not satisfied (i.e., no falling object has occurred).

[0066] (6) The first criterion for erratic driving is, for example, a vehicle making temporary lane changes more than a specified number of times. A temporary lane change, as described above, means changing lanes and then returning to the original lane within a specified distance or time.

[0067] Refer to Figure 8. The second discrimination unit 133 determines whether the determination result of the first discrimination unit 132, that is, the determination result of whether the road condition meets the first criterion, meets the second criterion.

[0068] The second criterion is a criterion defined in relation to the determination result of the first determination unit 132 (i.e., the determination result of whether or not the road condition satisfies the first criterion) in order to suppress notification regarding events. The second criterion is a criterion defined in relation to the number or frequency of times the road condition is determined to satisfy the first criterion, for example.

[0069] More specifically, the second criterion is that the road condition is determined to meet the first criterion at a frequency greater than a predetermined value (i.e., a number of times greater than a predetermined value within a predetermined time) or a number of times greater than a predetermined value. In other words, the second criterion is that the event is detected repeatedly at a frequency greater than a predetermined value or a number of times greater than a predetermined value.

[0070] For example, if the first criterion is defined for each type of event, as in this embodiment, the frequency or number of occurrences included in the second criterion may be counted for each type of event defined by the first criterion. In other words, the second criterion is that the same type of event is detected repeatedly at a frequency or number of occurrences equal to or greater than a predetermined value.

[0071] For example, the frequency or number of occurrences included in the second criterion may be counted for each specific event that satisfies the first criterion.

[0072] The specific events may be identified in different ways depending on the type of event. (1) In the case of traffic congestion, the specific event may be identified by the area and time period in which the congestion occurs. (2) In the case of driving in the wrong direction, (3) driving slowly, (4) stopping, and (6) driving erratically, the specific event may be identified by the object ID of the vehicle in question. (5) In the case of fallen objects, the specific event may be identified by at least one of the object ID of the fallen object, the area the vehicle avoids, and the time period.

[0073] Furthermore, if the swerving is carried out by a group (multiple vehicles), the specific event may be identified, for example, by the area and time period in which the swerving occurs. The time period may include only the start time or include the end time. The start time is the time when the specific event was first detected. The end time may be automatically set by the image processing device 102 or the road monitoring device 103 based on the history, or it may be set by the user.

[0074] Refer to Figure 8. The processing unit 134 performs processing based on the determination results of the first determination unit 132 and the second determination unit 133. For example, if the road condition satisfies the first criterion, the processing unit 134 performs either notification processing or change-related processing based on whether the second criterion is met.

[0075] Notification processing is the process of notifying users of events (i.e., road conditions that meet the first criterion). For example, notification processing is the process of notifying the user of an event. Notification processing is performed according to the notification settings. Notification settings are settings related to event notifications. Notification settings will be described in detail later.

[0076] Change-related processing refers to processing related to changes in notification settings. Change-related processing includes, for example, a first confirmation process to ask the user to confirm changes to notification settings, and a change process to modify the notification settings.

[0077] Figure 9 shows an example of the functional configuration of the processing unit 134 according to Embodiment 1. The processing unit 134 includes a notification unit 141 and a setting unit 142.

[0078] The notification unit 141 stores notification settings in advance and performs notification processing according to those notification settings. For example, the notification unit 141 performs notification processing when the first criterion is met and the second criterion is not met. However, the notification unit 141 may also perform notification processing when the first criterion is met, regardless of whether the second criterion is met or not.

[0079] Figure 10 shows an example of notification settings according to Embodiment 1. Note that the notification settings are not limited to those exemplified in Figure 10, and may be modified as appropriate, such as by deleting or adding items.

[0080] Notification settings may include, for example, settings regarding whether or not to send notifications for events. Notification settings may be set for specific events, for types of events, or for specific objects. Notification settings may also include conditions for deactivating the settings. Deactivation conditions may include a geographical range, a time period including at least one of the start and end dates.

[0081] The notification settings illustrated in Figure 10 include a setting to "not send" notifications for the event "driving against traffic," which is a road condition that meets the first criterion, for a vehicle with object ID "object 5." This notification setting is an example of a setting for a specific event.

[0082] The notification settings illustrated in Figure 10 include the condition "until 5:00 AM on August 22, 2022" for deactivation. In other words, the notification setting "Do not notify" for "driving in the wrong direction" for a vehicle with object ID "Object 5" will be applied to notification processing until 5:00 AM on August 22, 2022, and will not be applied to notification processing after 5:00 AM on August 22, 2022.

[0083] When setting the type of event, for example, in the notification settings exemplified in Figure 10, it is sufficient that the object ID is not set. Such notification settings should be applied to the set type of event, regardless of the object associated with that event. Specifically, when setting for "traffic congestion," an example of a notification setting can be given where the object ID is not included, but "traffic congestion" is included as the type of event. In this case, in order to identify the traffic congestion, the notification setting may also include the area and time period.

[0084] For example, when setting up notifications for a specific object, it is sufficient that the event type is not specified in the notification settings exemplified in Figure 10. Such notification settings should be applied to all types of events related to the object identified by its object ID. Specifically, when setting up notifications for a falling object, an example of a notification setting that includes the object ID of the falling object but does not include the event type can be given.

[0085] Refer to Figure 9. The setting unit 142 performs change-related processing. For example, the setting unit 142 performs change-related processing when the first criterion is met and the second criterion is met.

[0086] As shown in Figure 9, the setting unit 142 includes a first confirmation unit 151, an instruction reception unit 152, and a modification unit 153.

[0087] The first confirmation unit 151 performs a first confirmation process. For example, as the first confirmation process, the first confirmation unit 151 displays a first confirmation screen on the display unit 135. The first confirmation screen is a screen for the user to confirm changes to the notification settings.

[0088] The instruction receiving unit 152 receives user instructions (i.e., user instructions). For example, the instruction receiving unit 152 receives user instructions as a response to a confirmation process (for example, a first confirmation screen displayed on the display unit 135).

[0089] User instructions may include, for example, instructions to change notification settings. Instructions to change notification settings may include the content of the changed notification settings. User instructions may also include instructions not to change notification settings.

[0090] The modification unit 153 performs modification processing. Modification processing is the process of changing notification settings according to user instructions for the confirmation process.

[0091] In detail, when the instruction receiving unit 152 receives an instruction to change the notification settings for confirmation processing, the modification unit 153 changes the notification settings according to the user instruction. As mentioned above, the user instruction in this case includes the content of the changed notification settings, so the modification unit 153 should store the content of the notification settings included in the user instruction in the notification unit 141.

[0092] When the instruction receiving unit 152 receives an instruction from the user to not change the notification settings for confirmation processing, the modification unit 153 does not change the notification settings in accordance with the user instruction. As a result, the notification unit 141 retains the notification settings it holds.

[0093] Refer to Figure 8. The display unit 135 displays various information. This allows the user to view various types of information.

[0094] Up to this point, we have mainly described an example of the functional configuration of the road monitoring system 100 according to Embodiment 1. From here, we will describe an example of the physical configuration of the road monitoring system 100 according to Embodiment 1.

[0095] (Example of physical configuration of road monitoring system 100) The road monitoring system 100 physically comprises, for example, a camera 101, an image processing device 102, and a road monitoring device 103.

[0096] Physically, the image processing device 102 may include the imaging device 101, and the road monitoring device 103 may include either the imaging device 101 or the image processing device 102, or both. If the function of transmitting or receiving information between each device 101 to 103 via the network N is incorporated into a physically common device, it is preferable to transmit or receive the information via an internal bus or the like instead of the network N.

[0097] (Example of the physical configuration of the imaging device 101) Figure 11 shows an example of the physical configuration of the imaging device 101 according to Embodiment 1. The imaging device 101 physically includes, for example, a bus 1010, a processor 1020, a memory 1030, a storage device 1040, a network interface 1050, a user interface 1060, and a camera 1070.

[0098] Bus 1010 is a data transmission path for the processor 1020, memory 1030, storage device 1040, network interface 1050, user interface 1060, and camera 1070 to send and receive data to and from each other. However, the method of connecting the processor 1020 and the other components to each other is not limited to bus connection.

[0099] The 1020 processor is a processor implemented in components such as the CPU (Central Processing Unit) and GPU (Graphics Processing Unit).

[0100] Memory 1030 is a main memory device implemented using RAM (Random Access Memory), etc.

[0101] The storage device 1040 is an auxiliary storage device implemented as an HDD (Hard Disk Drive), SSD (Solid State Drive), memory card, or ROM (Read Only Memory). The storage device 1040 stores program modules for realizing each function of the imaging device 101. The processor 1020 reads these program modules into memory 1030 and executes them, thereby realizing each function corresponding to that program module.

[0102] The network interface 1050 is an interface for connecting the imaging device 101 to the network N.

[0103] The user interface 1060 includes touch panels, keyboards, mice, etc., as interfaces for the user to input information, and liquid crystal panels, organic EL (Electro-Luminescence) panels, etc., as interfaces for presenting information to the user.

[0104] Camera 1070 photographs subjects such as roads and generates images of those subjects. The shooting device 101 is fixed, for example, on the side of the road or above the road so that camera 1070 can photograph a predetermined location on the road.

[0105] The imaging device 101 may also accept input from the user and present information to the user via an external device connected to the network N (for example, an image processing device 102, a road monitoring device 103, etc.). In this case, the imaging device 101 does not need to have a user interface 1060.

[0106] (Example of physical configuration of image processing device 102 and road monitoring device 103) Figure 12 shows an example of the physical configuration of the image processing device 102 according to Embodiment 1. The image processing device 102 physically has, for example, a bus 1010, a processor 1020, a memory 1030, a storage device 1040, and a network interface 1050, similar to those of the imaging device 101. The image processing device 102 also physically has, for example, an input interface 2060 and an output interface 2070.

[0107] However, the storage device 1040 of the image processing device 102 stores program modules for realizing each function of the image processing device 102. Furthermore, the network interface 1050 of the image processing device 102 is an interface for connecting the image processing device 102 to network N.

[0108] The input interface 2060 is an interface for the user to input information, and includes, for example, a touch panel, keyboard, mouse, etc. The output interface 2070 is an interface for presenting information to the user, and includes, for example, an LCD panel, an OLED panel, etc.

[0109] The road monitoring device 103 according to Embodiment 1 may be physically configured in the same way as, for example, the image processing device 102. However, the storage device 1040 of the road monitoring device 103 stores program modules for realizing each function of the road monitoring device 103. Furthermore, the network interface 1050 of the road monitoring device 103 is an interface for connecting the road monitoring device 103 to the network N.

[0110] We have now described an example of the configuration of the road monitoring system 100 according to Embodiment 1. From here, we will describe an example of the operation of the road monitoring system 100 according to Embodiment 1.

[0111] (Example of operation of road monitoring system 100) The road monitoring system 100 performs road monitoring processing to monitor roads. Road monitoring processing includes, for example, imaging processing performed by the imaging device 101, image processing performed by the image processing device 102, and monitoring processing performed by the road monitoring device 103. These processes will be described with reference to the diagram.

[0112] (Example of the imaging process according to Embodiment 1) Figure 13 is a flowchart illustrating an example of the imaging process according to Embodiment 1. The imaging process is a process for photographing a road. When the imaging device 101 receives a start command from the user via, for example, the road monitoring device 103, it repeatedly executes the imaging process until it receives a stop command from the user. Note that the method for starting or ending the imaging process is not limited to these.

[0113] The imaging device 101 photographs the road and generates image information (step S101).

[0114] In more detail, for example, when the camera 1070 photographs a predetermined location on the road, the imaging device 101 generates image information including the image obtained by this photography.

[0115] Figure 14 shows an example of a road R being photographed.

[0116] Road R includes shoulders RS1 and RS2 provided along both sides of Road R, and a median strip SZ provided roughly in the center along the road. Road R further includes lanes L1 and L2 provided between shoulder RS1 and median strip SZ, and lanes L3 and L4 provided between shoulder RS2 and median strip SZ.

[0117] In Figure 14, the dotted arrows indicate the designated direction of travel for each lane. Specifically, the direction of travel for lanes L1 and L2 is towards the lower right in Figure 14. The direction of travel for lanes L3 and L4 is towards the upper left in Figure 14.

[0118] Vehicles C1, C2, C3, C4, and C5 are traveling on road R. Vehicles C1, C2, C3, and C4 are passenger cars, while vehicle C5 is a construction vehicle.

[0119] In Figure 14, the solid arrows indicate the direction of travel of the vehicles. That is, vehicles C1 and C2 are traveling in the direction of travel of the lanes L3 and L4, respectively. Vehicles C3 and C4 are traveling in the direction of travel of the lane L2, respectively. Vehicle C5 is traveling in the opposite direction to the direction of travel of the lane L1, which it is traveling in (i.e., going against the flow of traffic).

[0120] Figure 15 shows an example of image information IMD including image IM1, which is an image of road R as illustrated in Figure 14. The image information IMD illustrated in Figure 15 associates image-related information with image IM1. The image-related information illustrated in Figure 15 associates image ID "P1", shooting ID "CM1", shooting date "T1", and shooting location "L1".

[0121] "P1" is the image ID assigned to image IM1. The imaging device 101 may, for example, assign an image ID to image IM1 according to a predetermined rule and set the image ID in the image information IMD.

[0122] "CM1" is the shooting ID of the shooting device 101. The shooting device 101 may, for example, store a shooting ID that has been set in advance by the user via the road monitoring device 103, and set the shooting ID in the image information IMD.

[0123] "T1" indicates the time when image IM1 was captured. The imaging device 101 may, for example, be equipped with a timing function and set the time of capture as the capture date in the image information IMD.

[0124] "L1" is information indicating the location where the camera 101 will take a picture. The camera 101 may, for example, store in advance a shooting location (for example, the installation location of the camera 101) set by the user via the road monitoring device 103, and set that shooting location in the image information IMD.

[0125] Refer to Figure 13 again. The imaging device 101 transmits the image information generated in step S101 to the image processing device 102 (step S102), and then returns to step S101.

[0126] By performing this shooting process, the shooting device 101 can transmit each frame image captured at a predetermined frame rate to the image processing device 102 in near real-time. Alternatively, the process may be performed at pre-set time intervals to transmit image information for only a portion of the captured frame images.

[0127] (Example of image processing according to Embodiment 1) Figure 16 is a flowchart illustrating an example of image processing according to Embodiment 1. Image processing is a process for detecting road conditions by processing images of the road. The image processing device 102, for example, similar to the imaging device 101, receives a start command from the user via the road monitoring device 103 and repeatedly executes image processing until it receives a stop command from the user. Note that the method for starting or ending image processing is not limited to these.

[0128] The image acquisition unit 121 acquires the image information transmitted in step S102 (step S121).

[0129] The detection unit 122 detects the road conditions by processing the image acquired in step S121 (step S122).

[0130] In detail, for example, the detection unit 122 processes the image according to a preset image processing setting. The image processing setting includes, for example, at least one of the following: a setting to indicate the position of a road or lane in the image, a setting to indicate the actual distance between reference points in the image, and a setting to indicate the direction of travel for each lane in the road. The position of the road or lane may be set, for example, using the positions of both ends of the road or lane (e.g., white lines).

[0131] The detection unit 122 detects roads and objects on the roads, for example, by processing images, and assigns object identification information to each of the detected objects. The object identification information may be assigned according to predetermined rules.

[0132] The detection unit 122 detects the road conditions for the detected object.

[0133] Common techniques such as pattern matching and pre-trained machine learning models can be used to detect road conditions.

[0134] When a learning model is used, the detection unit 122 detects the road condition by inputting the images acquired by the image acquisition unit 121 into a trained learning model that has performed machine learning to detect road conditions, for example. In machine learning, it is preferable to perform supervised learning using, for example, training data in which images of roads have been labeled as input data.

[0135] Regarding road conditions, for example, the position and attributes of vehicles or fallen objects may be detected from the image acquired in the most recent step S121 (latest image). Also, for example, the direction of travel, speed, and movement path of a vehicle may be detected using the latest image and images previously acquired from the camera 101 (past images). In detail, for example, the direction of travel, speed, and movement path of a vehicle may be detected using the position of the vehicle detected from the latest image and the position of the same vehicle detected from past images. Similarly, the direction of movement, speed, and movement path of fallen objects may be detected using the latest image and past images.

[0136] Furthermore, the position of an object may be its position in the image. The position in the image can be represented, for example, by the pixel position of the area occupied by the object in the image, but the method of representing the position in the image is not limited to this. Note that the position of an object is not limited to its position in the image; it may also be its position in real space, for example. The position in real space can be represented, for example, by latitude and longitude, but the method of representing the position in real space is not limited to this.

[0137] The detection unit 122 generates state information including the road condition detected in step S122 (step S123).

[0138] Figure 17 shows an example of state information STD generated in step S123. State information STD is an example of state information generated based on image information IMD illustrated in Figure 15.

[0139] The status information STD includes road conditions detected based on image IM1.

[0140] In detail, the road condition included in the status information STD indicates that there are 5 vehicles and no fallen objects on road R. This road condition further associates an object ID and object condition for each object on the road.

[0141] "Object 1" and "Object 5" as illustrated in Figure 17 are the object IDs of vehicle C1 and vehicle C5, respectively.

[0142] The object state associated with "Object 1" includes "Position CP1, correct direction of travel, speed V1, passenger car, CN1". The object state associated with "Object 5" includes "Position CP5, reverse direction, speed V5, construction vehicle, CN5".

[0143] "Location P1" and "Location CP5" are examples of information indicating the respective locations of the associated vehicles C1 and C5.

[0144] "Correct direction of travel" and "Reverse direction of travel" are examples of information indicating the direction of travel for each associated vehicle C1 and C5. In this example, the direction of travel for each vehicle indicates whether or not it is the correct direction of travel according to the direction of travel on the road or lane.

[0145] "Speed ​​V1" and "Speed ​​V5" are examples of information indicating the speeds of the associated vehicles C1 and C5, respectively.

[0146] "Passenger car" and "Construction vehicle" are examples of information indicating the type of associated vehicle C1 and C5, respectively. "CN1" and "CN5" are examples of information indicating the vehicle number of associated vehicle C1 and C5, respectively. In other words, status information STD is an example of including the vehicle type and vehicle number as vehicle attributes.

[0147] Furthermore, the status information STD associates the road condition detected in step S122 with the image information IMD acquired in step S121. The image information IMD includes image IM1 as described above. Such image IM1 is an example of the latest image.

[0148] Refer to Figure 16 again. The road condition transmission unit 123 transmits the condition information generated in step S123 to the road monitoring device 103 (step S124).

[0149] In this embodiment, as described above, the imaging device 101 transmits image information, including the captured image, in near real time. When the image processing device 102 acquires this image information (step S121), it executes steps S122 to S124. Therefore, the image processing device 102 can detect the road condition in near real time and transmit the condition information, including the road condition, to the road monitoring device 103.

[0150] (Example of monitoring process according to Embodiment 1) Figure 18 is a flowchart showing an example of the monitoring process according to Embodiment 1. The monitoring process is a process to support the user in monitoring the road based on the road conditions.

[0151] For example, when the road monitoring device 103 receives a start command from the user, it transmits a start command to the camera 101 and the image processing device 102 and starts the monitoring process. Then, for example, when the road monitoring device 103 receives a stop command from the user, it transmits a stop command to the camera 101 and the image processing device 102 and ends the monitoring process. In other words, for example, when the road monitoring device 103 receives a start command from the user, it repeatedly executes the monitoring process until it receives a stop command from the user. Note that the method of starting or ending the monitoring process is not limited to these.

[0152] The road condition acquisition unit 131 acquires the condition information transmitted in step S124 (step S131).

[0153] In addition to the processing unit 134, the first discrimination unit 132 and the second discrimination unit 133 perform processing (step SA).

[0154] In processing SA (step SA), the first discrimination unit 132 determines whether the road condition included in the state information acquired in step S131 satisfies the first criterion (step S132). As a result, the first discrimination unit 132 detects the occurrence of an event predetermined for the road condition.

[0155] In detail, for example, the road condition included in the state information STD (see Figure 17) indicates that vehicle C, which is "object 5," is driving in the wrong direction. Therefore, when the state information STD is acquired in step S131, the first discrimination unit 132 determines that the state of vehicle C5, which is "object 5," satisfies the first condition. As a result, the first discrimination unit 132 detects the occurrence of a specific event, "driving in the wrong direction," for vehicle C5, which is "object 5." Hereafter, this specific event (i.e., "driving in the wrong direction" by vehicle C5, which is "object 5") will also be referred to as "event 1."

[0156] If it is determined that the first criterion is not met (step S132; No), the first determination unit 132 terminates the monitoring process.

[0157] If it is determined that the first criterion is met (step S132; Yes), the second determination unit 133 determines whether or not the second criterion is met based on the determination result in step S132 (step S133).

[0158] In detail, for example, the second discrimination unit 133 determines whether the second criterion is met based on the history of discrimination results. Here, the second criterion is that a specific event occurs at a predetermined frequency (for example, a predetermined number of times within a predetermined time) or more. In this case, the second discrimination unit 133 refers to the discrimination result from the previous step S132 and determines whether event 1 has been determined to have occurred at a predetermined frequency or more.

[0159] If it is determined that the second criterion is not met (step S133; No), the notification unit 141 performs notification processing according to the notification settings (step S134).

[0160] In detail, for example, if the notification setting prohibits notification of event 1 detected in step S132, the notification unit 141 will not notify of event 1 in step S134. If notification of event 1 is not prohibited by the notification setting, the notification unit 141 will notify of event 1. The notification unit 141 will notify, for example, by displaying a notification screen containing information about event 1 on the display unit 135. Note that the method of notifying of an event is not limited to displaying a screen and may be changed as appropriate.

[0161] Figure 19 shows an example of a notification screen according to Embodiment 1. The notification screen illustrated in Figure 19 is an example of a screen for notifying event 1. However, the notification screen is not limited to this, and the information included in the notification screen, for example, may be changed as appropriate.

[0162] The notification screen illustrated in Figure 19 includes image IM1 showing the road conditions when event 1 was detected, and the time and location where image IM1 was taken. The time and location included in the notification screen are examples of information indicating the time and place where event 1 was detected, respectively.

[0163] Furthermore, the notification screen illustrated in Figure 19 includes a frame F, which is an indicator for identifying each object contained in the image. Frame F is shown superimposed on image IM1 so as to surround each of the vehicles C1 to C5, which are objects contained in image IM1.

[0164] The frame F surrounding vehicle C5, which is an object related to event 1, is shown in a different manner than the frames F surrounding the other vehicles C1 to C4. Figure 19 shows an example where the frame F surrounding vehicle C5 has a thicker line than the frames F surrounding the other vehicles C1 to C4, but this is not the only different manner of the frame F. The frame F surrounding vehicle C5 is associated with a label indicating "event 1," which is information used to identify the detected event.

[0165] Furthermore, the notification screen illustrated in Figure 19 includes information about Event 1 below Image IM1. The information about Event 1 includes the object ID of the object related to Event 1, the object status of the object, and the type of event. In Figure 19, an example is shown where the object status included in the notification screen is the vehicle type, which is one of the vehicle's attributes.

[0166] The notification screen is not limited to this and may include one or more road conditions as appropriate. For example, the object conditions included in the notification screen may not be limited to the type of vehicle, but may be one of several other object conditions, or one or more pieces of object information.

[0167] Furthermore, the notification screen may include display items if the display items meet predetermined display conditions, such as "the vehicle type is a construction vehicle."

[0168] Refer to Figure 18 again. The notification unit 141 determines whether or not it has received an instruction to end the display of the notification screen (step S135). If it determines that it has not received an instruction to end the display (step S135; No), the notification unit 141 waits until it receives an instruction to end the display. If it determines that it has received an instruction to end the display (step S135; Yes), the notification unit 141 closes the notification screen and terminates the monitoring process.

[0169] This allows the notification unit 141 to continue displaying the notification screen on the display unit 135 until it receives a command to end the display. In the example notification screen in Figure 19, the command to end the display is received when the "close" button is pressed. In this case, the notification unit 141 can continue displaying the notification screen on the display unit 135 until the "close" button is pressed.

[0170] Refer to Figure 18 again. If it is determined that the second criterion is met (step S133; Yes), the first confirmation unit 151 displays the first confirmation screen on the display unit 135 (step S136).

[0171] Figure 20 shows an example of a first confirmation screen according to Embodiment 1. The first confirmation screen illustrated in Figure 20 is an example of a screen for confirming changes to notification settings related to Event 1 with the user.

[0172] The first confirmation screen contains information similar to that of the notification screen illustrated in Figure 19. Specifically, the first confirmation screen includes an image IM1 corresponding to event 1 (i.e., the road condition determined to meet the first criterion) and a frame F, which is an indicator for identifying each of the objects contained in the image IM1. The first confirmation screen also further includes the attributes of the vehicle C5 associated with event 1 (in the example in Figure 20, "construction vehicle").

[0173] The first confirmation screen further includes information to confirm the change in notification settings. In the example shown in Figure 20, this information includes the message, "Do you want to change the notification settings?". In the example shown in Figure 20, this information also includes the object ID, event type, notification type, and cancellation condition as notification setting items related to event 1. In the example in Figure 20, the notification type is an item for setting whether or not to send a notification.

[0174] The first confirmation screen is not limited to this and may be modified as appropriate. For example, the notification method may not be limited to whether or not to send a notification, but may also include a notification frequency, such as sending notifications at specified time intervals.

[0175] Refer to Figure 18 again. The modification unit 153 determines whether or not the instruction receiving unit 152 has received an instruction to make a change (step S137).

[0176] In the example of the first confirmation screen shown in Figure 20, the modification unit 153 determines that it has received an instruction to change the notification settings when the "Change" button is pressed after information has been entered (instructed) into the notification settings field. This instruction includes the information entered into the notification settings field. The modification unit 153 may also accept the instruction to change the settings on the condition that at least one of the predetermined required items (for example, at least one of the object ID and the type of event, and whether or not to send a notification) is entered.

[0177] Furthermore, in the example of the first confirmation screen shown in Figure 20, the change unit 153 determines that it has not received an instruction to change the notification settings when the "Close" button is pressed.

[0178] Refer to Figure 18 again. If it is determined that no instruction to make a change has been received (Step S137; No), the change unit 153 closes the first confirmation screen and terminates the monitoring process.

[0179] If it determines that an instruction to make a change has been received (Step S137; Yes), the change unit 153 changes the notification settings according to the content of the changed notification settings included in the instruction (Step S138) and terminates the monitoring process.

[0180] In the example of the first confirmation screen shown in Figure 20, suppose "Object 5" is entered for Object ID, "Reverse Driving" for Event Type, "Do Not Notify" for Whether or Not to Notify, and "Until 5:00 AM on August 22, 2022" for Cancellation Condition, and the "Change" button is pressed. In this case, the change unit 153 causes the notification unit 141 to retain the notification settings exemplified in Figure 10. As a result, the notification settings are changed to the content exemplified in Figure 10.

[0181] As described above, in step S134, the notification unit 141 issues a notification according to the notification settings. Therefore, if the notification settings exemplified in Figure 10 are retained, the notification unit 141 will not issue a notification regarding event 1 until "5:00 AM on August 22, 2022".

[0182] This type of monitoring process allows for the suppression of notifications related to an event if it is detected more than a predetermined number of times or frequency, in accordance with the user's instructions. This reduces the effort required to repeatedly check known events, thereby improving the efficiency of road monitoring.

[0183] (Effects / Actions) As described above, according to Embodiment 1, the road monitoring system comprises a detection unit 122 and a processing unit 134.

[0184] The detection unit 122 detects the road condition, which is the state of objects on the road, by processing images of the road. The processing unit 134, when the road condition meets the first criterion, performs either a notification process, which sends a notification according to the notification settings for notifications of road conditions that meet the first criterion, or a change-related process, which changes the notification settings, based on whether the second criterion related to the determination result of whether the road condition meets the first criterion is met.

[0185] This allows users to be notified of changes to their notification settings based on the second criterion. Therefore, users can change their notification settings at the appropriate time. Consequently, it becomes possible to improve the efficiency of road monitoring.

[0186] According to Embodiment 1, the processing unit 134 includes a notification unit 141 and a setting unit 142. The notification unit 141 executes a notification process when the first criterion is met. The setting unit 142 performs change-related processing when the first criterion is met and the second criterion is met.

[0187] This allows users to be notified of changes to their notification settings based on the second criterion. Therefore, users can change their notification settings at the appropriate time. Consequently, it becomes possible to improve the efficiency of road monitoring.

[0188] According to Embodiment 1, the notification unit 141 performs a notification process when the first criterion is met and the second criterion is not met.

[0189] This ensures that necessary notifications can be sent to monitor roads, thereby improving the efficiency of road monitoring.

[0190] According to Embodiment 1, the change-related processing includes a first confirmation process that displays a first confirmation screen on the display unit 135 for the user to confirm the change in notification settings.

[0191] This allows users to easily see the first confirmation screen and confirm any changes to their notification settings. Therefore, it becomes possible to improve the efficiency of road monitoring.

[0192] According to Embodiment 1, the first confirmation screen includes an image corresponding to a road condition that is determined to satisfy the first criterion, and an index for identifying each of the objects included in the image.

[0193] This allows users to easily recognize objects in the image corresponding to road conditions that meet the first criterion, making it easier to confirm changes to notification settings. Consequently, it becomes possible to improve the efficiency of road monitoring.

[0194] According to Embodiment 1, the object includes a vehicle. The road condition includes the vehicle's attributes. The first confirmation screen further includes the vehicle's attributes.

[0195] This allows users to identify vehicles in images corresponding to road conditions that meet the first criterion, along with their attributes. Therefore, when configuring notification settings based on vehicle attributes, users can easily confirm changes to those notification settings. Consequently, the efficiency of road monitoring can be improved.

[0196] According to Embodiment 1, the first criterion is a criterion defined in relation to road conditions. The notification settings include a setting regarding whether or not to provide notifications for road conditions that satisfy the first criterion. The change-related processing includes a change processing that modifies the notification settings in accordance with user instructions for the confirmation processing.

[0197] This allows users to change notification settings regarding road events according to the first criterion at the appropriate time. Consequently, it becomes possible to improve the efficiency of road monitoring.

[0198] According to Embodiment 1, the notification settings include conditions for canceling the settings.

[0199] This allows for setting conditions in notification settings, ensuring that necessary notifications for road monitoring are delivered. Consequently, it becomes possible to improve the efficiency of road monitoring.

[0200] According to Embodiment 1, the second criterion includes a criterion determined in relation to the number or frequency of times the road condition is determined to meet the first criterion.

[0201] This allows users to be notified of changes to their notification settings based on the number or frequency with which road conditions are determined to meet the first criterion. Therefore, users can change their notification settings at the appropriate time, thus improving the efficiency of road monitoring.

[0202] <Embodiment 2> This embodiment describes an example in which a road monitoring device automatically changes notification settings without user instruction.

[0203] In this embodiment, in order to simplify the explanation, descriptions of configurations similar to those in Embodiment 1 will be omitted as appropriate.

[0204] The road monitoring system according to Embodiment 2 includes a road monitoring device that includes a processing unit 234 that replaces the processing unit 134 according to Embodiment 1.

[0205] Figure 21 shows an example of the functional configuration of the processing unit 234 according to Embodiment 2. Similar to Embodiment 1, the processing unit 234 performs processing based on the determination results of the first determination unit 132 and the second determination unit 133. For example, when the road condition satisfies the first criterion, the processing unit 234 performs either notification processing or change-related processing based on whether the second criterion is met or not.

[0206] The change-related processing according to this embodiment includes, for example, an automatic generation process and a change process. The automatic generation process is a process that generates change values ​​to change the notification settings so as to suppress the notification of an event (i.e., a notification of a road condition that satisfies the first criterion). The change process changes the notification settings using the change values ​​generated by the automatic generation process.

[0207] The change-related processing according to this embodiment may further include, for example, change notification processing. Change notification processing is the process of notifying the user that the notification settings have been changed based on the changed value. The notification processing may be the same as in Embodiment 1.

[0208] As shown in Figure 21, the processing unit 234 includes a notification unit 141 similar to that in Embodiment 1, and a setting unit 242 that replaces the setting unit 142 in Embodiment 1.

[0209] The setting unit 242 performs the change-related processing according to this embodiment. For example, the setting unit 242 performs the change-related processing according to this embodiment when the first criterion is met and the second criterion is met.

[0210] As shown in Figure 21, the setting unit 242 includes an automatic generation unit 252, a modification unit 253, and a modification notification unit 254.

[0211] The automatic generation unit 252 performs automatic generation processing. The automatic generation unit 252 holds notification change rules that are set in advance by the user or the like, and generates change values ​​in accordance with said notification change rules.

[0212] Figure 22 shows an example of a notification change rule according to Embodiment 2. The notification change rule includes the condition to be changed and the changed value.

[0213] The conditions for change include criteria for identifying the events that will be subject to the change in notification settings. The notification change rule illustrated in Figure 22 includes conditions for change that define "driving in the wrong direction" by a "construction vehicle" as an event subject to change.

[0214] The change value defines the change value for events that meet the conditions for change. The notification change rule illustrated in Figure 22 is an example that includes a change value for notification, and includes the change value of "not to send notification".

[0215] In other words, the notification change rule illustrated in Figure 22 is an example of a notification change rule that is set up to "not" issue a notification when an incident such as a "construction vehicle" "driving in the wrong direction" is detected.

[0216] The modification unit 253 performs modification processing. For example, if the automatic generation unit 252 generates a modified value, the modification unit 253 uses that modified value to change the notification settings.

[0217] The change notification unit 254 performs change notification processing. For example, if the change unit 253 changes the notification settings, the change notification unit 254 notifies the user that the change has been made.

[0218] Aside from these, the road monitoring system according to Embodiment 2 may be configured functionally and physically in the same way as the road monitoring system 100 according to Embodiment 1.

[0219] (Example of operation of the road monitoring system according to this embodiment) The road monitoring system according to this embodiment performs road monitoring processing in the same manner as the road monitoring system according to Embodiment 1. The road monitoring processing according to this embodiment includes the same imaging and image processing as in Embodiment 1, and monitoring processing that differs from that of Embodiment 1.

[0220] Figure 23 is a flowchart showing an example of the monitoring process according to Embodiment 2. The monitoring process according to this embodiment includes steps S237 to S239 instead of steps S136 to S138 according to Embodiment 1. Aside from these steps, the monitoring process according to this embodiment may be the same as the monitoring process according to Embodiment 1.

[0221] If it is determined that the second criterion is met (step S133; Yes), the first verification unit 151 and the automatic generation unit 252 generate the changed value, for example, according to a pre-set notification change rule (step S237).

[0222] The modification unit 253 modifies the notification settings using the modified value generated in step S237 (step S238).

[0223] For example, suppose that the notification change rule illustrated in Figure 22 is set, and event 1 illustrated in Embodiment 1 is detected. In this case, by executing steps S237 to S238, the notification settings are automatically changed to the content illustrated in Figure 24. Here, Figure 24 is a diagram showing an example of the changed notification settings according to Embodiment 2.

[0224] The change notification unit 254 notifies the user in step S238 that the notification settings have been changed (step S239).

[0225] The notification in step S239 is, for example, provided by displaying a message on the display unit 135 for a predetermined time indicating that the notification settings have been changed. However, the notification in step S239 is not limited to this and may be modified as appropriate.

[0226] (Effects / Actions) As described above, according to Embodiment 2, the first criterion is a criterion defined in relation to road conditions. The notification setting includes a setting regarding whether or not to provide notifications for road conditions that satisfy the first criterion. The change-related processing includes an automatic generation process that generates change values ​​to change the notification settings to suppress notifications, and a change process that changes the notification settings using said change values.

[0227] This allows notification settings to be automatically changed to suppress notifications, ensuring that notification settings are adjusted appropriately at the right time. Consequently, it becomes possible to improve the efficiency of road monitoring.

[0228] According to Embodiment 2, the change-related processing further includes change notification processing that notifies the user that the notification settings have been changed based on the changed value.

[0229] This allows users to be notified when their notification settings are automatically changed. Therefore, users can review and reconfigure their notification settings as needed, thereby improving the efficiency of road monitoring.

[0230] <Embodiment 3> Embodiment 1 describes an example in which the first verification process is performed when the first and second criteria are met. When the first and second criteria are met, a second verification process different from the first verification process may be performed in addition to, or instead of, the first verification process.

[0231] In this embodiment, we will describe an example in which, when the first and second criteria are met, a second confirmation process is performed in addition to the first confirmation process.

[0232] In this embodiment, in order to simplify the explanation, descriptions of configurations similar to those in Embodiment 1 will be omitted as appropriate.

[0233] The road monitoring system according to Embodiment 3 includes a road monitoring device that includes a processing unit 334, which replaces the processing unit 134 according to Embodiment 1.

[0234] Figure 25 shows an example of the functional configuration of the processing unit 334 according to Embodiment 3. Similar to Embodiment 1, the processing unit 334 performs processing based on the determination results of the first determination unit 132 and the second determination unit 133. For example, when the road condition satisfies the first criterion, the processing unit 334 performs either notification processing or change-related processing based on whether the second criterion is met or not.

[0235] The change-related processing according to this embodiment includes, for example, a first confirmation process similar to that in Embodiment 1. In addition, the change-related processing according to this embodiment includes, for example, a second confirmation process and a change process different from that in Embodiment 1.

[0236] The second confirmation process is a process for having the user confirm changes to the image processing settings. As described above, the image processing settings include at least one of the following: for example, a setting to indicate the position of roads or lanes in the image, a setting to indicate the actual distance between reference points in the image, and a setting to indicate the direction of travel for each lane on a road.

[0237] The modification process according to this embodiment includes, in addition to the process of changing the notification settings, the process of changing the image processing settings.

[0238] The notification process may be the same as in Embodiment 1.

[0239] As shown in Figure 25, the processing unit 334 includes a notification unit 141 similar to that in Embodiment 1, and a setting unit 342 that replaces the setting unit 142 in Embodiment 1.

[0240] The setting unit 342 performs the change-related processing according to this embodiment. For example, the setting unit 342 performs the change-related processing according to this embodiment when the first criterion is met and the second criterion is met.

[0241] As shown in Figure 25, the setting unit 342 includes a first confirmation unit 151 similar to that in Embodiment 1, and an instruction receiving unit 352 and an instruction modification unit 353, which replace the instruction receiving unit 152 and modification unit 153 in Embodiment 1. The setting unit 342 further includes a second confirmation unit 355.

[0242] The second confirmation unit 355 performs a second confirmation process. For example, as part of the second confirmation process, the second confirmation unit 355 displays a second confirmation screen on the display unit 135. The second confirmation screen is a screen for the user to confirm changes to the image processing settings.

[0243] The instruction receiving unit 352 receives user instructions (i.e., user instructions) in the same manner as the instruction receiving unit 152 in Embodiment 1. The instruction receiving unit 352 in this embodiment receives user instructions, for example, as a response to a confirmation process (for example, a first confirmation screen or a second confirmation screen displayed on the display unit 135).

[0244] User instructions may include, for example, instructions to change image processing settings. Instructions to change image processing settings may include the content of the changed image processing settings. User instructions may also include instructions not to change image processing settings.

[0245] The modification unit 353 performs modification processing. Modification processing is the process of changing notification settings or image processing settings according to user instructions for the confirmation process.

[0246] In detail, when the instruction receiving unit 152 receives an instruction to change the image processing settings for the second confirmation process, the modification unit 353 changes the image processing settings according to the user instruction. As described above, the user instruction in this case includes the content of the changed image processing settings, so the modification unit 353 should send the content of the image processing settings included in the user instruction to the image processing device 102 for storage.

[0247] When the instruction receiving unit 152 receives an instruction from the user to not change the image processing settings for the second confirmation process, the modification unit 153 does not change the image processing settings in accordance with the user instruction. As a result, the image processing device 102 retains the image processing settings it has been holding.

[0248] Furthermore, the processing performed by the modification unit 353 in response to the first confirmation process may be the same as that performed by the modification unit 153 in Embodiment 1.

[0249] Aside from these, the road monitoring system according to Embodiment 3 may be configured functionally and physically in the same way as the road monitoring system 100 according to Embodiment 1.

[0250] (Example of operation of the road monitoring system according to this embodiment) The road monitoring system according to this embodiment performs road monitoring processing in the same manner as the road monitoring system according to Embodiment 1. The road monitoring processing according to this embodiment includes the same imaging and image processing as in Embodiment 1, and monitoring processing that differs from that of Embodiment 1.

[0251] Figure 26 is a flowchart showing an example of the monitoring process according to Embodiment 3. The monitoring process according to this embodiment includes steps S336 to S338 instead of steps S136 to S138 according to Embodiment 1. Aside from these, the monitoring process according to this embodiment may be the same as the monitoring process according to Embodiment 1.

[0252] If it is determined that the second criterion is met (step S133; Yes), the first confirmation unit 151 and the second confirmation unit 355 each cause the display unit 135 to display the first confirmation screen and the second confirmation screen, respectively (step S336).

[0253] Figure 27 shows an example of a second confirmation screen according to Embodiment 3. The second confirmation screen illustrated in Figure 27 is an example of a screen for confirming with the user the setting that shows the actual distance between reference points in the image. However, the second confirmation screen is not limited to this and may be modified as appropriate.

[0254] The second confirmation screen illustrated in FIG. 27 includes an image showing the first reference point and the second reference point currently set for an image (e.g., image IM1) obtained by the imaging device 101, and the currently set actual distance between the first reference point and the second reference point. Further, the second confirmation screen illustrated in FIG. 27 includes the currently set positions (e.g., pixel positions) of the currently set first reference point and second reference point in the image, respectively.

[0255] For each of the first reference point and the second reference point, for example, the user can input the position to the second confirmation screen using the image. For the actual distance, for example, the user can input a value to the second confirmation screen.

[0256] Refer to FIG. 26 again. The change unit 353 determines whether the instruction reception unit 152 has received an instruction to change the notification setting or the image processing setting (step S337).

[0257] When receiving an instruction to change the notification setting, the change unit 353 may perform the same processing as the change unit 153 according to Embodiment 1. Therefore, in this embodiment, the processing when receiving an instruction to change the image processing setting will be described.

[0258] In the example of the second confirmation screen shown in FIG. 27, after information indicating the first reference point, the second reference point, and their actual distances is input (instructed), when the "Change" button is pressed, the change unit 353 determines that an instruction to change the image processing setting has been received. This instruction includes the information input to the second confirmation screen. Also, in the example of the second confirmation screen shown in FIG. 27, when the "Close" button is pressed, the change unit 353 determines that an instruction to change the image processing setting has not been received.

[0259] Furthermore, the modification unit 353 may close the other screen when the "Change" button on either the first or second confirmation screen is pressed. This ensures that the modification unit 353 only accepts modification instructions corresponding to the screen on which the "Change" button was pressed, rather than the notification settings or the image processing settings. This prevents conflicts between instructions to change notification settings and instructions to change image processing settings.

[0260] Refer to Figure 26 again. If the system determines that it has not received instructions to change the notification settings and image processing settings (step S337; No), the modification unit 353 closes the first confirmation screen and the second confirmation screen and terminates the monitoring process.

[0261] If the system determines that it has received an instruction to change the notification settings or image processing settings (step S337; Yes), the modification unit 353 changes the notification settings or image processing settings according to the content of the changed notification settings or image processing settings included in the instruction (step S338). Then, the modification unit 353 terminates the monitoring process.

[0262] This monitoring process can prompt the user to check their image processing settings if an event is detected more than a predetermined number of times or frequency. The user can then change the image processing settings as needed.

[0263] Generally, maintenance of the imaging device 101 may change the camera's orientation (angle of view), or software updates may change (for example, reset) the image processing settings.

[0264] For example, if the position of the road or lane is misrecognized, it may incorrectly detect that a vehicle is driving in the wrong direction. For instance, on a two-lane road where the directions of travel are opposite, if one lane is recognized as the other lane, a vehicle traveling in that lane will be perceived as traveling in the other lane. As a result, even if the vehicle is traveling in the correct direction in that lane, it may be judged as driving in the wrong direction.

[0265] For example, if the actual distance is set incorrectly, it may result in an incorrect vehicle speed being calculated.

[0266] In such cases, there is a risk of repeated incorrect notifications.

[0267] When an event is detected more than a predetermined number of times or frequency, prompting the user to check the image processing settings allows the user to quickly notice any setting errors and correct them. Therefore, it becomes possible to improve the efficiency of road monitoring.

[0268] (Effects / Actions) As described above, according to Embodiment 3, the change-related processing includes a second confirmation process that displays a second confirmation screen on the display unit 135 for the user to confirm the change in the image processing settings, which are settings related to image processing.

[0269] This allows users to easily see the second confirmation screen and confirm any changes to the image processing settings. Therefore, it becomes possible to improve the efficiency of road monitoring.

[0270] According to Embodiment 1, the image processing settings include a setting value relating to at least one of the position of a road or lane in the image, and the actual distance between reference points in the image.

[0271] This reduces the possibility of false detections due to flaws in image processing settings. Consequently, it becomes possible to improve the efficiency of road monitoring.

[0272] <Embodiment 4> Embodiment 1 described an example in which the road monitoring system comprises one camera 101, one image processing device 102, and one road monitoring device 103. However, the road monitoring system may also comprise multiple camera 101s installed to photograph different locations on the road. In this case, the road may be a specific road such as Expressway X, or it may include multiple specific roads such as Expressway X and Expressway Y. Note that the road may also include pedestrian walkways.

[0273] Furthermore, the road monitoring system may include multiple image processing devices 102. In this case, each image processing device 102 may be connected to one or more imaging devices 101 via a network N so that they can send and receive information from each other. As a result, each image processing device 102 can detect the road condition, which is the state of objects on the road, by processing images of the road taken by one or more imaging devices 101.

[0274] Furthermore, these modifications can also be applied to embodiments 2 and 3.

[0275] Figure 28 shows an example configuration of a road monitoring system 400 according to Embodiment 4. The road monitoring system 400 comprises a plurality of imaging devices 101_1_1 to 101_1_M1, 101_X_1 to 101_X_M2, one or more image processing devices 102_1 to 102_X, and a road monitoring device 103. Each of M1, M2, and X is an integer of 1 or more.

[0276] Multiple imaging devices 101_1_1~101_1_M1, 101_X_1~101_X_M2 are installed to photograph different locations on the road. Each of the multiple imaging devices 101_1_1~101_1_M1, 101_X_1~101_X_M2 corresponds to, for example, the imaging device 101 according to Embodiment 1. Therefore, the multiple imaging devices 101_1_1~101_1_M1, 101_X_1~101_X_M2 generate multiple images that photograph different locations on the road.

[0277] When X is 2 or more, each of the image processing apparatuses 102_1 to 102_X corresponds to the image processing apparatus 102 according to Embodiment 1. For example, in each of the image processing apparatuses 102_1 to 102_X according to the present embodiment, the image acquisition unit 121 acquires one or more images from one or more imaging devices 101_1_1 to 101_1_M1, 101_X_1 to 101_X_M2. The detection unit 122 of each of the image processing apparatuses 102_1 to 102_X processes the one or more images acquired by the image acquisition unit 121 to detect the road state and generate state information.

[0278] The road state acquisition unit 131 according to the present embodiment acquires state information from one or more image processing apparatuses 102. The first determination unit 132 may, for example, determine whether each of the road states included in the one or more state information satisfies a first criterion.

[0279] Since there are a plurality of imaging devices 101_1_1 to 101_1_M1, 101_X_1 to 101_X_M2, the first determination unit 132 may, for example, make a determination for each of the plurality of road states detected based on each of the plurality of images.

[0280] (Operation and Effect) As described above, according to Embodiment 4, the images are a plurality of images taken at different locations on the road. The detection unit 122 is one or more. Each of the detection units 122 detects the road state by processing the plurality of images.

[0281] Thereby, the road monitoring system 400 can detect the road state based on a plurality of images taken at different locations on the road. Therefore, similar to Embodiment 1, it is possible to improve the efficiency of road monitoring and the like.

[0282] <Embodiment 5> In Embodiment 1, an example of changing the notification setting according to the content instructed by the user was described.

[0283] Generally, some events, such as traffic congestion, occur frequently at specific times or in specific areas (locations). In the case of congestion that occurs frequently at specific times or in specific areas, users performing road monitoring are likely to be able to predict it based on their experience. Notifying users of this would involve repeatedly confirming predictable events, potentially reducing the efficiency of road monitoring.

[0284] According to Embodiment 1, for example, by specifying at least one of the time period or area, notifications of traffic congestion that frequently occur in a specific time period or area can be suppressed. For example, as in the notification settings illustrated in Figure 10 where no object ID is set, the user can specify at least one of the time period and area, the type of event, the notification method, etc., on a notification setting screen such as the first confirmation screen, and set the contents as a notification setting. This makes it possible to suppress notifications about events that frequently occur in a specific time period or area, thereby improving the efficiency of road monitoring.

[0285] Here, "timing" refers to, for example, date attributes, time (time zone or specific time of day), etc. Date attributes are attributes related to the date, such as the day of the week, and whether it is a weekday or a holiday (for example, Saturday, Sunday, or public holiday).

[0286] Furthermore, notification settings may be automatically modified to suppress notifications for events that occur frequently during specific periods or in specific areas. In this embodiment, an example is described in which notification settings are automatically modified based on the history of events.

[0287] In this embodiment, in order to simplify the explanation, descriptions of configurations similar to those in Embodiment 1 will be omitted as appropriate.

[0288] The road monitoring system according to Embodiment 5 includes a road monitoring device that includes a processing unit 534 that replaces the processing unit 134.

[0289] Figure 29 shows an example of the functional configuration of the processing unit 534 according to Embodiment 5. Similar to Embodiment 1, the processing unit 534 performs processing based on the determination results of the first determination unit 132 and the second determination unit 133. For example, when the road condition satisfies the first criterion, the processing unit 534 performs either notification processing or change-related processing based on whether the second criterion is met or not.

[0290] The change-related processing according to this embodiment includes notification setting processing. Furthermore, the change-related processing according to this embodiment may further include setting notification processing.

[0291] The notification settings process is for automatically configuring notification settings based on the event history. The setting notification process is for notifying that the notification settings have been automatically configured.

[0292] As shown in Figure 29, the processing unit 534 includes a notification unit 141 similar to that in Embodiment 1, and a setting unit 542 that replaces the setting unit 142 in Embodiment 1.

[0293] The setting unit 542 performs the change-related processing according to this embodiment, for example, when the history of events satisfies the second criterion.

[0294] Here, the second criterion in this embodiment may include, for example, conditions relating to a region in addition to frequency or number of occurrences. More specifically, for example, the second criterion in this embodiment may be that the same type of event is detected repeatedly at a predetermined time or in a predetermined region, at a frequency or number of occurrences greater than or equal to a predetermined value.

[0295] The frequency here may be, for example, the number of times for each combination of date attributes, time zones, and time of day within a predetermined period. The number of times may also be, for example, the number of times for each combination of date attributes, time zones, and time of day. The specific details of the second criterion may be set by the user, for example.

[0296] As shown in Figure 29, the setting unit 542 includes a history storage unit 556, a notification setting unit 557, and a setting notification unit 558.

[0297] The history storage unit 556 stores history information indicating the history of events (i.e., road conditions that satisfy the first criterion). The history information includes the type of event, the area in which the event occurred, and the time.

[0298] For example, if the first discrimination unit 132 determines that the road condition meets the first criterion, it may generate historical information regarding the road condition that meets the first criterion and store it in the history storage unit 556.

[0299] The historical information only needs to include at least one of the following: the type of event, the region where the event occurred, and the time period when the event occurred. The time period only needs to include at least one of the following: date, time zone, or time of day.

[0300] The notification setting unit 557 automatically sets notification change rules based on the event history.

[0301] In detail, for example, the notification setting unit 557 creates notification settings based on the history of events stored in the history storage unit 556. At this time, the notification setting unit 557 may further refer to a second criterion. In this case, for example, the notification setting unit 557 creates notification settings based on events in the history of events that satisfy the second criterion, and sets the created notification settings.

[0302] Figure 30 shows an example of notification settings according to Embodiment 5.

[0303] The notification settings shown in Figure 30 are an example of notification settings for the event type "traffic congestion". Figure 30 shows an example of notification settings that, for "traffic congestion", if it occurs on a "weekday" between "17:00 and 19:00" in an area of ​​"Y km (kilometers) on the downhill lane from Junction X", then "no notification" will be sent.

[0304] Note that notification settings are not limited to those exemplified in Figure 30, and may be modified as appropriate, such as by deleting or adding items. For example, the setting "Do not send notifications" is one example of a notification type setting, and a notification frequency may also be set for this setting.

[0305] The setting notification unit 558 performs setting notification processing. For example, when the notification setting unit 557 sets a notification setting, the setting notification unit 558 notifies the user that the setting has been made.

[0306] Aside from these, the road monitoring system according to Embodiment 5 may be configured functionally and physically in the same way as the road monitoring system 100 according to Embodiment 1.

[0307] (Example of operation of the road monitoring system according to this embodiment) The road monitoring system according to this embodiment performs road monitoring processing in the same manner as the road monitoring system according to Embodiment 1. The road monitoring processing according to this embodiment includes the same shooting processing and image processing as in Embodiment 1, notification setting processing, and monitoring processing different from that of Embodiment 1.

[0308] Figure 31 is a flowchart showing an example of the notification setting process according to Embodiment 5. The notification setting process is a process for automatically setting notification settings. The notification setting process is executed at predetermined times, such as a predetermined time every day, a predetermined time once a week, or a predetermined date and time once a month.

[0309] The second discrimination unit 133 determines whether the history of the event satisfies the second criterion (step S133).

[0310] In detail, for example, the second discrimination unit 133 refers to the history storage unit 556 and determines whether or not there is an event in the history information that satisfies the second criterion.

[0311] If it is determined that the second criterion is not met (step S133; No), the second determination unit 133 terminates the notification setting process.

[0312] If it is determined that the second criterion is met (step S133; Yes), the notification setting unit 557 creates a notification setting based on the event that meets the second criterion among the events included in the history information, and has the notification unit 141 hold the created notification setting. As a result, the notification setting unit 557 sets the notification setting (step S538).

[0313] In detail, for example, the history information may include, at a predetermined frequency or higher, the history of traffic congestion that occurred on weekdays between 17:00 and 19:00 within Y km of the downhill lane from Junction X. In this case, the notification setting unit 557 may set the notification settings shown in Figure 30 based on this traffic congestion history.

[0314] Furthermore, the specific settings for notification behavior, such as whether to set notifications to "never" or to set the notification frequency, may be predetermined or configured to be specified by the user.

[0315] The setting notification unit 558 notifies the user that the notification setting has been set in step S538 (step S539), and terminates the notification setting process.

[0316] By performing this notification configuration process, notification settings can be automatically configured to suppress notifications for events that frequently occur at specific times or in specific areas.

[0317] Figure 32 is a flowchart showing an example of the monitoring process according to Embodiment 5. The monitoring process according to this embodiment includes steps S131 to S132, which are the same as those in Embodiment 1. If it is determined in step S132 that the first criterion is met (step S132; Yes), then steps S134 to S135, which are the same as those in Embodiment 1, are executed.

[0318] By performing this monitoring process, notifications of events can be sent according to the automatically configured notification settings.

[0319] In the monitoring process according to this embodiment, for example, steps S538 to S539 may be executed instead of steps S136 to S138 (see Figure 18) according to Embodiment 1. In this case, the notification setting process may not be executed.

[0320] (Effects / Actions) As described above, according to Embodiment 5, the road monitoring device includes a notification setting unit 557 that automatically sets notification change rules based on the history of events.

[0321] By implementing this type of monitoring process, notifications for events that frequently occur at specific times or in specific areas can be suppressed. Therefore, it becomes possible to improve the efficiency of road monitoring.

[0322] The embodiments and modifications of the present invention have been described above with reference to the drawings, but these are merely examples of the present invention, and various other configurations can also be adopted.

[0323] Furthermore, while the flowcharts used in the above description show multiple steps (processes) in sequence, the execution order of the steps performed in each embodiment is not limited to the order in which they are described. In each embodiment, the order of the illustrated steps can be changed to the extent that it does not impede the content. Also, the above embodiments and modifications can be combined to the extent that their content does not conflict.

[0324] Some or all of the above embodiments may also be described as follows, but are not limited to the following:

[0325] 1. A detection means that detects the road condition, which is the state of objects on the road, by processing images of the road, The system includes processing means that, when the road conditions satisfy the first criterion, performs either a notification process that sends a notification in accordance with the notification settings for notifications of road conditions satisfying the first criterion, based on whether or not the second criterion is satisfied, or a change-related process for changing the notification settings for the notification, The second criterion is a criterion relating to the determination result of whether or not the road condition satisfies the first criterion. Road monitoring system. 2. The processing means is A notification means that performs the notification process when the first criterion is met, Setting means to perform the change-related processing when the first criterion is met and the second criterion is met, 1. The road monitoring system described in 1. 3. The notification means performs the notification process if the first criterion is met and the second criterion is not met. The road monitoring system described in 2. 4. The aforementioned change-related processing includes a first confirmation process that displays a first confirmation screen on a display means for the user to confirm the change in the notification settings. A road monitoring system as described in any one of the following three items. 5. The first confirmation screen includes an image corresponding to the road condition determined to satisfy the first criterion, and an index for identifying each of the objects included in the image. The road monitoring system described in 4. 6. The aforementioned object includes a vehicle, The aforementioned road conditions include the attributes of the vehicle, The first confirmation screen further includes the attributes of the vehicle. The road monitoring system described in 5. 7. The first standard mentioned above is a standard prescribed in relation to the road conditions, The notification settings include a setting regarding whether or not to provide notification of road conditions that meet the first criterion, The aforementioned change-related processing includes a change process that modifies the notification settings in accordance with user instructions for the confirmation process. A road monitoring system as described in any one of items 4 through 6. 8. The first standard mentioned above is a standard prescribed in relation to the road conditions, The notification settings include a setting regarding whether or not to provide notification of road conditions that meet the first criterion, The aforementioned change-related processing includes an automatic generation process that generates change values ​​to change the notification settings so as to suppress the notifications, and a change process that changes the notification settings using the said change values. A road monitoring system as described in any one of the following appendices 1 to 3. 9. The aforementioned change-related processing further includes a change notification process that notifies the user that the notification settings have been changed based on the changed value. The road monitoring system described in Appendix 8. 10. The notification settings include conditions for canceling the settings. A road monitoring system as described in any one of the appendices 7 to 9. 11. The second criterion includes a criterion determined in relation to the number or frequency at which the road condition is determined to meet the first criterion. A road monitoring system as described in any one of the appendices 1 through 10. 12. The aforementioned change-related processing includes a second confirmation process that displays a second confirmation screen on a display means for the user to confirm the change in the image processing settings, which are settings related to the processing of the image. A road monitoring system as described in any one of the appendices 1 through 11. 13. The aforementioned image processing settings include a setting value relating to at least one of the position of roads or lanes in the image, and the actual distance between reference points in the image. A road monitoring system as described in any one of the appendices 1 through 12. 14. The aforementioned images are multiple images taken at different locations on the road. The detection means may be one or more, Each of the detection means detects the road condition by processing a plurality of images. A road monitoring system as described in any one of the appendices 1 through 13. 15. A road condition acquisition means that acquires condition information including road conditions, which are the state of objects on the road, The system includes processing means that, when the road conditions satisfy the first criterion, performs either a notification process that sends a notification in accordance with the notification settings for notifications of road conditions satisfying the first criterion, based on whether or not the second criterion is satisfied, or a change-related process for changing the notification settings for the notification, The second criterion is a criterion relating to the determination result of whether or not the road condition satisfies the first criterion. Road monitoring equipment. 16. One or more computers, We obtain state information including the road condition, which is the state of objects on the road. If the road condition satisfies the first criterion, then, based on whether or not the second criterion is met, either a notification process is performed to send a notification in accordance with the notification settings for notifications regarding road conditions that satisfy the first criterion, or a change-related process is performed to change the notification settings for the notification. The second criterion is a criterion relating to the determination result of whether or not the road condition satisfies the first criterion. Road monitoring method. 17. On one or more computers, We obtain state information including the road condition, which is the state of objects on the road. When the road conditions meet the first criterion, the system is designed to perform either a notification process, which sends a notification according to the notification settings for notifications regarding road conditions that meet the first criterion, or a change-related process, which involves changing the notification settings for the notification. The second criterion is a program that provides criteria for determining whether the road conditions meet the first criterion. 18. On one or more computers, We obtain state information including the road condition, which is the state of objects on the road. If the road condition satisfies the first criterion, the system performs either a notification process to send a notification in accordance with the notification settings for notifications regarding road conditions that satisfy the first criterion, or a change-related process related to changes in the notification settings, based on whether or not the second criterion is met. This is to make it happen. The second criterion is a recording medium on which a program is recorded, which is a criterion for determining whether the road condition satisfies the first criterion. [Explanation of Symbols]

[0326] 100,400 Road Monitoring Systems 101,101_1_1~101_1_M1,101_X_1~101_X_M2 Photography device 102,102_1~102_X Image Processing Device 103 Road monitoring equipment 121 Image acquisition unit 122 Detection unit 123 Road condition transmission unit 131 Road condition acquisition unit 132 1st discrimination part 133 Second discrimination part 134,234,534 Processing Unit 135 Display section 141 Notification Department 142,242,342,542 Setting section 151 First Verification Section 152,352 Instruction Reception Department 153,253,353 Changes 252 Automatic generation section 254 Change Notification Section 334 Processing Unit 355 Second Verification Section 556 History Storage Unit 557 Notification Settings Section 558 Settings Notification Section

Claims

1. A detection means that detects the road condition, which is the state of objects on the road, by processing images of the road, The system includes processing means that, when the road conditions satisfy a first criterion, performs either a notification process that sends a notification in accordance with the notification settings for notifications of road conditions satisfying the first criterion, based on whether or not a second criterion is met, or a change-related process for changing the notification settings for the notification. The second criterion is a criterion relating to the determination result of whether or not the road condition satisfies the first criterion. Road monitoring system.

2. The processing means is A notification means that performs the notification process when the first criterion is met, Setting means to perform the change-related processing when the first criterion is met and the second criterion is met, The road monitoring system according to claim 1.

3. The notification means performs the notification process if the first criterion is met and the second criterion is not met. The road monitoring system according to claim 2.

4. The aforementioned change-related processing includes a first confirmation process that displays a first confirmation screen on a display means for the user to confirm the change in the notification settings. A road monitoring system according to any one of claims 1 to 3.

5. The first confirmation screen includes an image corresponding to the road condition determined to satisfy the first criterion, and an index for identifying each of the objects included in the image. The road monitoring system according to claim 4.

6. The aforementioned object includes a vehicle, The aforementioned road conditions include the attributes of the vehicle, The first confirmation screen further includes the attributes of the vehicle. The road monitoring system according to claim 5.

7. The aforementioned change-related processing includes a second confirmation process that displays a second confirmation screen on a display means for the user to confirm the change in the image processing settings, which are settings related to the processing of the image. A road monitoring system according to any one of claims 1 to 3.

8. A road condition acquisition means that acquires condition information including road conditions, which are the state of objects on the road, The system includes processing means that, when the road conditions satisfy a first criterion, performs either a notification process that sends a notification in accordance with the notification settings for notifications of road conditions satisfying the first criterion, based on whether or not a second criterion is met, or a change-related process for changing the notification settings for the notification. The second criterion is a criterion relating to the determination result of whether or not the road condition satisfies the first criterion. Road monitoring equipment.

9. One or more computers, We obtain state information including the road condition, which is the state of objects on the road. If the road condition satisfies the first criterion, then, based on whether or not the second criterion is met, either a notification process is performed to send a notification in accordance with the notification settings for notifications regarding road conditions that satisfy the first criterion, or a change-related process is performed to change the notification settings for the notification. The second criterion is a criterion relating to the determination result of whether or not the road condition satisfies the first criterion. Road monitoring method.

10. On one or more computers, We obtain state information including the road condition, which is the state of objects on the road. When the road conditions meet the first criterion, the system is designed to perform either a notification process, which sends a notification according to the notification settings for notifications regarding road conditions that meet the first criterion, or a change-related process, which involves changing the notification settings for the notification, based on whether the second criterion is met or not. The second criterion is a program that provides criteria for determining whether the road conditions meet the first criterion.

Images