Processing device, traffic status monitoring system, processing method, and program
Patent Information
- Application Number
- JP2025502012
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Priority Date
- 2023-02-22
- Filing Date
- 2023-02-22
- Publication Date
- 2025-09-26
AI Technical Summary
Existing traffic monitoring systems struggle to detect traffic abnormalities, such as accidents and violations, in blind spots where roadside equipment cannot capture images.
A traffic situation monitoring system comprising multiple cameras and communication devices at traffic lights, which capture and transmit images of crosswalks and intersections, enabling image processing to detect abnormalities and collect information from vehicles, even in areas obstructed by weather or large vehicles.
Enables accurate detection of traffic abnormalities, including those involving vehicles without recorders and pedestrians or bicycles, by using image processing from multiple camera angles and communication networks to gather and transmit data effectively.
Abstract
Description
Processing device, traffic condition monitoring system, processing method, and program
[0001] The present disclosure relates to a processing device, a traffic condition monitoring system, a processing method, and a program.
[0002] It is known to detect abnormal traffic conditions on the road, such as traffic accidents and traffic violations, which are different from normal traffic conditions. For example, Patent Document 1 discloses a technology that uses road images that capture road conditions to detect the occurrence of a traffic accident.
[0003] Japanese Patent Application Publication No. 2018-173688
[0004] In Patent Document 1, the detection unit mainly detects traffic accidents from roadside images captured by an imaging device mounted on the roadside unit. However, it is difficult to detect traffic accidents in blind spots of the roadside unit.
[0005] An object of the present disclosure is to provide a processing device, a traffic condition monitoring system, a processing method, and a program that solve the above-mentioned problems.
[0006] A processing device according to one aspect of the present disclosure includes: a first acquisition means for acquiring a first image captured by the first camera of a first traffic light, the first image being captured by the first camera and a first communication device; a second acquisition means for acquiring a second image transmitted by the second communication device of a second traffic light, the second image being captured by the second camera and a second communication device that transmits the second image to the first communication device; and an image processing means for detecting a traffic abnormality at at least one of the crosswalk or the intersection based on the first image and the second image.
[0007] A processing method according to one aspect of the present disclosure includes the steps of: acquiring a first image captured by a first camera of a first traffic light, the first camera comprising a first camera that captures a first image including at least one of a crosswalk or an intersection, and a first communication device; acquiring a second image transmitted by a second communication device of a second traffic light, the second camera that captures a second image including at least one of the crosswalk or the intersection, and a second communication device that transmits the second image to the first communication device; and detecting a traffic incident at at least one of the crosswalk or the intersection based on the first image and the second image.
[0008] A program according to one aspect of the present disclosure is a program for causing a computer to execute the following steps: acquiring a first image captured by a first camera of a first traffic light, the first camera comprising a first camera that captures a first image including at least one of a crosswalk or an intersection, and a first communication device; acquiring a second image transmitted by a second communication device of a second traffic light, the second camera that captures a second image including at least one of the crosswalk or the intersection, and a second communication device that transmits the second image to the first communication device; and detecting a traffic emergency at at least one of the crosswalk or the intersection based on the first image and the second image.
[0009] The processing device, traffic condition monitoring system, processing method, and program according to the present disclosure make it easy to detect traffic abnormalities.
[0010] 1 is a diagram showing an overview of a traffic condition monitoring system in a first embodiment. FIG. 2 is a diagram showing data transmission and reception in the first embodiment. FIG. 3 is a block diagram showing the configuration of an in-vehicle device in the first embodiment. FIG. 4 is a block diagram showing the configuration of a processing device in the first embodiment. FIG. 5 is a flowchart showing the operation of a camera attached to a traffic light in the first embodiment. FIG. 6 is a flowchart showing the operation of an in-vehicle device in the first embodiment. FIG. 7 is a flowchart showing the operation of a processing device in the first embodiment. FIG. 8 is a diagram showing an overview of a traffic condition monitoring system in a second embodiment. FIG. 9 is a block diagram showing the configuration of a processing device in the second embodiment. FIG. 10 is a flowchart showing the operation of a processing device in the second embodiment. FIG. 11 is a block diagram showing the configuration of a processing device in a third embodiment. FIG. 12 is a flowchart showing the operation of a processing device in a fourth embodiment.
[0011] Hereinafter, each embodiment of the present disclosure will be described with reference to the drawings. Note that the drawings and specific configurations used in each embodiment should not be used to interpret the disclosure. The same or corresponding configurations in all drawings will be assigned the same reference numerals, and common descriptions will be omitted.
[0012] First Embodiment A first embodiment according to the present disclosure will be described below with reference to FIGS.
[0013] (Configuration of Traffic Condition Monitoring System) As shown in FIGS. 1 and 2 , the traffic condition monitoring system 1 includes a host system 2, an in-vehicle device 3, a first traffic light 4, a second traffic light 5, a signal controller 6, and a processing device 7. As shown in FIG. 2 , the host system 2 transmits and receives data and request signals to and from the processing device 7. Furthermore, the processing device 7 receives information about traffic incidents that are different from normal traffic conditions, such as traffic accidents and traffic violations, from the in-vehicle device 3, the first traffic light 4, the second traffic light 5, and the signal controller 6 in the traffic condition monitoring system 1. Additionally, the processing device 7 transmits and receives data and signals to and from the in-vehicle device 3 in steps described below. In this embodiment, the processing device 7 is attached to the first traffic light 4. The signal controller 6 controls the flashing of the first traffic light 4 based on the signal lighting information and also outputs lighting information. The processing device 7, described below, mainly obtains traffic light lighting information from the first and second images. However, if lighting information cannot be obtained from the first and second images due to bad weather, obstruction by a large vehicle, or other reasons, the processing device 7 obtains the lighting information output by the signal controller 6. In this embodiment, the signal controller 6 is attached to the first traffic light 4. The communication method between the components of the traffic condition monitoring system 1 may be wired or wireless.
[0014] (Traffic Signal Configuration) As shown in FIG. 1 , the first traffic light 4 includes a first camera 41 that captures a first image including at least one of a crosswalk or an intersection, and a first communication device 42. The second traffic light 5 includes a second camera 51 that captures a second image including at least one of a crosswalk or an intersection, and a second communication device 52. The first traffic light 4 and the second traffic light 5 are arranged so that the first image captured by the first camera 41 includes lighting information for the second traffic light 5, and the second image captured by the second camera 51 includes lighting information for the first traffic light 4. Therefore, in the first embodiment of the present disclosure, as an example, the first traffic light 4 and the second traffic light 5 are arranged with a crosswalk between them. The first communication device 42 communicates with other components of the traffic condition monitoring system 1 in response to instructions from a processing device 7 (described later). The second communication device 52 transmits the second image to the first communication device 42.
[0015] (Configuration of the In-Vehicle Device) As shown in FIG. 3 , the in-vehicle device 3 includes a camera 31, a communication device 32, a global positioning system (hereinafter referred to as GPS) 33, and a recording device 34. The camera 31 is a device that captures images of the surroundings from the vehicle and is installed in the vehicle. Image data of the surroundings image captured by the camera 31 is recorded in the recording device 34. The communication device 32 receives an information request signal from the processing device 7 and transmits image data of the surroundings image captured by the camera 31 and vehicle information to the processing device 7 via the network. The vehicle information includes the vehicle's driving history, the surroundings image showing the vehicle's surroundings, vehicle position information, the time of the internal clock of the in-vehicle device, acceleration information, etc. The GPS 33 measures the current position of the vehicle.
[0016] (Configuration of Processing Device) As shown in FIG. 4 , the processing device 7 includes an image processing unit 71, a communication processing unit 72, and a recording device 73. The image processing unit 71 includes a first acquisition unit 711 that acquires a first image captured by the first camera 41 and a second acquisition unit 712 that acquires a second image captured by the second camera 51. The image processing unit 71 performs image processing on the first image acquired by the first acquisition unit 711 and the second image acquired by the second acquisition unit 712 using known techniques, such as a combination of analysis techniques such as image analysis and video analysis with machine learning. By performing the image processing described above, the processing device 7 recognizes vehicles and people in real time. In addition, the processing device 7 also recognizes the lighting status of traffic lights. As described above, the image processing unit 71 uses image processing to detect a traffic abnormality that is different from normal traffic conditions, such as a traffic accident or a traffic violation, at at least one of a crosswalk or an intersection. Examples of traffic incidents include traffic violations that can be detected through image processing, such as traffic accidents, speeding, and red light violations, as well as various unusual traffic situations, such as a vehicle being unable to move due to a vehicle malfunction. Traffic incidents are not limited to vehicles, but include traffic incidents that can be detected through image processing performed by the processing device 7. The communication processing unit 72 transmits and receives data and transmits request signals via the first communication device 42. The communication processing unit 72 includes a communication function that causes the first communication device 42 to transmit a request signal requesting a surrounding situation image to vehicles surrounding the first traffic light 4 or the second traffic light 5 within the traffic condition monitoring system 1. In addition, the communication processing unit 72 includes a communication function that causes the first communication device 42 to transmit integrated information, including the first image, the second image, lighting information, vehicle information, and traffic light position information, to the higher-level system 2. The recording device 73 stores the first image acquired by the first acquisition unit 711 and the second image acquired by the second acquisition unit 712.
[0017] (Processing Method) The processing method in this embodiment will be described below. The processing method in the processing apparatus in this embodiment is carried out according to the flow shown in FIGS.
[0018] 5 is a flowchart showing the operation process of the first camera 41 and the second camera 51 according to the first embodiment. First, the first camera 41 and the second camera 51 execute a loop process of recording an image and transmitting the image to the processing device 7 (ST101).
[0019] Next, the first camera 41 and the second camera 51 record images of at least one of the crosswalk and the intersection (ST102).
[0020] Next, the first camera 41 and the second camera 51 transmit the first image and the second image to the processing device 7. At that time, the second camera 51 transmits the second image via the second communication device 52 (ST103).
[0021] Next, first camera 41 and second camera 51 return to ST101 through loop processing (ST104).
[0022] 6 is a flowchart showing the operation process of the in-vehicle device 3 according to the first embodiment. First, the in-vehicle device 3 executes a loop process of recording an image and transmitting a surrounding situation image to the processing device 7 upon determining whether a vehicle information request signal has been received (ST201).
[0023] Next, the in-vehicle device 3 records an image of the surroundings of the vehicle using the camera 31 (ST202).
[0024] Next, the in-vehicle device 3 stores the surrounding situation image recorded by the camera 31 in the recording device 34 (ST203).
[0025] Next, the in-vehicle device 3 determines whether or not it has received a vehicle information request signal from the processing device 7 via the first communication device 42 (ST204).
[0026] Next, when the in-vehicle device 3 receives a request signal from the processing device 7 (ST204: YES), it transmits the surrounding situation image captured by the camera 31 and the vehicle information data to the processing device 7 (ST205). The transmitted surrounding situation image is an image taken a certain time before and after the traffic incident. When the in-vehicle device 3 does not receive a request signal from the processing device 7 (ST204: NO), it does not transmit the surrounding situation image captured by the camera 31 and the vehicle information data.
[0027] Next, the in-vehicle device 3 returns to ST201 through loop processing (ST206).
[0028] 7 is a flowchart showing the operation process of the processing device 7 according to the first embodiment. First, the processing device 7 receives the first and second images recorded by the first and second cameras 41 and 51, detects traffic incidents that are different from normal traffic conditions, such as traffic accidents and traffic violations, and executes a loop process of transmitting integrated information to the host system 2 (ST301).
[0029] Next, the processing device 7 receives the first image captured by the first camera 41 (ST302). The processing device 7 also receives the second image captured by the second camera 51 via the second communication device 52 of the second traffic light 5.
[0030] Next, the processing device 7 performs image processing on the first image and the second image (ST303). The image processing is performed for each frame using the above-mentioned publicly known technique.
[0031] Next, the processing device 7 performs image processing to determine whether an abnormal traffic condition has been detected at the crosswalk or the intersection (ST304). If no abnormal traffic condition has been detected (ST304: NO), the processing device 7 starts image processing for the (p+1)th frame (ST310).
[0032] Next, if a traffic abnormality is detected (ST304: YES), the processing device 7 acquires lighting information (ST305). Traffic light lighting information is mainly acquired from the first image and the second image. However, as described above, if lighting information cannot be obtained from the first image and the second image, the processing device 7 acquires lighting information output by the signal controller 6.
[0033] Next, the processing device 7 transmits a vehicle information request signal to the in-vehicle device 3 provided in a vehicle near the first traffic light 4 or the second traffic light 5 where the traffic incident occurred (ST306).
[0034] Next, the processing device 7 determines whether or not vehicle information has been acquired from the surrounding in-vehicle devices 3 (ST307). The time required to determine whether or not vehicle information has been acquired is determined by whether or not the processing device 7 has received the vehicle information within a certain time period after the request signal has been transmitted.
[0035] Next, when the processing device 7 receives the vehicle information (ST307: YES), it transmits information A to the host system (ST308). The information A includes the vehicle information, image data of the first and second images captured by the first and second cameras 41 and 51, lighting information, and position information of the first traffic light 4.
[0036] Furthermore, if the processing device 7 has not received the vehicle information (ST307: NO), it transmits information B to the host system (ST309). The information B includes image data of the first and second images captured by the first and second cameras 41 and 51, lighting information, and position information of the first traffic light 4.
[0037] Next, the processing device 7 starts image processing of the (p+1)th frame (ST310).
[0038] Next, the processor 7 returns to ST301 by loop processing (ST311).
[0039] (Actions and Effects) According to the processing device 7 of the present embodiment, image processing can be performed on two images, the first image and the second image, to detect traffic abnormalities. Therefore, the processing device 7 according to the present disclosure can easily detect traffic abnormalities.
[0040] According to one aspect of the present disclosure, the processing device 7 can detect traffic incidents, such as traffic accidents and traffic violations, that differ from normal traffic conditions using multiple images captured by cameras installed at each traffic light and the image processing unit 71. Furthermore, the traffic condition monitoring system 1 can collect traffic information from the vicinity of the traffic incident by transmitting and receiving data from the processing device 7. Therefore, the occurrence of the traffic incident can be more accurately understood based on the collected data. Because the present disclosure detects traffic incidents using images captured by cameras installed at each traffic light, it can also obtain information on the status of vehicles not equipped with dashcams, accidents involving pedestrians and bicycles without vehicles, and other such information. <Modifications> In the example of the above-described embodiment, the traffic condition monitoring system 1 does not need to include an in-vehicle device 3. One of the components of the traffic condition monitoring system 1 may emit a trigger signal to facilitate synchronization of multiple pieces of information. The trigger signal may be emitted either at the time of or after the traffic incident is detected. In the above-described embodiment, the GPS 33 may be replaced with a global navigation satellite system (GNSS), which is a higher-level concept. In the above-described embodiment, the in-vehicle device 3 may include multiple cameras 31. In the above-described embodiment, the camera 31 may be an omnidirectional camera whose angle of view is not limited to one direction. In the above-described embodiment, the vehicle information may include some of the above-described elements. In the above-described embodiment, the vehicle information may include elements other than the above-described elements. In the above-described embodiment, each traffic light may include two or more cameras. In this case, one of the images captured by the two or more cameras included in the traffic light includes lighting information for the other traffic lights. In the above-described embodiment, the recording device 73 may have a function of erasing old image information and writing new image information depending on the remaining storage capacity.
[0041] Second Embodiment A second embodiment according to the present disclosure will be described below with reference to Figures 8 to 10. Components common to the first embodiment are denoted by the same reference numerals, and detailed description thereof will be omitted.
[0042] The first embodiment was a traffic condition monitoring system including a processing device that can detect traffic irregularities by performing image processing on two images, a first image and a second image. In contrast, the processing device according to this embodiment includes a recognition unit that recognizes license plates from captured images through image processing, and a notification unit that notifies a host system of license plate information. The traffic condition monitoring system including the processing device of this embodiment is effective for tracking.
[0043] (Configuration) As shown in FIG. 8 , the traffic condition monitoring system 101 includes a host system 2, a first traffic light 104, a second traffic light 105, and a processing device 7. In this embodiment, as an example, the first traffic light 104 and the second traffic light 105 are located on either side of an intersection. FIG. 8 shows an offending vehicle 103A and a victim vehicle 103B as vehicles equipped with an on-board device 3. Intersection TTh, where both vehicles are present, is an intersection where a traffic incident was detected. The first traffic light 104 includes a first camera 141, the first communication device 42 described above, and a signal controller 6. The second traffic light 105 includes a second camera 151 and the second communication device 52 described above. As shown in FIG. 9 , the image processing unit 71 further includes a recognition unit 713. The communication processing unit 72 further includes a notification unit 721. The traffic condition monitoring system 101 may take any form as long as the recognition unit 713 and the notification unit 721 are included. In this embodiment, the processing device 7 includes a recognition unit 713 and a notification unit 721, taking into consideration consistent processing within the processing device 7. In this embodiment, the processing device 7 is attached to the first traffic light 104. The recognition unit 713 recognizes the accident vehicle number, which is the license plate number of the vehicle causing the traffic accident, and the surrounding vehicle numbers, which are the license plates of surrounding vehicles, including the victim vehicle, around the accident vehicle, based on the first and second images captured by the first and second cameras 141 and 151. The notification unit 721 notifies surrounding traffic lights adjacent to the first and second traffic lights 104 and 105 of the accident vehicle number and the surrounding vehicle numbers via the host system 2. As a variant, the notification unit 721 may notify the processing device 7 installed in the surrounding traffic lights directly, without going through the host system 2. The processing device 7 then receives the accident vehicle number and the surrounding vehicle number from the host system 2. The processing device 7 that receives the accident vehicle number and the surrounding vehicle number is the processing device 7 located at an intersection adjacent to the intersection TTh where the traffic incident was detected in FIG. 8. According to the example of Figure 8, first, the accident vehicle number (NUM1) and the surrounding vehicle number (NUM2) at intersection TTh are notified to the processing devices 7 located at intersections TTe, TTg, TTi, and TTk adjacent to intersection TTh.When the accident vehicle number (NUM1) of the offending vehicle 103A is detected at the intersection TTe, the processing device 7 at the intersection TTe notifies the host system 2 that it has detected the accident vehicle number (NUM1) of the offending vehicle 103A at the intersection TTe. The host system 2 then notifies the accident vehicle number (NUM1) of the offending vehicle 103A to the processing devices 7 at the intersections TTb, TTd, TTf, and TTh adjacent to the intersection TTe. The processing devices 7 that have detected the accident vehicle number (NUM1) of the offending vehicle 103A in the vicinity in this manner again notify the host system 2, and the host system 2 again notifies the processing devices 7 at adjacent intersections from the intersection where the processing device 7 that issued this notification is located of the vehicle number. By repeating this process, the traffic condition monitoring system 101 tracks the accident vehicle number and location of the offending vehicle in real time.
[0044] (Processing Method) The processing method of this embodiment will be described. The processing method of the processing device in this embodiment is performed according to the flow shown in Fig. 10. First, the processing device 7 receives the first image and the second image recorded by the first camera 141 and the second camera 151, and when it receives the accident vehicle number of the offending vehicle and the surrounding vehicle numbers of the surrounding vehicles from the higher-level system 2, it performs different image processing on each of them, and executes a loop process that branches into the following two processes (ST301).
[0045] Next, the processing device 7 receives the first image and the second image captured by the first camera 141 and the second camera 151 (ST302).
[0046] Next, the processing device 7 determines whether it has received from the host system 2 the accident vehicle number of the offending vehicle and the surrounding vehicle numbers of the surrounding vehicles at the intersection where the traffic incident occurred (ST330).
[0047] Next, when the processing device 7 determines that the vehicle number has been received (ST330: YES), it performs image processing B (ST331). In addition to the processing in ST303 of the first embodiment, image processing B performs processing to recognize the vehicle number from the first image and the second image captured by the first camera 141 and the second camera 151. Furthermore, at the time of receiving the vehicle information, it is considered that an abnormal traffic situation has occurred at a nearby intersection.
[0048] Next, the processing device 7 compares the recognized vehicle number with the accident vehicle number of the offending vehicle received from the higher-level system 2 (ST332).
[0049] Next, the processor 7 determines whether the recognized vehicle number and the referenced accident vehicle number match (ST333). If they do not match (ST333: NO), the processor 7 performs the process of ST335, which will be described later.
[0050] Next, if the vehicle numbers match (ST333: YES), the processing device 7 notifies the higher-level system 2 of the accident vehicle number (ST334). Thereafter, the processing device 7 performs the same processing as in the first embodiment (ST305 to ST311). However, the A information includes vehicle information, image data of the first and second images captured by the first camera 141 and the second camera 151, lighting information, and traffic light position information. However, the B information includes image data of the first and second images captured by the first camera 141 and the second camera 151, lighting information, and traffic light position information.
[0051] Next, if the vehicle number has not been received (ST330: NO), the processing device 7 performs image processing A (ST303). Image processing A is the same processing as ST303 in the first embodiment.
[0052] Next, the processing device 7 detects a traffic incident through image processing (ST304). If no traffic incident is detected (ST304: NO), the processing device 7 starts image processing of the (p+1)th frame (ST310).
[0053] Next, if a traffic incident is detected (ST304: YES), the processing device 7 makes a note of the vehicle number (ST335). The target vehicle numbers are the vehicle number of the offending vehicle and the vehicle numbers of surrounding vehicles, including the victim vehicle, around the offending vehicle. If it is difficult to note the vehicle number of the offending vehicle, the processing device 7 may only note the vehicle numbers of the surrounding vehicles. Because secondary disasters caused by the offending vehicle can be considered, in this embodiment, information on not only the site of the traffic incident but also all surrounding vehicles is obtained before the secondary disaster occurs.
[0054] Next, the processing device 7 transmits the accident vehicle number of the offending vehicle and the surrounding vehicle numbers of the surrounding vehicles, including the victim vehicle, around the offending vehicle to the higher-level system 2 (ST336). Thereafter, the processing device 7 performs the same processes as in the first embodiment (ST305 to ST311).
[0055] (Operations and Effects) According to this embodiment, the traffic condition monitoring system 101 can detect traffic incidents by having the processing device 7 perform image processing on two images, the first image and the second image. Furthermore, the traffic condition monitoring system 101 simultaneously monitors the accident vehicle number of the offending vehicle that triggered the traffic incident and the surrounding vehicle numbers of surrounding vehicles, including victim vehicles, around the offending vehicle by notifying traffic lights around the scene of the traffic incident. By using the integrated information, the location and behavior of the offending vehicle can be grasped in chronological order from the occurrence of the accident. This makes it possible to detect a second traffic incident caused by the offending vehicle after the traffic incident, or other traffic incidents triggered by the traffic incident caused by the offending vehicle. Therefore, the traffic condition monitoring system 101 according to the present disclosure easily detects traffic incidents.
[0056] According to one aspect of the present disclosure, when the processing device 7 detects a traffic incident, the host system 2 can easily notify nearby vehicles and pedestrians, such as their smartphones, of a traffic accident and provide detour guidance. After the processing device 7 detects a traffic incident, the host system 2 determines, based on the collected integrated information, whether other devices near the intersection where the traffic incident occurred need to be alerted. If the host system 2 determines that the traffic incident will cause significant damage or affect nearby vehicles and pedestrians, it notifies the electronic devices of nearby vehicles and pedestrians that a traffic incident has occurred nearby. These electronic devices include drive recorders, car navigation systems, and smartphones. If the damage caused by the traffic incident is severe and it is determined that it will be difficult for vehicles and pedestrians to pass through, detour guidance is provided.
[0057] Third Embodiment Hereinafter, an embodiment of a minimum configuration of a processing apparatus according to the present disclosure will be described as a third embodiment with reference to FIG.
[0058] (Configuration) The processing device 107 comprises a first acquisition unit 171 that acquires a first image captured by a first camera of a first traffic light, the first camera having a first image captured by a first communication device, the first image including at least one of a crosswalk or an intersection; a second acquisition unit 172 that acquires a second image transmitted by a second communication device of a second traffic light, the second camera having a second image captured by a second communication device that transmits the second image to the first communication device; and an image processing unit 170 that detects traffic abnormalities at at least one of the crosswalk or the intersection based on the first image and the second image.
[0059] (Operations and Effects) According to this embodiment, the processing device can perform image processing on two images, the first image and the second image, and detect traffic abnormalities. Therefore, traffic abnormalities can be easily detected.
[0060] Fourth Embodiment Hereinafter, a fourth embodiment of a minimum configuration of a processing method according to the present disclosure will be described with reference to Fig. 12. The processing method in this embodiment is carried out according to the flow shown in Fig. 12.
[0061] The processing method includes the steps of: acquiring a first image captured by a first camera of a first traffic light, the first camera comprising a first camera that captures a first image including at least one of a crosswalk or an intersection, and a first communication device (ST401); acquiring a second image transmitted by a second communication device of a second traffic light, the second camera that captures a second image including at least one of a crosswalk or an intersection, and a second communication device that transmits the second image to the first communication device (ST402); and detecting a traffic abnormality at at least one of the crosswalk or the intersection based on the first image and the second image (ST403).
[0062] (Actions and Effects) According to the processing method of this embodiment, two images, a first image and a second image, are acquired, and image processing is performed to detect a traffic incident. By acquiring two images, this embodiment can avoid a situation in which a traffic incident cannot be detected if one of the cameras cannot capture an image containing the traffic incident. Therefore, the processing method according to the present disclosure makes it easy to detect a traffic incident.
[0063] Although an embodiment of the present disclosure has been described above, this embodiment is shown by way of example and is not intended to limit the scope of the disclosure. This embodiment can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the present disclosure. This embodiment and its modifications are considered to be within the scope and spirit of the present disclosure, as well as within the scope of the present disclosure and its equivalents.
[0064] According to the above-described aspect, traffic abnormalities can be easily detected.
[0065] REFERENCE SIGNS LIST 1 Traffic condition monitoring system 2 Upper system 3 In-vehicle device 31 Camera 32 Communication device 33 GPS 34 Recording device 4 First traffic light 41 First camera 42 First communication device 5 Second traffic light 51 Second camera 52 Second communication device 6 Signal controller 7 Processing device 71 Image processing unit 711 First acquisition unit 712 Second acquisition unit 713 Recognition unit 72 Communication processing unit 721 Notification unit 73 Recording device 101 Traffic condition monitoring system 103A Offending vehicle 103B Victim vehicle 104 First traffic light 141 First camera 105 Second traffic light 151 Second camera 107 Processing device 170 Image processing unit 171 First acquisition unit 172 Second acquisition unit
Claims
1. a first camera that captures a first image including at least one of a crosswalk or an intersection, and a first communication device; and a first acquisition means that acquires the first image captured by the first camera of a first traffic light; a second acquisition means for acquiring the second image transmitted by the second communication device of a second traffic light, the second image including at least one of the crosswalk or the intersection, and a second communication device that transmits the second image to the first communication device; an image processing means for detecting a traffic abnormality at at least one of the crosswalk or the intersection based on the first image and the second image; Equipped with Processing equipment.
2. the first image includes lighting information of the second traffic light, The second image includes lighting information of the first traffic light. The processing device of claim 1 .
3. The vehicle further includes a communication processing means for causing the first communication device to transmit a request signal requesting a surrounding situation image to a vehicle in the vicinity of the first traffic light or the second traffic light. The processing device according to claim 1 or 2.
4. The image processing device further includes a communication processing unit that causes the first communication device to transmit integrated information including the first image and the second image to a host system. The processing device according to claim 1 or 2.
5. The first traffic light further includes a traffic light controller; The integrated information includes traffic light illumination information acquired from the traffic light controller. The processing device according to claim 4 .
6. The first traffic light is provided with the processing device according to claim 1 or 2; the second traffic light; Equipped with Traffic condition monitoring system.
7. The first traffic light and the second traffic light are provided on either side of the crosswalk or the intersection. The traffic condition monitoring system according to claim 6.
8. a recognition means for recognizing the accident vehicle number of the vehicle that caused the traffic incident and the surrounding vehicle numbers of the vehicles surrounding the vehicle based on the first image and the second image; a notification means for notifying surrounding traffic lights adjacent to the first traffic light and the second traffic light of the accident vehicle number and the surrounding vehicle number; The traffic condition monitoring system according to claim 6, comprising:
9. a first camera configured to capture a first image including at least one of a crosswalk or an intersection; and a first communication device. The first camera of a first traffic light captures the first image, and the first image is acquired; a second camera configured to capture a second image including at least one of the crosswalk and the intersection, and a second communication device configured to transmit the second image to the first communication device; and Detecting a traffic abnormality at at least one of the crosswalk or the intersection based on the first image and the second image. Processing method.
10. On the computer, a first camera configured to capture a first image including at least one of a crosswalk or an intersection; and a first communication device. The first camera of a first traffic light is configured to capture the first image including at least one of a crosswalk or an intersection. a second camera configured to capture a second image including at least one of the crosswalk and the intersection, and a second communication device configured to transmit the second image to the first communication device; and Detecting a traffic abnormality at at least one of the crosswalk or the intersection based on the first image and the second image. to make something happen program.