Traffic Safety Support System

Abstract

To provide a traffic safety assistance system equipped with a display device with which it is possible to easily identify a correspondence between a second traffic participant in the actual space and an exterior appearance image in a surrounding area image.SOLUTION: The traffic safety assistance system comprises a server device that predicts the future behavior of a plurality of traffic participants on the basis of information regarding the plurality of traffic participants; and a notification device that performs notification for the plurality of traffic participants on the basis of the prediction result of the server device. The server device transmits exterior appearance images 92-94 of a second traffic participant corresponding to the appearance of the second traffic participant to a first traffic participant. The notification device includes a display device 84 provided to the first traffic participant. The display device 84 displays a surrounding area image 91 indicating the surrounding area of the first traffic participant and displays, at a position corresponding to the second traffic participant in the surrounding area image 91, the exterior appearance images 92-94 of the second traffic participant transmitted to the first traffic participant from the server device.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The present invention relates to a traffic safety support system. [Background technology]

[0002] In recent years, efforts to provide vulnerable transport participants with access to sustainable transport systems have been gaining momentum. To achieve this, research and development into preventive safety technologies that can further improve transport safety and convenience has been attracting attention.

[0003] For example, Patent Document 1 discloses a technology in which a surrounding area image showing the surrounding area of ​​a first traffic participant (own vehicle) is displayed on a display device of a first traffic participant (own vehicle), and a symbol image showing the second traffic participant (other vehicle) is displayed at a position in the surrounding area image corresponding to the second traffic participant. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent Publication No. 2021-165938 Summary of the Invention [Problem to be solved by the invention]

[0005] However, in Patent Document 1, multiple second traffic participants are displayed by the same symbol image (see FIG. 4 of Patent Document 1). Therefore, it is difficult to determine which second traffic participant in the actual space corresponds to which symbol image in the surrounding area image. In addition, when there is a second traffic participant hidden in a blind spot in the actual space (for example, a vehicle hidden behind a right-turning vehicle in the oncoming lane), it is difficult to determine which symbol image in the surrounding area image this second traffic participant corresponds to.

[0006] In view of the above background, the present invention aims to provide a traffic safety support system including a display device capable of easily determining the correspondence between a second traffic participant in the actual space and an appearance image in the surrounding area image, and further aims to contribute to the development of a sustainable transportation system. [Means for solving the problem]

[0007] In order to solve the above problem, one aspect of the present invention is a traffic safety support system (1) comprising: an acquisition device (12-15) that acquires information about a plurality of traffic participants (2-5) present in a target traffic area (A); a server device (18) that predicts future behavior of the plurality of traffic participants based on the information about the plurality of traffic participants acquired by the acquisition device; and a notification device (12-15) that notifies the plurality of traffic participants based on the prediction result of the server device, wherein the plurality of traffic participants include a first traffic participant (71) and a second traffic participant (72-74), the server device transmits an appearance image (92-94) of the second traffic participant corresponding to the appearance of the second traffic participant to the first traffic participant, the notification device includes a display device (84) provided in the first traffic participant, the display device displays a surrounding area image (91) showing the surrounding area of ​​the first traffic participant, and displays the appearance image of the second traffic participant transmitted from the server device to the first traffic participant at a position corresponding to the second traffic participant in the surrounding area image.

[0008] According to this embodiment, an appearance image corresponding to the appearance of the second traffic participant is displayed at a position corresponding to the second traffic participant in the surrounding area image. This makes it possible to make the appearance image of the second traffic participant in the surrounding area image closer to the actual appearance of the second traffic participant. Therefore, it is possible to easily determine the correspondence between the second traffic participant in the actual space and the appearance image in the surrounding area image. This can ultimately contribute to the development of a sustainable transportation system.

[0009] In the above aspect, the server device transmits data of a sound generated by the second traffic participant to the first traffic participant together with the external image of the second traffic participant, and the notification device may include an audio output device (85) provided in the first traffic participant, and when the display device displays the external image of the second traffic participant, the audio output device may output a sound corresponding to the data of the sound generated by the second traffic participant.

[0010] According to this embodiment, the display device displays an appearance image corresponding to the appearance of the second traffic participant, and the audio output device outputs a sound corresponding to the sound data generated by the second traffic participant. Therefore, it is easier to determine the correspondence between the second traffic participant in the actual space and the appearance image in the surrounding area image.

[0011] In the above aspect, when the server device is unable to transmit the exterior image of the second traffic participant to the first traffic participant, the display device may display a predetermined symbol image at a position corresponding to the second traffic participant in the surrounding area image.

[0012] According to this aspect, even if the server device cannot transmit an external image of the second traffic participant to the first traffic participant, it is possible to indicate the position of the second traffic participant on the surrounding area image using a symbol image.

[0013] In the above aspect, the server device may include a memory unit (61) that stores the exterior images of the multiple traffic participants, and when the memory unit stores the exterior image of the second traffic participant, the server device may transmit the exterior image of the second traffic participant read from the memory unit to the first traffic participant.

[0014] According to this aspect, the server device reads out the appearance image of the second traffic participant from its own memory unit, and the appearance image of the second traffic participant can be quickly transmitted from the server device to the first traffic participant.

[0015] In the above aspect, when the memory unit does not store the appearance image of the second traffic participant and the second traffic participant holds the appearance image of the second traffic participant, the server device may transmit the appearance image of the second traffic participant obtained from the second traffic participant to the first traffic participant.

[0016] According to this aspect, it is possible to increase the probability that the server device can transmit the exterior image of the second traffic participant to the first traffic participant.

[0017] In the above aspect, when the memory unit does not store the appearance image of the second traffic participant and the second traffic participant does not hold the appearance image of the second traffic participant, the server device may transmit the appearance image of the second traffic participant acquired via an external communication network to the first traffic participant.

[0018] According to this aspect, it is possible to further increase the probability that the server device can transmit the exterior image of the second traffic participant to the first traffic participant.

[0019] In the above aspect, the server device may determine whether a risk occurs between the multiple traffic participants, and the display device may display the appearance image of the second traffic participant, which differs for each second traffic participant, at a position corresponding to the second traffic participant who is included in the parties to the risk, and display a predetermined symbol image at a position corresponding to the second traffic participant who is not included in the parties to the risk.

[0020] According to this embodiment, it is possible to easily distinguish between second traffic participants who are included in the parties at risk and second traffic participants who are not included in the parties at risk.

[0021] In the above aspect, the first traffic participant is a first vehicle and the second traffic participant is a second vehicle, and the display device may flash at least a portion of the exterior image of the second vehicle when a turn indicator (75) of the second vehicle is activated.

[0022] According to this aspect, it is possible to confirm that the second vehicle is about to turn, based on the exterior image of the second vehicle.

[0023] In the above aspect, the first traffic participant may be a first vehicle and the second traffic participant may be a second vehicle, and the server device may transmit to the first vehicle a three-dimensional image of the second vehicle corresponding to the type and color of the second vehicle.

[0024] According to this embodiment, the appearance image of the second traffic participant in the surrounding area image can be made closer to the actual appearance of the second traffic participant, which makes it easier to determine the correspondence between the second traffic participant in the actual space and the appearance image in the surrounding area image. Effect of the Invention

[0025] According to the above aspects, it is possible to provide a traffic safety support system equipped with a display device that can easily determine the correspondence between a second traffic participant in real space and an appearance image in the surrounding area image. [Brief description of the drawings]

[0026] [Figure 1] FIG. 2 is a schematic plan view showing a target traffic area according to an embodiment of the present invention; [Diagram 2] A functional configuration diagram showing a traffic safety support system according to an embodiment of the present invention. [Diagram 3] FIG. 1 is a plan view showing a main part of a target traffic area according to an embodiment of the present invention. [Figure 4] FIG. 1 is an explanatory diagram showing a situation in which a visual error may occur in an embodiment of the present invention. [Diagram 5]FIG. 5 is an explanatory diagram showing a surrounding area image in the situation of FIG. 4; [Figure 6] 1 is a flowchart showing image transmission control according to an embodiment of the present invention. [Figure 7] FIG. 2 is an explanatory diagram illustrating a situation in which a prediction error may occur in one embodiment of the present invention. [Figure 8] FIG. 8 is an explanatory diagram showing a surrounding area image in the situation of FIG. 7; [Figure 9] FIG. 13 is an explanatory diagram showing a surrounding area image according to a modified example of an embodiment of the present invention; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0027] Hereinafter, a traffic safety support system 1 according to one embodiment of the present invention will be described with reference to the drawings.

[0028] <Traffic Safety Support System 1> Fig. 1 is a schematic plan view showing an example of a traffic area (hereinafter referred to as "target traffic area A") to which a traffic safety support system 1 according to one embodiment of the present invention is applied. In the target traffic area A, there are a plurality of automobiles 2 (e.g., four-wheeled automobiles), a plurality of motorcycles 3, a plurality of bicycles 4, and a plurality of pedestrians 5 as a plurality of traffic participants. In the target traffic area A, there are a plurality of roadways 6, a plurality of sidewalks 7, a plurality of crosswalks 8, a plurality of traffic lights 9, etc. as a plurality of infrastructure facilities. Note that the plurality of sidewalks 7, the plurality of crosswalks 8, and the plurality of traffic lights 9 are not shown except in Fig. 1.

[0029] 2, the traffic safety support system 1 includes a plurality of automobile device groups 12 (an example of an acquisition device and a notification device), a plurality of two-wheeled vehicle device groups 13 (an example of an acquisition device and a notification device), a plurality of bicycle terminals 14 (an example of an acquisition device and a notification device), a plurality of pedestrian terminals 15 (an example of an acquisition device and a notification device), a plurality of infrastructure cameras 16, a traffic light control device 17, and a server device 18. Note that in FIG. 2, only one of each of the plurality of automobile device groups 12, the plurality of two-wheeled vehicle device groups 13, the plurality of bicycle terminals 14, the plurality of pedestrian terminals 15, and the plurality of infrastructure cameras 16 is shown. Below, the components of the traffic safety support system 1 will be explained in order.

[0030] <Automotive equipment group 12> Each automobile device group 12 is provided in a corresponding automobile 2 and moves together with the corresponding automobile 2. Each automobile device group 12 has an on-board actuator 21, an on-board sensor 22, an on-board navigation device 23 (on-board NAVI), an on-board HMI 24, an on-board control device 25, an on-board communication device 26, and an on-board terminal 27. The components of each automobile device group 12 other than the on-board terminal 27 form part of the corresponding automobile 2.

[0031] The on-vehicle actuator 21 includes a drive device that applies a driving force to the automobile 2, a brake device that applies a braking force to the automobile 2, and a steering device that steers the wheels of the automobile 2. The drive device is configured by an internal combustion engine and / or an electric motor.

[0032] The on-board sensor 22 detects various conditions related to the automobile 2. The on-board sensor 22 includes an external sensor that detects the external state of the automobile 2, a vehicle sensor that detects the state of the automobile 2, and a driver sensor that detects the state of the driver of the automobile 2. The external sensor includes an external camera that captures images of targets (division lines, obstacles, other vehicles, etc.) around the automobile 2, a radar that detects the positions of targets around the automobile 2 using radio waves such as millimeter waves, and a LiDAR that detects the positions of targets around the automobile 2 using light such as infrared rays. The vehicle sensor includes a vehicle speed sensor that detects the speed of the automobile 2. The driver sensor includes a driver camera that captures images of the driver, and a biosensor that detects the bioinformation of the driver (pulse, respiration, skin potential, etc.).

[0033] The in-vehicle navigation device 23 is a device that provides route guidance to the destination of the automobile 2. The in-vehicle navigation device 23 stores map information. The in-vehicle navigation device 23 identifies the current position of the automobile 2 based on the GNSS signal received from an artificial satellite.

[0034] The in-vehicle HMI 24 notifies the driver of the automobile 2. For example, the in-vehicle HMI 24 includes a touch panel and an audio output device. The touch panel displays various screens to the driver. The audio output device outputs audio guidance, warning sounds, and the like to the driver.

[0035] The on-vehicle control device 25 is an electronic control unit (ECU) consisting of one or more computers configured to execute various processes. The on-vehicle control device 25 includes an arithmetic processing device (a processor such as a CPU or MPU) and a storage device (a memory such as a ROM or RAM). The on-vehicle control device 25 is connected to each component of the automobile 2 and controls each component of the automobile 2. The on-vehicle control device 25 controls the traveling of the automobile 2 by controlling the on-vehicle actuator 21. The on-vehicle control device 25 recognizes targets existing around the automobile 2 based on the detection results of the external sensors of the on-vehicle sensor 22.

[0036] The on-vehicle communication device 26 is connected to the server device 18 via a wireless communication network. The on-vehicle communication device 26 transmits to the server device 18 various states related to the automobile 2 detected by the on-vehicle sensor 22 and the current position of the automobile 2 identified by the on-vehicle navigation device 23. The on-vehicle communication device 26 receives traffic safety support information (described in detail later) from the server device 18.

[0037] The in-vehicle terminal 27 is a portable terminal carried by the driver of the automobile 2. The in-vehicle terminal 27 is an electronic control unit (ECU) consisting of one or more computers configured to execute various processes. The in-vehicle terminal 27 includes an arithmetic processing unit (processor such as CPU or MPU) and a storage device (memory such as ROM or RAM). For example, the in-vehicle terminal 27 is configured by a wearable device or a smartphone. The in-vehicle terminal 27 is connected to the server device 18 via a wireless communication network.

[0038] <Motorcycle equipment group 13> Each motorcycle equipment group 13 is provided on a corresponding motorcycle 3 and moves together with the corresponding motorcycle 3. With reference to Fig. 2, each motorcycle equipment group 13 has an on-vehicle actuator 31, an on-vehicle sensor 32, an on-vehicle navigation device 33 (on-vehicle NAVI), an on-vehicle HMI 34, an on-vehicle control device 35, an on-vehicle communication device 36, and an on-vehicle terminal 37. The components of each motorcycle equipment group 13 other than the on-vehicle terminal 37 form part of the corresponding motorcycle 3. The components of each motorcycle equipment group 13 are similar to the components of each automobile equipment group 12, and therefore description thereof will be omitted.

[0039] <Bicycle Terminal 14> Each bicycle terminal 14 is a portable terminal carried by the rider of the corresponding bicycle 4, and moves together with the corresponding bicycle 4. For example, each bicycle terminal 14 is configured by a wearable device or a smartphone.

[0040] Each bicycle terminal 14 has a terminal sensor 41, a terminal navigation device 42 (terminal NAVI), a terminal HMI 43, a terminal control device 44, and a terminal communication device 45.

[0041] The terminal sensor 41 is built into each bicycle terminal 14 and detects the state of the bicycle 4. The terminal sensor 41 includes an acceleration sensor 41A that detects the acceleration of the bicycle 4, and a gyro sensor 41B that detects the angular velocity of the bicycle 4.

[0042] The terminal navigation device 42 stores map information. The terminal navigation device 42 identifies the current position of the bicycle 4 based on GNSS signals received from artificial satellites.

[0043] The terminal HMI 43 notifies the rider of the bicycle 4. For example, the terminal HMI 43 includes a touch panel and an audio output device. The touch panel displays various screens to the rider. The audio output device outputs audio guidance, warning sounds, and the like to the rider.

[0044] The terminal control device 44 is an electronic control unit (ECU) consisting of one or more computers configured to execute various processes. The terminal control device 44 includes an arithmetic processing device (a processor such as a CPU or an MPU) and a storage device (a memory such as a ROM or a RAM).

[0045] The terminal communication device 45 is connected to the server device 18 via a wireless communication network. The terminal communication device 45 transmits to the server device 18 the state of the bicycle 4 detected by the terminal sensor 41 and the current position of the bicycle 4 identified by the terminal navigation device 42. The terminal communication device 45 receives traffic safety support information (described in detail later) from the server device 18.

[0046] <Pedestrian terminal 15> Each pedestrian terminal 15 is a portable terminal carried by the corresponding pedestrian 5, and moves together with the corresponding pedestrian 5. For example, each pedestrian terminal 15 is configured by a wearable device or a smartphone.

[0047] Each pedestrian terminal 15 has a terminal sensor 51, a terminal navigation device 52 (terminal NAVI), a terminal HMI 53, a terminal control device 54, and a terminal communication device 55. The terminal sensor 51 includes an acceleration sensor 51A that detects the acceleration of the pedestrian 5, and a gyro sensor 51B that detects the angular velocity of the pedestrian 5. The components of each pedestrian terminal 15 are similar to the components of each bicycle terminal 14, so a description thereof will be omitted.

[0048] <Infrastructure Camera 16> Each infrastructure camera 16 is installed in a target traffic area A. Each infrastructure camera 16 captures images of multiple traffic participants and multiple infrastructure facilities within the target traffic area A. Each infrastructure camera 16 is connected to a server device 18 via a wireless communication network. Each infrastructure camera 16 transmits the captured images of the traffic participants and infrastructure facilities to the server device 18.

[0049] <Signal control device 17> The signal control device 17 controls each traffic light 9 installed in the target traffic area A. The signal control device 17 acquires information about each traffic light 9 installed in the target traffic area A. The signal control device 17 is connected to a server device 18 via a wireless communication network. The signal control device 17 transmits the acquired information about each traffic light 9 to the server device 18.

[0050] <Server device 18> The server device 18 is an electronic control unit (ECU) consisting of one or more computers configured to execute various processes. The server device 18 includes an arithmetic processing device (a processor such as a CPU or an MPU) and a storage device (a memory such as a ROM or a RAM). The server device 18 is configured by a virtual server built on the cloud. In another embodiment, the server device 18 may be configured by a physical server installed in a company that operates the traffic safety support system 1.

[0051] The server device 18 includes a database unit 61 , a behavior prediction unit 62 , a risk determination unit 63 , a support information generation unit 64 , and a support information transmission unit 65 .

[0052] The database unit 61 stores map information (hereinafter referred to as "area map information") of the target traffic area A. The area map information includes information on each roadway 6 in the target traffic area A (e.g., information on the width and number of lanes of each roadway 6), information on each sidewalk 7 in the target traffic area A (e.g., information on the width of each sidewalk 7), information on each crosswalk 8 in the target traffic area A (e.g., information on the position of each crosswalk 8), and the like.

[0053] The behavior prediction unit 62 recognizes the state of the target traffic area A (including the state of traffic participants present in the target traffic area A) based on information transmitted from the on-board communication device 26 of each automobile device group 12, the on-board communication device 36 of each two-wheeled vehicle device group 13, the terminal communication device 45 of each bicycle terminal 14, the terminal communication device 55 of each pedestrian terminal 15, each infrastructure camera 16, and the signal control device 17, and the area map information stored in the database unit 61. The behavior prediction unit 62 predicts the future behavior (for example, future trajectories) of the multiple traffic participants based on the state of the target traffic area A. More specifically, the behavior prediction unit 62 predicts the future behavior of the multiple traffic participants by constructing a virtual space corresponding to the target traffic area A based on the state of the target traffic area A and performing a simulation in this virtual space.

[0054] The risk determination unit 63 determines whether or not a risk (e.g., possibility of contact) will occur between the multiple traffic participants based on the future behaviors of the multiple traffic participants predicted by the behavior prediction unit 62. For example, when the future trajectory of one traffic participant overlaps with the future trajectory of another traffic participant, the risk determination unit 63 determines that a risk will occur between these traffic participants.

[0055] The support information generating unit 64 generates traffic safety support information (hereinafter abbreviated as "support information") based on the judgment result of the risk judging unit 63. The support information is information for notifying traffic participants who may be parties to risk (hereinafter referred to as "risk parties") of the existence of a risk. The support information includes information on the risk parties (e.g., information on the location of the risk parties) and information on the content of the risk (e.g., information on the location where the risk occurs).

[0056] The support information transmission unit 65 transmits the support information generated by the support information generation unit 64 to the risk parties. For example, when one automobile 2 in the target traffic area A is included in the risk parties, the support information transmission unit 65 transmits the support information to the in-vehicle communication device 26 provided in the one automobile 2. In response to this, the in-vehicle HMI 24 provided in the one automobile 2 notifies the driver of the one automobile 2 of the support information.

[0057] <Functions of Traffic Safety Support System 1> As described above, each of the automobile device groups 12 (particularly, the on-board sensor 22 and the on-board navigation device 23), each of the two-wheeled vehicle device groups 13 (particularly, the on-board sensor 32 and the on-board navigation device 33), each of the bicycle terminals 14 (particularly, the terminal sensor 41 and the terminal navigation device 42), and each of the pedestrian terminals 15 (particularly, the terminal sensor 51 and the terminal navigation device 52) acquires information about multiple traffic participants present in the target traffic area A. The server device 18 predicts the future behavior of the multiple traffic participants based on the information about the multiple traffic participants acquired by these devices. Each of the automobile device groups 12 (particularly, the on-board HMI 24), each of the two-wheeled vehicle device groups 13 (particularly, the on-board HMI 34), each of the bicycle terminals 14 (particularly, the terminal HMI 43), and each of the pedestrian terminals 15 (particularly, the terminal HMI 53) notifies the multiple traffic participants based on the prediction results of the server device 18. In this way, the traffic safety support system 1 supports safe traffic for multiple traffic participants.

[0058] In addition, when the traffic participant is a vehicle (e.g., an automobile 2, a motorcycle 3, or a bicycle 4), the notification to the traffic participant refers to a notification to a passenger of the traffic participant (e.g., a driver). In contrast, when the traffic participant is a human (e.g., a pedestrian 5), the notification to the traffic participant refers to a notification to the traffic participant himself / herself.

[0059] <Transportation participants> With reference to FIG. 3, the multiple automobiles 2 present in the target traffic area A include a first automobile 71, a second automobile 72, and a third automobile 73. The multiple motorcycles 3 present in the target traffic area A include a motorcycle 74. The first automobile 71 is an example of a first traffic participant and a first vehicle. The second automobile 72, the third automobile 73, and the motorcycle 74 are an example of a second traffic participant and a second vehicle. Hereinafter, the second automobile 72, the third automobile 73, and the motorcycle 74 will be collectively referred to as "nearby vehicles 72-74."

[0060] <Configuration of the first vehicle 71> 4, the first automobile 71 has a dashboard 82 provided below a windshield 81. The dashboard 82 has a meter panel 84 (an example of a display device) provided in front of a steering wheel 83. The meter panel 84 is a device that displays the vehicle speed and the like of the first automobile 71. The meter panel 84 is one of the components of the in-vehicle HMI 24 of the first automobile 71.

[0061] The first automobile 71 is provided with a speaker 85 (an example of an audio output device) at any location such as the dashboard 82 or a door (not shown). The speaker 85 is a device that outputs audio guidance, warning sounds, and the like to the driver of the first automobile 71. The speaker 85 is one of the components of the in-vehicle HMI 24 of the first automobile 71.

[0062] <Surrounding area image 91> 5, the meter panel 84 is provided so as to be able to display a surrounding area image 91. The surrounding area image 91 is an image showing the surrounding area of ​​the first automobile 71. The surrounding area image 91 may be generated by the on-board control device 25 of the first automobile 71, or may be generated by the server device 18 and transmitted from the server device 18 to the first automobile 71.

[0063] The surrounding area image 91 is a bird's-eye view image (three-dimensional image) looking down on the surrounding area of ​​the first automobile 71 from above toward the front and below the first automobile 71. In other embodiments, the surrounding area image 91 may be a bird's-eye view image (two-dimensional image) looking down on the first automobile 71 and its surrounding area from directly above.

[0064] First to third exterior images 92 to 94 are displayed at positions in the surrounding area image 91 corresponding to the surrounding vehicles 72 to 74. The first exterior image 92 is an exterior image of the second automobile 72, the second exterior image 93 is an exterior image of the third automobile 73, and the third exterior image 94 is an exterior image of the motorcycle 74. Hereinafter, the first to third exterior images 92 to 94 will be collectively referred to as "exterior images 92 to 94." The meter panel 84 may determine the positions of the exterior images 92 to 94 in the surrounding area image 91 based on position information of the surrounding vehicles 72 to 74 transmitted from the surrounding vehicles 72 to 74 to the first automobile 71 via the server device 18.

[0065] The exterior images 92-94 of the surrounding vehicles 72-74 are stored in a database unit 61 (an example of a storage unit) of the server device 18, and are transmitted from the server device 18 to the first automobile 71 together with position information of the surrounding vehicles 72-74. If the server device 18 cannot transmit the exterior images 92-94 of some of the surrounding vehicles 72-74 to the first automobile 71, the meter panel 84 may display a predetermined symbol image at a position in the surrounding area image 91 corresponding to the some of the surrounding vehicles 72-74.

[0066] The exterior images 92-94 of the surrounding vehicles 72-74 are three-dimensional images corresponding to the vehicle types and colors (one example of the exteriors of the surrounding vehicles 72-74) of the surrounding vehicles 72-74. Therefore, the exterior images 92-94 of the surrounding vehicles 72-74 have different shapes and colors for each of the surrounding vehicles 72-74. In other embodiments, when the surrounding area image 91 is an overhead image (two-dimensional image), the exterior images 92-94 of the surrounding vehicles 72-74 may be two-dimensional images.

[0067] When the direction indicators (not shown) of the surrounding vehicles 72-74 are operating, the meter panel 84 may blink a part of the exterior images 92-94 of the surrounding vehicles 72-74 (for example, a part corresponding to the direction indicators of the surrounding vehicles 72-74) or may blink the entire exterior images 92-94 of the surrounding vehicles 72-74. Information relating to the operation of the direction indicators of the surrounding vehicles 72-74 may be transmitted from the surrounding vehicles 72-74 to the first automobile 71 via the server device 18.

[0068] <Sound effects of nearby vehicles 72-74> When the meter panel 84 displays the exterior images 92-94 of the nearby vehicles 72-74, the speaker 85 outputs dummy sounds of the nearby vehicles 72-74. The dummy sounds of the nearby vehicles 72-74 correspond to sound data of the nearby vehicles 72-74 (data of sounds generated by the nearby vehicles 72-74) transmitted from the server device 18 to the first automobile 71. For example, the dummy sounds of the nearby vehicles 72-74 are sounds that reproduce the output sounds of the drive devices (internal combustion engines and / or electric motors) of the nearby vehicles 72-74. The dummy sounds of the nearby vehicles 72-74 have different volumes and pitches for each of the nearby vehicles 72-74.

[0069] <Image transmission control> Next, the image transmission control executed by the server device 18 will be described with reference to Fig. 6. Here, as an example, the image transmission control in the case where the server device 18 transmits an exterior image (i.e., the first exterior image 92) of the second automobile 72 to the first automobile 71 will be described.

[0070] When the image transmission control is started, the server device 18 judges whether or not the database unit 61 stores an exterior image of the second automobile 72 (step ST1).

[0071] If the database unit 61 stores an exterior image of the second automobile 72 (step ST1: Yes), the server device 18 transmits the exterior image of the second automobile 72 read from the database unit 61 to the first automobile 71 (step ST2).

[0072] If the database unit 61 does not store an exterior image of the second automobile 72 (step ST1: No), the server device 18 determines whether the second automobile 72 holds an exterior image of the second automobile 72 (i.e., an exterior image of the own vehicle) (step ST3).

[0073] If the second automobile 72 holds an exterior image of the second automobile 72 (step ST3: Yes), the server device 18 acquires the exterior image of the second automobile 72 from the second automobile 72 and transmits the exterior image of the second automobile 72 acquired from the second automobile 72 to the first automobile 71 (step ST4).

[0074] If the second automobile 72 does not retain an exterior image of the second automobile 72 (step ST3: No), the server device 18 determines whether or not an exterior image of the second automobile 72 exists on the Internet (an example of an external communication network) (step ST5).

[0075] If an exterior image of the second automobile 72 exists on the Internet (step ST5: Yes), the server device 18 acquires the exterior image of the second automobile 72 via the Internet and transmits the exterior image of the second automobile 72 acquired via the Internet to the first automobile 71 (step ST6).

[0076] If there is no exterior image of the second automobile 72 on the Internet (step ST5: No), the server device 18 ends the image transmission control without transmitting an exterior image of the second automobile 72 to the first automobile 71.

[0077] <Effects> 5, in the surrounding area image 91, a symbol image common to all the surrounding vehicles 72-74 is not displayed at positions corresponding to the surrounding vehicles 72-74, but rather exterior images 92-94 with different shapes and colors are displayed for each of the surrounding vehicles 72-74. Therefore, the driver of the first automobile 71 can easily determine the correspondence between the surrounding vehicles 72-74 in the actual space and the exterior images 92-94 in the surrounding area image 91.

[0078] In the situation shown in FIG. 4, the motorcycle 74 is hidden behind the second and third automobiles 72 and 73 as viewed from the first automobile 71. Therefore, the on-board sensor 22 of the first automobile 71 cannot detect the position of the motorcycle 74. However, the first automobile 71 and the motorcycle 74 are connected to the server device 18 via a wireless communication network. Therefore, the motorcycle 74 can transmit position information of the motorcycle 74 to the first automobile 71 via the server device 18 by wireless communication. Therefore, the meter panel 84 of the first automobile 71 can display the third exterior image 94 (an exterior image of the motorcycle 74) at a position corresponding to the motorcycle 74 in the surrounding area image 91, based on the position information of the motorcycle 74 transmitted from the motorcycle 74 to the first automobile 71 via the server device 18.

[0079] In the situation shown in FIG. 4, motorcycle 74 is hidden behind second and third automobiles 72 and 73 as seen by the driver of first automobile 71. Therefore, the driver of first automobile 71 cannot see motorcycle 74. In other words, in the situation shown in FIG. 4, a visual recognition error for motorcycle 74 may occur. However, as shown in FIG. 5, a third exterior image 94 (an exterior image of motorcycle 74) is displayed in surrounding area image 91, which is a bird's-eye view image. Therefore, the driver of first automobile 71 can confirm the position of motorcycle 74 by the third exterior image 94 displayed in surrounding area image 91.

[0080] In the situation shown in FIG. 7, motorcycle 74 is lined up next to second automobile 72, which is larger than motorcycle 74. Due to this relationship, the driver of first automobile 71 may predict that motorcycle 74 is farther away than it actually is. In other words, in the situation shown in FIG. 7, a prediction error for motorcycle 74 may occur. However, as shown in FIG. 8, the surrounding area image 91, which is a bird's-eye view image, displays the positional relationship between second automobile 72 and motorcycle 74 in an easily understandable manner. Therefore, the driver of first automobile 71 can accurately grasp the actual position of motorcycle 74 from surrounding area image 91.

[0081] <Modification> In the above embodiment, as shown in FIG. 5, only different exterior images 92-94 are used for the surrounding vehicles 72-74 in the surrounding area image 91. In another embodiment, as shown in FIG. 9, both different exterior images 92-94 and a predetermined symbol image 95 may be used for the surrounding vehicles 72-74 in the surrounding area image 91. For example, different exterior images 92-94 for the surrounding vehicles 72-74 may be displayed at positions corresponding to the surrounding vehicles 72-74 included in the risk parties in the support information transmitted from the server device 18 to the first automobile 71. Meanwhile, a predetermined symbol image 95 may be displayed at positions corresponding to the surrounding vehicles (not shown) not included in the risk parties in the above support information.

[0082] 5, in the above embodiment, exterior images 92-94 corresponding to all traffic participants are displayed in the surrounding area image 91. In another embodiment, only the exterior images 92-94 corresponding to traffic participants included in the risk parties in the support information transmitted from the server device 18 to the first vehicle 71 may be displayed in the surrounding area image 91. In other words, for traffic participants not included in the risk parties in the above support information, the display of the exterior images 92-94 in the surrounding area image 91 may be prohibited.

[0083] In the above embodiment, the automobile 2 (first automobile 71) is an example of the first traffic participant. In other embodiments, a traffic participant other than the automobile 2 (e.g., the motorcycle 3, the bicycle 4, or the pedestrian 5) may be an example of the first traffic participant.

[0084] In the above embodiment, the automobile 2 (second and third automobiles 72, 73) and the motorcycle 3 (motorcycle 74) are examples of the second traffic participant. In other embodiments, a traffic participant other than the automobile 2 and the motorcycle 3 (for example, the bicycle 4 or the pedestrian 5) may be an example of the second traffic participant. When the bicycle 4 or the pedestrian 5 is an example of the second traffic participant, an image of the bicycle 4 or the pedestrian 5 captured by the camera of the bicycle terminal 14 or the pedestrian terminal 15 may be used as an appearance image of the second traffic participant.

[0085] In the above embodiment, the automobile 2, the motorcycle 3, the bicycle 4, and the pedestrian 5 are examples of the traffic participants. In other embodiments, a moving object other than the automobile 2, the motorcycle 3, the bicycle 4, and the pedestrian 5 (e.g., a Segway, a ship, an airplane, etc.) may be an example of the traffic participant.

[0086] Although the specific embodiment has been described above, the present invention is not limited to the above embodiment and its modified examples, and can be modified in a wide range of ways. [Explanation of symbols]

[0087] 1: Traffic safety support system 2: Automobile (an example of a transportation participant) 3: Motorcycles (an example of a traffic participant) 4: Bicycle (an example of a traffic participant) 5: Pedestrian (an example of a traffic participant) 12: Automobile device group (examples of acquisition devices and notification devices) 13: Motorcycle device group (an example of an acquisition device and a notification device) 14: Bicycle terminal (an example of an acquisition device and a notification device) 15: Pedestrian terminal (an example of an acquisition device and a notification device) 18: Server device 61: Database unit (an example of a memory unit) 71: First automobile (an example of a first traffic participant and a first vehicle) 72: Second automobile (an example of a second traffic participant and a second vehicle) 73: Third car (an example of a second traffic participant and a second vehicle) 74: Motorcycle (an example of a second traffic participant and a second vehicle) 84: Meter panel (an example of a display device) 85: Speaker (an example of an audio output device) 91: Surrounding area image 92: First exterior image 93: Second exterior image 94: 3rd exterior image 95: Symbol image A: Target traffic area

Claims

1. An acquisition device for acquiring information on a plurality of traffic participants present in a target traffic area; A server device that predicts future behaviors of the plurality of traffic participants based on information about the plurality of traffic participants acquired by the acquisition device; A traffic safety support system including: a notification device that notifies the plurality of traffic participants based on a prediction result of the server device, the plurality of traffic participants includes a first traffic participant and a second traffic participant; The server device transmits an appearance image of the second traffic participant corresponding to an appearance of the second traffic participant to the first traffic participant; The second traffic participant transmits location information of the second traffic participant to the first traffic participant via the server device by wireless communication; The notification device includes a display device provided in the first traffic participant; The display device includes: displaying a surrounding area image showing a surrounding area of ​​the first traffic participant; A traffic safety support system that displays the exterior image of the second traffic participant transmitted from the server device to the first traffic participant at a position corresponding to the second traffic participant in the surrounding area image based on the position information of the second traffic participant transmitted from the second traffic participant to the first traffic participant via the server device.

2. the server device transmits data of a sound generated by the second traffic participant together with the external appearance image of the second traffic participant to the first traffic participant; The notification device includes an audio output device provided in the first traffic participant; 2. The traffic safety support system according to claim 1, wherein, when the display device displays the external image of the second traffic participant, the audio output device outputs a sound corresponding to data of a sound generated by the second traffic participant.

3. 3. The traffic safety support system according to claim 1, wherein when the server device is unable to transmit the exterior image of the second traffic participant to the first traffic participant, the display device displays a predetermined symbol image at a position in the surrounding area image corresponding to the second traffic participant.

4. The server device includes a storage unit that stores the appearance images of the plurality of traffic participants, 3. The traffic safety support system according to claim 1, wherein when the memory unit stores the external image of the second traffic participant, the server device transmits the external image of the second traffic participant read from the memory unit to the first traffic participant.

5. The traffic safety support system according to claim 4, wherein when the memory unit does not store the exterior image of the second traffic participant and the second traffic participant holds the exterior image of the second traffic participant, the server device transmits the exterior image of the second traffic participant acquired from the second traffic participant to the first traffic participant.

6. 6. The traffic safety support system according to claim 5, wherein when the memory unit does not store the exterior image of the second traffic participant and when the second traffic participant does not hold the exterior image of the second traffic participant, the server device transmits the exterior image of the second traffic participant acquired via an external communication network to the first traffic participant.

7. The server device determines whether a risk occurs between the plurality of traffic participants; The display device includes: displaying the appearance image of the second traffic participant, which differs for each of the second traffic participants, at a position corresponding to the second traffic participant included in the party of the risk; The traffic safety support system according to claim 1 or 2, wherein a predetermined symbol image is displayed at a position corresponding to the second traffic participant who is not included in the parties to the risk.

8. the first traffic participant is a first vehicle; the second traffic participant is a second vehicle; 3. The traffic safety support system according to claim 1, wherein the display device blinks at least a part of the exterior image of the second vehicle when a direction indicator of the second vehicle is activated.

9. the first traffic participant is a first vehicle; the second traffic participant is a second vehicle; 3. The traffic safety support system according to claim 1, wherein the server device transmits to the first vehicle a three-dimensional image of the second vehicle corresponding to a model and color of the second vehicle.

Images