Vehicle accident peripheral information correlating device

Abstract

The present application provides a vehicle accident surrounding information association device, which enables further grasping of the situation of an accident in an emergency reporting system. A vehicle accident surrounding information association device (93) is provided in an emergency reporting system (1) capable of transmitting emergency information related to an accident from a vehicle (10) that has encountered the accident to a server device (2), and acquires accident surrounding information capable of being transmitted from a surrounding terminal (9) other than the vehicle (10), judges whether the acquired accident surrounding information is information about the accident of the vehicle (10), and generates association information that associates the accident surrounding information judged to be information about the accident of the vehicle (10) with the emergency information transmitted by the vehicle (10) to the server device (2).

Description

TECHNICAL FIELD

[0001] The present application relates to a peripheral information relating device for a vehicle accident. BACKGROUND

[0002] With respect to a vehicle such as an automobile, information at the time of an accident is considered to be reported. In an automobile, for example, an emergency reporting system such as AACN (Advanced Automatic Collision Notification) is put into practical use. With respect to AACN, an automobile that has encountered an accident uses an automatic reporting device provided in the automobile to transmit information at the time of an accident, such as the working state of a passenger protection device at the time of an accident, the position, the input direction and strength of impact in the accident, and the like, to a server device of a call center (Patent Document 1). At the call center, the information at the time of an accident of each automobile received by the server device is confirmed, and a rescue helicopter and / or an action force for first aid is requested to be dispatched. Thereby, the preparation time until the rescue helicopter and / or the ambulance is dispatched can be shortened. The possibility that the passenger of the vehicle in the accident can be rescued can be increased.

[0003] PRIOR ART DOCUMENT

[0004] PATENT DOCUMENT

[0005] Patent Document 1: Japanese Patent Application Laid-Open No. 2001-216588 SUMMARY

[0006] PROBLEMS TO BE SOLVED

[0007] Thus, only the information at the time of an accident of the vehicle that has encountered an accident is transmitted to the server device, and the information related to the accident in the server device can be insufficient, and the situation of the accident cannot be accurately grasped.

[0008] For example, in the case where a vehicle collides with a pedestrian and / or a person riding a bicycle, only the information at the time of an accident related to the vehicle from the vehicle can be insufficient with respect to the information of the pedestrian and the like that has encountered an accident.

[0009] In addition, for example, in the case where an accident involving a plurality of vehicles and a plurality of pedestrians occurs, it can also be impossible to grasp which vehicle the pedestrian that has encountered an accident collided with, and the like.

[0010] Further, in the case where the information with respect to the pedestrian and the like that has encountered an accident is insufficient to accurately grasp the situation of the accident, the action force dispatched based on the request of the call center can also be unable to apply sufficient first aid measures to the person that has encountered an accident.

[0011] Thus, with respect to the emergency reporting system, it is required to be able to grasp the situation of the accident with higher accuracy.

[0012] Technical Solution

[0013] The vehicle accident peripheral information association device of one embodiment of the present application is provided in an emergency reporting system that can transmit emergency information related to an accident from a vehicle that has encountered the accident to a server device, and has: an acquisition section that acquires accident peripheral information that can be transmitted from a peripheral terminal other than the vehicle; a determination section that determines whether the acquired accident peripheral information is information about an accident of the vehicle; and a generation section that generates association information that associates the accident peripheral information determined by the determination section to be information about an accident of the vehicle with the emergency information transmitted by the vehicle to the server device.

[0014] Preferably, the determination section can determine whether the accident peripheral information is information about an accident of the vehicle by collating a position, a time, or an image about the accident peripheral information acquired by the server device with a position, a time, or an image about the vehicle received by the server device from the vehicle that has encountered the accident.

[0015] Preferably, the acquisition section can acquire the accident peripheral information received by the server device, and the vehicle accident peripheral information association device has an output section that outputs the accident peripheral information associated with the emergency information transmitted by the vehicle to the server device using the association information generated by the generation section.

[0016] Preferably, the vehicle that has encountered the accident can generate information about a position of the own vehicle or the other vehicle or information about a change in position and transmit it to the server device, and the determination section determines that the accident peripheral information is information about an accident of the vehicle in a case where a position or a change in position of a vehicle or the other vehicle in the accident peripheral information acquired by the acquisition section is related to the information about the position or the change in position acquired from the vehicle that has encountered the accident.

[0017] Preferably, the acquisition section can acquire the accident peripheral information received by the vehicle that has encountered the accident from a peripheral terminal, the determination section determines whether the acquired accident peripheral information of the peripheral terminal is information about an accident of the vehicle by collating the acquired accident peripheral information of the peripheral terminal with information possessed by the vehicle that has encountered the accident, and the vehicle transmits the acquired accident peripheral information and the association information to the server device.

[0018] Technical Effects

[0019] Regarding this invention, a vehicle accident perimeter information association device is installed in an emergency notification system capable of sending emergency information related to an accident from a vehicle involved in an accident to a server device. The vehicle accident perimeter information association device acquires accident perimeter information that can be sent from peripheral terminals outside the vehicle, compares this accident perimeter information with emergency information from the vehicle, and determines whether the accident perimeter information pertains to an accident involving the vehicle. Furthermore, the vehicle accident perimeter information association device generates association information, which associates the accident perimeter information determined to be related to an accident involving the vehicle with the emergency information sent by the vehicle to the server device.

[0020] Therefore, server devices and the like can utilize not only emergency information related to the accident from the vehicle involved, but also surrounding accident information sent from devices outside the vehicle, based on associated information. For situations where emergency information from the vehicle alone is insufficient to provide a complete picture, call center staff can use the surrounding accident information to gain a better understanding. Based on the richer information supplemented by the surrounding accident information, call center staff can make a more detailed and accurate assessment of the accident scene, enabling necessary emergency responders to proceed urgently. Emergency responders, too, can use the richer information supplemented by the surrounding accident information to more accurately assess not only the condition of passengers but also that of pedestrians, allowing them to proceed to the scene when appropriate. Attached Figure Description

[0021] Figure 1 This is an explanatory diagram of an example of an emergency notification system according to the first embodiment of the present invention.

[0022] Figure 2 This is an explanatory diagram of a car's control system, which can serve as... Figure 1 It functions as an automatic notification device that sends emergency information to cars that have been involved in accidents.

[0023] Figure 3 It is by Figure 1 A diagram illustrating the server equipment used in a call center.

[0024] Figure 4 It is by Figure 1 A diagram illustrating the client terminals used by the operational troops.

[0025] Figure 5 It means Figure 1 This is a sequence diagram illustrating an example of the process of handling a series of events from the emergency notification of a car involved in an accident to the dispatch of emergency medical services.

[0026] Figure 6 yes Figure 1A flowchart of the association processing of peripheral information about a car accident in the server device.

[0027] Figure 7 yes Figure 6 An explanatory diagram showing the comparison and judgment made by the server device regarding images generated by peripheral terminals as information about the surroundings of an accident.

[0028] Figure 8 This is an illustration of an example of an accident involving multiple cars and pedestrians.

[0029] Figure 9 This is a flowchart of the process for generating accident information in a vehicle, executed by the vehicle's control system, according to the second embodiment of the present invention.

[0030] Figure 10 Is Figure 6 The server device association processing used Figure 9 This is an explanatory diagram illustrating the comparison and judgment of images generated by surrounding terminals as information about the accident's surroundings, in the case of accident information.

[0031] Figure 11 This is a flowchart of the association processing of peripheral information about a car accident performed by the vehicle's control system according to the third embodiment of the present invention.

[0032] Figure 12 yes Figure 11 An explanatory diagram showing the comparison and judgment made by the vehicle with images generated by surrounding terminals as information about the accident's surroundings.

[0033] Symbol Explanation

[0034] 1 emergency reporting system; 2 server device; 3 client terminal; 4 automatic reporting device; 5 wireless communication network; 6 base station; 7 communication network; 9 mobile terminal (peripheral terminal); 10 automobile (vehicle); 11 ambulance; 12 SNS server; 20 control system; 21 drive ECU; 22 steering ECU; 23 brake ECU; 24 travel control ECU; 25 driving operation ECU; 26 detection ECU; 27 external communication ECU; 28 internal communication ECU; 29 UI operation ECU; 30 occupant protection ECU (vehicle accident peripheral information association device); 36 vehicle network; 37 bus cable; 38 central gateway; 41 display device; 42 operation device; 51 speed sensor; 52 three-axis acceleration sensor; 53 stereo camera; 54 in-vehicle camera; 55 microphone; 56 GNSS receiver; 60 external communication terminal; 61 external communication device; 70 internal communication terminal; 71 internal communication device; 80 occupant protection device; 81 driver's side seat belt device; 82 passenger's side seat belt device; 83 driver's side front airbag device; 84 driver's side curtain airbag device; 85 passenger's side front airbag device; 86 passenger's side curtain airbag device; 87 occupant protection memory; 91 server communication device; 92 server memory; 93 server CPU (vehicle accident peripheral information association device); 94 server GNSS receiver; 95 server monitor; 96 server talk device; 97 server bus; 101 client communication device; 102 client memory; 103 client CPU; 104 client notification device; 105 client GNSS receiver; 106 client monitor; 107 client talk device; 108 client bus; 110 GNSS satellite DETAILED DESCRIPTION

[0035] Hereinafter, an embodiment of the present application will be described based on the drawings.

[0036] (First Embodiment)

[0037] Figure 1 is a diagram illustrating an example of the emergency reporting system 1 of the first embodiment of the present application.

[0038] Figure 1An emergency reporting system 1 of the related art has a server device 2 used by a call center of an organization that manages a road accident caused by a vehicle 10 or the like, a client terminal 3 used by a rescue team of a fire department or the like, an automatic reporting device 4 provided to a plurality of vehicles 10, and a wireless communication network 5 that provides communication lines for these devices. The wireless communication network 5 has base stations 6 that are provided in a dispersed manner in a region along, for example, a road, for communication with wireless terminals such as the automatic reporting device 4, and a communication network 7 that connects the plurality of base stations 6. The base stations 6 function as access points that connect a plurality of wireless terminals within a communicable area. The server device 2 of the call center and the client terminal 3 of the rescue team are connected to the communication network 7. Such an emergency reporting system 1 at the time of an accident has, for example, AACN (Advanced Automatic Collision Notification). The AACN is capable of transmitting automatic accident information from a vehicle 10 that has encountered an accident to the server device 2 of the call center in real time, and causes the rescue team to dispatch an ambulance 11 and / or a rescue helicopter based on a dispatch request from the call center. The call center is capable of selecting a rescue team that corresponds to the situation of the accident and issuing a dispatch request. The ambulance 11 and / or the rescue helicopter are capable of being dispatched to the accident site in a state in which the situation of the accident is grasped. Thus, appropriate rescue treatment can be provided to the parties to the accident in a short preparation time. Figure 1

[0039] Note that, with respect to the emergency reporting system 1 of the related art, although an example in which a plurality of organizations cooperatively use the system is shown, for example, a police department, a fire department, a government office, a hospital, a medical institution, a security company, a management company, or the like that manages a region including a road on which the vehicle 10 or the like can travel can also use the system individually. Figure 1

[0040] In addition, in the emergency reporting system 1 of the related art, a GNSS satellite 110 is illustrated. Figure 1 Figure 1 Each of the devices is capable of obtaining its own position and time by receiving a radio wave that includes position information of a plurality of GNSS satellites 110, such as latitude and longitude, and time information. Also, the plurality of devices are capable of making each of the current time and the current position, and the like, high in precision by receiving radio waves from a plurality of GNSS satellites 110 that cooperate with each other. The plurality of devices are capable of using a synchronized common time.

[0041] Figure 2 is a diagram of a control system 20 of the vehicle 10 that is capable of functioning as the automatic reporting device 4 that transmits emergency information in the vehicle 10 that has encountered an accident in the emergency reporting system 1 of the related art. Figure 1

[0042] Figure 2 ​​​​The control system 20 of the automobile 10 is represented by control ECUs (Electronic Control Unit) each of which is assembled with a plurality of control devices, representatively. In addition to the control ECUs, the control devices have, for example, memories that store control programs and data, input and output ports that are connected to control objects or state detection devices of the control objects, timers that measure time and / or time of day, and internal buses that connect them.

[0043] Specifically, Figure 2 The control ECUs shown are, for example, a drive ECU 21, a steering ECU 22, a brake ECU 23, a travel control ECU 24, a driving operation ECU 25, a detection ECU 26, an external communication ECU 27, an internal communication ECU 28, a UI operation ECU 29, and a passenger protection ECU 30. The control system 20 of the automobile 10 can also have other control ECUs not shown.

[0044] The plurality of control ECUs are connected to a vehicle network 36 such as a CAN (Controller Area Network) or a LIN (Local Interconnect Network) employed in the automobile 10. The vehicle network 36 can include a plurality of bus cables 37 that can connect the plurality of control ECUs and a central gateway (CGW) 38 that is a relay device that connects the plurality of bus cables 37. The plurality of control ECUs are assigned IDs that are identification information different from each other. The control ECUs basically periodically output data to other control ECUs. The data has attached thereto an ID of the control ECU of the output source and an ID of the control ECU of the output target. The other control ECUs monitor the bus cables 37, and in a case where the ID of the output target is, for example, the own ID, the control ECU acquires the data and performs processing based on the data. The central gateway 38 monitors each of the plurality of bus cables 37 connected thereto, and if a control ECU connected to a bus cable 37 different from the bus cable 37 to which the control ECU of the output source is connected is detected, the central gateway 38 outputs the data to the bus cable 37 to which the control ECU is connected. Through the relay processing of the central gateway 38, the plurality of control ECUs can input and output data between other control ECUs connected to bus cables 37 different from the bus cables 37 to which the plurality of control ECUs are connected, respectively.

[0045] The display device 41 and the operation device 42 are connected to the UI operation ECU 29 as user interface devices with the occupant of the vehicle, for example. The display device 41 can be, for example, a liquid crystal device, a video projection device. The operation device 42 can be, for example, a touch panel, a keyboard, a non-contact operation detection device. The display device 41 and the operation device 42 can be provided inside the vehicle cabin in which the occupant is seated, for example. The UI operation ECU 29 acquires data from the vehicle network 36 and displays it on the display device 41. The UI operation ECU 29 outputs operation input for the operation device 42 to the vehicle network 36. In addition, the UI operation ECU 29 can perform processing based on the operation input and cause the processing result to be included in the data. The UI operation ECU 29 can display a navigation screen for setting a destination or the like on the display device 41, for example, search for a route to the destination selected by the operation input, and cause the route data to be included in the data. The route data can include attribute information such as a lane of a road to be used until the destination is reached from the current position.

[0046] As operation members for the occupant to control the running of the vehicle 10, a steering wheel, a brake pedal, an accelerator pedal, a shift lever, and the like, which are not shown, are connected to the driving operation ECU 25. If the operation members are operated, the driving operation ECU 25 outputs data including whether or not the operation, the operation amount, and the like to the vehicle network 36. In addition, the driving operation ECU 25 can perform processing regarding the operation of the operation members and cause the processing result to be included in the data. For example, in the case where the accelerator pedal is operated in a situation where there is another moving body and / or a fixed object in the direction of travel of the vehicle 10, the driving operation ECU 25 can judge that the operation is abnormal and cause the judgment result to be included in the data.

[0047] As detection means for detecting a running state of the vehicle 10, for example, a speed sensor 51 that detects a speed of the vehicle 10, a three-axis acceleration sensor 52 that detects an acceleration of the vehicle 10, a stereo camera 53 that photographs a periphery of an outside of the vehicle 10, an in-vehicle camera 54 that photographs an occupant of a vehicle compartment, a microphone 55 that data- izes sound outside and inside the vehicle, a GNSS receiver 56 that detects a position of the vehicle 10, and the like are connected to the detection ECU 26. The GNSS receiver 56 receives electric waves from a plurality of GNSS satellites 110, and obtains a current position of the host vehicle, that is, a latitude and a longitude, and a current time. The detection ECU 26 acquires detection information from the detection means, and outputs data including the detection information to the vehicle network 36. In addition, the detection ECU 26 can perform processing based on the detection information, and cause the processing result to be included in the data. For example, in a case where the three-axis acceleration sensor 52 detects an acceleration that exceeds a threshold value of a collision detection, the detection ECU 26 can determine a collision detection, and cause a collision detection result to be included in the data. The detection ECU 26 can extract a pedestrian and / or another vehicle, a street tree and / or a power pole, a guardrail, and the like that exist in a periphery of the host vehicle based on an image of the stereo camera 53, determine a kind and / or an attribute of the object, estimate a relative direction, a relative distance, and a moving direction in a case where the object is moving, from a position, a size, and a change of the object in the image, and cause prediction information of a collision with another object including these estimation results to be included in the data and output to the vehicle network 36.

[0048] The external communication device 61 is connected to the external communication ECU 27. Thereby, the external communication terminal 60 that is a communication apparatus provided to the vehicle 10 is constituted. The external communication device 61 performs wireless communication with a base station 6 of the wireless communication network 5 in the vicinity of the vehicle 10. The external communication ECU 27 transmits and receives data between the server apparatus 2 and the like through the wireless communication network 5 using the wireless communication between the external communication device 61 and the base station 6. The external communication terminal 60 is a transmission apparatus provided to the vehicle 10, and is a kind of wireless terminal.

[0049] The internal communication device 71 is connected to the internal communication ECU 28. Thereby, the internal communication terminal 70 that is another communication apparatus provided to the vehicle 10 is constituted. The internal communication device 71 performs close-range wireless communication with a mobile terminal 9 of an occupant in the vehicle 10, for example. The mobile terminal 9 performs wireless communication with the base station 6 of the wireless communication network 5 in the vicinity. Figure 1 A mobile terminal 9 carried by a pedestrian is illustrated in the figure. The internal communication ECU 28 transmits and receives data between the mobile terminal 9 of the occupant in the vehicle using the close-range wireless communication between the internal communication device 71 and the mobile terminal 9 of the occupant. Note that the mobile terminal 9 is basically capable of performing wireless communication with the base station 6 of the wireless communication network 5 in the vicinity.

[0050] Also, such an in-vehicle communication terminal 70 that communicates with the mobile terminal 9 of the occupant in the vehicle can wirelessly communicate with the mobile terminal 9 based on, for example, the IEEE 802.15.1 or the like. According to the IEEE 802.15.1 or the like, the in-vehicle communication terminal 70 and the mobile terminal 9 can search for a communicable communication device in the surroundings and connect to each other through consistent authentication information. The in-vehicle communication terminal 70 and the mobile terminal 9 can directly connect and pair without using the base station 6. The authentication information can be registered in respective, not-illustrated memories. With respect to subsequent communication between the in-vehicle communication terminal 70 and the mobile terminal 9, the in-vehicle communication ECU 28 automatically authenticates and connects the mobile terminal 9 through the authentication information registered in advance. Thus, the mobile terminal 9 used by the occupant or the like is automatically connected to the in-vehicle communication terminal 70 according to the situation in which the occupant gets into the vehicle 10, and becomes in a state in which communication with the in-vehicle communication terminal 70 is possible.

[0051] The travel control ECU 24 controls the travel of the vehicle 10. For example, the travel control ECU 24 acquires data from the out-vehicle communication ECU 27, the detection ECU 26, the driving operation ECU 25, and the like through the vehicle network 36, and performs control of automatic driving or manual driving assistance with respect to the travel of the vehicle 10. The travel control ECU 24 generates travel control data for controlling the travel of the vehicle 10 based on the acquired data, and outputs the travel control data to the drive ECU 21, the steering ECU 22, and the brake ECU 23. The drive ECU 21, the steering ECU 22, and the brake ECU 23 control the travel of the vehicle 10 based on the input travel control data.

[0052] A plurality of seat belt devices, a plurality of air bag devices, and an occupant protection memory 87 are connected to the occupant protection ECU 30. The seat belt devices include, for example, a driver side seat belt device 81 related to the occupant who drives the vehicle 10, and a passenger side seat belt device 82 related to the occupant who rides in the vehicle 10. The air bag devices include, for example, a driver side front air bag device 83 that deploys in front of the occupant who drives the vehicle 10, a driver side curtain air bag device 84 that deploys on the outside of the occupant who drives the vehicle 10, a passenger side front air bag device 85 that deploys in front of the occupant who rides in the vehicle 10, and a passenger side curtain air bag device 86 that deploys on the outside of the occupant who rides in the vehicle 10. Thus, the occupant protection device 80 is configured.

[0053] Based on information of the prediction of collision with another object or the collision detection result from the detection ECU 26, the occupant protection ECU 30 activates or controls the seat belt device and / or the air bag device.

[0054] The occupant protection memory 87 is a storage medium readable by a computer, and stores programs, set values, and the like executed by the occupant protection ECU 30. Information on the contents of control executed by the occupant protection ECU 30 can be stored in the occupant protection memory 87. The occupant protection ECU 30 reads in the programs from the occupant protection memory 87 and executes them. As a result, the occupant protection ECU 30 can function as an occupant protection control section of the automobile 10.

[0055] For example, in the case of detecting a collision, the occupant protection ECU 30 of the automobile 10 as the occupant protection control section executes occupant protection processing and collects emergency information and the like of the automobile 10 and transmits it. The occupant protection ECU 30 uses the external communication terminal 60, and transmits the collected emergency information and the like of the accident to the server device 2 via the base station 6, the communication network 7, and in real time.

[0056] Figure 3 is a diagram of the server device 2 used by the call center of Figure 1

[0057] Figure 3 The server device 2 of has a server communication device 91, a server memory 92, a server CPU 93, a server GNSS receiver 94, a server monitor 95, a server talk device 96, and a server bus 97 connecting them.

[0058] The server communication device 91 is connected to the communication network 7 of the wireless communication network 5. The server communication device 91 transmits and receives data between other devices, for example, the external communication terminal 60 as the wireless terminal of the automobile 10, the client terminal 3, via the wireless communication network 5.

[0059] The server GNSS receiver 94 receives the electric wave of the GNSS satellite 110 to obtain the current time. The server device 2 can be provided with an unillustrated server timer that is corrected according to the current time of the server GNSS receiver 94.

[0060] The server monitor 95 displays information of the server device 2. The server monitor 95 displays, for example, the emergency information received by the server device 2 from the automobile 10 that has encountered an accident or the like.

[0061] The server talk device 96 is used by the staff of the call center in order to talk with the user of the mobile terminal 9 that is being connected using the server communication device 91 by the staff of the call center.

[0062] ​The server memory 92 is a storage medium readable by a computer, and stores programs, setting values, and the like executed by the server CPU 93. Information of control contents executed by the server CPU 93 can be stored in the server memory 92. The server CPU 93 reads programs from the server memory 92 and executes them. Thus, the server control section is implemented in the server device 2. The server CPU 93 as the server control section manages the overall operation of the server device 2.

[0063] For example, if the server communication equipment 91 receives the emergency information transmitted from each vehicle 10 that has encountered an accident in real time, the server CPU 93 of the server device 2 of the call center displays the received emergency information on the server monitor 95. The staff of the call center judges the situation of the accident based on the emergency information of each vehicle 10 being displayed and inputs a dispatch request corresponding to the situation of the accident. The server CPU 93 transmits the dispatch request to the client terminal 3 using the server communication equipment 91.

[0064] Figure 4 is a diagram of the client terminal 3 used by the action team of Figure 1

[0065] Figure 4 The client terminal 3 of the present embodiment has a client communication equipment 101, a client memory 102, a client CPU 103, a client notification equipment 104, a client GNSS receiver 105, a client monitor 106, a client call equipment 107, and a client bus 108 connecting them.

[0066] The client communication equipment 101 is connected to the communication network 7 of the wireless communication network 5. The client communication equipment 101 transmits and receives data between other devices, such as the external communication equipment 61 as the wireless terminal of the vehicle 10, and the server device 2 through the wireless communication network 5.

[0067] The client GNSS receiver 105 receives the electric wave of the GNSS satellite 110 to obtain the current time. The client terminal 3 can be provided with a not-illustrated client timer that is corrected according to the current time of the client GNSS receiver 105.

[0068] The client monitor 106 displays information of the client terminal 3. The client monitor 106 displays, for example, the dispatch request received from the server device 2 and the like.

[0069] The client notification equipment 104 outputs the dispatch request sound to the team member of the action team.

[0070] The team member of the action team uses the client call equipment 107 in order to make a call between the user of the mobile terminal 9 that the team member of the action team is connecting using the client communication equipment 101.​

[0071] The client memory 102 is a storage medium readable by a computer, and stores programs, setting values, and the like executed by the client CPU 103. In the client memory 102, information of control contents executed by the client CPU 103 can be stored. The client CPU 103 reads a program from the client memory 102 and executes it. Thereby, the client control section is realized in the client terminal 3. The client CPU 103 as the client control section manages the overall operation of the client terminal 3.

[0072] For example, if the client communication device 101 receives a dispatch request, the client CPU 103 of the client terminal 3 of the rescue action team notifies the dispatch request by the client notification device 104. Thereby, the rescue action team causes the ambulance 11 and / or the rescue helicopter to urgently go to the accident site based on the dispatch request. The action team can dispatch to the accident site in a state where the situation of the accident of each vehicle 10 is grasped. The action team can immediately provide appropriate rescue treatment to the person involved in the accident in a short preparation time.

[0073] Figure 5 is a sequence diagram showing an example of a flow of a series of processes from the emergency notification of the vehicle 10 that has encountered an accident until the emergency dispatch of the emergency ambulance 11 of the emergency notification system 1. Figure 1

[0074] In Figure 5 A control system 20 of the automatic notification device 4 of the vehicle 10, a server device 2 of a call center, a client terminal 3 of an action team, a mobile terminal 9 of a pedestrian who has not encountered an accident, and an SNS server 12 are shown. The time elapses from top to bottom.

[0075] In step ST21, the detection ECU 26 of the control system 20 of the vehicle 10 detects a collision of the vehicle 10. In a case where the magnitude of acceleration detected by, for example, the three-axis acceleration sensor 52 is greater than a predetermined threshold value, the detection ECU 26 detects a collision. In a case where a collision is not detected, the detection ECU 26 repeats the present process. If a collision is detected, the detection ECU 26 transmits collision detection information to the occupant protection ECU 30, and advances the process to step ST4. It should be noted that in a case where the present process is started and a collision is not detected after a certain time elapses, the detection ECU 26 can end the present process.

[0076] ​It should be noted that the detection ECU 26 can predict that the collision is unavoidable before detecting the collision. In addition, the occupant protection ECU 30 can perform a preliminary process for occupant protection before detecting the collision based on the prediction that the collision is unavoidable. As the preliminary process, for example, the occupant protection ECU 30 can wind a redundancy of a safety belt of a safety belt device to make the safety belt a pre-tensioned state, or can perform other processes. For example, the occupant protection ECU 30 can perform a pre-deployment of an airbag device, or the like.

[0077] In step ST22, the occupant protection ECU 30 of the automobile 10 that has detected the collision performs a protection process for the occupant based on the information that the detection ECU 26 has detected the collision. The occupant protection ECU 30 selects a safety belt device and an airbag device to be operated. The occupant protection ECU 30 selects only a safety belt device of a seat on which the occupant is seated and an airbag device that deploys in a direction in which the upper body of the occupant falls due to the collision. The occupant protection ECU 30 winds a redundancy of a safety belt of the selected safety belt device to make the safety belt a pre-tensioned state. The occupant protection ECU 30 selects an airbag device that can deploy in a direction in which the upper body of the occupant falls due to the collision based on the input direction and the magnitude of the detected collision.

[0078] It should be noted that in the present embodiment, although the occupant protection ECU 30 performs the occupant protection control after detecting the collision in step ST21, the occupant protection ECU 30 can perform the occupant protection control in a stage of collision prediction before detecting the collision.

[0079] In step ST23, the occupant protection ECU 30 of the automobile 10 that has performed the protection control for the occupant collects emergency information of the accident. The emergency information of the accident can be substantially information collected by the AACN described above. The AACN collects emergency information such as an operating state, a position of the occupant protection device 80 at the time of the accident, an input direction and a strength of an impact in the accident, and the like.

[0080] In step ST24, the occupant protection ECU 30 of the automobile 10 performs automatic notification.

[0081] In step ST25, the server communication device 91 of the server device 2 of the call center receives the information of the automatic notification from the automobile 10 that has encountered the accident. The information of the automatic notification received by the server communication device 91 of the server device 2 of the call center can be stored in the server storage 92. The server communication device 91 of the server device 2 of the call center can also receive the information of the automatic notification from other automobiles that have encountered the same accident before and after step ST25.

[0082] In step ST26, the server CPU 93 of the server device 2 of the call center displays the emergency information of the accident, which is automatically reported, received by the server communication device 91, on the server monitor 95. The staff of the call center can confirm the situation of the accident of the vehicle 10 based on the emergency information of the accident displayed by the server monitor 95.

[0083] In step ST27, the server CPU 93 of the server device 2 of the call center communicates with the external communication ECU 27 of the vehicle 10 that has encountered the accident. In step ST28, the occupant protection ECU 30 of the vehicle 10 answers the voice call. Thus, a call line through which the call can be made is established between the server call device 96 and, for example, the microphone 55 of the vehicle 10. The staff of the call center confirms whether the occupant is safe and the health state by voice. Thus, it is possible to directly confirm the state such as the degree of injury of the occupant seated in the vehicle 10 that has encountered the accident. The staff of the call center can input the result of the confirmation to the server device 2.

[0084] In step ST29, the server CPU 93 of the server device 2 of the call center estimates the situation. The server CPU 93 can estimate the situation based on the information automatically reported received by the server communication device 91, the result of the collation judgment of the accident, and the input information of the staff of the call center. The server CPU 93 can estimate the situation by the processing of artificial intelligence by collating the emergency information of the past accident. In addition, the staff of the call center can comprehensively consider the situation to estimate the situation, and input the result of the estimation to the server device 2.

[0085] In step ST30, the server CPU 93 of the server device 2 of the call center arranges the dispatch. The server CPU 93 transmits a dispatch request to the client terminal 3 of the action force using the server communication device 91. The server CPU 93 can also transmit the dispatch request based on the operation of the staff of the call center.

[0086] In step ST31, the client communication device 101 of the client terminal 3 of the action force receives the dispatch request from the server device 2. The dispatch request received by the client communication device 101 can be stored in the client storage 102.

[0087] In step ST32, the client CPU 103 of the client terminal 3 of the action force notifies the dispatch. The client CPU 103 outputs a dispatch request sound from the client notification device 104 based on the fact that the dispatch request is received by the client communication device 101. In addition, the client CPU 103 can display a screen of the dispatch request on the client monitor 106. On the screen of the dispatch request, the information automatically reported and the input information of the staff of the call center can be displayed.

[0088] In step ST33, the crew of the action team is dispatched. The crew of the action team can grasp that a dispatch request has been made to the team based on the dispatch request sound and the dispatch request screen and dispatch the rescue helicopter and / or the ambulance 11 in an emergency.

[0089] Thus, the action team of the rescue helicopter and / or the ambulance can be dispatched without delay in the minimum required preparation time based on the emergency information of the accident automatically reported from the vehicle 10 that has encountered the accident. The action team of the rescue helicopter and / or the ambulance can be dispatched in an emergency in a state in which appropriate preparation has been made based on the emergency information of the accident obtained in advance. The possibility of saving a person in an accident is improved.

[0090] However, the vehicle 10 that is traveling on a road sometimes collides with a moving body other than another vehicle, such as a pedestrian and / or a person on a bicycle, and the like. In this case, although the vehicle 10 that has encountered the accident can transmit the above-described emergency information of the accident to the server device 2, the pedestrian and the like can not be able to transmit the emergency information of the accident to the server device 2. In particular, in a case in which the consciousness of the pedestrian who has encountered the accident is in a daze, it is difficult for the pedestrian to operate the mobile terminal 9 that is carried. As a result, information related to the accident can be insufficient in the server device 2, and it can be impossible to correctly grasp the situation of the accident.

[0091] In addition to this, for example, in a case in which an accident involving a plurality of vehicles 10 and a plurality of pedestrians has occurred, it can be impossible to grasp which vehicle 10 with which the pedestrian who has encountered the accident has collided. Depending on the manner of collision with the vehicle 10, the degree of injury of the pedestrian and the like is greatly different. The vehicle 10 that has encountered the accident can include information that can infer the degree of injury of the pedestrian and / or the person on a bicycle who has collided, such as the position, the direction, the degree of impact, and an image of the pedestrian and / or the person on a bicycle who has collided, in the emergency information. However, if it is not possible to associate a plurality of pedestrians with which vehicle 10 among a plurality of vehicles 10 has collided, it is difficult to determine which pedestrian the emergency information corresponds to when the emergency information is actually used, or it can take time to determine which pedestrian the emergency information corresponds to. For example, in a case in which an accident involving a plurality of vehicles 10 and a plurality of pedestrians has occurred, if it is a clear day, if an image captured by the vehicle 10 is included in the emergency information, it can be relatively easy to determine the pedestrian who has actually collided with the vehicle 10 based on the body shape and / or the gender, the features of the clothing, and the like of the pedestrian. On the other hand, if it is a rainy night, the features of the pedestrian can not be clearly captured in the image captured by the vehicle 10. It can be difficult to determine which pedestrian has collided with the vehicle 10 that has transmitted the emergency information.

[0092] As a result, the action team dispatched based on the request of the call center can also be unable to apply sufficient first-aid measures to the person who has encountered the accident.

[0093] In this way, it is hoped that the emergency notification system 1 can provide a more accurate understanding of the accident situation.

[0094] Therefore, in Figure 5 In the emergency notification system 1, after receiving the automatically reported information from the vehicle 10 that has been involved in an accident in step ST25, the server device 2 extracts and sets search conditions based on the received information in step ST43, and uses the set conditions to search for surrounding information on the network in step ST44. For example, such as Figure 1 As shown in the emergency notification system 1, other pedestrians near the accident scene use their mobile terminals 9 to take pictures of the accident scene in step ST41 and upload them to the SNS in step ST42. The mobile terminal 9 sends the captured image data to the SNS server 12 connected to the communication network 7 via the base station 6 and communication network 7 of the wireless communication network 5. The captured image data of the accident scene is registered in the SNS server 12, which is used for cloud services. The captured image data typically includes information related to the shooting location, shooting time, etc., as tag data. Furthermore, the captured images of the accident scene are highly likely to include the subject of the accident, i.e., the car 10, and the other party in the accident, i.e., the pedestrian. By obtaining such captured image data of the accident scene, the server device 2 can potentially provide call center staff with information lacking in the emergency information from the car 10. This will be explained in detail below.

[0095] Figure 6 yes Figure 1 The flowchart of the association processing of peripheral information about the accident in server device 2. Figure 6 Corresponding to Figure 5 The processing from step ST25 to step ST26.

[0096] If a collision caused by an accident involving this vehicle is detected, vehicle 10 sends emergency information related to the accident to server device 2 of emergency notification system 1. If new emergency information is received from vehicle 10, server CPU 93 of server device 2 executes... Figure 6 Association processing.

[0097] In step ST25, the server CPU 93 determines whether or not the emergency information of the accident has been newly received from the vehicle 10 that has encountered the accident. The emergency information of the accident can include, for example, the position of the accident site, the time of the occurrence of the accident, the passenger protection information in the vehicle 10, the input position of the impact of the accident, the input direction, the size, and the like, which are the accident-time information of the AACN standard. In addition to these, the emergency information of the accident can include the vehicle attributes of the own vehicle, such as the vehicle type and the color, the additional information such as the captured images inside and outside obtained by the own vehicle, and the detection values of the sensors of the own vehicle. In a case where the emergency information of the accident has not been newly received, the server CPU 93 repeats the present processing. If the emergency information of the accident has been newly received, the server CPU 93 advances the processing to step ST43.

[0098] In step ST43, the server CPU 93 sets the search conditions for searching the cloud service such as the SNS based on the acquired emergency information of the accident. The server CPU 93 can set, for example, a search area including the position of the accident site and a search time period including the time of the occurrence of the accident as the search conditions.

[0099] In step ST3, the server CPU 93 starts the processing of step ST44 and searches the cloud service using the set search conditions. In the SNS server 12 of the cloud service, the accident- surrounding information such as the image data captured at the accident site can be uploaded from the surrounding terminals such as the mobile terminal 9 of the pedestrian in the periphery of the accident site. Using the set search conditions, the server CPU 93 searches for and acquires the accident-surrounding information of such surrounding terminals. Here, the surrounding terminal is a device other than the vehicle 10 that has encountered the accident, and can be another vehicle.

[0100] In step ST4, the server CPU 93 determines whether or not the accident-surrounding information such as the image data of the accident site has been acquired. In a case where the accident-surrounding information has not been acquired, the server CPU 93 returns the processing to step ST3 and continues the search of the cloud service. Thus, the server device 2 can acquire the accident-surrounding information uploaded to the cloud service after the time of receiving the emergency information of the accident. If the accident-surrounding information has been acquired, the server CPU 93 advances the processing to step ST5.

[0101] In step ST5, the server CPU 93 collates the acquired accident site image data and the like as the accident surrounding information with the emergency information of the accident from the automobile 10 acquired in step ST25. For example, the server CPU 93 extracts an image portion of the automobile 10 from an image of the image data as the accident surrounding information, and collates the extracted image portion of the automobile 10 with attribute information of the automobile 10 involved in the accident, such as the vehicle type and color, included in the emergency information. In addition to this, for example, the server CPU 93 can also collate an image portion of the automobile 10 included in the image of the image data as the accident surrounding information with an image portion of the own vehicle in the image of the automobile 10 involved in the accident included in the emergency information. In addition, the server CPU 93 can also collate an image portion of a pedestrian or the like included in the image of the image data as the accident surrounding information with an image portion of the pedestrian or the like in the image of the automobile 10 involved in the accident included in the emergency information. Further, the server CPU 93 can also recheck whether the accident surrounding information is the accident surrounding information of the position of the accident site, and whether the accident surrounding information is the accident surrounding information of the time of occurrence.

[0102] In step ST6, the server CPU 93 determines whether the collated accident surrounding information is consistent with the emergency information of the accident from the automobile 10 acquired in step ST25. For example, in a case where all of the collation elements of the vehicle type, color, and the like of the automobile 10 in the above-described collation determination are consistent, the server CPU 93 determines that the accident surrounding information is consistent with the emergency information, and advances the processing to step ST7. In a case where any of the collation elements is not consistent, the server CPU 93 determines that the accident surrounding information is not consistent with the emergency information, and skips step ST7, advancing the processing to step ST8.

[0103] In step ST7, the server CPU 93 generates association information that associates the consistent accident surrounding information with the emergency information of the accident from the automobile 10 acquired in step ST25. The association information can correspond the address such as the URL in the SNS server 12 with respect to the consistent accident surrounding information to the management ID attached to the emergency information. Thus, the server device 2 generates the association information that can be used in the server device 2 by itself. The association information is stored in the server storage 92 in association with the emergency information of the accident.

[0104] In step ST8, the server CPU 93 determines whether to continue the search of the cloud service. The search of the cloud service takes time. The server CPU 93 can also search a plurality of cloud services. On the other hand, the server apparatus 2 needs to provide the staff of the call center with the emergency information and the like as early as possible. In a case where the elapsed time after the reception of the emergency information does not exceed a predetermined threshold, the server CPU 93 determines to continue the search of the cloud service, and returns the process to step ST3. Thereby, the server CPU 93 performs the following search of the accident surrounding information. If the elapsed time after the reception of the emergency information exceeds the predetermined threshold, the server CPU 93 ends the search of the cloud service as the process of step ST44, and advances the process to step ST9.

[0105] In step ST9, the server CPU 93 starts the process of step ST26, reads the emergency information from the server storage 92, and displays the emergency information on the server monitor 95. The server monitor 95 displays a screen of, for example, the AACN standard. The screen of the AACN standard displays the location of the accident site, the time of the occurrence of the accident, the occupant protection information in the automobile 10, the input part of the impact of the accident, the input direction, and the size. In addition, a selection button and the like with respect to the associated information obtained by the cloud search can also be displayed in the screen of the AACN standard.

[0106] In step ST10, the server CPU 93 determines whether the associated information is selected. The server CPU 93 can determine whether the associated information is selected based on whether the selection button of the associated information displayed in the screen of the AACN standard is operated by the staff of the call center. In a case where the associated information is not selected, the server CPU 93 returns the process to step ST9, and continues the display of the screen of the AACN standard. If the associated information is selected, the server CPU 93 advances the process to step ST11.

[0107] In step ST11, the server CPU 93 acquires the accident surrounding information such as the image data of the accident site from the SNS server 12 and the like based on the selected associated information, and displays it on the server monitor 95. The server CPU 93 outputs the accident surrounding information using the associated information generated by itself in the server apparatus 2 in association with the emergency information transmitted to the server apparatus 2 by the automobile 10 that encountered the accident. Thereby, the server CPU 93 ends the process of step ST44.

[0108] Figure 7 is Figure 6 An explanatory diagram of the collation determination in the associated process of the server apparatus 2 with respect to the image generated by the surrounding terminal as the accident surrounding information.

[0109] Figure 7 (A) is an image taken by the mobile terminal 9 of the running car 10 at a location far from the accident site. In this case, the image as the accident surrounding information has the photographing location and photographing time different from the accident site. Therefore, the server CPU 93 determines in step ST3 or step ST6 that the location and time of the image as the accident surrounding information do not coincide with the location and time at the accident site included in the emergency information acquired from the car 10 that encountered the accident.

[0110] Figure 7 (B) is an image taken by the mobile terminal 9 of the car 10 that encountered the accident and the pedestrian in the vicinity of the accident site. In this case, the image as the accident surrounding information has the photographing location and photographing time substantially the same as the accident site. Therefore, the server CPU 93 determines in step ST3 or step ST6 that the location and time of the image as the accident surrounding information coincide with the location and time at the accident site included in the emergency information acquired from the car 10 that encountered the accident.

[0111] In this case, the server CPU 93 determines that the image of (B) coincides only with respect to the image of (A) and the image of (B) of the images uploaded to the SNS server 12. Figure 7 Figure 7 In this case, the server CPU 93 determines that the image of (B) coincides only with respect to the image of (A) and the image of (B) of the images uploaded to the SNS server 12. Figure 7 Figure 7 In this case, the server CPU 93 determines that the image of (B) coincides only with respect to the image of (A) and the image of (B) of the images uploaded to the SNS server 12. Figure 7 Figure 7 In this case, the server CPU 93 determines that the image of (B) coincides only with respect to the image of (A) and the image of (B) of the images uploaded to the SNS server 12.

[0112] ​​​As described above, in the present embodiment, the accident peripheral information association device is provided in the server device 2 of the emergency reporting system 1 capable of transmitting the emergency information related to the accident from the vehicle 10 that has encountered the accident to the server device 2. The accident peripheral information association device acquires the accident peripheral information, collates the accident peripheral information with the emergency information of the vehicle 10 that has encountered the accident, and judges whether the accident peripheral information is information on the accident of the vehicle 10, the accident peripheral information being, for example, a photographed image of the accident site and the like transmitted from a peripheral terminal other than the vehicle 10 that has encountered the accident to the cloud service such as the SNS server 12. Also, the association information is generated in a manner that can be used in the server device 2, the association information associating the accident peripheral information of the peripheral terminal judged to be information on the accident of the vehicle 10 with the emergency information transmitted from the vehicle 10 to the server device 2. Thereby, in the server device 2 and the like, in addition to being able to use the emergency information related to the accident from the vehicle 10 that has encountered the accident, it is also possible to use the accident peripheral information transmitted from the peripheral terminal other than the vehicle 10 that has encountered the accident to the cloud service such as the SNS server 12 based on the association information. For a situation that cannot be fully grasped by relying only on the emergency information from the vehicle 10 that has encountered the accident, the staff of the call center and the like can grasp the situation based on the accident peripheral information. The staff of the call center and the like can judge the situation at the accident site in detail and more accurately based on the rich information supplemented by the accident peripheral information, and thereby cause the required emergency crew to urgently go to the site. For the emergency crew, it is also possible to grasp not only the situation of the occupant but also the situation of a pedestrian and the like based on the rich information supplemented by the accident peripheral information, and thereby urgently go to the site in a situation that can be coped with.

[0113] For example, it is expected that, in a case where a pedestrian and / or a cyclist is involved in the accident of the vehicle 10, the pedestrian and / or the cyclist involved in the accident is grasped based on the accident peripheral information associated by the association information.

[0114] In addition to this, for example, it is also expected that, even if an accident involving a plurality of vehicles 10 and a plurality of pedestrians occurs, it is possible to appropriately grasp the correspondence relationship of each pedestrian and which vehicle 10 collided based on the accident peripheral information associated by the association information.

[0115] Based on the image at the time of the accident included in the emergency information of one of the plurality of vehicles 10, information on where the pedestrian colliding with the vehicle 10 is thrown is acquired.

[0116] For example, in matching the accident surrounding information of the photographed image of the accident site with the emergency information of the car 10 that encountered the accident, the surrounding information associating device matches the direction in which the pedestrian was thrown by the collision with the emergency information, based on the image of the accident surrounding information in which both the car 10 and the pedestrian thrown by the collision are photographed. If the accident surrounding information is consistent with the emergency information, the surrounding information associating device associates the pedestrian of the accident surrounding information with the object that contacted the car 10 with the emergency information.

[0117] Even if the accident surrounding information is the image in which only the pedestrian thrown by the collision is photographed, if the information of the position and the photographing direction of the photographer can be acquired, the pedestrian of the accident surrounding information can be associated with the object that contacted the car 10 with the emergency information by estimating the position of the pedestrian and the relative positional relationship between the position of the pedestrian and the position of the car 10 included in the emergency information.

[0118] Thus, even in the case where the accident involves a plurality of cars 10 and a plurality of pedestrians, and the car 10 contacted which pedestrian cannot be determined using only the emergency information, the surrounding information associating device can associate the pedestrian with the emergency information, so the emergency information can be effectively used for the rescue of the pedestrian.

[0119] Figure 8 is an explanatory view of an example of a state in which an accident involving a plurality of cars and a plurality of pedestrians occurs.

[0120] In Figure 8 , the first car 10A and the second car 10B that are traveling in opposite directions on the road move to the left and right shoulders, respectively, after colliding with each other, and stop. The first car 10A collides with the first pedestrian 120A on one side shoulder. The second car 10B collides with the second pedestrian 120B on the other side shoulder.

[0121] In the case where information about such an accident is acquired, the surrounding information associating device can determine only that an accident involving a plurality of cars 10A, 10B and a plurality of pedestrians 120A, 120B occurred, based on the acquired information.

[0122] Further, in this accident, the surrounding information association device can determine or can attempt to determine that the first vehicle 10A collided with the first pedestrian 120A and that the second vehicle 10B collided with the second pedestrian 120B. The surrounding information association device can determine that the first vehicle 10A and the first pedestrian 120A correspond to the accident based on, for example, an image in which both the first vehicle 10A and the first pedestrian 120A are captured. The surrounding information association device can also determine that the second vehicle 10B and the second pedestrian 120B correspond to the accident based on, for example, an image in which both the second vehicle 10B and the second pedestrian 120B are captured. In a case where either of these conditions can be determined, the surrounding information association device can estimate the degree of collision with the first pedestrian 120A, the degree of injury, and the like based on information of the acceleration of the first vehicle 10A in the accident, and can estimate the degree of collision with the second pedestrian 120B, the degree of injury, and the like based on information of the acceleration of the second vehicle 10B in the accident. By obtaining information obtained by analyzing such an accident, the action team can urgently go to the accident site with equipment and / or a scale corresponding to the conditions of the accident.

[0123] (Second Embodiment)

[0124] Next, an emergency notification system 1 of a second embodiment of the present application will be described. In the following description, mainly the points different from the above-described embodiment will be described. For the same constituent elements as those of the above-described embodiment, the same symbols as those of the above-described embodiment will be used and the description thereof will be omitted.

[0125] Figure 9 is a flowchart of the generation processing of the accident information in the vehicle 10 performed by the control system 20 of the vehicle 10 of the second embodiment of the present application.

[0126] If the collision caused by the accident of the host vehicle is detected, the control system 20 of the vehicle 10 performs the generation processing of the accident information. Figure 9

[0127] In step ST21, the detection ECU 26 determines whether or not the collision is detected. For example, in a case where the magnitude of the acceleration detected by the three-axis acceleration sensor 52 is greater than a predetermined threshold value, the detection ECU 26 detects the collision. In a case where the collision is not detected, the detection ECU 26 repeats the processing. If the collision is detected, the detection ECU 26 transmits the collision detection information to the occupant protection ECU 30 and advances the processing to step ST22. It should be noted that in a case where the processing is started and the collision is not detected after a certain time elapses, the detection ECU 26 can end the processing.

[0128] ​In step ST22, the occupant protection ECU 30 executes occupant protection processing based on the collision detection information of the detection ECU 26. The occupant protection ECU 30 selects and operates the seat belt device and the airbag device to be operated based on the size, direction, input position of the impact, and the occupant position of the occupant. Thereby, the occupant can be protected from the impact.

[0129] It should be noted that, in the present embodiment, although the occupant protection control is executed after the collision is detected in step ST21, the occupant protection control can be implemented at the stage of the pre-control of step ST21 after the collision is predicted. The occupant protection control can also be implemented at the stage of the collision prediction before the collision is detected.

[0130] In step ST23, the occupant protection ECU 30 collects accident information. The occupant protection ECU 30 acquires, in addition to the accident time information such as the position of the host vehicle, the captured image data outside the vehicle generated by the stereo camera 53.

[0131] In step ST54, the occupant protection ECU 30 or the detection ECU 26 generates information on the position or the position change of the host vehicle. The occupant protection ECU 30 or the detection ECU 26 generates the position of the host vehicle or the direction and amount of change of the position of the host vehicle in a predetermined period from before the accident to after the accident based on the position of the GNSS receiver 56 and / or the detection value of the three-axis acceleration sensor 52. Here, the information on the position or the position change of the host vehicle can be information based on absolute values formed by the latitude, longitude, and the like, or information based on values obtained with reference to the position of the host vehicle before the accident.

[0132] In step ST55, the occupant protection ECU 30 or the detection ECU 26 generates information on the position or the position change of the other party that has encountered the accident with the host vehicle. The occupant protection ECU 30 or the detection ECU 26 generates the position of the other party or the direction and amount of change of the position of the other party in a predetermined period from before the accident to after the accident based on the captured image of the stereo camera 53. The position and the position change of the other party can be an amount based on absolute values formed by the latitude, longitude, and the like determined from the captured image of the stereo camera 53, or a relative value obtained with reference to the position or the position change of the host vehicle.

[0133] In step ST24, the external communication ECU 27 transmits the emergency information collected or generated through the above-described processing to the server device 2 of the emergency notification system 1. The emergency information in this case includes the accident time information of the AACN standard, the captured image data of the outside of the vehicle generated by the stereo camera 53, the information of the position or the position change of the own vehicle, and the information of the position or the position change of the partner.

[0134] If new emergency information is received from the automobile 10, the server CPU 93 of the server device 2 performs the association processing of Figure 6 as the processing from step ST25 to step ST26 of Figure 5 .

[0135] Also, as for the collation processing of step ST5 and the coincidence determination of step ST6 of Figure 6 , the server CPU 93 collates the position or the position change of the automobile 10 or the partner in the accident surrounding information of the surrounding terminal with the information of the position or the position change of the own vehicle and the partner that encountered the accident included in the emergency information and determines coincidence. In a case where the position or the position change of the automobile 10 or the partner in the acquired accident surrounding information of the surrounding terminal coincides with the information of the position or the position change of the own vehicle and the partner that encountered the accident acquired from the automobile 10 that encountered the accident, the server CPU 93 determines that the accident surrounding information is information about the accident of the automobile 10. In a case where they do not coincide, the server CPU 93 does not determine that the accident surrounding information is information about the accident of the automobile 10. In this case, it is possible to compare the information of the automobile 10 with each other, to compare the information of the pedestrian with each other, and to compare the information of the automobile 10 with the information of the pedestrian. Even in a case where the information of the automobile 10 and the information of the pedestrian are compared, since the position of the pedestrian changes in the direction of the position change of the automobile 10, it is considered that the information of the automobile 10 and the information of the pedestrian have a certain correlation with each other.

[0136] Figure 10 is an explanatory view of the collation determination of the image as the accident surrounding information generated by the surrounding terminal in a case where the accident information of Figure 6 is used in the association processing of the server device 2 of Figure 9 .

[0137] Figure 10(A) is an image taken by the mobile terminal 9 with the car 10 involved in the accident and the pedestrian in the vicinity of the accident site. The image as the accident surrounding information in this case is attached with the photographing position and the photographing time substantially the same as the accident site. Therefore, the server CPU 93 determines in step ST3 or step ST6 that the position and the time of the image as the accident surrounding information coincide with the position and the time at the accident site included in the emergency information acquired from the car 10 involved in the accident. In addition, in the image as the accident surrounding information, the pedestrian involved in the accident is lying down at a position to the left front of the car 10 involved in the accident. The server CPU 93 determines that the image in (A) is the image data of the accident surrounding information and generates the correlation information with reference to the position of the car 10 involved in the accident in the image in (A). Figure 10 the position of the pedestrian involved in the accident included in the emergency information acquired from the car 10 involved in the accident. Also, since they do not coincide in the image in (A), the server CPU 93 determines that the image in (A) is not the image data of the accident surrounding information with reference to the position of the pedestrian involved in the accident in the image in (A). Figure 10 the position of the pedestrian involved in the accident included in the emergency information acquired from the car 10 involved in the accident. Also, since they do not coincide in the image in (A), the server CPU 93 determines that the image in (A) is not the image data of the accident surrounding information with reference to the position of the pedestrian involved in the accident in the image in (A). Figure 10 the position of the pedestrian involved in the accident included in the emergency information acquired from the car 10 involved in the accident. Also, since they do not coincide in the image in (A), the server CPU 93 determines that the image in (A) is not the image data of the accident surrounding information with reference to the position of the pedestrian involved in the accident in the image in (A).

[0138] Figure 10 (B) is an image taken by the mobile terminal 9 with the car 10 involved in the accident and the pedestrian not involved in the accident in the vicinity of the accident site. The image as the accident surrounding information in this case is attached with the photographing position and the photographing time substantially the same as the accident site. Therefore, the server CPU 93 determines in step ST3 or step ST6 that the position and the time of the image as the accident surrounding information coincide with the position and the time at the accident site included in the emergency information acquired from the car 10 involved in the accident. In addition, in the image as the accident surrounding information, the pedestrian not involved in the accident stands at a position to the right front of the car 10 involved in the accident. The server CPU 93 determines that the image in (B) is the image data of the accident surrounding information and generates the correlation information with reference to the position of the car 10 involved in the accident in the image in (B). Figure 10 the position of the pedestrian involved in the accident included in the emergency information acquired from the car 10 involved in the accident. Also, since they do not coincide in the image in (A), the server CPU 93 determines that the image in (A) is not the image data of the accident surrounding information with reference to the position of the pedestrian involved in the accident in the image in (A). Figure 10 the position of the pedestrian involved in the accident included in the emergency information acquired from the car 10 involved in the accident. Also, since they do not coincide in the image in (A), the server CPU 93 determines that the image in (A) is not the image data of the accident surrounding information with reference to the position of the pedestrian involved in the accident in the image in (A). Figure 10 the position of the pedestrian involved in the accident included in the emergency information acquired from the car 10 involved in the accident. Also, since they do not coincide in the image in (A), the server CPU 93 determines that the image in (A) is not the image data of the accident surrounding information with reference to the position of the pedestrian involved in the accident in the image in (A). Figure 10 the position of the pedestrian involved in the accident included in the emergency information acquired from the car 10 involved in the accident. Also, since they do not coincide in the image in (A), the server CPU 93 determines that the image in (A) is not the image data of the accident surrounding information with reference to the position of the pedestrian involved in the accident in the image in (A).

[0139] Thus, the server CPU 93 collates the position or the position change of the host vehicle or the pedestrian of the other party in the image acquired from the SNS server 12 of the cloud service with the information of the position or the position change of the host vehicle or the pedestrian of the other party at the accident site acquired from the vehicle 10 that has experienced the accident and makes a judgment. The server CPU 93 can make a collation judgment without performing the process of acquiring the information of the position or the position change of the host vehicle or the pedestrian of the other party in the dark image generated by the vehicle 10 that has experienced the accident in which the headlamp or the like can be damaged, on the basis of the dark image taken outside the vehicle. In the dark image, it can not be easy to extract the color and / or the shape of the vehicle 10 and / or the pedestrian in the image clearly.

[0140] As described above, in the present embodiment, the vehicle 10 generates the information of the position of the host vehicle or the other party before and after the accident or the information of the position change and transmits it to the server device 2. Also, in the server device 2, on the basis of the mutual relationship between the position or the position change of the vehicle 10 or the other party in the accident surrounding information of the surrounding terminal acquired by the acquisition section and the information of the position or the position change acquired from the vehicle 10 that has experienced the accident, it is judged whether the accident surrounding information of the surrounding terminal acquired by the acquisition section is information on the accident of the vehicle 10. Thus, in the server device 2, it is possible to reduce the processing load. In addition, the server device 2 can judge whether the acquired accident surrounding information of the surrounding terminal is appropriate with high accuracy on the basis of the information of the position or the position change collected with high accuracy at each accident site. It is possible to reduce the processing load related to the server device 2 and to improve the selection accuracy related to the accident surrounding information.

[0141] Also, with respect to the dark image taken outside the vehicle generated by the vehicle 10 that has experienced the accident at a dark place such as at night or in a tunnel, the server device 2 can make a collation judgment with respect to the image of the surrounding terminal as the accident surrounding information without extracting the position of the vehicle 10 and the pedestrian. With respect to the image generated by the surrounding terminal, since the surrounding terminal itself is not malfunctioning, even in the image taken at a dark place such as at night or in a tunnel, the possibility that the subject is brightly taken using a flash is high. In the image in which the subject is bright, it is easy to perform the extraction process of the position of the vehicle 10 and the pedestrian.

[0142] In addition, as with the above-described embodiment, as shown in FIG. 17, in a state in which an accident involving a plurality of vehicles 10 and a plurality of pedestrians has occurred, the server device 2 can judge that the first vehicle 10A collides with the first pedestrian 120A and that the second vehicle 10B collides with the second pedestrian 120B. Figure 8

[0143] (Third Embodiment)

[0144] ​Next, an emergency reporting system 1 of a third embodiment of the present application will be described. In the above-described embodiment, the server device 2 performs the association processing of the surrounding information on the accident. In the present embodiment, the association processing of the surrounding information on the accident is performed in the automobile 10. In the following description, mainly the points different from the above-described embodiment will be described. For the same constituent elements as those of the above-described embodiment, the same symbols as those of the above-described embodiment are used and the description thereof will be omitted.

[0145] Figure 11 is a flowchart of the association processing of the surrounding information on the accident performed by the control system 20 of the automobile 10 of the third embodiment of the present application.

[0146] If the collision caused by the accident of the own vehicle is detected, the occupant protection ECU 30 and the like of the control system 20 of the automobile 10 performs the association processing of the surrounding information on the accident of Figure 11

[0147] In step ST21, the detection ECU 26 determines whether or not the collision caused by the accident of the own vehicle is detected. For example, the three-axis acceleration sensor 52 can detect the acceleration of the impact of the size that is not likely to occur in the usual running. In the case where it is determined based on the detection value of the three-axis acceleration sensor 52 that the collision caused by the accident is not detected, the detection ECU 26 repeats the present processing. If it is determined that the collision caused by the accident of the own vehicle is detected, the detection ECU 26 passes the collision detection information to the occupant protection ECU 30 and advances the processing to step ST22.

[0148] In step ST22, the occupant protection ECU 30 performs the occupant protection processing based on the collision detection information. The occupant protection ECU 30 selects the seat belt device and the airbag device to be operated based on the size, the direction, the input position of the impact, and the occupant position of the occupant and causes them to operate. Thereby, the occupant can be protected from the impact.

[0149] In step ST23, the occupant protection ECU 30 collects the accident information. The occupant protection ECU 30 acquires the outside-vehicle captured image data generated by the stereo camera 53 in addition to the accident time information of the AACN standard such as the position of the own vehicle.

[0150] In step ST24, the occupant protection ECU 30 transmits the emergency information of the accident generated by the above-described processing to the server device 2 of the emergency reporting system 1 in real time.

[0151] ​In step ST65, the in-communication ECU 28 searches for the peripheral terminals existing in the periphery of the host vehicle. The in-communication ECU 28 searches for the peripheral mobile terminal 9 by, for example, close-range communication using the in-communication device 71. Thus, the in-communication ECU 28 can also search for the mobile terminal 9 of the pedestrian outside the vehicle which does not register the authentication information.

[0152] In step ST66, the in-communication ECU 28 connects with the searched peripheral terminal. For example, the in-communication ECU 28 connects with the mobile terminal 9 of the pedestrian outside the vehicle which does not register the authentication information using the in-communication device 71. At this time, the in-communication ECU 28 can also connect with the searched peripheral terminal after obtaining the consent of the searched peripheral terminal.

[0153] In step ST67, the in-communication ECU 28 obtains the accident peripheral information generated by the connected peripheral terminal from the connected peripheral terminal. In the case where the peripheral terminal is capturing the accident site on the spot, the in-communication ECU 28 obtains the image data of the peripheral terminal as the accident peripheral information.

[0154] In step ST68, the occupant protection ECU 30 or the detection ECU 26 collates the obtained accident site image data and the like as the accident peripheral information with various information possessed by the host vehicle. For example, the occupant protection ECU 30 or the detection ECU 26 extracts the image portion of the automobile 10 from the image of the image data as the accident peripheral information, and collates the image portion of the automobile 10 with the attribute information of the host vehicle possessed by the host vehicle, such as the vehicle type, color, and the like. In addition, for example, the occupant protection ECU 30 or the detection ECU 26 can also collate the image portion of the automobile 10 included in the image of the image data as the accident peripheral information with the image portion of the host vehicle in the image outside the vehicle captured by the host vehicle. Further, the occupant protection ECU 30 or the detection ECU 26 can also collate the image portion of the pedestrian and the like included in the image of the image data as the accident peripheral information with the image portion of the pedestrian and the like in the image outside the vehicle captured by the host vehicle. Furthermore, the occupant protection ECU 30 or the detection ECU 26 can also collate whether the capturing position and the capturing time included in the accident peripheral information are the occurrence position and the occurrence time of the accident of the emergency information possessed by the host vehicle.

[0155] In step ST69, the occupant protection ECU 30 or the detection ECU 26 determines whether the collated accident surrounding information is consistent with the various information possessed by the own vehicle. For example, in the case where all of the collated elements of the vehicle type, color, and the like of the automobile 10 in the above-described collation determination are consistent, the occupant protection ECU 30 or the detection ECU 26 determines that the accident surrounding information is consistent with the own vehicle information, and advances the processing to step ST70. In the case where any of the collated elements is inconsistent, the occupant protection ECU 30 or the detection ECU 26 determines that the accident surrounding information is inconsistent with the own vehicle information, and skips step ST70, advancing the processing to step ST71.

[0156] In step ST70, the occupant protection ECU 30 or the detection ECU 26 generates association information that associates the consistent accident surrounding information with the emergency information of the accident transmitted to the server device 2. The association information can correspond, for example, to a file name on the consistent accident surrounding information and a management ID attached to the emergency information. Thereby, the occupant protection ECU 30 can generate the association information usable in the server device 2.

[0157] In step ST71, the occupant protection ECU 30 or the detection ECU 26 determines whether to continue searching for the surrounding terminal. The searching for the surrounding terminal is a process that sequentially connects with the surrounding terminal to acquire the accident surrounding information, and takes time. On the other hand, the staff of the call center needs to request the emergency dispatch as early as possible after the server device 2 receives the emergency information. For example, in the case where the elapsed time after the transmission of the emergency information does not exceed a predetermined threshold, the occupant protection ECU 30 or the detection ECU 26 determines to continue searching for the surrounding terminal, returning the processing to step ST65. Thereby, in order to obtain the next accident surrounding information, the occupant protection ECU 30 or the detection ECU 26 performs the searching for the surrounding terminal. If the elapsed time after the transmission of the emergency information exceeds the predetermined threshold, the occupant protection ECU 30 or the detection ECU 26 ends the searching for the surrounding terminal, advancing the processing to step ST72.

[0158] In step ST72, the external communication ECU 27 transmits the accident surrounding information of the surrounding terminal and the association information obtained by the above-described processing to the server device 2 of the emergency notification system 1.

[0159] The server CPU 93 of the server device 2 receives the accident surrounding information of the surrounding terminal and the association information from the automobile 10 that has encountered the accident during the period in which the association processing of Figure 6 the emergency information is performed. As with the emergency information, the server CPU 93 stores the accident surrounding information of the surrounding terminal and the association information received from the automobile 10 that has encountered the accident in the server memory 92.

[0160] And, if the correlation information is selected in the step ST10 of Figure 6 , the server CPU 93 displays a screen of the accident surrounding information of the surrounding terminal received from the vehicle 10 that encountered the accident on the server monitor 95 using the correlation information received from the vehicle 10 that encountered the accident in the step ST11.

[0161] Figure 12 is Figure 11 an explanatory view of the collation judgment by the vehicle 10 regarding the image generated by the surrounding terminal as the accident surrounding information.

[0162] Figure 12 (A) of is an image as the accident surrounding information that the vehicle 10 acquires from the surrounding terminal. The surrounding terminal records the image of (A) by photographing the accident site. Figure 12

[0163] Figure 12 (B) of is a photographing image outside the vehicle generated by the vehicle 10. The vehicle 10 records the image of (B) by photographing the outside of the vehicle using the stereo camera 53. Figure 12

[0164] And, the occupant protection ECU 30 of the vehicle 10 that encountered the accident analyzes the image as the accident surrounding information of (A) if the image is acquired from the surrounding terminal, and extracts an image portion of the vehicle 10 and an image portion of a pedestrian or the like. The occupant protection ECU 30 collates the extracted image portion of the vehicle 10 with attribute information such as a vehicle type, a color, or the like of the vehicle. The occupant protection ECU 30 can also collate the image portion of the vehicle 10 with the attribute information of the vehicle 10 that encountered the accident. Figure 12 Figure 12 ​​​the captured image of the stereo camera 53. However, at night without illumination, the color of the host vehicle can not be correctly reflected in the captured image of the stereo camera 53. Therefore, it is desirable to perform the comparison with the attribute information of the host vehicle such as the vehicle type, color, and the like as information as much as possible. The occupant protection ECU 30 acquires the information of the position or the change in position of the opposite pedestrian of the collision based on the captured image of the stereo camera 53 or the like and / or the input position of the collision, and compares the position or the change in position of the pedestrian with the image portion of the pedestrian or the like. The occupant protection ECU 30 can also acquire the information of the direction of the relative position of the opposite pedestrian with respect to the position of the host vehicle based on, for example, the host vehicle information, and compare the direction of the relative position with the direction of the captured position of the person with respect to the captured position of the automobile 10 by the surrounding terminal. Also, in the case where the comparison of all of these elements are consistent, the occupant protection ECU 30 judges that the image acquired from the surrounding terminal is the image related to the own accident and generates the correlation information. The occupant protection ECU 30 transmits the image acquired from the surrounding terminal together with the generated correlation information to the server device 2. In this way, the automobile 10 can correctly judge the consistency with respect to the accident surrounding information acquired from the surrounding terminal by using the information possessed by the host vehicle.

[0165] As described above, in the emergency reporting system 1 in which the emergency information relating to the accident can be transmitted from the vehicle 10 that has encountered the accident to the server device 2, the control ECU such as the occupant protection ECU 30 of the vehicle 10 performs the acquisition processing and the association processing of the accident surrounding information as the accident surrounding information association device in the present embodiment. The control ECU such as the occupant protection ECU 30 receives and collects the accident surrounding information such as the photographed image of the accident site from the surrounding terminal by pairing with the surrounding terminal at the accident site through the internal communication terminal 70 of the vehicle 10 that has encountered the accident, and collates the accident surrounding information with the information possessed by the own vehicle. Also, if it is judged that the information is about the accident of the own vehicle, the control ECU such as the occupant protection ECU 30 generates the association information that associates the accident surrounding information of the judged surrounding terminal with the emergency information in a manner that can be used in the server device 2, and transmits the association information to the server device 2 together with the acquired accident surrounding information. Thereby, the server device 2 can use the accident surrounding information of the surrounding terminal about the accident in association with the emergency information of the vehicle 10 that has encountered the accident without performing the processing of generating the association information of the accident surrounding information by itself. The staff of the call center or the like can grasp the situation based on the accident surrounding information for the situation that cannot be completely grasped using only the emergency information from the vehicle 10 that has encountered the accident. The staff of the call center or the like can judge the situation at the accident site in detail and more accurately based on the rich information supplemented by the accident surrounding information, and make the required emergency crew to rush to the site. Also, the emergency crew can grasp not only the situation of the occupant but also the situation of the pedestrian or the like based on the rich information supplemented by the accident surrounding information, and rush to the site in a situation that can be coped with.

[0166] Also, as in the above-described embodiment, as shown in Figure 8 the server device 2 can judge that the first vehicle 10A collides with the first pedestrian 120A and the second vehicle 10B collides with the second pedestrian 120B in a state where an accident involving a plurality of vehicles 10 and a plurality of pedestrians occurs.

[0167] The above-described embodiment is an example of the preferred embodiment of the present application, but the present application is not limited thereto, and various modifications or changes can be made within the scope of the gist of the present application.

[0168] In the above-described embodiment, although the ECU is divided into a plurality of ECU in the vehicle 10, a part or all of them can be integrated into one ECU.

[0169] For example, in the above-described embodiments, the server device 2 or the vehicle 10 that has encountered an accident performs the generation process of associated information based on the detection of the accident or the receipt of emergency information about the accident based on the detection of the accident.

[0170] In addition, for example, server device 2 or car 10 that has been involved in an accident can also perform related information generation processing based on the operation of server device 2 by a call center employee who judges that the situation of the accident may not be understood by using emergency information alone.

[0171] In the above-described embodiments, the occupant protection ECU 30 in the vehicle 10 performs the generation process of associated information or performs the process for generating associated information.

[0172] In addition, other control ECUs besides the occupant protection ECU 30 in the vehicle 10 can also perform the generation of associated information or perform the processing for the generation of associated information.

Claims

1. A device for associating peripheral information in a vehicle accident, characterized in that, An emergency notification system in which a vehicle that has encountered an accident transmits emergency information related to the accident to a server device, the server device having: a setting unit that, when emergency information of an accident is received from the vehicle, sets a search condition for searching a cloud service based on the emergency information of the accident that is acquired; a retrieval unit that searches the cloud service using the set search condition, and retrieves accident surrounding information that can be transmitted from a surrounding terminal other than the vehicle; a determination unit that collates the retrieved accident surrounding information with the emergency information of the accident, and determines that the retrieved accident surrounding information is information about the accident of the vehicle when they are consistent; and a generation unit that generates association information that associates the accident surrounding information determined by the determination unit to be information about the accident of the vehicle with the emergency information transmitted by the vehicle to the server device.

2. The vehicle accident surrounding information association device according to claim 1, wherein the determination unit determines whether the accident surrounding information is information about the accident of the vehicle by collating a position, a time, or an image about the accident surrounding information retrieved by the server device with a position, a time, or an image of the emergency information of the vehicle received by the server device from the vehicle that has encountered the accident.

3. The vehicle accident surrounding information association device according to claim 1 or 2, wherein the retrieval unit retrieves the accident surrounding information received by the server device, the vehicle accident surrounding information association device has an output unit that outputs the accident surrounding information in association with the emergency information transmitted by the vehicle to the server device using the association information generated by the generation unit.

4. The vehicle accident surrounding information association device according to claim 1 or 2, wherein the vehicle that has encountered the accident generates information about a position of the own vehicle or an opponent vehicle or information about a change in position and transmits it to the server device, the determination unit determines that the accident surrounding information is information about the accident of the vehicle when a position or a change in position of a vehicle or an opponent vehicle in the accident surrounding information retrieved by the retrieval unit is consistent with the information about the position or the change in position acquired from the vehicle that has encountered the accident.

Images