Accident reporting device, accident reporting method, and accident reporting program
The integration of impact and sound analysis in the determination device improves accident detection accuracy by identifying low-impact events as accidents, ensuring timely emergency notifications.
Patent Information
- Application Number
- JP2024089531
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-05-31
- Publication Date
- 2025-12-11
AI Technical Summary
Conventional accident detection systems fail to accurately identify accidents, particularly those with low impact levels, leading to missed emergency calls or false determinations.
A determination device that combines impact detection with sound analysis, determining an accident based on impact thresholds and sudden changes in sound volume within a predetermined period, enhancing the accuracy of accident detection.
Accurately identifies accidents, including those with low impact levels, reducing false negatives and false positives, and ensuring timely emergency notifications.
Smart Images

Figure 2025181502000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to an accident reporting device, an accident reporting method, and an accident reporting program. [Background technology]
[0002] Drive recorders, which store vehicle status information (forward footage, vehicle speed, sudden acceleration / deceleration, etc.) before and after a car accident, provide useful information for investigating car collisions and other accidents. Therefore, they are increasingly being installed in transportation vehicles such as trucks, as well as commercial vehicles such as taxis and buses, and are also increasingly being installed in general vehicles. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-000818 Summary of the Invention [Problem to be solved by the invention]
[0004] However, conventional technologies may not properly detect accidents. For example, accidents may be determined based on the level of impact a vehicle receives and an emergency call may be made. However, conventional technologies may detect an accident as a sudden movement rather than an accident because the level of impact is low. Therefore, with conventional technologies, even though the vehicle occupants may recognize that an accident has occurred, the device may not determine that an accident has occurred, resulting in a situation where an emergency call is not made or the call cannot be connected.
[0005] In order to solve the above-mentioned problems and achieve the object, the device aims to perform appropriate detection of accidents. [Means for solving the problem]
[0006] The present invention provides a determination device to be mounted on a vehicle, the determination device having a first detection unit that detects an impact occurring to the vehicle, a second detection unit that detects sound inside the vehicle, and a determination unit that determines an accident involving the vehicle based on the detection results of the first detection unit and the second detection unit, wherein the determination unit determines that an accident has occurred when the first detection unit detects an impact equal to or greater than a predetermined value and the second detection unit detects a sudden change in the volume of the sound within a predetermined period including the time when the impact was detected. [Brief explanation of the drawings]
[0007] [Figure 1] FIG. 1 is a diagram illustrating an example of the overall configuration of a system according to the first embodiment. [Figure 2] FIG. 2 is a diagram showing an example of a problem in a general accident determination process. [Figure 3] FIG. 3 is a diagram illustrating the processing performed by the determination device according to the first embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of a block diagram of the determination device according to the first embodiment. [Figure 5] FIG. 5 is a diagram showing an example of classification of impacts detected by the impact detection unit according to the first embodiment. [Figure 6] FIG. 6 is a diagram showing an example of audio data subjected to FFT analysis according to the first embodiment. [Figure 7] FIG. 7 is a diagram showing an example of audio data subjected to FFT analysis according to the first embodiment. [Figure 8] FIG. 8 is a diagram illustrating an example of a determination condition according to the first embodiment. [Figure 9] FIG. 9 is a diagram illustrating an example of a condition for determination according to the first embodiment. [Figure 10] FIG. 10 is a diagram illustrating an example of a determination condition according to the first embodiment. [Figure 11] FIG. 11 is a diagram illustrating an example of the effect of the determination device according to the first embodiment. [Figure 12] FIG. 12 is a flowchart illustrating an example of a determination process procedure according to the first embodiment. [Figure 13]FIG. 13 is a flowchart illustrating an example of a determination process procedure according to the first embodiment. [Figure 14] FIG. 14 is a diagram illustrating an example of a determination condition according to the first embodiment. [Figure 15] FIG. 15 is a diagram illustrating an example of a problem in a general accident notification process. [Figure 16] FIG. 16 is a diagram illustrating the processing performed by the determination device according to the second embodiment. [Figure 17] FIG. 17 is a diagram illustrating an example of a block diagram of a determination device according to the second embodiment. [Figure 18] FIG. 18 is a diagram showing an example of a setting change screen according to the second embodiment. [Figure 19] FIG. 19 is a diagram illustrating an example of changing the settings of the impact and sound thresholds according to the second embodiment. [Figure 20] FIG. 20 is a diagram illustrating an example of a setting change according to the second embodiment. [Figure 21] FIG. 21 is a diagram illustrating an example of a comparison target displayed by the setting change unit according to the second embodiment. [Figure 22] FIG. 22 is a flowchart showing an example of the flow of processing in the determination device according to the second embodiment. [Figure 23] FIG. 23 is a diagram illustrating an example of a problem with a general accident notification process. [Figure 24] FIG. 24 is a diagram illustrating the processing performed by the determination device according to the third embodiment. [Figure 25] FIG. 25 is a diagram illustrating an example of a block diagram of a determination device according to the third embodiment. [Figure 26] FIG. 26 is a diagram illustrating an example of the degree of certainty determined by the determining unit according to the third embodiment. [Figure 27] FIG. 27 is a diagram illustrating an example of a notification executed by the communication processing unit according to the third embodiment. [Figure 28] FIG. 28 is a diagram illustrating an example of a notification executed by the communication processing unit according to the third embodiment. [Figure 29] FIG. 29 is a diagram illustrating an example of processing performed by the determination unit according to the third embodiment. [Figure 30] FIG. 30 is a flowchart illustrating an example of an accident notification processing procedure according to the third embodiment. [Figure 31] FIG. 31 is a flowchart illustrating an example of an accident notification processing procedure according to the third embodiment. [Figure 32] FIG. 32 illustrates an example of a hardware configuration. DETAILED DESCRIPTION OF THE INVENTION
[0008] The following describes in detail embodiments of the notification device, notification method, and notification program disclosed herein with reference to the accompanying drawings. Note that the present invention is not limited to these embodiments. Furthermore, the embodiments can be combined as appropriate within a consistent range.
[0009] <Embodiment 1> (Overall composition) A determination device according to the first embodiment will be described. FIG. 1 is a diagram illustrating an example of the overall configuration of a system according to the first embodiment. As shown in FIG. 1, the system according to the first embodiment includes a vehicle 20, a determination device 10 mounted on the vehicle 20, and an external server device 7. As shown in FIG. 1, the system detects image data, audio data, and impacts while the vehicle 20 is traveling, and determines whether an accident has occurred based on the detected data. Note that the number of determination devices 10 and vehicles 20 is not limited to that shown in FIG. 1.
[0010] The determination device 10 is a device that determines whether or not the vehicle 20 has had an accident. For example, the determination device 10 is an example of a computer device that determines whether or not an accident has occurred by combining the impact received by the vehicle 20 with audio data within the vehicle 20. For example, the determination device 10 may be a dedicated navigation device that is built into or mounted on the vehicle 20. The determination device 10 may also be configured with a navigation device and a recording device (drive recorder). As one example, the determination device 10 may be a composite device in which a navigation device and a recording device that are independent of each other are connected so as to be able to communicate with each other. As another example, the determination device 10 may be a single device that has a navigation function and a recording function.
[0011] The determination device 10 may also be configured with a sensor device and a communication device. As an example, the determination device 10 may be a composite device in which a sensor device and a notification device that are independent of each other are communicatively connected. As another example, the determination device 10 may be a single device having a sensor function and a notification function.
[0012] Furthermore, an occupant of the vehicle 20 can connect a predetermined sensor to a portable terminal device (for example, a smartphone, tablet terminal, notebook PC, desktop PC, PDA, or the like) that they use on a daily basis and install a predetermined application, thereby substituting the determination device 10. For example, a portable terminal device that is equipped with a predetermined sensor or to which a predetermined sensor is connected can be understood as the vehicle 20 referred to here. When the portable terminal device is used as the determination device 10, it is installed, for example, on the dashboard of the vehicle 20 while driving.
[0013] When the determination device 10 detects that there is a possibility of an accident, the external server device 7 is notified of an event that an accident has occurred from the determination device 10. For example, when the external server device 7 is notified of an event that an accident has occurred from the determination device 10, the external server device 7 establishes a call between the occupant of the vehicle 20 and a call center so that the occupant of the vehicle 20 can make a call with the call center that is the destination of an emergency call.
[0014] (Problems with general accident determination processing) Here, we will explain the problems with general accident determination processing (hereinafter, sometimes simply referred to as "accident determination processing"). The accident determination processing executed by a determination device mounted on a general vehicle may not properly detect an accident. For example, when a vehicle receives an impact, if the level of the impact is analyzed to determine whether it is an accident or not, the impact may not be detected as an accident because the level of the impact is low, but may be detected as a sudden movement. As a result, although the occupant driving the vehicle recognizes that there is an accident, the accident determination device does not determine that there is an accident, so an accident report is not sent to the external server device 7, and a call to the call center is not made. In addition, there may be cases where an erroneous determination is made that there is an accident when there is no accident.
[0015] This will be explained in detail using Figure 2. Figure 2 is a diagram illustrating the problems with general accident determination processing. Figure 2 shows the classification of accidents according to the level of impact determined by the accident determination processing, and whether or not an accident has occurred is determined according to the impact level shown in Figure 2.
[0016] For example, in a typical accident determination process, if an impact equal to or greater than a first threshold is detected and a vehicle collides with a wall, it is determined to be a large impact. Furthermore, if an accident determination device detects an impact that is less than the first threshold and equal to or greater than a second threshold, and a vehicle collides with another vehicle as a chain reaction accident, it is determined to be a medium or small impact. If the impact is large, medium, or small, it is determined that an accident has occurred, and a report is sent to the external server device 7.
[0017] On the other hand, in a general accident determination process, when an impact such as sudden steering, sudden braking, or sudden acceleration is detected, which is an impact less than the second threshold value, it is determined to be a sudden movement and no notification is sent to the external server device 7. This is because the accident determination process determines that a sudden movement is a low-level impact.
[0018] However, as mentioned above, typical accident determination processing only allows two choices: accident or no accident, so even if the vehicle is impacted and the vehicle occupants recognize that an accident has occurred, they may not be able to make an appropriate determination.
[0019] Therefore, as shown in FIG. 1, the determination device 10 according to the first embodiment analyzes not only the impact that occurred on the vehicle 20 but also the audio data before and after the impact was detected, and appropriately determines that an accident that was erroneously determined to be caused by a sudden movement (such as sudden acceleration, sudden braking, or sudden steering) because the detected impact level was low is an accident based on the volume peak at the time of the sudden movement.
[0020] (Processing contents of the determination device 10) Next, the processing contents of the determination device 10 according to the embodiment 1 will be described. The determination device 10 according to the embodiment 1 detects an impact occurring on the vehicle 20 and a sound inside the vehicle 20, and determines an accident of the vehicle 20 based on the detection results. Then, when the determination device 10 detects an impact less than a second threshold and detects a sudden change in the volume of the sound within a predetermined period including the timing when the impact is detected, it determines that an accident has occurred.
[0021] Here, a specific example will be given to explain the processing content of the determination device 10. Fig. 3 is a diagram for explaining the processing content of the determination device 10 according to embodiment 1. Fig. 3 shows an example of conditions under which the determination device 10 determines that an accident has occurred.
[0022] For example, when the vehicle 20 receives an impact, the determination device 10 determines whether or not an accident has occurred by combining data related to the impact and data related to audio inside the vehicle 20. At this time, the determination device 10 determines whether or not the impact is below a second threshold for determining a sudden movement. Furthermore, the determination device 10 constantly detects audio inside the vehicle, and determines whether or not there has been a sudden change in volume in particular within a few seconds before and after the timing at which the impact was detected. Then, when the determination device 10 detects both an impact below the second threshold for determining a sudden movement and a sudden change in volume, the determination device 10 determines that the sudden movement is an accident.
[0023] As a result, the determination device 10 can determine that a sudden movement that was determined not to be an accident in the above accident determination process is an accident by performing sound detection in addition to impact detection, so the determination device 10 can make an appropriate determination about the accident.
[0024] (Functional configuration of the determination device 10) Next, a description will be given of the functional configuration of the determination device 10. Fig. 4 is a block diagram showing an example of the functional configuration of the determination device 10 according to embodiment 1. As shown in Fig. 4, the determination device 10 includes a storage unit 11, a determination processing unit 12, a camera 20a, a microphone 20b, an acceleration sensor 20c, a video encoder processing unit 2, an audio encoder processing unit 3, a muxer unit 4, and an abrupt behavior detection unit 5.
[0025] The video encoder processing unit 2, audio encoder processing unit 3, muxer unit 4, and sudden behavior detection unit 5 are realized by a control unit such as a processor. The control unit such as a processor has an internal memory for storing programs that define various processing procedures and required data, and executes various processes using these. Here, the processor is, for example, an electronic circuit such as a CPU (Central Processing Unit) or MPU (Micro Processing Unit), or an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or FPGA (Field Programmable Gate Array).
[0026] The video encoder processing unit 2 is a processing unit that converts analog image data captured by the camera 20a into a digital signal. The audio encoder processing unit 3 is software that converts the format of an audio file of audio data acquired by the microphone 20b.
[0027] The acceleration sensor 20c measures the acceleration of the vehicle 20. For example, the acceleration sensor 20c measures acceleration along three axes, namely, the X-axis, the Y-axis, and the Z-axis. The acceleration sensor 20c then outputs information about the measured acceleration of the vehicle 20 to the determination processing unit 12. Note that the acceleration information measured here may include the angular velocity of the vehicle 20, and this information is used by the determination processing unit 12 as impact data indicating the impact that the vehicle 20 has received.
[0028] The muxer 4 combines the imaging data and audio data to output a moving image file 11a. For example, the muxer 4 combines the imaging data output from the video encoder processing unit 2 with the audio data output from the audio encoder processing unit 3, and outputs the moving image file 11a.
[0029] The memory unit 11 stores various programs executed by the judgment processing unit 12, data required when the judgment processing unit 12 performs processing, video file 11a output by the muxer unit 4, and analyzed audio data output by the audio detection unit 12b described later.
[0030] The judgment processing unit 12 has an impact detection unit 12a, a sound detection unit 12b, a calculation unit 12c, a judgment unit 12d, and a short-time Fourier transform unit 13, and judges whether or not an accident has occurred using the impact and sound obtained from the vehicle 20.
[0031] The impact detection unit 12a is an example of a first detection unit that detects an impact occurring to the vehicle 20. For example, the impact detection unit 12a detects an impact occurring to the vehicle 20 using impact data, which is acceleration information output from the acceleration sensor 20c. For example, the impact detection unit 12a classifies the accident based on the value of a resultant vector of Gx, Gy, and Gz, which are accelerations on the X-axis, Y-axis, and Z-axis, respectively, measured by the acceleration sensor 20c.
[0032] The classification of accidents based on the value of the resultant vector will be described with reference to Fig. 5. Fig. 5 is a diagram showing an example of classification of impacts detected by the impact detection unit 12a according to the first embodiment. When the value of the resultant vector is higher than a first threshold, the impact detection unit 12a detects the accident as a major accident, and when the value of the resultant vector is lower than the first threshold and equal to or higher than a second threshold, the impact detection unit 12a detects the accident as a medium or minor accident. Furthermore, when the impact is equal to or lower than the second threshold, the impact detection unit 12a detects the accident as a sudden movement.
[0033] The voice detection unit 12b is an example of a second detection unit that detects voice inside the vehicle 20. For example, the voice detection unit 12b constantly detects voice inside the vehicle 20 by using voice data inside the vehicle 20 collected by the microphone 20b and the audio encoder processing unit 3.
[0034] The short-time Fourier transform unit 13 uses the audio data obtained from the audio detection unit 12b, the microphone 20b, and the audio encoder processing unit 3 to perform a short-time Fourier transform (STFT).
[0035] The short-time Fourier transform unit 13 has a windowing unit 13a and an FFT unit 13b. The windowing unit 13a is a processing unit that multiplies input signal data, which is audio data acquired from the voice detection unit 12b, the microphone 20b, and the audio encoder processing unit 3, by a window function of a specific analysis frame length on the time axis. For example, the windowing unit 13a extracts frames of a specific time length from the input signal input by the vehicle 20 for each frame period and multiplies the extracted frames by a window function, for example, a Hanning window.
[0036] To reduce information loss due to the window function, the windowing unit 13a can overlap the preceding and following analysis frames at any desired rate. For example, by analyzing a fixed frame length of 512 samples at a fixed frame period of 256 samples, the overlap rate can be set to 50%. The analysis frames obtained in this manner are output to the FFT unit 13b, the calculation unit 12c, and the determination unit 12d.
[0037] The FFT unit 13b is a processing unit that performs FFT (Fast Fourier Transform). For example, the FFT unit 13b applies FFT to the analysis frame that has been windowed by the windowing unit 13a. This converts the input signal of the analysis frame into an amplitude spectrum and a phase spectrum.
[0038] Thereafter, the FFT unit 13b outputs the amplitude spectrum obtained by the FFT to the calculation unit 12c and the determination unit 12d. Note that although an example in which the FFT is applied has been given here, other algorithms such as Fourier transform and discrete Fourier transform may be applied to convert from the time domain to the frequency domain.
[0039] The calculation unit 12c calculates the sum of the amplitudes of all frequency bands of the amplitude spectrum obtained by the short-time Fourier transform unit 13. For example, the calculation unit 12c calculates the sum of the amplitudes of all frequency bands using FFT, and calculates the peak value of the audio data.
[0040] Here, the difference between the sound data after FFT analysis in normal times and when a contact sound is generated will be described. Fig. 6 is a diagram showing an example of sound data that has undergone FFT analysis according to embodiment 1. In the example of Fig. 6, an FFT is performed on sound data that includes a contact sound acquired by microphone 20b, and the amplitude value is shown for each frequency.
[0041] As shown in Figure 6, the graph showing the FFT results for normal times when no contact sound is included shows large amplitude values in the low frequency band, indicating that the overall amplitude values are small. On the other hand, the graph showing the FFT results for contact sound also shows large amplitude values in the high frequency band, indicating that the overall amplitude values are large.
[0042] Next, a description will be given of analysis data obtained by calculating the sum of amplitudes of all frequency bands after performing FFT on the audio data including the contact sound shown in Fig. 6. Fig. 7 is a diagram showing an example of audio data after FFT analysis used for accident detection according to embodiment 1. The example in Fig. 7 shows a graph in which the sum of amplitudes of all frequency bands after performing FFT on the audio data including the contact sound shown in Fig. 7 is calculated for each playback time (seconds).
[0043] In the graph shown in Figure 7, the vertical axis represents the sum of the amplitudes (Σ) of all frequency bands, and the horizontal axis represents the playback time (seconds) of the acquired audio data. As shown in Figure 6, the sum of the amplitudes Σ exceeds 600 around 9.7 seconds when the contact sound occurred, while the maximum sum of the amplitudes at other times remains around 300. In other words, over the approximately 16-second playback time, the audio data around 9.7 seconds when the contact sound occurred due to the accident is detected as the volume peak.
[0044] As a result, the voice detection unit 12b can create analysis data from the voice data acquired by the microphone 20b, which is used by the determination unit 12d (described later) and is capable of detecting volume peaks.
[0045] The determination unit 12d determines whether an accident has occurred in the vehicle 20 based on the detection results of the impact detection unit 12a and the sound detection unit 12b. Furthermore, when the determination unit 12d detects a sudden deceleration, a sudden acceleration, or a sudden turn of the vehicle 20, it determines that the vehicle 20 has made a sudden movement. The conditions under which the determination unit 12d determines that an accident has occurred will be explained below. When a sudden movement is detected by the impact detection unit 12a, the determination unit 12d determines that an accident has occurred if conditions 1 to 3 are additionally satisfied for the sound.
[0046] Here, when the determination unit 12d detects a sudden movement in which the detected impact is less than a small to medium accident, for example, the determination unit 12d determines whether the sudden movement is an accident by determining whether conditions 1 to 3 described below are satisfied. The determination contents of conditions 1 to 3 will be described below in order.
[0047] (Explanation of condition 1) Condition 1 is a condition for determining whether a volume deviating from normal volume has been detected from audio data after analysis for about 20 seconds including the time point at which an impact is detected. Fig. 8 is a diagram showing an example of the processing content of the determination unit 12d according to the first embodiment. As shown in Fig. 8, the determination unit 12d determines that the volume peak at around 9.7 seconds, which indicates a sound at the time of contact sound, is audio that may be deviating from normal volume and may be due to contact.
[0048] Here, a specific example of the determination content of condition 1 by the determination unit 12d will be described. Fig. 9 is a diagram showing an example of the processing content of the accident detection unit according to embodiment 1. Fig. 9 shows an example of the case where the sum of the amplitudes of all frequency bands of audio data is calculated at intervals of 100 ms by FFT, and a sudden change in volume is detected when the calculated sum of amplitudes satisfies the following (1) to (4):
[0049] First, the determination unit 12d performs outlier determination to determine whether the target amplitude is an outlier compared to the immediately preceding sound field (Condition 1-(1)). Specifically, the determination unit 12d determines whether the following condition is satisfied: "total amplitude value Σ of the target amplitude for 100 ms > average amplitude Σ for the immediately preceding 5 seconds + 3σ." Note that σ represents the standard deviation.
[0050] Next, the determination unit 12d performs a gradient determination to determine whether the target amplitude is abruptly changing in volume (Condition 1-(2)). Specifically, the determination unit 12d determines whether the following condition is satisfied: "target amplitude 100 msΣ - immediately preceding amplitude 100 msΣ > gradient threshold."
[0051] Next, the determination unit 12d performs a contact volume determination to determine whether the target amplitude is an amplitude equivalent to the contact volume (Condition 1-(3)). Specifically, the determination unit 12d determines whether or not "target amplitude 100 msΣ>contact volume threshold" is satisfied.
[0052] Then, the determination unit 12d performs a detection validity determination to determine whether or not the immediately preceding sound field is detectable (Condition 1-(4)). Specifically, the determination unit 12d determines whether or not "amplitude σ for the immediately preceding 5 seconds < detection validity σ threshold" is satisfied.
[0053] 9, the accident detection unit 125 performs the determination of the above-described conditions 1-(1) to 1-(4) and detects the sum of the amplitudes around 9.7 seconds as a volume peak that may be a contact sound that deviates from normal conditions and satisfies all of conditions 1-(1) to 1-(4). That is, the determination unit 12d determines that condition 1 is satisfied. Note that the order in which the determination unit 12d performs the determination of the above-described conditions 1-(1) to 1-(4) is not particularly limited.
[0054] (Explanation of condition 2) Condition 2 determines whether or not a volume peak that satisfies the above-described condition 1 exists between 2 seconds before and 1 second after the point in time when the sudden movement is detected. Fig. 10 is a diagram showing an example of the processing content of the determination unit 12d according to the first embodiment. Fig. 10 shows an example in which a sudden movement is detected at a point in time of 10 seconds of playback time in the audio data.
[0055] As shown in FIG. 10, the determination unit 12d determines that condition 2 is satisfied because a volume peak that satisfies the above-mentioned condition 1 is detected around 9.7 seconds, which is within 2 seconds before the playback time of 10 seconds when the sudden behavior was detected.
[0056] (Explanation of condition 3) Condition 3 is a condition for determining whether vehicle 20 has slowed down or stopped within a certain distance from the point where a sudden movement was detected. The certain distance is the distance at which the vehicle is expected to slow down or stop in the event of a vehicle accident, and is set to, for example, 100 m. Note that the certain distance is not limited to 100 m, but may be 200 m, and can be changed as appropriate based on empirical and research results.
[0057] The certain distance can be acquired by a GPS (Global Positioning System) sensor (not shown). Note that the method for measuring the distance is not limited to a GPS sensor, and various methods capable of measuring the distance can be used. For example, the distance may be measured based on parameters acquired from a vehicle speed sensor, or based on an odometer value acquired via a CAN (Controller Area Network).
[0058] For example, the determination unit 12d determines that condition 3 is satisfied when the speed of the vehicle 20 becomes equal to or less than a slow speed within a travel distance of 200 m, which is an example of a certain distance, from the point where the sudden behavior was detected. Explaining this using the example of Fig. 10, the determination unit 12d uses the vehicle position at the point in time 10 seconds into the playback when the sudden behavior was detected as a reference, and determines that condition 3 is satisfied when the speed of the vehicle 20 becomes equal to or less than a threshold value (for example, 5 km / hour) within a certain distance (for example, 200 m) from the reference, or when the speed of the vehicle 20 becomes 0 m / hour.
[0059] Furthermore, Condition 3 is not limited to the distance from the detection of the sudden behavior, but can also be the time from the detection of the sudden behavior until the vehicle stops. For example, the determination unit 12d determines that Condition 3 is satisfied if the vehicle 20 stops within a certain time (for example, within 10 seconds) after the detection of the sudden behavior. Note that the 10 seconds period exemplified here is merely an example, and the setting can be changed as appropriate. Furthermore, the time can be measured by a general method, such as using time information or a timer in the determination device 10 or another on-board device to measure the time from the detection of the sudden behavior until the vehicle speed becomes equal to or less than a threshold.
[0060] As described above, when the impact detected by the detection result of the impact detection unit 12a is determined to be a sudden movement that is less than the second threshold, the judgment unit 12d additionally determines whether or not all of conditions 1 to 3 are met using the analysis data created by the sound detection unit 12b, thereby making it possible to properly judge an accident that was erroneously determined to be a sudden movement as an accident.
[0061] Fig. 11 is a diagram showing an example of the flow of the determination process of the determination device 10 according to embodiment 1. As shown in Fig. 11, when a sudden movement is determined based on the detection result of the impact detection unit 12a, the determination device 10 can also determine that the sudden movement is an accident by additionally determining whether or not the sound inside the vehicle 20 satisfies all of the above-described conditions 1 to 3.
[0062] <Processing Executed by Determination Device 10> Next, the processing of the determination device 10 according to the embodiment 1 will be described with reference to Fig. 12 and Fig. 13. Fig. 12 is a flowchart showing the overall flow of the determination processing procedure according to the embodiment 1. First, the determination device 10 detects an impact to the vehicle 20 (step S101) and a sound inside the vehicle 20 (step S102).
[0063] Next, the determination device 10 performs FFT using the detected sound inside the vehicle 20 (step S103). Next, the determination device 10 calculates the sum of the amplitudes of all frequency bands from the results obtained by performing FFT (step S104). Then, the determination device 10 combines the impact result obtained in step S101 with the sound data result obtained in step S104, and determines whether an accident has occurred (step S105).
[0064] 13 is a flowchart showing a detailed flow of the determination process procedure according to the first embodiment. First, the determination device 10 performs FFT to calculate the sum of the amplitudes of all frequency bands of the audio data (step S201). Next, if the volume is equal to or greater than the threshold compared to the sound immediately before the vehicle 20 receives an impact (step S202, Yes), the determination device 10 determines whether a sudden change in volume has occurred (step S203). On the other hand, if the volume is not equal to or greater than the threshold compared to the sound immediately before the vehicle 20 receives an impact (step S202, No), the determination device 10 ends the process.
[0065] Next, if a sudden volume change has occurred (step S203, Yes), the determination device 10 determines whether the amplitude is about the volume that would cause the vehicle 20 to come into contact with something (step S204). On the other hand, if a sudden volume change has not occurred (step S203, No), the determination device 10 ends the process.
[0066] Next, if the amplitude is about the same as the volume of sound when the vehicle 20 comes into contact with something (step S204, Yes), the determination device 10 determines whether or not the sound field immediately before the vehicle 20 receives an impact can be detected (step S205). On the other hand, if the amplitude is not about the same as the volume of sound when the vehicle 20 comes into contact with something (step S204, No), the determination device 10 ends the process.
[0067] If the determination device 10 can detect the sound field immediately before the vehicle 20 receives an impact (step S205, Yes), it determines that an accident has occurred (step S206) and ends the process. On the other hand, if the determination device 10 cannot detect the sound field immediately before the vehicle 20 receives an impact (step S205, No), it ends the process.
[0068] <Effects of the First Embodiment> As described above, the determination device 10 makes a determination by combining the sudden behavior of the vehicle 20 when it receives an impact, the detected impact, and the audio of the vehicle 20 before and after the impact, and is therefore able to determine that even sudden behavior that would not be determined to be an accident using general accident determination processing is an accident.
[0069] Furthermore, the determination device 10 can determine that an abrupt behavior that satisfies any one of conditions 1 to 3 is an accident. As a result, the determination device 10 can detect all accidents even when an abrupt behavior occurs that is indistinguishable from a simple abrupt behavior such as abrupt steering and an accident caused by abrupt behavior.
[0070] Furthermore, the determination device 10 can detect an accident when two or more of the determination conditions from Condition 1 to Condition 3 are satisfied, or can detect an accident when all of the conditions are satisfied, allowing the occupant (passenger) to set the desired conditions. As a result, the determination device 10 can provide an appropriate accident detection service according to the occupant's wishes.
[0071] Furthermore, the determination device 10 can detect an accident when all of conditions 1 to 3 are satisfied, thereby enabling accurate accident detection with reduced false detections. As a result, the determination device 10 can provide a safe and secure car life for the occupants.
[0072] Furthermore, by determining that sudden movements are also accidents, the determination device 10 can prevent a situation in which the occupant recognizes an accident but does not make a call to the call center, resulting in the occupant being unable to receive appropriate service.
[0073] Furthermore, the determination device 10 can provide a device that realizes a determination algorithm through the above-described processing and determines that even sudden movements are accidents, thereby realizing accurate and high-speed determination processing by the determination device 10.
[0074] (Determined by moving average of acceleration) In the above-mentioned first embodiment, an example of detecting a sudden behavior using a composite vector of Gx, Gy, and Gz, which are accelerations on the X-axis, Y-axis, and Z-axis, respectively, has been described. However, the determination device 10 of the first embodiment can detect in detail what kind of sudden behavior has occurred using a moving average of the acceleration.
[0075] For example, the impact detection unit 12a of the determination device 10 detects details of the sudden behavior using a moving average of acceleration in each direction measured by the acceleration sensor 20c mounted on the vehicle 20. FIG. 14 is a diagram illustrating an example of a determination condition according to the first embodiment. As shown in FIG. 14, the impact detection unit 12a determines that the sudden behavior is a sudden deceleration when the moving average of acceleration in the x-axis direction measured by the acceleration sensor 20c mounted on the vehicle 20 is greater than a third threshold. The impact detection unit 12a also detects a sudden acceleration in which the moving average of acceleration in the x-axis direction is smaller than the third threshold, a sudden right turn in which the moving average of acceleration in the y-axis direction is greater than the third threshold, or a sudden left turn in which the moving average of acceleration in the y-axis direction is greater than the third threshold.
[0076] <Embodiment 2> (Summary of Second Embodiment) In the first embodiment, the determination device 10 determines whether the sound inside the vehicle 20 when a sudden movement is detected satisfies the conditions for an accident, thereby realizing an accurate accident determination for a sudden movement. However, the disclosed determination device can also notify the occupants by displaying, on a screen mounted on the vehicle 20, the detection method used to detect the accident when an accident is detected.
[0077] Therefore, in the second embodiment, a determination device 10 will be described as an example of a notification device that, when an accident is detected, presents the detection result and the detection method to an occupant, and allows the occupant to change the setting of the detection method. Note that the system configuration of the second embodiment is the same as that of Fig. 1, and therefore detailed description thereof will be omitted.
[0078] For example, the determination device 10 suppresses the detection of accidents caused by small impacts by a first detection method using "impact only" determined by the resultant vector of acceleration, and performs the detection of accidents caused by large impacts. Furthermore, the determination device 10 can also detect accidents caused by small impacts, such as sudden movements, by a second detection method using both "impact" determined by the resultant vector of acceleration and "audio" determined by the total amplitude of the frequency band (hereinafter, sometimes referred to as "impact + audio"). In this way, the determination device 10 can select a detection method depending on the setting situation, such as using the first detection method for performing wide-ranging accident detection and the second detection method for performing strict accident detection.
[0079] By the way, the determination device 10 can detect accidents with small impacts by setting a low threshold for the first detection method using "impact only," but erroneous detection of an accident may occur depending on the threshold setting. Even in such cases, an accident notification is sent to the external server device 7, which may be annoying to the vehicle occupants.
[0080] This will be explained in detail using Fig. 15. Fig. 15 is a diagram illustrating problems with accident notification. For example, when the setting of the accident detection method is "impact and sound," the determination device 10 detects a situation in which the sound becomes abnormally loud due to "sudden behavior such as sudden steering, sudden braking, or sudden acceleration" as an accident using the method of embodiment 1, and notifies the external server device 7.
[0081] On the other hand, when the accident detection method is set to "impact only" and a small threshold is set, the determination device 10 not only detects accidents with large impacts, but also detects simple sudden movements as small impact accidents, and notifies the external server device 7. In other words, an erroneous determination occurs due to an incorrect setting of the threshold. Note that even when the "impact and sound" detection method is used, it is possible that an erroneous setting of the threshold may result in an erroneous detection of sudden movements with small sounds as an accident.
[0082] Therefore, in order to reduce the inconvenience to passengers who receive accident alerts every time an accident is falsely detected due to a small impact or a strict accident detection due to sudden movement, the determination device 10 displays a setting screen for information related to accident detection, allowing passengers to change the detection method and threshold value.
[0083] (Processing contents of the determination device 10) Next, the processing content of the determination device 10 according to the second embodiment will be described. Specifically, the determination device 10 according to the second embodiment detects an accident of the vehicle 20 using a first detection method using an impact occurring on the vehicle 20 or a second detection method using an impact and sound inside the vehicle 20. The determination device 10 displays a notification screen including the accident detection result by the detection unit and information indicating whether the detected accident was detected by the first detection method or the second detection method. Then, the determination device 10 accepts a change in the setting of the accident detection method on the displayed notification screen.
[0084] In other words, when an accident occurs, the judgment device 10 displays an alert screen on a screen installed in the vehicle 20 or on a screen such as a smartphone held by the occupant, which screen accepts changes to the accident detection method and threshold for accident detection, accepts the detection level desired by the occupant from the occupant, and performs accident detection at the detection level desired by the occupant.
[0085] 16 is a diagram illustrating a notification screen and a setting change. Here, "changing the detection method" is explained as an example, and "changing the threshold" will be described later.
[0086] 16, for example, when the determination device 10 detects an accident in a situation where "impact only" is set as a detection method, the determination device 10 displays a notification screen such as "Detection method: Impact only. Do you want to change the setting?" Then, when the "Yes" button requesting a setting change is selected, the determination device 10 changes the accident detection method to "impact + sound."
[0087] Similarly, when the determination device 10 detects an accident in a situation where the detection method is set to "impact + sound," it displays a notification screen such as "Detection method: Impact + sound. Do you want to change the setting?" Then, when the "Yes" button requesting a setting change is selected, the determination device 10 changes the accident detection method to "impact only."
[0088] This allows the determination device 10 to accept the selection of a detection method or a change in settings by the occupant, and to perform appropriate accident detection for each occupant, thereby reducing the inconvenience to the occupant.
[0089] (Functional configuration of the determination device 10) Next, the configuration functions of the determination device 10 according to the second embodiment will be described. Fig. 17 is a block diagram showing an example of the functional configuration of the determination device 10 according to the second embodiment. As shown in Fig. 17, the determination device 10 according to the second embodiment has the same configurations as the storage unit 11, determination processing unit 12, short-time Fourier transform unit 13, camera 20a, microphone 20b, acceleration sensor 20c, video encoder processing unit 2, audio encoder processing unit 3, and Muxer unit 4 described in Fig. 4, and therefore detailed description thereof will be omitted. Here, the determination unit 12d, notification unit 12e, and setting change unit 12f of the determination processing unit 12, which have configurations different from those of the first embodiment, will be described.
[0090] The determination unit 12d performs accident detection using a first detection method that uses only impact or a second detection method that uses impact and sound. For example, when the determination unit 12d uses the first detection method, it detects an accident when it detects an impact equal to or greater than a threshold. When the determination unit 12d uses the second detection method, it detects an accident by the determination process described in the first embodiment.
[0091] The notification unit 12e outputs a notification screen including the accident detection results by the impact detection unit 12a and the sound detection unit 12b and information indicating the detection results of the detected accident to the screen of a terminal device or the like mounted on the vehicle 20. For example, the notification unit 12e outputs a notification screen including, in addition to the detection results, the detection method used to detect the accident, "a detection method that combines impact and sound sensitivity (threshold), or a detection method that uses only impact sensitivity (threshold)."
[0092] The setting change unit 12f accepts a change in the setting of the accident detection method or a change in the threshold value used for accident detection on the notification screen output by the notification unit 12e. Then, the setting change unit 12f instructs the determination unit 12d to change the method or threshold value used for accident detection. As a result, the determination unit 12d executes the accident detection process after changing the detection method or threshold value.
[0093] <Example> Here, the details of the notification screen output by the determination device 10 will be described. FIG. 18 is an example of a notification screen for the accident detection method. As shown in FIG. 18, when an accident is detected in a situation where "impact only" is set among the detection methods, the notification unit 12e displays a notification screen including "Detection method: Impact only. Do you want to change the setting?" and "Do you want to change the impact threshold?". Here, when the "Yes" button requesting a setting change is selected, the setting change unit 12f changes the accident detection method to "impact + audio." When the "No" button for setting change is selected, the setting change unit 12f does not change the detection method. Furthermore, when the "Yes" button requesting a setting change for the "impact threshold" is selected, the setting change unit 12f displays a screen for changing the impact threshold set at the time of the accident. When the "No" button for setting change is selected, the setting change unit 12f does not change the threshold.
[0094] Similarly, when an accident is detected in a situation where "impact and sound" is set as the detection method, the notification unit 12e displays a notification screen including "Detection method: Impact + sound only. Do you want to change the setting?" and "Do you want to change the impact and sound thresholds?" Here, when the "Yes" button requesting a setting change is selected, the setting change unit 12f changes the accident detection method to "impact only," and when the "No" button for setting change is selected, the detection method is not changed. Furthermore, when the "Yes" button requesting a setting change for the "impact and sound thresholds" is selected, the setting change unit 12f displays a screen for changing the thresholds set when an accident occurs, and when the "No" button for setting change is selected, the thresholds are not changed.
[0095] Next, the details of the change of the threshold explained in Fig. 18 will be explained. Fig. 19 is an example of a screen for accepting a change of the threshold setting. Here, the change of the threshold of the impact (for example, the resultant vector of acceleration data) used for accident detection will be explained as an example, but the change of the threshold of the sound (for example, the total amplitude of the frequency band) used for accident detection can also be processed in a similar manner.
[0096] 19, for example, if the occupant feels annoyed that a sudden start or a sudden stop may be determined to be a minor accident by the first detection method of "impact only," the occupant sets the threshold to be higher. In this case, the setting change unit 12f displays a screen in which the vertical axis represents the threshold "impact sensitivity" and the horizontal axis represents the threshold before change (before setting), and accepts an operation to move the horizontal axis up, thereby setting a higher threshold.
[0097] On the other hand, if the occupant is concerned about the accuracy of accident detection because the sudden impact is not determined to be an accident by the first detection method of "impact only," the threshold value is set to be lower. In this case, the setting change unit 12f can set a lower threshold value by displaying the above screen and accepting an operation to move the horizontal axis downward.
[0098] Here, assumed situations in which the threshold value is changed will be explained. Fig. 20 is a diagram for explaining an example of threshold value changes on expressways and general roads.
[0099] As shown in FIG. 20, expressways tend to have more vehicles 20 traveling at high speeds than ordinary roads, and are therefore congested, resulting in louder sounds outside the vehicles 20 and a higher frequency of accident detection. In such cases, setting a higher threshold value can prevent unnecessary accident detection. On the other hand, ordinary roads tend to have fewer vehicles 20 traveling at high speeds and are not congested, resulting in quieter sounds outside the vehicles 20 and a lower frequency of accident detection. In such cases, setting a lower threshold value can detect accidents caused by small impacts or sounds.
[0100] In this way, by accepting changes to the threshold on a visually easy-to-understand screen, the judgment device 10 can reduce occupant anxiety regarding changes to the threshold settings and questions such as how to set a new threshold.
[0101] Furthermore, the setting change unit 12f can assist the occupant in changing the setting by displaying a notification screen that further associates the magnitude of the impact or the volume of the sound when an accident of the vehicle 20 is detected with the currently set impact threshold or sound threshold used to detect the accident of the vehicle 20. Explaining using the example of FIG. 19 , the setting change unit 12f displays the numerical value when the accident is detected on the vertical axis (impact sensitivity). Then, when the horizontal axis (impact threshold) is moved up or down, the setting change unit 12f displays the numerical value representing the impact sensitivity in accordance with the movement. In this way, the occupant can visually set the threshold.
[0102] As another example, the setting change unit 12f can simultaneously display the currently set impact and sound thresholds and other thresholds to be compared. Fig. 21 is a diagram for explaining threshold change with the comparison target displayed.
[0103] As shown in FIG. 21, when a request to "change threshold settings" is made on the accident notification screen, the setting change unit 12f displays the currently set threshold and a threshold to be compared on the same screen. This helps the occupant change the setting of the sensitivity (threshold) of the detection method. The comparison target may be, for example, an average threshold of users who use the same vehicle as the vehicle 20, or an average threshold by region or road. These are merely examples and are not limiting.
[0104] <Processing flow of the determination device 10> Next, an example of a processing procedure by the determination device 10 according to the second embodiment will be described. Fig. 22 is a flowchart showing an example of the processing flow in the determination device 10 according to the second embodiment. However, since the contents up to step S105 in Fig. 22 are the same as those described in the first embodiment, detailed description thereof will be omitted.
[0105] 22, when the determination device 10 detects that an accident has occurred, it displays on the notification screen what detection method was used to detect the accident (step S106). Then, when the notification ends, the determination device 10 accepts a setting change for the occupant threshold (sensitivity) (step S107) and ends the process.
[0106] <Effects of the Second Embodiment> When an accident occurs, the determination device 10 displays to the occupant what detection method was used to detect the accident and accepts an operation to change the setting of the detection method. In this way, the determination device 10 can reduce notifications due to erroneous determinations by changing the setting, and can reduce the inconvenience to the occupant of having to notify the call center every time an erroneous determination is made.
[0107] Furthermore, the determination device 10 displays the currently set impact and sound thresholds on the screen and accepts an operation to change the threshold settings, thereby enabling the detection method to be set to suit the occupant.
[0108] In addition, the determination device 10 simultaneously displays the comparison target on the setting change screen, and accepts threshold value changes on a visually easy-to-understand screen, thereby reducing occupant anxiety regarding threshold setting changes and questions such as how to set a new threshold value.
[0109] In addition, the determination device 10 accepts setting changes made by the occupant, allowing the occupant to change settings that may cause false detections, thereby reducing false detections and alerts based on false detections and reducing inconvenience to the occupant.
[0110] <Embodiment 3> (Outline of embodiment 3) In the first and second embodiments, an example has been described in which an accident is constantly notified to the external server device 7 when an accident is detected, but the present invention is not limited to this. For example, the determination device 10 can determine the accident level in stages and change the method of notifying the external server device 7 according to the determined accident level. Therefore, in the third embodiment, a description will be given of the determination device 10, which is an example of an accident notification device that classifies the accident level and selects the notification method. Note that detailed description of the system configuration of the third embodiment that is the same as that of the first and second embodiments will be omitted.
[0111] Here, improvements to the constant accident notification will be explained. Fig. 23 is a diagram for explaining improvements to the constant accident notification. Fig. 23 explains an example of a determination device 10 that is set to detect both "impact and sound" and is set to notify (issue an alert) of an accident every time an accident occurs.
[0112] 23, for example, when the determination device 10 detects an accident such as the above-mentioned large, medium or small impact, it notifies the external server device 7 of the accident. In such a determination device 10, if an attempt is made to reduce notifications due to erroneous detection, the threshold value or the like would have to be changed, which would make it difficult to detect accidents with small impacts such as slipping.
[0113] On the other hand, if the determination device 10 attempts to notify of accidents involving small impacts, the number of false positives may increase. In other words, the occupant must cancel the notification each time, which can be a hassle.
[0114] Therefore, in the determination device 10 according to the third embodiment, when an accident is detected in the vehicle 20, it is determined whether or not the criteria are met, and if the impact is large, an alert is automatically issued, whereas if the impact is small, the occupant can operate whether or not to issue an alert, and if the occupant operates the operation, an alert is issued, and if the occupant does not operate the operation, the detection is terminated without issuing an alert. In this way, the determination device 10 provides an appropriate alert while reducing the operational burden on the user in response to false detections that occur when even relatively small impacts are detected in order to prevent accident detection omissions.
[0115] (Processing contents of the determination device 10) Next, a description will be given of the processing content of the determination device 10 according to the embodiment 3. The determination device 10 according to the embodiment 3 determines the accuracy of accident detection based on the output of a sensor mounted on the vehicle 20, selects a notification mode according to the accuracy, and executes notification processing in the selected mode.
[0116] Here, a specific example of the processing content of the determination device 10 will be described. Fig. 24 is a diagram illustrating a method for determining whether or not an accident notification is necessary according to embodiment 3. Fig. 24 shows an example of classification of accidents according to the impact level and a notification method executed by the determination device 10.
[0117] For example, when the determination device 10 determines that the vehicle 20 has had an accident, it classifies the accident according to the level of the impact. As shown in Fig. 24, for example, when the determination device 10 detects an impact equal to or greater than the first standard but less than the second standard, it determines the accident as a sudden movement; when the determination device 10 detects an impact equal to or greater than the second standard but less than the third standard, it determines the accident as a medium or small impact; and when the determination device 10 detects an impact equal to or greater than the third standard, it determines the accident as a large impact. Furthermore, when the determination device 10 detects an impact less than the first standard, it determines the accident as a small impact.
[0118] Next, the determination device 10 selects a notification method using the classification of the accident according to the first to third criteria described above. For example, when the determination device 10 determines that the vehicle 20 has made a sudden movement by detecting an impact and sound, it selects the first notification mode and manually notifies the external server device 7. Manual notification is a method in which the occupant can select whether or not to notify a call center of the occurrence of an accident.
[0119] Furthermore, when the determination device 10 detects a medium or small impact, it selects the second notification mode, automatically notifies the external server device 7, and accepts cancellation of the notification by the occupant. Furthermore, when the determination device 10 detects a large impact, it selects the third notification mode, and automatically notifies the external server device 7.
[0120] As a result, when the determination device 10 determines that the vehicle 20 has had an accident, it classifies the accident according to the level of impact and selects an alarm method appropriate for the classified accident, thereby preventing alarms from being issued due to erroneous determination and reducing the burden on the occupants of having to cancel the alarm.
[0121] (Functional configuration of the determination device 10) Next, a description will be given of the functional configuration of the determination device 10. The determination device 10 according to the third embodiment determines the accuracy of accident detection based on the output of a sensor mounted on the vehicle 20, selects a reporting mode according to the accuracy, and executes reporting processing in the selected mode.
[0122] Fig. 25 is a diagram showing an example of a block diagram of the determination device 10 according to embodiment 3. The determination device 10 according to embodiment 3 has the same configurations as the storage unit 11, determination processing unit 12, short-time Fourier transform unit 13, camera 20a, microphone 20b, acceleration sensor 20c, video encoder processing unit 2, audio encoder processing unit 3, Muxer unit 4, and sudden behavior detection unit 5 described in Fig. 4 and Fig. 17, and therefore detailed description thereof will be omitted. Here, a determination unit 12d, a selection unit 12g, and a communication processing unit 12h of the determination processing unit 12, which have configurations different from those of embodiment 1 and embodiment 2, will be described.
[0123] The determination unit 12d determines the accuracy of accident detection based on the output of the acceleration sensor 20c mounted on the vehicle 20. For example, the determination unit 12d determines the accuracy of accident using a resultant vector of accelerations measured by the acceleration sensor 20c.
[0124] The selection unit 12g selects a reporting mode depending on the accuracy determined by the determination unit 12d. Here, the reporting mode selected by the selection unit 12g will be described with reference to FIG. 26. FIG. 26 is a diagram showing an example of the accuracy determined by the determination unit 12d according to the third embodiment. As shown in FIG. 26, when the accuracy is equal to or greater than a first standard and less than a second standard, the selection unit 12g determines that the vehicle has become abrupt, and selects the (1) first reporting mode. For example, the (1) first reporting mode is to manually report to the external server device 7.
[0125] Furthermore, when the accuracy is equal to or greater than the second standard and less than the third standard, the determining unit 12d determines that the impact is a medium or small impact, and the selecting unit 12g selects the (2) second notification mode. For example, the (2) second notification mode automatically issues a notification to the external server device 7, and if the notification is incorrect, a cancellation notification is accepted.
[0126] Furthermore, when the accuracy is equal to or greater than the third standard, the selection unit 12g causes the determination unit 12d to determine that the impact is a large impact, and the (3) third reporting mode is selected. For example, the (3) third reporting mode automatically issues a report to the external server device 7. Furthermore, when the accuracy is less than the first standard, the selection unit 12g causes the determination unit 12d to determine that the impact is a small impact, and the (4) fourth reporting mode is selected. For example, the (4) fourth reporting mode does not issue a report to the external server device 7.
[0127] When a third criterion, which is more accurate than the second criterion, is met, the selection unit 12g selects a third notification mode in which a notification is made without accepting a cancellation operation by the occupant. In other words, when the (3) third notification mode is selected, an operation by the occupant to cancel the issuance of a notification to the external server device 7 is not accepted. This is because the (3) third notification mode is classified as a major accident, and the necessity of issuing a notification to the external server device 7 is higher than in the (1) first notification mode or the (2) second notification mode.
[0128] The communication processing unit 12h executes the notification process in the mode selected by the selection unit 12g. Here, a selection screen for issuing an alert will be described with reference to Fig. 27. Fig. 27 is an example of the selection screen for issuing an alert according to the third embodiment. For example, when the selection unit 12g selects (1) the first notification mode or (2) the second notification mode, the communication processing unit 12h displays a screen that prompts the occupant to select whether or not to issue an alert to make a call to a call center.
[0129] Next, detailed processing when the first notification mode is selected will be described. Fig. 28 is a diagram showing detailed processing when the first notification mode according to embodiment 3 is selected. When the selection unit 12g selects (1) the first notification mode, the communication processing unit 12h presents information prompting the occupant to perform a notification operation, and then, if the notification operation is not performed within a predetermined time, stops presenting the information prompting the occupant to perform a notification operation.
[0130] That is, when the selection unit 12g selects (1) the first notification mode, the communication processing unit 12h stops displaying the screen prompting the occupant to issue a manual notification if the occupant has not issued a notification to the external server device 7 within a certain time period. As a result, even if the determination device 10 recognizes that the occupant has not had an accident and the first notification mode is selected and a screen prompting the occupant to issue a manual notification is displayed, the notification will not be issued to the external server device 7 unless the occupant operates to issue a notification, thereby eliminating the need for the occupant to cancel the notification and reducing the burden on the occupant.
[0131] Furthermore, the communication processing unit 12h accepts an operation to cancel the issuance of the alert when the selection unit 12g selects (2) the second notification mode but the occupant recognizes that there is no accident, or when an impact has occurred but the occupant is not in a state to call the call center. This allows the determination device 10 to reduce erroneous determinations and eliminate the burden on the occupant by eliminating the need to cancel the issuance of the alert every time an erroneous determination occurs.
[0132] (Determination by acceleration) The determination unit 12d can also determine the accuracy using impact data obtained from the acceleration sensor 20c. Fig. 29 is a diagram showing an example of the accuracy determined by the determination unit 12d according to the third embodiment using data obtained from the acceleration sensor 20c. For example, the determination unit 12d determines that the accuracy satisfies the first criterion when the output of the acceleration sensor 20c exceeds the first impact threshold and, at the same time, the output of the microphone 20b exceeds the first sound threshold. In other words, the determination unit 12d determines that the accuracy satisfies the first criterion when the conditions (1) that the impact is equal to or greater than the first impact threshold and less than the second impact threshold and (2) that the sound is equal to or greater than the first sound threshold are simultaneously satisfied.
[0133] Furthermore, the determination unit 12d determines that the accuracy satisfies the second criterion when the output of the acceleration sensor 20c exceeds a second impact threshold that is greater than the first impact threshold. That is, the determination unit 12d determines that the accuracy satisfies the second criterion when the condition (3) is satisfied, which is the threshold of the impact that is equal to or greater than the second criterion.
[0134] <Processing flow of the determination device 10> Next, an example of the processing procedure of the determination device 10 according to the third embodiment will be described with reference to Fig. 30 and Fig. 31. Fig. 30 is a flowchart showing an example of the accident notification processing procedure according to the third embodiment. However, since the contents up to step S104 in Fig. 30 are the same as those described in the first and second embodiments, detailed description thereof will be omitted.
[0135] 30, the determination device 10 determines the accuracy of accident detection by combining the impact and the sound inside the vehicle 20 (step S105). Then, the determination device 10 selects a notification mode according to the determined accuracy (step S106), and executes notification processing to the external server device 7 in the selected notification mode (step S107). Note that the selection of the notification mode will be described in detail later.
[0136] Fig. 31 is a flowchart showing an example of an accident notification processing procedure according to embodiment 3. As shown in Fig. 31, when the accuracy is higher than the first standard (step S201, Yes), the determination device 10 determines whether the accuracy is higher than the second standard (step S203). On the other hand, when the accuracy is lower than the first standard (step S201, No), the determination device 10 determines that the impact is a minor impact and does not issue an alert (step S202).
[0137] Next, if the accuracy is higher than the second standard (step S203, Yes), the determination device 10 determines whether the accuracy is higher than a third standard (step S205). On the other hand, if the accuracy is lower than the second standard (step S203, No), the determination device 10 determines that the vehicle is moving suddenly and issues a manual alert (step S204).
[0138] Next, if the accuracy is higher than the third standard (step S205, Yes), the determination device 10 determines that the impact is a large impact and issues an automatic alert (step S206). On the other hand, if the accuracy is lower than the third standard (step S205, No), the determination device 10 determines that the impact is a medium or small impact and accepts automatic alerting and cancellation of the alerting (step S207).
[0139] <Effects of the Third Embodiment> In the third embodiment, when it is detected that the vehicle 20 has had an accident, the accuracy of the accident detection is determined, and the method of issuing an alert is changed according to the determined accuracy: automatic alert for a large impact, automatic alert and cancellation of alert for a medium or small impact, and manual alert for a sudden movement. As a result, the determination device 10 can issue an appropriate alert while reducing the operational burden on the occupant, even if a false detection occurs due to the setting of the detection method.
[0140] In addition, when a sudden movement is detected, the judgment device 10 manually issues a notification to the external server device 7, so that the notification is only issued when an operation to issue the notification is performed, and by automatically ceasing to issue the notification after a certain period of time has elapsed, false detections can be prevented and the burden on occupants can be reduced.
[0141] In addition, the determination device 10 automatically issues a notification to the external server device 7 when a major impact is detected, and does not accept cancellation of the notification from the occupant, thereby enabling a rapid response to major accidents.
[0142] In addition, the judgment device 10 automatically issues a report to the external server device 7 when a medium or small impact is detected, and by accepting cancellation of the report from the occupant, it is possible to cancel the report if the occupant does not recognize it as an accident but the device determines that it is an accident.
[0143] <Embodiment 4> Although the embodiments of the present invention have been described above, the present invention may be embodied in various different forms other than the above-described embodiments.
[0144] (Numbers, etc.) The numerical values, graphs, threshold values (for example, arbitrary numerical values), etc. used in the above embodiments are merely examples and can be changed as desired. Furthermore, in the above embodiments, an example using the amplitude of sound has been described, but this is not limiting, and similar processing can also be performed using sound pressure in decibels (db). Note that each embodiment can be applied to various vehicles, such as private cars, taxis, buses, electric vehicles, hybrid vehicles, motorcycles, and three-wheeled vehicles.
[0145] <Hardware> The determination device 100 according to the first, second, and third embodiments described above is realized, for example, by a computer 1000 configured as shown in Fig. 32. The determination device 100 will be described below as an example. Fig. 32 is a hardware configuration diagram showing an example of a computer that realizes the functions of the determination device according to the first, second, third, and fourth embodiments. The computer 1000 has a CPU 1100, a RAM 1200, a ROM 1300, an HDD 1400, a communication interface (I / F) 1500, an input / output interface (I / F) 1600, and a media interface (I / F) 1700.
[0146] The CPU 1100 operates and controls each unit based on programs stored in the ROM 1300 or the HDD 1400. The ROM 1300 stores a boot program executed by the CPU 1100 when the computer 1000 starts up, programs that depend on the hardware of the computer 1000, and the like.
[0147] HDD 1400 stores programs executed by CPU 1100, data used by such programs, etc. Communication interface 1500 receives data from other devices via a predetermined communication network and sends it to CPU 1100, and transmits data generated by CPU 1100 to other devices via a predetermined communication network.
[0148] The CPU 1100 controls output devices such as a display and a printer, and input devices such as a keyboard and a mouse, via the input / output interface 1600. The CPU 1100 acquires data from the input devices via the input / output interface 1600. The CPU 1100 also outputs generated data to the output devices via the input / output interface 1600.
[0149] Media interface 1700 reads a program or data stored in recording medium 1800 and provides it to CPU 1100 via RAM 1200. CPU 1100 loads the program or data from recording medium 1800 onto RAM 1200 via media interface 1700 and executes the loaded program. Recording medium 1800 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or a PD (Phase Change Rewritable Disc), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory.
[0150] For example, when the computer 1000 functions as the determination device 100 according to the first, second, third, and fourth embodiments, the CPU 1100 of the computer 1000 executes programs loaded onto the RAM 1200 to implement the functions of the determination processing unit 12, the video encoder processing unit 2, the audio encoder processing unit 3, and the muxer unit 4. The CPU 1100 of the computer 1000 reads and executes these programs from the recording medium 1800, but as another example, the CPU 1100 may acquire these programs from another device via a predetermined communication network.
[0151] <Other> Furthermore, among the processes described in each of the above embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically using known methods. In addition, the information including the processing procedures, specific names, various data, and parameters shown in the above documents and drawings can be changed as desired unless otherwise specified. For example, the various information shown in each drawing is not limited to the information shown in the drawings.
[0152] Furthermore, the components of each device shown in the figure are conceptual functional components and do not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit depending on various loads, usage conditions, etc.
[0153] Furthermore, the above-described embodiments can be combined as appropriate within the scope of not causing any contradiction in the processing content.
[0154] Although some of the embodiments of the present application have been described in detail above with reference to the drawings, these are merely examples, and the present invention can be implemented in other forms that include the embodiments described in the Disclosure of the Invention section and that have undergone various modifications and improvements based on the knowledge of those skilled in the art.
[0155] Furthermore, the above-mentioned "section, module, unit" can be read as "means" or "circuit," etc. For example, a receiving section can be read as receiving means or receiving circuit. [Explanation of symbols]
[0156] 2 Video encoder processing section 3 Audio Encoder Processing Section 4 Muxer section 7. External server device 10 Judgment device 11 Storage section 11a Video file 12. Judgment processing unit 12a Impact detection unit 12b Audio detection unit 12c calculation part 12d Judgment section 12e Notification Department 12f Setting change section 12g Selection section 12h communication processing unit 13 Short-time Fourier transform section 13a Window hanging part 13b FFT section 20a Camera 20b Microphone 20c Accelerometer
Claims
1. An accident reporting device that is mounted on a vehicle and reports to the outside when an accident involving the vehicle is detected, a determination unit that determines the accuracy of accident detection based on the output of a sensor mounted on the vehicle; a selection unit that selects a mode of the notification in accordance with the accuracy; a notification processing unit that executes notification processing in the mode selected by the selection unit; Equipped with The selection unit, when the degree of certainty meets a first criterion, presents information prompting the user to perform a reporting operation, and selects a first reporting mode in which the reporting operation is made when the reporting operation by the user is accepted, and when the degree of certainty meets a second criterion that is higher than the first criterion, selects a second reporting mode in which the reporting operation is made automatically unless a cancellation operation is accepted by the user within a specified time.
2. The accident notification device described in claim 1, characterized in that when the first notification mode is selected, the notification processing unit presents information to the user prompting the user to perform a notification operation, and then, if the user does not perform the notification operation within a predetermined time, executes a notification process to stop presenting the information prompting the user to perform the notification operation.
3. The accident notification device according to claim 1, characterized in that the selection unit selects a third notification mode in which a notification is made without accepting a cancellation operation by the occupant when a third criterion, which has a higher degree of certainty than the second criterion, is met.
4. The sensor An acceleration sensor and a microphone are included, The determination unit determining that the accuracy satisfies a first criterion when the output of the acceleration sensor exceeds a first impact threshold and, at approximately the same time, the output of the microphone exceeds a first sound threshold; 2. The accident reporting device according to claim 1, wherein the accuracy is determined to satisfy a second standard when the output of the acceleration sensor exceeds a second impact threshold that is greater than the first impact threshold.
5. An accident reporting method that is mounted on a vehicle and reports to an outside party when an accident involving the vehicle is detected, a determination method for determining the accuracy of accident detection based on the output of a sensor mounted on the vehicle; a selection method for selecting a mode of the notification according to the accuracy; a notification processing method for executing notification processing in the mode selected by the selection method; Equipped with The selection method is characterized in that, when the certainty satisfies a first criterion, information is presented to the user to prompt them to perform a reporting operation, and a first reporting mode is selected in which the reporting operation is made when the reporting operation by the user is accepted, and when the certainty satisfies a second criterion that is higher than the first criterion, a second reporting mode is selected in which the reporting is made automatically unless a cancellation operation is accepted by the user within a specified time.
6. An accident reporting program that is installed in a vehicle and that reports to an outside party when an accident involving the vehicle is detected, a determination step of determining the accuracy of accident detection based on the output of a sensor mounted on the vehicle; a selection step of selecting a mode of the notification in accordance with the certainty; a notification processing step of executing a notification process in the mode selected by the selection step; Equipped with The selection step is characterized by selecting a first reporting mode in which, when the certainty satisfies a first criterion, information prompting the user to perform a reporting operation is presented to the user and the reporting operation is performed when the reporting operation by the user is accepted, and selecting a second reporting mode in which, when the certainty satisfies a second criterion that is higher than the first criterion, the reporting operation is automatically performed unless a cancellation operation is accepted by the user within a specified time.
Citation Information
Patent Citations
Drive recorder main body and apparatus
JP2022000818A