Driving data recording device and method, driving support system, and recording medium
By integrating external condition information and driver identification capability information processing modules in the dash recorder, external condition information that is consistent with the driver's perception is solved, and the problem that the existing technology cannot understand the driver identification capability is achieved, and more accurate driving is achieved Risk analysis and accident investigation.
Patent Information
- Application Number
- CN202111296838.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2020-11-17
- Filing Date
- 2021-11-03
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2041-11-03
AI Technical Summary
Existing dash recorders can only record original information about surrounding conditions and cannot determine how the driver can identify these conditions, resulting in the inability to accurately understand the driver's external recognition ability.
A driving data recording device is designed to process and output information by obtaining external condition information and driver's external recognition ability information to generate perceptual information corresponding to the driver's external recognition ability. The device can obtain external conditions through imaging and sound input, and perform data processing based on the driver's vision or hearing information to generate conditions that the driver may perceive.
It realizes a recording method based on the driver's external recognition ability, provides external situation information consistent with the driver's perception, and can be used for accident investigation and driving risk analysis, improving the accuracy of driving support.
Smart Images

Figure CN114511944B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a driving data recording device and method, a driving support system, and a recording medium. Background Art
[0002] In the past, so-called driving recorders, which are installed on mobile objects such as vehicles and record the conditions around the installation location in the form of sound, image, etc., have been put into practical use (for example, see Japanese Patent Publication No. 2020-052634). The information recorded in the driving recorder is used for on-site investigation of traffic accidents and identification of the causes of accidents. Summary of the invention
[0003] However, the information recorded by the conventional driving recorder originally shows the surrounding conditions at the time of recording. Therefore, if only the information recorded in the driving recorder is used, it may not be known how the driver of the moving object recognized the conditions.
[0004] One object of the aspects of the present invention is to provide a driving data recording device and method, a driving support system, and a recording medium capable of recording the conditions around a moving object in a manner that matches the driver's ability to recognize the outside world.
[0005] The first scheme of the present invention relates to a driving data recording device, wherein the driving data recording device comprises: an external condition information acquisition unit, which acquires external condition information representing the external condition of the mobile body while the mobile body is traveling; an ability information acquisition unit, which acquires ability information representing the external recognition ability of the driver of the mobile body; and an information processing unit, which processes the external condition information based on the ability information.
[0006] The second scheme of the present invention is based on the driving data recording device of the above-mentioned first scheme, and it can also be that the external condition information acquisition unit acquires image data obtained by photographing the outside of the mobile body as the external condition information, the ability information acquisition unit acquires information representing the driver's eyesight during driving of the mobile body as the ability information, and the information processing unit processes the image data based on the information representing the driver's eyesight.
[0007] The third scheme of the present invention is based on the driving data recording device of the above-mentioned first scheme, and it can also be that the external condition information acquisition unit acquires sound data obtained by recording the external sounds of the mobile body as the external condition information, the ability information acquisition unit acquires information representing the hearing of the driver during driving of the mobile body as the ability information, and the information processing unit processes the sound data based on the information representing the hearing of the driver.
[0008] The fourth scheme of the present invention is based on the driving data recording device involved in any one of the above-mentioned first to third schemes, and may also be provided with an information output unit, which determines the attribute of the device of the output object, and when it is determined that the attribute is a specified attribute, the external condition information processed by the information processing unit is output to the device of the output object.
[0009] The fifth scheme of the present invention is based on the driving data recording device involved in any one of the above-mentioned first to third schemes, and may also be further equipped with: a storage unit, which stores the external condition information before processing; and an information output unit, which instructs the information processing unit to process the external condition information before processing when it is decided to output the processed external condition information.
[0010] A sixth scheme of the present invention relates to a driving support system, comprising: a driving data recording device of any one of the first to fifth schemes described above; and a driving data analysis device, which has a driving data collection unit, a driving data analysis unit and a support information providing unit, wherein the driving data collection unit collects driving data including at least the external condition information and the capability information processed by the information processing unit from one or more of the driving data recording devices, the driving data analysis unit analyzes driving risks associated with driving of the mobile body based on the driving data, and the support information providing unit generates driving support information for supporting driving of a subject person for driving support based on the analysis results of the driving risks, and provides the generated driving support information to the driving support device used by the subject person.
[0011] The seventh scheme of the present invention is based on the driving assistance system of the sixth scheme mentioned above, and may also be further provided with the driving assistance device having a driving assistance information acquisition unit and a reporting unit, wherein the driving assistance information acquisition unit acquires the driving assistance information from the driving data analysis device, and the reporting unit reports the driving risks related to the driving of the mobile body to the subject person based on the driving assistance information.
[0012] An eighth aspect of the present invention is based on the driving support system of the seventh aspect, and may be such that the driving data analysis unit analyzes the driving risk associated with a location, and the reporting unit reports the attention-calling related to the location to the subject.
[0013] The ninth scheme of the present invention relates to a driving data recording method, wherein the driving data recording method causes the computer to perform processing including: obtaining external condition information representing the external condition of the mobile body during the driving of the mobile body; obtaining ability information representing the external recognition ability of the driver of the mobile body; and processing the external condition information based on the ability information.
[0014] The tenth scheme of the present invention relates to a recording medium, which records a program, wherein the program causes a computer to perform the following processing: obtain external condition information representing the external condition of the mobile body during its travel; obtain ability information representing the external environment recognition ability of the driver of the mobile body; and process the external condition information based on the ability information.
[0015] According to the above-mentioned first to tenth schemes, external condition information representing the external condition of the mobile body while the mobile body is traveling is obtained, ability information representing the external recognition ability of the driver of the mobile body is obtained, and the external condition information is processed based on the ability information, thereby being able to record the conditions around the mobile body in a manner corresponding to the driver's external recognition ability. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] Figure 1 It is a diagram showing a configuration example of a driving support system according to an embodiment.
[0017] Figure 2 It is a diagram showing an overview of a driving support system according to an embodiment.
[0018] Figure 3 This is a diagram showing an example of processing of the external environment information acquired as image data in the driving data recording device according to the embodiment.
[0019] Figure 4 This is a sequence diagram showing an example of the flow of processing executed by the driving support system according to the embodiment to realize driving support for the support target person.
[0020] Figure 5 It is a diagram showing an example of the external environment condition information in the embodiment.
[0021] Figure 6 This is a diagram showing an example of capability information in an embodiment.
[0022] Figure 7 It is a diagram showing an example of the analysis result of the driving risk in the embodiment. DETAILED DESCRIPTION
[0023] Hereinafter, embodiments of a driving data recording device and method, a driving support system, and a recording medium according to the present invention will be described with reference to the accompanying drawings.
[0024] Figure 11 is a diagram showing a configuration example of a driving support system 100 according to an embodiment. The driving support system 100 includes a driving data recording device 200, a driving data analysis device 300, and a driving support device 400. The driving data recording device 200, the driving data analysis device 300, and the driving support device 400 are connected in a manner capable of communicating via a network NW. For example, the network NW is a WAN (Wide Area Network) including the Internet, a cellular network, and the like.
[0025] The driving data recording device 200 is a device that is installed in a mobile body such as a vehicle, and functions as a so-called drive recorder that records the conditions near the installation location in the form of sound, video, etc. Hereinafter, information indicating the conditions near the mobile body where the driving data recording device 200 is installed is referred to as "external condition information."
[0026] In addition to the function of recording such external condition information, the driving data recording device 200 of the present embodiment also has a function of obtaining "capability information" indicating the external recognition capability of the driver of the mobile body equipped with the device. The external recognition capability is the capability of the driver of the mobile body to recognize the external conditions of the mobile body while driving the mobile body. The driving data recording device 200 of the present embodiment has a function of supplying the external condition information, capability information and other data obtained in this way to the driving data analysis device 300 as data for analyzing driving risks described later. Hereinafter, the data for analysis supplied by the driving data recording device 200 to the driving data analysis device 300 is referred to as "driving data".
[0027] The driving data analysis device 300 is a device that analyzes the driving data supplied from the driving data recording device 200. More specifically, the driving data analysis device 300 analyzes the risk associated with the driving of a mobile body (hereinafter referred to as "driving risk") based on the driving data collected from one or more driving data recording devices 200, and generates driving support information based on the analysis result. The driving support information is information that supports the subject's driving of the mobile body. For example, the driving data analysis device 300 generates information representing the driving risk that matches the subject as driving support information based on the analysis result of the driving risk and the subject's external recognition ability. The driving data analysis device 300 supplies the generated driving support information to the driving support device 400 mounted on the mobile body driven by the subject.
[0028] The driving support device 400 is, for example, a device that is provided on a mobile body driven by a subject person for driving support, and supports the subject person in driving the mobile body. More specifically, the driving support device 400 obtains driving support information from the driving data analysis device 300, and performs an action (hereinafter referred to as a "driving support action") based on the obtained driving support information, thereby supporting the subject person's driving. For example, as an example of a driving support action, the driving support device 400 may perform an action of reporting the content indicated by the driving support information to the driver, or may perform an action of assisting the driving operation based on the content indicated by the driving support information.
[0029] The following describes the configurations of the driving data recording device 200, the driving data analyzing device 300, and the driving support device 400 in more detail. Figure 2 The driving data recording device 200 and the driving support device 400 are shown in the figure as being mounted on a vehicle. In addition, hereinafter, a vehicle equipped with the driving data recording device 200 is sometimes referred to as a "data collection vehicle", and a vehicle equipped with the driving support device 400 is sometimes referred to as a "support target vehicle" to distinguish between the two. In addition, hereinafter, a driver of the data collection vehicle is sometimes referred to as an "analysis target person", and a driver of the support target vehicle is sometimes referred to as a "support target person" to distinguish between the two.
[0030] The driving data recording device 200 includes a communication unit 210, an input unit 220, a display unit 230, a storage unit 240, a camera unit 250, a sound input unit 260, and a control unit 270. The control unit 270 among these components is implemented by, for example, a hardware processor such as a CPU (Central Processing Unit) executing a program (software). Some or all of these components may be implemented by hardware (including a circuit unit: circuitry) such as an LSI (Large Scale Integration), an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), and a GPU (Graphics Processing Unit), or may be implemented by the cooperation of software and hardware. The program may be stored in advance in a storage device (a storage device having a non-temporary storage medium) such as an HDD (Hard Disk Drive) or a flash memory, or may be stored in a removable storage medium (a non-temporary storage medium) such as a DVD or a CD-ROM, and installed by assembling the storage medium in a drive device.
[0031] The communication unit 210 is a communication interface for connecting the driving data recording device 200 to the network NW. For example, the communication unit 210 is configured using a wireless communication interface connected to a cellular network. The communication unit 210 is connected to the driving data analysis device 300 via the network NW in a communicable manner.
[0032] The input unit 220 is configured using input devices such as buttons, switches, keyboards, mice, and touch panels. The input unit 220 receives input of operations performed on the driving data recording device 200. The input unit 220 outputs input information indicating the content of the received operation input to the control unit 270.
[0033] The display unit 230 is configured using a display device such as a liquid crystal display, an organic EL (Electro-luminescence) display, a touch panel, etc. The display unit 230 can display arbitrary information based on the instruction of the control unit 270. For example, the display unit 230 can also display the driving data recorded in the driving data recording device 200.
[0034] The storage unit 240 is configured using a storage device such as an HDD or a flash memory. In addition to storing data of a program executed by the driving data recording device 200, image data and video data obtained by the camera unit 250, and audio data obtained by the audio input unit 260, the storage unit 240 also stores various information related to the operation of the driving data recording device 200.
[0035] The imaging unit 250 is configured using an imaging device such as a camera. The imaging unit 250 is installed at a position and posture relative to the data collection vehicle where the driving data recording device 200 is installed so as to be able to capture the external conditions of the vehicle. The imaging unit 250 performs imaging operations according to the instructions of the control unit 270, thereby generating image data of the subject. The imaging unit 250 may also be configured to be able to adjust its imaging range according to the instructions of the control unit 270. The imaging unit 250 outputs the generated image data to the control unit 270.
[0036] The sound input unit 260 is configured using a sound input device such as a microphone. The sound input unit 260 is installed at a position where it can record the sound outside the vehicle relative to the data collection vehicle where the driving data recording device 200 is installed. The sound input unit 260 performs a recording operation according to the instruction of the control unit 270, thereby generating sound data recording the sound outside the data collection vehicle. The sound input unit 260 outputs the generated sound data to the control unit 270.
[0037] The control unit 270 has the function of inputting and outputting information with the communication unit 210, the input unit 220, the display unit 230, the storage unit 240, the camera unit 250, and the sound input unit 260, and controlling the operation of the driving data recording device 200. Here, the control functions of the control unit 270 include the function of acquiring external condition information related to the data collection vehicle on which the driving data recording device 200 is installed, the function of acquiring the ability information of the driver driving the vehicle, the function of processing the acquired external condition information, and the function of outputting various information including the external condition information. The control unit 270 includes an external condition information acquisition unit 271, an ability information acquisition unit 272, an information processing unit 273, and an information output unit 274 as functional units for realizing these functions.
[0038] The external condition information acquisition unit 271 causes the imaging unit 250 and the audio input unit 260 to perform imaging and audio recording operations at predetermined timings, thereby acquiring external condition information indicating the condition of the outside of the vehicle while the data collection vehicle is traveling. The external condition information acquisition unit 271 records the acquired external condition information in the storage unit 240 .
[0039] The ability information acquisition unit 272 acquires ability information indicating the outside world recognition ability of the driver of the data collection vehicle while driving the vehicle. For example, the ability information acquisition unit 272 acquires information indicating the vision or hearing of the driver of the data collection vehicle as ability information. The information indicating the vision or hearing of the driver of the data collection vehicle may be pre-stored in the storage unit 240, or may be received from another device via the communication unit 210. In addition, when the ability information acquisition unit 272 is able to acquire the biological information of the driver driving the data collection vehicle, it may also acquire information indicating the vision or hearing corresponding to the state of the driver driving the vehicle as ability information.
[0040] For example, as an example of biological information, heart rate, respiratory rate, blood pressure, body temperature, degree of alertness, etc. can be cited. Part or all of this biological information can be generated by the capability information acquisition unit 272, or can be acquired from an information terminal such as a so-called smart watch that has a function of acquiring biological information. In addition, as a method of measuring biological information, in addition to a method of directly measuring using a dedicated medical measuring instrument, a measurement method based on image processing, a measurement method based on sound processing, etc. can also be cited. In the case where the capability information acquisition unit 272 generates biological information, in addition to the camera unit 250 and the sound input unit 260 for acquiring external condition information, the driving data recording device 200 can also be equipped with a camera unit and a sound input unit for acquiring biological information.
[0041] For example, the ability information acquisition unit 272 may acquire information obtained by correcting the normal external recognition ability of the driver of the data collection vehicle based on the value of the biometric information as the ability information. For example, for a driver whose vision at a normal level of sobriety is 1.0, when it is detected that the sobriety during driving has dropped to half of the normal level, for example, the ability information acquisition unit 272 may set half of the vision 1.0 at the normal level of sobriety, that is, 0.5, as the driver's vision at this time. The ability information acquisition unit 272 records the ability information thus acquired in the storage unit 240.
[0042] The information processing unit 273 processes the external condition information obtained about the data collection vehicle based on the ability information obtained about the driver of the vehicle when the external condition information was obtained. The information processing unit 273 records the processed external condition information in the storage unit 240. The information processing unit 273 may process the obtained external condition information itself, or may process information obtained by copying the obtained external condition information.
[0043] Figure 3 : is a diagram showing an example of processing of external condition information obtained as image data. Image P1 shows an example of an image shown by the image data before processing, and image P2 shows an example of an image shown by the image data after processing. Here, the processed image P2 is an image generated by reducing the resolution of the image P1 before processing. For example, the image P2 can be generated by a so-called blurring process in which each pixel value of the image P2 is determined based on a plurality of pixel values of the corresponding image P1.
[0044] In this case, for example, the information processing unit 273 determines the resolution of the processed image based on the external recognition ability of the driver of the data collection vehicle, and blurs the image P1 so that it becomes the determined resolution, thereby generating the image P2. For example, when the Landolt ring is used to measure the visual acuity, the information processing unit 273 can determine the resolution of the processed image based on the information indicating the visual acuity of the driver by using the relationship of the following formula (1).
[0045] Res=Itr×Ld / (Lx×Od)···(1)
[0046] In formula (1), Res represents the resolution [dpi] of the processed image. Ld represents the distance from the Landolt ring to the center of the viewpoint, which serves as a reference. Specifically, Ld is 5 [m].
[0047] Itr represents the actual size of 1 inch, that is, 25.4 [mm]. Ps represents the driver's vision. Lx represents the length of the gap of the Landolt ring corresponding to the vision Ps [mm]. Od represents the distance from the driver's viewpoint to the subject captured in the image. Od can be a distance estimated based on image data, or it can be a distance measured by sensors such as LiDAR (Light Detection and Ranging). According to such formula (1), the clarity of the scenery that the driver will perceive through vision while driving can be obtained based on the vision of the driver while driving the data collection vehicle, as the resolution of the image (hereinafter referred to as "capability-equivalent resolution"). The information processing unit 273 generates an image P2 after reducing the resolution of the image P1 before processing to the capability-equivalent resolution, thereby being able to obtain image data representing the external conditions that the driver of the data collection vehicle will perceive while driving the vehicle.
[0048] In addition, as another example of a method of processing external condition information, the following case is considered: based on information indicating the hearing of the driver when driving the data collection vehicle, the external sound data obtained as the external condition information is processed. In this case, for example, the information processing unit 273 obtains a sonogram indicating the hearing of the driver in Hertz and decibel as the ability information, and transforms the sonogram of the sound data according to the hearing of the driver, thereby obtaining sound data indicating the external condition that the driver of the data collection vehicle can perceive through hearing.
[0049] In this way, the information processing unit 273 processes the external condition information based on the driver's ability information, thereby generating information indicating the external condition that the driver of the data collection vehicle will perceive when the vehicle is driving. In this sense, the processed external condition information is sometimes referred to as perception information below. The information processing unit 273 establishes a corresponding relationship between the generated perception information and the external condition information and ability information of the generation source and records them in the storage unit 240.
[0050] The information output unit 274 has a function of outputting various information stored in the driving data recording device 200 to the outside as needed. The information output to the outside described here includes, in addition to data transmission via the communication unit 210, information display by a display device, sound output by a sound output device, and information recording to a recording medium. Specifically, the information output unit 274 is configured to output information to a device designated as an output target (hereinafter referred to as a "target device") when the specified conditions are met.
[0051] For example, the information output unit 274 may be configured to determine whether the target device has a predetermined attribute, and output information to the target device if the target device is determined to have the predetermined attribute. In this case, the attribute determined for the target device may be any attribute as long as it can determine whether the target device is appropriate as a target for providing information.
[0052] For example, the attribute of the target device may be identification information of the target device, information indicating the owner of the target device, information indicating the model and category of the target device, or an attribute related to the function of the target device. In this way, when the target device is a device with a specified attribute, the information output unit 274 outputs information to the target device, thereby preventing the perception information and capability information that may become personal information from being circulated to multiple non-specific devices.
[0053] It should be noted that the information output unit 274 may also be configured to output information to the object device when an operation of outputting permission information is inputted with respect to the object device. In addition, the information output unit 274 may also be configured to change the output information and the method of outputting the information according to the properties of the object device. For example, the information output unit 274 may also be configured to output the sensed information as processed external condition information to a specific object device regarding the output of information obtained based on the external condition information, and to output the external condition information before processing to other object devices. In addition, for example, the information output unit 274 may also be configured to instruct the information processing unit 273 to generate sensed information (process the external condition information) when the output of sensed information is required.
[0054] On the other hand, the information output unit 274 sends the following driving data, which includes at least perception information obtained about the driver of the host vehicle and capability information corresponding to the perception information, to the driving data analysis device 300. The perception information and capability information sent to the driving data analysis device 300 are used for analyzing risks related to driving, and the driving support information obtained based on the analysis result is provided to the driving support device 400 used by the driver of the support target vehicle.
[0055] Next, the structure of the driving data analysis device 300 is described. The driving data analysis device 300 includes a communication unit 310, an input unit 320, a display unit 330, a storage unit 340, and a control unit 350. The control unit 350 among these components is implemented by, for example, a hardware processor such as a CPU executing a program (software). Some or all of these components may be implemented by hardware (including a circuit unit: circuitry) such as an LSI, an ASIC, an FPGA, a GPU, or the like, or may be implemented by the cooperation of software and hardware. The program may be stored in advance in a storage device such as an HDD or a flash memory (a storage device having a non-temporary storage medium), or may be stored in a removable storage medium such as a DVD or a CD-ROM (a non-temporary storage medium), and installed by assembling the storage medium in a drive device.
[0056] The communication unit 310 is a communication interface for connecting the driving data analysis device 300 to the network NW. For example, the communication unit 310 is configured using a wired or wireless LAN (Local Area Network) interface that can be connected to the Internet. The communication unit 310 is connected to the driving data recording device 200 and the driving support device 400 via the network NW in a manner that allows communication.
[0057] The input unit 320 is configured using input devices such as buttons, switches, keyboards, mice, and touch panels. The input unit 320 receives input of operations performed on the driving data analysis device 300. The input unit 320 outputs input information indicating the content of the received operation input to the control unit 350.
[0058] The display unit 330 is configured using a display device such as a liquid crystal display, an organic EL display, or a touch panel. The display unit 330 can display arbitrary information based on an instruction from the control unit 350 .
[0059] The storage unit 340 is configured using a storage device such as an HDD or a flash memory. In the storage unit 340, various information related to the operation of the driving data analysis device 300 is stored in addition to data of a program executed by the driving data analysis device 300, driving data obtained from the driving data recording device 200, information indicating the analysis results thereof, and driving support information generated based on the analysis results.
[0060] The control unit 350 has a function of inputting and outputting information with the communication unit 310, the input unit 320, the display unit 330, and the storage unit 340, and controlling the operation of the driving data analysis device 300. Here, the control function of the control unit 350 includes a function of collecting driving data of the analysis target person from the driving data recording device 200 of each data collection vehicle, a function of analyzing the collected driving data, and a function of generating driving support information based on the analysis result of the driving data. The control unit 350 includes a driving data collection unit 351, a driving data analysis unit 352, and a driving support information provision unit 353 as functional units for realizing these functions.
[0061] The driving data collection unit 351 has a function of collecting driving data from one or more driving data recording devices 200 . The driving data collection unit 351 records the driving data collected from each driving data recording device 200 in the storage unit 340 .
[0062] The driving data analysis unit 352 has a function of analyzing driving risks related to driving of the vehicle based on the driving data collected from each driving data recording device 200 . The analysis method of driving data will be described later. The driving data analysis unit 352 records the analysis result of driving risks in the storage unit 340 .
[0063] The driving support information providing unit 353 has a function of providing the driver of the support target vehicle with driving support information for supporting the driving of the vehicle. Specifically, the driving support information providing unit 353 generates driving support information based on the analysis result of the driving risk, and sends the generated driving support information to the driving support device 400. The driving support information providing unit 353 may be configured to generate and send driving support information periodically, or may be configured to generate and send driving support information when a request for driving support information is received from the driving support device 400.
[0064] Next, the structure of the driving support device 400 is described. The driving support device 400 includes a communication unit 410, an input unit 420, a display unit 430, a storage unit 440, a camera unit 450, a sound input unit 460, a sound output unit 470, and a control unit 480. The control unit 480 among these components is implemented by, for example, a hardware processor such as a CPU executing a program (software). Some or all of these components can be implemented by hardware (including a circuit unit: circuitry) such as an LSI, an ASIC, an FPGA, a GPU, or can be implemented by the cooperation of software and hardware. The program can be pre-stored in a storage device such as an HDD or a flash memory (a storage device having a non-temporary storage medium), or can be stored in a removable storage medium such as a DVD or a CD-ROM (a non-temporary storage medium), and installed by assembling the storage medium in a drive device.
[0065] The communication unit 410 is a communication interface that connects the driving support device 400 to the network NW. For example, the communication unit 410 is configured using a wireless communication interface that connects to a cellular network. The communication unit 410 is connected to the driving data analysis device 300 via the network NW so as to be able to communicate.
[0066] The input unit 420 is configured using input devices such as buttons, switches, keyboards, mice, and touch panels. The input unit 420 receives input of operations performed on the driving support device 400. The input unit 420 outputs input information indicating the content of the received operation input to the control unit 480.
[0067] The display unit 430 is configured using a display device such as a liquid crystal display, an organic EL display, or a touch panel. The display unit 430 can display any information based on the instruction of the control unit 480. For example, the display unit 430 can also display driving support information provided by the driving data analysis device 300. For example, the display unit 430 is used as one of the means for reporting information by the reporting unit described later.
[0068] The storage unit 440 is configured using a storage device such as an HDD or a flash memory. In addition to data of a program executed by the driving support device 400, image data and video data obtained by the camera unit 450, audio data obtained by the audio input unit 460, and driving support information obtained from the driving data analysis device 300, the storage unit 440 also stores various information related to the operation of the driving support device 400.
[0069] The imaging unit 450 is configured using an imaging device such as a camera. The imaging unit 450 is installed at a position and posture relative to the vehicle to be supported in which the driving support device 400 is installed, so as to be able to capture the external conditions of the vehicle. The imaging unit 450 performs imaging operations according to the instructions of the control unit 480, thereby generating image data of the subject. The imaging unit 450 may also be configured to be able to adjust its imaging range according to the instructions of the control unit 480. The imaging unit 450 outputs the generated image data to the control unit 480.
[0070] The sound input unit 460 is configured using a sound input device such as a microphone. The sound input unit 460 is installed at a position where it can record the sound outside the vehicle relative to the support target vehicle in which the driving support device 400 is installed. The sound input unit 460 performs a recording operation according to the instruction of the control unit 480, thereby generating sound data recording the sound outside the support target vehicle. The sound input unit 460 outputs the generated sound data to the control unit 480.
[0071] The sound output unit 470 is configured using a sound output device such as a speaker. The sound output unit 470 converts the telecommunication signal output from the control unit 480 into sound and outputs the sound. For example, the sound output unit 470 is used as one of the means for the reporting unit described later to report information.
[0072] The control unit 480 has the function of inputting and outputting information with the communication unit 410, the input unit 420, the display unit 430, the storage unit 440, the camera unit 450, the sound input unit 460, and the sound output unit 470, and controlling the operation of the driving support device 400. Here, the control function of the control unit 480 includes a function of acquiring external condition information related to the support target vehicle provided with the driving support device 400, a function of acquiring driving support information from the driving data analysis device 300, and a function of causing each functional unit to perform a reporting operation of a predetermined phenomenon. The control unit 480 includes an external condition information acquisition unit 481, a capability information acquisition unit 482, a driving support information acquisition unit 483, and a reporting unit 484 as functional units for realizing these functions.
[0073] The external condition information acquisition unit 481 causes the imaging unit 450 and the audio input unit 460 to perform imaging and audio recording operations at a predetermined timing, thereby acquiring data indicating the external condition of the vehicle while the support target vehicle is traveling as external condition information. The external condition information acquisition unit 481 stores the acquired external condition information in the storage unit 440 .
[0074] The capability information acquisition unit 482 acquires capability information indicating an ability to recognize the outside world, which is the ability of the driver of the support target vehicle to recognize the conditions of the outside world of the vehicle while driving the vehicle. For example, the capability information acquisition unit 482 acquires information indicating the vision or hearing of the driver of the support target vehicle as capability information. The information indicating the vision or hearing of the driver of the support target vehicle may be pre-stored in the storage unit 440, or may be received from another device via the communication unit 410. In addition, the capability information acquisition unit 482 may acquire information indicating the vision or hearing corresponding to the state of the driver driving the support target vehicle as capability information when it is possible to acquire the biometric information of the driver driving the support target vehicle.
[0075] The driving support information acquisition unit 483 has a function of acquiring driving support information from the driving data analysis device 300. The driving support information acquisition unit 483 may be configured to acquire driving support information from the driving data analysis device 300 periodically, or may be configured to acquire driving support information from the driving data analysis device 300 at a specific timing. For example, the driving support information acquisition unit 483 may acquire driving support information from the driving data analysis device 300 when an instruction to execute driving support for the driver of the support target vehicle is input, or may acquire driving support information from the driving data analysis device 300 when a condition in which driving support should be executed is confirmed based on external condition information. The driving support information acquisition unit 483 outputs the driving support information acquired from the driving data analysis device 300 to the reporting unit 484. The driving support information acquisition unit 483 may also record the acquired driving support information in the storage unit 440.
[0076] The reporting unit 484 reports the contents of the driving support information to the driver of the support target vehicle by outputting the driving support information acquired from the driving data analyzing device 300 in a predetermined format.
[0077] Figure 4 1 is a sequence diagram showing an example of the flow of processing performed by the driving support system 100 of the present embodiment to realize driving support for the support target person. First, in the driving data recording device 200, the external condition information acquisition unit 271 operates the camera unit 250 or the sound input unit 260 to acquire external condition information (step S101). The external condition information acquisition unit 271 records the acquired external condition information in the storage unit 240. Figure 5 is a diagram showing an example of the external condition information in this embodiment. Figure 5 The external condition information table T1 shown in the figure is recorded in the storage unit 240. The external condition information table T1 has one or more records holding the acquisition period, information category and each value of the external condition information. Here, the acquisition period indicates the time when the corresponding external condition information is acquired, and the information category indicates the category of the corresponding external condition information. The external condition information indicates the image, sound and other data acquired as the external condition information. It should be noted that Figure 5 The value “[image data]” of the external condition information in indicates that the value is image data acquired as the external condition information, and the value “[sound data]” indicates that the value is sound data acquired as the external condition information.
[0078] Next, the capability information acquisition unit 272 acquires the capability information of the driver of the data collection vehicle at the time when the external condition information is acquired (step S102 ). The capability information acquisition unit 272 records the acquired capability information in the storage unit 240 . Figure 6 is a diagram showing an example of capability information in this embodiment. Figure 6 The capability information table T2 in the format shown is recorded in the storage unit 240 . Figure 6 The ability information table T2 shown is a table obtained by assuming that the ability information acquisition unit 272 estimates the ability value corresponding to the driver's state, and has one or more records holding the acquisition time, ability category, and each value of the estimated ability value. The acquisition time indicates the time when the estimated ability value is acquired, and the ability category indicates the category of the ability indicated by the estimated ability value (for example, vision or hearing). The estimated ability value indicates the ability value estimated for the corresponding ability category.
[0079] Next, the information processing unit 273 processes the external condition information obtained in step S101 based on the driver's ability information obtained in step S102, thereby generating driver's perception information (step S103). The information processing unit 273 establishes a correspondence between the generated perception information and the external condition information and ability information used for the generation and records them in the storage unit 240.
[0080] Next, the information output unit 274 sends the following driving data to the driving data analysis device 300, wherein the driving data includes at least the perception information generated in step S103 and the corresponding capability information (step S104). It should be noted that, here, the data required in the description of several specific examples described later as an analysis of driving risk is assumed to include the external condition information before processing, the driver's gender, age, vehicle location information, weather, time period and other information in the driving data, and the capability information includes, in addition to the value indicating the driver's external recognition capability at the time of obtaining the external condition information, the value indicating the driver's normal external recognition capability.
[0081] Next, in the driving data analysis device 300, the driving data collection unit 351 obtains driving data from one or more driving data recording devices 200 (step S201). The driving data collection unit 351 records the obtained driving data in the storage unit 340. Next, the driving data analysis unit 352 analyzes the driving risk based on the driving data obtained from each driving data recording device 200 (step S202). The driving data analysis unit 352 records the analysis result of the driving risk in the storage unit 340.
[0082] Figure 7 is a diagram showing an example of the analysis result of the driving risk in this embodiment. Figure 7The analysis result table T3 shown in the figure is recorded in the storage unit 340. For example, the analysis result table T3 has one or more records holding values of dangerous scenes, driver attributes, and occurrence conditions. Here, the dangerous scene represents a dangerous scene in driving that is considered to be highly likely to be encountered by a driver with the corresponding driver attribute in a corresponding occurrence condition. In addition, the driver attribute represents the attribute of the driver that is considered to be highly likely to encounter the corresponding dangerous scene in the corresponding occurrence condition. In addition, the occurrence condition represents a situation in which the driver with the corresponding driver attribute is highly likely to encounter the corresponding dangerous scene.
[0083] For example, in Figure 7 In the analysis result table T3 of the example, "approaching pedestrians" and "forgetting to stop temporarily" are cited as examples of dangerous scenes. Figure 7 The analysis result table T3 of the example shows that, for a male driver in his 50s, it is analyzed that he is likely to "approach a pedestrian" when at least the following conditions occur in combination.
[0084] (1) Visual acuity S is estimated to be less than or equal to s11.
[0085] (2) The hearing ability H is estimated to be below the value h11.
[0086] (3) The time is included in the time period from 18:00 to 20:00.
[0087] (4) The position is within a specified distance from the location (x11, y11).
[0088] When performing such an analysis, for example, the driving data analysis unit 352 identifies pedestrians outside the data collection vehicle based on the external condition information collected as driving data, and estimates the distance between the vehicle and the pedestrians. The driving data analysis unit 352 estimates the distance between the pedestrians and all data collection vehicles involved in the collected driving data, and identifies the situation where the distance becomes below a specified threshold as a dangerous scene "approaching pedestrians". The driving data analysis unit 352 implements statistics on the situation in which a dangerous scene is identified for each combination of driver attributes (here, the driver's external recognition ability, time period, location information, etc.), thereby determining the situation with the highest probability of encountering a dangerous scene in each combination of driver attributes. The driving data analysis unit 352 establishes a correspondence between the situation determined in this way and the corresponding driver attributes and the identified dangerous scene, thereby being able to generate an analysis result table T3. It should be noted that such a method for analyzing driving data is an example, and the method for analyzing driving data is not limited to the above-mentioned example. The analysis of driving data is only necessary for at least driving-related risks (for example, Figure 7It is sufficient to find a certain correlation between the dangerous scene in the example and the driver's external recognition ability, and the type and method of analysis can be arbitrary.
[0089] Next, the driving support information providing unit 353 generates driving support information for the support target person based on the analysis result of the driving risk thus obtained (step S203). The driving support information providing unit 353 records the generated driving support information in the storage unit 340, and provides the driving support information to the driving support device 400 as needed (step S204).
[0090] For example, the analysis of driving data may also be performed using a machine learning method. In this case, for example, the driving data analysis unit 352 learns data that establishes a correspondence between the collected driving data and the driving risk as teaching data for the data collection vehicle, thereby generating a learned model that estimates the driving risk using the driving data as input. In this case, the driving support information providing unit 353 inputs the acquired driving data into the learned model for the support target vehicle, thereby being able to estimate the driving risk associated with the driver of the support target vehicle. The driving support information providing unit 353 may also provide the driving support information acquired by such a machine learning method to the driving support device 400.
[0091] Next, in the driving support device 400, the driving support information acquisition unit 483 acquires driving support information from the driving data analysis device 300 (step S301). The driving support information acquisition unit 483 may be configured to receive driving support information sent by the driving data analysis device 300 at any time, or may be configured to request the driving data analysis device 300 to provide driving support information at any time.
[0092] For example, the driving support information acquisition unit 483 may also be configured to cooperate with the control system of the vehicle (i.e., the support target vehicle) provided with the driving support device 400, and request the provision of driving support information when it is detected that the vehicle has started to travel. In addition, for example, the driving support information acquisition unit 483 may also be configured to request the provision of driving support information when the driver of the support target vehicle is determined to be in a state requiring driving support (hereinafter referred to as the "support-required state"). For example, whether the driver is in the support-required state may be determined based on the external conditions of the support target vehicle that can be identified based on the external condition information, or may be determined based on the state of the support target person that can be identified based on the ability information.
[0093] Next, the reporting unit 484 outputs the driving support information obtained from the driving data analysis device 300 in a predetermined manner, thereby reporting the content of the driving support information to the driver of the supported vehicle (step S302). For example, the reporting unit 484 may also generate sound data representing the content of the driving support information and output it to the sound output unit 470, thereby reporting the content of the driving support information to the driver through sound. In addition, for example, the reporting unit 484 may also generate an image signal representing the content of the driving support information and output it to the display unit 430, thereby reporting the content of the driving support information to the driver through an image.
[0094] For example, through the analysis of driving data Figure 7 In the case of the analysis result table T3 of the example, the driving support information acquisition unit 483 may notify the driving data analysis device 300 of the driver attributes of the support target person when requesting to provide driving support information, and the driving data analysis device 300 provides the analysis result consistent with the driver attributes notified from the driving support device 400 as driving support information to the driving support device 400. In this case, for example, the reporting unit 484 compares the occurrence status included in the driving support information acquired from the driving data analysis device 300 with the current status, thereby determining the dangerous scene that should be reported to the support target person. In addition, for example, Figure 7 As shown in the analysis result table T3 of the example, the driving data analysis unit 352 may also be configured to collect the position information of the vehicle based on the data that can be included in the driving data, and analyze the driving risks associated with the location. In this case, the reporting unit 484 may also be configured to report the attention-calling related to the location to the support target person.
[0095] In addition, for example, when requesting provision of driving support information, the driving support information acquisition unit 483 may provide information necessary for determining a dangerous scene to be reported to the support target person (for example, Figure 7 In an example, the information is provided to the driving data analysis device 300, and the driving data analysis device 300 determines the dangerous scene based on the information provided from the driving support device 400, and provides the determined dangerous scene to the driving support device 400 as driving support information.
[0096] In addition, the driving support device 400 may be configured to notify the driving data analysis device 300 of the route information when requesting the driving support information from the driving data analysis device 300, when the route information of the route guidance can be obtained from the navigation device, etc. In this case, the driving data analysis device 300 may be configured to determine a driving route that can further reduce the driving risk (hereinafter referred to as a "recommended route") based on the route information of the support target vehicle and the analysis result of the driving risk, and transmit the driving support information including the determined recommended route to the driving support device 400 of the support target vehicle.
[0097] The driving data recording device 200 of the embodiment constructed as described above has an information processing unit 273, which processes the external condition information based on the external recognition ability of the driver of the vehicle equipped with the device. By having such a structure, the driving data recording device 200 of the embodiment replaces the function of the so-called driving recorder in the past, which originally records the conditions of the surroundings of the moving body (the outside world) with images and sounds. On this basis, it can realize a new recording function such as recording the conditions of the outside world in a manner corresponding to the driver's external recognition ability. The external condition information (i.e., perception information) recorded in such a new manner can become a clue for knowing the difference between the actual external condition and the external condition perceived by the driver. Therefore, the external condition information recorded in such a new manner can be used as evidence for conducting an on-site investigation when an accident occurs, and can also be used as a teaching material for potential dangers in shared driving.
[0098] In addition, the driving support system 100 of the embodiment configured as described above includes: one or more driving data recording devices 200 that provide driving data including the driver's external recognition ability to the driving data analysis device 300; the driving data analysis device 300 that analyzes the driving data collected from the driving data recording device 200; and the driving support device 400 that supports the driving of the support target person based on the analysis result of the driving data. By having such a structure, the driving support system 100 of the embodiment can provide appropriate support to the driver according to the driver's external recognition ability.
[0099] It should be noted that the driving data recording device 200 and the driving support device 400 may be configured as a device having both functions. If so, the driving data recording device 200 can function as a driving data recording device 200 that positions the setting object vehicle as a data collection vehicle and supplies driving data to the driving data analysis device 300, and can also function as a driving support device 400 that positions the setting object vehicle as a support object vehicle and receives driving support information from the driving data analysis device 300. That is, in such a scheme, the driving support system 100 includes one driving data analysis device 300 and one or more driving data recording devices 200, and each driving data recording device 200 provides driving data related to the driver of the vehicle to the driving data analysis device 300, thereby supporting the driver of the vehicle based on the analysis results of the driving data obtained about the vehicle and other vehicles.
[0100] The above-described embodiment can be expressed as follows.
[0101] A driving data recording device is provided, comprising:
[0102] a storage device storing a program; and
[0103] Hardware processor,
[0104] The hardware processor executes the program stored in the storage device to perform the following processing:
[0105] Acquiring external condition information indicating the external condition of the mobile body while the mobile body is traveling;
[0106] acquiring capability information indicating the external environment recognition capability of the driver of the mobile object; and
[0107] The external condition information is processed based on the capability information.
[0108] Although specific embodiments of the present invention have been described above using the embodiments, the present invention is not limited to such embodiments at all, and various modifications and substitutions can be made without departing from the gist of the present invention.
Claims
1. A driving data recording device, wherein: The driving data recording device comprises: an external condition information acquisition unit that acquires external condition information indicating a condition of the outside world of the mobile body while the mobile body is traveling; a capability information acquisition unit that acquires capability information indicating an outside world recognition capability of a driver of the mobile object; as well as an information processing unit, which processes the external condition information based on the capability information, The external condition information acquisition unit acquires image data obtained by photographing the outside world of the moving object as the external condition information. The ability information acquisition unit acquires information indicating the vision of the driver during driving of the mobile object as the ability information, The information processing unit obtains the clarity of the scenery perceived by the driver through vision while driving based on the visual acuity information as the resolution of the image, that is, the ability-equivalent resolution; The information processing unit generates an image by reducing the resolution of the image before processing to the capability-equivalent resolution through blurring.
2. The driving data recording device according to claim 1, wherein: The external condition information acquisition unit further acquires sound data obtained by recording external sounds of the moving body as the external condition information. The ability information acquisition unit further acquires information indicating the hearing of the driver during driving of the mobile object as the ability information, The information processing unit further processes the audio data based on information indicating the hearing ability of the driver.
3. The driving data recording device according to claim 1 or 2, wherein: The device further includes an information output unit that determines an attribute of a device as an output target, and when it is determined that the attribute is a predetermined attribute, outputs the external condition information processed by the information processing unit to the device as an output target.
4. The driving data recording device according to claim 1 or 2, wherein: Also available: A storage unit that stores the external condition information before processing; and The information output unit instructs the information processing unit to process the external condition information before processing when it is determined to output the processed external condition information.
5. A driving support system, wherein: The driving support system comprises: The driving data recording device according to any one of claims 1 to 4; and A driving data analysis device, comprising a driving data collection unit, a driving data analysis unit and a driving support information providing unit, wherein the driving data collection unit collects driving data including at least the external condition information and the capability information processed by the information processing unit from one or more driving data recording devices, the driving data analysis unit analyzes driving risks associated with driving of the mobile body based on the driving data, and the driving support information providing unit generates driving support information for supporting driving of a subject person for driving support based on the analysis result of the driving risk, and provides the generated driving support information to a driving support device used by the subject person.
6. The driving support system according to claim 5, wherein: The driving support device further includes a driving support information acquisition unit and a reporting unit. The driving support information acquisition unit acquires the driving support information from the driving data analysis device. The notification unit notifies the subject person of a driving risk related to driving of the mobile object based on the driving support information.
7. The driving support system according to claim 6, wherein: The driving data analysis unit analyzes the driving risk corresponding to the location, The notification unit notifies the subject person of an attention call regarding the place.
8. A driving data recording method, wherein: The driving data recording method enables the computer to perform the following processing: An external condition information acquisition process of acquiring external condition information indicating the external condition of the mobile body while the mobile body is traveling; A capability information acquisition process of acquiring capability information indicating the outside world recognition capability of the driver of the mobile object; and information processing of processing the external condition information based on the capability information, In the external condition information acquisition process, image data obtained by photographing the outside of the moving body is acquired as the external condition information. In the ability information acquisition process, information indicating the vision of the driver during driving of the mobile body is acquired as the ability information, In the information processing, based on the vision information, the clarity of the scenery perceived by the driver through vision while driving is obtained as the resolution of the image, that is, the capability-equivalent resolution; in the information processing, a blurring process is used to generate an image in which the resolution of the image before processing is reduced to the capability-equivalent resolution.
9. A recording medium having a program recorded thereon, wherein: The program causes the computer to perform the following processing: An external condition information acquisition process of acquiring external condition information indicating the external condition of the mobile body while the mobile body is traveling; A capability information acquisition process of acquiring capability information indicating the outside world recognition capability of the driver of the mobile object; and information processing of processing the external condition information based on the capability information, In the external condition information acquisition process, image data obtained by photographing the outside of the moving body is acquired as the external condition information. In the ability information acquisition process, information indicating the vision of the driver during driving of the mobile body is acquired as the ability information, In the information processing, based on the vision information, the clarity of the scenery perceived by the driver through vision while driving is obtained as the resolution of the image, that is, the capability-equivalent resolution; in the information processing, a blurring process is used to generate an image in which the resolution of the image before processing is reduced to the capability-equivalent resolution.
