Vehicle-mounted devices, control methods, and storage media

Abstract

This application provides an in-vehicle device, a control method, and a storage medium. The in-vehicle device includes: a determining unit that determines an indicator based on changes in a user's physical state detected in a vehicle controlled by an autonomous driving function or a driver assistance function; and a storage unit that stores vehicle-related data in correspondence with the indicator in a manner corresponding to the timing of the aforementioned changes in the physical state.

Description

Technical Field

[0001] This invention relates to a vehicle-mounted device, a control method, and a storage medium. Background Technology

[0002] A technique for recording data related to vehicle movement is known. Japanese Patent Application Publication No. 2019-164403 discloses a technique for recording image data captured when a predetermined event such as a large change in acceleration occurs in a vehicle. Summary of the Invention

[0003] In vehicles controlled by autonomous driving or driver assistance functions, there is an expectation for more efficient data recording.

[0004] The purpose of this invention is to provide a technique for more effectively recording data in vehicles controlled by autonomous driving or driver assistance functions.

[0005] One aspect of the present invention relates to an in-vehicle device comprising: a determination unit that determines an index based on the amount of change in a user’s physical state detected in a vehicle controlled by an autonomous driving function or a driving assistance function; and a storage unit that stores vehicle-related data in correspondence with the index in a manner corresponding to the timing of the change in the state.

[0006] One aspect of the present invention relates to a control method implemented by a processor of an in-vehicle device, which includes the following processing: determining an index based on the amount of change in the user's physical state detected in a vehicle controlled by an autonomous driving function or a driving assistance function; and storing vehicle-related data and the index in a storage unit in a manner corresponding to the timing of the change in the state.

[0007] One aspect of the present invention relates to a storage medium that stores a program that enables a computer to function as an in-vehicle device, wherein the in-vehicle device comprises: a determining unit that determines an index based on the amount of change in a user’s physical state detected in a vehicle controlled by an autonomous driving function or a driving assistance function; and a storage unit that stores vehicle-related data in a correspondence with the index in a manner corresponding to the timing of the change in the state.

[0008] According to the present invention, a technique for more effectively recording data can be provided in vehicles controlled by autonomous driving functions or driving assistance functions. Attached Figure Description

[0009] The features, advantages, technical and industrial value of representative embodiments of the present invention will be depicted in the following drawings for reference, wherein the same symbols in the drawings denote the same elements, wherein:

[0010] Figure 1 This diagram illustrates the general structure of a system in one implementation.

[0011] Figure 2 A block diagram illustrating the outline structure of the hardware of a portion of a vehicle in one embodiment.

[0012] Figure 3 A block diagram illustrating the general structure of the functionality of a portion of an onboard device in one embodiment.

[0013] Figure 4 This is a flowchart illustrating the processing flow of an on-board device in one embodiment. Detailed Implementation

[0014] The following describes one embodiment of the present invention. However, this embodiment is merely an example for illustrating the present invention and is not intended to limit the invention to this specific embodiment. Furthermore, various modifications can be made to the present invention without departing from its spirit. Additionally, those skilled in the art will be able to employ embodiments by substituting the elements described below with equivalent elements, and these embodiments are also included within the scope of the present invention.

[0015] <System Architecture>

[0016] Reference Figure 1 An exemplary structure of a system 100 according to one embodiment will be described. In this embodiment, the system 100 includes a vehicle 1, a server device 2, and a terminal device 3. The vehicle 1, server device 2, and terminal device 3 are configured to communicate with each other wirelessly or via wired means (or both). Although in Figure 1 In the example shown, the system 100 has one vehicle 1, one server device 2, and one terminal device 3, but it is not limited to this; the system 100 may also have two or more vehicle 1, server device 2, and terminal device 3. Furthermore, the system 100 may also omit at least one of the server device 2 and terminal device 3.

[0017] Vehicle 1 is a mobile body capable of communicating with the outside world. Vehicle 1 is controlled by at least one of an automatic driving function or a driver assistance function. The automatic driving function is the vehicle's autonomous driving capability. The driver assistance function is a function that assists the driver in driving actions based on the driver's actions or the vehicle's state.

[0018] Server device 2 stores and manages the data received from vehicle 1. Furthermore, server device 2 can also send control commands to vehicle 1. Server device 2 is composed of an information processing device such as a server computer. Server device 2 can be composed of a single information processing device or multiple information processing devices (e.g., cloud computing or edge computing).

[0019] The terminal device 3 has the function of diagnosing the state of vehicle 1 based on data received from vehicle 1 or server device 2. The terminal device 3 may be, for example, a personal computer, smartphone, tablet computer, or a general-purpose or special-purpose information processing device.

[0020] <Hardware Structure>

[0021] Reference Figure 2 The hardware structure of vehicle 1 will be described below. Vehicle 1 includes an electronic control unit 10, a control component 30, and a sensor device 40 as its hardware structure.

[0022] The electronic control unit 10 is an in-vehicle device configured using a computer, which controls the processing and operation of various structures of the vehicle 1. The electronic control unit 10 includes a processor 11, a memory 12, a storage device 13, and a communication interface 14. The processor 11 is a Central Processing Unit (CPU). The memory 12 is a storage unit that stores data required for various processes performed by the processor 11 and the data resulting from those processes. The storage device 13 is a high-capacity storage unit, and may also be configured as a Hard Disk Drive (HDD) or an SSD (Solid State Drive). The communication interface 14 is configured as an interface circuit for communicating between the electronic control unit 10 and external structures. Through the communication interface 14, communication can be implemented, for example, via an in-vehicle network based on standards such as Controller Area Network (CAN).

[0023] The communication device 20 is an in-vehicle device for communicating with external devices of the vehicle 1 wirelessly or via wired connection. The control unit 30 includes, for example, control components of various structures mounted on the vehicle 1, such as an internal combustion engine, an electric motor, and an air conditioner. The sensor device 40 includes various sensors for acquiring data representing the state and condition of the vehicle 1 and the driver. The sensor device 40 includes, for example, a camera, a voice sensor, a vehicle speed sensor, a gyroscope sensor, a temperature sensor, a vehicle distance sensor, and a positioning unit.

[0024] <Functional Structure>

[0025] Reference Figure 3 A portion of the functional structure of the electronic control unit 10 will be described. The functional structure of the electronic control unit 10 is realized by the processor 11 reading and executing a computer program stored in the memory 12 or the storage device 13. The electronic control unit 10 includes a status acquisition unit 101, an index determination unit 102, a storage unit 103, and an input / output unit 104 as its functional structure.

[0026] The status acquisition unit 101 acquires data related to the physical state of the user as the driver, detected within the vehicle 1. This data is acquired based on data detected by the sensor device 40. The data related to the user's physical state includes, for example, voice data emitted by the user and image data of the user's body.

[0027] The indicator determination unit 102 determines an indicator based on the change in the user's physical state, obtained by the state acquisition unit 101. This indicator can be calculated and determined by the indicator determination unit 102, or it can be determined by the indicator determination unit 102 by obtaining the indicator from an external source.

[0028] The changes in a user's physical state include, for example, changes in the volume of the user's spoken voice, and at least a portion of changes in physical state determined based on an image of the user's body. Changes in physical state determined based on an image of the user's body include, for example, at least a portion of changes in the user's facial tone, expression, eye position, pupil size, and arm or other body position. That is, the indicator can also be calculated based on changes in at least a portion of the user's volume, expression, facial tone, eye position, pupil size, and body position. The changes in a user's physical state are, for example, changes within a predetermined period (e.g., 3 seconds).

[0029] Metrics can be calculated in a way that the greater the change in a user's physical condition, the higher the priority. Priorities can also include levels such as "high," "medium," and "low." Metrics can also be calculated numerically, and their priority can be set according to a pre-defined numerical range. For example, a metric might be calculated within the range of 0 to 100. In this case, for example, a metric above 0 and below 30 could be set to "low" priority, a metric above 30 and below 40 to "medium" priority, and a metric between 40 and 100 to "high" priority.

[0030] The indicator determination unit 102 can also determine the aforementioned indicators based on the occurrence of predetermined events related to the control implemented by the autonomous driving function or driving assistance function of the vehicle 1. These predetermined events include acceleration, braking, engine stop / start, and warnings that occur through the autonomous driving function or driving assistance function.

[0031] Storage unit 103 stores various data related to vehicle 1. Data stored in storage unit 103 as vehicle-1 related data includes, for example, data acquired by sensor device 40. Data stored in storage unit 103 as vehicle-1 related data may also include at least a portion of data indicating the load state of processor 11, memory 12 usage, communication status implemented by communication device 20, and the state of control unit 30. Storage unit 103 continuously stores, for example, vehicle-1 related data such as data indicating the state of vehicle 1 (including the internal and external states of vehicle 1) acquired by sensor device 40, and the state of the user as driver of vehicle 1.

[0032] The storage unit 103 can also store data related to the vehicle 1 and the aforementioned indicators in a manner corresponding to the timing of changes in the user's physical state. That is, when a change in the user's physical state occurs, the storage unit 103 can store the indicators determined by the indicator determination unit 102 based on the change and the timing of obtaining data related to the vehicle 1, establishing a correspondence between the two. For example, when a predetermined amount of change occurs in the user's physical state at date and time T1, the storage unit 103 stores the indicators determined based on the change and the data related to the vehicle 1 at date and time T1. Furthermore, the storage unit 103 can also store data related to the vehicle 1 within a predetermined period (10 seconds before and after the timing of the change), including the timing of the change in the user's physical state, in a correspondence with the aforementioned indicators.

[0033] As described above, according to this embodiment, the index determination unit 102 determines an index based on the amount of change in the physical state of the user, who is the driver, detected in the vehicle 1 controlled by the automatic driving function or the driving assistance function. The storage unit 103 stores data related to the vehicle 1 in a corresponding manner to the aforementioned index, in a manner that corresponds to the timing of the change in the user's physical state. As a result, when a predetermined amount of change occurs in the user's physical state, it is easy to determine the data related to the vehicle 1 stored in the storage unit 103 at the time of that change. That is, according to this embodiment, data can be recorded more effectively in a vehicle controlled by the automatic driving function or the driving assistance function.

[0034] Furthermore, as described above, the indicator determination unit 102 determines the aforementioned indicators based on the occurrence of a predetermined event related to the control implemented by the autonomous driving function or driving assistance function of the vehicle 1. The change in the user's physical state at the time of the aforementioned event is sometimes the user's reaction to that event. Therefore, by determining the aforementioned indicators based on the occurrence of the aforementioned event, and storing vehicle-related data in the storage unit 103 in a correspondence with the indicators, vehicle-related data regarding a certain reaction to the aforementioned event is stored in the storage unit 103 with a higher priority, and this data can be easily retrieved from the storage unit 103.

[0035] Furthermore, the aforementioned indicators are calculated with higher priority, for example, by recognizing greater changes in the user's physical state. Additionally, storage unit 103 stores vehicle 1-related data corresponding to these indicators with a higher priority than other data. Changes in the user's physical state sometimes correspond to a positive or negative reaction to the aforementioned event. Therefore, by determining the aforementioned indicators based on the occurrence of the event and storing vehicle 1-related data in storage unit 103 in a corresponding manner, vehicle 1-related data regarding the timing of the user's positive or negative reaction to the event is stored in storage unit 103 with a higher priority, and this data can be easily retrieved from storage unit 103.

[0036] Alternatively, the data related to vehicle 1 can be assigned a higher priority based on the aforementioned indicators, and the storage unit 103 will store that data for a longer period of time. By managing data storage in this way, higher priority data can be stored in the storage unit 103 for a longer period of time compared to other data. As a result, data storage management can be effectively performed within a limited storage area.

[0037] The input / output unit 104 implements the input of data stored in the storage unit 103 to the electronic control unit 10, and the output of data stored in the storage unit 103 from the electronic control unit 10. For example, the input / output unit 104 outputs vehicle-related data stored in the storage unit 103 based on an output request received by the electronic control unit 10 from the server device 2 or the terminal device 3 via the communication device 20. The output request may also include conditions for the output data, such as the timing of the storage of vehicle-related data or the establishment of corresponding indicators for that data. The input / output unit 104 may also output vehicle-related data that satisfies the above conditions. The data output from the input / output unit 104 may also be sent to the server device 2 or the terminal device 3 via the communication device 20.

[0038] The input / output unit 104 can also be configured to prioritize outputting data that corresponds to vehicle 1 data stored in the storage unit 103, with higher priority given to the aforementioned indicators. For example, the input / output unit 104 can also, based on output requests from the server device 2 or the terminal device 3, first output only the data corresponding to indicators with a priority of "high", and then output the data corresponding to indicators with a priority of "medium".

[0039] <Processing Flow>

[0040] Reference Figure 4 An example of the processing flow in the electronic control unit 10 will be described. This processing is implemented, for example, by the processor 11 reading and executing a computer program stored in the memory 12 or storage device 13. Furthermore, in the following description, the already described processes will be simplified or omitted.

[0041] In step S11, the electronic control unit 10 acquires data related to the physical state of the user as the driver, detected in the vehicle 1. The data related to the user's physical state is acquired based on data detected by the sensor device 40.

[0042] In step S12, the electronic control unit 10 determines an index based on the change in the user's physical state obtained in step S11. This index may, for example, be calculated based on changes in at least a portion of the user's voice volume, facial expression, complexion, eye position, pupil size, and body position, as determined by the data related to the user's physical state obtained in step S11.

[0043] In step S13, the electronic control unit 10 stores data related to the vehicle 1 in the storage device 13 in a manner corresponding to the timing of changes in the user's physical state, establishing a correspondence between the data and the indicators determined in step S12. That is, the electronic control unit 10 can also store data related to the vehicle 1 in a manner corresponding to the timing of the change in the user's physical state when the change occurs, thus establishing a correspondence between the indicators determined in step S12 and the data related to the vehicle 1. The data related to the vehicle 1 may, for example, include data acquired by the sensor device 40. The data related to the vehicle 1 may also include data representing at least a portion of the processor 11's load state, memory 12's usage rate, communication status implemented by the communication device 20, and the state of the control unit 30.

[0044] As described above, according to this embodiment, the electronic control unit 10 determines an index based on the amount of change in the physical state of the user, who is the driver, detected in the vehicle 1 controlled by the automatic driving function or the driving assistance function. Furthermore, the electronic control unit 10 stores data related to the vehicle 1 in a corresponding manner to the aforementioned index, in a way that corresponds to the timing of the change in the user's physical state. As a result, when a predetermined amount of change occurs in the user's physical state, it is easy to determine the data related to the vehicle 1 at the time of that change, stored in the storage unit 103. That is, according to this embodiment, data can be recorded more effectively in a vehicle controlled by the automatic driving function or the driving assistance function.

[0045] <Change Example>

[0046] The program for installing the system 100 (or vehicle 1 or electronic control unit 10) in this embodiment can be pre-recorded on various recording media such as CD-ROM, magnetic disk, and semiconductor memory. Furthermore, by downloading the program using a recording medium or via a communication network, it can be installed or loaded into a computer.

[0047] This invention is not limited to the embodiments described above, but can be implemented in various forms without departing from the spirit of the invention. The above embodiments are merely examples in all respects and are not intended to be construed as limiting.

Claims

1. A vehicle-mounted device comprising: The determination unit determines an index based on the amount of change in the user's physical state detected in a vehicle controlled by an autonomous driving function or a driving assistance function, and determines the index based on the occurrence of a predetermined event associated with the control implemented by the autonomous driving function or the driving assistance function. The index is set such that the greater the amount of change in the detected state, the higher the priority, and the index is a value calculated based on the amount of change in at least one of the user's voice volume, facial expression, complexion, eye position, pupil size, and body position. The storage unit stores vehicle-related data in a manner corresponding to the timing of changes in the state, and is configured such that the higher the priority of the indicator to which the data is associated, the longer the data will be stored. The output unit is configured such that the higher the priority of the indicator corresponding to the data, the higher the priority of the data will be output.

2. The vehicle-mounted device as claimed in claim 1, wherein, The storage unit stores data that corresponds to the specified index with a higher priority than other data.

3. A control method, wherein the control method is implemented by a processor of an on-board device, wherein, This includes the following processing: An index is determined based on the amount of change in a user’s physical state detected in a vehicle controlled by an autonomous driving function or a driver assistance function, and the index is determined based on the occurrence of a predetermined event associated with the control implemented by the autonomous driving function or the driver assistance function. The index is set such that the greater the amount of change in the detected state, the higher the priority. The index is a value calculated based on the amount of change in at least one of the user’s voice volume, facial expression, complexion, eye position, pupil size, and body position. In a manner corresponding to the timing of changes in the state, vehicle-related data is stored in the storage unit in a corresponding manner with the indicators, and the higher the priority of the indicator with which the data is corresponding, the longer the data will be stored. The higher the priority of the corresponding metric, the more likely that metric will be output.

4. A storage medium storing a program for enabling a computer to function as an in-vehicle device, wherein, The vehicle-mounted device includes: The determination unit determines an index based on the amount of change in the user's physical state detected in a vehicle controlled by an autonomous driving function or a driving assistance function, and determines the index based on the occurrence of a predetermined event associated with the control implemented by the autonomous driving function or the driving assistance function. The index is set such that the greater the amount of change in the detected state, the higher the priority, and the index is a value calculated based on the amount of change in at least one of the user's voice volume, facial expression, complexion, eye position, pupil size, and body position. The storage unit stores vehicle-related data in a manner corresponding to the timing of changes in the state, and is configured such that the higher the priority of the indicator to which the data is associated, the longer the data will be stored. The output unit is configured such that the higher the priority of the indicator corresponding to the data, the higher the priority of the data will be output.

Images