Data communication system, center device, vehicle device, data processing method, and data processing program

Abstract

A center device (2) sets a trigger condition, sets a collection data list corresponding to the trigger condition, distributes the trigger condition and the collection data list to a vehicle device, and acquires collected data from the vehicle device. The vehicle device (4) continuously estimates the emotion of a user. When it is identified that the trigger condition is satisfied on the basis of the user emotion estimation result, the vehicle device (4) creates, as collected data corresponding to the collection data list, emotion data indicating the emotion of the user and at least one of operation log data indicating an operation log and vehicle state data indicating a vehicle state, and causes the collection data to be transmitted to the center device.

Description

Data communication system, center device, vehicle device, data processing method, and data processing program CROSS-REFERENCE TO RELATED APPLICATIONS

[0001] This application is based on Japanese Application No. 2024-013004, filed on January 31, 2024, the contents of which are incorporated herein by reference.

[0002] The present disclosure relates to a data communication system, a center device, a vehicle device, a data processing method, and a data processing program.

[0003] A data communication system is provided in which a center device receives vehicle data transmitted from vehicle devices mounted in an unspecified number of vehicles, thereby collecting vehicle data from the vehicle devices. For example, Patent Document 1 discloses a technology for reducing the frequency of transmission of access requests from the vehicle devices to a center device and reducing the processing load of authentication for collecting vehicle data.

[0004] JP 2023-084379 A

[0005] When a user uses a vehicle, the user's emotions can potentially provide important feedback information for apps and vehicle functions, and can be useful information for developing apps and improving vehicle functions. However, it is not easy to estimate a user's emotions from an operation log or vehicle state, and it is difficult to identify operation logs or vehicle states when the user is satisfied or dissatisfied. Under these circumstances, it is desirable to identify operation logs or vehicle states when the user is satisfied or dissatisfied.

[0006] The present disclosure aims to appropriately identify operation logs and vehicle states when a user feels satisfied or dissatisfied.

[0007] According to one aspect of the present disclosure, a data communication system is capable of data communication between a center device and a vehicle device mounted on a vehicle. The center device includes a trigger condition setting unit that sets a trigger condition, a collected data list setting unit that sets a collected data list corresponding to the trigger condition, a distribution unit that distributes the trigger condition and the collected data list to the vehicle device, and a collected data acquisition unit that acquires collected data from the vehicle device. The vehicle device includes an emotion estimation unit that continuously estimates a user's emotion, a trigger condition determination unit that determines whether a trigger condition is satisfied based on a result of the user's emotion estimation, a collected data creation unit that, when it is determined that the trigger condition is satisfied, creates, as collected data corresponding to the collected data list, emotion data indicating the user's emotion, operation log data indicating an operation log, and / or vehicle state data indicating a vehicle state, and a collected data transmission unit that transmits the collected data to the center device.

[0008] According to one aspect of the present disclosure, a center device is mounted on a vehicle, continuously estimates a user's emotion, determines whether a trigger condition is satisfied based on the estimated user's emotion, and, when it is determined that the trigger condition is satisfied, creates at least one of emotion data indicating the user's emotion, operation log data indicating an operation log, and vehicle state data indicating a vehicle state as collected data corresponding to a collected data list and transmits the collected data to the center device. The center device is capable of data communication with a vehicle device that is mounted on a vehicle, continuously estimates a user's emotion, determines whether a trigger condition is satisfied based on the estimated user's emotion, and, when it is determined that the trigger condition is satisfied, creates at least one of emotion data indicating the user's emotion, operation log data indicating an operation log, and vehicle state data indicating a vehicle state as collected data corresponding to a collected data list and transmits the collected data to the center device. The center device includes a trigger condition setting unit that sets the trigger condition, a collected data list setting unit that sets the collected data list corresponding to the trigger condition, a distribution unit that distributes the trigger condition and the collected data list to the vehicle device, and a collected data acquisition unit that acquires the collected data from the vehicle device.

[0009] According to one aspect of the present disclosure, a vehicle device is mounted on a vehicle and is capable of data communication with a center device that sets a trigger condition, sets a collected data list corresponding to the trigger condition, distributes the trigger condition and the collected data list to the vehicle device, and acquires collected data from the vehicle device. The vehicle device includes: an emotion estimation unit that continuously estimates a user's emotion; a trigger condition determination unit that determines whether the trigger condition is satisfied based on a result of the estimation of the user's emotion; a collected data creation unit that, when it is determined that the trigger condition is satisfied, creates, as collected data corresponding to the collected data list, emotion data indicating the user's emotion, operation log data indicating an operation log, and vehicle state data indicating a vehicle state; and a collected data transmission unit that transmits the collected data to the center device.

[0010] According to a data processing method for a data communication system of one aspect of the present disclosure, the center device executes the following steps: a trigger condition setting step for setting a trigger condition, a collected data list setting step for setting a collected data list corresponding to the trigger condition, a distribution step for distributing the trigger condition and the collected data list to the vehicle device, and a collected data acquisition step for acquiring collected data from the vehicle device. The vehicle device executes the following steps: an emotion estimation step for continuously estimating a user's emotion, a trigger condition determination step for determining whether a trigger condition is satisfied based on a result of the estimation of the user's emotion, a collected data creation step for creating, when it is determined that the trigger condition is satisfied, at least one of emotion data indicating the user's emotion, operation log data indicating an operation log, and vehicle state data indicating a vehicle state, as collected data corresponding to the collected data list, and a collected data transmission step for transmitting the collected data to the center device.

[0011] According to a data processing method of a center device of one aspect of the present disclosure, a user's emotion is continuously estimated, and based on the estimation result of the user's emotion, it is determined whether or not a trigger condition is satisfied. If it is determined that the trigger condition is satisfied, emotion data indicating the user's emotion, operation log data indicating an operation log, and / or vehicle state data indicating a vehicle state are created as collected data corresponding to a collected data list and transmitted to the center device. In the center device capable of data communication with a vehicle device, the following steps are executed: a trigger condition setting step for setting a trigger condition; a collected data list setting step for setting a collected data list corresponding to the trigger condition; a distribution step for distributing the trigger condition and the collected data list to the vehicle device; and a collected data acquisition step for acquiring collected data from the vehicle device.

[0012] According to one aspect of the data processing method for a vehicle device of the present disclosure, a trigger condition is set, a collected data list corresponding to the trigger condition is set, the trigger condition and the collected data list are distributed to the vehicle device, and data communication with a center device that acquires collected data from the vehicle device is possible. In the vehicle device mounted on the vehicle, an emotion estimation procedure is executed to continuously estimate a user's emotion; a trigger condition determination procedure is executed to determine whether or not the trigger condition is satisfied based on a result of the estimation of the user's emotion; a collected data creation procedure is executed to create, when it is determined that the trigger condition is satisfied, emotion data indicating the user's emotion, operation log data indicating an operation log, and / or vehicle state data indicating a vehicle state, as collected data corresponding to the collected data list; and a collected data transmission procedure is executed to transmit the collected data to the center device.

[0013] According to a data processing program for a center device of one aspect of the present disclosure, the program is mounted on a vehicle, continuously estimates a user's emotion, and determines whether a trigger condition is met based on the estimation result of the user's emotion. If it is determined that the trigger condition is met, the program creates emotion data indicating the user's emotion, operation log data indicating an operation log, and / or vehicle state data indicating a vehicle state as collected data corresponding to a collected data list and transmits the collected data to the center device. The program then causes a control unit of the center device, which is capable of data communication with a vehicle device, to execute a trigger condition setting procedure for setting a trigger condition, a collected data list setting procedure for setting a collected data list corresponding to the trigger condition, a distribution procedure for distributing the trigger condition and the collected data list to the vehicle device, and a collected data acquisition procedure for acquiring collected data from the vehicle device.

[0014] According to one aspect of the present disclosure, a data processing program for a vehicle device sets a trigger condition, sets a collected data list corresponding to the trigger condition, distributes the trigger condition and the collected data list to the vehicle device, and is capable of data communication with a center device that acquires collected data from the vehicle device. The program causes a control unit of the vehicle device mounted on the vehicle to execute an emotion estimation procedure for continuously estimating a user's emotion, a trigger condition determination procedure for determining whether or not a trigger condition is satisfied based on a result of the estimation of the user's emotion, a collected data creation procedure for, when it is determined that the trigger condition is satisfied, creating, as collected data corresponding to the collected data list, emotion data indicating the user's emotion, operation log data indicating an operation log, and / or vehicle state data indicating a vehicle state, and a collected data transmission procedure for transmitting the collected data to the center device.

[0015] According to the disclosure above, the center device sets a trigger condition, sets a collected data list corresponding to the trigger condition, distributes the trigger condition and the collected data list to the vehicle device, acquires collected data from the vehicle device, continuously estimates the user's emotion, and when it is determined that the trigger condition is satisfied based on the estimation result of the user's emotion, creates at least one of emotion data indicating the user's emotion, operation log data indicating an operation log, and vehicle state data indicating the vehicle state as collected data corresponding to the collected data list, and transmits the collected data to the center device. It is possible to appropriately identify the operation log and vehicle state when the user is satisfied or dissatisfied.

[0016] The above and other objects, features, and advantages of the present disclosure will become more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which Fig. 1 is a functional block diagram showing an overall configuration of an embodiment, Fig. 2 is a functional block diagram of a center device, Fig. 3 is a functional block diagram of a vehicle device, Fig. 4 is a functional block diagram of a control unit of the center device, Fig. 5 is a functional block diagram of a control unit of the vehicle device, Fig. 6 is a diagram illustrating an in-vehicle device and a user device, Fig. 7 is a diagram illustrating emotion data, Fig. 8 is a diagram illustrating emotion level data, Fig. 9 is a diagram illustrating operation log data, Fig. 10 is a diagram illustrating vehicle state data, Fig. 11 is a flowchart illustrating processing by the center device, Fig. 12 is a flowchart illustrating processing by the vehicle device, Fig. 13 is a flowchart illustrating processing by the vehicle device, Fig. 14 is a diagram illustrating a processing flow, and Fig. 15 is a diagram illustrating determination of a trigger condition.

[0017] The present invention relates to a data communication system for a vehicle, a data communication method for a vehicle, and a data communication system for a vehicle.

[0018] As shown in FIG. 2 , the center device 2 includes a control unit 6, a communication unit 7, and a storage unit 8. The control unit 6 is mainly configured with a microcomputer (hereinafter referred to as "microcomputer") having a CPU, ROM, RAM, I / O, etc., and controls the operation of the center device 2 by executing software processing by the CPU running a computer program stored in a non-transitory tangible storage medium, and hardware processing by a dedicated electronic circuit. By executing the computer program, a method corresponding to the computer program is performed. The control unit 6 may include one or more microcomputers. The communication unit 7 controls data communication between the multiple vehicle devices 4 via the wide-area wireless communication network 5. The storage unit 8 stores various data.

[0019] As shown in FIG. 3 , the vehicle device 4 includes a control unit 9, a communication unit 10, a storage unit 11, and a CAN (Controller Area Network) communication unit 12. The control unit 9 is mainly configured with a microcomputer having a CPU, ROM, RAM, I / O, etc., and controls the operation of the vehicle device 4 by executing software processing by the CPU running a computer program stored in a non-transient tangible storage medium and hardware processing by a dedicated electronic circuit. By executing the computer program, a method corresponding to the computer program is performed. The control unit 9 may include one or more microcomputers. The communication unit 10 controls data communication with the center device 2 via the wide-area wireless communication network 5. The storage unit 11 stores various data.

[0020] The CAN communication unit 12 is connected to CAN buses 13 to 15. The CAN communication unit 12 is connected to a plurality of ECUs 161 to 16n via the CAN bus 13 so as to be able to communicate data with them. The plurality of ECUs 161 to 16n include, for example, an engine ECU that controls the engine, an accelerator ECU that controls the accelerator, a brake ECU that controls the brakes, a steering ECU that controls the steering, a meter ECU that controls the meters, and a navigation ECU that controls navigation. For example, the accelerator ECU transmits data indicating the accelerator opening to the CAN communication unit 12 as detected data. For example, the brake ECU transmits data indicating the brake pedal operation amount to the CAN communication unit 12 as detected data. For example, the steering ECU transmits data indicating the steering angular velocity of the steering wheel to the CAN communication unit 12 as detected data. For example, the navigation ECU transmits data indicating latitude and longitude to the CAN communication unit 12 as detected data. The plurality of ECUs 161 to 16n are connected to the same bus for each system. For example, an ADAS (Advanced Driving Assistant System) ECU, a body ECU, a chassis ECU, etc. are all connected to the same bus.

[0021] The CAN communication unit 12 is connected to a plurality of cameras 171-17n and a plurality of sensors 181-18n via the CAN bus 14 so as to be able to communicate data with them. The plurality of cameras 171-17n may be, for example, a forward-facing camera that captures images of the area ahead of the vehicle, an interior-facing camera that captures images of the interior of the vehicle, a driver-facing camera that captures images of the driver, etc. For example, a forward-facing camera that captures images of the area ahead of the vehicle transmits data indicating an image of the area ahead of the vehicle as detection data to the CAN communication unit 12. For example, an interior-facing camera transmits data indicating an image of the interior of the vehicle as detection data to the CAN communication unit 12. The plurality of sensors 181-18n may be, for example, a light detection and ranging (LIDAR), a millimeter-wave radar, an ultrasonic sensor, an illuminance sensor, a rain sensor, etc. For example, a sensor that detects the area ahead of the vehicle using LIDAR, millimeter-wave radar, etc. transmits data indicating the distance from a leading vehicle to the CAN communication unit 12 as detection data. For example, an illuminance sensor transmits data indicating illuminance as detected data to the CAN communication unit 12. For example, a rain sensor transmits data indicating the amount of rainfall as detected data to the CAN communication unit 12.

[0022] The CAN communication unit 12 is connected to a DSM (Driver Status Monitor) 19, an ACC (Adaptive Cruise Control) system 20, an auto light system 21, an auto air conditioning system 22, etc. via a CAN bus 15 so as to be able to communicate data with them. For example, the DSM 19 transmits data indicating the driver's status to the CAN communication unit 12 as detected data. For example, the ACC system 20 transmits data indicating the control status of the ACC system 20 to the CAN communication unit 12 as detected data. For example, the auto light system 21 transmits data indicating the control status of the auto light system 21 to the CAN communication unit 12 as detected data. For example, the auto air conditioning system 22 transmits data indicating the control status of the auto air conditioning system 22 to the CAN communication unit 12 as detected data. Furthermore, a Lane Keeping Assist (LKA) system may be connected, and data indicating the control status of the LKA system may be transmitted to the CAN communication unit 12 as detected data.

[0023] The number of CAN buses 13-15 connected to the CAN communication unit 12 is not limited to three, and may be two or less, or four or more. The various ECUs 161-16n, the various cameras 171-17n, the various sensors 181-18n, the DSM 19, and the various systems 20-22 may be connected to the CAN buses 13-15 in any manner. The various devices connected to the CAN buses 13-15 are not limited to the ECUs, cameras, sensors, and systems described above. Furthermore, the in-vehicle communication network is not limited to a configuration in which the CAN buses 13-15 are used, and may also be a configuration in which Ethernet or the like is used. Ethernet is a registered trademark.

[0024] 4, in the center device 2, the control unit 6 includes, for each function, a trigger condition setting unit 6a, a collected data list setting unit 6b, a distribution unit 6c, and a collected data acquisition unit 6d. These units 6a to 6d execute the data processing method of the center device 2 and the data processing program of the center device 2.

[0025] The trigger condition setting unit 6a sets trigger conditions. The collected data list setting unit 6b sets a collected data list corresponding to the trigger conditions. When the trigger condition setting unit 6a sets the trigger condition and the collected data list set by the collected data list setting unit 6b, the distribution unit 6c distributes the set trigger condition and collected data list from the communication unit 7 to the vehicle device 4. The collected data acquisition unit 6d acquires the collected data from the vehicle device 4 by receiving the collected data transmitted from the vehicle device 4 via the communication unit 7.

[0026] 5, in the vehicular device 4, the control unit 9 includes, for each function, an emotion estimation unit 9a, a trigger condition determination unit 9b, a collected data creation unit 9c, and a collected data transmission unit 9d. These units 9a to 9d execute the data processing method of the vehicular device 4 and execute the data processing program for the vehicular device 4.

[0027] The emotion deduction unit 9 a continuously deduces the emotion of the user based on data detected by an in-vehicle device mounted on the vehicle and data detected by a user device owned by the user.

[0028] As shown in FIG. 6 , the emotion estimation unit 9a continuously estimates the user's emotion based on data such as a user image acquired by an in-car camera, in-car voice acquired by an in-car microphone, and body temperature and heart rate acquired by the steering wheel. The emotion estimation unit 9a continuously estimates the user's emotion based on data such as sleep data acquired by a smartphone and sleep data and body temperature acquired by a smartwatch. Note that the data detected by the in-car device and the data detected by the user device may be used together, or only data detected by one of the devices may be used. Examples of user emotions include joy, trust, fear, surprise, sadness, disgust, anger, expectation, drowsiness, and neutrality. When continuously estimating the user's emotion, for example, the drowsiness level can be estimated from a facial image of the user captured by an in-car camera and information on a decrease in heart rate detected by a smartwatch. The anger level and fear level can be estimated from the facial image of the user captured by the in-car camera, voice from the microphone, and an increase in heart rate of the smartwatch. The user's emotion estimated by the emotion estimation unit 9a is quantified, for example, as "sleepiness level = 3" or "anger level = 5".

[0029] The trigger condition determination unit 9b determines whether a trigger condition is satisfied using the estimation result of the user's emotion as a trigger. The trigger condition determination unit 9b, for example, determines whether time-series emotion data indicating the estimation result of the user's emotion in time series satisfies the trigger condition. The trigger condition determination unit 9b may also determine whether the trigger condition is satisfied using at least one of operation log data indicating an operation log and vehicle state data indicating a vehicle state, in addition to the estimation result of the user's emotion. The trigger condition determination unit 9b determines whether at least one of time-series operation log data indicating user operations in time series and time-series vehicle state data indicating a vehicle state in time series satisfies the trigger condition, in addition to the time-series emotion data. Methods for determining the emotion data indicating the user's emotion, the operation log data, and the vehicle state data include a method of determining based on a specified logic and a method of determining based on artificial intelligence (hereinafter referred to as AI) logic. The trigger condition can be expressed as a logical sum or a logical product of multiple triggers.

[0030] Emotion data includes emotion data and emotion level data. As shown in Fig. 7, when emotion data is used as a trigger, the trigger content includes whether or not there is a change in emotion, the elapsed time since the emotion change, the accuracy of the emotion trigger determination by the AI ​​model, the elapsed time since the emotion trigger determination accuracy by the AI ​​model reached a predetermined value, etc. As shown in Fig. 8, when emotion level data is used as a trigger, the trigger content includes whether or not there is a change in emotion level, the elapsed time since the emotion level change, the accuracy of the emotion trigger determination by the AI ​​model, the elapsed time since the emotion trigger determination accuracy by the AI ​​model reached a predetermined value, etc.

[0031] As shown in Figure 9, when operation log data is used as a trigger, the trigger content includes whether or not an operation was performed, the number of operations performed in a specified period, the elapsed time after the operation, the accuracy of the AI ​​model's determination that the operation was triggered, and the elapsed time after the accuracy of the AI ​​model's determination that the operation was triggered reaches a specified value.

[0032] As shown in Figure 10, when vehicle state data is used as a trigger, the trigger content includes whether or not the vehicle state has changed, the elapsed time since the change in the vehicle state, whether or not the value of the vehicle state has changed, the elapsed time since the value of the vehicle state has changed, the accuracy of the trigger determination of the vehicle state by the AI ​​model, and the elapsed time after the accuracy of the trigger determination of the vehicle state by the AI ​​model has reached a predetermined value.

[0033] The collected data creation unit 9c creates collected data based on the determination result of the trigger condition determination. That is, when it is determined that the trigger condition is satisfied, the collected data creation unit 9c creates emotion data indicating the user's emotion, operation log data, and vehicle state data as collected data corresponding to the collected data list. When the collected data creation unit 9c creates the collected data, the collected data transmission unit 9d causes the communication unit 10 to transmit the created collected data to the center device 2.

[0034] The trigger condition will now be described. The trigger condition set by the trigger condition setting unit 6a may be, for example, a trigger condition related to the transition of the user's emotions. For example, if the trigger condition is set as "when the type of emotion changes from normal to anger" in the emotion data itself, the trigger condition determination unit 9b determines that the trigger condition is satisfied when the type of emotion changes from normal to anger. The collected data creation unit 9c creates, as collected data, emotion data, operation log data, and vehicle state data before and after the type of emotion changes from normal to anger.

[0035] For example, if the trigger condition for emotion level data is set as "when the emotion type is anger and the emotion intensity is 3 or more and continues for 10 seconds or more," the trigger condition determination unit 9b determines that the trigger condition is satisfied when the emotion type is anger and the emotion intensity is 3 or more and continues for 10 seconds or more. The collected data creation unit 9c creates, as collected data, emotion data, operation log data, and vehicle state data before and after the emotion type is anger and the emotion intensity is 3 or more and continues for 10 seconds or more.

[0036] The trigger condition set by the trigger condition setting unit 6a also includes, for example, a trigger condition related to the relationship between a transition in the user's emotion and at least one of a user operation and a vehicle state. For example, if the trigger condition is set as "when the type of emotion changes from neutral to anger" in the emotion data and "when operation A is performed within 10 seconds" in the operation log data, the trigger condition determination unit 9b determines that the trigger condition is satisfied when the type of emotion changes from neutral to anger and operation A is performed within 10 seconds of the emotion change. The collected data creation unit 9c creates, as collected data, emotion data, operation log data, and vehicle state data before and after the emotion changes from neutral to anger and operation A is performed within 10 seconds of the emotion change.

[0037] The trigger condition determination unit 9b may determine the emotion data, operation log data, and vehicle state data based on the specified logic in the following cases, for example: (Example 1) When the type of emotion changes from normal to anger (Example 2) When 10 seconds have passed since the LKA system was turned on, and the type of emotion changes from normal to anger (Example 3) When the vehicle state changes from stopped to moving, and the type of emotion changes from normal to anger

[0038] The trigger condition determination unit 9b may determine the emotion data, operation log data, and vehicle state data based on AI logic in the following cases, for example: (Example 4) When the accuracy of the emotion trigger determination by AI model A is 80% or more (Example 5) When the accuracy of the operation trigger determination by AI model B is 80% or more and the accuracy of the emotion level trigger determination by AI model C is 80% or more

[0039] The trigger condition determination unit 9b may determine only a part of the emotion data, operation log data, and vehicle state data based on AI logic in the following cases: (Example 6) When 10 seconds have passed since the LKA system was turned on, and the accuracy of the emotion trigger determination by AI model A is 80% or more, or when the accuracy of the emotion trigger determination by AI model C is 80% or more.

[0040] Next, the operation of the above-described configuration will be described with reference to Figures 11 to 15. Here, the processing performed by the control unit 6 of the center device 2 and the processing performed by the control unit 9 of the vehicle device 4 will be described. (1) Processing performed by the control unit 6 of the center device 2 (see Figure 11). When the control unit 6 of the center device 2 starts center-side processing, it sets a trigger condition (A1, corresponding to the trigger condition setting procedure) and sets a collected data list corresponding to the trigger condition (A2, corresponding to the collected data list setting procedure). The control unit 6 distributes the set trigger condition and collected data list to the vehicle device 4 (A3, corresponding to the distribution procedure) and waits to receive collected data from the vehicle device 4.

[0041] When the collected data transmitted from the vehicle device 4 is received by the communication unit 10, the control unit 6 acquires the collected data from the vehicle device 4 (corresponding to A4, the collected data acquisition procedure) and ends the center-side processing. After this, by analyzing the collected data acquired from the vehicle device 4, it is possible to identify operation logs and vehicle conditions when the user is satisfied or dissatisfied, and this information can be used as useful information for developing apps and improving vehicle functions.

[0042] (2) Processes Performed by the Control Unit 9 of the Vehicle Device 4 (See FIGS. 12 and 13) In the vehicle device 4, the control unit 9 performs emotion estimation processing and trigger condition determination processing. Each process will be described below.

[0043] (2-1) Emotion Estimation Process (See FIG. 12 ) The control unit 9 starts the emotion estimation process when a start condition for the emotion estimation process is met, for example, because the user has gotten in the vehicle. When the emotion estimation process starts, the control unit 9 acquires data detected by the in-vehicle device (B1) and acquires data detected by the user device (B2). The control unit 9 estimates the user's emotion based on the data acquired from the in-vehicle device and the data acquired from the user device (B3, corresponding to the emotion estimation procedure), and determines whether a termination condition for the emotion estimation process is met (B4). If the control unit 9 determines that the termination condition for the emotion estimation process is not met (B4: NO), it returns to step B1 and repeats step B1 and subsequent steps. If the control unit 9 determines that the termination condition for the emotion estimation process is met, for example, because the user has gotten out of the vehicle (B4: YES), it terminates the emotion estimation process.

[0044] (2-2) Trigger condition determination process (see Figure 13) When the control unit 9 starts the trigger condition determination process, the trigger conditions and collected data list distributed from the center device 2 are received by the communication unit 10, and the control unit 9 acquires the trigger conditions and collected data list from the center device 2 (B11), and then sets the acquired trigger conditions and collected data list (B12).

[0045] The control unit 9 acquires the estimation result of the user's emotion estimated by the emotion estimation process (B13), acquires operation log data (B14), and acquires vehicle state data (B15). The control unit 9 determines a trigger condition based on the acquired estimation result of the user's emotion, the operation log data, and the vehicle state data (B16), and determines whether the trigger condition is satisfied (B17, corresponding to the trigger condition determination step).

[0046] When the control unit 9 determines that the trigger condition is satisfied (B17: YES), it creates emotion data indicating the user's emotion, operation log data, and vehicle state data as collected data corresponding to the collected data list (B18, corresponding to the collected data creation procedure).The control unit 9 then causes the communication unit 10 to transmit the created collected data to the center device 2 (B19, corresponding to the collected data transmission procedure), and ends the trigger condition determination process.

[0047] As shown in FIG. 15 , when the trigger conditions are set as, for example, “when the type of emotion in the emotion level data changes from calm to anger at level 5 or higher,” “when operation A is performed,” and “when the vehicle state A changes to vehicle state B,” the control unit 9 determines that the trigger conditions are met at time “t4,” creates collected data, and transmits it from the communication unit 10 to the center device 2.

[0048] While the above describes an example of a configuration for determining whether a trigger condition is satisfied based on the estimation result of a user's emotion, operation log data, and vehicle state data, it is sufficient to determine whether a trigger condition is satisfied by including at least the estimation result of a user's emotion, and the operation log data and vehicle state data do not necessarily need to be included. That is, it may be determined whether a trigger condition is satisfied based only on the estimation result of a user's emotion. It may be determined whether a trigger condition is satisfied based on the estimation result of a user's emotion and the operation log data, or it may be determined whether a trigger condition is satisfied based on the estimation result of a user's emotion and the vehicle state data.

[0049] Furthermore, although the configuration in which emotion data indicating the user's emotion, operation log data, and vehicle status data are created and transmitted as collected data has been exemplified, it is not necessary to include both operation log data and vehicle status data. Emotion data and operation log data may be created and transmitted as collected data, or emotion data and vehicle status data may be created and transmitted as collected data.

[0050] As described above, according to the embodiment, the following advantageous effects can be obtained: In the center device 2, a trigger condition is set, a collected data list corresponding to the trigger condition is set, and the trigger condition and the collected data list are distributed to the vehicle device 4. The vehicle device 4 continuously estimates the user's emotions, and when it is determined that the trigger condition is satisfied based on the estimation result of the user's emotions, emotion data indicating the user's emotions, operation log data indicating an operation log, and vehicle state data indicating the vehicle state are created as collected data and transmitted to the center device 2. It is possible to appropriately identify the operation log and vehicle state when the user is satisfied or dissatisfied.

[0051] Whether or not the trigger condition is satisfied is determined based on the estimation result of the user's emotion, according to a prescribed logic. By prescribing the prescribed logic in advance, it is possible to determine whether or not the trigger condition is satisfied based on the estimation result of the user's emotion.

[0052] Whether or not the trigger condition is met is determined based on the estimation result of the user's emotion using AI logic. There is no need to prescribe a prescribed logic beforehand, and it is possible to determine whether or not the trigger condition is met based on the estimation result of the user's emotion.

[0053] The system continuously estimates the user's emotions based on data detected by in-vehicle devices, such as images of the user captured by an in-vehicle camera, in-vehicle voice captured by an in-vehicle microphone, and data such as body temperature and heart rate captured by the steering wheel.

[0054] The system continuously estimates the user's emotions based on data detected by the user's device, such as sleep data acquired by a smartphone or a smartwatch, as well as body temperature data.

[0055] Although the present disclosure has been described with reference to the embodiments, it is understood that the present disclosure is not limited to the embodiments or structures. The present disclosure also encompasses various modifications and modifications within the scope of equivalents. In addition, various combinations and forms, as well as other combinations and forms including only one element, more than one element, or less than one element, are also within the scope and spirit of the present disclosure.

[0056] The control unit and the method described herein may be implemented by a special-purpose computer configured by configuring a processor and memory programmed to perform one or more functions embodied in a computer program. Alternatively, the control unit and the method described herein may be implemented by a special-purpose computer configured by configuring a processor with one or more dedicated hardware logic circuits. Alternatively, the control unit and the method described herein may be implemented by one or more special-purpose computers configured by combining a processor and memory programmed to perform one or more functions with a processor configured with one or more hardware logic circuits. Furthermore, the computer program may be stored as instructions executed by a computer on a computer-readable non-transitory tangible storage medium.

[0057] The present disclosure includes the following disclosure in addition to what is set forth in the claims: [1] A data communication system (1) in which a center device (2) and a vehicle device (4) mounted on a vehicle can communicate data, the center device including: a trigger condition setting unit (6a) that sets a trigger condition, a collected data list setting unit (6b) that sets a collected data list corresponding to the trigger condition, a distribution unit (6c) that distributes the trigger condition and the collected data list to the vehicle device, and a collected data acquisition unit (6d) that acquires collected data from the vehicle device, the vehicle device including: an emotion estimation unit (9a) that continuously estimates a user's emotion, a trigger condition determination unit (9b) that determines whether or not the trigger condition is satisfied based on the estimation result of the user's emotion, and a collected data creation unit (9c) that, when it is determined that the trigger condition is satisfied, creates, as collected data corresponding to the collected data list, emotion data indicating the user's emotion, operation log data indicating an operation log, and vehicle state data indicating a vehicle state; a collected data transmitting unit (9d) for transmitting the collected data to the center device.

[0058] [2] The data communication system according to [1], wherein the trigger condition determination unit determines whether or not the trigger condition is met based on at least one of the operation log and the vehicle state in addition to the estimation result of the user's emotion.

[0059] [3] The data communication system according to [1], wherein the trigger condition setting unit sets a trigger condition related to a transition of a user's emotion, and the trigger condition determination unit determines whether the trigger condition is satisfied based on time-series emotion data that indicates the estimation result of the user's emotion in time series.

[0060] [4] The data communication system described in [1], wherein the trigger condition setting unit sets a trigger condition relating to a relationship between a transition in a user's emotion and at least one of a user operation and a vehicle state, and the trigger condition determination unit determines whether or not the trigger condition is satisfied based on time-series emotion data that shows the estimated results of the user's emotion in time series, as well as time-series operation log data that shows user operations in time series and time-series vehicle state data that shows vehicle states in time series.

[0061] [5] The data communication system according to any one of [1] to [4], wherein the trigger condition determination unit determines whether or not a trigger condition is satisfied based on the estimation result of the user's emotion, based on a prescribed logic.

[0062] [6] The data communication system according to any one of [1] to [4], wherein the trigger condition determination unit determines whether or not a trigger condition is satisfied based on the estimation result of the user's emotion, based on AI logic.

[0063] [7] The data communication system according to claim 1 in any one of [1] to [6], wherein the emotion estimation unit continuously estimates the user's emotion based on data detected by an in-vehicle device mounted on the vehicle.

[0064] [8] The data communication system according to any one of [1] to [7], wherein the emotion estimation unit continuously estimates the emotion of the user based on data detected by a user device owned by the user.

Claims

1. A data communication system (1) in which a center device (2) and a vehicle device (4) mounted on a vehicle can communicate data, wherein the center device comprises: a trigger condition setting unit (6a) that sets a trigger condition; a collected data list setting unit (6b) that sets a collected data list corresponding to the trigger condition; a distribution unit (6c) that distributes the trigger condition and the collected data list to the vehicle device; and a collected data acquisition unit (6d) that acquires collected data from the vehicle device, wherein the vehicle device comprises: an emotion estimation unit (9a) that continuously estimates a user's emotion; a trigger condition determination unit (9b) that determines whether or not a trigger condition is satisfied based on the result of the estimation of the user's emotion; and a collected data creation unit (9c) that, when it is determined that the trigger condition is satisfied, creates, as collected data corresponding to the collected data list, emotion data indicating the user's emotion, operation log data indicating an operation log, and vehicle state data indicating a vehicle state. a collected data transmitting unit (9d) for transmitting the collected data to the center device.

2. A data communication system as described in claim 1, wherein the trigger condition determination unit determines whether the trigger condition is met based on at least one of the operation log and the vehicle state in addition to the estimated user emotion.

3. A data communication system as described in claim 1, wherein the trigger condition setting unit sets a trigger condition relating to a transition in the user's emotions, and the trigger condition determination unit determines whether the trigger condition is satisfied based on time-series emotion data that shows the estimated results of the user's emotions in a time series.

4. A data communication system as described in claim 1, wherein the trigger condition setting unit sets a trigger condition relating to the relationship between the transition of the user's emotions and at least one of the user operations and the vehicle state, and the trigger condition determination unit determines whether the trigger condition is satisfied based on time-series emotion data showing the estimated results of the user's emotions in time series, as well as time-series operation log data showing user operations in time series and time-series vehicle state data showing vehicle states in time series.

5. A data communication system according to claim 1, wherein the trigger condition determination unit determines whether or not a trigger condition is satisfied based on the estimation result of the user's emotion, in accordance with a prescribed logic.

6. A data communication system according to claim 1, wherein the trigger condition determination unit determines whether or not the trigger condition is met based on the estimation result of the user's emotion using AI logic.

7. The data communication system according to claim 1, wherein the emotion estimation unit continuously estimates the user's emotion based on data detected by an in-vehicle device installed in the vehicle.

8. The data communication system according to claim 1, wherein the emotion estimation unit continuously estimates the user's emotion based on data detected by a user device owned by the user.

9. A center device (2) capable of data communication with a vehicle device (4) that is mounted on a vehicle, continuously estimates a user's emotions, determines whether a trigger condition is met based on the estimated user emotion, and, when it is determined that the trigger condition is met, creates emotion data indicating the user's emotions, operation log data indicating an operation log, and / or vehicle state data indicating the vehicle state as collected data corresponding to a collected data list and transmits the collected data to the center device, the center device comprising: a trigger condition setting unit (6a) that sets a trigger condition; a collected data list setting unit (6b) that sets a collected data list corresponding to the trigger condition; a distribution unit (6c) that distributes the trigger condition and the collected data list to the vehicle device; and a collected data acquisition unit (6d) that acquires collected data from the vehicle device.

10. A vehicle device (4) mounted on a vehicle, capable of data communication with a center device (2) that sets trigger conditions, sets a collected data list corresponding to the trigger conditions, distributes the trigger conditions and the collected data list to a vehicle device, and acquires collected data from the vehicle device, the vehicle device comprising: an emotion estimation unit (9a) that continuously estimates a user's emotion; a trigger condition determination unit (9b) that determines whether or not a trigger condition is satisfied based on the result of the estimation of the user's emotion; a collected data creation unit (9c) that, when it is determined that the trigger condition is satisfied, creates, as collected data corresponding to the collected data list, emotion data indicating the user's emotion, operation log data indicating an operation log, and / or vehicle state data indicating a vehicle state; and a collected data transmission unit (9d) that transmits the collected data to the center device.

11. A data processing method executed in a data communication system (1) capable of data communication between a center device (2) and a vehicle device (4) mounted on a vehicle, wherein the center device executes: a trigger condition setting procedure for setting a trigger condition; a collected data list setting procedure for setting a collected data list corresponding to the trigger condition; a distribution procedure for distributing the trigger condition and the collected data list to the vehicle device; and a collected data acquisition procedure for acquiring collected data from the vehicle device; and the vehicle device executes: an emotion estimation procedure for continuously estimating a user's emotion; a trigger condition determination procedure for determining whether a trigger condition has been satisfied based on a result of the estimation of the user's emotion; a collected data creation procedure for, when it is determined that the trigger condition has been satisfied, creating emotion data indicating the user's emotion, operation log data indicating an operation log, and / or vehicle status data indicating a vehicle status as collected data corresponding to the collected data list; and a collected data transmission procedure for transmitting the collected data to the center device.

12. A data processing method in a center device (2) capable of data communication with a vehicle device (4) that is mounted on a vehicle, continuously estimates a user's emotions, determines whether a trigger condition is met based on the estimated user emotion, and, if it is determined that the trigger condition is met, creates emotion data indicating the user's emotions, operation log data indicating an operation log, and / or vehicle state data indicating the vehicle state as collected data corresponding to a collected data list and transmits the collected data to the center device, the data processing method comprising: a trigger condition setting procedure for setting a trigger condition; a collected data list setting procedure for setting a collected data list corresponding to the trigger condition; a distribution procedure for distributing the trigger condition and the collected data list to the vehicle device; and a collected data acquisition procedure for acquiring collected data from the vehicle device.

13. A data processing method in a vehicle device (4) mounted on a vehicle, capable of data communication with a center device (2) that sets trigger conditions, sets a collected data list corresponding to the trigger conditions, distributes the trigger conditions and the collected data list to a vehicle device, and acquires collected data from the vehicle device, the data processing method comprising: an emotion estimation procedure that continuously estimates a user's emotion; a trigger condition determination procedure that determines whether or not a trigger condition is satisfied based on the result of the user's emotion estimation; a collected data creation procedure that, when it is determined that the trigger condition is satisfied, creates, as collected data corresponding to the collected data list, emotion data indicating the user's emotion, operation log data indicating an operation log, and vehicle status data indicating a vehicle status; and a collected data transmission procedure that transmits the collected data to the center device.

14. A data processing program that is mounted on a vehicle, continuously estimates a user's emotions, determines whether a trigger condition is met based on the estimated user's emotions, and, if it is determined that the trigger condition is met, creates emotion data indicating the user's emotions, operation log data indicating an operation log, and / or vehicle state data indicating the vehicle state as collected data corresponding to a collected data list and transmits the collected data to a center device, in a control unit (6) of a center device (2) that can communicate with a vehicle device (4), and executes: a trigger condition setting procedure for setting a trigger condition; a collected data list setting procedure for setting a collected data list corresponding to the trigger condition; a distribution procedure for distributing the trigger condition and the collected data list to the vehicle device; and a collected data acquisition procedure for acquiring collected data from the vehicle device.

15. A data processing program that sets trigger conditions, sets a collected data list corresponding to the trigger conditions, distributes the trigger conditions and the collected data list to a vehicle device, and is capable of data communication with a center device (2) that acquires collected data from the vehicle device, and causes a control unit (9) of the vehicle device (4) mounted on the vehicle to execute: an emotion estimation procedure that continuously estimates a user's emotion; a trigger condition determination procedure that determines whether or not a trigger condition is satisfied based on the result of the estimation of the user's emotion; a collected data creation procedure that, when it is determined that the trigger condition is satisfied, creates, as collected data corresponding to the collected data list, emotion data indicating the user's emotion, operation log data indicating an operation log, and / or vehicle status data indicating a vehicle status; and a collected data transmission procedure that transmits the collected data to the center device.

Images