Vehicle control system
The vehicle control system addresses repetitive proposals by setting user-specific normal ranges and adjusting control based on user responses, enhancing personalization and reducing annoyance.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- AISIN CORP
- Filing Date
- 2024-10-24
- Publication Date
- 2026-05-12
AI Technical Summary
Existing vehicle control systems make repetitive proposals based on preset conditions, leading to user annoyance.
A vehicle control system that recognizes individual user characteristics and preferences by setting a normal range for user and vehicle states, proposing changes only when these states fall outside the normal range, and adjusting vehicle control based on user responses.
Reduces user annoyance by providing personalized and appropriate vehicle control adjustments, ensuring changes are made only when necessary and in response to user preferences.
Smart Images

Figure 2026076790000001_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a vehicle control system that changes vehicle control based on a user's response.
Background Art
[0002] A vehicle control system that makes a proposal to a user and changes vehicle control based on the response is known. Japanese Unexamined Patent Application Publication No. 2016-042293 (Patent Document 1) discloses a vehicle control system including a situation identification unit (15) that identifies a target situation such as the situation in which the user is placed, a terminal-side proposal content identification unit (18) that identifies proposal content corresponding to the target situation identified by the situation identification unit (15), and a proposal processing unit (19) that causes a proposal to be made according to the proposal content identified by the terminal-side proposal content identification unit (18).
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] In the vehicle control system of Patent Document 1, a proposal is made based on preset conditions. For example, when the "situation of the occupant himself / herself" is "sneezing", the "situation where the occupant is placed" is "October to March", and the "temperature inside the vehicle cabin is less than x degrees", a proposal of "raising the set temperature of the car air conditioner" is made. In such a vehicle control system, since a proposal is made due to satisfying preset conditions, there is a problem that the user may feel bothered by the proposal from the vehicle control system, such as the same proposal being repeatedly made when the same conditions are repeatedly satisfied.
[0005] Therefore, it is desired to realize a vehicle control system that is less likely to make the user feel bothered by the proposal. [Means for solving the problem]
[0006] The vehicle control system according to this disclosure includes: a user recognition unit that recognizes a user of a vehicle; a state information acquisition unit that acquires state information indicating a target state which is at least one of a user state which is the state of the user and a vehicle state which is the state of the vehicle; a storage unit that stores user-specific information unique to the user; an information update unit that performs processing to update the user-specific information stored in the storage unit based on the state information; a normal range setting unit that sets a normal range for the target state based on the user-specific information stored in the storage unit; a proposal execution unit that compares the current state information acquired by the state information acquisition unit with the normal range, determines that a proposal start status exists when the target state indicated in the current state information is outside the normal range, and proposes a change to the vehicle control to the user; and a control execution unit that executes the change to the vehicle control according to the content of the user's response to the proposal by the proposal execution unit.
[0007] According to this configuration, a normal range is set based on user-specific information unique to each user, and if the target state indicated in the current state information is outside the normal range, a change in vehicle control is proposed to the user. Therefore, it is possible to propose changes in vehicle control in appropriate situations according to each user's characteristics and preferences, making it easier to reduce the possibility that the user will find the proposal bothersome. In addition, since the vehicle control change is executed according to the content of the user's response to the proposal, it is difficult for the vehicle control to be changed unintentionally by the user. [Brief explanation of the drawing]
[0008] [Figure 1] This figure shows a vehicle equipped with the vehicle control system according to this embodiment. [Figure 2] Figure 1 shows an example of a normal range set by the normal range setting unit. [Figure 3] Figure 1 shows an example of a normal range set by the normal range setting unit. [Figure 4]Figure 1 shows the vehicle control process by the vehicle control system. [Figure 5] Figure 4 shows the sequence diagram illustrating the flow of the control change process. [Modes for carrying out the invention]
[0009] Hereinafter, embodiments of the vehicle control system 10 will be described with reference to the drawings. Figure 1 is a diagram showing an example of a vehicle 12 equipped with the vehicle control system 10.
[0010] The vehicle control system 10 includes an imaging device 15. The vehicle 12 is equipped with a speaker that outputs audio to the occupant in the driver's seat. The speaker functions as a suggestion output device 16, which will be described later. The vehicle 12 is equipped with a microphone that detects the voice of the occupant in the driver's seat. The microphone functions as a response detection device 17, which will be described later.
[0011] The vehicle control system 10 includes a user recognition unit 21 that recognizes the user 11 of the vehicle 12. The user recognition unit 21 identifies whether the occupant in the driver's seat of the vehicle 12 is a pre-registered user 11. Examples of identification by the user recognition unit 21 include authentication by facial image, authentication by voice, authentication by password input, authentication by key, etc. In this embodiment, the user recognition unit 21 performs authentication by facial image using an image captured by the imaging device 15. The microphone mentioned above may also be used for identification by the user recognition unit 21.
[0012] The vehicle control system 10 includes a state information acquisition unit 22 that acquires state information D1 indicating a target state M. The target state M is at least one of the following: the "user state," which is the state of the user 11, and the "vehicle state," which is the state of the vehicle 12. The state information acquisition unit 22 acquires the state information D1 using one or more of the following: an electroencephalograph, a heart rate monitor, an imaging device, an acceleration sensor, a speed sensor, a tilt sensor, a temperature sensor, a humidity sensor, a vibration sensor, an imaging device 15, a microphone, etc. The state information acquisition unit 22 acquires the state information D1 for example every 0.5 seconds, every 1 second, every 1 minute, etc.
[0013] The user state includes at least one of the following: the user 11's actions toward the vehicle 12; the user 11's emotions determined based on information acquired by sensors attached to the user 11; and the user 11's physical state determined based on information acquired by sensors monitoring the user 11. In this embodiment, the user state is the state of the user 11 who is the occupant in the driver's seat. Figure 2 shows an example of the user 11's actions toward the vehicle 12 acquired by the state information acquisition unit 22. Figure 3 shows an example of the user 11's emotions acquired by the state information acquisition unit 22.
[0014] Examples of operations performed by user 11 on vehicle 12 include driving operations such as accelerator operation, brake operation, steering operation, and shift operation, as well as operation of vehicle equipment such as air conditioning and audio. Examples of accelerator operation amounts include the amount the accelerator is pressed and the throttle opening. Examples of brake operation amounts include the amount the brake is pressed and the amount the brake pads are moved. In Figure 2, the maximum values of accelerator operation amount, accelerator operation amount with respect to time, brake operation amount, and brake operation amount with respect to time for each of the four users 11 (U1, U2, U3, U4) over a predetermined period T1 are shown as bar graphs.
[0015] Examples of User 11's emotions, determined based on information acquired by sensors attached to User 11, include emotional valence and arousal level. Figure 3 shows User 11's emotions on independent two-dimensional axes. Arousal level indicates the degree of physical and cognitive arousal, such as whether the user is arousal (Arousal +) or calm (Arousal -). Emotional valence indicates the degree of pleasure (Valence +) or displeasure (Valence -).
[0016] Examples of the physical condition of user 11 determined based on information acquired by sensors monitoring user 11 include user 11's facial expressions, voice, movements, etc., which can be detected by various sensors, imaging device 15, microphone, etc. Examples of user 11's movements include blinking, crying, sneezing, coughing, yawning, head orientation, arm movements, leg movements, body swaying, etc.
[0017] The vehicle condition includes at least one of the vehicle's motion state and the vehicle's cabin environment. Examples of the vehicle's motion state include longitudinal acceleration, lateral acceleration, travel speed, roll angle, pitch angle, steering angle, inclination, etc. Examples of the vehicle's cabin environment include temperature, humidity, noise, vibration, etc.
[0018] As shown in Figure 1, the vehicle control system 10 includes a storage unit 30 that stores user-specific information D2 unique to the user 11. The vehicle control system 10 includes an information update unit 23 that performs processing to update the user-specific information D2 stored in the storage unit 30. The vehicle control system 10 includes a normal range setting unit 24 that sets the normal range E1 of the target state M.
[0019] In this embodiment, the information update unit 23 performs a process to update the user-specific information D2 stored in the storage unit 30 based on the state information D1 acquired by the state information acquisition unit 22. The user-specific information D2 stored in the storage unit 30 may be the state information D1, or it may be a value obtained by statistically processing the state information D1. Examples of user-specific information D2 include the measurement results of past state information D1, the average value of past state information D1 measurement results, the maximum value of past state information D1 measurement results, the minimum value of past state information D1 measurement results, the median value of past state information D1 measurement results, etc.
[0020] The normal range setting unit 24 sets the normal range E1 of the target state M based on the user-specific information D2 stored by the storage unit 30. The normal range E1 of the target state M is set based on a value obtained by statistically processing the state information D1 during a predetermined period T1. Examples of the normal range E1 include a range below the maximum value of the state information D1 during the predetermined period T1, a range below the minimum value of the state information D1 during the predetermined period T1, a boundary between a region with a large number of measured values and a region with a small number of measured values, and the like. Examples of the predetermined period T1 include the past one week, the past one month, the past six months, the past one year, and the like.
[0021] In the example shown in FIG. 2, the normal range E1 is set based on the maximum value of the state information D1. Examples of the normal range E1 based on the maximum value of the state information D1 include a range smaller than the maximum value of the state information D1, a range smaller than 1.1 times the maximum value of the state information D1, a range smaller than 1.5 times the maximum value of the state information D1, and the like. In FIG. 3, a region with a large number of measured values during the predetermined period T1 is set as the normal range E1.
[0022] The normal range setting unit 24 sets each normal range E1, for example, according to a predetermined time zone. Examples of time zones include morning, noon, evening, night, commuting time zones, holiday time zones, and the like. The normal range setting unit 24 sets each normal range E1, for example, according to the classification of roads. Examples of road classifications include highways, general roads, private roads, and the like. The normal range setting unit 24 sets each normal range E1, for example, according to the weather.
[0023] In this embodiment, the normal range E1 set by the normal range setting unit 24 is included in the user-specific information D2 stored in the storage unit 30. When the normal range setting unit 24 sets the normal range E1, the information update unit 23 updates the information of the normal range E1 stored in the storage unit 30.
[0024] The vehicle control system 10 includes a proposal execution unit 25 that proposes changes to the vehicle control to the user 11. The proposal execution unit 25 compares the current state information D1 acquired by the state information acquisition unit 22 with the normal range E1. If the target state Mn indicated in the current state information D1 is outside the normal range E1, the proposal execution unit 25 determines that it is a proposal start situation and proposes changes to the vehicle control to the user 11.
[0025] Here, the target state M indicated in the current state information D1 is defined as the current target state Mn. The current state information D1 may be, for example, one state information D1 measured most recently, multiple state information D1 from the last 10 seconds, multiple state information D1 from the last 1 minute, multiple state information D1 from the last 10 minutes, etc.
[0026] Whether the current target state Mn is outside the normal range E1 may be determined by comparing multiple types of current state information D1 with the normal range E1, or by comparing one type of current state information D1 with the normal range E1. Whether the current target state Mn is outside the normal range E1 may be determined by whether one measurement value of the current state information D1 is located outside the normal range E1, or by whether multiple measurement values of the current state information D1 are located outside the normal range E1.
[0027] The vehicle control system 10 is equipped with a suggestion output device 16. Suggestions from the suggestion execution unit 25 are output to the user 11 by the suggestion output device 16. Examples of the suggestion output device 16 include a speaker, an image output device, a light-emitting device, a user 11's mobile terminal, etc.
[0028] The vehicle control system 10 includes a control execution unit 26 that performs modifications to the vehicle control. The control execution unit 26 performs modifications to the vehicle control according to the content of the user's response to the proposal made by the proposal execution unit 25. In this embodiment, the control execution unit 26 determines whether or not to perform vehicle control according to the content of the user's response to the proposal made by the proposal execution unit 25. The control execution unit 26 determines the degree of modification to the vehicle control according to the content of the user's response to the proposal made by the proposal execution unit 25.
[0029] If the user's response to the proposal from the proposal execution unit 25 is positive, the control execution unit 26 will implement a change to the vehicle control based on the proposal from the proposal execution unit 25. If the user's response to the proposal from the proposal execution unit 25 is negative, the control execution unit 26 will not implement a change to the vehicle control based on the proposal from the proposal execution unit 25. In this embodiment, if the user's response from the proposal execution unit 26 is positive, the control execution unit 26 will determine the degree of change to the vehicle control according to the strength of the positive response.
[0030] "Vehicle control modification" includes at least one of the following: changing the responsiveness settings of the vehicle 12 to user 11's operations, changing the state settings of various parts of the vehicle 12, and changing the operating state of various equipment in the cabin. In this embodiment, the user-specific information D2 stored in the storage unit 30 includes the results of the vehicle control modification performed by the control execution unit 26 according to the content of user 11's response. In this way, vehicle control can be optimized according to the content of user 11's response.
[0031] Examples of changing the settings for the vehicle 12's responsiveness to user 11's operations include adjusting the ratio of accelerator opening to user 11's operations, adjusting the ratio of braking force to user 11's operations, adjusting the ratio of actual steering angle to steering angle, adjusting the response speed during gear changes, adjusting the gear change initiation conditions, and so on.
[0032] Examples of changing the settings of various parts of the vehicle 12 include adjusting the stiffness of the suspension, changing various settings of the power source, and adjusting the strength of the regenerative brakes.
[0033] Examples of changes to the operating status of various cabin equipment include the air conditioning temperature setting, audio settings, sunroof opening / closing, and window opening / closing.
[0034] The vehicle control system 10 is equipped with a response detection device 17. The user's response to a proposal made by the proposal execution unit 25 is detected by the response detection device 17. Examples of the response detection device 17 include a microphone, touch panel, keyboard, buttons on the steering wheel, the user's mobile terminal, etc.
[0035] The vehicle control system 10 includes a machine learning unit 28. In this embodiment, the machine learning unit 28 converts the voice responses of the user 11 into text information using machine learning.
[0036] In this embodiment, the machine learning unit 28 learns the correspondence between the proposals made by the proposal execution unit 25 and the user's responses, and the control execution unit 26 determines whether or not to perform vehicle control based on the correspondence learned by the machine learning unit 28.
[0037] In this embodiment, the machine learning unit 28 learns the correspondence between the user's 11 responses and past vehicle control results, and the control execution unit 26 determines the degree of change to the vehicle control based on the correspondence learned by the machine learning unit 28.
[0038] Figure 4 is a flowchart illustrating an example of vehicle control processing by the vehicle control system 10. The vehicle control system 10 includes a control device having a arithmetic processing unit such as a CPU (Central Processing Unit) and a main memory that can be accessed by the arithmetic processing unit, such as RAM (Random Access Memory) and ROM (Read Only Memory). Each function of the control device is realized through the cooperation of the hardware provided by the control device and the program executed on the hardware such as the arithmetic processing unit. In this embodiment, the control device (specifically, the arithmetic processing unit provided by the control device) functions as a "computer".
[0039] In this embodiment, the user recognition unit 21 performs an identification process S10 to determine whether the occupant in the driver's seat of the vehicle 12 is a pre-registered user 11. In this embodiment, if the occupant in the driver's seat of the vehicle 12 is a pre-registered user 11, the vehicle control mode of the vehicle 12 is set to the "normal control mode" corresponding to the normal range E1 based on user-specific information D2 corresponding to user 11. If the occupant in the driver's seat of the vehicle 12 is not a pre-registered user 11, for example, a new user 11 is registered. In this embodiment, after the completion of the identification process S10, the status information acquisition unit 22 starts a status information acquisition process to acquire status information D1.
[0040] In this embodiment, the normal range setting unit 24 performs a normal range setting process S20 to set the normal range E1 of the target state M based on user-specific information D2. In this embodiment, the normal range E1 of the target state M is set based on the user-specific information D2 updated by the information update unit 23 in the update process S50 described later.
[0041] In this embodiment, the proposal execution unit 25 performs a state comparison process S30 that compares the current state information D1 acquired by the state information acquisition unit 22 with the normal range E1. The proposal execution unit 25 determines that the proposal has started if the target state Mn indicated in the current state information D1 is outside the normal range E1. If the target state Mn indicated in the current state information D1 is within the normal range E1, the proposal execution unit 25 repeats the state comparison process S30 at regular intervals.
[0042] In this embodiment, when the control execution unit 26 determines that the proposal has started, it performs a control change process S40 that modifies the vehicle control according to the content of the user's response to the proposal from the proposal execution unit 25.
[0043] Figure 5 is a sequence diagram showing an example of the flow of the control change process S40. In the control change process S40, the proposal execution unit 25 performs a proposal execution process to propose a change to the vehicle control to the user 11. In the illustrated example, the proposal execution process includes the first question generation process S41, the second question generation process S42, and the third question generation process S44. In the control change process S40, the control execution unit 26 performs a control execution process to execute the change to the vehicle control. In the illustrated example, the control execution process includes the first control adjustment process S43 and the second control adjustment process S45.
[0044] If the proposal execution unit 25 determines that the proposal has started, it asks the user 11 a first question corresponding to the target state Mn shown in the current state information D1 obtained by the state information acquisition unit 22 (first question generation process S41). In this embodiment, the first question is a single question, but the first question may consist of multiple questions.
[0045] When the proposal execution unit 25 receives a first response from the user 11 to the first question, it asks the user 11 a second question (second question generation process S42) that proposes a change to the vehicle control according to the content of the first response. In this embodiment, the proposal in the second question is one option, but the proposal in the second question may be multiple options.
[0046] In this embodiment, the first question corresponding to the current target state Mn is a question that asks about the factors that cause the current target state Mn to be outside the normal range E1. For example, the first question is a question that asks about the factors that cause the current target state Mn, which is a user state, to be rough with the vehicle 12 by the user 11, tension, nervousness, depression, apathy, or other emotions of the user 11, or the user 11's physical state such as sleepiness or sluggishness. The first question is generated, for example, by the machine learning unit 28 learning the correspondence between the current state information D1, the first question, and the first answer, and based on the learned correspondence.
[0047] Examples of initial questions include: "You seem more irritable than usual. Did something upsetting happen?", "You seem to be having more trouble driving than usual. Is there anything bothering you?", and "You seem to be feeling less well than usual. Is there something wrong with the car?".
[0048] In this embodiment, the second question is a question that asks whether it is possible to select a change in vehicle control that may resolve the factors causing the current state information D1 to fall outside the normal range E1, and whether the selected change in vehicle control is permissible. The second question is generated according to, for example, the type of current target state Mn that has fallen outside the normal range E1, the direction in which the current target state Mn is deviating from the normal range E1, the amount by which the current target state Mn is deviating from the normal range E1, etc. The machine learning unit 28 learns the correspondence between the second question and the second answer and generates the second question based on the learned correspondence.
[0049] Examples of the second question include: "Shall we switch to a control setting that's just right for your irritated feelings?", "Shall we slow down the accelerator response?", "Shall we lower the humidity inside the car?", and "Shall we open the windows for 100 seconds?".
[0050] When the control execution unit 26 receives a second response from the user 11 to the second question, it performs a change in vehicle control according to the content of the second response (first control adjustment process S43). In this embodiment, the control execution unit 26 determines whether or not to perform vehicle control based on the second question according to the content of the second response. If the content of the second response is positive, the control execution unit 26 performs a change in vehicle control based on the second question. If the content of the second response is negative, the control execution unit 26 does not perform a change in vehicle control based on the second question.
[0051] In this embodiment, if the content of the second answer is positive, the control execution unit 26 determines the degree to which the vehicle control is modified based on the second question, according to the strength of the positive response. In this embodiment, machine learning by the machine learning unit 28 described above is used by the control execution unit 26 to modify the vehicle control according to the content of the second answer.
[0052] The proposal execution unit 25, after the control execution unit 26 has modified the vehicle control according to the content of the second response, asks the user 11 a third question to ask for their opinion on the changes to the vehicle control (third question generation process S44). Examples of the third question include, "How do you like the current control?", "How do you like the current accelerator response?", etc.
[0053] The control execution unit 26, upon receiving a third response from the user 11 to the third question, performs a change to the vehicle control according to the content of the third response (second control adjustment process S45). The control execution unit 26 determines whether or not to perform a change to the vehicle control based on the content of the third response.
[0054] If the content of the third response is positive regarding the modification of vehicle control based on the second question, the control execution unit 26 will not perform vehicle control based on the content of the third response. If the content of the third response is negative regarding the modification of vehicle control based on the second question, the control execution unit 26 will perform vehicle control based on the content of the third response.
[0055] In this embodiment, if the content of the third response is negative regarding the change in vehicle control based on the second question, the control execution unit 26 determines the degree of change in vehicle control based on the content of the third response according to the strength of the negative response. In this embodiment, the control execution unit 26 adjusts at least one of the amount of change and the direction of change in vehicle control according to the content of the third response. In this embodiment, machine learning by the machine learning unit 28 described above is used by the control execution unit 26 to change the vehicle control according to the content of the third response.
[0056] The proposal execution unit 25 may, after the control execution unit 26 has performed a change to the vehicle control according to the content of the third response, ask the user 11 a third question again to ask for their opinion on the change to the vehicle control. For example, the third question generation process S44 and the second control adjustment process S45 may be repeated until the content of the third response indicates that no change to the vehicle control is necessary.
[0057] Returning to Figure 4, the information update unit 23 updates the user-specific information D2 stored in the storage unit 30 (update process S50). The information update unit 23 updates the user-specific information D2 stored in the storage unit 30 according to the content of the user 11's response to the proposal from the proposal execution unit 25. In this embodiment, when there is a third response from the user 11 to the third question, the information update unit 23 updates the user-specific information D2 stored in the storage unit 30 according to the content of the third response. In this way, the control of the vehicle 12 can be brought closer to vehicle control in which the target state M is likely to be within the normal range E1.
[0058] In this embodiment, user-specific information D2 includes the result of the vehicle control change performed by the control execution unit 26. If the content of the third response is positive regarding the vehicle control change based on the second question, the information update unit 23 updates the user-specific information D2 to reflect the result of the vehicle control based on the second question. If the content of the third response is negative regarding the vehicle control change based on the second question, the information update unit 23 updates the user-specific information D2 to reflect the result of the vehicle control based on the content of the third response.
[0059] "Vehicle control" includes at least one of the following: setting the responsiveness of the vehicle 12 to user 11 operations, setting the state of various parts of the vehicle 12, and setting the operation of various equipment in the cabin.
[0060] In this embodiment, user-specific information D2 includes information on the normal control mode, which is vehicle control corresponding to the normal range E1. When the user 11 gives a third answer to the third question, the information update unit 23 updates the information on the normal control mode, which is vehicle control corresponding to the normal range E1, according to the content of the third answer. In this way, the normal control mode can be made closer to vehicle control in which the target state M is likely to fall within the normal range E1.
[0061] Examples of third-party responses include: "It's just right," "It could be stronger," "The response has worsened," and "It's too strong."
[0062] In this embodiment, the vehicle control system 10 performs the operation termination process S60 when it determines that the operation by the user 11 has ended. The end of the operation by the user 11 is determined, for example, when the ignition power of the vehicle 12 is turned off, or when the user 11 is not present in the vehicle 12 for a certain period of time. In the operation termination process S60, the status information acquisition process in which the status information acquisition unit 22 acquires status information D1 is terminated.
[0063] In this embodiment, if the current target state Mn, which is the user state, is good and the current target state Mn is outside the normal range E1, it is determined that a proposal start situation has occurred, and a change in vehicle control that will improve the current target state Mn is proposed to the user 11. For example, if the user state is a comfortable (Valence +) and aroused (Arousal +) state as shown in Figure 3 and is outside the normal range E1, the first and second questions are asked, which tend to move the user state in the direction of the upper right of Figure 3.
[0064] Examples of the first question include, "You seem to be in a better mood than usual. Did something good happen?", and "You seem to be driving more smoothly than usual. Did something good happen?". Examples of the second question include, "Shall we switch to a control setting that suits your current mood?", "Shall we improve the accelerator responsiveness?", and "Shall we improve the brake responsiveness?".
[0065] As shown in Figure 1, in this embodiment, the entire vehicle control system 10 is mounted on the vehicle 12. However, a part of the vehicle control system 10 may be mounted on the vehicle 12, with other parts located in an external facility, such as an external server like a cloud server. Alternatively, the entire vehicle control system 10, excluding sensors for detecting user status and vehicle status, may be located outside the vehicle 12. In these cases, the parts of the vehicle control system 10 mounted on the vehicle 12 and the parts located outside the vehicle 12 can be changed as appropriate.
[0066] If part or all of the vehicle control system 10 is located outside the vehicle 12, the vehicle control system 10 and the vehicle 12 are connected wirelessly for communication and transmission of necessary information. In these cases, for example, even in multiple vehicles 12 owned by a user 11, or in vehicles 12 shared by multiple users 11 (e.g., rental cars, shared cars, company cars, etc.), it is possible to propose changes to vehicle control in appropriate situations according to the characteristics and preferences of each user 11, or to perform vehicle control according to the characteristics and preferences of each user 11.
[0067] [Other Embodiments] Next, other embodiments of the vehicle control system 10 will be described.
[0068] (1) In the above embodiment, the user recognition unit 21 identifies whether the occupant in the driver's seat of the vehicle 12 is a pre-registered user 11, and the user state acquired by the state information acquisition unit 22 is the state of user 11 who is the occupant in the driver's seat. However, the system is not limited to such an example, and for example, the user state acquired by the state information acquisition unit 22 may include the state of user 11 who is an occupant in the passenger seat or rear seat. Also, for example, the user state acquired by the state information acquisition unit 22 may be the state of user 11 who is an occupant in the passenger seat or rear seat. Also, for example, the user 11 identified by the user recognition unit 21 may be user 11 who is an occupant in the passenger seat or rear seat. In this way, vehicle control can be changed according to the characteristics and preferences of user 11 who is an occupant in the passenger seat or rear seat.
[0069] (2) In the above embodiment, a configuration was described as in which the proposal execution unit 25 asks the user 11 a first question and a second question, and the control execution unit 26 performs a change in vehicle control according to the content of the second answer. However, the system is not limited to such an example, and for example, if the proposal execution unit 25 determines that it is in a proposal start state, it may propose a change in vehicle control without asking the first question.
[0070] (3) In the above embodiment, a configuration was described as in which the proposal execution unit 25 asks the user 11 a third question and the information update unit 23 updates the user-specific information D2 according to the content of the third answer. However, the embodiment is not limited to such an example, and for example, the information update unit 23 may update the user-specific information D2 in the operation termination process S60 regardless of the content of the third answer. Alternatively, for example, the information update unit 23 may update the user-specific information D2 according to the content of the second answer. Alternatively, for example, the proposal execution unit 25 may not ask a third question.
[0071] (4) In the above embodiment, a configuration in which user-specific information D2 includes state information D1, the result of the vehicle control change by the control execution unit 26, and the normal range E1 was described as an example. However, the embodiment is not limited to such an example, for example, user-specific information D2 may not include the result of the vehicle control change by the control execution unit 26. Also, for example, user-specific information D2 may not include the normal range E1.
[0072] (5) In the above embodiment, a configuration in which the normal range setting process S20 is performed between the identification process S10 and the state comparison process S30 was described as an example. However, the example is not limited to such an example, and for example, the normal range E1 may be determined at the time of the previous operation termination process S60 and stored in the storage unit 30.
[0073] (6) In the above embodiment, a configuration was described in which machine learning by the machine learning unit 28 is used for both the proposal made by the proposal execution unit 25 and the modification of the vehicle control by the control execution unit 26 in accordance with the user's response. However, the embodiment is not limited to such an example, and for example, machine learning by the machine learning unit 28 may be used for either the proposal made by the proposal execution unit 25 or the modification of the vehicle control by the control execution unit 26 in accordance with the user's response. Also, for example, the vehicle control system 10 does not have to include the machine learning unit 28.
[0074] (7) In the above embodiment, a configuration was described as an example in which the target state M indicated in the status information D1, which is the user state, is good, and there is a region in which the target state M indicated in the status information D1 is outside the normal range E1. However, the system is not limited to such an example, and for example, the normal range setting unit 24 may set the normal range E1 so that all parts in which the target state M, which is the user state, is good are within the normal range E1.
[0075] (8) The configurations disclosed in the embodiments described above can be applied in combination with configurations disclosed in other embodiments, as long as no inconsistencies arise. With regard to other configurations, the embodiments disclosed herein are merely illustrative in all respects. Therefore, various modifications can be made as appropriate without departing from the spirit of this disclosure.
[0076] [Summary of the above embodiments] The vehicle control system related to this disclosure will be described below.
[0077] In one embodiment, the vehicle control system (10) includes a user recognition unit (21) that recognizes the user (11) of the vehicle (12), a state information acquisition unit (22) that acquires state information (D1) that indicates a target state (M) which is at least one of the user state, which is the state of the user (11), and the vehicle state, which is the state of the vehicle, a storage unit (30) that stores user-specific information (D2) that is unique to the user (11), an information update unit (23) that performs processing to update the user-specific information (D2) stored in the storage unit (30) based on the state information (D1), and the user-specific information (D2) stored in the storage unit (30) The system includes: a normal range setting unit (24) that sets a normal range (E1) for the target state (M) based on available information (D2); a proposal execution unit (25) that compares the current state information (D1) acquired by the state information acquisition unit (22) with the normal range (E1), determines that the target state (Mn) indicated in the current state information (D1) is outside the normal range (E1), and proposes a change in vehicle control to the user (11); and a control execution unit (26) that executes the change in vehicle control according to the content of the user's (11) response to the proposal from the proposal execution unit (25).
[0078] According to this configuration, a normal range (E1) is set based on user-specific information (D2) unique to the user (11), and if the target state (Mn) indicated in the current state information (D1) is outside the normal range (E1), a change in vehicle control is proposed to the user (11). Therefore, it is possible to propose changes in vehicle control in appropriate situations according to the characteristics and preferences of each user, and it is easier to reduce the possibility that the user (11) will find the proposal bothersome. In addition, since the vehicle control change is executed according to the content of the user's (11) response to the proposal, it is difficult for the vehicle control to be changed unintentionally by the user (11).
[0079] In one embodiment, when the proposal execution unit (25) determines that it is in a proposal start state, it asks the user (11) a first question corresponding to the target state (Mn) indicated in the current state information (D1) acquired by the state information acquisition unit (22). When the user (11) gives a first answer to the first question, the control execution unit (26) asks the user (11) a second question proposing a change in vehicle control according to the content of the first answer. When the user (11) gives a second answer to the second question, the control execution unit (26) executes a change in vehicle control according to the content of the second answer.
[0080] With this configuration, the vehicle control is modified according to the content of the second response, making it easier to modify the vehicle control to closely match the user's (11) wishes. Furthermore, since the first and second questions are asked to the user (11), and the vehicle control is modified according to the user's (11) answers to those questions, it is easier to implement vehicle control that appropriately reflects the user's (11) vague requests.
[0081] In one embodiment, the proposal execution unit (25) asks the user (11) a third question to ask for their opinion on the vehicle control changes after the control execution unit (26) has performed the changes according to the content of the second response, and the information update unit (23) updates the user-specific information (D2) stored in the storage unit (30) according to the content of the third response, which is the user's (11) answer to the third question.
[0082] With this configuration, by updating user-specific information (D2) according to the content of the third response, the results of the changes to the vehicle control this time can be used for the next vehicle control.
[0083] In one embodiment, the user state includes at least one of the user's (11) operation of the vehicle (12), the user's (11) emotions determined based on information acquired by sensors attached to the user (11), and the user's (11) state determined based on information acquired by sensors monitoring the user (11); the vehicle state includes at least one of the vehicle's (12) motion state and the vehicle's (12) cabin environment state; and the vehicle control change includes at least one of changing the settings for the vehicle's (12) responsiveness to the user's (11) operation, changing the settings for the state of each part of the vehicle (12), and changing the operating state of various equipment in the cabin.
[0084] This configuration makes it easier to appropriately reflect the user's (11) state and the vehicle's (12) state in vehicle control. It also makes it easier to make appropriate changes to vehicle control according to the user's (11) state and the vehicle's (12) state.
[0085] The vehicle control system described herein only needs to achieve at least one of the effects described above. The technical features of the vehicle control system described herein are also applicable to vehicle control methods and vehicle control programs. [Explanation of Symbols]
[0086] 10: Vehicle control system, 11: User, 12: Vehicle, 21: User recognition unit, 22: Status information acquisition unit, 23: Information update unit, 24: Normal range setting unit, 25: Proposal execution unit, 26: Control execution unit, 30: Storage unit
Claims
1. A user recognition unit that recognizes the vehicle's user, A state information acquisition unit that acquires state information indicating a target state which is at least one of the user state, which is the state of the user, and the vehicle state, which is the state of the vehicle. A storage unit that stores user-specific information unique to the user, An information update unit performs a process to update the user-specific information stored in the storage unit based on the status information, A normal range setting unit sets a normal range for the target state based on the user-specific information stored in the storage unit, A proposal execution unit compares the current state information acquired by the state information acquisition unit with the normal range, and if the target state indicated in the current state information is outside the normal range, it determines that the proposal is in a proposal start state and proposes a change in vehicle control to the user. A vehicle control system comprising: a control execution unit that performs a change to the vehicle control according to the content of the user's response to the proposal made by the proposal execution unit.
2. When the proposal execution unit determines that the proposal has started, The system acquires a status information unit and asks the user a first question corresponding to the target state indicated in the current status information. If a first response is received from the user in response to the first question, a second question is asked to the user to propose a change to the vehicle control in accordance with the content of the first response. The vehicle control system according to claim 1, wherein the control execution unit, upon receiving a second answer which is the user's response to the second question, performs a change to the vehicle control according to the content of the second answer.
3. After the control execution unit has performed the modification of the vehicle control according to the content of the second response, the proposal execution unit asks the user a third question to ask for their opinion on the modification of the vehicle control. The vehicle control system according to claim 2, wherein the information update unit updates the user-specific information stored in the storage unit according to the content of the third answer when the user has given a third answer to the third question.
4. The user state includes at least one of the user's operations on the vehicle, the user's emotions determined based on information acquired by sensors attached to the user, and the user's state determined based on information acquired by sensors monitoring the user. The vehicle condition includes at least one of the vehicle's motion state and the vehicle's cabin environment state. The vehicle control system according to any one of claims 1 to 3, wherein the modification of the vehicle control includes at least one of changing the setting of the vehicle's responsiveness to user operations, changing the setting of the state of each part of the vehicle, and changing the operating state of various equipment in the cabin.