Vehicle interior environment setting device, vehicle, and vehicle interior environment setting method

The in-vehicle environment setting device addresses the challenge of adapting interior settings to individual emotions by using occupant information and emotion estimation to dynamically adjust lighting and other factors, improving comfort and satisfaction.

JP7587107B2Active Publication Date: 2024-11-20TS TECH CO LTD
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
JP2020128534
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2020-07-29
Publication Date
2024-11-20
Estimated Expiration
2040-07-29

AI Technical Summary

Technical Problem

Existing in-vehicle environment setting devices fail to adapt the interior environment to the varying emotions of occupants, as they rely solely on biological rhythms, neglecting individual feelings and preferences.

Method used

An in-vehicle environment setting device that includes an occupant information acquisition unit, emotion estimation unit, and environment determining unit to quantify and learn the correspondence between occupant emotions and environment settings, adjusting lighting and other environmental factors to suit individual emotional states.

Benefits of technology

The system effectively adapts the vehicle interior to the occupants' emotions, enhancing comfort and satisfaction by dynamically adjusting lighting and other settings based on learned emotional responses.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007587107000001
    Figure 0007587107000001
  • Figure 0007587107000002
    Figure 0007587107000002
  • Figure 0007587107000003
    Figure 0007587107000003
Patent Text Reader

Abstract

To provide an in-vehicle environment setting device capable of suitably adapting an in-vehicle environment to the feeling of an occupant.SOLUTION: An information processing device includes an occupant information acquisition part 101 for acquiring occupant information on an occupant of a vehicle, a feeling estimation part 102 for estimating the feeling of the occupant on the basis of the occupant information acquired by the occupant information acquisition part 101, an environment setting part for setting an in-vehicle environment, a learning part 104 for learning a correspondence relation between the in-vehicle environment set by the environment setting part and the feeling of the occupant, and an environment determination part 103 for determining a target in-vehicle environment on the basis of the feeling of the occupant estimated by the feeling estimation part 102 and the correspondence relation learned by the learning part 104. The environment setting part outputs a setting change command to an apparatus mounted on the vehicle such that the in-vehicle environment becomes the target in-vehicle environment determined by the environment determination part 103.SELECTED DRAWING: Figure 3
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to an in-vehicle environment setting device for setting an environment such as brightness inside a vehicle, a vehicle, and an in-vehicle environment setting method. [Background technology]

[0002] A known example of this type of device is one that sets the brightness inside a vehicle in accordance with biological rhythms that change depending on the time of day, such as morning, daytime, and nighttime (see, for example, Patent Document 1). The device described in Patent Document 1 automatically controls the lighting device inside the vehicle to achieve a color temperature and brightness that the occupants find comfortable. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2015-221655 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the brightness that occupants find comfortable may differ depending on the occupants' emotions at the time, even during the same time period. Therefore, simply setting the brightness inside the vehicle in accordance with the occupants' biological rhythms, as in the device described in Patent Document 1, may not result in a good adaptation between the in-vehicle environment and the occupants' emotions. [Means for solving the problem]

[0005] An in-vehicle environment setting device according to one aspect of the present invention includes an occupant information acquisition unit that acquires occupant information related to vehicle occupants, an emotion estimation unit that estimates the emotions of the occupants based on the occupant information acquired by the occupant information acquisition unit and calculates an emotion value by quantifying the estimated occupant emotions, an environment setting unit that sets an in-vehicle environment, a learning unit that learns a correspondence between the in-vehicle environment set by the environment setting unit and the emotions of the occupants, and an environment determination unit that determines a target in-vehicle environment based on the emotions of the occupants estimated by the emotion estimation unit and the correspondence learned by the learning unit. The environment setting unit outputs a setting change command to equipment installed in the vehicle so that the in-vehicle environment becomes the target in-vehicle environment determined by the environment determination unit, the emotion estimation unit estimates emotions corresponding to each of a plurality of parameters representing the emotions of the occupants based on the occupant information acquired by the occupant information acquisition unit, and the environment determination unit determines the target in-vehicle environment so that, when the emotion value of the occupant's emotion corresponding to the reference parameter is less than a threshold value, the emotion value becomes equal to or greater than the threshold value, using any parameter designated in advance by the occupant from among the plurality of parameters as a reference parameter. The device includes a lighting device installed in the vehicle. The setting change command includes a setting value for either the color of light emitted from the lighting device or the light intensity. When the emotion of the occupant corresponding to the reference parameter is joy, and the emotion value is less than a threshold value at a second time point after the setting change command is transmitted by the environment setting unit at a first time point, the environment determination unit determines a first target interior environment so that the color of the light is an orange color with an uplifting effect. If the emotion value decreases after the environment setting unit outputs a first setting change command corresponding to the first target interior environment, the environment determination unit further determines a second target interior environment so that the color of the light is a green color with a calming effect. When the emotion value becomes equal to or greater than a threshold value after the environment setting unit outputs the first setting change command or a second setting change command corresponding to the second target interior environment, the learning unit learns a correspondence relationship based on the setting value of the light color included in the second setting change command and the emotion value at the first time point.

[0006] Another aspect of the present invention is a vehicle including the above-described interior environment setting device.

[0007] Another aspect of the present invention is a method for setting an in-vehicle environment, which includes a step of acquiring occupant information about a vehicle occupant; a step of estimating the occupant's emotions based on the acquired occupant information and calculating an emotion value by quantifying the estimated occupant's emotions; a learning step of learning the correspondence between the in-vehicle environment and the occupant's emotions; a determination step of determining a target in-vehicle environment based on the estimated occupant's emotions and the learned correspondence; and an output step of outputting a setting change command to equipment mounted in the vehicle so that the in-vehicle environment becomes the determined target in-vehicle environment.In the estimation step, emotions corresponding to each of a plurality of parameters representing the occupant's emotions are estimated based on the occupant information, and in the determination step, an arbitrary parameter from the plurality of parameters designated in advance by the occupant is used as a reference parameter, and when the emotion value of the occupant's emotion corresponding to the reference parameter is below a threshold, the target in-vehicle environment is determined so that the emotion value is equal to or greater than the threshold. The device includes a lighting device installed in the vehicle. The setting change command includes a setting value for either the color of light emitted from the lighting device or the light intensity. In the determining step, when the emotion of the occupant corresponding to the reference parameter is joy, if the emotion value is less than a threshold at a second time point after the setting change command is transmitted at a first time point, a first target in-vehicle environment is determined so that the light color is an orange color with an uplifting effect. If the emotion value decreases after the first setting change command corresponding to the first target in-vehicle environment is output, a second target in-vehicle environment is determined so that the light color is a green color with a calming effect. In the learning step, if the emotion value becomes equal to or greater than a threshold after the first setting change command or a second setting change command corresponding to the second target in-vehicle environment is output, a correspondence is learned based on the setting value of the light color included in the second setting change command and the emotion value at the first time point. [Effects of the Invention]

[0008] According to the present invention, the interior environment of the vehicle can be well adapted to the emotions of the occupants. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a block diagram showing a schematic configuration of an in-vehicle environment setting system according to an embodiment of the present invention; [Figure 2] 1 is a block diagram showing a configuration of a main part of an in-vehicle device according to an embodiment of the present invention; [Figure 3] 1 is a block diagram showing the configuration of a main part of an information processing apparatus according to an embodiment of the present invention; [Figure 4] FIG. 10 is a block diagram illustrating another example of the configuration of the vehicle interior environment setting device according to the embodiment of the present invention. [Figure 5] 4 is a flowchart showing an example of processing executed by a CPU of the information processing apparatus according to the embodiment of the present invention. [Figure 6] FIG. 2 is a diagram for explaining processing in the information processing apparatus according to the embodiment of the present invention. [Figure 7] FIG. 10 is a block diagram showing the configuration of a main part of an in-vehicle device according to a first modified example. [Figure 8] A diagram showing the appearance of the special seat. [Figure 9] FIG. 9 is a diagram showing a schematic configuration of the special seat shown in FIG. 8; DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, an embodiment of the present invention will be described with reference to FIGS. 1 to 6. FIG. 1 is a block diagram showing a schematic configuration of an in-vehicle environment setting system 100 according to an embodiment of the present invention. The in-vehicle environment setting system 100 is a system capable of setting the environment inside a vehicle, and includes an information processing device 1 and an in-vehicle device 3 mounted on a vehicle 2. The information processing device 1 and the in-vehicle device 3 are configured to be able to communicate with each other via a communication network 4. The communication network 4 is a wireless public line such as a mobile phone network or an Internet line. Note that the in-vehicle environment setting device according to this embodiment is configured to include the information processing device 1 and the in-vehicle device 3. Furthermore, while FIG. 1 illustrates one in-vehicle device 3, multiple in-vehicle devices 3 may be connected to the information processing device 1. In other words, the information processing device 1 may be configured to be able to communicate with in-vehicle devices 3 mounted on multiple vehicles.

[0011] The vehicle 2 is configured as an autonomous vehicle with an autonomous driving function. That is, the vehicle 2 has various sensors such as a camera, radar, and lidar that detect the situation around the vehicle 2, and various actuators such as a travel motor and a steering motor, and the various actuators are controlled based on signals from the various sensors. As a result, the vehicle 2 is autonomously driven toward its destination.

[0012] 2 is a block diagram showing the configuration of the main parts of the in-vehicle device 3 according to this embodiment. As shown in Fig. 2, the in-vehicle device 3 is connected to an input unit 32, a group of sensors 33, a communication unit 34, a microphone 35, a speaker 36, a display 37, a lighting device 38, and a drive unit 39, which are all mounted on the vehicle 2.

[0013] The input unit 32 is a general term for devices operated by an occupant (such as the driver) of the vehicle 2, and includes various switches. A touch panel may be provided on the display screen of the display 37, and the touch panel may be configured as the input unit 32. Various commands and information are input to the in-vehicle device 3 in response to operations on the input unit 32. The various switches include a manual / automatic changeover switch that commands either the automatic driving mode or the manual driving mode.

[0014] The manual / automatic changeover switch is configured as a switch that can be manually operated by, for example, an occupant of the vehicle 2, and outputs a command to switch to an automatic driving mode in which the automatic driving function is enabled or to a manual driving mode in which the automatic driving function is disabled depending on the switch operation. A command to switch from the manual driving mode to the automatic driving mode or from the automatic driving mode to the manual driving mode may be issued when a predetermined driving condition is met, regardless of the operation of the manual / automatic changeover switch. In other words, the manual / automatic changeover switch may be automatically switched, so that the mode switch is performed automatically rather than manually.

[0015] The sensor group 33 includes a camera 331, a seating sensor 332, a heartbeat sensor 333, and a positioning sensor 334. The camera 331 has an imaging element such as a CCD sensor or a CMOS sensor, and captures an image of the upper body, including the face, of the occupant. A plurality of cameras 331 are provided corresponding to the riding positions (seat positions) so that the facial expressions and postures of all occupants can be captured. The seating sensor 332 is a pressure sensor disposed in each seat in the vehicle, such as a sensor (pressure sensor) for a seat belt reminder. The detection value of the seating sensor 332 can determine whether or not an occupant is present in each seat. Therefore, the detection value of the seating sensor 332 can detect the number of occupants in the vehicle, as well as the physique, gender, age (adult or child, etc.) of the occupant. The heartbeat sensor 333 is disposed in each seat and detects the heartbeat of the occupant in each seat. The positioning sensor 334 is, for example, a GPS sensor, which receives positioning signals transmitted from GPS satellites and detects the absolute position (latitude, longitude, etc.) of the vehicle 2. The positioning sensor 334 includes not only GPS sensors but also sensors that perform positioning using radio waves transmitted from quasi-zenith orbit satellites. Information such as captured images and detected values ​​acquired by the sensor group 33 is input to the in-vehicle device 3. The sensor group 33 also includes sensors necessary for autonomous driving, such as the above-mentioned radar and lidar.

[0016] The communication unit 34 communicates with the communication network 4. The communication unit 34 can also perform short-range wireless communication with a mobile communication terminal such as a smartphone present in the vehicle. The microphone 35 acquires the voices of the occupants. The voice signal from the microphone 35 is input to the in-vehicle device 3 as voice data via, for example, an A / D converter. The microphone 35 has narrow directivity, and the sensitivity for acquiring voice varies depending on the direction. Multiple microphones 35 are installed in the vehicle corresponding to the passenger positions, making it possible to determine whether each passenger is speaking.

[0017] The speaker 36 outputs audio including map information, topics, music, etc. stored in the memory unit 31 in response to a command from the in-vehicle device 3. When a request for audio output is received from the occupant via the input unit 32 or the microphone 35, the speaker 36 provides audio in response to the request. The speaker 36 can also automatically provide audio in response to a command from the in-vehicle device 3, even if no audio output request is received from the occupant.

[0018] The display 37 displays information related to destination setting, route guidance information to the destination, current position information on the route, etc. The display content of the display 37 is controlled by the in-vehicle device 3.

[0019] The drive unit 39 is a general term for actuators that drive devices that affect the comfort of the occupants. The drive unit 39 includes, for example, a motor and a compressor of an air conditioning device (not shown) mounted on the vehicle 2, and a motor for opening and closing windows and a sunroof. The drive unit 39 also includes the above-mentioned travel motor, steering motor, etc.

[0020] The in-vehicle device 3 includes a computer having a calculation unit 30 such as a CPU, a storage unit 31 such as a ROM and a RAM, and other peripheral circuits (not shown) such as an I / O interface. The calculation unit 30 has, as its functional components, an information transmission unit 301 and an environment setting unit 302.

[0021] The information transmission unit 301 transmits information from the sensor group 33 (hereinafter referred to as sensor information) and audio data from the microphone 35 to the information processing device 1 via the communication unit 34. The environment setting unit 302 outputs a setting change command to the target device in accordance with the environment setting information received from the information processing device 1 via the communication unit 34. The setting change command includes various commands and data for changing the settings of the target device. The environment setting information is information related to the setting of the in-vehicle environment of the vehicle 2, and the in-vehicle environment includes either the color and brightness (intensity) of light emitted from the lighting device 38 provided in the vehicle 2, or the sound emitted from the speaker provided in the vehicle. Note that the in-vehicle environment may also include the set temperature of the air conditioning device, etc.

[0022] If the environment setting information includes information about the setting values ​​of the color and intensity of light of the lighting device 38, the environment setting unit 302 outputs a command corresponding to the setting values ​​to the lighting device 38. If the environment setting information includes the name of a piece of music, the environment setting unit 302 acquires music data corresponding to the name of the piece of music from the information processing device 1 (a music database 113 described later) via the communication unit 34 and outputs this to the speaker 36 via a D / A converter. If the environment setting information includes information about audio, the environment setting unit 302 generates audio data corresponding to the audio and outputs this to the speaker 36 via a D / A converter. If the environment setting information includes information about the set temperature of the air conditioner, the environment setting unit 302 outputs a control signal corresponding to the set temperature to the drive unit 39.

[0023] 3 is a block diagram showing the configuration of the main parts of an information processing device 1 according to this embodiment. The information processing device 1 is configured by, for example, a server device. The information processing device 1 is configured to include a computer having a calculation unit 10 such as a CPU, a storage unit 11 such as a ROM and a RAM, and other peripheral circuits (not shown) such as an I / O interface. The information processing device 1 has a communication unit 12 that communicates with a communication network 4. The calculation unit 10 has, as functional components, an occupant information acquisition unit 101, an emotion estimation unit 102, an environment determination unit 103, and a learning unit 104.

[0024] The storage unit 11 has a map database 111 storing map information, a topic database 112 storing information on various topics, and a music database 113 storing music. The map database 111 stores map information including road map data and facility data. The topic database 112 stores information on various topics that are expected to come up in conversations between passengers, such as traffic information, weather, current events, food, hobbies, travel, work, and family. The music database 113 stores music data of various genres, such as Western music, Japanese music, jazz, and classical music. The information processing device 1 reads information stored in the storage unit 11 as needed. Specifically, the information processing device 1 reads information from each of the databases 111 to 113 from the storage unit 11 in response to a command from the in-vehicle device 3 and transmits the read information to the in-vehicle device 3. The information processing device 1 can also periodically retrieve topic data, music data, and the like received from an external server or the like via the communication unit 12 to update the information stored in the storage unit 11.

[0025] The occupant information acquisition unit 101 acquires information about occupants (hereinafter referred to as occupant information) based on the sensor information and voice data received from the in-vehicle device 3 via the communication unit 12. More specifically, the occupant information acquisition unit 101 identifies the facial expressions (corners of the mouth, etc.) of each occupant of the vehicle 2 based on the captured image included in the sensor information. The occupant information acquisition unit 101 also identifies the heart rate of each occupant based on the detection value of the heart rate sensor 333 included in the sensor information. The occupant information acquisition unit 101 also identifies the seating position of each occupant and the body movement of each occupant based on the detection value of the seating sensor 332 included in the sensor information. The occupant information acquisition unit 101 also identifies the tone of voice and the content of speech of each occupant based on the voice data. The occupant information acquisition unit 101 recognizes the voice signal included in the voice data by referring to words registered in a dictionary database (not shown) in the storage unit 11, thereby identifying the content of the speech. The occupant information acquisition unit 101 also identifies the tone of voice based on the sound frequency spectrum of the recognized voice signal.

[0026] The occupant information acquisition unit 101 acquires the information identified based on the sensor information and the voice data as occupant information. The occupant information acquisition unit 101 may determine whether each occupant is speaking by determining whether a voice signal is input from the microphone 35 corresponding to the identified seating position. The occupant information acquisition unit 101 may also identify the body movement of the occupant based on a captured image included in the sensor information. The in-vehicle device 3 may generate occupant information based on information from the sensor group 33 and a voice signal from the microphone 35, and transmit the occupant information to the information processing device 1, and the occupant information acquisition unit 101 may acquire the occupant information transmitted from the in-vehicle device 3 via the communication unit 12.

[0027] The emotion estimation unit 102 estimates the emotion of the occupant based on the occupant information acquired by the occupant information acquisition unit 101. For example, the emotion estimation unit 102 classifies the emotion of the occupant into eight basic emotions (anticipation, joy, trust, fear, surprise, sadness, disgust, and anger) using Plutchik's sum of emotions. The emotion estimation unit 102 may assign the emotion of the occupant to one of the patterns on a wheel of emotions, taking into consideration not only the facial expression of the occupant but also the content of the occupant's utterance, the accent and pronunciation of the voice spoken by the occupant, and the like. Then, the emotion estimation unit 102 quantifies the emotion of the occupant according to the assignment to the wheel of emotions, and derives an emotion value representing the degree of the occupant's emotion.

[0028] The emotion estimation unit 102 expresses emotion values ​​corresponding to favorable emotions (positive emotions), such as happiness, as positive values, and emotion values ​​corresponding to unfavorable emotions (negative emotions), such as sadness, as negative values. Specifically, emotion values ​​corresponding to positive emotions are expressed as integers between 0 and +10, and emotion values ​​corresponding to negative emotions are expressed as integers between -10 and 0. In this way, the stronger the emotion (the closer to the center of the emotion circle), the larger the value of the emotion level (absolute value). It is also possible to determine whether each occupant is moving based on information about the body movement of each occupant included in the occupant information, and determine that the occupant is sleeping if there is no movement. In this case, the emotion estimation unit 102 may set emotion values ​​corresponding to the emotions of a sleeping occupant to 0. Furthermore, the emotion estimation unit 102 may refer to the topic database 112 to identify topics from the content of conversations between occupants. When it is assumed that the entire vehicle interior is excited about a common topic, it may consider that topic and assign the emotion of each occupant to one of the patterns on the emotion circle. Furthermore, the scale of the emotion value for each emotion may be other than 10 (for example, 100) and may be different for each emotion.

[0029] It is also possible to estimate the emotions of passengers using an API provided by an external server, such as Microsoft's FACE API (Application Programming Interface). In other words, the emotion estimation unit can be provided on the external server. The FACE API is a type of Web API provided by Microsoft's server. The FACE API estimates a person's emotions based on an input facial image of the person, and outputs a score (percentage) for each of eight emotions (happiness, surprise, neutral, sadness, fear, anger, contempt, and disgust) as the estimation result.

[0030] Here, a vehicle interior environment setting device in which the emotion deduction unit is provided in an external server will be described. FIG. 4 is a block diagram illustrating another example of the configuration of the vehicle interior environment setting device according to this embodiment. The information processing device 1 in FIG. 4 has the same configuration as the information processing device 1 in FIG. 3, but includes an emotion acquisition unit 105 instead of the emotion deduction unit 102. Note that databases 111 to 113 are omitted from FIG. 4. A server 5 is connected to the communication unit 12 via a communication network 4. The server 5 includes a computer having a calculation unit 50 such as a CPU, a storage unit 51 such as a ROM and a RAM, and other peripheral circuits (not shown) such as an I / O interface. The server 5 also includes a communication unit 52 that communicates with the communication network 4. The calculation unit 50 includes an emotion deduction unit 501 as a functional component. The server 5 is a server provided by Microsoft Corporation, which provides the FACE API, and the emotion deduction unit 501 is configured using the FACE API.

[0031] The occupant information acquisition unit 101 acquires a captured image of the occupant included in the sensor information as occupant information, and the emotion acquisition unit 105 transmits the captured image of the occupant acquired by the occupant information acquisition unit 101 to the server 5 (emotion estimation unit 102) via the communication unit 12. At this time, the captured image of the occupant is transmitted to the server 5 via the communication network 4 by the transmission function of the FACE API. The emotion estimation unit 501 estimates the emotion of the occupant based on the captured image of the occupant received via the communication unit 52, and transmits the estimation result, i.e., the scores of eight emotions, to the information processing device 1 via the communication unit 52. At this time, the estimation result is transmitted from the server 5 via the communication network 4 to the information processing device 1 by the transmission function of the FACE API. The emotion acquisition unit 105 converts the emotion estimation result (score) received from the server 5 via the communication unit 12 into an emotion value and acquires it. For example, when the score of a positive emotion such as joy is 40% (0.40), the integer value (+4) obtained by multiplying this value by the maximum emotion value (+10) is acquired as the emotion value. For example, when the percentage of a negative emotion such as sadness is 30% (0.30), the integer value (-3) obtained by multiplying this value by the minimum emotion value (-10) is acquired as the emotion value. In this manner, the in-vehicle environment setting device according to this embodiment may be configured to include an information processing device 1, an in-vehicle device 3, and a server 5. Note that, when transmitting a captured image of the occupant to the server 5, the emotion acquisition unit 105 may reduce the image quality of the captured image of the occupant to a minimum image quality level required for image analysis in the FACE API. Furthermore, when transmitting a captured image of the occupant to the server 5, the emotion acquisition unit 105 may also crop an image of the occupant's face from the captured image and transmit the cropped image.

[0032] The environment determination unit 103 determines a target in-vehicle environment based on the emotion value of the occupant's emotion estimated by the emotion estimation unit 102 or the emotion value of the occupant's emotion acquired by the emotion acquisition unit 105, and the correspondence between the occupant's emotion and the in-vehicle environment learned by the learning unit 104. The correspondence between the occupant's emotion and the in-vehicle environment learned by the learning unit 104 will be described later.

[0033] When the emotion value α of the reference parameter estimated by the emotion estimation unit 102 or acquired by the emotion acquisition unit 105 is less than the threshold Th, the environment determination unit 103 determines a target in-vehicle environment such that the emotion value α becomes equal to or greater than the threshold Th, using an arbitrary emotion such as joy or surprise as a reference parameter. The environment determination unit 103 transmits information indicating the determined target in-vehicle environment, i.e., environment setting information, to the vehicle 2 (on-vehicle device 3) via the communication unit 12. The threshold Th is set in advance for each type of emotion and stored in the storage unit 11.

[0034] The learning unit 104 learns the correspondence between the emotions of the occupants and the in-vehicle environment, and stores information including the learning results (hereinafter referred to as correspondence information) in the storage unit 11. The learning unit 104 performs the above learning for each emotion, and stores the learning results for each emotion in the storage unit 11. The learning unit 104 also performs the above learning for each occupant, and stores the learning results for each occupant in the storage unit 11.

[0035] 5 is a flowchart showing an example of processing executed by the CPU of the information processing device 1 of FIG. 3 in accordance with a program previously stored in the ROM of the information processing device 1. The processing shown in this flowchart is repeatedly executed at predetermined intervals (for example, every 10 minutes). For simplicity of explanation, it is assumed here that the in-vehicle environment is determined based only on the emotions of the occupants.

[0036] First, in step S1, occupant information is acquired based on the sensor information and voice data received from the in-vehicle device 3. Next, in step S2, the emotions of the occupants of the vehicle 2 are estimated based on the occupant information, and an emotion value α of the emotion designated as a reference parameter is acquired based on the estimation result. Next, in step S3, it is determined whether the emotion value α acquired in step S2 is less than a preset threshold Th. If the result in step S3 is negative, the processing ends. If the result in step S3 is positive, in step S4, a target in-vehicle environment is determined based on the emotion value α acquired in step S2 and the correspondence information stored in the memory unit 11. In step S5, the in-vehicle environment is set to achieve the determined target in-vehicle environment. More specifically, environmental setting information corresponding to the target in-vehicle environment determined in step S4 is transmitted to the vehicle 2 (in-vehicle device 3).

[0037] In step S6, the process waits for a predetermined time Δt. The predetermined time Δt is set to the time (for example, several seconds to several tens of seconds) required for the emotion of the occupant of vehicle 2 to change after the environmental setting information is transmitted to vehicle 2. In steps S7 and S8, the same processing as in steps S1 and S2 is performed to estimate the emotion of the occupant and obtain an emotion value α. In step S9, it is determined whether the emotion value α obtained in step S8 is equal to or greater than threshold value Th. If the result in step S9 is negative, in step S10, the target in-vehicle environment is determined again, and the process returns to step S5. If the result in step S9 is positive, in step S11, the current in-vehicle environment setting value, i.e., the setting value indicated by the environmental setting information transmitted to vehicle 2 in S5, is stored in the correspondence information in association with the emotion value α obtained in step S2. At this time, if the correspondence information stored in memory unit 11 already contains a setting value for the in-vehicle environment corresponding to the emotion value α obtained in step S2, that setting value is overwritten with the setting value for the current in-vehicle environment.

[0038] In step S4, if the in-vehicle environment setting value corresponding to the emotion value α acquired in step S2 is not stored in the correspondence information, the target in-vehicle environment is determined based on a preset initial value. The initial in-vehicle environment setting value is determined, for example, by having learning unit 104 learn in advance data (teaching data) acquired by estimating the emotion of a predetermined user while changing the in-vehicle environment setting value. The initial in-vehicle environment setting value may also be determined by other methods.

[0039] The processing in the information processing device 1 according to this embodiment can be summarized as follows. Fig. 6 is a diagram for explaining the processing in the information processing device 1 according to this embodiment. Here, for simplicity of explanation, the in-vehicle environment is assumed to be determined only by the brightness (intensity) of the lighting device 38. Also, the in-vehicle environment is assumed to be determined based only on the emotions of the occupants.

[0040] At time t1 in FIG. 6, when the emotional value α of the occupant is less than the threshold Th as shown at point P1, the environment determination unit 103 determines the target in-vehicle environment and transmits environment setting information indicating the target in-vehicle environment (the first in-vehicle environment) to the vehicle 2 (steps S1 to S5). At time t2 after a predetermined time Δt has elapsed since the environment setting information was transmitted, the environment determination unit 103 determines whether the emotional value α of the occupant is greater than or equal to the threshold Th (steps S6 to S9). When the emotional value α of the occupant is less than the threshold Th as shown at point P2, the environment determination unit 103 re-determines the target in-vehicle environment according to the degree of change Δα1 of the emotional value α (step S10). For example, as shown in FIG. 6, when the degree of improvement of the occupant's emotion is low, the set value of the brightness of the lighting device 38 is set to a value larger than the current value according to Δα1. The environment determination unit 103 transmits environment setting information indicating the re-determined target in-vehicle environment (the second in-vehicle environment) to the vehicle 2 (step S5). At time t3 after a predetermined time Δt has elapsed since the environment setting information was transmitted, the environment determination unit 103 determines whether the emotional value α of the occupant is greater than or equal to the threshold Th (steps S6 to S9). When the emotional value α of the occupant is greater than or equal to the threshold Th as shown at point P3, the learning unit 104 stores, as learning results (corresponding relationship information), information associating the emotional value α acquired at time t1 with the set value of the current in-vehicle environment (the second in-vehicle environment) in the storage unit 11 (step S11). By repeating such learning, the set value of the in-vehicle environment to be set for the emotional value α (<Th) of the occupant can be accurately derived.

[0041] On the other hand, if the occupant's emotion value α deteriorates (from point P2 to point P4) after the second in-vehicle environment is set at time t2, the information processing device 1 determines that the second in-vehicle environment is not suitable for the occupant (the brightness of the lighting device 38 is too bright), and re-determines the target in-vehicle environment (step S10). For example, the brightness setting value of the lighting device 38 is set to a value smaller than the current value according to Δα2. The environment determination unit 103 transmits to the vehicle 2 environment setting information indicating the target in-vehicle environment (third in-vehicle environment) re-determined according to Δα2 (step S5). Thereafter, the information processing device 1 repeats the same process until the occupant's emotion value α becomes equal to or greater than the threshold value Th (steps S5 to S10). Then, when the occupant's emotion value α becomes equal to or greater than the threshold value Th, the information processing device 1 associates the setting value of the in-vehicle environment at that time (the n-th in-vehicle environment) with the emotion value α acquired at time t1 and stores it in the correspondence information (step S11).

[0042] According to the embodiment of the present invention, the following advantageous effects can be achieved. (1) The in-vehicle environment setting device according to this embodiment includes an occupant information acquisition unit 101 that acquires occupant information about occupants of the vehicle 2, a feeling estimation unit 102 that estimates the feelings of the occupants based on the occupant information acquired by the occupant information acquisition unit 101, an environment setting unit 302 that sets an in-vehicle environment, a learning unit 104 that learns a correspondence between the in-vehicle environment set by the environment setting unit 302 and the feelings of the occupants, and an environment determination unit 103 that determines a target in-vehicle environment based on the feelings of the occupants estimated by the feeling estimation unit 102 and the correspondence learned by the learning unit 104. The environment setting unit 302 sets an in-vehicle environment by outputting a setting change command to a device mounted on the vehicle 2 so that the in-vehicle environment becomes the target in-vehicle environment determined by the environment determination unit 103. In this way, the in-vehicle environment is learned by associating the feelings of the occupants with the in-vehicle environment, and the in-vehicle environment is set based on the learning result and the feelings of the occupants estimated from the occupant information, thereby enabling the in-vehicle environment to be well adapted to the feelings of the occupants.

[0043] (2) The emotion estimation unit 102 quantifies the estimated emotion of the occupant, and the environment determination unit 103 determines the target in-vehicle environment when the emotion of the occupant quantified by the emotion estimation unit 102 is below a threshold. This allows the in-vehicle environment to be set only when the emotion value is below the threshold, thereby reducing the processing load on the in-vehicle environment setting device.

[0044] (3) The emotion estimation unit 102 estimates emotions corresponding to each of a plurality of parameters representing the emotions of the occupant based on the occupant information acquired by the occupant information acquisition unit 101, and the environment determination unit 103 determines a target in-vehicle environment using an arbitrary parameter from the plurality of parameters as a reference parameter so that the emotion corresponding to the reference parameter is equal to or greater than a threshold. This makes it possible to set an in-vehicle environment according to the occupant's preferences, such as a desire to relax or concentrate.

[0045] (4) The occupant information acquisition unit 101 acquires the occupant information at predetermined time intervals. By acquiring the occupant information at predetermined time intervals in this manner, it is possible to prevent the in-vehicle environment from becoming complicated due to changes in the in-vehicle environment and to reduce the processing load of the in-vehicle environment setting device.

[0046] (5) The occupant information includes information indicating the occupant's facial expression, body movement, tone of voice, or words uttered by the occupant, which allows the occupant's emotions to be estimated with high accuracy.

[0047] (6) The interior of the vehicle 2 is equipped with a lighting device 38 and a speaker 36, and the setting change command includes any one of the color and intensity of the light emitted from the lighting device 38 and the sound emitted from the speaker 36. This increases the variety of settings for the interior environment, allowing the interior environment to be better adapted to the emotions of the occupants.

[0048] (7) The occupant information is an image including the face of the occupant. The in-vehicle environment setting device according to this embodiment further includes an external server 5 including a feeling estimation unit 501 and a communication unit 12 that communicates with the server 5 (FIG. 4). The occupant information acquisition unit 101 acquires, as occupant information, an image captured by a camera 331 mounted on the vehicle 2 and capturing an image of the face of the occupant. The communication unit 12 transmits the occupant information acquired by the occupant information acquisition unit 101 to the server 5. The feeling estimation unit 501 estimates the feeling of the occupant based on the occupant information transmitted from the communication unit 12. The environment determination unit 103 receives the estimation result of the feeling estimation unit 501 from the server 5 via the communication unit 12 and determines a target in-vehicle environment based on the received estimation result and the correspondence learned by the learning unit 104. In this way, by using an image including the face of the occupant as occupant information, the occupant's feeling can be estimated based on the occupant's facial expression, which is likely to reflect the occupant's feeling, thereby enabling the occupant's feeling to be estimated with high accuracy. Moreover, by providing the emotion estimation unit in the external server 5, it is possible to reduce the processing load on the information processing device 1 and reduce the manufacturing cost of the information processing device 1. Furthermore, the communication unit 12 only needs to transmit the image captured by the camera 331 as it is (without processing, etc.) to the server 5, which further reduces the processing load on the information processing device 1.

[0049] (8) The in-vehicle environment setting device of this embodiment can also be used as an in-vehicle environment setting method. The in-vehicle environment setting method includes a step of acquiring occupant information about occupants of the vehicle 2 (step S1), a step of estimating the emotions of the occupants based on the acquired occupant information (step S2), a step of learning a correspondence between the in-vehicle environment and the emotions of the occupants (step S11), a step of determining a target in-vehicle environment based on the estimated emotions of the occupants and the learned correspondence (step S4), and a step of outputting a setting change command to the devices 36, 38 mounted on the vehicle 2 so that the in-vehicle environment becomes the determined target in-vehicle environment (step S5). This allows the in-vehicle environment to be well adapted to the emotions of the occupants.

[0050] The above embodiment can be modified in various ways. Modifications will be described below. <First Modification> FIG. 7 is a block diagram showing the configuration of a main part of an in-vehicle device 3 according to a first modified example. In FIG. 7, for simplicity of the drawing, the devices 32 to 39 connected to the in-vehicle device 3 are omitted. In the above embodiment, the calculation unit 10 of the information processing device 1 includes the occupant information acquisition unit 101, the emotion estimation unit 102, the environment determination unit 103, and the learning unit 104. However, as shown in FIG. 7, these functional components may be included in the in-vehicle device 3. That is, the vehicle 2 may be configured to include an in-vehicle environment setting device. The in-vehicle device 3 in FIG. 7 is configured based on, for example, a navigation device or the like installed in the vehicle 2.

[0051] The in-vehicle device 3 of FIG. 7 includes an occupant information acquisition unit 303, a feeling estimation unit 304, an environment determination unit 305, and a learning unit 306 instead of the information transmission unit 301 of FIG. 2. The occupant information acquisition unit 303, the feeling estimation unit 304, the environment determination unit 305, and the learning unit 306 are configured similarly to the occupant information acquisition unit 101, the feeling estimation unit 102, the environment determination unit 103, and the learning unit 104, respectively. The occupant information acquisition unit 303 acquires occupant information by identifying facial expressions and speech content of each occupant of the vehicle 2 based on information such as captured images and detection values ​​acquired by the sensor group 33 and audio signals from the microphone 35. The environment determination unit 305 stores environment setting information in the storage unit 31, and the environment setting unit 302 outputs various data and commands to target devices in accordance with the environment setting information stored in the storage unit 31. In this way, by estimating the emotions of the occupants using the in-vehicle device 3 directly connected to the sensor group 33, it becomes possible to instantly estimate the emotions of the occupants, and the in-vehicle environment can be better adapted to the emotions of the occupants.

[0052] <Second Modification> In the above embodiment, an arbitrary emotion is used as the reference parameter. However, the user may specify the reference parameter. For example, a command specifying the reference parameter may be received via the communication unit 12 from a mobile communication terminal, such as a smartphone, carried by a user, such as an occupant of the vehicle 2, and the target in-vehicle environment may be determined so that the emotion value of the reference parameter specified by the command is equal to or greater than a threshold value. More specifically, the user activates a program for specifying the reference parameter installed on the mobile communication terminal via an operation unit (e.g., a touch panel) of the mobile communication terminal and specifies a desired emotion as the reference parameter to the program. The mobile communication terminal transmits information indicating the emotion specified by the user as the reference parameter (hereinafter referred to as reference parameter information) to the information processing device 1. The calculation unit 10 of the information processing device 1 stores the reference parameter information received via the communication unit 12 in the storage unit 11. The environment determination unit 103 determines the target in-vehicle environment based on the emotion value of the emotion indicated by the reference parameter information stored in the storage unit 11. This configuration allows the occupant to specify the reference parameter, thereby enabling the in-vehicle environment to be set more suited to the occupant's preferences.

[0053] <Third Modification> In the above embodiment, the emotion acquisition unit 105 transmits the occupant information acquired by the occupant information acquisition unit 101 to the server 5 via the communication unit 12 and receives the estimation result of the occupant's emotion from the server 5 via the communication unit 12. However, if a communication error with the server 5 occurs, the communication unit 12 may be unable to transmit the occupant information to the server 5 or receive the estimation result of the occupant's emotion from the server 5. Therefore, the environment setting unit 302 may determine whether the communication unit 12 has received the estimation result of the occupant's emotion, and determine the target in-vehicle environment when it determines that the communication unit 12 has received the estimation result of the occupant's emotion. This prevents the in-vehicle environment from suddenly changing or the occupant's emotion from unnecessarily worsening. In the above embodiment, the emotion estimation unit 501 is configured using the FACE API. However, the emotion estimation unit 501 may be configured using an API for emotion recognition other than the FACE API.

[0054] Furthermore, in the above embodiment, an example ( FIG. 4 ) has been described in which the information processing device 1 has the emotion acquisition unit 105 instead of the emotion estimation unit 102. However, the information processing device 1 may have the emotion acquisition unit 105 together with the emotion estimation unit 102. For example, the emotion estimation unit 102 may estimate the emotion of the occupant based on the content of the occupant's utterance, the accent or pronunciation of the voice spoken by the occupant, and the estimation result of the emotion of the occupant acquired by the emotion acquisition unit 105.

[0055] <Fourth Modification> In the above embodiment, the emotion estimation unit 102 classifies the emotions of the occupant into eight basic emotions (expectation, joy, acceptance, anxiety, surprise, sadness, disgust, and anger). However, the emotion estimation unit 102 may classify the emotions of the occupant into eight basic emotions and eight applied emotions (optimism, love, submission, awe, disappointment, self-blame, contempt, and aggression) that are combinations of two adjacent basic emotions.

[0056] <Fifth Modification> Furthermore, although one emotion is designated as the reference parameter in the above embodiment, multiple emotions may be designated as the reference parameter. The in-vehicle environment may be set based on the emotion values ​​of the multiple emotions designated as the reference parameters. For example, if anger and contempt are designated as the reference parameters, and the degree of anger or contempt (absolute value of the emotion value) of the occupant (driver) exceeds a threshold value in the manual driving mode, the environment determination unit 103 may transmit environment setting information including a command to switch to the autonomous driving mode to the vehicle 2. Upon receiving the environment setting information including the command to switch to the autonomous driving mode, the environment setting unit 302 notifies the occupant of information urging the occupant to switch to the autonomous driving mode. For example, the environment setting unit 302 outputs audio data urging the occupant to switch to the autonomous driving mode to the speaker 36 via a D / A converter. Furthermore, for example, the environment setting unit 302 outputs text information or the like urging the occupant to switch to the autonomous driving mode to the display 37. In this way, the environment determination unit 103 and the environment setting unit 302 may function as a notification unit that notifies the occupant of information urging the occupant to switch to the automatic driving mode when the occupant's anger or contempt exceeds a threshold. With this configuration, aggressive driving or dangerous driving by the occupant (driver) can be suppressed.

[0057] Instead of outputting voice data or the like urging the driver to switch to the automatic driving mode, the environment setting unit 302 may switch the driving mode from the manual driving mode to the automatic driving mode. Also, after switching to the automatic driving mode, the driving mode may be switched from the automatic driving mode to the manual driving mode when the degree of anger and contempt of the occupant (driver) falls below a threshold.

[0058] <Sixth Modification> Furthermore, if the vehicle 2 is provided with a dedicated seat unit (hereinafter simply referred to as a dedicated seat) designed to help occupants relax, the dedicated seat may be adjusted based on the emotions of the occupant sitting in the dedicated seat. More specifically, using the occupant's happiness and surprise as reference parameters, the tilt of the seat back and the position of the headrest of the dedicated seat may be adjusted so that the happiness score is 30% (0.30) or more and the surprise score is 30% (0.30) or less, that is, so that the happiness emotional value is +3 or more and the surprise emotional value is -3 or more.

[0059] FIG. 8 is a diagram showing the appearance of a dedicated seat. As shown in FIG. 8, the dedicated seat 7 is a seat unit on which an occupant can sit, and is mainly applied to the rear seat of a vehicle 2. The dedicated seat 7 has a seat back 70, a seat cushion 71, an ottoman 72, a headrest 73, and a support member 74. The seat back 70, the seat cushion 71, the ottoman 72, and the headrest 73 each have a predetermined length, width, and thickness. Hereinafter, the length direction, width direction, and thickness direction of the seat back 70 etc. will be referred to as the up-down direction, left-right direction, and height direction of the seat back 70 etc., respectively.

[0060] FIG. 9 is a diagram illustrating a configuration of the dedicated seat 7. Note that FIG. 9 is a diagram illustrating the rear seat of the vehicle 2 to which the dedicated seat 7 is applied, viewed from the left side of the vehicle 2, and the left-right direction in FIG. 9 represents the front-rear direction of the vehicle 2. As shown in FIG. 9, the dedicated seat 7 further includes various actuators 80-83 and an occupant detection sensor 84. The seat back 70 can be tilted backward relative to the seat cushion 71 by a seat back moving mechanism 80. The seat cushion 71 can be rotated by a seat cushion moving mechanism 81 so that its front end moves up and down. In other words, the tilt angle of the seat cushion 71 can be changed. The ottoman 72 is supported on the front end of the seat cushion 71 via a rotation shaft extending in the left-right direction, and can be rotated around the rotation shaft by an ottoman moving mechanism 82. The ottoman moving mechanism 82 moves (rotates) the ottoman 72 from a stored state in which the ottoman 72 hangs down to an expanded state in which the ottoman 72 protrudes forward beyond the front end of the seat cushion 71, or from the expanded state to the stored state. The headrest 73 has a support (pillar) that extends downward, and the pillar is inserted into the upper end of the seatback 70. The headrest 73 can be moved in the longitudinal direction of the seatback 70 by the headrest moving mechanism 83. The occupant detection sensor 84 is provided inside the seat cushion 71 and is a sensor that detects whether an occupant is seated on the seat cushion 71, and is configured as the seating sensor 332 in FIG. 2.

[0061] The processing in the information processing device 1 according to the sixth modified example can be summarized as follows. For simplicity of explanation, the in-vehicle environment to be set is assumed to be only the state of the dedicated seat 7. The environment determination unit 103 determines a target in-vehicle environment and transmits environment setting information indicating the target in-vehicle environment to the vehicle 2 (S1 to S5). After a predetermined time has elapsed since the environment setting information was transmitted, the environment determination unit 103 determines whether the emotion value of joy of the occupant P is +3 or greater and the emotion value of surprise of the occupant P is −3 or greater (S6 to S9). If the emotion value of joy is +3 or greater and the emotion value of surprise of the occupant P is not −3 or greater, the environment determination unit 103 changes the setting values ​​of the various actuators 80 to 83 so that the occupant P can further relax (S10). For example, the setting value of the seatback moving mechanism 80 is changed so that the seatback 70 is tilted further backward. At this time, the environment determination unit 103 may adjust the tilt angle of the seat cushion 71 or the degree of deployment of the ottoman 72 so that the angle of the thighs of the occupant P (the angle with respect to the longitudinal direction of the vehicle 2) becomes a predetermined angle (for example, 30 degrees). That is, the environment determination unit 103 may change the setting values ​​of the seat cushion moving mechanism 81 and the ottoman moving mechanism 82. Furthermore, the environment determination unit 103 may adjust the position of the headrest 73 in accordance with the tilt angle of the seatback 70. That is, the environment determination unit 103 may change the setting value of the headrest moving mechanism 83. Note that the setting of the in-vehicle environment (S5) may be executed only when the occupant detection sensor 84 detects that an occupant is seated in the dedicated seat.

[0062] In this modification, priorities may be set for the emotional value (score) of joy and the emotional value (score) of surprise. For example, the emotional value of surprise may be set as the first priority emotional value and the emotional value of joy as the second priority emotional value, with the emotional value of surprise being set to have a higher priority than the emotional value of joy. If both the emotional values ​​of surprise and joy are undesirable, i.e., if both the emotional values ​​of surprise and joy are below their thresholds, the setting values ​​of the in-vehicle environment may be changed so that the emotional value of surprise is improved first (S9, S10). For example, the setting values ​​of the in-vehicle environment may be changed so that the seat back 70 is tilted further backward and soothing music is output from the speaker 36.

[0063] <Seventh Modification> In the above embodiment, after transmitting the environmental setting information to the vehicle 2 in step S5, the vehicle waits for a predetermined time Δt in step S6. However, when transmitting environmental setting information including the name of a piece of music to the vehicle 2 in step S5, the vehicle may wait in step S6 to match the playback time of the music (one piece of music), that is, until the playback of the music is completed. This prevents the in-vehicle environment from being reset before the emotions of the occupants change, and allows the in-vehicle environment to better adapt to the emotions of the occupants.

[0064] Furthermore, in the above embodiment, an example was shown in which the brightness (intensity) of the light emitted from the lighting device 38 was adapted to the emotion of the occupant ( FIG. 6 ). However, the color of the light emitted from the lighting device 38 can also be adapted to the emotion of the occupant in a similar manner. Specifically, when the emotion value α of the occupant's joy is less than the threshold value Th (point P2), the environment determination unit 103 transmits to the vehicle 2 environment setting information specifying a color with an uplifting effect, such as orange. When the emotion value α of the occupant deteriorates (points P2 to P4), the environment determination unit 103 transmits to the vehicle 2 environment setting information specifying a color with a calming effect, such as green. Then, when the emotion value α becomes equal to or greater than the threshold value Th, the color of the light set in the lighting device 38 at that time is stored in the correspondence information in association with the emotion value α acquired at time t1.

[0065] Similarly, other in-vehicle environment settings can be adapted to the emotions of the occupants. More specifically, when the emotion value α of the occupant's joy is less than the threshold value Th (point P2), the environment determination unit 103 transmits to the vehicle 2 environment setting information including, for example, the name of music with a cheerful melody or an intense melody so that music with an uplifting effect is output from the speakers 36. When the emotion value α of the occupant deteriorates (point P2 → P4), the environment determination unit 103 transmits to the vehicle 2 environment setting information including, for example, the name of music with a gentle melody or a beautiful melody so that music with a calming effect is output from the speakers 36. Then, when the emotion value α becomes equal to or greater than the threshold value Th, the name of the music being output from the speakers 36 at that time is stored in the correspondence information in association with the emotion value α acquired at time t1.

[0066] Furthermore, in the above embodiment, the learning unit 104 stores the learning results for each occupant in the memory unit 11. However, the learning results may be stored in the memory unit 11 for each occupant characteristic (such as gender or age (adult or child)) determined by the detection value of the seating sensor 332. Furthermore, when there are multiple occupants in the vehicle 2, the emotion estimation unit 102 may estimate the emotion of all occupants (overall emotion) based on the emotion of each occupant. More specifically, the emotion estimation unit 102 may calculate an emotion value of the overall emotion by dividing the sum of the quantified emotion values ​​of each occupant by the number of occupants, and may make the determinations of steps S3 and S9 based on the emotion value. This makes it possible to set an in-vehicle environment that is suited to the overall atmosphere inside the vehicle.

[0067] Furthermore, in the above embodiment, when the emotion value α is less than the threshold value Th in step S3, the processes of steps S4 to S10 are executed. However, the judgment in step S3 may be made using a value different from the threshold value Th. Specifically, a lower limit value for the emotion value α of each emotion may be set, and when the emotion value α is less than the lower limit value in step S3, steps S4 to S10 may be executed. For example, the lower limit value for the emotion value α of joy may be set to +5 (50%), and the threshold value Th (target value) for the emotion value α of joy used in the judgment in step S9 may be set to +8 (80%). This reduces the frequency with which the in-vehicle environment is set, further preventing complicated changes to the in-vehicle environment. The lower limit value is set in advance for each type of emotion and stored in storage unit 11.

[0068] Furthermore, in the above embodiment, the vehicle 2 is an automatically driven vehicle, but the vehicle 2 may be a manually driven vehicle that does not have an automatically driven function.

[0069] The above description is merely an example, and the present invention is not limited to the above-described embodiment and modifications, as long as the features of the present invention are not impaired. One or more of the above-described embodiment and modifications can be arbitrarily combined, and modifications can also be combined with each other. [Explanation of symbols]

[0070] 1 Information processing device, 10 Calculation unit, 11 Memory unit, 12 Communication unit, 101 Occupant information acquisition unit, 102 Emotion estimation unit, 103 Environment determination unit, 104 Learning unit, 105 Emotion acquisition unit, 2 Vehicle, 3 In-vehicle device, 30 Calculation unit, 31 Memory unit, 33 Sensor group, 34 Communication unit, 36 Speaker, 38 Lighting device, 302 Environment setting unit, 501 Emotion estimation unit, 100 In-vehicle environment setting system

Claims

1. an occupant information acquisition unit that acquires occupant information related to an occupant of the vehicle; an emotion estimation unit that estimates an emotion of the occupant based on the occupant information acquired by the occupant information acquisition unit and calculates an emotion value by quantifying the estimated emotion of the occupant; an environment setting unit for setting an in-vehicle environment; a learning unit that learns a correspondence relationship between the in-vehicle environment set by the environment setting unit and the emotion of the occupant; an environment determination unit that determines a target in-vehicle environment based on the emotion of the occupant estimated by the emotion estimation unit and the correspondence relationship learned by the learning unit, the environment setting unit outputs a setting change command to a device mounted in the vehicle so that the in-vehicle environment becomes the target in-vehicle environment determined by the environment determination unit; the emotion estimation unit estimates emotions corresponding to each of a plurality of parameters representing emotions of the occupant based on the occupant information acquired by the occupant information acquisition unit; and the environment determination unit determines the target in-vehicle environment such that an arbitrary parameter designated in advance by the occupant among the plurality of parameters is used as a reference parameter, and when the emotion value of the emotion of the occupant corresponding to the reference parameter is less than a threshold, the emotion value becomes equal to or greater than the threshold; the equipment includes a lighting device provided in the interior of the vehicle; the setting change command includes a setting value of either a color of light emitted from the lighting device or an intensity of the light, the environment determination unit determines a first target in-vehicle environment such that a color of the light is an uplifting orange color when the emotion of the occupant corresponding to the reference parameter is joy and the emotion value is less than the threshold value at a second time point after the environment setting unit transmits the setting change command at a first time point; the environment determination unit further determines a second target in-vehicle environment such that the color of the light is a greenish color having a calming effect when the emotion value decreases after the first setting change command corresponding to the first target in-vehicle environment is output by the environment setting unit; The vehicle in-vehicle environment setting device is characterized in that when the emotion value becomes equal to or greater than the threshold value after the first setting change command or the second setting change command corresponding to the second target vehicle in-vehicle environment is output by the environment setting unit, the learning unit learns the correspondence based on the setting value of the light color included in the second setting change command and the emotion value at the first point in time.

2. 2. The vehicle interior environment control device according to claim 1, The occupant information includes information indicating any one of a facial expression, a body movement, a tone of voice, or a word uttered by the occupant, The vehicle interior environment setting device is characterized in that, when there are multiple occupants in the vehicle, the emotion estimation unit calculates the emotion value representing the overall emotion of the multiple occupants based on the emotion values ​​of each of the multiple occupants.

3. 3. The vehicle interior environment control device according to claim 1, The vehicle interior environment setting device, wherein the occupant information is an image including a face of the occupant.

4. 4. The vehicle interior environment control device according to claim 3, an external server provided with the emotion estimation unit; A communication unit that communicates with the server, the occupant information acquisition unit acquires, as the occupant information, an image captured by a camera mounted on the vehicle for capturing an image of a face of the occupant; The communication unit transmits the occupant information acquired by the occupant information acquisition unit to the server, The emotion estimation unit estimates an emotion of the occupant based on the occupant information transmitted from the communication unit, the environment determination unit determines the target in-vehicle environment based on an estimation result of the emotion estimation unit received from the server via the communication unit and a correspondence relationship learned by the learning unit.

5. 5. The vehicle interior environment control device according to claim 4, the environment determination unit determines whether the communication unit has received an inference result from the emotion deduction unit from the server, and determines the target in-vehicle environment when the communication unit has acquired the inference result from the emotion deduction unit.

6. The vehicle interior environment control device according to any one of claims 1 to 5, The environment determination unit receives an instruction specifying the reference parameter from a portable communication terminal carried by the occupant, and determines the target in-vehicle environment so that the emotion value related to the reference parameter specified by the instruction is greater than or equal to the threshold value.

7. The vehicle interior environment control device according to any one of claims 1 to 6, the device further includes a speaker disposed within the vehicle; The sound emitted from the speaker includes music. The vehicle environment setting device is characterized in that, when the environment setting unit sends the setting change command including the music to the device, it does not make any new settings for the vehicle environment between the time when the setting change command is sent and the time when the device finishes playing the music.

8. A vehicle comprising an interior environment control device according to any one of claims 1 to 7.

9. acquiring occupant information relating to an occupant of the vehicle; an estimation step of estimating an emotion of the occupant based on the acquired occupant information and calculating an emotion value by quantifying the estimated emotion of the occupant; a learning step of learning a correspondence relationship between an in-vehicle environment and the emotion of the occupant; a determining step of determining a target in-vehicle environment based on the estimated emotion of the occupant and the learned correspondence relationship; and an output step of outputting a setting change command to a device mounted in the vehicle so that the in-vehicle environment becomes the determined target in-vehicle environment, In the estimation step, emotions corresponding to each of a plurality of parameters representing an emotion of the occupant are estimated based on the occupant information, In the determining step, an arbitrary parameter designated in advance by the occupant among the plurality of parameters is used as a reference parameter, and when the emotion value of the emotion of the occupant corresponding to the reference parameter is less than a threshold, the target in-vehicle environment is determined such that the emotion value becomes equal to or greater than the threshold; the equipment includes a lighting device provided in the interior of the vehicle; the setting change command includes a setting value of either a color of light emitted from the lighting device or an intensity of the light, In the determination step, when the emotion of the occupant corresponding to the reference parameter is joy, if the emotion value is less than the threshold value at a second time point after the setting change command is transmitted at a first time point, a first target in-vehicle environment is determined so that the color of the light is an orange color having an uplifting effect, and if the emotion value decreases after the first setting change command corresponding to the first target in-vehicle environment is output, a second target in-vehicle environment is determined so that the color of the light is a green color having a calming effect, a setting value for the color of the light included in the second setting change command and the emotion value at the first point in time, the setting value being set to a value that corresponds to the color of the light and the emotion ...

Citation Information

Patent Citations

  • In-cabin lighting device

    JP2015221655A

  • Operation support system

    JP2018086135A

  • Device and method for controlling switching between driving modes and program

    JP2018151684A

  • Vehicle driving support system and vehicle driving support method

    JP2018169704A

  • Driver state determination device

    JP2019123434A