Content output device, content output method, program, and storage medium

Abstract

This content output device comprises a first information acquiring unit, a content acquiring unit, an output unit, a second information acquiring unit, and an estimating unit. The first information acquiring unit acquires driving situation information, which is information pertaining to a current driving situation of a vehicle. If the driving situation information satisfies a trigger condition, the content acquiring unit acquires content for output, which is content to be used for output to a passenger of the vehicle. The output unit outputs the content for output to the passenger. The second information acquiring unit acquires passenger information, which is information with which it is possible to identify an actual reaction of the passenger when the content for output is output. The estimating unit estimates the emotional state of the passenger when the content for output is output to the passenger, on the basis of the passenger information.

Description

[Technical field]

[0001] The present invention relates to a technique that can be used in push-type content output. [Background technology]

[0002] 2. Description of the Related Art There is known a push-type content output technique that outputs content corresponding to various information obtained through a sensor or the like to a user without a request from the user, based on the information.

[0003] Specifically, for example, Patent Document 1 discloses a technology for outputting a greeting voice when passengers get on and off a vehicle, based on information obtained through a vibration sensor that detects the opening and closing of the vehicle door. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2003-237453 A Summary of the Invention [Problem to be solved by the invention]

[0005] Here, with the above-mentioned push-type content output, there are cases where content that is not necessarily suited to the user's situation is output.

[0006] Therefore, for example, when push-type content output is applied while driving a vehicle, a problem may arise in that the content may be output without taking into account the emotional state of the vehicle occupants.

[0007] However, Patent Document 1 does not particularly disclose a method capable of solving the above problems. Therefore, according to the configuration disclosed in Patent Document 1, problems corresponding to the above problems still exist.

[0008] The present invention has been made to solve the above-mentioned problems, and has as its main object to provide a content output device that is capable of outputting content according to the emotional state of a vehicle occupant when outputting push-type content. [Means for solving the problem]

[0009] The claimed invention is a content output device, comprising: a first information acquisition unit that acquires driving situation information, which is information related to the current driving situation of a vehicle; a content acquisition unit that acquires output content, which is content used to output to an occupant of the vehicle when the driving situation information satisfies a trigger condition; an output unit that outputs the output content to the occupant; a second information acquisition unit that acquires occupant information, which is information that can identify an actual reaction of the occupant when the output content is output; and based on the occupant information, An emotional state of the passenger when the reaction of the passenger when the output content is output to the passenger belongs to a normal reaction is estimated as a first emotional state, and an emotional state of the passenger when the reaction of the passenger when the output content is output to the passenger does not belong to the normal reaction is estimated as a second emotional state. An estimation unit for estimating the When there is no factor that can be identified based on the driving situation information as an external factor that could be the cause of the second emotional state, the estimation unit estimates that the output content caused the second emotional state, and when the second emotional state is a negative emotional state and it is estimated that the first output content outputted to the occupant caused the second emotional state, the content acquisition unit acquires a script including words of apology to the occupant as second output content that can suppress the second emotional state, and the output unit outputs the second output content to the occupant immediately after outputting the first output content to the occupant.

[0011] The claimed invention is a content output method, which acquires driving situation information, which is information related to a current driving situation of a vehicle, acquires output content, which is content used to output to an occupant of the vehicle when the driving situation information satisfies a trigger condition, outputs the output content to the occupant, acquires passenger information, which is information that can identify an actual reaction of the occupant when the output content is output, and based on the passenger information, When the reaction of the passenger when the output content is output to the passenger belongs to a normal reaction, the emotional state of the passenger is estimated as a first emotional state, and when the reaction of the passenger when the output content is output to the passenger does not belong to the normal reaction, the emotional state of the passenger is estimated as a second emotional state. When there is no factor that can be identified based on the driving situation information as an external factor that may cause the second emotional state, the output content is estimated to have caused the second emotional state. When the second emotional state is a negative emotional state and it is estimated that the first output content output to the passenger caused the second emotional state, a script including words of apology to the passenger is obtained as second output content capable of suppressing the second emotional state, and the second output content is output to the passenger immediately after the first output content is output to the passenger.

[0013] The invention described in the claims is a program executed by a content output device having a computer, the program including a first information acquisition unit that acquires driving situation information, which is information related to the current driving situation of a vehicle, a content acquisition unit that acquires output content, which is content used to output to an occupant of the vehicle when the driving situation information satisfies a trigger condition, an output unit that outputs the output content to the occupant, a second information acquisition unit that acquires occupant information, which is information that can identify an actual reaction of the occupant when the output content is output, and, based on the occupant information, An emotional state of the passenger when the reaction of the passenger when the output content is output to the passenger belongs to a normal reaction is estimated as a first emotional state, and an emotional state of the passenger when the reaction of the passenger when the output content is output to the passenger does not belong to the normal reaction is estimated as a second emotional state. The computer functions as an estimation unit for the estimation unit estimates that the output content caused the second emotional state when there is no factor identifiable based on the driving situation information as an external factor that could be the cause of the second emotional state; the content acquisition unit acquires a script including words of apology to the occupant as second output content capable of suppressing the second emotional state when the second emotional state is a negative emotional state and it is estimated that the first output content output to the occupant caused the second emotional state; and the output unit causes the computer to function in such a way that the second output content is output to the occupant immediately after the first output content is output to the occupant. [Brief description of the drawings]

[0015] [Figure 1] FIG. 1 is a diagram showing an example of the configuration of a voice output system according to an embodiment. [Diagram 2] FIG. 1 is a block diagram showing a schematic configuration of an audio output device. [Diagram 3] FIG. 2 is a diagram showing an example of a schematic configuration of a server device. [Figure 4] 4 is a flowchart illustrating a process performed in the audio output device. [Diagram 5] 11A and 11B are diagrams for explaining a modified example of processing performed in the audio output device. [Figure 6] 6 is a flowchart illustrating a process performed in the server device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0016] In one preferred embodiment of the present invention, a content output device includes a first information acquisition unit that acquires driving situation information, which is information related to the current driving situation of a vehicle, a content acquisition unit that acquires output content, which is content used to output to an occupant of the vehicle when the driving situation information satisfies a trigger condition, an output unit that outputs the output content to the occupant, a second information acquisition unit that acquires passenger information, which is information that can identify an actual reaction of the occupant when the output content is output, and an estimation unit that estimates, based on the passenger information, an emotional state of the occupant when the output content is output to the occupant.

[0017] The content output device includes a first information acquisition unit, a content acquisition unit, an output unit, a second information acquisition unit, and an estimation unit. The first information acquisition unit acquires driving situation information, which is information related to a current driving situation of a vehicle. The content acquisition unit acquires output content, which is content used to be output to an occupant of the vehicle when the driving situation information satisfies a trigger condition. The output unit outputs the output content to the occupant. The second information acquisition unit acquires passenger information, which is information capable of identifying an actual reaction of the occupant when the output content is output. The estimation unit estimates an emotional state of the occupant when the output content is output to the occupant based on the passenger information. This makes it possible to output content according to the emotional state of the occupant of the vehicle in push-type content output.

[0018] In one aspect of the above-mentioned content output device, the estimation unit estimates, based on the passenger information, an emotional state of the passenger when the output content is output to the passenger that corresponds to a normal reaction as a first emotional state, and estimates an emotional state of the passenger when the output content is output to the passenger that corresponds to a normal reaction not as a second emotional state.

[0019] In one aspect of the above content output device, when there is no external factor that can be identified based on the driving situation information as a factor that could be the cause of the second emotional state, the estimation unit estimates that the output content is the cause of the second emotional state.

[0020] In one aspect of the above-mentioned content output device, when it is estimated that the second emotional state is a negative emotional state and that a first output content output to the occupant has caused the second emotional state, the content acquisition unit acquires a second output content capable of suppressing the second emotional state, and the output unit outputs the second output content to the occupant immediately after outputting the first output content to the occupant.

[0021] In another embodiment of the present invention, a content output device includes a content transmission unit that acquires output content, which is content used to output to occupants of each of a plurality of vehicles, and transmits the acquired output content to the plurality of vehicles, and an estimation unit that estimates the emotional state of the occupant based on a plurality of occupant information received from each of the plurality of vehicles as information that can identify the actual reaction of the occupant when the output content is output to the occupant.

[0022] The content output device includes a content sending unit and an estimation unit. The content sending unit acquires output content, which is content used to output to passengers of each of a plurality of vehicles, and transmits the acquired output content to the plurality of vehicles. The estimation unit estimates the emotional state of the passenger based on a plurality of passenger information received from each of the plurality of vehicles as information capable of identifying the actual reaction of the passenger when the output content is output to the passenger. This makes it possible to output content according to the emotional state of the vehicle passenger in push-type content output.

[0023] In one aspect of the above-mentioned content output device, the estimation unit estimates, based on the passenger information, an emotional state of the passenger when the output content is output to the passenger that corresponds to a normal reaction as a first emotional state, and estimates an emotional state of the passenger when the output content is output to the passenger that corresponds to a normal reaction not as a second emotional state.

[0024] In yet another embodiment of the present invention, a content output method includes acquiring driving situation information that is information related to a current driving situation of a vehicle, acquiring output content that is content used to be output to an occupant of the vehicle when the driving situation information satisfies a trigger condition, outputting the output content to the occupant, acquiring passenger information that is information that can identify an actual reaction of the occupant when the output content is output, and estimating an emotional state of the occupant when the output content is output to the occupant based on the passenger information. This makes it possible to output content according to the emotional state of the occupant of the vehicle in a push-type content output.

[0025] In yet another embodiment of the present invention, a content output method includes acquiring output content to be used for output to a passenger of each of a plurality of vehicles, transmitting the acquired output content to the plurality of vehicles, and estimating an emotional state of the passenger based on a plurality of passenger information received from each of the plurality of vehicles as information capable of identifying an actual reaction of the passenger when the output content is output to the passenger. In this way, in push-type content output, content according to the emotional state of the vehicle passenger can be output.

[0026] In yet another embodiment of the present invention, a program executed by a content output device having a computer causes the computer to function as a first information acquisition unit that acquires driving situation information, which is information related to the current driving situation of a vehicle, a content acquisition unit that acquires output content, which is content used to output to an occupant of the vehicle when the driving situation information satisfies a trigger condition, an output unit that outputs the output content to the occupant, a second information acquisition unit that acquires passenger information, which is information that can identify the actual reaction of the passenger when the output content is output, and an estimation unit that estimates the emotional state of the passenger when the output content is output to the passenger based on the passenger information. By executing this program on a computer, the above content output device can be realized. This program can be stored in a storage medium and used.

[0027] In yet another embodiment of the present invention, a program executed by a content output device including a computer causes the computer to function as a content transmission unit that acquires output content, which is content used to output to passengers of each of a plurality of vehicles, and transmits the acquired output content to the plurality of vehicles, and an estimation unit that estimates the emotional state of the passenger based on a plurality of passenger information received from each of the plurality of vehicles as information that can identify the actual reaction of the passenger when the output content is output to the passenger. By executing this program on a computer, the above-mentioned content output device can be realized. This program can be stored in a storage medium and used. EXAMPLES

[0028] Hereinafter, first and second preferred embodiments of the present invention will be described with reference to the drawings.

[0029] <First Example> First, the first embodiment will be described.

[0030] [System Configuration] (Overall composition) 1 is a diagram showing a configuration example of an audio output system according to an embodiment. The audio output system 1 according to the embodiment includes an audio output device 100 and a server device 200. The audio output device 100 is mounted on a vehicle Ve. The server device 200 communicates with a plurality of audio output devices 100 mounted on a plurality of vehicles Ve.

[0031] The audio output device 100 basically performs route search processing, route guidance processing, and the like for a user who is a passenger of a vehicle Ve. For example, when a destination or the like is input by a user, the audio output device 100 transmits an upload signal S1 including position information of the vehicle Ve and information related to the specified destination to the server device 200. The server device 200 calculates a route to the destination by referring to map data, and transmits a control signal S2 indicating the route to the destination to the audio output device 100. The audio output device 100 provides route guidance to the user by audio output based on the received control signal S2.

[0032] Furthermore, the audio output device 100 provides various types of information to the user through dialogue with the user. For example, when the user makes an information request, the audio output device 100 supplies the server device 200 with an upload signal S1 including information indicating the content or type of the information request and information regarding the running state of the vehicle Ve. The server device 200 acquires and generates the information requested by the user and transmits it to the audio output device 100 as a control signal S2. The audio output device 100 provides the received information to the user by audio output.

[0033] (Audio output device) The audio output device 100 moves together with the vehicle Ve and provides route guidance mainly through audio so that the vehicle Ve travels along the guide route. Note that "route guidance mainly through audio" refers to route guidance that allows the user to grasp information necessary for driving the vehicle Ve along the guide route at least from audio alone, and does not exclude the audio output device 100 displaying a map around the current position as an auxiliary. In this embodiment, the audio output device 100 outputs various information related to driving by audio, such as at least points on the route where guidance is required (also called "guidance points"). Here, the guidance points correspond to, for example, intersections where the vehicle Ve must turn right or left, and other important passing points for the vehicle Ve to travel along the guide route. The audio output device 100 provides audio guidance related to the guidance points, such as the distance from the vehicle Ve to the next guidance point and the traveling direction at the guidance point. Hereinafter, the audio related to the guidance for the guide route will also be called "route audio guidance".

[0034] The audio output device 100 is attached, for example, to an upper portion of a windshield or on a dashboard of the vehicle Ve. The audio output device 100 may be built into the vehicle Ve.

[0035] 2 is a block diagram showing a schematic configuration of the audio output device 100. The audio output device 100 mainly includes a communication unit 111, a storage unit 112, an input unit 113, a control unit 114, a sensor group 115, a display unit 116, a microphone 117, a speaker 118, an outside-vehicle camera 119, and an inside-vehicle camera 120. The elements in the audio output device 100 are connected to each other via a bus line 110.

[0036] The communication unit 111 performs data communication with the server device 200 under the control of the control unit 114. The communication unit 111 may receive, for example, map data for updating a map DB (DataBase) 4 (described later) from the server device 200.

[0037] The storage unit 112 is configured with various types of memory such as a RAM (Random Access Memory), a ROM (Read Only Memory), and a non-volatile memory (including a hard disk drive, a flash memory, etc.). The storage unit 112 stores programs for the audio output device 100 to execute predetermined processes. The above-mentioned programs may include an application program for providing route guidance by voice, an application program for playing music, and an application program for outputting content other than music (such as television). The storage unit 112 is also used as a working memory for the control unit 114. The programs executed by the audio output device 100 may be stored in a storage medium other than the storage unit 112.

[0038] The storage unit 112 also stores a map database (hereinafter, database will be referred to as "DB") 4. Various data necessary for route guidance is recorded in the map DB 4. The map DB 4 stores, for example, road data that represents a road network by a combination of nodes and links, and facility data that indicates facilities that are candidates for a destination, a stop-off point, or a landmark. The map DB 4 may be updated based on map information that the communication unit 111 receives from a map management server under the control of the control unit 114.

[0039] The input unit 113 is a button, a touch panel, a remote controller, etc. that is operated by the user. The display unit 116 is a display or the like that displays information based on the control of the control unit 114. The microphone 117 collects sounds inside the vehicle Ve, particularly sounds uttered by the driver, etc. The speaker 118 outputs sounds for route guidance to the driver, etc.

[0040] The sensor group 115 includes an external sensor 121 and an internal sensor 122. The external sensor 121 is one or more sensors for recognizing the surrounding environment of the vehicle Ve, such as a lidar, a radar, an ultrasonic sensor, an infrared sensor, or a sonar. The internal sensor 122 is a sensor for measuring the position of the vehicle Ve, such as a Global Navigation Satellite System (GNSS) receiver, a gyro sensor, an Inertial Measurement Unit (IMU), a vehicle speed sensor, or a combination of these. Note that the sensor group 115 may include any sensor that allows the control unit 114 to directly or indirectly (i.e., by performing an estimation process) derive the position of the vehicle Ve from the output of the sensor group 115.

[0041] The exterior camera 119 is a camera that captures the outside of the vehicle Ve. The exterior camera 119 may be only a front camera that captures the view in front of the vehicle, or may include a rear camera that captures the view behind the vehicle in addition to the front camera, or may be an omnidirectional camera that can capture the entire surroundings of the vehicle Ve. On the other hand, the interior camera 120 is a camera that captures the inside of the vehicle Ve, and is provided at a position that can capture at least the area around the driver's seat.

[0042] The control unit 114 includes a central processing unit (CPU), a graphics processing unit (GPU), and the like, and controls the entire audio output device 100. For example, the control unit 114 estimates the position (including the direction of travel) of the vehicle Ve based on the output of one or more sensors of the sensor group 115. Furthermore, when a destination is specified by the input unit 113 or the microphone 117, the control unit 114 generates route information indicating a guide route that is a route to the destination, and performs route guidance based on the route information, the estimated position information of the vehicle Ve, and the map DB4. In this case, the control unit 114 causes the speaker 118 to output route voice guidance. Furthermore, the control unit 114 controls the display unit 116 to display information on the music being played, video content, a map of the surroundings of the current position, and the like.

[0043] The processing executed by the control unit 114 is not limited to being realized by software using a program, but may be realized by any combination of hardware, firmware, and software. The processing executed by the control unit 114 may be realized by using an integrated circuit programmable by a user, such as an FPGA (field-programmable gate array) or a microcomputer. In this case, the program executed by the control unit 114 in this embodiment may be realized by using this integrated circuit. In this way, the control unit 114 may be realized by hardware other than a processor.

[0044] The configuration of the audio output device 100 shown in FIG. 2 is an example, and various changes may be made to the configuration shown in FIG. 2. For example, instead of the map DB4 being stored in the storage unit 12, the control unit 114 may receive information necessary for route guidance from the server device 200 via the communication unit 111. In another example, instead of including the speaker 118, the audio output device 100 may output audio from an audio output unit configured separately from the audio output device 100 by electrically connecting the audio output unit to the audio output unit via a known communication means. In this case, the audio output unit may be a speaker provided in the vehicle Ve. In yet another example, the audio output device 100 may not include the display unit 116. In this case, the audio output device 100 may not perform any control regarding the display, and may be electrically connected to a display unit provided in the vehicle Ve or the like via a wired or wireless connection to cause the display unit to execute a predetermined display. Similarly, instead of including the sensor group 115, the audio output device 100 may acquire information output by a sensor provided in the vehicle Ve from the vehicle Ve based on a communication protocol such as CAN (Controller Area Network).

[0045] (Server device) The server device 200 generates route information indicating a guide route along which the vehicle Ve should travel, based on an upload signal S1 including a destination and the like received from the audio output device 100. The server device 200 then generates a control signal S2 related to information output in response to the user's information request, based on the user's information request and the traveling state of the vehicle Ve indicated in the upload signal S1 transmitted thereafter by the audio output device 100. The server device 200 then transmits the generated control signal S2 to the audio output device 100.

[0046] Furthermore, the server device 200 generates content for providing information to the user of the vehicle Ve and for dialogue with the user, and transmits the content to the audio output device 100. Information provided to the user is mainly push-type information provided from the server device 200 side, triggered by the vehicle Ve entering a predetermined driving situation. Also, dialogue with the user is basically pull-type dialogue that is initiated by a question or inquiry from the user. However, dialogue with the user may also be initiated by push-type content provision.

[0047] 3 is a diagram showing an example of a schematic configuration of the server device 200. The server device 200 mainly includes a communication unit 211, a storage unit 212, and a control unit 214. The elements in the server device 200 are connected to each other via a bus line 210.

[0048] The communication unit 211 performs data communication with external devices such as the audio output device 100 under the control of the control unit 214. The storage unit 212 is composed of various types of memory such as RAM, ROM, and non-volatile memory (including a hard disk drive, a flash memory, etc.). The storage unit 212 stores a program for the server device 200 to execute a predetermined process. The storage unit 212 also includes a map DB4.

[0049] The control unit 214 includes a CPU, a GPU, and the like, and controls the entire server device 200. The control unit 214 also executes a program stored in the storage unit 212 to operate together with the audio output device 100 and executes route guidance processing and information provision processing for the user. For example, the control unit 214 generates route information indicating a guidance route or a control signal S2 related to information output in response to an information request from the user, based on an upload signal S1 received from the audio output device 100 via the communication unit 211. Then, the control unit 214 transmits the generated control signal S2 to the audio output device 100 via the communication unit 211.

[0050] [Push-type content provision] Next, push-type content provision will be described. Push-type content provision means that when the vehicle Ve is in a predetermined driving state, the audio output device 100 outputs audio content related to the driving state to the user. Specifically, the audio output device 100 acquires driving state information indicating the driving state of the vehicle Ve based on the output of the sensor group 115 as described above, and transmits the information to the server device 200. The server device 200 stores table data for performing push-type content provision in the storage unit 212. The server device 200 refers to the table data, and when the driving state information received from the audio output device 100 mounted on the vehicle Ve matches a trigger condition defined in the table data, the server device 200 generates output content using a script corresponding to the trigger condition and transmits the generated content to the audio output device 100. The audio output device 100 outputs the output content received from the server device 200 as audio. In this way, the content corresponding to the driving state of the vehicle Ve is output as audio to the user.

[0051] The driving situation information may include at least one piece of information that can be acquired based on the functions of each unit of the audio output device 100, such as the position of the vehicle Ve, the direction of the vehicle, traffic information (including speed restrictions and congestion information, etc.) around the position of the vehicle Ve, the current time, the destination, etc. The driving situation information may also include any of the voice (excluding the user's speech) acquired by the microphone 117, the image captured by the outside camera 119, and the image captured by the inside camera 120. The driving situation information may also include information received from the server device 200 via the communication unit 111.

[0052] [Specific example of how to estimate the passenger's emotional state after outputting the output content] (First concrete example) For example, when the location information included in the driving status information of the vehicle Ve satisfies a trigger condition TG1 corresponding to approaching a restaurant in the vicinity of the current location, the server device 200 acquires a script SC1 corresponding to "There is a restaurant up ahead that I would recommend to Mr. R. Would you like me to show you there?". The server device 200 also transmits the script SC1 to the audio output device 100 as output content. In this way, the script SC1 is output as audio to the user. Note that the aforementioned "Mr. R" represents a name registered in advance as the real name or pseudonym of a passenger in the vehicle Ve.

[0053] After transmitting output content including the script SC1, the server device 200 acquires occupant information that is information capable of identifying the actual reaction of an occupant of the vehicle Ve when the script SC1 is output as audio by the audio output device 100.

[0054] The passenger information may include, for example, at least one of the voice obtained by the microphone 117 and the image captured by the in-vehicle camera 120. In the following, an example will be described in which the voice obtained by the microphone 117 is included in the passenger information.

[0055] The server device 200 analyzes the voice contained in the passenger information to determine whether the passenger's speech in response to the voice output of the script SC1 is a normal reaction, and estimates the emotional state of the passenger at the time the script SC1 was output.

[0056] For example, when the voice included in the passenger information is "Yes," "No," "Yes," or "No," the server device 200 determines that the passenger's speech in response to the voice output of the script SC1 belongs to a normal reaction and estimates that the passenger's emotional state at the time when the script SC1 is output is a normal emotional state. Also, when the voice included in the passenger information is "Like. Yes!", the server device 200 determines that the passenger's speech in response to the voice output of the script SC1 does not belong to a normal reaction and estimates that the passenger's emotional state at the time when the script SC1 is output is a positive emotional state. Also, when the voice included in the passenger information is "I don't want it" or "That's enough," the server device 200 determines that the passenger's speech in response to the voice output of the script SC1 does not belong to a normal reaction and estimates that the passenger's emotional state at the time when the script SC1 is output is a negative emotional state.

[0057] Criteria for determining whether the speech of a passenger is a normal reaction or not may include, for example, the presence or absence of words expressing emotions, the volume of the voice, and the tone of the voice.

[0058] Normal emotional states may include, for example, emotions such as calm and collected, positive emotional states may include, for example, emotions such as anticipation and joy, and negative emotional states may include, for example, emotions such as confusion, impatience, and anger.

[0059] According to the specific example described above, a database DBA including data associating the script SC1 and the emotional state of the passenger after output of the script SC1 with the trigger condition TG1 can be constructed and stored in the storage unit 212. Therefore, according to the specific example described above, when the trigger condition TG1 is satisfied, the server device 200 can determine whether or not the script SC1 is suitable as output content to be output to the driver of the vehicle Ve by referring to the database DBA.

[0060] (Second concrete example) For example, when a trigger condition TG2 corresponding to the number of days since the start of use of the voice output device 100 included in the driving status information of the vehicle Ve reaches a predetermined number of days is satisfied, the server device 200 acquires a script SC2 corresponding to "The number of days since you started using me has reached 187 days. Speaking of 187, the length of the shortest national highway in Japan, Route 174, located in Hyogo Prefecture, is 187 meters." The server device 200 also transmits the script SC2 to the voice output device 100 as an output content. In this way, the script SC2 is output as voice to the user.

[0061] After transmitting output content including the script SC2, the server device 200 acquires occupant information that is information capable of identifying the actual reaction of an occupant of the vehicle Ve when the script SC2 is output as audio by the audio output device 100.

[0062] The server device 200 analyzes the voice contained in the passenger information to determine whether the passenger's speech in response to the voice output of script SC2 is a normal reaction, and estimates the emotional state of the passenger at the time the script SC2 was output.

[0063] For example, if the voice included in the passenger information is "Oh, is that so?", the server device 200 determines that the passenger's speech in response to the voice output of script SC2 does not belong to a normal reaction, and infers that the emotional state of the passenger at the time the script SC2 was voice output was a positive emotional state.

[0064] According to the specific example described above, a database DBB including data associating the script SC2 and the emotional state of the passenger after the output of the script SC2 with the trigger condition TG2 can be constructed and stored in the storage unit 212. Therefore, according to the specific example described above, when the trigger condition TG2 is satisfied, the server device 200 can determine whether or not the script SC2 is suitable as output content to be output to the driver of the vehicle Ve by referring to the database DBB.

[0065] (Third concrete example) For example, when a trigger condition TG3 corresponding to the state of the memory card attached to the audio output device 100 included in the driving status information of the vehicle Ve being in an uninitialized state is satisfied, the server device 200 acquires a script SC3 corresponding to "The memory card needs to be initialized. Do you want to initialize the memory card?". The server device 200 also transmits the script SC3 to the audio output device 100 as an output content. In this way, the script SC3 is output as voice to the user.

[0066] After transmitting output content including the script SC3, the server device 200 acquires occupant information, which is information that can identify the actual reaction of the occupant of the vehicle Ve when the script SC3 is output as audio by the audio output device 100.

[0067] The server device 200 analyzes the voice contained in the passenger information to determine whether the passenger's speech in response to the voice output of script SC3 is a normal reaction, and estimates the emotional state of the passenger at the time the script SC3 was output.

[0068] For example, if the voice included in the passenger information is "Um, what's initialization?", the server device 200 determines that the passenger's speech in response to the voice output of script SC3 does not belong to a normal reaction, and infers that the emotional state of the passenger at the time the script SC3 was voice output was a negative emotional state.

[0069] According to the specific example described above, a database DBC including data associating the script SC3 and the emotional state of the passenger after output of the script SC3 with the trigger condition TG3 can be constructed and stored in the storage unit 212. Therefore, according to the specific example described above, when the trigger condition TG3 is satisfied, the server device 200 can determine whether or not the script SC3 is suitable as output content to be output to the driver of the vehicle Ve by referring to the database DBC.

[0070] (Processing flow) FIG. 4 is a flowchart illustrating the process performed in the audio output device.

[0071] In this embodiment, a case will be described in which the process relating to estimation of the emotional state of the passenger is performed in the audio output device 100.

[0072] The control unit 114 acquires driving situation information relating to the current driving situation of the vehicle Ve (step S11).

[0073] The control unit 114 refers to the table data TB stored in the storage unit 212 of the server device 200 to determine whether or not the driving condition information acquired in step S11 satisfies the trigger condition (step S12).

[0074] When the control unit 114 determines that the driving condition information acquired in step S11 does not satisfy the trigger condition (step S12: NO), it performs the operation of step S11 again.

[0075] When the control unit 114 determines that the driving condition information acquired in step S11 satisfies the trigger condition (step S12: YES), it performs a process for acquiring content for output (step S13).

[0076] The control unit 114 performs processing for outputting the script included in the content for output acquired in step S13 from the speaker 118 as voice (step S14).

[0077] The control unit 114 acquires occupant information, which is information capable of identifying the actual reaction of the occupant of the vehicle Ve when the processing of step S14 is performed, i.e., when the output content acquired in step S13 is output to the occupant (step S15).

[0078] The control unit 114 estimates the emotional state of the occupant of the vehicle Ve when the output content is output to the occupant through the process of step S14, based on the occupant information acquired in step S15 (step S16).

[0079] According to this embodiment, the control unit 114 has functions as an information acquisition unit, a content acquisition unit, and an estimation unit. Also, according to this embodiment, the speaker 118 has a function as an output unit.

[0080] As described above, according to this embodiment, output contents corresponding to driving situation information acquired as information related to the current driving situation of the vehicle are output to the passenger of the vehicle, and the emotional state of the passenger is estimated based on passenger information acquired as information that can identify the actual reaction of the passenger when the output contents are output. Therefore, according to this embodiment, in the push-type content output, it is possible to output contents corresponding to the emotional state of the passenger of the vehicle.

[0081] (Modification) A modified example of the above embodiment will be described below. This modified example can be applied to the second embodiment described later in substantially the same manner. Fig. 5 is a diagram for explaining a modified example of the process performed in the audio output device.

[0082] The control unit 114 of this embodiment may perform, for example, a process for further estimating whether the output content caused the negative emotional state when it is estimated that the emotional state of the passenger when the output content is output is a negative emotional state. Also, the control unit 114 of this embodiment may perform, when it is estimated that the output content caused the negative emotional state, a process for acquiring additional content capable of suppressing the negative emotional state as the output content and outputting the acquired additional content. A specific example of such a process will be described below.

[0083] The control unit 114 determines whether or not the emotional state of the occupant of the vehicle Ve estimated in step S16 is a negative emotional state (step S21).

[0084] If the control unit 114 determines that the emotional state of the occupant of the vehicle Ve estimated in step S16 is not a negative emotional state (step S21: NO), it ends the processing without acquiring and outputting the additional content described below.

[0085] If the control unit 114 determines that the emotional state of the occupant of the vehicle Ve estimated in step S16 is a negative emotional state (step S21: YES), it further determines whether or not there are external factors that may be the cause of the negative emotional state based on the driving situation information acquired in step S11 (step S22).

[0086] When it is determined that there is an external factor that may be the cause of a negative emotional state (step S22: YES), the control unit 114 ends the process without acquiring and outputting additional content, which will be described later.

[0087] Specifically, for example, when the control unit 114 detects that the vehicle Ve is caught in a traffic jam based on traffic information included in the driving condition information, the control unit 114 determines that there is an external factor that may cause a negative emotional state.

[0088] When it is determined that there is no external factor that may be the cause of the negative emotional state (step S22: NO), the control unit 114 presumes that the content for output acquired in step S13 is the cause of the negative emotional state. Then, when such a presumption result is obtained, the control unit 114 acquires additional content capable of suppressing the negative emotional state as content for output (step S23), and performs processing for outputting the acquired additional content (step S24).

[0089] Specifically, the control unit 114 acquires, as additional content, a script SC4 equivalent to, for example, "I'm sorry for the inconvenience," or "I'm sorry for being so intrusive." Then, the control unit 114 performs processing to output the script SC4 as voice from the speaker 118.

[0090] According to this modification, for example, when it is estimated that the emotional state of the passenger has become negative due to the output of the script SC1, the control unit 114 performs a process for audibly outputting the script SC4 immediately after the script SC1. That is, according to this modification, the speaker 118 audibly outputs the script SC4 immediately after audibly outputting the script SC1. Therefore, according to this modification, it is possible to prevent the occurrence of a situation in which the output of the content by the audio output device 100 adversely affects the driving of the vehicle Ve.

[0091] In addition, according to this modified example, for example, a measurement value obtained by measuring the number of times or frequency of output of script SC4 within a certain period of time can be used as data for understanding the personality tendencies of the occupant of vehicle Ve.

[0092] <Second Example> Next, a second embodiment will be described.

[0093] In this embodiment, a case will be described in which the server device 200 transmits output contents to each of a plurality of vehicles Ve, and estimates the emotional state of the passenger when the output contents are output using passenger information received (acquired) from each of the plurality of vehicles Ve after the transmission of the output contents. Therefore, in this embodiment, the description of the parts to which the same configuration as in the first embodiment can be applied will be omitted as appropriate, and the description will be focused on the parts different from the first embodiment.

[0094] 6 is a flowchart for explaining the process performed in the server device 200. First, the control unit 214 receives a plurality of pieces of driving condition information relating to the current driving conditions of each of the plurality of vehicles Ve (step S31).

[0095] Specifically, in step S31, the control unit 214 receives, for example, driving status information transmitted from vehicle Ve1, driving status information transmitted from vehicle Ve2, driving status information transmitted from vehicle Ve3, driving status information transmitted from vehicle Ve4, and driving status information transmitted from vehicle Ve5.

[0096] The control unit 214 determines whether or not any of the driving condition information received in step S31 satisfies the trigger condition (step S32).

[0097] When it is determined in step S31 that all of the driving condition information received does not satisfy the trigger condition (step S32: NO), the control unit 214 performs the operation of step S31 again.

[0098] When it is determined that at least one of the plurality of pieces of driving condition information received in step S31 satisfies the trigger condition (step S32: YES), the control unit 214 performs a process for acquiring the content for output (step S33).

[0099] The control unit 214 performs processing for transmitting the output content acquired in step S33 to the vehicle Ve that is the transmission source of the driving situation information determined to satisfy the trigger condition in step S32 (step S34). Then, according to such processing by the control unit 214, in the vehicle Ve that has received the driving situation information that satisfies the trigger condition, one or more scripts included in the output content acquired as the content corresponding to the trigger condition are output as audio.

[0100] The control unit 214 receives multiple passenger information from each of the multiple vehicles Ve to which the output content was sent in step S34, the information being capable of identifying the actual reaction of the passenger in each of the multiple vehicles Ve when the output content is output to the passenger (step S35).

[0101] Based on the multiple occupant information received in step S35, the control unit 214 estimates the emotional state of the occupants when the output content transmitted by the processing of step S34 is output to the occupants of each of the multiple vehicles Ve (step S36).

[0102] According to the above-described process, for example, a database DBX including data associating the output content transmitted in step S34 and the emotional states of the multiple occupants after the transmission of the output content with the trigger condition TGX can be constructed and stored in the storage unit 212. Therefore, according to the above-described process, when the trigger condition TGX is satisfied, the control unit 214 can selectively acquire content other than content that is likely to cause negative emotions in the occupants of the multiple vehicles Ve, as output content to be transmitted to the multiple vehicles Ve, by referring to the database DBX.

[0103] According to this embodiment, the control unit 214 has functions as a content transmission unit and an estimation unit.

[0104] As described above, according to this embodiment, output contents are transmitted to a plurality of vehicles, passenger information capable of identifying actual reactions of passengers of the plurality of vehicles after the output contents are output to the passengers is received, and the emotional states of the passengers are estimated based on the passenger information. Therefore, according to this embodiment, in the push-type content output, content corresponding to the emotional states of the vehicle passengers can be output.

[0105] In each of the above-mentioned embodiments, the program can be stored using various types of non-transitory computer readable media and supplied to a control unit, which is a computer. The non-transitory computer readable medium includes various types of tangible storage media. Examples of the non-transitory computer readable medium include magnetic storage media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical storage media (e.g., magneto-optical disks), CD-ROM (Read Only Memory), CD-R, CD-R / W, and semiconductor memory (e.g., mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM (Random Access Memory)).

[0106] Although the present invention has been described above with reference to the embodiments, the present invention is not limited to the above-mentioned embodiments. Various modifications that can be understood by a person skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention. In other words, the present invention naturally includes various modifications and corrections that a person skilled in the art could make in accordance with the entire disclosure, including the claims, and the technical ideas. In addition, the disclosures of the above cited patent documents and the like are incorporated herein by reference. [Explanation of symbols]

[0107] 100 Audio output device 200 Server device 111, 211 Communications Department 112, 212 Storage section 113 Input section 114, 214 Control section 115 Sensor Group 116 Display section 117 Mike 118 Speaker 119 Exterior Camera 120 In-car camera

Claims

1. A first information acquisition unit that acquires driving condition information that is information related to a current driving condition of a vehicle; a content acquisition unit that acquires an output content, which is a content used to output to an occupant of the vehicle, when the driving situation information satisfies a trigger condition; an output unit that outputs the output content to the passenger; a second information acquisition unit that acquires passenger information that is information that can identify an actual reaction of the passenger when the output content is output; an estimation unit that estimates, based on the passenger information, an emotional state of the passenger when the reaction of the passenger when the output content is output to the passenger belongs to a normal reaction as a first emotional state, and estimates, based on the passenger information, an emotional state of the passenger when the reaction of the passenger when the output content is output to the passenger does not belong to the normal reaction as a second emotional state; Equipped with the estimation unit estimates that the content for output has caused the second emotional state when there is no factor that can be identified based on the driving situation information as an external factor that may be a cause of the second emotional state; and the content acquisition unit, when it is estimated that the second emotional state is a negative emotional state and that the first output content output to the passenger has caused the second emotional state, acquires a script including words of apology to the passenger as second output content capable of suppressing the second emotional state; The output unit outputs the second content for output to the passenger immediately after outputting the first content for output to the passenger.

2. Acquire driving status information which is information related to the current driving status of a vehicle, acquiring an output content, which is a content used to output to a passenger of the vehicle when the driving situation information satisfies a trigger condition; outputting the output content to the passenger; acquiring passenger information that is information that can identify an actual reaction of the passenger when the output content is output; based on the passenger information, estimating an emotional state of the passenger as a first emotional state when the passenger's reaction when the output content is output to the passenger belongs to a normal reaction, and estimating an emotional state of the passenger as a second emotional state when the passenger's reaction when the output content is output to the passenger does not belong to the normal reaction; When there is no factor that can be identified based on the driving situation information as an external factor that may be a cause of the second emotional state, it is estimated that the content for output is a cause of the second emotional state; when the second emotional state is a negative emotional state and it is estimated that the first output content output to the passenger has caused the second emotional state, acquiring a script including words of apology to the passenger as second output content capable of suppressing the second emotional state; A content output method for outputting the second content for output to the passenger immediately after outputting the first content for output to the passenger.

3. A program executed by a content output device having a computer, A first information acquisition unit that acquires driving situation information that is information related to a current driving situation of the vehicle; a content acquisition unit that acquires an output content, which is a content used to output to an occupant of the vehicle, when the driving situation information satisfies a trigger condition; an output unit that outputs the output content to the passenger; a second information acquisition unit that acquires passenger information that is information that can identify an actual reaction of the passenger when the output content is output; and making the computer function as an estimation unit that estimates, based on the passenger information, an emotional state of the passenger when the reaction of the passenger when the output content is output to the passenger belongs to a normal reaction as a first emotional state, and estimates, based on the passenger information, an emotional state of the passenger when the reaction of the passenger when the output content is output to the passenger does not belong to the normal reaction as a second emotional state; the estimation unit estimates that the content for output has caused the second emotional state when there is no factor that can be identified based on the driving situation information as an external factor that may be a cause of the second emotional state; and the content acquisition unit, when it is estimated that the second emotional state is a negative emotional state and that the first output content output to the passenger has caused the second emotional state, acquires a script including words of apology to the passenger as second output content capable of suppressing the second emotional state; The output unit is a program that causes the computer to function such that the second output content is output to the passenger immediately after the first output content is output to the passenger.

4. A storage medium storing the program described in claim 3.

Images