Information processing system, information processing device, vehicle, information processing method, and program

Abstract

To provide an information processing system, an information processing device, a vehicle, an information processing method, and a program that suitably assist for the utterance of a vehicle occupant.SOLUTION: Provided is an information processing system 10 in which a vehicle 12 and an information processing device 14 perform bidirectional communication via a communication circuit 16 such as the Internet. The information processing system 10 comprises: state information acquisition units 36, 54 for acquiring state information indicating the driving state of the vehicle 12; utterance information acquisition units 34, 52 for acquiring utterance information representing utterance of a vehicle occupant; an analysis unit 56 for analyzing the content of the utterance of the vehicle occupant on the basis of the utterance information acquired by the utterance information acquisition units 34, 52; and an assist control unit 58 for executing assist control to provide voice assistance or assistance by screen display to the vehicle occupant on the basis of the result of analysis by the analysis unit 56. The assist control unit 58 changes an output mode in assist control in accordance with the state information.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an information processing system, an information processing device, a vehicle, an information processing method, and a program. [Background technology]

[0002] Patent Document 1 discloses an information processing method and an information processing device that can start a dialogue that matches the psychological tendencies of an occupant. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-71606 Summary of the Invention [Problem to be solved by the invention]

[0004] A technique that can better assist with passenger speech is desirable.

[0005] The present invention aims to solve the above-mentioned problems. [Means for solving the problem]

[0006] The information processing system of the first invention comprises a status information acquisition unit that acquires status information, which is information on the driving status of the vehicle, an utterance information acquisition unit that acquires speech information, which is information on the speech of an occupant of the vehicle, an analysis unit that analyzes the content of the occupant's speech based on the speech information acquired by the utterance information acquisition unit, and an assist control unit that executes assist control, which is control for providing assistance to the occupant through voice assistance or screen display, based on the results of the analysis by the analysis unit, and the assist control unit changes the output mode in the assist control in accordance with the status information.

[0007] A second invention is an information processing device in the information processing system according to the first invention, comprising the state information acquisition unit, the speech information acquisition unit, the analysis unit, and the assist control unit.

[0008] A third invention is a vehicle in the information processing system according to the first invention, comprising the state information acquisition unit, the speech information acquisition unit, the analysis unit, and the assist control unit.

[0009] The fourth invention is an information processing method comprising a state information acquisition step of acquiring state information, which is information on the driving state of the vehicle; an utterance information acquisition step of acquiring speech information, which is information on the speech of an occupant of the vehicle; an analysis step of analyzing the content of the occupant's speech based on the speech information acquired in the utterance information acquisition step; and an assist control step of executing assist control, which is control for providing assistance to the occupant through voice assistance or screen display, based on the results of the analysis in the analysis step, wherein in the assist control step, the output mode in the assist control is changed in accordance with the state information.

[0010] A program according to a fifth aspect of the present invention causes a computer to execute the information processing method according to the fourth aspect of the present invention. Effect of the Invention

[0011] According to the present invention, it is possible to provide better assistance in response to the speech of the occupant. [Brief description of the drawings]

[0012] [Figure 1] FIG. 1 is a schematic configuration diagram of an information processing system according to the first embodiment. [Diagram 2] FIG. 2 is a sequence diagram of the assist process performed in the information processing system. [Diagram 3] FIG. 3 is a process flow of a first specific example of the process for changing the output mode of the explanation. [Figure 4]FIG. 4 is a process flow of a second specific example of the process for changing the output mode of the explanation. [Diagram 5] FIG. 5 is a process flow of a third specific example of the process for changing the output mode of the explanation. [Figure 6] FIG. 6 is a process flow of a fourth specific example of the process for changing the output mode of the explanation. [Figure 7] FIG. 7 is a schematic configuration diagram of an information processing system according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] [1 First embodiment] [1-1 Configuration of information processing system 10] 1 is a schematic configuration diagram of an information processing system 10 according to a first embodiment. The information processing system 10 includes a vehicle 12 and an information processing device 14. The vehicle 12 and the information processing device 14 can perform two-way communication via a communication line 16 such as the Internet.

[0014] (Vehicle 12 Configuration) The vehicle 12 is equipped with a wheel speed sensor 18, a sound collection device 20, an audio output device 22, a display device 24, a communication device 26, and a control device 28.

[0015] The wheel speed sensor 18 measures the rotational speed of a wheel provided on the vehicle 12. The wheel speed sensor 18 outputs to the control device 28 rotational speed information indicating the measured rotational speed.

[0016] The sound collection device 20 includes a microphone. The sound collection device 20 collects sounds within the cabin of the vehicle 12, and outputs audio information that has been digitized from the sounds to the control device 28. The audio information that has been digitized from the speech of the occupant of the vehicle 12 (hereinafter simply referred to as the occupant) is also referred to as speech information.

[0017] The audio output device 22 includes a speaker. The audio output device 22 acquires audio information from the control device 28, and outputs audio into the cabin based on the audio information. The audio output from the audio output device 22 reaches the passengers.

[0018] The display device 24 includes a display screen. The display device 24 acquires display information from the control device 28 and displays information corresponding to the display information on the display screen.

[0019] The communication device 26 is configured by, for example, a TCU (Telematics Control Unit). The communication device 26 can realize two-way communication between the control device 28 and a device (such as the information processing device 14) outside the vehicle 12. The communication device 26 includes a communication circuit for performing two-way communication with the control device 28, a wireless communication module (integrated circuit module) for performing two-way communication with a device outside the vehicle 12 via the communication line 16, and a microcomputer for performing data processing.

[0020] The control device 28 may be configured by an ECU (Electronic Control Unit). The control device 28 includes a calculation unit 30 and a storage unit 32. The calculation unit 30 may be configured by a processor such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit). That is, the calculation unit 30 may be configured by a processing circuit. The calculation unit 30 includes an utterance information acquisition unit 34, a state information acquisition unit 36, a voice output control unit 38, a display control unit 40, and a communication control unit 42. The utterance information acquisition unit 34, the state information acquisition unit 36, the voice output control unit 38, the display control unit 40, and the communication control unit 42 may be realized by the calculation unit 30 executing a program stored in the storage unit 32. At least a part of the calculation unit 30 may be realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field-Programmable Gate Array). At least a part of the calculation unit 30 may be realized by an electronic circuit including discrete devices.

[0021] The speech information acquisition unit 34 acquires voice information supplied from the sound collection device 20. The state information acquisition unit 36 ​​acquires state information indicating the driving state of the vehicle 12. For example, the state information acquisition unit 36 ​​acquires rotation speed information supplied by the wheel speed sensor 18. When the rotation speed of the wheels is equal to or higher than a predetermined speed, the state information acquisition unit 36 ​​determines that the driving state of the vehicle 12 is a running state. When the rotation speed of the wheels is less than the predetermined speed, the state information acquisition unit 36 ​​determines that the driving state of the vehicle 12 is a running stop state. In this way, the state information acquisition unit 36 ​​acquires state information indicating whether the driving state of the vehicle 12 is a running state or not. Note that the driving state of the vehicle 12 is not limited to a running state and a running stop state. The driving state of the vehicle 12 may be an "assisted state by automatic driving" or the like. The audio output control unit 38 outputs audio information to the audio output device 22. The display control unit 40 outputs display information to the display device 24. The communication control unit 42 controls communication with the communication device 26.

[0022] The storage unit 32 is configured with a volatile memory (not shown) and a non-volatile memory (not shown) which are computer-readable storage media. The volatile memory is, for example, a random access memory (RAM). The non-volatile memory is, for example, a read only memory (ROM) or a flash memory. Data and the like are stored, for example, in the volatile memory. Programs, tables, maps, and the like are stored, for example, in the non-volatile memory. At least a part of the storage unit 32 may be provided in the above-mentioned processor, integrated circuit, and the like.

[0023] (Configuration of information processing device 14) The information processing device 14 is configured by, for example, a server device. The server device can be provided by a physical server or a cloud server. The information processing device 14 can perform two-way communication with other server devices via a communication line 16.

[0024] The information processing device 14 includes a calculation unit 48 and a storage unit 50. The calculation unit 48 may be configured by a processor such as a CPU or a GPU. That is, the calculation unit 48 may be configured by a processing circuitry. The calculation unit 48 includes an utterance information acquisition unit 52, a state information acquisition unit 54, an analysis unit 56, an assist control unit 58, and a questionnaire control unit 60. The utterance information acquisition unit 52, the state information acquisition unit 54, the analysis unit 56, the assist control unit 58, and the questionnaire control unit 60 may be realized by the calculation unit 48 executing a program stored in the storage unit 50. At least a part of the calculation unit 48 may be realized by an integrated circuit such as an ASIC or an FPGA. At least a part of the calculation unit 48 may be realized by an electronic circuit including a discrete device.

[0025] The speech information acquisition unit 52 acquires speech information supplied from the vehicle 12 via the communication line 16. The status information acquisition unit 54 acquires status information supplied from the vehicle 12 via the communication line 16. The analysis unit 56 analyzes the content of the occupant's speech based on the speech information acquired by the speech information acquisition unit 52. The analysis unit 56 has, for example, a voice recognition function. The assist control unit 58 executes assist control, which is control for providing voice assistance or screen display assistance in response to a request from the occupant, based on the result of the analysis by the analysis unit 56. The assist control unit 58 has, for example, a natural language processing function. The questionnaire control unit 60 executes questionnaire control, which is control for conducting a questionnaire to the occupant regarding voice assistance that has already been performed.

[0026] The storage unit 50 is configured with a volatile memory (not shown) and a non-volatile memory (not shown) which are computer-readable storage media. The volatile memory is, for example, a RAM. The non-volatile memory is, for example, a ROM, a flash memory. Data and the like are stored, for example, in the volatile memory. Programs, tables, maps, and the like are stored, for example, in the non-volatile memory. At least a part of the storage unit 50 may be provided in the above-mentioned processor, integrated circuit, and the like.

[0027] [1-2 Assist processing performed by the information processing device 14] In this specification, the information processing device 14 responding to the occupant's speech by voice is referred to as voice assist. Also, in this specification, the information processing device 14 responding to the occupant's speech by displaying an explanatory text on a screen is referred to as assisting by displaying an explanatory text on a screen.

[0028] The information processing device 14 is capable of having a conversation with the occupant. When the occupant speaks to the information processing device 14, the information processing device 14 executes assist control for providing an explanation to the occupant's speech. As a result, an explanatory voice corresponding to the occupant's speech is output from the audio output device 22 of the vehicle 12. Alternatively, an explanatory text or the like corresponding to the occupant's speech is displayed on the display screen of the display device 24 of the vehicle 12.

[0029] Fig. 2 is a sequence diagram of the assist process performed in the information processing system 10. Fig. 2 shows a basic flow of the process in which the information processing device 14 responds to one utterance by the occupant. When the conversation between the occupant and the information processing device 14 continues, the process shown in Fig. 2 is repeatedly executed.

[0030] In step S1, the speech information acquisition unit 34 of the vehicle 12 acquires the speech information collected by the sound collection device 20. In addition, the status information acquisition unit 36 ​​of the vehicle 12 acquires status information based on the rotation speed information supplied by the wheel speed sensor 18. When step S1 ends, the process proceeds to step S2.

[0031] In step S2, the communication control unit 42 of the vehicle 12 controls transmission of the utterance information and the status information to the information processing device 14. As a result, the utterance information and the status information are transmitted to the information processing device 14 via the communication device 26 and the communication line 16. When step S2 ends, the process proceeds to step S3.

[0032] In step S3, the utterance information acquisition unit 52 of the information processing device 14 acquires utterance information via the communication line 16. Also, the status information acquisition unit 54 of the information processing device 14 acquires status information via the communication line 16. When step S3 ends, the process proceeds to step S4.

[0033] In step S4, the analysis unit 56 of the information processing device 14 analyzes the speech information. For example, the analysis unit 56 performs voice recognition based on the speech information and generates text data of the voice. When step S4 ends, the process proceeds to step S5.

[0034] In step S5, the assist control unit 58 of the information processing device 14 executes assist control. For example, the assist control unit 58 performs natural language processing based on the text data generated by the analysis unit 56. The assist control unit 58 generates audio information or display information (including character information) of an explanatory sentence to respond to an inquiry uttered by the occupant in a manner corresponding to the state information. Note that a plurality of explanatory sentences may be stored in advance in the storage unit 50, and the assist control unit 58 may generate the audio information or display information based on the explanatory sentences stored in the storage unit 50. The assist control unit 58 performs control to transmit the audio information or display information to the vehicle 12. When step S5 ends, the process proceeds to step S6.

[0035] In step S6, the communication control unit 42 of the vehicle 12 acquires the voice information or the display information via the communication line 16 and the communication device 26. When step S6 ends, the process proceeds to step S7.

[0036] In step S7, the audio output control unit 38 of the vehicle 12 outputs the audio information to the audio output device 22. As a result, the audio output device 22 outputs audio. The audio output from the audio output device 22 reaches the occupants. Alternatively, the display control unit 40 of the vehicle 12 outputs information corresponding to the display information to the display device 24. As a result, the display device 24 displays an explanatory text or the like on the display screen.

[0037] In step S8, the survey control unit 60 executes survey control. The survey control unit 60 generates survey information (audio information or display information related to the survey) in a format corresponding to the status information. The survey information is pre-stored, for example, in the memory unit 50. The survey control unit 60 controls the transmission of the survey information to the vehicle 12. When step S8 ends, the process proceeds to step S9.

[0038] In step S9, the communication control unit 42 of the vehicle 12 acquires the survey information via the communication line 16 and the communication device 26. When step S9 ends, the process proceeds to step S10.

[0039] In step S10, the audio output control unit 38 of the vehicle 12 outputs the questionnaire information (audio information) to the audio output device 22. As a result, the audio output device 22 outputs the audio of the questionnaire. The audio output from the audio output device 22 reaches the occupant. Alternatively, the display control unit 40 of the vehicle 12 outputs the questionnaire information (display information) to the display device 24. As a result, the display device 24 displays the questionnaire on the display screen.

[0040] The above is the basic flow of the assist process performed in the information processing system 10. In step S5, the assist control unit 58 of the information processing device 14 changes the output mode of the explanatory text (the output mode in the assist control) according to the driving state of the vehicle 12. In other words, the assist control unit 58 determines the output mode of the explanatory text according to the driving state of the vehicle 12.

[0041] When the driving state of the vehicle 12 changes, the degree of concentration of the occupant on the dialogue with the information processing device 14 changes. According to this embodiment, the output mode of the explanatory text for responding to the inquiry uttered by the occupant is changed according to the driving state of the vehicle 12. That is, the explanation for responding to the inquiry uttered by the occupant is provided in an output mode suitable for the driving state of the vehicle 12. Therefore, it is possible to provide better assistance in response to the occupant's speech.

[0042] There are various possible processes for changing (determining) the output mode of the explanatory text. A specific example of the process for changing (determining) the output mode of the explanatory text will be described below.

[0043] (First concrete example) FIG. 3 is a process flow of a first specific example of a process for changing the output mode of an explanatory sentence. A plurality of items may be explained by the information processing device 14. An item here is the smallest unit of explanation. For example, when an occupant inquires of the information processing device 14 about a function of the vehicle 12, the information processing device 14 may sequentially explain a plurality of features related to the function. In this case, the explanation of one feature is the smallest unit of explanation and corresponds to one item. In the first specific example, when the explanatory sentence includes a plurality of items, the assist control unit 58 changes the output mode in the assist control according to the state information.

[0044] In step S11, the assist control unit 58 determines whether there are multiple items to be explained to the occupant. If there are multiple items to be explained to the occupant (step S11: YES), the process proceeds to step S12. On the other hand, if there are not multiple items to be explained to the occupant (step S11: NO), the process proceeds to step S14.

[0045] When the process proceeds from step S11 to step S12, the assist control unit 58 determines the driving state of the vehicle 12 based on the state information acquired by the state information acquisition unit 54. If the driving state of the vehicle 12 is a traveling state (step S12: traveling state), the process proceeds to step S13. On the other hand, if the driving state of the vehicle 12 is a traveling stopped state (step S12: traveling stopped state), the process proceeds to step S14.

[0046] When the process proceeds from step S12 to step S13, the assist control unit 58 performs assist control for notifying the number of items by voice assistance and explaining each item by voice assistance. For example, the assist control unit 58 generates voice information of an explanatory sentence to respond to an inquiry by voice of the occupant. The generated voice information includes voice information for notifying the number of items and voice information for explaining each item. The assist control unit 58 also performs control to transmit the voice information to the vehicle 12. As a result, in step S7 shown in FIG. 2, the voice output device 22 of the vehicle 12 outputs the number of items to be explained by voice prior to explaining each item by voice assistance.

[0047] When the process proceeds from step S11 or step S12 to step S14, the assist control unit 58 performs assist control to provide explanations using normal voice assistance. The assist control unit 58 generates voice information of an explanatory sentence to respond to an inquiry uttered by the occupant. The voice information generated here includes voice information for providing an explanation that does not have any items. The assist control unit 58 also performs control to transmit the voice information to the vehicle 12. As a result, in step S7 shown in FIG. 2, the voice output device 22 of the vehicle 12 outputs the normal explanation by voice.

[0048] When the vehicle 12 is traveling, the driver (passenger) concentrates on driving the vehicle 12. Therefore, if multiple items are explained in succession, the driver has difficulty understanding the entire content of the explanation. According to the first specific example, the number of items is notified before the explanation of multiple items, making it easier for the driver to grasp the overall picture of the explanation. In other words, information is more easily conveyed to the driver. Therefore, better assistance can be provided in response to the passenger's speech.

[0049] (Second concrete example) 4 is a process flow of a second specific example of the process for changing the output mode of the explanatory text. As in the first specific example, in the second specific example, when the explanatory text includes multiple items, the assist control unit 58 changes the output mode in the assist control according to the state information. The processes of steps S21, S22, and S24 shown in FIG. 4 are the same as the processes of steps S11, S12, and S14 shown in FIG. 3. Therefore, the description of the processes of steps S21, S22, and S24 will be omitted below.

[0050] When the process proceeds from step S22 to step S23, the assist control unit 58 performs assist control for explaining one item by voice assistance. For example, the assist control unit 58 generates voice information of an explanatory sentence for one item. The assist control unit 58 also performs control for transmitting the voice information to the vehicle 12. After completing the explanation of one item, the assist control unit 58 shifts to explaining the next item in response to an instruction from the occupant who intends to shift to explaining the next item. An instruction from the occupant who intends to shift to explaining the next item is, for example, an utterance by the occupant such as "next." In other words, after completing the explanation of one item, the assist control unit 58 executes assist control for explaining the next item at the point in time when the occupant's utterance is acquired by the utterance information acquisition unit 52.

[0051] According to the second concrete example, since a plurality of items are explained step by step, the driver can easily grasp the explanation of each item. In other words, the information is easily conveyed to the driver. Therefore, the driver can be better assisted in response to the passenger's speech.

[0052] (Third concrete example) 5 is a process flow of a third specific example of the process for changing the output mode of the explanation. In the third specific example, the assist control unit 58 executes assist control for outputting audio when the driving state of the vehicle 12 is in a driving state, and executes assist control for displaying on the screen when the driving state of the vehicle 12 is in a stopped state.

[0053] In step S31, the assist control unit 58 determines the driving state of the vehicle 12 based on the state information acquired by the state information acquisition unit 54. If the driving state of the vehicle 12 is a traveling state (step S31: traveling state), the process proceeds to step S32. On the other hand, if the driving state of the vehicle 12 is a traveling stopped state (step S31: traveling stopped state), the process proceeds to step S33.

[0054] When the process proceeds from step S31 to step S32, the assist control unit 58 executes assist control to perform voice assistance. Here, the assist control unit 58 generates voice information of an explanatory sentence to respond to an inquiry uttered by the occupant. The assist control unit 58 also performs control to transmit the voice information to the vehicle 12. As a result, in step S7 shown in FIG. 2, the voice output device 22 of the vehicle 12 outputs the explanation by voice.

[0055] When the process proceeds from step S31 to step S33, the assist control unit 58 executes assist control for providing assistance through screen display. The assist control unit 58 generates display information for an explanatory text to respond to an inquiry made by the occupant through speech. The assist control unit 58 also controls the transmission of the display information to the vehicle 12. As a result, in step S7 shown in Fig. 2, the display device 24 of the vehicle 12 displays the explanatory text, etc. on the display screen.

[0056] According to the third specific example, since the explanatory text is displayed on the display screen when the vehicle 12 is stopped, the occupant can read the explanatory text at his / her own pace. In other words, the information is easily conveyed to the occupant. Therefore, the occupant's speech can be better assisted.

[0057] (Fourth Specific Example) 6 is a process flow of a fourth specific example of the process for changing the output mode of the explanation. In the fourth specific example, the assist control unit 58 changes the amount of information provided to the user during the assist control in accordance with the state information.

[0058] In step S41, the assist control unit 58 determines the driving state of the vehicle 12 based on the state information acquired by the state information acquisition unit 54. If the driving state of the vehicle 12 is a traveling state (step S41: traveling state), the process proceeds to step S42. On the other hand, if the driving state of the vehicle 12 is a traveling stopped state (step S41: traveling stopped state), the process proceeds to step S43.

[0059] When the process moves from step S41 to step S42, the assist control unit 58 executes assist control by voice assistance. The assist control unit 58 generates audio information of an explanatory sentence to respond to an inquiry uttered by the occupant. The amount of information of the explanatory sentence generated here (second amount of information) is relatively small. For example, the explanatory sentence is composed of the minimum information necessary for the occupant to understand. In other words, the explanatory sentence is a concise summary. The assist control unit 58 also controls to transmit the audio information to the vehicle 12. As a result, in step S7 shown in FIG. 2, the audio output device 22 of the vehicle 12 outputs an explanatory sentence with a small amount of information.

[0060] When the process moves from step S41 to step S43, the assist control unit 58 executes assist control by voice assistance. The assist control unit 58 generates audio information of an explanatory sentence to respond to an inquiry uttered by the occupant. The amount of information of the explanatory sentence generated here (first amount of information) is relatively large. For example, the explanatory sentence is composed of the minimum information necessary for the occupant to understand and additional information. In other words, the explanatory sentence is a detailed sentence including various explanations. The assist control unit 58 also controls to transmit the audio information to the vehicle 12. As a result, in step S7 shown in FIG. 2, the audio output device 22 of the vehicle 12 outputs an explanation with a large amount of information by voice.

[0061] According to the fourth specific example, the occupant can grasp the summary of the explanation while the vehicle 12 is moving, and can grasp the details of the explanation while the vehicle 12 is stopped. That is, information is easily conveyed to the occupant. Therefore, assistance can be provided in response to the occupant's speech in a better manner.

[0062] [2 Second embodiment] 7 is a schematic configuration diagram of an information processing system 10 according to the second embodiment. In the second embodiment, the same components as those in the first embodiment are denoted by the same reference numerals.

[0063] In the second embodiment, the calculation unit 30 of the vehicle 12 includes, similarly to the first embodiment, an utterance information acquisition unit 34, a state information acquisition unit 36, a voice output control unit 38, a display control unit 40, and a communication control unit 42. Furthermore, the calculation unit 30 of the vehicle 12 includes an analysis unit 56, an assist control unit 58, and a questionnaire control unit 60. In other words, the control device 28 of the vehicle 12 may function as the information processing device 14.

[0064] According to the second embodiment, similarly to the first embodiment, it is possible to provide better assistance in response to the speech of the occupant.

[0065] [3 Notes] In addition to the above disclosure, the following notes are also disclosed.

[0066] (Appendix 1) The information processing system (10) relating to the first disclosure includes a status information acquisition unit (36, 54) that acquires status information, which is information on the driving status of a vehicle (12), an utterance information acquisition unit (34, 52) that acquires speech information, which is information on the speech of an occupant of the vehicle, an analysis unit (56) that analyzes the content of the occupant's utterance based on the speech information acquired by the utterance information acquisition unit, and an assist control unit (58) that executes assist control, which is control for providing assistance to the occupant by voice assistance or screen display, based on the result of the analysis by the analysis unit, and the assist control unit changes the output mode in the assist control in accordance with the status information.

[0067] When the driving state of the vehicle changes, the degree of concentration of the occupant on the dialogue with the information processing device changes. According to the above configuration, the output mode of the explanatory text for responding to the inquiry uttered by the occupant is changed according to the driving state of the vehicle. In other words, the explanation for responding to the inquiry uttered by the occupant is provided in an output mode suitable for the driving state of the vehicle. Therefore, it is possible to better assist the occupant in the speech.

[0068] (Appendix 2) The information processing system described in Appendix 1 may include a questionnaire control unit (60) that executes questionnaire control, which is control for conducting a questionnaire regarding the voice assistance that has already been conducted for the occupant, and the questionnaire control unit may change the output mode in the questionnaire control depending on the status information.

[0069] (Appendix 3) In the information processing system described in Appendix 1 or 2, when the status information indicating that the vehicle is moving is acquired by the status information acquisition unit and there are multiple items to be explained to the occupant by the voice assist, the assist control unit may execute the assist control to output the number of items by voice prior to the explanation by the voice assist.

[0070] When the vehicle is traveling, the driver (passenger) concentrates on driving the vehicle. Therefore, if multiple items are explained in succession, the driver has difficulty understanding the entire content of the explanation. According to the above configuration, the number of items is notified before the explanation of multiple items, making it easier for the driver to grasp the overall picture of the explanation. In other words, information is easily conveyed to the driver. Therefore, better assistance can be provided in response to the passenger's speech.

[0071] (Appendix 4) In the information processing system described in Appendix 1 or 2, when the status information indicating that the vehicle is moving is acquired by the status information acquisition unit and there are multiple items to be explained to the occupant through the voice assist, the assist control unit may execute the assist control to move on to an explanation of the next item in response to a command from the occupant who intends to move on to an explanation of the next item after completing the explanation of one of the items.

[0072] According to the above configuration, since a plurality of items are explained step by step, the driver can easily understand the explanation of each item. In other words, the information is easily conveyed to the driver. Therefore, the driver can be better assisted in response to the utterance of the occupant.

[0073] (Appendix 5) In the information processing system described in any one of Appendices 1 to 4, when the status information indicating that the vehicle has stopped traveling is acquired by the status information acquisition unit and there are multiple items to be explained to the occupant, the assist control unit may execute the assist control to display each of the items on a screen.

[0074] According to the above configuration, since the explanatory text is displayed on the display screen when the vehicle is stopped, the occupant can read the explanatory text at his / her own pace. In other words, the information is easily conveyed to the occupant. Therefore, the occupant's speech can be more effectively assisted.

[0075] (Appendix 6) In the information processing system described in any one of Appendices 1 to 5, the assist control unit may set the amount of information in the explanation provided by the voice assist to a first amount of information when the status information acquisition unit acquires the status information indicating that the vehicle is stopped, and may set the amount of information in the explanation provided by the voice assist to a second amount of information less than the first amount of information when the status information acquisition unit acquires the status information indicating that the vehicle is moving.

[0076] According to the above configuration, the occupant can grasp the summary of the explanation when the vehicle is moving, and can grasp the details of the explanation when the vehicle is stopped. In other words, information is easily conveyed to the occupant. Therefore, the occupant's speech can be better assisted.

[0077] (Appendix 7) The information processing system described in any one of Appendices 1 to 6 may include an information processing device (14) having the status information acquisition unit, the utterance information acquisition unit, the analysis unit, and the assist control unit, and the vehicle having a transmission unit (42) that transmits the status information and the utterance information to the information processing device.

[0078] (Appendix 8) A second disclosure is an information processing device in the information processing system according to any one of Supplementary Notes 1 to 7, comprising the state information acquisition unit, the speech information acquisition unit, the analysis unit, and the assist control unit.

[0079] (Appendix 9) A third disclosure is a vehicle in the information processing system described in Supplementary Note 1, comprising the state information acquisition unit, the speech information acquisition unit, the analysis unit, and the assist control unit.

[0080] (Appendix 10) The fourth disclosure is an information processing method comprising a state information acquisition step of acquiring state information, which is information on the driving state of a vehicle; an utterance information acquisition step of acquiring speech information, which is information on the speech of an occupant of the vehicle; an analysis step of analyzing the content of the occupant's speech based on the speech information acquired in the utterance information acquisition step; and an assist control step of executing assist control, which is control for providing assistance to the occupant through voice assistance or screen display, based on the result of the analysis in the analysis step, wherein in the assist control step, an output mode in the assist control is changed according to the state information.

[0081] (Appendix 11) The program according to the fifth disclosure causes a computer to execute the information processing method described in Supplementary Note 10.

[0082] The present invention is not limited to the above disclosure, and various configurations can be adopted without departing from the gist of the present invention. [Explanation of symbols]

[0083] 10...Information processing system 12...Vehicle 14... Information processing device 34, 52... Speech information acquisition unit 36, 54... Status information acquisition unit 42... Communication control unit (transmission unit) 56: Analysis section 58: Assist control section 60...Survey control section

Claims

1. A state information acquisition unit that acquires state information that is information on a driving state of a vehicle; an utterance information acquisition unit that acquires utterance information that is information on utterances of an occupant of the vehicle; an analysis unit that analyzes the content of the utterance of the occupant based on the utterance information acquired by the utterance information acquisition unit; an assist control unit that executes an assist control for providing the occupant with voice assistance or screen display assistance based on a result of the analysis by the analysis unit; Equipped with The assist control unit changes an output mode in the assist control in accordance with the state information.

2. 2. The information processing system according to claim 1, a questionnaire control unit that executes questionnaire control for conducting a questionnaire regarding the voice assistance that has already been conducted for the occupant, The survey control unit changes an output mode in the survey control in accordance with the state information.

3. 2. The information processing system according to claim 1, The assist control unit of this information processing system executes the assist control to output the number of items by voice prior to the explanation by the voice assist when the status information indicating that the vehicle is moving is acquired by the status information acquisition unit and there are multiple items to be explained to the occupant by the voice assist.

4. 2. The information processing system according to claim 1, The assist control unit executes the assist control to move on to explaining the next item in response to an instruction from the occupant who intends to move on to explaining the next item after completing the explanation of one item, when the status information indicating that the vehicle is moving is acquired by the status information acquisition unit and there are multiple items to be explained to the occupant through the voice assist.This is an information processing system.

5. 2. The information processing system according to claim 1, The assist control unit of this information processing system executes the assist control to display each of the items on the screen when the status information indicating that the vehicle has stopped traveling is acquired by the status information acquisition unit and there are multiple items to be explained to the occupant.

6. 2. The information processing system according to claim 1, The assist control unit, when the status information indicating that the vehicle is stopped is acquired by the status information acquisition unit, sets the amount of information provided by the voice assist to a first amount of information, and when the status information indicating that the vehicle is moving is acquired by the status information acquisition unit, sets the amount of information provided by the voice assist to a second amount of information less than the first amount of information.

7. 2. The information processing system according to claim 1, an information processing device including the state information acquisition unit, the speech information acquisition unit, the analysis unit, and the assist control unit; the vehicle including a transmission unit that transmits the status information and the speech information to the information processing device; An information processing system comprising:

8. An information processing device in the information processing system according to claim 1, An information processing device comprising: the state information acquisition unit, the speech information acquisition unit, the analysis unit, and the assist control unit.

9. A vehicle in the information processing system according to claim 1, A vehicle comprising the state information acquisition unit, the speech information acquisition unit, the analysis unit, and the assist control unit.

10. A state information acquisition step of acquiring state information which is information on a driving state of a vehicle; an utterance information acquisition step of acquiring utterance information which is information on utterances of an occupant of the vehicle; an analysis step of analyzing the content of the utterance of the occupant based on the utterance information acquired in the utterance information acquisition step; an assist control step of executing an assist control for providing the occupant with voice assistance or screen display assistance based on a result of the analysis in the analysis step; An information processing method comprising: In the assist control step, an output mode in the assist control is changed in accordance with the state information.

11. A program for causing a computer to execute the information processing method according to claim 10.

Images