In-vehicle information processing device, information processing method, and program

Abstract

The activation words for each VUI (Voice User Interface) function are standardized while suppressing the increase in resource consumption. [Solution] The in-vehicle information processing device (1) includes a control unit (12) having multiple VUI functions that are activated with the same activation phrase. Each of the multiple VUI functions is associated with an in-vehicle function. The VUI function processes the user's speech using speech recognition to recognize voice commands for the in-vehicle function, and executes the in-vehicle function based on the voice command. If a predetermined in-vehicle function is activated, the VUI function associated with that in-vehicle function is activated in response to the activation phrase.

Description

Technical Field

[0004] , , , ,

[0005] , , ,

[0003] , ,

[0001] The present disclosure relates to an in-vehicle information processing apparatus, an information processing method, and a program.

Background Art

[0002] Conventionally, technologies related to voice dialogue services in vehicles are known. For example, in Patent Document 1, a plurality of agent function units that provide services including voice responses in response to the utterances of vehicle occupants, and when a first activation phrase individually set for each of the plurality of agent function units is uttered by a vehicle occupant, one agent function unit corresponding to the uttered first activation phrase among the plurality of agent function units is activated, and when a second activation phrase commonly set for two or more of the plurality of agent function units is uttered by a vehicle occupant, two or more agent function units corresponding to the uttered second activation phrase are activated, and a management unit is provided. An agent device is disclosed. <ooo0010>

Prior Art Documents

Patent Documents

[0003] <o000016>

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, when a plurality of VUI (Voice User Interface) functions are mounted, the user needs to have knowledge of the combination of activation phrases and the VUI functions associated with the activation phrases. Further, when the number of VUI functions increases, it becomes difficult for the user to memorize all the activation words of each agent function. Therefore, it is conceivable to make the activation phrases of each VUI function common, but in that case, when a plurality of VUI functions are activated simultaneously, the resource consumption amount increases.

[0005] In light of these circumstances, the purpose of this disclosure is to provide an in-vehicle information processing device, an information processing method, and a program that can suppress an increase in resource consumption while standardizing the activation words for each VUI function. [Means for solving the problem]

[0006] An in-vehicle information processing device according to one embodiment of the present disclosure is an in-vehicle information processing device comprising a control unit, wherein the control unit has a plurality of VUI functions that are activated with the same activation phrase, each of the plurality of VUI functions is associated with an in-vehicle function, the VUI function processes the user's utterance using speech recognition to recognize a voice command for the in-vehicle function, executes the in-vehicle function based on the voice command, and if a predetermined in-vehicle function is activated, the VUI function associated with that in-vehicle function is activated in response to the activation phrase.

[0007] An information processing method according to one embodiment of the present disclosure is an information processing method performed by an in-vehicle information processing device having a plurality of VUI functions that are activated with the same activation phrase, wherein each of the plurality of VUI functions is associated with an in-vehicle function, and the in-vehicle information processing device performs speech recognition processing of the user's utterance to recognize a voice command for the in-vehicle function, and executes the in-vehicle function based on the voice command, and if a predetermined in-vehicle function is activated, activates the VUI function associated with that in-vehicle function in response to the activation phrase.

[0008] A program according to one embodiment of the present disclosure is a program to be executed by a computer that functions as an in-vehicle information processing device having multiple VUI functions that are activated with the same activation phrase, wherein each of the multiple VUI functions is associated with an in-vehicle function, and the program causes the computer to perform speech recognition processing of the user's utterance to recognize a voice command for the in-vehicle function, and to execute the in-vehicle function based on the voice command, and, if a predetermined in-vehicle function is activated, to activate the VUI function associated with that in-vehicle function in response to the activation phrase. [Effects of the Invention]

[0009] According to this disclosure, it becomes possible to standardize the activation words for each VUI function while suppressing the increase in resource consumption. [Brief explanation of the drawing]

[0010] [Figure 1] This figure shows a schematic configuration of an in-vehicle information processing device according to the first embodiment of this disclosure. [Figure 2] This is a first flowchart showing an example of operation of the in-vehicle information processing device according to the first embodiment of this disclosure. [Figure 3] This figure shows an example of the screen displayed when the in-vehicle information processing device according to the first embodiment of this disclosure is started up. [Figure 4] This is a second flowchart showing an example of operation of the in-vehicle information processing device according to the first embodiment of this disclosure. [Figure 5] This figure shows a schematic configuration of an in-vehicle information processing device according to the second embodiment of this disclosure. [Figure 6] This figure shows an example of the screen displayed when the in-vehicle information processing device according to the second embodiment of this disclosure is started up. [Figure 7] This flowchart shows an example of the operation of an in-vehicle information processing device according to the second embodiment of this disclosure. [Figure 8] This figure shows a plurality of in-vehicle functions activated by an in-vehicle information processing device according to one embodiment of the present disclosure. [Figure 9] This figure shows an example of an in-vehicle function linked to the VUI function unit of an in-vehicle information processing device according to one embodiment of the present disclosure. [Figure 10] This flowchart shows an example of operation of an in-vehicle information processing device according to one embodiment of the present disclosure. [Modes for carrying out the invention]

[0011] The embodiments of this disclosure will be described in detail below with reference to the drawings.

[0012] <First Embodiment> Referring to Figure 1, the configuration of the in-vehicle information processing device according to the first embodiment will be described. The in-vehicle information processing device 1 shown in Figure 1 comprises an input unit 11, a control unit 12, a storage unit 13, an output unit 14, and a communication unit 15.

[0013] The in-vehicle information processing device 1 is a multimedia device installed in a vehicle and has multiple in-vehicle functions. These functions may include, for example, navigation functions, audio functions such as radio and television, information dissemination functions such as news and weather, vehicle cooperation functions for communicating with other vehicles, and functions for coordinating with smart devices (e.g., smartphones). The in-vehicle functions may also include functions for operating vehicle equipment such as air conditioning, windows, wipers, lighting, roof, and shades. The in-vehicle information processing device 1 has multiple VUI (Voice User Interface) functions that are activated with the same wake-up phrase. These multiple VUI functions are linked to in-vehicle functions, and when a predetermined in-vehicle function (typically a navigation function) is activated, the VUI function linked to that function is activated in response to the wake-up phrase. The wake-up phrase may be, for example, "Hey, Toyota!", but is not limited to this. The wake-up phrase may be changed by the user through settings.

[0014] The input unit 11 has one microphone for capturing the speech of the vehicle's occupants. The input unit 11 may also have physical keys, capacitive keys, a touch panel, or the like for receiving input from the user of the in-vehicle information processing device 1.

[0015] The storage unit 13 includes at least one semiconductor memory, at least one magnetic memory, at least one optical memory, or any combination thereof. The semiconductor memory is, for example, RAM (random access memory), ROM (read-only memory), or flash memory. The storage unit 13 functions, for example, as a main memory, auxiliary memory, or cache memory. The storage unit 13 stores information used in the operation of the in-vehicle information processing device 1 and information obtained by the operation of the in-vehicle information processing device 1.

[0016] The output unit 14 has at least one output interface. The output interface may be a display that outputs the video created by the control unit 12. Also, the output interface may be a speaker that outputs the audio created by the control unit 12. Note that the input unit 11 and the output unit 14 may be integrated like a touch screen.

[0017] The communication unit 15 has at least one communication interface for communicating with external devices such as servers and sensors. The communication interface may be an interface corresponding to a communication standard such as a LAN (Local Area Network) interface or USB (Universal Serial Bus) in the case of wired communication. The communication interface may be an interface corresponding to a mobile communication standard such as LTE (Long Term Evolution), 4G (4th generation), 5G (5th generation), or an interface corresponding to short-range wireless communication such as Bluetooth in the case of wireless communication. The communication unit 15 transmits the information created by the control unit 12 to an external device. The communication unit 15 outputs the information received from the external device to the storage unit 13.

[0018] The control unit 12 includes at least one processor, at least one programmable circuit, at least one dedicated circuit, or any combination thereof. The processor is a general-purpose processor such as a CPU (central processing unit) or GPU (graphics processing unit), or a dedicated processor specialized for specific processing. The programmable circuit is, for example, an FPGA (field-programmable gate array). The dedicated circuit is, for example, an ASIC (application specific integrated circuit). The control unit 12 executes the processing related to the operation of the in-vehicle information processing device 1 while controlling each part of the in-vehicle information processing device 1.

[0019] The control unit 12 comprises a VUI management unit 121, N VUI function units 122-k (1 ≤ k ≤ N), and N in-vehicle function execution units 123-k (1 ≤ k ≤ N). Here, N is the number of VUIs and is an integer greater than or equal to 2. In Figure 1, the number of VUIs N = 2, and the first VUI function unit 122-k is shown as the first VUI function unit 122-1 and the second VUI function unit 122-2, and the first in-vehicle function execution unit 123-k is shown as the first in-vehicle function execution unit 123-1 and the second in-vehicle function execution unit 123-2. The VUI function units 122-k and in-vehicle function execution units 123-k may all be manufactured in-house, or some may be manufactured in-house and the rest as third-party manufacturers.

[0020] The VUI management unit 121 controls the activation (on) and deactivation (off) of the VUI function unit 122-k. When the VUI function unit 122-k is activated, it first enters standby mode. Standby mode is a state in which the VUI function unit 122-k is waiting for an activation phrase. In standby mode, the microphone is always on and voice input is monitored. Also, no advanced processing is performed until an activation phrase is detected. When the VUI function unit 122-k is not activated, voice input is disabled, meaning it does not wait for an activation phrase.

[0021] The VUI function unit 122-k is activated by the same activation phrase. In this specification, "the VUI function unit 122-k is activated by the activation phrase" means that the VUI function unit 122-k detects the activation phrase and switches from standby mode to active mode. Active mode is a state in which the VUI function unit is ready to receive voice commands from the user. In active mode, natural language processing, cloud communication, etc., are used to execute the user's request. Each VUI function unit 122-k is linked to (cooperates with) an in-vehicle function. For example, suppose the first in-vehicle function is linked to the first VUI function unit 122-1, and the second in-vehicle function is linked to the second VUI function unit 122-2. In this case, if the first in-vehicle function is activated, the first VUI function unit 122-1 linked to the first in-vehicle function is activated. Similarly, if the second in-vehicle function is activated, the second VUI function unit 122-2 linked to the second in-vehicle function is activated.

[0022] The VUI function unit 122-k interacts with the user and performs agent processing such as speech recognition and natural language processing. When the VUI function unit 122-k recognizes a command (voice command) from the user for an in-vehicle function, it outputs the voice command to the in-vehicle function execution unit 123-k, thereby executing the in-vehicle function associated with the VUI function unit 122-k. Speech recognition processing may include noise reduction processing as a preprocessing step to remove background noise and other noise contained in the voice signal. The VUI function unit 122-k may utilize AI (Artificial Intelligence) for speech recognition and natural language processing. For example, the VUI function unit 122-k extracts phonemes using an acoustic model and understands the context using a language model such as an HMM (Hidden Markov Model) or N-gram. The VUI function unit 122-k may use not only a DNN-HMM model but also known models such as an End-to-End model.

[0023] The in-vehicle function execution unit 123-k executes an in-vehicle function associated with the VUI function unit 122-k based on a voice command input from the VUI function unit 122-k. The in-vehicle function execution unit 123-k may also execute an in-vehicle function associated with the VUI function unit 122-k based on an operation command input by the user by operating the input unit 11. That is, the first in-vehicle function execution unit 123-1 executes an in-vehicle function associated with the first VUI function unit 122-1, and the second in-vehicle function execution unit 123-2 executes an in-vehicle function associated with the second VUI function unit 122-2. There may be one or more in-vehicle functions associated with the VUI function unit 122-k. For example, the in-vehicle function associated with the first VUI function unit 122-1 may be a proprietary navigation application, and the in-vehicle function associated with the second VUI function unit 122-2 may be a navigation application from another company. For example, the in-vehicle function linked to the first VUI function unit 122-1 may be an in-vehicle function that has a significant impact on vehicle safety, while the in-vehicle function linked to the second VUI function unit 122-2 may be an in-vehicle function that does not have a significant impact on vehicle safety or an in-vehicle function from another company.

[0024] Next, an example of the operation of a vehicle equipped with the in-vehicle information processing device 1 according to the first embodiment will be described. Figure 2 is a flowchart showing an example of operation when the user of the in-vehicle information processing device 1 switches in-vehicle functions between the startup and shutdown of the in-vehicle information processing device 1.

[0025] In S101, when the ignition power is turned on, the in-vehicle information processing unit 1 starts up. In S102, the vehicle starts moving.

[0026] In S103, the control unit 12 activates a predetermined in-vehicle function (for example, a proprietary navigation application) as the default setting.

[0027] In S104, the VUI management unit 121 activates the VUI function unit 122-k associated with the in-vehicle function activated in S103 and puts it into standby mode. Here, it is assumed that the first VUI function unit 122-1 is activated.

[0028] In S105, the user operates the input unit 11 (for example, by touching an icon on the touchscreen) to issue a command to switch in-vehicle functions. That is, the control unit 12 receives a command to switch in-vehicle functions from the input unit 11. The control unit 12 then terminates the currently running in-vehicle function and starts a new in-vehicle function based on the switching command.

[0029] In S106, the VUI management unit 121 determines whether the in-vehicle function switched in S105 is an in-vehicle function associated with the first VUI function unit 122-1. If the switched in-vehicle function is an in-vehicle function associated with the first VUI function unit 122-1, the VUI management unit 121 proceeds to S107. If the switched in-vehicle function is an in-vehicle function associated with the second VUI function unit 122-2, the VUI management unit 121 proceeds to S109. The processes from S105 to S110 can be repeated.

[0030] In S107, if the first VUI function unit 122-1 is running, no processing is performed. If the processing from S105 to S110 is repeated, and the first VUI function unit 122-1 is turned off during that process, the VUI management unit 121 starts the first VUI function unit 122-1 and puts it into standby mode.

[0031] In S108, if the second VUI function unit 122-2 is off, no processing is performed. If the processing from S105 to S110 is repeated and the second VUI function unit 122-2 is activated during that process, the VUI management unit 121 terminates the second VUI function unit 122-2 and puts it into a deactivated state.

[0032] In S109, the VUI management unit 121 activates the second VUI function unit 122-2 and puts it into standby mode. If the process from S105 to S110 is repeated and the second VUI function unit 122-2 is turned on during that process, no processing is performed.

[0033] In S110, the VUI management unit 121 terminates the first VUI function unit 122-1 and puts it into a non-started state. If the process from S105 to S110 is repeated and the first VUI function unit 122-1 is turned off during that process, no processing is performed.

[0034] In S111, when the ignition power is turned off, the in-vehicle information processing unit 1 terminates processing.

[0035] Figure 2 shows an example where the in-vehicle information processing device 1 starts up with default settings for the in-vehicle functions, but it is not always necessary for the in-vehicle functions to be set to default settings. For example, as shown in Figure 3, the in-vehicle information processing device 1 may display multiple icons for in-vehicle functions on a screen such as a touchscreen when it starts up, allowing the user to select an in-vehicle function. Figure 3 shows an example where icons A and B for two in-vehicle functions are displayed.

[0036] Figure 4 is a flowchart showing an example of operation when a user selects an in-vehicle function when the in-vehicle information processing device 1 is started up. There is no limit to the number of in-vehicle functions, but for example, there are two in-vehicle functions, with the first in-vehicle function linked to the first VUI function unit 122-1 and the second in-vehicle function linked to the second VUI function unit 122-2.

[0037] In the S201, when the ignition power is turned on, the in-vehicle information processing unit 1 starts up.

[0038] In S202, the user of the in-vehicle information processing device 1 operates the input unit 11 (for example, by touching an icon on the touchscreen) to input a command to activate an in-vehicle function. In other words, the control unit 12 receives the command to activate an in-vehicle function from the input unit 11. Then, the control unit 12 activates a new in-vehicle function based on the activation command.

[0039] In S203, the VUI management unit 121 determines whether the in-vehicle function activated in S202 is an in-vehicle function associated with the first VUI function unit 122-1. If the in-vehicle function activated in S202 is an in-vehicle function associated with the first VUI function unit 122-1, the VUI management unit 121 proceeds to S204. If the in-vehicle function activated in S202 is an in-vehicle function associated with the second VUI function unit 122-2, the VUI management unit 121 proceeds to S206. The processing from S202 to S207 can be repeated.

[0040] In S204, the VUI management unit 121 activates the first VUI function unit 122-1 and puts it into standby mode.

[0041] In S205, if the second VUI function unit 122-2 is off, no processing is performed. If the processing from S202 to S207 is repeated and the second VUI function unit 122-2 is turned on during that process, the VUI management unit 121 terminates the second VUI function unit 122-2 and puts it into a deactivated state.

[0042] In S206, the VUI management unit 121 activates the second VUI function unit 122-2 and puts it into standby mode.

[0043] In S207, if the first VUI function unit 122-1 is off, no processing is performed. If the processing from S202 to S207 is repeated, and the first VUI function unit 122-1 is turned on during that process, the VUI management unit 121 terminates the first VUI function unit 122-1 and puts it into a deactivated state.

[0044] In the S208, when the ignition power is turned off, the in-vehicle information processing unit 1 terminates its processing.

[0045] <Second Embodiment> Next, an in-vehicle information processing device according to the second embodiment will be described. The in-vehicle information processing device 1a shown in Figure 5 comprises an input unit 11, a control unit 12a, a storage unit 13, an output unit 14, and a communication unit 15. The operation of the control unit 12a differs from that of the in-vehicle information processing device 1 shown in Figure 1. The other components have the same configuration as the in-vehicle information processing device 1, so their explanation will be omitted.

[0046] In the in-vehicle information processing device 1 shown in Figure 1, the number of VUIs N=2 is the same as in the in-vehicle information processing device 1a, which differs from the in-vehicle information processing device 1 in that the number of VUIs N=3. Specifically, the control unit 12a comprises a VUI management unit 121, a VUI function unit 122-k (first VUI function unit 122-1, second VUI function unit 122-2, and third VUI function unit 122-3), and an in-vehicle function execution unit 123-k (first in-vehicle function execution unit 123-1, second in-vehicle function execution unit 123-2, and third in-vehicle function execution unit 123-3).

[0047] Figure 3 shows an example where there are two in-vehicle functions, but there may be three or more in-vehicle functions. For example, as shown in Figure 6, the in-vehicle information processing device 1 may display icons A, B, and C for three in-vehicle functions on a screen such as a touchscreen when it starts up.

[0048] Figure 7 is a flowchart showing an example of operation when a user selects an in-vehicle function when the in-vehicle information processing device 1a is started. There is no limit to the number of in-vehicle functions, but for example, there are three in-vehicle functions, with the first in-vehicle function linked to the first VUI function unit 122-1, the second in-vehicle function linked to the second VUI function unit 122-2, and the third in-vehicle function linked to the third VUI function unit 122-3.

[0049] In the S301, when the ignition power is turned on, the in-vehicle information processing unit 1 starts up.

[0050] In S302, the user operates the input unit 11 to input a command to activate an in-vehicle function. The control unit 12 then activates the in-vehicle function based on the activation command.

[0051] In S303, the VUI management unit 121 determines whether the in-vehicle function activated in S302 is an in-vehicle function linked to the first VUI function unit 122-1. If the in-vehicle function activated in S302 is an in-vehicle function linked to the first VUI function unit 122-1, the VUI management unit 121 proceeds to S304. If the in-vehicle function activated in S302 is not an in-vehicle function linked to the first VUI function unit 122-1, the VUI management unit 121 proceeds to S306. The processing from S302 to S310 can be repeated.

[0052] In S304, the VUI management unit 121 activates the first VUI function unit 122-1 and puts it into standby mode.

[0053] In S305, if the second VUI function unit 122-2 and the third VUI function unit 122-3 are off, no processing is performed. If the processing from S302 to S310 is repeated, and either the second VUI function unit 122-2 or the third VUI function unit 122-3 is turned on during that process, the VUI management unit 121 terminates the turned-on second VUI function unit 122-2 or the third VUI function unit 122-3 and puts it into a deactivated state.

[0054] In S306, the VUI management unit 121 determines whether the in-vehicle function activated in S302 is an in-vehicle function linked to the second VUI function unit 122-2. If the activated in-vehicle function is an in-vehicle function linked to the second VUI function unit 122-2, the VUI management unit 121 proceeds to S307. If the activated in-vehicle function is not an in-vehicle function linked to the second VUI function unit 122-2, the VUI management unit 121 proceeds to S309.

[0055] In S307, the VUI management unit 121 activates the second VUI function unit 122-2 and puts it into standby mode.

[0056] In S308, if the first VUI function unit 122-1 and the third VUI function unit 122-3 are off, no processing is performed. If the processing from S302 to S310 is repeated, and either the first VUI function unit 122-1 or the third VUI function unit 122-3 is turned on during that process, the VUI management unit 121 terminates the turned-on first VUI function unit 122-1 or the third VUI function unit 122-3 and puts it into a deactivated state.

[0057] In S309, the VUI management unit 121 activates the third VUI function unit 122-3 and puts it into standby mode.

[0058] In S310, if the first VUI function unit 122-1 and the second VUI function unit 122-2 are off, no processing is performed. If the processing from S302 to S310 is repeated, and either the first VUI function unit 122-1 or the second VUI function unit 122-2 is turned on during that process, the VUI management unit 121 terminates the turned-on first VUI function unit 122-1 or the second VUI function unit 122-2 and puts it into a deactivated state.

[0059] In S311, when the ignition power is turned off, the in-vehicle information processing unit 1 terminates processing.

[0060] In the above example, one in-vehicle function was associated with each VUI function unit 122-k, but multiple in-vehicle functions may be associated with a single VUI function unit 122-k. Furthermore, multiple in-vehicle functions may be able to be started simultaneously. For example, as shown in Figure 8, the in-vehicle functions associated with the VUI function unit 122-k are a navigation application and an audio application that plays audio (streaming) in the background of the navigation application, and the navigation application and the audio application may be able to be started simultaneously.

[0061] As shown in Figure 9, the first VUI function unit 122-1 may be associated with a first navigation application and a first voice application as multiple in-vehicle functions, and the first navigation application and the first voice application may be able to be started simultaneously. Similarly, the second VUI function unit 122-2 may be associated with a second navigation application and a second voice application as multiple in-vehicle functions, and the second navigation application and the second voice application may be able to be started simultaneously. It may also be possible to start the first VUI function unit 122-1 and the first navigation application and the second voice application simultaneously, or to start the second VUI function unit 122-2 and the second navigation application and the first voice application simultaneously. Furthermore, when multiple in-vehicle functions can be started simultaneously, a priority may be set in advance for each in-vehicle function. The priority may also be changeable by the user. The priority may be stored in the storage unit 13.

[0062] In the example shown in Figure 9, the priority of the first navigation application is set high, and the priority of the first voice application is set low. Similarly, the priority of the second navigation application is set high, and the priority of the second voice application is set low. Priorities can be set numerically, and higher priority values ​​may be larger.

[0063] Figure 10 is a flowchart illustrating an example of operation when a user selects an in-vehicle function during startup of the in-vehicle information processing unit 1,1a. Here, it is assumed that the in-vehicle information processing unit 1,1a has the in-vehicle functions shown in Figure 9, and that each in-vehicle function has a priority assigned to it.

[0064] In the S401, when the ignition power is turned on, the in-vehicle information processing unit 1,1a starts up.

[0065] In S402, the user operates the input unit 11 and requests the launch of the first navigation application. The control units 12 and 12a then launch the first navigation application selected by the user.

[0066] In S403, the VUI management unit 121 activates the first VUI function unit 122-1, which is linked to the first navigation application, and puts it into standby mode.

[0067] In S404, the user operates the input unit 11 and requests the activation of the second voice application. The control units 12 and 12a then activate the second voice application requested by the user.

[0068] In S405, the VUI management unit 121 compares the priorities of the first navigation application and the second voice application. Here, as shown in Figure 9, the priority of the first navigation application is assumed to be higher than the priority of the second voice application.

[0069] In S406, the VUI management unit 121 maintains the active state of the first VUI function unit 122-1 without activating the second VUI function unit 122-2 because the first navigation application has a higher priority. In other words, when activating multiple in-vehicle functions linked to multiple VUI function units 122-k simultaneously, the VUI management unit 121 activates the VUI function unit 122-k linked to the in-vehicle function with the highest priority.

[0070] In S407, when the ignition power is turned off, the in-vehicle information processing unit 1 terminates processing.

[0071] The above embodiments described the cases where the number of VUIs N is 2 and 3, but it is clear that similar processing can be performed even when N is 4 or more. Furthermore, the operation is not limited to the above examples. As described above, multiple VUI functions of the in-vehicle information processing device 1,1a are activated with the same activation phrase. Therefore, the user does not need to have knowledge of the combination of activation phrases and the VUI functions associated with those activation phrases, nor does it need to memorize multiple activation phrases, thereby improving the operability of the in-vehicle functions. In addition, the in-vehicle information processing device 1,1a can be equipped with a large number of VUI functions. For example, in order to support different languages ​​in each country and region, the in-vehicle information processing device 1,1a may be equipped with different VUI functions for each language, or it may be equipped with VUI functions from vendors that are proficient in that language. Furthermore, since the user can operate various in-vehicle functions by voice without taking their eyes off the road by using multiple VUI functions, it is possible to improve safety while driving.

[0072] Furthermore, when a predetermined in-vehicle function is activated, the in-vehicle information processing device 1,1a activates only the VUI function associated with that in-vehicle function in response to the activation phrase. In other words, only the VUI function associated with the in-vehicle function remains in a standby state, while other VUI functions remain in a non-standby state, so only the VUI function associated with the in-vehicle function awaits the activation phrase. As a result, resources are optimized, and the in-vehicle information processing device 1,1a can suppress an increase in resource consumption. In addition, it becomes possible to equip systems with limited resources (for example, navigation systems) with multiple VUI functions (for example, VUI functions optimized for each language). Moreover, since the in-vehicle information processing device 1,1a does not activate multiple VUI functions simultaneously, it is possible to prevent the occurrence of task dispatch due to parallel processing, which would increase processing time.

[0073] Furthermore, when the in-vehicle information processing unit 1,1a attempts to simultaneously activate multiple in-vehicle functions linked to multiple VUI functions, it activates the VUI function linked to the in-vehicle function with the highest priority. Therefore, when attempting to simultaneously activate multiple in-vehicle functions linked to different VUI functions, it becomes possible to appropriately determine which VUI function to activate.

[0074] <Program> To enable the above-described in-vehicle information processing devices 1 and 1a to function, it is also possible to use a computer capable of executing program instructions. The program can cause the computer to perform the operations described above, thereby enabling the computer to function as an in-vehicle information processing device 1 and 1a.

[0075] The program can be stored on a non-temporary computer-readable medium. Examples of non-temporary computer-readable media include flash memory, magnetic recording devices, optical discs, magneto-optical recording media, or ROM. The program can be distributed, for example, by selling, transferring, or leasing portable media such as SD (Secure Digital) cards, DVDs (digital versatile discs), or CD-ROMs (compact disc read-only memory) on which the program is stored. The program may also be distributed by storing it in server storage and transferring it from the server to other computers. The program may also be provided as a program product.

[0076] The computer, for example, stores a program stored on a portable medium or a program transferred from a server in the storage unit 13. Then, the computer reads the program stored in the storage unit 13 with the processor (control unit 12) and executes processing according to the read program in the processor. The processor may be a CPU (central processing unit), MPU (Micro Processing Unit), SoC (System on a Chip), etc., and may be composed of multiple processors of the same or different types.

[0077] A computer may read a program directly from a portable medium and execute processing according to the program. A computer may also execute processing according to the received program sequentially each time a program is transferred to the computer from a server. Processing may also be performed by a so-called ASP (application service provider) type service, which does not transfer programs from the server to the computer, but realizes its function only through execution instructions and result retrieval. A program includes information used for processing by an electronic computer that is equivalent to a program. For example, data that is not a direct instruction to the computer but has the nature of defining the computer's processing falls under "equivalent to a program."

[0078] Although the embodiments described above are representative examples, various modifications or changes are possible without departing from the spirit of this disclosure. For example, multiple component blocks or processing steps described in the embodiments can be combined into one, or one can be divided into multiple.

[0079] Some embodiments of the present disclosure are described below. However, it should be noted that the embodiments of the present disclosure are not limited to these. [Note 1] An in-vehicle information processing device comprising a control unit, The control unit has multiple VUI functions that are activated with the same activation phrase, Each of the aforementioned VUI functions is linked to an in-vehicle function. The VUI function processes user speech using speech recognition to recognize voice commands for in-vehicle functions and executes the in-vehicle functions based on those voice commands. An in-vehicle information processing device that, when a specified in-vehicle function is activated, activates a VUI function associated with that in-vehicle function in response to an activation phrase. [Note 2] An in-vehicle information processing device having multiple VUI functions that are activated with the same startup phrase, Each of the aforementioned VUI functions is linked to an in-vehicle function. An in-vehicle information processing device that, when a specified in-vehicle function is activated, activates a VUI function associated with that in-vehicle function in response to an activation phrase. [Note 3] When a command to switch in-vehicle functions is input, a new in-vehicle function is activated based on that command. An in-vehicle information processing device as described in Appendix 1 or 2, which activates a VUI function linked to a newly activated in-vehicle function and terminates other VUI functions. [Note 4] An in-vehicle information processing device according to any one of the appendices 1 to 3, wherein at least one of the VUI functions is linked to multiple in-vehicle functions. [Note 5] An in-vehicle information processing device according to Appendix 4, which simultaneously activates multiple in-vehicle functions linked to at least one of the aforementioned VUI functions. [Note 6] The in-vehicle information processing device described in Appendix 5, wherein each of the aforementioned multiple in-vehicle functions is assigned a priority. [Note 7] In the case of simultaneously activating multiple in-vehicle functions associated with the multiple VUI functions, the in-vehicle information processing device described in Appendix 6 activates the VUI function associated with the in-vehicle function with the highest priority. [Note 8] An information processing method executed by an in-vehicle information processing device having multiple VUI functions that are activated with the same startup phrase, Each of the aforementioned VUI functions is linked to an in-vehicle function. The in-vehicle information processing device, The system processes user speech using speech recognition to recognize voice commands for in-vehicle functions and executes those functions based on those voice commands. If a specified in-vehicle function is activated, the activation phrase will activate the VUI function associated with that in-vehicle function, An information processing method that performs [this action]. [Note 9] An information processing method executed by an in-vehicle information processing device having multiple VUI functions that are activated with the same startup phrase, Each of the aforementioned VUI functions is linked to an in-vehicle function. The in-vehicle information processing device, If a specified in-vehicle function is activated, the activation phrase will activate the VUI function associated with that in-vehicle function. An information processing method that performs [this action]. [Note 10] The in-vehicle information processing device, When a command to switch in-vehicle functions is input, the system will activate a new in-vehicle function based on that command. This involves activating a VUI function linked to a newly activated in-vehicle function, and terminating other VUI functions. The information processing method described in Appendix 8 or 9, which performs the following: [Note 11] An information processing method according to any one of the appendices 8 to 10, wherein at least one of the VUI functions is linked to multiple in-vehicle functions. [Note 12] The in-vehicle information processing device, To simultaneously activate multiple in-vehicle functions linked to at least one of the aforementioned VUI functions. The information processing method described in Appendix 11, which executes the above. [Note 13] The information processing method described in Appendix 12, wherein each of the aforementioned multiple in-vehicle functions is assigned a priority. [Note 14] The in-vehicle information processing device, When activating multiple in-vehicle functions linked to the aforementioned multiple VUI functions simultaneously, the VUI function linked to the in-vehicle function with the highest priority will be activated. The information processing method described in Appendix 13, which executes the above. [Note 15] A program to be executed on a computer that functions as an in-vehicle information processing device having multiple VUI functions that are started with the same startup phrase, Each of the aforementioned VUI functions is linked to an in-vehicle function. To the aforementioned computer, The system processes user speech using speech recognition to recognize voice commands for in-vehicle functions and executes those functions based on those voice commands. If a specified in-vehicle function is activated, the activation phrase will activate the VUI function associated with that in-vehicle function, A program to execute. [Note 16] A program to be executed on a computer that functions as an in-vehicle information processing device having multiple VUI functions that are started with the same startup phrase, Each of the aforementioned VUI functions is linked to an in-vehicle function. To the aforementioned computer, If a specified in-vehicle function is activated, the activation phrase will activate the VUI function associated with that in-vehicle function. A program to execute. [Note 17] To the aforementioned computer, When a command to switch in-vehicle functions is input, the system will activate a new in-vehicle function based on that command. This involves activating a VUI function linked to a newly activated in-vehicle function, and terminating other VUI functions. A program described in Appendix 15 or 16 for executing the program. [Note 18] At least one of the VUI functions is a program as described in any of the appendices 15 to 17, which is linked to multiple in-vehicle functions. [Note 19] To the aforementioned computer, To simultaneously activate multiple in-vehicle functions linked to at least one of the aforementioned VUI functions. The program described in Appendix 18 for executing this program. [Note 20] Each of the aforementioned multiple in-vehicle functions is assigned a priority level. To the aforementioned computer, When activating multiple in-vehicle functions linked to the aforementioned multiple VUI functions simultaneously, the VUI function linked to the in-vehicle function with the highest priority will be activated. The program described in Appendix 19 for executing this program. [Explanation of symbols]

[0080] 1,1a In-vehicle information processing device 11 Input section 12,12a Control Unit 13 Storage section 14 Output section 15 Communications Department 121 VUI Management Department 122-1 1st VUI function section 122-2 2nd VUI function section 122-3 3rd VUI function section 123-1 First In-Vehicle Function Execution Unit 123-2 Second In-Vehicle Function Execution Unit 123-3 Third In-Vehicle Function Execution Unit

Claims

1. An in-vehicle information processing device comprising a control unit, The control unit has multiple VUI functions that are activated with the same activation phrase, Each of the aforementioned VUI functions is linked to an in-vehicle function. The VUI function processes user speech using speech recognition to recognize voice commands for in-vehicle functions and executes the in-vehicle functions based on those voice commands. An in-vehicle information processing device that, when a predetermined in-vehicle function is activated, activates a VUI function associated with that in-vehicle function in response to an activation phrase.

2. An in-vehicle information processing device having multiple VUI functions that are activated with the same startup phrase, Each of the aforementioned VUI functions is linked to an in-vehicle function. An in-vehicle information processing device that, when a predetermined in-vehicle function is activated, activates a VUI function associated with that in-vehicle function in response to an activation phrase.

3. When a command to switch in-vehicle functions is input, a new in-vehicle function is activated based on that command. The in-vehicle information processing device according to claim 2, which activates a VUI function linked to a newly activated in-vehicle function and terminates other VUI functions.

4. The in-vehicle information processing device according to claim 2, wherein at least one of the VUI functions is linked to a plurality of in-vehicle functions.

5. The in-vehicle information processing device according to claim 4, which simultaneously activates multiple in-vehicle functions linked to at least one of the VUI functions.

6. The in-vehicle information processing device according to claim 5, wherein each of the plurality of in-vehicle functions is assigned a priority.

7. In the case of simultaneously activating multiple in-vehicle functions associated with the multiple VUI functions, the in-vehicle information processing device according to claim 6 activates the VUI function associated with the in-vehicle function with the highest priority.

8. An information processing method executed by an in-vehicle information processing device having multiple VUI functions that are activated with the same startup phrase, Each of the aforementioned VUI functions is linked to an in-vehicle function. The in-vehicle information processing device, The system processes user speech using speech recognition to recognize voice commands for in-vehicle functions and executes those functions based on those voice commands. If a specified in-vehicle function is activated, the activation phrase will activate the VUI function associated with that in-vehicle function, An information processing method that performs [this action].

9. An information processing method executed by an in-vehicle information processing device having multiple VUI functions that are activated with the same startup phrase, Each of the aforementioned VUI functions is linked to an in-vehicle function. The in-vehicle information processing device, If a specified in-vehicle function is activated, the activation phrase should be used to activate the VUI function associated with that in-vehicle function. An information processing method that performs [this action].

10. The in-vehicle information processing device, When a command to switch in-vehicle functions is input, the system will activate a new in-vehicle function based on that command. This involves activating a VUI function linked to a newly activated in-vehicle function, and terminating other VUI functions. The information processing method according to claim 9, which performs the following.

11. The information processing method according to claim 9, wherein at least one of the VUI functions is linked to a plurality of in-vehicle functions.

12. The in-vehicle information processing device, To simultaneously activate multiple in-vehicle functions linked to at least one of the aforementioned VUI functions. The information processing method according to claim 11, which performs the following.

13. The information processing method according to claim 12, wherein each of the multiple in-vehicle functions is assigned a priority.

14. The in-vehicle information processing device, When activating multiple in-vehicle functions linked to the aforementioned multiple VUI functions simultaneously, the VUI function linked to the in-vehicle function with the highest priority will be activated. The information processing method according to claim 13, which performs the following.

15. A program to be executed on a computer that functions as an in-vehicle information processing device having multiple VUI functions that are started with the same startup phrase, Each of the aforementioned VUI functions is linked to an in-vehicle function. To the aforementioned computer, The system processes user speech using speech recognition to recognize voice commands for in-vehicle functions and executes those functions based on those voice commands. If a specified in-vehicle function is activated, the activation phrase will activate the VUI function associated with that in-vehicle function, A program to execute.

16. A program to be executed on a computer that functions as an in-vehicle information processing device having multiple VUI functions that are started with the same startup phrase, Each of the aforementioned VUI functions is linked to an in-vehicle function. To the aforementioned computer, If a specified in-vehicle function is activated, the activation phrase should be used to activate the VUI function associated with that in-vehicle function. A program to execute.

17. To the aforementioned computer, When a command to switch in-vehicle functions is input, the system will activate a new in-vehicle function based on that command. This involves activating a VUI function linked to a newly activated in-vehicle function, and terminating other VUI functions. The program according to claim 16 for causing the execution of the program.

18. The program according to claim 16, wherein at least one of the VUI functions is associated with a plurality of in-vehicle functions.

19. To the aforementioned computer, To simultaneously activate multiple in-vehicle functions linked to at least one of the aforementioned VUI functions. A program according to claim 18 for causing the execution of the following:

20. Each of the aforementioned multiple in-vehicle functions is assigned a priority level. To the aforementioned computer, When activating multiple in-vehicle functions linked to the aforementioned multiple VUI functions simultaneously, the VUI function linked to the in-vehicle function with the highest priority will be activated. A program according to claim 19 for causing the execution of the following.

Images