In-vehicle information processing device, information processing method, and program

Abstract

The activation words for each VUI (Voice User Interface) function will be standardized while improving resource utilization efficiency. [Solution] The in-vehicle information processing device (1) includes a control unit (12) having multiple VUI functions that are activated with the same activation phrase. Each of the multiple VUI functions is associated with an in-vehicle function. The VUI function processes the user's speech using speech recognition to recognize voice commands for the in-vehicle function, and executes the in-vehicle function based on the voice command. If a predetermined in-vehicle function is activated, the VUI function associated with that in-vehicle function is activated, and other VUI functions perform predetermined operations even while that VUI function is activated.

Description

Technical Field

[0001] The present disclosure relates to an in-vehicle information processing apparatus, an information processing method, and a program.

Background Art

[0002] Conventionally, technologies related to voice dialogue services in vehicles are known. For example, in Patent Document 1, a plurality of agent functional units that provide services including voice responses in response to the utterance of a vehicle occupant, and when a first activation phrase individually set for each of the plurality of agent functional units is uttered by a vehicle occupant, one agent functional unit corresponding to the uttered first activation phrase among the plurality of agent functional units is activated, and when a second activation phrase commonly set for two or more of the plurality of agent functional units is uttered by a vehicle occupant, a management unit that activates two or more agent functional units corresponding to the uttered second activation phrase is disclosed.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, when a plurality of VUI (Voice User Interface) functions are mounted, the user needs to have knowledge of the combination of the activation phrase and the VUI function associated with the activation phrase. Further, when the number of VUI functions increases, it becomes difficult for the user to memorize all the activation words of each agent function. Therefore, it is conceivable to make the activation phrases of each VUI function common, but in that case, if each VUI function is individually corresponded, the resource utilization efficiency deteriorates.

[0005] In light of these circumstances, the purpose of this disclosure is to provide an in-vehicle information processing device, an information processing method, and a program that can improve resource utilization efficiency while standardizing the activation words for each VUI function. [Means for solving the problem]

[0006] An in-vehicle information processing device according to one embodiment of the present disclosure is an in-vehicle information processing device comprising a control unit, wherein the control unit has a plurality of VUI functions that are activated with the same activation phrase, each of the plurality of VUI functions is associated with an in-vehicle function, the VUI function processes the user's utterance using speech recognition to recognize a voice command for the in-vehicle function, executes the in-vehicle function based on the voice command, and when a predetermined in-vehicle function is activated, the VUI function associated with that in-vehicle function is activated, and other VUI functions perform predetermined operations even while the VUI function is activated.

[0007] An information processing method according to one embodiment of the present disclosure is an information processing method executed by an in-vehicle information processing device having a plurality of VUI functions that are activated with the same activation phrase, wherein each of the plurality of VUI functions is associated with an in-vehicle function, and the in-vehicle information processing device performs speech recognition processing of the user's utterance to recognize a voice command for the in-vehicle function and executes the in-vehicle function based on the voice command, and if a predetermined in-vehicle function is activated, it activates the VUI function associated with that in-vehicle function and performs predetermined operations even while the VUI function is activated.

[0008] A program according to one embodiment of the present disclosure is a program to be executed by a computer that functions as an in-vehicle information processing device having multiple VUI functions that are activated with the same activation phrase, wherein each of the multiple VUI functions is associated with an in-vehicle function, and the program causes the computer to perform speech recognition processing of the user's utterance to recognize a voice command for the in-vehicle function, and to execute the in-vehicle function based on the voice command, and, if a predetermined in-vehicle function is activated, to activate the VUI function associated with that in-vehicle function, and to perform predetermined operations even while the VUI function is activated, other VUI functions perform predetermined operations. [Effects of the Invention]

[0009] According to this disclosure, it will be possible to improve resource utilization efficiency while standardizing the activation words for each VUI function. [Brief explanation of the drawing]

[0010] [Figure 1] This figure shows a schematic configuration of an in-vehicle information processing device according to the first embodiment of this disclosure. [Figure 2] This is a first flowchart showing an example of operation of the in-vehicle information processing device according to the first embodiment of this disclosure. [Figure 3] Figure 2 shows the priority of VUI functions during operation. [Figure 4] This is a second flowchart showing an example of operation of the in-vehicle information processing device according to the first embodiment of this disclosure. [Figure 5] This figure shows a plurality of in-vehicle functions activated by an in-vehicle information processing device according to the first embodiment of this disclosure. [Figure 6] This is a third flowchart showing an example of operation of the in-vehicle information processing device according to the first embodiment of this disclosure. [Figure 7] This figure shows the priority of VUI functions during operation as shown in Figure 6. [Figure 8] This is a fourth flowchart showing an example of operation of the in-vehicle information processing device according to the first embodiment of this disclosure. [Figure 9]This figure shows a schematic configuration of an in-vehicle information processing device according to the second embodiment of this disclosure. [Figure 10] This is a first flowchart showing an example of operation of the in-vehicle information processing device according to the second embodiment of this disclosure. [Figure 11] Figure 10 shows the priority of VUI functions during operation. [Figure 12] This is a second flowchart showing an example of operation of the in-vehicle information processing device according to the second embodiment of this disclosure. [Figure 13] Figure 12 shows the priority of VUI functions during operation. [Modes for carrying out the invention]

[0011] The embodiments of this disclosure will be described in detail below with reference to the drawings.

[0012] <First Embodiment> Referring to Figure 1, the configuration of the in-vehicle information processing device according to the first embodiment will be described. The in-vehicle information processing device 1 shown in Figure 1 comprises an input unit 11, a control unit 12, a storage unit 13, an output unit 14, and a communication unit 15.

[0013] The in-vehicle information processing device 1 is a multimedia device mounted on a vehicle and has a plurality of in-vehicle functions. The in-vehicle functions may be, for example, a navigation function, an audio function such as radio and television, an information transmission function such as news and weather, a vehicle cooperation function for communicating with other vehicles, a cooperation function with a smart device (e.g., a smartphone), etc. Further, the in-vehicle function may be a function for operating vehicle equipment such as an air conditioner, windows, wipers, lighting, a roof, and a shade. The in-vehicle information processing device 1 has a plurality of VUI (Voice User Interface) functions that are activated by the same wake-up phrase. The plurality of VUI functions are associated with the in-vehicle functions. When a predetermined in-vehicle function (typically, the navigation function) is activated, the VUI function associated with the predetermined in-vehicle function is activated, but other VUI functions perform a predetermined operation even during the activation of the VUI. The wake-up phrase is, for example, "Hey, Toyota!", but is not limited thereto. The wake-up phrase may be changeable by the user through settings.

[0014] The input unit 11 has one microphone for picking up the speech of the vehicle occupants. Further, the input unit 11 may have a physical key, a capacitance key, a touch panel, etc., for receiving an input from the user of the in-vehicle information processing device 1.

[0015] The storage unit 13 includes at least one semiconductor memory, at least one magnetic memory, at least one optical memory, or any combination thereof. The semiconductor memory is, for example, a RAM (random access memory), a ROM (read only memory), or a flash memory. The storage unit 13 functions as, for example, a main memory device, an auxiliary memory device, or a cache memory. The storage unit 13 stores information used for the operation of the in-vehicle information processing device 1 and information obtained by the operation of the in-vehicle information processing device 1.

[0016] The output unit 14 has at least one output interface. The output interface may be a display that outputs the video created by the control unit 12. Also, the output interface may be a speaker that outputs the audio created by the control unit 12. Note that the input unit 11 and the output unit 14 may be integrated like a touch screen.

[0017] The communication unit 15 has at least one communication interface for communicating with external devices such as servers and sensors. The communication interface may be an interface corresponding to a communication standard such as a LAN (Local Area Network) interface or USB (Universal Serial Bus) in the case of wired communication. The communication interface may be an interface corresponding to a mobile communication standard such as LTE (Long Term Evolution), 4G (4th generation), 5G (5th generation), or an interface corresponding to short-range wireless communication such as Bluetooth in the case of wireless communication. The communication unit 15 transmits the information created by the control unit 12 to an external device. The communication unit 15 outputs the information received from the external device to the storage unit 13.

[0018] The control unit 12 includes at least one processor, at least one programmable circuit, at least one dedicated circuit, or any combination thereof. The processor is a general-purpose processor such as a CPU (central processing unit) or GPU (graphics processing unit), or a dedicated processor specialized for specific processing. The programmable circuit is, for example, an FPGA (field-programmable gate array). The dedicated circuit is, for example, an ASIC (application specific integrated circuit). The control unit 12 executes the processing related to the operation of the in-vehicle information processing device 1 while controlling each part of the in-vehicle information processing device 1.

[0019] The control unit 12 comprises a VUI management unit 121, N VUI function units 122-k (1 ≤ k ≤ N), and N in-vehicle function execution units 123-k (1 ≤ k ≤ N). Here, N is the number of VUIs and is an integer greater than or equal to 2. In Figure 1, the number of VUIs N = 2, and the first VUI function unit 122-k is shown as the first VUI function unit 122-1 and the second VUI function unit 122-2, and the first in-vehicle function execution unit 123-k is shown as the first in-vehicle function execution unit 123-1 and the second in-vehicle function execution unit 123-2. The VUI function units 122-k and the in-vehicle function execution units 123-k may all be manufactured in-house, or some may be manufactured in-house and the rest as third-party manufacturers.

[0020] The VUI management unit 121 controls the activation (on) and deactivation (off) of the VUI function units 122-k. The VUI management unit 121 also determines the priority of activation phrase recognition authority (authority to recognize activation phrases) for each VUI function unit 122-k. The VUI management unit 121 grants activation phrase recognition authority to the VUI function unit 122-k with the highest priority of activation phrase recognition authority (hereinafter also simply referred to as "priority"). The VUI function unit 122-k that has activation phrase recognition authority has the authority to recognize user utterances following the activation phrase. The priority may be stored in the storage unit 13.

[0021] The VUI function units 122-k are activated with the same activation phrase. Each VUI function unit 122-k is linked to (coordinates with) an in-vehicle function. For example, suppose the first in-vehicle function is linked to the first VUI function unit 122-1, and the second in-vehicle function is linked to the second VUI function unit 122-2. In this case, if the first in-vehicle function is activated, the first VUI function unit 122-1, which is linked to the first in-vehicle function, is activated, but the second VUI function unit 122-2 also performs its predetermined operation while the first VUI function unit 122-1 is activated. Similarly, if the second in-vehicle function is activated, the second VUI function unit 122-2, which is linked to the second in-vehicle function, is activated, but the first VUI function unit 122-1 also performs its predetermined operation while the second VUI function unit 122-2 is activated.

[0022] The VUI function unit 122-k interacts with the user and performs agent processing such as speech recognition and natural language processing. When the VUI function unit 122-k recognizes a command (voice command) from the user for an in-vehicle function, it outputs the voice command to the in-vehicle function execution unit 123-k, thereby executing the in-vehicle function associated with the VUI function unit 122-k. Speech recognition processing may include noise reduction processing as a preprocessing step to remove background noise and other noise contained in the voice signal. The VUI function unit 122-k may utilize AI (Artificial Intelligence) for speech recognition and natural language processing. For example, the VUI function unit 122-k extracts phonemes using an acoustic model and understands the context using a language model such as an HMM (Hidden Markov Model) or N-gram. The VUI function unit 122-k may use not only a DNN-HMM model but also known models such as an End-to-End model.

[0023] The in-vehicle function execution unit 123-k executes an in-vehicle function associated with the VUI function unit 122-k based on a voice command input from the VUI function unit 122-k. The in-vehicle function execution unit 123-k may also execute an in-vehicle function associated with the VUI function unit 122-k based on an operation command input by the user by operating the input unit 11. That is, the first in-vehicle function execution unit 123-1 executes an in-vehicle function associated with the first VUI function unit 122-1, and the second in-vehicle function execution unit 123-2 executes an in-vehicle function associated with the second VUI function unit 122-2. There may be one or more in-vehicle functions associated with the VUI function unit 122-k. For example, the in-vehicle function associated with the first VUI function unit 122-1 may be a proprietary navigation application, and the in-vehicle function associated with the second VUI function unit 122-2 may be a navigation application from another company. For example, the in-vehicle function linked to the first VUI function unit 122-1 may be an in-vehicle function that has a significant impact on vehicle safety, while the in-vehicle function linked to the second VUI function unit 122-2 may be an in-vehicle function that does not have a significant impact on vehicle safety or an in-vehicle function from another company.

[0024] Next, with reference to Figures 2 to 4, an example of the operation of the control unit 12 of the in-vehicle information processing device 1 according to the first embodiment will be described. In this example, it is assumed that there is one in-vehicle function associated with the second VUI function unit 122-2. Figure 2 is a flowchart showing an example of operation when a user activates an in-vehicle function associated with the second VUI function unit 122-2 between the start-up and shutdown of the in-vehicle information processing device 1. Figure 3 is a diagram showing the priority of the VUI function unit 122-k during the operation shown in Figure 2. Figure 4 is a flowchart showing the update operation of the activation phrase recognition authority.

[0025] In S11, when the in-vehicle information processing device 1 starts up, the VUI management unit 121 starts up all VUI function units 122-k. In this embodiment, the VUI management unit 121 starts up the first VUI function unit 122-1 and the second VUI function unit 122-2. At this point, the in-vehicle functions are not started.

[0026] In S12, the VUI management unit 121 initializes the priority of the activation phrase recognition authority. The priority at the time of initialization may be predetermined or may be changed by the user. For example, as shown in Figure 3, the priority of the first VUI function unit 122-1 is set to "0" and the priority of the second VUI function unit 122-2 is set to "-1". In the following explanation, a higher value indicates a higher priority. Also, the priority is not limited to the values ​​shown in the figure. In the example shown in Figure 3, the priority of the first VUI function unit 122-1 is set to the highest during initialization. The VUI management unit 121 also initializes the activation phrase recognition authority. The activation phrase recognition authority at the time of initialization may be predetermined or may be changed by the user. Here, the following operation will be explained assuming that the VUI management unit 121 has granted activation phrase recognition authority to the first VUI function unit 122-1.

[0027] In S13, it is assumed that the user of the in-vehicle information processing device 1 operates the input unit 11 (for example, by touching an icon on the touchscreen) and inputs an instruction to activate an in-vehicle function linked to (cooperating with) the second VUI function unit 122-2. Then, the second in-vehicle function execution unit 123-2 activates the in-vehicle function based on the user's instruction.

[0028] In S14, the VUI management unit 121 sets the priority of the second VUI function unit 122-2 higher than the priority of the first VUI function unit 122-1. For example, as shown in Figure 3, the priority of the second VUI function unit 122-2 is increased from "-1" to "+1".

[0029] In S15, the VUI management unit 121 updates the activation phrase recognition authority. Refer to Figure 4 to explain the operation of updating the activation phrase recognition authority.

[0030] In S151, the VUI management unit 121 determines whether the priority of the VUI function unit 122-k to which the activation phrase recognition authority has been granted is the highest. If the priority of the VUI function unit 122-k to which the activation phrase recognition authority has been granted is the highest, the VUI management unit 121 terminates the activation phrase recognition authority update operation. If the priority of the VUI function unit 122-k to which the activation phrase recognition authority has been granted is not the highest, the VUI management unit 121 proceeds to S152. In the initial state, the activation phrase recognition authority has been granted to the first VUI function unit 122-1, and in this embodiment, the priority of the first VUI function unit 122-1 is "0", which is lower than the priority of the second VUI function unit 122-2, which is "+1", so the VUI management unit 121 proceeds to S152.

[0031] In S152, the VUI management unit 121 revokes the activation phrase recognition authority from the VUI function unit 122, which has been granted activation phrase recognition authority. In the example shown in Figure 2, the VUI management unit 121 revokes the activation phrase recognition authority from the first VUI function unit 122-1, which has been granted activation phrase recognition authority.

[0032] In S153, the VUI management unit 121 grants activation phrase recognition authority to the VUI function unit 122-k, which has the highest priority. In the example shown in Figure 2, the VUI management unit 121 grants activation phrase recognition authority to the second VUI function unit 122-2, which has the highest priority.

[0033] Refer to Figure 2 again. In S16, assume that the user of the in-vehicle information processing device 1 operates the input unit 11 and inputs a command to terminate the in-vehicle function linked to the second VUI function unit 122-2. Then, the second in-vehicle function execution unit 123-2 terminates the in-vehicle function based on the user's command.

[0034] In S17, the VUI management unit 121 sets the priority of the second VUI function unit 122-2 lower than the priority of the first VUI function unit 122-1. For example, as shown in Figure 3, the priority of the second VUI function unit 122-2 is lowered from "+1" to "-1".

[0035] In S18, the VUI management unit 121 performs the same process as in S15 again. In the example shown in Figures 2 and 3, at this point, the second VUI function unit 122-2 has been granted activation phrase recognition authority, and the first VUI function unit 122-1 has the highest priority (No in S151). Therefore, the VUI management unit 121 revokes the activation phrase recognition authority from the second VUI function unit 122-2 (S152). Then, the VUI management unit 121 grants activation phrase recognition authority to the first VUI function unit 122-1, which has the highest priority (S153).

[0036] Figure 2 assumes the case where only one in-vehicle function linked to the second VUI function unit 122-2 is activated, but multiple in-vehicle functions linked to the VUI function unit 122-k may be activated simultaneously. For example, as shown in Figure 5, the in-vehicle functions linked to the second VUI function unit 122-2 are a navigation application and an audio application that plays audio (streaming) in the background of the navigation application, and the navigation application and the audio application may be activated simultaneously. In addition, the VUI management unit 121 may change the priority weight according to the in-vehicle function. The processing in this case will be explained with reference to Figures 6 and 7.

[0037] Figure 6 is a flowchart showing an example of the update operation of the activation phrase recognition authority when the user activates two in-vehicle functions linked to the second VUI function unit 122-2 after the in-vehicle information processing device 1 has been activated. Figure 7 is a diagram showing the priority of the VUI function unit 122-k during the operation shown in Figure 6.

[0038] In S21, when the in-vehicle information processing device 1 is started up, the VUI management unit 121 starts up the first VUI function unit 122-1 and the second VUI function unit 122-2.

[0039] In S22, the VUI management unit 121 initializes the priority of the activation phrase recognition authority. For example, as shown in Figure 7, the priority of the first VUI function unit 122-1 is set to "0" and the priority of the second VUI function unit 122-2 is set to "-1". In other words, in the example shown in Figure 7, the priority of the first VUI function unit 122-1 is set to the highest during initialization. The VUI management unit 121 also initializes the activation phrase recognition authority. Here, the operation will be described assuming that the VUI management unit 121 has granted activation phrase recognition authority to the first VUI function unit 122-1.

[0040] In S23, it is assumed that the user of the in-vehicle information processing device 1 operates the input unit 11 and inputs a command to start the first in-vehicle function (for example, a navigation application) linked to the second VUI function unit 122-2. Then, the second in-vehicle function execution unit 123-2 starts the first in-vehicle function based on the user's command.

[0041] In S24, the VUI management unit 121 sets the priority of the second VUI function unit 122-2 higher than the priority of the first VUI function unit 122-1. For example, as shown in Figure 7, the priority of the second VUI function unit 122-2 is increased from "-1" to "+1".

[0042] In S25, the VUI management unit 121 updates the activation phrase recognition authority. The process in S25 is the same as the process in S15 shown in Figure 4. In the example shown in Figures 6 and 7, at this point, the first VUI function unit 122-1 has been granted activation phrase recognition authority, and the second VUI function unit 122-2 has the highest priority (No in S151). Therefore, the VUI management unit 121 revokes the activation phrase recognition authority from the first VUI function unit 122-1 (S152). Then, the VUI management unit 121 grants activation phrase recognition authority to the second VUI function unit 122-2, which has the highest priority (S153).

[0043] In S26, it is assumed that the user of the in-vehicle information processing device 1 operates the input unit 11 and inputs an instruction to activate a second in-vehicle function (for example, a voice application) linked to the second VUI function unit 122-2. Then, the second in-vehicle function execution unit 123-2 activates the second in-vehicle function based on the user's instruction. Alternatively, when the user of the in-vehicle information processing device 1 issues an instruction to activate a first in-vehicle function linked to the second VUI function unit 122-2 (S23), the second in-vehicle function execution unit 123-2 may automatically activate the second in-vehicle function following the activation of the first in-vehicle function.

[0044] In S27, the VUI management unit 121 sets an even higher priority for the second VUI function unit 122-2. For example, as shown in Figure 7, the priority of the second VUI function unit 122-2 is increased from "+1" to "+2".

[0045] After S27, the VUI management unit 121 performs the same process as in S25 (S15) again. In the example shown in Figures 6 and 7, at this point, the second VUI function unit 122-2 has been granted activation phrase recognition authority, and the second VUI function unit 122-2 has the highest priority (Yes in S151). Therefore, the VUI management unit 121 maintains the granting of activation phrase recognition authority to the second VUI function unit 122-2.

[0046] Next, we will describe an example in which another VUI function performs a predetermined operation while one VUI function is running. Figure 8 is a flowchart showing an example of operation when an in-vehicle function linked to the second VUI function unit 122-2 is started, and the user gives an operation instruction for an in-vehicle function linked to the first VUI function unit 122-1. Here, it is assumed that the processes from S11 to S15 shown in Figure 2 have been performed. Therefore, the first VUI function unit 122-1 and the second VUI function unit 122-2 are running. Also, the second VUI function unit 122-2 has the highest priority.

[0047] In S31, the second VUI function unit 122-2, which has the highest priority, recognizes the activation phrase uttered by the user.

[0048] In S32, the second VUI function unit 122-2 recognizes the voice command uttered by the user following the activation phrase.

[0049] In S33, the second VUI function unit 122-2 checks whether it has access rights to the operation requested by the voice command. If the second VUI function unit 122-2 has access rights to the requested operation, it proceeds to S34; otherwise, it proceeds to S35.

[0050] In S34, the second in-vehicle function execution unit 123-2 executes the operation requested by voice command.

[0051] In S35, the second VUI function unit 122-2 inputs (transfers) the recognized voice command to the first VUI function unit 122-1. Alternatively, the second VUI function unit 122-2 may notify the VUI management unit 121 that it does not have access rights to the voice command and the requested operation, and the VUI management unit 121 may determine the input destination (transfer destination) of the voice command.

[0052] In S36, the first VUI function unit 122-1 performs the operation requested by voice command on behalf of the second VUI function unit 122-2.

[0053] <Second Embodiment> Next, an in-vehicle information processing device according to the second embodiment will be described. The in-vehicle information processing device 1a shown in Figure 9 comprises an input unit 11, a control unit 12a, a storage unit 13, an output unit 14, and a communication unit 15. The operation of the control unit 12a differs from that of the in-vehicle information processing device 1 shown in Figure 1. The other components are the same as those of the in-vehicle information processing device 1, so their explanation will be omitted.

[0054] In the in-vehicle information processing device 1 shown in Figure 1, the number of VUIs N=2 is the same as in the in-vehicle information processing device 1a, which differs from the in-vehicle information processing device 1 in that the number of VUIs N=3. Specifically, the control unit 12a comprises a VUI management unit 121, a VUI function unit 122-k (first VUI function unit 122-1, second VUI function unit 122-2, and third VUI function unit 122-3), and an in-vehicle function execution unit 123-k (first in-vehicle function execution unit 123-1, second in-vehicle function execution unit 123-2, and third in-vehicle function execution unit 123-3).

[0055] Referring to Figures 10 and 11, an example of the operation of the control unit 12a of the in-vehicle information processing device 1a according to the second embodiment will be described. Figure 10 is a flowchart showing an example of operation when the user activates an in-vehicle function linked to the second VUI function unit 122-2 between the startup and shutdown of the in-vehicle information processing device 1a. Figure 11 is a diagram showing the priority of the VUI function unit 122-k during the operation shown in Figure 10.

[0056] In S41, when the in-vehicle information processing device 1a is started up, the VUI management unit 121 starts up the first VUI function unit 122-1, the second VUI function unit 122-2, and the third VUI function unit 122-3.

[0057] In S42, the VUI management unit 121 initializes the priority of the activation phrase recognition authority. For example, as shown in Figure 11, the priority of the first VUI function unit 122-1 is set to "0", the priority of the second VUI function unit 122-2 is set to "-1", and the priority of the third VUI function unit 122-3 is set to "-1". In other words, in the example shown in Figure 11, the priority of the first VUI function unit 122-1 is set to the highest during initialization. The VUI management unit 121 also initializes the activation phrase recognition authority. Here, the operation will be described assuming that the VUI management unit 121 has granted activation phrase recognition authority to the first VUI function unit 122-1.

[0058] In S43, it is assumed that the user of the in-vehicle information processing device 1a operates the input unit 11 and inputs an instruction to activate an in-vehicle function linked to the second VUI function unit 122-2. Then, the second in-vehicle function execution unit 123-2 activates the in-vehicle function based on the user's instruction.

[0059] In S44, the VUI management unit 121 sets the priority of the second VUI function unit 122-2 higher than the priority of the first VUI function unit 122-1. For example, as shown in Figure 11, the priority of the second VUI function unit 122-2 is increased from "-1" to "+1".

[0060] In S45, the VUI management unit 121 updates the activation phrase recognition authority. The process in S45 is the same as the process in S15 shown in Figure 4. In the examples shown in Figures 10 and 11, at this point, the first VUI function unit 122-1 has been granted activation phrase recognition authority, and the second VUI function unit 122-2 has the highest priority (No in S151). Therefore, the VUI management unit 121 revokes the activation phrase recognition authority from the first VUI function unit 122-1 (S152). Then, the VUI management unit 121 grants activation phrase recognition authority to the second VUI function unit 122-2, which has the highest priority (S153).

[0061] In S46, it is assumed that the user of the in-vehicle information processing device 1a operates the input unit 11 and inputs a command to terminate the in-vehicle function linked to the second VUI function unit 122-2. Then, the second in-vehicle function execution unit 123-2 terminates the in-vehicle function based on the user's command.

[0062] In S47, the VUI management unit 121 sets the priority of the second VUI function unit 122-2 lower than the priority of the first VUI function unit 122-1. For example, as shown in Figure 11, the priority of the second VUI function unit 122-2 is lowered from "+1" to "-1".

[0063] After S47, the VUI management unit 121 performs the same process as in S45 (S15) again. In the example shown in Figures 10 and 11, at this point, the second VUI function unit 122-2 has been granted activation phrase recognition authority, and the first VUI function unit 122-1 has the highest priority (No in S151). Therefore, the VUI management unit 121 revokes the activation phrase recognition authority from the second VUI function unit 122-2 (S152). Then, the VUI management unit 121 grants activation phrase recognition authority to the first VUI function unit 122-1, which has the highest priority (S153).

[0064] Figure 10 assumes the case where only one in-vehicle function linked to the second VUI function unit 122-2 is activated, but multiple in-vehicle functions linked to different VUI function units 122-k may be activated simultaneously. For example, as shown in Figure 5, the in-vehicle function linked to the second VUI function unit 122-2 is a navigation application, and the in-vehicle function linked to the third VUI function unit 122-3 is a voice application that plays audio in the background of the navigation application, and the navigation application and the voice application may be activated simultaneously. In addition, the VUI management unit 121 may change the priority weight according to the in-vehicle function. The processing in this case will be explained with reference to Figures 12 and 13.

[0065] Figure 12 is a flowchart showing an example of operation when the user activates an in-vehicle function linked to the second VUI function unit 122-2 and an in-vehicle function linked to the third VUI function unit 122-3 after the in-vehicle information processing device 1 has been started. Figure 13 is a diagram showing the priority of the VUI function unit 122-k during the operation shown in Figure 12.

[0066] In S51, when the in-vehicle information processing device 1 is started up, the VUI management unit 121 starts up the first VUI function unit 122-1, the second VUI function unit 122-2, and the third VUI function unit 122-3.

[0067] In S52, the VUI management unit 121 initializes the priority of the activation phrase recognition authority. For example, as shown in Figure 13, the priority of the first VUI function unit 122-1 is set to "0", the priority of the second VUI function unit 122-2 is set to "-1", and the priority of the third VUI function unit 122-3 is set to "-1". In other words, in the example shown in Figure 13, the priority of the first VUI function unit 122-1 is set to the highest during initialization. The VUI management unit 121 also initializes the activation phrase recognition authority. Here, assuming that the VUI management unit 121 has granted activation phrase recognition authority to the first VUI function unit 122-1, the following operation will be described.

[0068] In S53, it is assumed that the user of the in-vehicle information processing device 1a operates the input unit 11 and inputs a command to start the first in-vehicle function (for example, a navigation application) linked to the second VUI function unit 122-2. Then, the second in-vehicle function execution unit 123-2 starts the first in-vehicle function based on the user's command.

[0069] In S54, the VUI management unit 121 sets the priority of the second VUI function unit 122-2 higher than the priority of the first VUI function unit 122-1. For example, as shown in Figure 13, the priority of the second VUI function unit 122-2 is increased from "-1" to "+2".

[0070] In S55, the VUI management unit 121 updates the activation phrase recognition authority. The process in S45 is the same as the process in S15 shown in Figure 4. In the examples shown in Figures 12 and 13, at this point, the first VUI function unit 122-1 has been granted activation phrase recognition authority, and the second VUI function unit 122-2 has the highest priority (No in S151). Therefore, the VUI management unit 121 revokes the activation phrase recognition authority from the first VUI function unit 122-1 (S152). Then, the VUI management unit 121 grants activation phrase recognition authority to the second VUI function unit 122-2, which has the highest priority (S153).

[0071] In S56, it is assumed that the user of the in-vehicle information processing device 1a operates the input unit 11 and inputs an instruction to activate a second in-vehicle function (for example, a voice application) linked to the third VUI function unit 122-3. Then, the third in-vehicle function execution unit 123-3 activates the second in-vehicle function based on the user's instruction. Alternatively, when the user of the in-vehicle information processing device 1a issues an instruction to activate a first in-vehicle function linked to the second VUI function unit 122-2 (S43), the third in-vehicle function execution unit 123-3 may automatically activate the second in-vehicle function following the activation of the first in-vehicle function.

[0072] In S57, the VUI management unit 121 sets a higher priority for the third VUI function unit 122-3. For example, as shown in Figure 13, the priority of the third VUI function unit 122-3 is increased from "-1" to "+1".

[0073] After S57, the VUI management unit 121 performs the same process as in S55 (S15) again. In the example shown in Figures 12 and 13, at this point, the second VUI function unit 122-2 has been granted activation phrase recognition authority, and the second VUI function unit 122-2 has the highest priority (Yes in S151). Therefore, the VUI management unit 121 maintains the granting of activation phrase recognition authority to the second VUI function unit 122-2.

[0074] The above embodiments described the cases where the number of VUIs N is 2 and 3, but it is clear that similar processing can be performed even when N is 4 or more. Furthermore, the operation is not limited to the above examples. As described above, multiple VUI functions of the in-vehicle information processing device 1,1a are activated with the same activation phrase. Therefore, the user does not need to have knowledge of the combination of activation phrases and the VUI functions associated with those activation phrases, nor does it need to memorize multiple activation phrases, thereby improving the operability of the in-vehicle functions. In addition, the in-vehicle information processing device 1,1a can be equipped with a large number of VUI functions. For example, in order to support different languages ​​in each country and region, the in-vehicle information processing device 1,1a may be equipped with different VUI functions for each language, or it may be equipped with VUI functions from vendors that are proficient in that language. Furthermore, since the user can operate various in-vehicle functions by voice without taking their eyes off the road by using multiple VUI functions, it is possible to improve safety while driving.

[0075] Furthermore, when a predetermined in-vehicle function is activated, the in-vehicle information processing device 1,1a activates the VUI function associated with that in-vehicle function, and other VUI functions perform predetermined operations even while the VUI function is activated. If a VUI function does not have access rights to an operation requested by a voice command, the other VUI function can be activated even while one VUI function is activated by inputting a voice command to that VUI function. Therefore, the in-vehicle information processing device 1,1a can improve the efficiency of resource utilization compared to when each VUI function is handled individually. For example, even if a VUI function associated with a first in-vehicle function (e.g., navigation function) does not have access rights to a second in-vehicle function (e.g., air conditioning operation function), the user can still give voice instructions to the second in-vehicle function while the first in-vehicle function is activated.

[0076] Furthermore, the in-vehicle information processing devices 1 and 1a dynamically change the priority of the activation phrase recognition authority and update the activation phrase recognition authority, triggered by the activation and termination of in-vehicle functions. As a result, the in-vehicle information processing devices 1 and 1a can prevent resource consumption from increasing due to the simultaneous activation of multiple in-vehicle functions in response to the activation phrase.

[0077] <Program> To enable the above-described in-vehicle information processing devices 1 and 1a to function, it is also possible to use a computer capable of executing program instructions. The program can cause the computer to perform the operations described above, thereby enabling the computer to function as an in-vehicle information processing device 1 or 1a.

[0078] The program can be stored on a non-temporary computer-readable medium. Examples of non-temporary computer-readable media include flash memory, magnetic recording devices, optical discs, magneto-optical recording media, or ROM. The program can be distributed, for example, by selling, transferring, or leasing portable media such as SD (Secure Digital) cards, DVDs (digital versatile discs), or CD-ROMs (compact disc read-only memory) on which the program is stored. The program may also be distributed by storing it in server storage and transferring it from the server to other computers. The program may also be provided as a program product.

[0079] The computer, for example, stores a program stored on a portable medium or a program transferred from a server in the storage unit 13. Then, the computer reads the program stored in the storage unit 13 with the processor (control unit 12) and executes processing according to the read program in the processor. The processor may be a CPU (central processing unit), MPU (Micro Processing Unit), SoC (System on a Chip), etc., and may be composed of multiple processors of the same or different types.

[0080] A computer may read a program directly from a portable medium and execute processing according to the program. A computer may also execute processing according to the received program sequentially each time a program is transferred to the computer from a server. Processing may also be performed by a so-called ASP (application service provider) type service, which does not transfer programs from the server to the computer, but realizes its function only through execution instructions and result retrieval. A program includes information used for processing by an electronic computer that is equivalent to a program. For example, data that is not a direct instruction to the computer but has the nature of defining the computer's processing falls under "equivalent to a program."

[0081] Although the embodiments described above are representative examples, various modifications or changes are possible without departing from the spirit of this disclosure. For example, multiple component blocks or processing steps described in the embodiments can be combined into one, or one can be divided into multiple.

[0082] Some embodiments of the present disclosure are described below. However, it should be noted that the embodiments of the present disclosure are not limited to these. [Note 1] An in-vehicle information processing device comprising a control unit, The control unit has multiple VUI functions that are activated with the same activation phrase, Each of the aforementioned VUI functions is linked to an in-vehicle function. The VUI function processes user speech using speech recognition to recognize voice commands for in-vehicle functions and executes the in-vehicle functions based on those voice commands. An in-vehicle information processing device in which, when a predetermined in-vehicle function is activated, a VUI function linked to that in-vehicle function is activated, and other VUI functions perform predetermined operations even while the VUI function is activated. [Note 2] An in-vehicle information processing device having multiple VUI functions that are activated with the same startup phrase, Each of the aforementioned VUI functions is linked to an in-vehicle function. An in-vehicle information processing device in which, when a predetermined in-vehicle function is activated, a VUI function linked to that in-vehicle function is activated, and other VUI functions perform predetermined operations even while the VUI function is activated. [Note 3] If the aforementioned VUI function does not have access rights to the operation requested by the voice command, the in-vehicle information processing device according to Appendix 1 or 2 inputs the voice command to another VUI function. [Note 4] An in-vehicle information processing device according to any one of the appendices 1 to 3, which activates all of the above-mentioned VUI functions when the in-vehicle information processing device is started up. [Note 5] An in-vehicle information processing device as described in any of Appendix 1 to 4, which, when a specified in-vehicle function is activated, increases the priority of the activation phrase recognition authority for the VUI function associated with that in-vehicle function. [Note 6] An in-vehicle information processing device as described in any of Appendix 1 to 5, which, when a specified in-vehicle function is terminated, lowers the priority of the activation phrase recognition authority for the VUI function associated with that in-vehicle function. [Note 7] An in-vehicle information processing device according to any one of the appendices 1 to 6, wherein, with respect to a VUI function to which activation phrase recognition authority has been granted, if the priority of said activation phrase recognition authority is not the highest, the activation phrase recognition authority is revoked from said VUI function and the activation phrase recognition authority is granted to another VUI function to which the priority is the highest. [Note 8] An in-vehicle information processing device according to any one of the appendices 1 to 7, which initializes the priority of the startup phrase recognition authority for the multiple VUI functions when the in-vehicle information processing device is started. [Note 9] An information processing method executed by an in-vehicle information processing device having multiple VUI functions that are activated with the same startup phrase, Each of the aforementioned VUI functions is linked to an in-vehicle function. The in-vehicle information processing device, The system processes user speech using speech recognition to recognize voice commands for in-vehicle functions and executes those functions based on those voice commands. If a specified in-vehicle function is activated, the VUI function associated with that in-vehicle function will be activated, and other VUI functions will perform their specified operations while that VUI function is activated. An information processing method that performs [this action]. [Note 10] An information processing method executed by an in-vehicle information processing device having multiple VUI functions that are activated with the same startup phrase, Each of the aforementioned VUI functions is linked to an in-vehicle function. The in-vehicle information processing device, If a specified in-vehicle function is activated, the VUI function associated with that in-vehicle function will be activated, and other VUI functions will perform their specified operations while that VUI function is running. An information processing method that performs [this action]. [Note 11] The in-vehicle information processing device, If the aforementioned VUI function does not have access rights to the operation requested by the voice command, the voice command will be entered into another VUI function. The information processing method described in Appendix 9 or 10, which performs the following: [Note 12] The in-vehicle information processing device, To activate all of the above VUI functions when the in-vehicle information processing device is started up. An information processing method described in any of appendices 9 to 11, which performs the following. [Note 13] The in-vehicle information processing device, When a specified in-vehicle function is activated, the priority of the activation phrase recognition authority for the VUI function associated with that in-vehicle function is increased. An information processing method described in any of appendices 9 to 12, which performs the following. [Note 14] The in-vehicle information processing device, When a specified in-vehicle function is terminated, the priority of the activation phrase recognition authority for the VUI function associated with that in-vehicle function should be lowered. An information processing method described in any of appendices 9 to 13, which performs the following. [Note 15] The in-vehicle information processing device, If a VUI function that has been granted activation phrase recognition authority does not have the highest priority, the activation phrase recognition authority shall be revoked from that VUI function, and the activation phrase recognition authority shall be granted to another VUI function that has the highest priority. An information processing method described in any of appendices 9 to 14, which performs the following. [Note 16] The in-vehicle information processing device, When the in-vehicle information processing device is started, the priority of the startup phrase recognition authority for the multiple VUI functions is initialized. An information processing method described in any of appendices 9 to 15, which performs the following. [Note 17] A program to be executed on a computer that functions as an in-vehicle information processing device having multiple VUI functions that are started with the same startup phrase, Each of the aforementioned VUI functions is linked to an in-vehicle function. To the aforementioned computer, The system processes user speech using speech recognition to recognize voice commands for in-vehicle functions and executes those functions based on those voice commands. When a specified in-vehicle function is activated, the VUI function associated with that in-vehicle function is activated, and other VUI functions perform their specified operations while that VUI function is activated. A program to execute. [Note 18] A program to be executed on a computer that functions as an in-vehicle information processing device having multiple VUI functions that are started with the same startup phrase, Each of the aforementioned VUI functions is linked to an in-vehicle function. To the aforementioned computer, If a specified in-vehicle function is activated, the VUI function associated with that in-vehicle function will be activated, and other VUI functions will perform their specified operations while that VUI function is running. A program to execute. [Note 19] To the aforementioned computer, If the aforementioned VUI function does not have access rights to the operation requested by the voice command, the voice command will be entered into another VUI function. A program described in Appendix 17 or 18 for executing the program. [Note 20] To the aforementioned computer, When a specified in-vehicle function is activated, the priority of the activation phrase recognition authority for the VUI function associated with that in-vehicle function is increased. A program described in any of appendices 17 to 19 to execute the program. [Explanation of symbols]

[0083] 1,1a In-vehicle information processing device 11 Input section 12,12a Control Unit 13 Storage section 14 Output section 15 Communications Department 121 VUI Management Department 122-1 1st VUI function section 122-2 2nd VUI function section 122-3 3rd VUI function section 123-1 First In-Vehicle Function Execution Unit 123-2 Second In-Vehicle Function Execution Unit 123-3 Third In-Vehicle Function Execution Unit

Claims

1. An in-vehicle information processing device comprising a control unit, The control unit has multiple VUI functions that are activated with the same activation phrase, Each of the aforementioned VUI functions is linked to an in-vehicle function. The VUI function processes user speech using speech recognition to recognize voice commands for in-vehicle functions and executes the in-vehicle functions based on those voice commands. An in-vehicle information processing device in which, when a predetermined in-vehicle function is activated, a VUI function linked to that in-vehicle function is activated, and other VUI functions perform predetermined operations even while the VUI function is activated.

2. An in-vehicle information processing device having multiple VUI functions that are activated with the same startup phrase, Each of the aforementioned VUI functions is linked to an in-vehicle function. An in-vehicle information processing device in which, when a predetermined in-vehicle function is activated, a VUI function linked to that in-vehicle function is activated, and other VUI functions perform predetermined operations even while the VUI function is activated.

3. The in-vehicle information processing device according to claim 2, wherein if the VUI function does not have access rights to the operation requested by the voice command, the voice command is input to another VUI function.

4. The in-vehicle information processing device according to claim 2, wherein all of the plurality of VUI functions are activated when the in-vehicle information processing device is started.

5. The in-vehicle information processing device according to claim 2, which, when a predetermined in-vehicle function is activated, increases the priority of the activation phrase recognition authority for the VUI function associated with said in-vehicle function.

6. The in-vehicle information processing device according to claim 2, wherein when a predetermined in-vehicle function is terminated, the priority of the activation phrase recognition authority for the VUI function associated with said in-vehicle function is lowered.

7. The in-vehicle information processing device according to claim 2, wherein, with respect to a VUI function to which activation phrase recognition authority has been granted, if the priority of the activation phrase recognition authority is not the highest, the activation phrase recognition authority is revoked from the VUI function and the activation phrase recognition authority is granted to another VUI function to which the priority is the highest.

8. The in-vehicle information processing device according to claim 2, wherein when the in-vehicle information processing device is started, the priority of the startup phrase recognition authority for the plurality of VUI functions is initialized.

9. An information processing method executed by an in-vehicle information processing device having multiple VUI functions that are activated with the same startup phrase, Each of the aforementioned VUI functions is linked to an in-vehicle function. The in-vehicle information processing device, The system processes user speech using speech recognition to recognize voice commands for in-vehicle functions and executes those functions based on those voice commands. If a specified in-vehicle function is activated, the VUI function associated with that in-vehicle function is activated, and other VUI functions perform their predetermined operations while that VUI function is running. An information processing method that performs [this action].

10. An information processing method executed by an in-vehicle information processing device having multiple VUI functions that are activated with the same startup phrase, Each of the aforementioned VUI functions is linked to an in-vehicle function. The in-vehicle information processing device, If a specified in-vehicle function is activated, the VUI function associated with that in-vehicle function will be activated, and other VUI functions will perform their predetermined operations while that VUI function is running. An information processing method that performs [this action].

11. The in-vehicle information processing device, If the aforementioned VUI function does not have access rights to the operation requested by the voice command, the voice command will be entered into another VUI function. The information processing method according to claim 10, which performs the following.

12. The in-vehicle information processing device, To activate all of the aforementioned VUI functions when the in-vehicle information processing device is started up. The information processing method according to claim 10, which performs the following.

13. The in-vehicle information processing device, When a specified in-vehicle function is activated, the priority of the activation phrase recognition authority is increased for the VUI function associated with that in-vehicle function. The information processing method according to claim 10, which performs the following.

14. The in-vehicle information processing device, When a specified in-vehicle function is terminated, the priority of the activation phrase recognition authority for the VUI function associated with that in-vehicle function should be lowered. The information processing method according to claim 10, which performs the following.

15. The in-vehicle information processing device, If a VUI function that has been granted the right to recognize the activation phrase does not have the highest priority, the right to recognize the activation phrase shall be revoked from that VUI function, and the right to recognize the activation phrase shall be granted to another VUI function that has the highest priority. The information processing method according to claim 10, which performs the following.

16. The in-vehicle information processing device, When the in-vehicle information processing device is started, the priority of the startup phrase recognition authority is initialized for the multiple VUI functions. The information processing method according to claim 10, which performs the following.

17. A program to be executed by a computer that functions as an in-vehicle information processing device having multiple VUI functions that are started with the same startup phrase, Each of the aforementioned VUI functions is linked to an in-vehicle function. To the aforementioned computer, The system processes user speech using speech recognition to recognize voice commands for in-vehicle functions and executes those functions based on those voice commands. When a specified in-vehicle function is activated, the VUI function associated with that in-vehicle function is activated, and other VUI functions perform their specified operations while that VUI function is running. A program to execute.

18. A program to be executed by a computer that functions as an in-vehicle information processing device having multiple VUI functions that are started with the same startup phrase, Each of the aforementioned VUI functions is linked to an in-vehicle function. To the aforementioned computer, If a specified in-vehicle function is activated, the VUI function associated with that in-vehicle function will be activated, and other VUI functions will perform their predetermined operations while that VUI function is running. A program to execute.

19. To the aforementioned computer, If the aforementioned VUI function does not have access rights to the operation requested by the voice command, the voice command will be entered into another VUI function. A program according to claim 18 for causing the execution of the following:

20. To the aforementioned computer, When a specified in-vehicle function is activated, the priority of the activation phrase recognition authority is increased for the VUI function associated with that in-vehicle function. A program according to claim 18 for causing the execution of the following:

Images