Vehicle-mounted information processing device, information processing method, program product, and non-transitory information storage medium

Abstract

The present application provides a kind of vehicle information processing device, information processing method, program product and non-transitory storage medium.The vehicle information processing device is equipped with control part, the control part has multiple VUI functions being started with the same start statement.The multiple VUI functions are respectively associated with vehicle function being established.The multiple VUI functions are each configured to perform speech recognition processing on the user's voice to recognize voice commands, and cause the vehicle function to execute based on the voice commands.The control part is configured to start the VUI function associated with the predetermined vehicle function for the start statement in the case where the predetermined vehicle function is in the start.

Description

Technical Field

[0001] This disclosure relates to an in-vehicle information processing device, information processing method, program, and non-transitory information storage medium. Background Technology

[0002] A technology related to voice dialogue services in vehicles is known. For example, Japanese Patent Application Publication No. 2020-144275 discloses an intelligent agent device comprising multiple intelligent agent functional units and a management unit. The multiple intelligent agent functional units provide a service including voice-enabled responses based on the voices of vehicle occupants. When a first activation statement, individually set for each of the multiple intelligent agent functional units, is uttered by a vehicle occupant, the management unit activates one of the multiple intelligent agent functional units corresponding to the uttered first activation statement. When a second activation statement, commonly set for two or more of the multiple intelligent agent functional units, is uttered by a vehicle occupant, the management unit activates two or more intelligent agent functional units corresponding to the uttered second activation statement. Summary of the Invention

[0003] However, when multiple VUI (Voice User Interface) functions are implemented, users need to master the activation phrases and the combinations of VUI functions associated with those phrases. As the number of VUI functions increases, it becomes difficult for users to remember all the activation phrases for each agent's functions. Therefore, although commonality in the activation phrases for each VUI function is considered, resource consumption increases if multiple VUI functions are activated simultaneously.

[0004] This disclosure provides an in-vehicle information processing device, information processing method, and program that can suppress the increase in resource consumption while making the activation words of various VUI functions common.

[0005] One embodiment of the in-vehicle information processing apparatus disclosed herein includes a control unit. The control unit has multiple VUI functions that are activated by the same activation statement. Each of the multiple VUI functions is associated with an in-vehicle function. Each of the multiple VUI functions is configured to perform voice recognition processing on a user's voice to recognize a voice command, and to execute the associated in-vehicle function based on the voice command. The control unit is configured to activate the VUI function associated with the predetermined in-vehicle function in response to the activation statement when a predetermined in-vehicle function is activated.

[0006] One embodiment of this disclosure relates to an in-vehicle information processing apparatus having multiple VUI functions that are activated by the same startup statement. Each of the multiple VUI functions is associated with an in-vehicle function. The in-vehicle information processing apparatus is configured to activate the VUI functions associated with the predetermined in-vehicle function in response to the startup statement when a predetermined in-vehicle function is activated.

[0007] The aforementioned vehicle information processing device may also be configured such that, when a vehicle function switching instruction is input, a new vehicle function is started based on the switching instruction, and the VUI function associated with the newly started vehicle function is started, while other VUI functions are terminated.

[0008] In the aforementioned vehicle information processing device, at least one of the plurality of VUI functions may be associated with a plurality of vehicle functions.

[0009] The aforementioned vehicle information processing device can also be configured to simultaneously activate the plurality of vehicle functions that have been associated with at least one of the plurality of VUI functions.

[0010] In the aforementioned vehicle information processing device, the multiple vehicle functions may also be configured with different priorities.

[0011] The aforementioned vehicle information processing device may also be configured to activate the VUI function associated with the highest priority vehicle function when multiple vehicle functions associated with the multiple VUI functions are activated simultaneously.

[0012] One embodiment of this disclosure relates to an information processing method executed by an in-vehicle information processing device having multiple VUI functions activated by the same startup statement. The multiple VUI functions are respectively associated with in-vehicle functions. The information processing method includes the following steps: the in-vehicle information processing device performs voice recognition processing on the user's voice to recognize a voice command, and executes the in-vehicle function based on the voice command; when a predetermined in-vehicle function is activated, the in-vehicle information processing device activates the VUI function associated with the predetermined in-vehicle function in response to the startup statement.

[0013] One embodiment of this disclosure relates to an information processing method executed by an in-vehicle information processing device having multiple VUI functions that are activated with the same activation statement. The multiple VUI functions are respectively associated with in-vehicle functions. The information processing method includes the following process: when a predetermined in-vehicle function is activated, the in-vehicle information processing device activates the VUI functions associated with the predetermined in-vehicle function in response to the activation statement.

[0014] The above information processing method may also include the following processing: when the vehicle information processing device receives a vehicle function switching instruction, it starts a new vehicle function based on the switching instruction; the vehicle information processing device starts the VUI function associated with the newly started vehicle function and stops other VUI functions.

[0015] The above information processing method may also include the following processing: the vehicle information processing device enables the simultaneous activation of the plurality of vehicle functions that have been associated with at least one of the plurality of VUI functions.

[0016] In the above information processing method, it can also be configured that the multiple vehicle functions are each assigned a priority.

[0017] The above information processing method may also include the following processing: when multiple vehicle functions associated with the multiple VUI functions are started simultaneously, the vehicle information processing device starts the VUI function associated with the highest priority vehicle function.

[0018] One embodiment of this disclosure involves a program executed by a computer functioning as an in-vehicle information processing device having multiple VUI functions that are activated by the same startup statement. Each of the multiple VUI functions is associated with an in-vehicle function. The program causes the computer to perform the following processes: perform speech recognition processing on the user's voice to recognize a voice command, and execute the in-vehicle function based on the voice command; and, when a predetermined in-vehicle function is activated, activate the VUI function associated with the predetermined in-vehicle function in response to the startup statement.

[0019] One embodiment of this disclosure involves a program executed by a computer functioning as an in-vehicle information processing device having multiple VUI functions that are started with the same startup statement. The multiple VUI functions are each associated with an in-vehicle function. The program causes the computer to perform the following process: when a predetermined in-vehicle function is being started, the program starts the VUI function associated with the predetermined in-vehicle function in response to the startup statement.

[0020] The above procedure can also cause the computer to perform the following processing: when a vehicle function switching instruction is input, a new vehicle function is started based on the switching instruction; the VUI function associated with the newly started vehicle function is started, and other VUI functions are terminated.

[0021] In the above procedure, it can also be configured such that at least one of the multiple VUI functions is associated with multiple in-vehicle functions.

[0022] The above procedure can also cause the computer to perform the following process: simultaneously start the plurality of vehicle functions that have been associated with at least one of the plurality of VUI functions.

[0023] In the above procedure, it can also be configured such that the multiple vehicle functions are each assigned a priority. The procedure can also cause the computer to perform the following processing: when multiple vehicle functions associated with the multiple VUI functions are started simultaneously, the VUI function associated with the vehicle function with the highest priority is started.

[0024] One embodiment of this disclosure involves a non-transitory storage medium storing commands that enable a computer, functioning as an in-vehicle information processing device with multiple VUI functions activated by the same startup statement, to execute. The multiple VUI functions are respectively associated with in-vehicle functions. The commands cause the computer to perform the following processes: perform speech recognition processing on the user's voice to recognize a voice command, and execute the associated in-vehicle function based on the voice command; and, when a predetermined in-vehicle function is activated, activate the VUI function associated with the predetermined in-vehicle function in response to the startup statement.

[0025] One embodiment of this disclosure involves a non-transitory storage medium storing commands that enable a computer to function as an in-vehicle information processing device having multiple VUI functions that are started with the same startup statement. The multiple VUI functions are each associated with an in-vehicle function. The commands cause the computer to perform the following process: when a predetermined in-vehicle function is being started, the VUI function associated with the predetermined in-vehicle function is started in response to the startup statement.

[0026] In the aforementioned non-temporary storage medium, the command can also cause the computer to perform the following processes: when a vehicle function switching instruction is input, to start a new vehicle function based on the switching instruction; to start the VUI function associated with the newly started vehicle function, and to terminate other VUI functions.

[0027] In the aforementioned non-temporary storage medium, at least one of the plurality of VUI functions is configured to be associated with a plurality of in-vehicle functions.

[0028] In the aforementioned non-temporary storage medium, the command can also cause the computer to perform the following process: simultaneously start the plurality of vehicle functions that have been associated with at least one of the plurality of VUI functions.

[0029] In the aforementioned non-temporary storage medium, the multiple vehicle functions can also be configured with different priorities. The command can also cause the computer to perform the following processing: when multiple vehicle functions associated with the multiple VUI functions are started simultaneously, the VUI function associated with the vehicle function with the highest priority is started.

[0030] According to this disclosure, it is possible to suppress the increase in resource consumption while making the launch words of various VUI functions common. Attached Figure Description

[0031] The features, advantages, and technical and industrial significance of exemplary embodiments of the present invention will now be described with reference to the accompanying drawings, wherein like symbols denote like elements, wherein:

[0032] Figure 1 This diagram illustrates the general structure of the in-vehicle information processing device according to the first embodiment of this disclosure.

[0033] Figure 2 This is a first flowchart illustrating an example of the operation of an in-vehicle information processing device according to the first embodiment of this disclosure.

[0034] Figure 3 This is a diagram illustrating an example of a screen when the in-vehicle information processing device according to the first embodiment of this disclosure is started.

[0035] Figure 4 This is a second flowchart illustrating an example of the operation of the in-vehicle information processing device according to the first embodiment of this disclosure.

[0036] Figure 5 This diagram illustrates the general structure of the vehicle information processing device according to the second embodiment of this disclosure.

[0037] Figure 6 This is a diagram illustrating an example of a screen when the vehicle information processing device according to the second embodiment of this disclosure is started.

[0038] Figure 7 A flowchart illustrating an example of the operation of an in-vehicle information processing device according to the second embodiment of this disclosure.

[0039] Figure 8 This diagram illustrates multiple vehicle functions activated by an in-vehicle information processing device according to one embodiment of this disclosure.

[0040] Figure 9 This diagram illustrates an example of an in-vehicle function that has been established in association with the VUI function unit of an in-vehicle information processing device according to one embodiment of this disclosure.

[0041] Figure 10 This is a flowchart illustrating an example of the operation of an in-vehicle information processing device according to one embodiment of the present disclosure. Detailed Implementation

[0042] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings.

[0043] First Implementation Method Reference Figure 1 The structure of the vehicle information processing device according to the first embodiment will be described. Figure 1 The vehicle information processing device 1 shown includes an input unit 11, a control unit 12, a storage unit 13, an output unit 14, and a communication unit 15.

[0044] The in-vehicle information processing unit 1 is a multimedia device installed in a vehicle and has multiple in-vehicle functions. These functions may include, for example, navigation, audio functions such as radio and television, information dissemination functions such as news and weather, vehicle collaboration functions for communication with other vehicles, and collaboration functions with smart devices (such as smartphones). Furthermore, in-vehicle functions may also include functions for operating vehicle equipment such as air conditioning, windows, wipers, lighting, roof, and sun visors. The in-vehicle information processing unit 1 has multiple VUI (Voice User Interface) functions that are activated with the same wake-up word. These VUI functions are associated with the in-vehicle functions, and when a predetermined in-vehicle function (typically navigation) is activated, the VUI function associated with that in-vehicle function is activated in response to the wake-up word. While the wake-up word may be, for example, "Hello, Toyota!", it is not limited to this. The wake-up word can be changed by the user through settings.

[0045] The input unit 11 includes a microphone for picking up the voices of the vehicle occupants. Alternatively, the input unit 11 may also include physical buttons, electrostatic capacitive buttons, touch panels, etc., for accepting input from the user of the in-vehicle information processing device 1.

[0046] The storage unit 13 includes at least one semiconductor memory, at least one magnetic memory, at least one optical memory, or any combination thereof. The semiconductor memory may be, for example, RAM (Random Access Memory), ROM (Read Only Memory), or flash memory. The storage unit 13 functions as, for example, a main storage device, an auxiliary storage device, or a cache memory. The storage unit 13 stores information used in the operation of the vehicle information processing device 1 and information obtained through the operation of the vehicle information processing device 1.

[0047] The output unit 14 has at least one output interface. The output interface can be a display that outputs images generated by the control unit 12. Alternatively, the output interface can be a speaker that outputs voice generated by the control unit 12. Furthermore, the input unit 11 and the output unit 14 can also be integrated, such as with a touchscreen.

[0048] The communication unit 15 has at least one communication interface for communicating with external devices such as servers and sensor components. In the case of wired communication, the communication interface may be an interface corresponding to communication standards such as LAN (Local Area Network) or USB (Universal Serial Bus). In the case of wireless communication, the communication interface may be an interface corresponding to LTE (Long Term Evolution) or 4G (4G) standards. th generation: fourth-generation mobile communication technology), 5G (5 th The communication unit 15 uses an interface corresponding to mobile communication standards such as fifth-generation mobile communication technology (5G) or short-range wireless communication such as Bluetooth. The communication unit 15 transmits the information generated by the control unit 12 to an external device. The communication unit 15 also outputs information received from the external device to the storage unit 13.

[0049] The control unit 12 includes at least one processor, at least one programmable circuit, at least one dedicated circuit, or any combination thereof. The processor is a general-purpose processor such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit), or a dedicated processor for specific processing. The programmable circuit is, for example, a FPGA (Field-Programmable Gate Array). The dedicated circuit is, for example, an ASIC (Application Specific Integrated Circuit). The control unit 12 controls various parts of the vehicle information processing device 1 while performing processing related to the operation of the vehicle information processing device 1.

[0050] The control unit 12 includes a VUI management unit 121, N VUI function units 122k (1≤k≤N), and N in-vehicle function execution units 123k (1≤k≤N). Here, N is the number of VUIs and is an integer of 2 or more. Figure 1 In this design, the number of VUIs is set to N=2. A first VUI function unit 1221 and a second VUI function unit 1222 are shown as VUI function units 122k, and a first vehicle function execution unit 1231 and a second vehicle function execution unit 1232 are shown as vehicle function execution units 123k. Both the VUI function units 122k and the vehicle function execution units 123k can be entirely developed by our company, or a portion can be developed by our company while the remainder is developed by other companies (third-party development).

[0051] The VUI management unit 121 controls the ON / OFF operation of the VUI function unit 122k. When the VUI function unit 122k is activated, it first enters standby mode. Standby mode is the state in which the VUI function unit 122k waits for a start statement. In standby mode, the microphone is always on to monitor sound output. Furthermore, no advanced processing is performed until a start statement is detected. In the non-activated state, the VUI function unit 122k disables sound output, i.e., it does not wait for a start statement.

[0052] The VUI function unit 122k is started with the same startup statement. In this specification, "the VUI function unit 122k is started with a startup statement" means that the VUI function unit 122k detects a startup statement and switches from standby mode to active mode. Active mode refers to a state where it is ready to receive user voice instructions. In active mode, user requests are executed using natural language processing, cloud communication, etc. The VUI function unit 122k is associated (cooperatively working) with each vehicle function. For example, suppose a first vehicle function is associated with a first VUI function unit 1221, and a second vehicle function is associated with a second VUI function unit 1222. In this case, when the first vehicle function is started, the first VUI function unit 1221, associated with the first vehicle function, will start. Similarly, when the second vehicle function is started, the second VUI function unit 1222, associated with the second vehicle function, will start.

[0053] The VUI function unit 122k engages in dialogue with the user and performs intelligent agent processing such as speech recognition and natural language processing. When the VUI function unit 122k recognizes a user's command (voice instruction) for in-vehicle functions, it outputs a voice command to the in-vehicle function execution unit 123k, thereby establishing an association between the VUI function unit 122k and the in-vehicle function execution unit. Speech recognition processing can also include noise removal processing, such as removing background noise from the speech signal, as preprocessing. The VUI function unit 122k can also effectively utilize AI (Artificial Intelligence) for speech recognition and natural language processing. For example, the VUI function unit 122k extracts phonemes using an acoustic model and understands the text structure using language models such as HMM (Hidden Markov Model) and N-gram. The VUI function unit 122k can use not only DNN-HMM (Deep Neural Network-Hidden Markov Model) models but also known models such as End-to-End models.

[0054] The vehicle function execution unit 123k executes vehicle functions associated with the VUI function unit 122k based on voice commands input from the VUI function unit 122k. The vehicle function execution unit 123k can also execute vehicle functions associated with the VUI function unit 122k based on operation commands input by the user through the input unit 11. Specifically, the first vehicle function execution unit 1231 executes vehicle functions associated with the first VUI function unit 1221, and the second vehicle function execution unit 1232 executes vehicle functions associated with the second VUI function unit 1222. There can be one or more vehicle functions associated with the VUI function unit 122k. For example, the vehicle function associated with the first VUI function unit 1221 can be a navigation application developed by this company, and the vehicle function associated with the second VUI function unit 1222 can be a navigation application developed by another company. For example, it can also be set that the vehicle function associated with the first VUI function unit 1221 is a vehicle function that has a significant impact on vehicle safety, and the vehicle function associated with the second VUI function unit 1222 is a vehicle function that has a minor impact on vehicle safety, as well as vehicle functions developed by other companies.

[0055] Next, an example of the operation of a vehicle equipped with the vehicle information processing device 1 according to the first embodiment will be described. Figure 2 This is a flowchart illustrating an example of an action when a user of the vehicle information processing device 1 switches vehicle functions during the period from the start to the end of the operation of the vehicle information processing device 1.

[0056] In S101, when the ignition power is turned on, the vehicle information processing unit 1 is activated. In S102, the vehicle begins to move.

[0057] In S103, the control unit 12 activates the predetermined vehicle function (e.g., the navigation application developed by our company) as the default setting.

[0058] In S104, the VUI management unit 121 starts the VUI function unit 122k associated with the vehicle function that was started in S103, and sets it to standby mode. Here, the first VUI function unit 1221 is set to start.

[0059] In step S105, the user operates the input unit 11 (e.g., touches an icon on the touchscreen) and gives a switching instruction for the vehicle function. That is, the control unit 12 inputs the switching instruction for the vehicle function from the input unit 11. Then, the control unit 12 terminates the vehicle function that is currently in operation and starts a new vehicle function based on the switching instruction.

[0060] In S106, the VUI management unit 121 determines whether the vehicle function switched in S105 is a vehicle function associated with the first VUI function unit 1221. If the switched vehicle function is a vehicle function associated with the first VUI function unit 1221, the VUI management unit 121 proceeds to S107. If the switched vehicle function is a vehicle function associated with the second VUI function unit 1222, the VUI management unit 121 proceeds to S109. The processes from S105 to S110 can be repeated.

[0061] In S107, if the first VUI function unit 1221 is in the startup state, no processing is performed. If the processing in S105 to S110 is repeatedly performed, and the first VUI function unit 1221 becomes shut down during this process, the VUI management unit 121 starts the first VUI function unit 1221 and sets it to standby mode.

[0062] In S108, if the second VUI function unit 1222 is closed, no processing is performed. If the processing in S105 to S110 is repeatedly performed, and the second VUI function unit 1222 becomes active during this process, the VUI management unit 121 terminates the second VUI function unit 1222 and sets it to a non-active state.

[0063] In step S109, the VUI management unit 121 starts the second VUI function unit 1222 and sets it to standby mode. If the processes of S105 to S110 are repeatedly performed, and the second VUI function unit 1222 is turned on during the process, no processing is performed.

[0064] In step S110, the VUI management unit 121 terminates the first VUI function unit 1221 and sets it to a non-started state. If the processes of S105 to S110 are repeatedly performed, and the first VUI function unit 1221 becomes closed during the process, no processing is performed.

[0065] In S111, when the ignition power is turned off, the vehicle information processing unit 1 ends processing.

[0066] Although Figure 2 The example shown illustrates how default vehicle functions are activated upon startup of the in-vehicle information processing unit 1; however, these functions are not necessarily required to be set to default. For example, such as... Figure 3 As shown, the vehicle information processing device 1 can also display icons of multiple vehicle functions on a touchscreen or other screen upon startup, allowing the user to select the vehicle function. Figure 3 The image shows an example of how icons A and B for two in-vehicle functions are displayed.

[0067] Figure 4 This is a flowchart illustrating an example of operation when a user selects a vehicle function when the vehicle information processing device 1 is started. Although there is no limit to the number of vehicle functions, for example, there are two vehicle functions, and the first vehicle function is associated with the first VUI function unit 1221, and the second vehicle function is associated with the second VUI function unit 1222.

[0068] In S201, when the ignition power is turned on, the vehicle information processing unit 1 is activated.

[0069] In S202, the user of the vehicle information processing device 1 operates the input unit 11 (for example, by touching an icon on the touchscreen) and inputs a start instruction for the vehicle function. That is, the control unit 12 inputs the start instruction for the vehicle function from the input unit 11. Then, the control unit 12 starts the vehicle function based on the start instruction.

[0070] In S203, the VUI management unit 121 determines whether the vehicle function activated in S202 is a vehicle function associated with the first VUI function unit 1221. If the vehicle function activated in S202 is a vehicle function associated with the first VUI function unit 1221, the VUI management unit 121 proceeds to S204. If the vehicle function activated in S202 is a vehicle function associated with the second VUI function unit 1222, the VUI management unit 121 proceeds to S206. The processes from S202 to S207 can be repeated.

[0071] In step S204, the VUI management unit 121 starts the first VUI function unit 1221 and sets it to standby mode.

[0072] In S205, if the second VUI function unit 1222 is closed, no processing is performed. If the processing from S202 to S207 is repeatedly performed, and the second VUI function unit 1222 becomes open during this process, the VUI management unit 121 shuts down the second VUI function unit 1222 and sets it to a non-started state.

[0073] In step S206, the VUI management unit 121 starts the second VUI function unit 1222 and sets it to standby mode.

[0074] In S207, if the first VUI function unit 1221 is closed, no processing is performed. If the processing from S202 to S207 is repeatedly performed, and the first VUI function unit 1221 becomes open during this process, the VUI management unit 121 shuts down the first VUI function unit 1221 and sets it to a non-started state.

[0075] In S208, when the ignition power is turned off, the vehicle information processing unit 1 will end the processing.

[0076] Second Implementation Method Next, the vehicle information processing device according to the second embodiment will be described. Figure 5 The vehicle information processing device 1a shown includes an input unit 11, a control unit 12a, a storage unit 13, an output unit 14, and a communication unit 15. The vehicle information processing device 1a and... Figure 1 The operation of the control unit 12a differs from that of the vehicle information processing device 1 shown. Since the other structures are the same as those of the vehicle information processing device 1, descriptions are omitted.

[0077] Although Figure 1 In the vehicle information processing device 1 shown, the number of VUIs N=2, but the vehicle information processing device 1a differs from the vehicle information processing device 1 in that the number of VUIs N=3. That is, the control unit 12a includes a VUI management unit 121, a VUI function unit 122k (a first VUI function unit 1221, a second VUI function unit 1222, and a third VUI function unit 1223), and a vehicle function execution unit 123k (a first vehicle function execution unit 1231, a second vehicle function execution unit 1232, and a third vehicle function execution unit 1233).

[0078] Although Figure 3 The example shown illustrates a scenario with two in-vehicle functions, but in-vehicle functions can also be three or more. For example, such as... Figure 6 As shown, the vehicle information processing device 1a can also display icons A, B, and C of three vehicle functions on a touch screen or other screen when it is started.

[0079] Figure 7 This is a flowchart illustrating an example of operation when a user selects a vehicle function upon startup of the vehicle information processing device 1a. While there is no limit to the number of vehicle functions, for example, there are three vehicle functions, and the first vehicle function is associated with the first VUI function unit 1221, the second vehicle function is associated with the second VUI function unit 1222, and the third vehicle function is associated with the third VUI function unit 1223.

[0080] In S301, the vehicle information processing unit 1a is activated when the ignition power is turned on.

[0081] In step S302, the user operates the input unit 11 and inputs a start instruction for the vehicle function. The control unit 12 then starts the vehicle function based on the start instruction.

[0082] In S303, the VUI management unit 121 determines whether the vehicle function activated in S302 is a vehicle function associated with the first VUI function unit 1221. If the VUI management unit 121 determines that the vehicle function activated in S302 is a vehicle function associated with the first VUI function unit 1221, the process proceeds to S304. If the VUI management unit 121 determines that the vehicle function activated in S302 is not a vehicle function associated with the first VUI function unit 1221, the process proceeds to S306. The processes from S302 to S310 can be repeated.

[0083] In step S304, the VUI management unit 121 starts the first VUI function unit 1221 and sets it to standby mode.

[0084] In S305, if the second VUI function unit 1222 and the third VUI function unit 1223 are closed, no processing is performed. If the processing from S302 to S310 is repeatedly performed, and during this process the second VUI function unit 1222 or the third VUI function unit 1223, or both of them, becomes open, the VUI management unit 121 terminates the open second VUI function unit 1222 or the third VUI function unit 1223 and sets it to a non-started state.

[0085] In S306, the VUI management unit 121 determines whether the vehicle function activated in S302 is a vehicle function associated with the second VUI function unit 1222. If the activated vehicle function is a vehicle function associated with the second VUI function unit 1222, the VUI management unit 121 proceeds to S307. If the activated vehicle function is not a vehicle function associated with the second VUI function unit 1222, the VUI management unit 121 proceeds to S309.

[0086] In step S307, the VUI management unit 121 starts the second VUI function unit 1222 and sets it to standby mode.

[0087] In S308, if the first VUI function unit 1221 and the third VUI function unit 1223 are closed, no processing is performed. If the processing from S302 to S310 is repeatedly performed, and during this process the first VUI function unit 1221 or the third VUI function unit 1223, or both of them, becomes open, the VUI management unit 121 terminates the first VUI function unit 1221 or the third VUI function unit 1223 that has become open, and sets it to a non-starting state.

[0088] In step S309, the VUI management unit 121 starts the third VUI function unit 1223 and sets it to standby mode.

[0089] In S310, if the first VUI function unit 1221 and the second VUI function unit 1222 are closed, no processing is performed. If the processing from S302 to S310 is repeatedly performed, and during this process the first VUI function unit 1221 or the second VUI function unit 1222, or both of them, becomes open, the VUI management unit 121 terminates the first VUI function unit 1221 or the second VUI function unit 1222 that has become open, and sets it to a non-starting state.

[0090] In S311, when the ignition power is turned off, the vehicle information processing unit 1a ends processing.

[0091] Although in the above example, each VUI function unit 122k is associated with a separate vehicle function, multiple vehicle functions can also be associated with a single VUI function unit 122k. Furthermore, multiple vehicle functions can be configured to activate simultaneously. For example, ... Figure 8 As shown, the in-vehicle functions associated with the VUI function unit 122k are a navigation application and a voice application that plays voice (streaming) in the background of the navigation application. The navigation application and the voice application can also be set to be able to start simultaneously.

[0092] like Figure 9As shown, the first VUI function unit 1221 can also be associated with the first navigation application and the first voice application as multiple in-vehicle functions, and the first navigation application and the first voice application can be launched simultaneously. Similarly, the second VUI function unit 1222 can also be associated with the second navigation application and the second voice application as multiple in-vehicle functions, and the second navigation application and the second voice application can be launched simultaneously. Furthermore, it is also possible to launch the first VUI function unit 1221, the first navigation application, and the second voice application simultaneously, or to launch the second VUI function unit 1222, the second navigation application, and the first voice application simultaneously. Moreover, when multiple in-vehicle functions can be launched simultaneously, a priority can be preset for each in-vehicle function. In addition, the priority can also be changed by the user. The priority can also be stored in the storage unit 13.

[0093] exist Figure 9 In the example shown, the first navigation application has a higher priority, and the first voice application has a lower priority. Furthermore, the second navigation application has a higher priority, and the second voice application has a lower priority. Priorities can be set numerically, or by setting values ​​that increase with higher priority levels.

[0094] Figure 10 This is a flowchart illustrating an example of action when a user selects a vehicle function during the startup of in-vehicle information processing devices 1 and 1a. Here, it is assumed that in-vehicle information processing devices 1 and 1a have... Figure 9 The in-vehicle functions shown are assigned priorities.

[0095] In S401, when the ignition power is turned on, the vehicle information processing units 1 and 1a are activated.

[0096] In S402, the user operates the input unit 11 to request the startup of the first navigation application. Then, the control units 12 and 12a start the first navigation application selected by the user.

[0097] In step S403, the VUI management unit 121 starts the first VUI function unit 1221 that has been associated with the first navigation application and sets it to standby mode.

[0098] In step S404, the user operates the input unit 11 to request the launch of the second voice application. Then, the control units 12 and 12a launch the second voice application requested by the user.

[0099] In S405, the VUI management unit 121 compares the priorities of the first navigation application and the second voice application. Here, as... Figure 9 As shown, the first navigation application has a higher priority than the second voice application.

[0100] In S406, since the first navigation application has a higher priority, the VUI management unit 121 does not activate the second VUI function unit 1222 but maintains the activation state of the first VUI function unit 1221. That is, when multiple vehicle functions that have been associated with multiple VUI function units 122k are activated simultaneously, the VUI management unit 121 sets the VUI function unit 122k associated with the highest priority vehicle function to the activated state.

[0101] In S407, when the ignition power is turned off, the vehicle information processing units 1 and 1a cease processing.

[0102] Although the above embodiments described cases where the number of VUIs N is 2 or 3, it is clear that the same processing can be performed when N is 4 or more. Furthermore, the operation is not limited to the examples described above. As explained above, the multiple VUI functions of the vehicle information processing devices 1 and 1a are activated by the same activation statement. Therefore, users do not need to know the combination of activation statements and VUI functions associated with those statements, nor do they need to store multiple activation statements, thereby improving the operability of the vehicle functions. Furthermore, the vehicle information processing devices 1 and 1a can actively incorporate multiple VUI functions. For example, to accommodate different languages ​​in different countries and regions, the vehicle information processing devices 1 and 1a can either incorporate different VUI functions for each language, or incorporate VUI functions developed by suppliers proficient in that language. Moreover, since multiple VUI functions allow users to operate various vehicle functions using voice without taking their eyes off the road, driving safety is improved.

[0103] Furthermore, when a predetermined vehicle function is activated, the vehicle information processing units 1 and 1a only activate the VUI function associated with that vehicle function in response to the activation command. That is, since only the VUI function associated with the vehicle function is in standby mode, and other VUI functions are in active standby mode, the VUI function associated only with the vehicle function listens for the activation command. Therefore, resources are optimized, thereby preventing increased resource consumption by the vehicle information processing units 1 and 1a. Moreover, even for systems with limited resources (e.g., navigation systems), multiple VUI functions can be implemented (e.g., VUI functions optimized for each language). Furthermore, since the vehicle information processing units 1 and 1a do not activate multiple VUI functions simultaneously, they can prevent task scheduling due to parallel processing from causing longer processing times.

[0104] Furthermore, when multiple vehicle functions associated with multiple VUI functions are activated simultaneously, the vehicle information processing units 1 and 1a activate the VUI function associated with the highest priority vehicle function. Therefore, when multiple vehicle functions associated with different VUI functions are to be activated simultaneously, the VUI function to be activated can be appropriately determined.

[0105] program In order to function as the vehicle information processing devices 1 and 1a described above, a computer capable of executing program commands may also be used. The program enables the computer to function as the vehicle information processing devices 1 and 1a by causing the computer to perform the actions described above.

[0106] The program can be pre-stored on a non-transitory computer-readable medium. Examples of non-transitory computer-readable media include flash memory, magnetic recording devices, optical discs, magneto-optical recording media, or ROM. Program distribution can be achieved, for example, by selling, transferring, or renting removable media such as SD (Secure Digital) cards, DVDs (Digital Versatile Discs), or CD-ROMs (Compact Disc Read Only Memory) containing the program. Alternatively, the program can be stored in the server's memory and distributed by forwarding it from the server to other computers. The program can also be provided as a program product.

[0107] The computer stores programs, such as those stored on removable media or forwarded from a server, in the storage unit 13. Furthermore, the computer uses a processor (control unit 12) to read the programs stored in the storage unit 13 and executes the processing performed according to the read programs. The processor can be a CPU (Central Processing Unit), MPU (Micro Processing Unit), SoC (System on a Chip), or multiple processors of the same or different types.

[0108] Computers can also directly read programs from removable media and execute the processing according to the program. Computers can also execute the processing according to the received program each time it is forwarded from a server to the computer. Alternatively, processing can be performed through a so-called ASP (Application Service Provider) type service, which functions solely based on execution instructions and result retrieval, without the transmission of programs from the server to the computer. A program is information for processing performed by a computer and contains information with equivalent functionality to the program. For example, data that, while not direct instructions to the computer, has the nature of specifying the computer's processing is equivalent to "information with equivalent functionality to a program."

[0109] While the above embodiments have been described as representative examples, various modifications or alterations can be made without departing from the spirit of this disclosure. For example, regarding the structural blocks or processing steps described in the embodiments, multiple blocks can be combined into one, or one block can be divided into multiple blocks.

[0110] Hereinafter, some embodiments of the present disclosure will be illustrated. However, it should be noted that the embodiments of the present disclosure are not limited to these embodiments.

[0111] [Postscript 1] A vehicle information processing device with a control unit, wherein the control unit has multiple VUI functions that are activated by the same activation statement, the multiple voice user interface functions are respectively associated with vehicle functions, each of the multiple VUI functions performs voice recognition processing on the user's voice to recognize voice commands for vehicle functions, and executes the associated vehicle function based on the voice commands, and the control unit activates the VUI function associated with the vehicle function in response to the activation statement when a predetermined vehicle function is activated.

[0112] [Postscript 2] A vehicle information processing device having multiple VUI functions that are started with the same startup statement, wherein the multiple VUI functions are respectively associated with a vehicle function, and when a predetermined vehicle function is being started, the VUI function associated with that vehicle function is started in response to the startup statement.

[0113] [Postscript 3] As described in Appendix 1 or Appendix 2, the vehicle-mounted information processing device, wherein, When a switching instruction for in-vehicle functions is input, the new in-vehicle function is activated based on that instruction, and This activates the VUI function associated with the newly launched in-vehicle function and terminates other VUI functions.

[0114] [Postscript 4] As described in any of the appendices 1 to 3, the vehicle-mounted information processing device, wherein, At least one of the VUI functions is associated with multiple in-vehicle functions.

[0115] [Postscript 5] As described in Appendix 4, the vehicle information processing device, in which... This enables multiple in-vehicle functions that have been associated with at least one of the VUI functions to be activated simultaneously.

[0116] [Postscript 6] As described in Appendix 5, the vehicle information processing device, in which... The various in-vehicle functions are each assigned a priority.

[0117] [Postscript 7] As described in Appendix 6, the in-vehicle information processing device, in which, When multiple vehicle functions that are associated with the multiple VUI functions are started simultaneously, the VUI function associated with the highest priority vehicle function is started.

[0118] [Postscript 8] An information processing method is provided for an in-vehicle information processing device having multiple VUI functions that are started with the same startup statement, wherein... The multiple VUI functions are respectively associated with the vehicle functions. In the information processing method, the vehicle information processing device performs the following processing: performing voice recognition processing on the user's voice to recognize the voice command for the vehicle function, and executing the vehicle function based on the voice command; when the predetermined vehicle function is in the process of starting, starting the VUI function associated with the vehicle function based on the start statement.

[0119] [Postscript 9] An information processing method is provided for an in-vehicle information processing device having multiple VUI functions that are started with the same startup statement, wherein... The multiple VUI functions are respectively associated with the vehicle functions. In the information processing method, the vehicle information processing device performs the following processing: when a predetermined vehicle function is in the process of starting, the VUI function associated with the vehicle function is started in response to the start statement.

[0120] [Postscript 10] As described in Appendix 8 or 9, the information processing methods include... The vehicle-mounted information processing device performs the following processing: When a switching instruction for an in-vehicle function is input, the in-vehicle function is newly activated based on the switching instruction; and the VUI function associated with the newly activated in-vehicle function is activated, while other VUI functions are terminated.

[0121] [Postscript 11] For example, the information processing method described in any of Appendix 8 to Appendix 10, wherein... At least one of the VUI functions is associated with multiple in-vehicle functions.

[0122] [Postscript 12] As described in Appendix 11, the information processing method, in which, The vehicle information processing device performs the following process: simultaneously activating multiple vehicle functions that have been associated with at least one of the VUI functions.

[0123] [Postscript 13] As described in Appendix 12, the information processing method, in which, The various in-vehicle functions are each assigned a priority.

[0124] [Postscript 14] As described in Appendix 13, the information processing method, in which, When multiple vehicle functions that are associated with the multiple VUI functions are started simultaneously, the VUI function associated with the highest priority vehicle function is started.

[0125] [Postscript 15] A program for execution by a computer functioning as an in-vehicle information processing device, the in-vehicle information processing device having multiple VUI functions activated by the same startup statement, wherein... The various VUI functions are respectively associated with in-vehicle functions. The program is used to cause the computer to perform the following processes: The system performs speech recognition processing on the user's voice to identify voice commands for in-vehicle functions and executes the in-vehicle functions based on the voice commands; when a predetermined in-vehicle function is in the process of starting, the system starts the VUI function associated with that in-vehicle function in response to the start statement.

[0126] [Postscript 16] A program for execution by a computer functioning as an in-vehicle information processing device, the in-vehicle information processing device having multiple VUI functions activated by the same startup statement, wherein... The various VUI functions are respectively associated with in-vehicle functions. The program is used to cause the computer to perform the following process: when a predetermined vehicle function is in the process of starting, the VUI function associated with the vehicle function is started in response to a startup statement.

[0127] [Postscript 17] The procedure described in Appendix 15 or 16, in which, The program causes the computer to perform the following processes: when a vehicle function switching instruction is input, a new vehicle function is started based on the switching instruction; the VUI function associated with the newly started vehicle function is started, and other VUI functions are terminated.

[0128] [Postscript 18] The procedure described in any of the appendices 15 to 17, wherein, At least one of the VUI functions is associated with multiple in-vehicle functions.

[0129] [Postscript 19] As described in Appendix 18, in which, The program causes the computer to perform the following processes: This enables multiple in-vehicle functions that have been associated with at least one of the VUI functions to be activated simultaneously.

[0130] [Postscript 20] As described in Appendix 19, in which, The multiple vehicle functions are each assigned a priority, and the program causes the computer to perform the following process: when multiple vehicle functions associated with the multiple VUI functions are started simultaneously, the VUI function associated with the vehicle function with the highest priority is started.

Claims

1. A vehicle-mounted information processing device, characterized in that, Equipped with a control unit, The control unit has multiple voice user interface functions that are activated by the same startup statement. The various voice user interface functions are respectively associated with in-vehicle functions. Each of the plurality of voice user interface functions is configured to perform speech recognition processing on the user's voice to recognize a voice command, and to execute an associated in-vehicle function based on the voice command. The control unit is configured to activate a voice user interface function associated with the predetermined vehicle function in response to the activation statement when the predetermined vehicle function is activated.

2. A vehicle-mounted information processing device, characterized in that, It features multiple voice user interfaces that can be launched using the same startup statement. The various voice user interface functions are respectively associated with in-vehicle functions. The in-vehicle information processing device is configured to, when a predetermined in-vehicle function is activated, activate a voice user interface function associated with the predetermined in-vehicle function in response to the activation statement.

3. The vehicle-mounted information processing device as described in claim 2, characterized in that, The vehicle information processing device is configured to, when a vehicle function switching instruction is input, activate a new vehicle function based on the switching instruction, and activate a voice user interface function associated with the newly activated vehicle function, while deactivating other voice user interface functions.

4. The vehicle-mounted information processing device as described in claim 2, characterized in that, At least one of the multiple voice user interface functions is configured to be associated with multiple in-vehicle functions.

5. The vehicle-mounted information processing device as described in claim 4, characterized in that, The in-vehicle information processing device is configured to simultaneously activate the plurality of in-vehicle functions that are associated with at least one of the plurality of voice user interface functions.

6. The vehicle-mounted information processing device as described in claim 5, characterized in that, The various in-vehicle functions are each assigned a priority.

7. The vehicle-mounted information processing device as described in claim 6, characterized in that, The vehicle information processing device is configured to activate the voice user interface function associated with the highest priority vehicle function when multiple vehicle functions associated with the multiple voice user interface functions are activated simultaneously.

8. An information processing method, which is an information processing method executed by an in-vehicle information processing device having the function of activating multiple voice user interfaces with the same activation statement, characterized in that, The various voice user interface functions are respectively associated with in-vehicle functions. The information processing method includes: The in-vehicle information processing device performs voice recognition processing on the user's voice to identify voice commands, and executes the associated in-vehicle functions based on the voice commands; and When a predetermined vehicle function is activated, the in-vehicle information processing device activates a voice user interface function associated with the predetermined vehicle function in response to the activation statement.

9. An information processing method, which is an information processing method executed by an in-vehicle information processing device having the function of activating multiple voice user interfaces with the same activation statement, characterized in that, The various voice user interface functions are respectively associated with in-vehicle functions. The information processing method includes: When a predetermined vehicle function is activated, the in-vehicle information processing device activates a voice user interface function associated with the predetermined vehicle function in response to the activation statement.

10. The information processing method as described in claim 9, characterized in that, include: When the vehicle information processing device receives a vehicle function switching instruction, it restarts the vehicle function based on the switching instruction; and The in-vehicle information processing device activates the voice user interface function associated with the newly activated in-vehicle function and terminates other voice user interface functions.

11. The information processing method as described in claim 9, characterized in that, At least one of the multiple voice user interface functions is configured to be associated with multiple in-vehicle functions.

12. The information processing method as described in claim 11, characterized in that, Also includes: The vehicle information processing device will simultaneously activate the plurality of vehicle functions that have been associated with at least one of the plurality of voice user interface functions.

13. The information processing method as described in claim 12, characterized in that, The various in-vehicle functions are each assigned a priority.

14. The information processing method as described in claim 13, characterized in that, Also includes: When the vehicle information processing device simultaneously activates multiple vehicle functions that are associated with the multiple voice user interface functions, it activates the voice user interface function associated with the highest priority vehicle function.

15. A program product comprising a program for causing a computer functioning as an in-vehicle information processing device to execute, the in-vehicle information processing device having multiple voice user interface functions activated by the same startup statement. The program product is characterized by the following features: The various voice user interface functions are respectively associated with in-vehicle functions. The program causes the computer to perform the following processes: The system performs speech recognition processing on the user's voice to identify voice commands, and executes associated in-vehicle functions based on these commands; and When a predetermined in-vehicle function is activated, the voice user interface function associated with the predetermined in-vehicle function is activated in response to the activation statement.

16. A program product comprising a program for executing a computer functioning as an in-vehicle information processing device, the in-vehicle information processing device having multiple voice user interface functions activated by the same startup statement. The program product is characterized by the following features: The various voice user interface functions are respectively associated with in-vehicle functions. The program causes the computer to perform the following processes: When a predetermined in-vehicle function is activated, the voice user interface function associated with the predetermined in-vehicle function is activated in response to the activation statement.

17. The program product as described in claim 16, characterized in that, The program causes the computer to perform the following processes: When a switching instruction for in-vehicle functions is input, the in-vehicle function is newly activated based on that instruction; and The voice user interface function associated with the newly launched in-vehicle function is activated, and other voice user interface functions are deactivated.

18. The program product as claimed in claim 16, characterized in that, At least one of the multiple voice user interface functions is configured to be associated with multiple in-vehicle functions.

19. The program product as described in claim 18, characterized in that, The program causes the computer to perform the following processes: The multiple in-vehicle functions that have been associated with at least one of the multiple voice user interface functions are simultaneously activated.

20. The program product as described in claim 19, characterized in that, The multiple in-vehicle functions are each assigned a priority, and The program causes the computer to perform the following processes: When multiple in-vehicle functions that are associated with the multiple voice user interface functions are started simultaneously, the voice user interface function associated with the highest priority in-vehicle function is started.

21. A non-transitory storage medium storing commands that enable a computer, functioning as an in-vehicle information processing device, to execute, the in-vehicle information processing device having multiple voice user interface functions activated by the same startup statement. The non-transitory storage medium is characterized in that, The various voice user interface functions are respectively associated with in-vehicle functions. The command causes the computer to perform the following processing: The system performs speech recognition processing on the user's voice to identify voice commands, and executes associated in-vehicle functions based on these commands; and When a predetermined in-vehicle function is activated, the voice user interface function associated with the predetermined in-vehicle function is activated in response to the activation statement.

22. A non-transitory storage medium storing commands that enable a computer, functioning as an in-vehicle information processing device, to execute, the in-vehicle information processing device having multiple voice user interface functions activated by the same startup statement. The non-transitory storage medium is characterized in that, The various voice user interface functions are respectively associated with in-vehicle functions. The command causes the computer to perform the following processing: When a predetermined in-vehicle function is activated, the voice user interface function associated with the predetermined in-vehicle function is activated in response to the activation statement.

23. The non-transitory storage medium as described in claim 22, characterized in that, The command causes the computer to perform the following processing: When a switching instruction for in-vehicle functions is entered, the in-vehicle function is activated based on that switching instruction; The voice user interface function associated with the newly launched in-vehicle function is activated, and other voice user interface functions are deactivated.

24. The non-transitory storage medium as described in claim 22, characterized in that, At least one of the multiple voice user interface functions is configured to be associated with multiple in-vehicle functions.

25. The non-transitory storage medium as described in claim 24, characterized in that, The command causes the computer to perform the following processing: The multiple in-vehicle functions that have been associated with at least one of the multiple voice user interface functions are simultaneously activated.

26. The non-transitory storage medium as described in claim 25, characterized in that, The multiple in-vehicle functions are each assigned a priority, and The command causes the computer to perform the following processing: When multiple in-vehicle functions that are associated with the multiple voice user interface functions are started simultaneously, the voice user interface function associated with the highest priority in-vehicle function is started.

Images