In-vehicle information device and information processing method

Abstract

This in-vehicle information device, which is mounted on a vehicle and transmits a voice signal, including a voice uttered by a user, to a server device for performing a voice recognition process via a mobile terminal, and causes the server device to perform the voice recognition process, comprises a controller for transmitting the voice signal including pseudo noise to the mobile terminal when the voice recognition process performed via the mobile terminal is being executed.

Description

In-vehicle information equipment and information processing method

[0001] The present invention relates to an in-vehicle information device and an information processing method.

[0002] 2. Description of the Related Art There is a communication device that detects a silent section in which the user is not speaking and outputs pseudo background noise, thereby enabling a natural conversation without any interruption.

[0003] Japanese Patent Application Publication No. 4-273621

[0004] On the other hand, when a vehicle occupant is connected to a voice recognition server via a mobile terminal and using the voice recognition function, the noise environment may change significantly (become quieter) due to, for example, the vehicle stopping. In this case, the mobile terminal enters DTX (Discontinuous Transmission) mode, and the next time the user speaks, the voice is transmitted to the server after the DTX mode is released, resulting in the beginning of the speech being cut off and incorrect voice recognition. DTX mode is a mode that reduces the power consumption of the mobile terminal by stopping the transmission of voice signals (voice packets) during silence and transmitting a Mute signal.

[0005] An object of the present invention is to provide a technology that enables more accurate voice recognition processing even when the noise environment inside a vehicle changes significantly.

[0006] In order to solve the above problems, the present invention employs the following means: That is, a first aspect is an in-vehicle information device that is mounted on a vehicle and transmits a voice signal containing a voice uttered by a user to a server device that performs voice recognition processing via a mobile terminal, causing the server device to perform the voice recognition processing, the in-vehicle information device including a controller that transmits the voice signal containing pseudo-noise to the mobile terminal when the voice recognition processing via the mobile terminal is being executed.

[0007] The disclosed aspects may be realized by a program being executed by an information processing device. That is, the disclosed configuration may be specified as a program for causing an information processing device to execute the processes executed by each means in the above aspects, or a computer-readable recording medium on which the program is recorded. The disclosed configuration may also be specified as a method by which an information processing device executes the processes executed by each means. The disclosed configuration may also be specified as a system including an information processing device that performs the processes executed by each means.

[0008] According to the present invention, it is possible to provide a technology that enables more accurate speech recognition processing even when the noise environment inside a vehicle changes significantly.

[0009] Fig. 1 is a diagram showing an example of the configuration of a system according to an embodiment. Fig. 2 is a diagram showing an example of the configuration of an in-vehicle information device 100. Fig. 3 is a diagram showing an example of the hardware configuration of an information processing device. Fig. 4 is a diagram showing an example of the operation sequence of the system according to an embodiment.

[0010] Hereinafter, embodiments of the present invention will be described with reference to the drawings. The configurations of the following embodiments are examples, and the present invention is not limited to the configurations of the embodiments.

[0011] [Embodiment] (Configuration Example) FIG. 1 is a diagram showing a configuration example of a system according to this embodiment. The system according to this embodiment includes a vehicle 10 including an in-vehicle information device 100 and a vehicle information detection unit 200, a mobile terminal 300, and a server device 400. The in-vehicle information device 100 and the vehicle information detection unit 200 are connected to an in-vehicle network established inside the vehicle 10. The in-vehicle information device 100 and the vehicle information detection unit 200 can communicate any information via the in-vehicle network. A CAN (Controller Area Network) or the like can be used as the in-vehicle network. The in-vehicle information device 100 is communicably connected to the mobile terminal 300. The mobile terminal 300 is communicably connected to the server device 400.

[0012] In the system of this embodiment, the in-vehicle information device 100 accepts input of a command to start voice recognition in the mobile terminal 300. The command is issued, for example, by inputting a predetermined voice. The in-vehicle information device 100 transmits the command to the mobile terminal 300. Upon receiving the command, the mobile terminal 300 enters a voice recognition state (a state in which voice recognition processing is being executed). The in-vehicle information device 100 transmits an audio signal including comfort noise along with the command to the mobile terminal 300. The mobile terminal 300 receives the audio signal. The in-vehicle information device 100 accepts voice input for operating the in-vehicle information device 100, etc. The in-vehicle information device 100 transmits an audio signal including the received voice to the mobile terminal 300. The mobile terminal 300 transmits the received audio signal to the server device 400. Upon receiving the audio signal, the server device 400 performs voice recognition processing. The server device 400 transmits a command based on the voice recognition result of the voice recognition processing to the mobile terminal 300. The mobile terminal 300 transmits the received command to the in-vehicle information device 100. The in-vehicle information device 100 executes processing based on the received command. When the mobile terminal 300 receives a command to start voice recognition, it receives an audio signal including comfort noise, thereby preventing it from transitioning to DTX mode after entering the voice recognition state (does not transition to DTX mode). This allows the mobile terminal 300 to transmit an audio signal including voice for operating the in-vehicle information device 100, etc., to the server device 400 without missing the beginning of the voice.

[0013] Comfort noise is random noise such as white noise or pink noise, and is noise at a level that does not affect voice recognition. Furthermore, comfort noise does not necessarily have to be random noise; it can be music, for example. In other words, comfort noise can be any signal at a level that does not affect voice recognition and does not cause the mobile terminal 300 to transition to DTX mode. Comfort noise is an example of pseudo-noise (pseudo-noise signal).

[0014] 2 is a diagram showing an example configuration of the in-vehicle information device 100. The in-vehicle information device 100 includes a control unit 102, a storage unit 104, an input unit 106, an output unit 108, and a communication IF (interface) 110. The control unit 102, the storage unit 104, the input unit 106, the output unit 108, and the communication IF 110 are connected to one another by a communication bus. The in-vehicle information device 100 may be included in a navigation device that calculates a route to a destination, a content playback device that plays content such as video and music, or a vehicle control device that operates an air conditioner, all of which are installed in the vehicle 10. The in-vehicle information device 100 may also be a device that is connected to the navigation device, content playback device, vehicle control device, or the like, all of which are installed in the vehicle 10.

[0015] The control unit 102 controls the entire in-vehicle information device 100. The control unit 102 controls communication with other devices. The control unit 102 accepts audio input via the microphone of the input unit 106. The control unit 102 transmits an audio signal, in which comfort noise is added to the input audio, to the mobile terminal 300 via the communication IF 110. The comfort noise is noise above a predetermined threshold. The control unit 102 is an example of a controller.

[0016] The storage unit 104 stores programs and data used by the control unit 102, provides a working area, and stores operation setting information and the like.

[0017] The input unit 106 is an input means for accepting information input by a user (occupant, user). The input unit 106 includes, for example, a keyboard, a pointing device, a wireless remote control, a touch panel, a camera, a microphone, etc. The input unit 106 is an example of an input interface. The sound input from the microphone of the input unit 106 may be subjected to noise canceling processing and echo canceling processing.

[0018] The output unit 108 is an output means for outputting information etc. to a user etc. The output unit 108 includes a display for displaying text information, images etc., and a speaker for outputting sound etc. The output unit 108 is an example of an output interface.

[0019] The communication IF 110 is a communication interface that communicates with other information processing devices such as the mobile terminal 300 to exchange data via a communication network. The communication IF 110 can be connected to other information processing devices via a well-known wireless communication standard such as a wireless local area network (LAN) or Bluetooth (registered trademark). The communication IF 110 can also be connected to other information processing devices via a well-known wired communication standard such as USB (Universal Serial Bus). The communication IF 110 can be connected to an in-vehicle network and communicate with other devices connected to the in-vehicle network. The communication IF 110 is an example of an in-vehicle communication unit.

[0020] The vehicle information detection unit 200 includes a plurality of on-board sensors installed in the vehicle 10, and generates vehicle information using the detection results from each on-board sensor. The vehicle information is generated sequentially, for example, at a predetermined cycle. The generated vehicle information is sequentially transmitted to the on-board information device 100, etc. The vehicle information detection unit 200 may generate and transmit vehicle information in response to a request from the on-board information device 100, etc. The on-board sensors include, for example, a vehicle speed detection unit, an engine detection unit, etc. The vehicle speed detection unit detects the traveling speed (vehicle speed) of the vehicle 10. The engine detection unit detects whether the engine of the vehicle 10 is operating. The vehicle information detection unit 200 is connected to an on-board network of the vehicle 10, and can communicate with other devices connected to the on-board network.

[0021] The mobile terminal 300 enters a voice recognition state upon receiving a command to start voice recognition processing, such as a predetermined voice. In the voice recognition mode, the mobile terminal 300 transmits the received voice (voice signal) to the server device 400. The mobile terminal 300 receives a command based on the voice recognition result of the transmitted voice from the server device 400. Here, the mobile terminal 300 receives a command to start voice recognition processing, based on the predetermined voice acquired by the in-vehicle information device 100. The mobile terminal 300 also transmits a command based on the voice recognition result to the in-vehicle information device 100. The mobile terminal 300 also receives voice input (voice signal) acquired by the in-vehicle information device 100. In the voice recognition state, the mobile terminal 300 transitions to a DTX mode if the voice level (volume) of the voice signal is below a threshold. The DTX mode is a mode that reduces power consumption by transmitting a mute signal (silence signal) to the server device 400 instead of a voice signal. When mobile terminal 300 receives an audio input of a level equal to or higher than a threshold while in DTX mode, it cancels the DTX mode. Mobile terminal 300 may be controlled to transition to and cancel the DTX mode in response to an instruction from in-vehicle information device 100. Mobile terminal 300 may be realized by a smartphone, a tablet terminal, or the like. Mobile terminal 300 is communicably connected to in-vehicle information device 100 via USB, wireless LAN, Bluetooth (registered trademark), or the like.

[0022] The server device 400 receives a voice signal or the like from the mobile terminal 300 in a voice recognition state, and performs a voice recognition process on the voice signal. The server device 400 transmits a command based on the voice recognition result to the mobile terminal 300. The server device 400 performs the voice recognition process using well-known voice recognition technology. By performing the voice recognition process in the server device 400, the load on the mobile terminal 300 or the like can be reduced.

[0023] FIG. 3 is a diagram showing an example of the hardware configuration of an information processing device. The information processing device 90 shown in FIG. 3 has the configuration of a general computer. The in-vehicle information device 100, the mobile terminal 300, and the server device 400 are realized by the information processing device 90 shown in FIG. 3. The information processing device 90 in FIG. 3 has a processor 91, a memory 92, a storage unit 93, an input unit 94, an output unit 95, and a communication control unit 96. These components are connected to each other by a bus. The memory 92 and the storage unit 93 are computer-readable recording media. The hardware configuration of the computer is not limited to the example shown in FIG. 3, and components may be omitted, replaced, or added as appropriate.

[0024] The information processing device 90 has a processor 91 that loads a program stored on a recording medium into a working area of ​​a memory 92 and executes it, and each component is controlled through the execution of the program, thereby realizing functions that meet a specified purpose.

[0025] The processor 91 is, for example, a CPU (Central Processing Unit). The processor 91 is not limited to a single processor and may have a multi-processor configuration. Furthermore, a single control unit 102 connected via a single socket may have a multi-core configuration. The processor 91 deploys a program stored in the storage unit 93 in an executable manner in a working area of ​​the memory 92, and provides functions that meet a predetermined purpose by controlling peripheral devices and the like through the execution of the program. The processor 91 may include a dedicated large-scale integration (LSI) such as a digital signal processor (DSP), an application-specific integrated circuit (ASIC), or a field-programmable gate array (FPGA), or other digital circuits.

[0026] The memory 92 includes, for example, a random access memory (RAM) and a read only memory (ROM). The memory 92 is also called a main storage device.

[0027] The storage unit 93 is, for example, an erasable programmable read only memory (EPROM) or a hard disk drive (HDD). The storage unit 93 may also include removable media, i.e., portable recording media. The removable media may be, for example, a universal serial bus (USB) memory or a disk recording medium such as a compact disc (CD) or a digital versatile disc (DVD). The storage unit 93 is also called an auxiliary storage device.

[0028] The storage unit 93 stores various programs, various data, and various tables in a readable and writable recording medium. The storage unit 93 stores an operating system (OS), various programs, various tables, etc. The information stored in the storage unit 93 may be stored in the memory 92. Furthermore, the information stored in the memory 92 may be stored in the storage unit 93. Examples of recording media include silicon disks including nonvolatile semiconductor memories (flash memories), hard disks, CDs, DVDs, etc.

[0029] The operating system is software that mediates between software and hardware, manages memory space, manages files, and manages processes and tasks. The operating system also includes a communication interface. The communication interface is a program that exchanges data with other external devices connected via the communication control unit 96. Examples of external devices include other computers and external storage devices.

[0030] The input unit 94 includes a keyboard, a pointing device, a wireless remote control, a touch panel, etc. The input unit 94 may also include an input device for video or images such as a camera, and an input device for audio such as a microphone.

[0031] The output unit 95 includes a display device such as an LCD (Liquid Crystal Display), an EL (Electroluminescence) panel, a CRT (Cathode Ray Tube) display, a PDP (Plasma Display Panel), a printer, etc. The output unit 95 may also include an audio output device such as a speaker.

[0032] The communication control unit 96 connects to other devices and controls communication between the information processing device 90 and the other devices. The communication control unit 96 is, for example, a USB, a LAN (Local Area Network) interface board, a wireless communication circuit for wireless communication, or a communication circuit for wired communication. The LAN interface board and the wireless communication circuit are connected to a network such as the Internet. Bluetooth (registered trademark), wireless LAN, etc. may be used as a wireless communication standard.

[0033] The computer that implements the in-vehicle information device 100 implements the functions of each functional unit by having the processor load a program stored in an auxiliary storage device into a main storage device and execute the program. That is, each functional block in FIG. 2 is implemented as a software algorithm executed by the processor. However, the embodiment is not limited to this, and some or all of the functional blocks may be implemented as individual hardware circuits. The same applies to the mobile terminal 300 and the server device 400.

[0034] (Operation Example) Fig. 4 is a diagram showing an example of an operation sequence of the system of this embodiment. The operation sequence of Fig. 4 shows an example of an operation sequence between the in-vehicle information device 100, the mobile terminal 300, and the server device 400. Here, an operation from the start of voice recognition processing by the mobile terminal 300 (and the server device 400) to the execution of processing based on a command will be described.

[0035] In SQ101, the control unit 102 of the in-vehicle information device 100 of the vehicle 10 receives, via the microphone of the input unit 106, a predetermined voice input instructing the mobile terminal 300 to start voice recognition processing. The predetermined voice is, for example, a predetermined phrase. The control unit 102 receives the input by detecting the predetermined voice input by the input unit 106 through voice recognition processing. The control unit 102 may receive the input instructing the mobile terminal 300 to start voice recognition processing via the keyboard, buttons, touch panel, camera, or the like of the input unit 106. For example, the control unit 102 may receive the input instructing the mobile terminal 300 to start voice recognition processing via an operation on a button of the input unit 106 provided on the steering wheel of the vehicle 10. The control unit 102 may also receive the input by recognizing a predetermined gesture by the user from an image captured by the camera of the input unit 106. When the control unit 102 receives the input instructing the mobile terminal 300 to start voice recognition processing, the process proceeds to SQ102.

[0036] In SQ102, the control unit 102 of the in-vehicle information device 100 transmits a command to start voice recognition processing (a command to start voice recognition processing (voice recognition command)) to the mobile terminal 300 via the communication IF 110. Furthermore, the control unit 102 generates a voice signal by adding comfort noise to voice acquired from the microphone of the input unit 106. The control unit 102 transmits the generated voice signal to the mobile terminal 300 via the communication IF 110. Here, the comfort noise is noise having a volume equal to or greater than a threshold. The threshold is the voice volume at which the mobile terminal 300 transitions to the DTX mode. The voice signal including the comfort noise prevents the mobile terminal 300 from transitioning to the DTX mode even when the level (volume) of the voice acquired from the microphone is below the threshold. The control unit 102 may adjust the comfort noise so that the voice volume of the voice signal is equal to or greater than the threshold when the comfort noise is added to the voice acquired from the microphone of the input unit 106. At this time, the control unit 102 measures the level (volume) of the voice acquired from the microphone of the input unit 106, and determines the noise volume obtained by subtracting the level from the threshold as comfort noise. The mobile terminal 300 receives a command to start voice recognition processing and a voice signal including comfort noise from the in-car information device 100. The control unit 102 continues to transmit the voice signal including comfort noise even after transmitting the command to start voice recognition processing to the mobile terminal 300. The voice acquired from the microphone of the input unit 106 may include sounds (noise) generated in the vehicle 10. The voice acquired from the microphone of the input unit 106 is voice inside the vehicle 10.

[0037] In SQ103, upon receiving a command instructing the start of voice recognition processing, the mobile terminal 300 starts voice recognition processing. At this time, the mobile terminal 300 enters a voice recognition state. The mobile terminal 300 also receives an audio signal including comfort noise from the in-vehicle information device 100. Because the audio level of the audio signal is equal to or greater than a threshold, the mobile terminal 300 does not transition to DTX mode.

[0038] In SQ104, the control unit 102 of the in-vehicle information device 100 accepts voice input via the microphone of the input unit 106. The voice is uttered, for example, by the driver or passenger of the vehicle 10. The driver or passenger of the vehicle 10 is an example of a user. The voice is, for example, voice that generates a command to operate the in-vehicle information device 100 or a device connected to the in-vehicle information device 100 (such as a navigation device, a content playback device, or a vehicle control device). After transmitting a command instructing the start of voice recognition in SQ102, the control unit 102 accepts voice input via the microphone of the input unit 106.

[0039] In SQ105, the control unit 102 of the in-vehicle information device 100 transmits an audio signal containing the voice received by the input unit 106 to the mobile terminal 300 via the communication IF 110. At this time, the control unit 102 may convert the audio signal into an audio signal obtained by adding comfort noise, which is noise with a volume equal to or greater than the threshold, to the audio. The control unit 102 may measure the level (volume) of the audio acquired from the microphone of the input unit 106 and transmit an audio signal obtained by adding noise with a volume equal to or greater than the threshold as comfort noise to the audio. The mobile terminal 300 receives an audio signal from the in-vehicle information device 100. The audio acquired from the microphone of the input unit 106 may include not only the user's voice but also sounds (noises) generated in the vehicle 10. The audio acquired from the microphone of the input unit 106 is audio inside the vehicle 10.

[0040] In SQ106, the mobile terminal 300 transmits the audio signal received from the in-car information device 100 to the server device 400. The server device 400 receives the audio signal from the mobile terminal 300.

[0041] The operations from SQ104 to SQ106 continue until the in-vehicle information device 100 receives a command.

[0042] In SQ107, the server device 400 performs a voice recognition process on the voice signal received from the mobile terminal 300 using a well-known voice recognition technology. The server device 400 generates a command based on the voice recognition result. The command is, for example, a command to operate the in-vehicle information device 100. The command is an example of result data.

[0043] In SQ108, server device 400 transmits the generated command to mobile terminal 300. Mobile terminal 300 receives the command from server device 400.

[0044] In SQ109, the mobile terminal 300 transmits the command received from the server device 400 to the in-car information device 100. The control unit 102 of the in-car information device 100 transmits the command to the mobile terminal 300 via the communication IF 110.

[0045] In SQ110, the control unit 102 of the in-vehicle information device 100 performs processing based on the received command, thereby causing the in-vehicle information device 100 to execute the command based on the voice input by the user.

[0046] If the mobile terminal 300 does not receive an audio signal including comfort noise in SQ103 (i.e., the in-vehicle information device 100 does not transmit an audio signal including comfort noise), the mobile terminal 300 may transition to DTX mode. For example, after the mobile terminal 300 receives a command to start speech recognition processing using a predetermined voice or the like and enters a speech recognition state, the user may not immediately utter the next utterance, resulting in a "pause." In such a case, the mobile terminal 300 may transition to DTX mode. In particular, when the mobile terminal 300 enters the speech recognition state while the vehicle 10 is running or the engine is running, and then the vehicle is stopped or the engine is shut off, creating a quiet environment inside the vehicle 10, the mobile terminal 300 is likely to transition to DTX mode. This is because noise (rumble) inside the vehicle cabin is loud while the vehicle is running or the engine is running, and the threshold for the audio level (volume) of the audio signal at which mobile terminal 300 transitions to DTX mode may be set high, and when the vehicle cabin subsequently becomes quiet, the level (volume) of the audio acquired from the microphone decreases, and mobile terminal 300 is likely to fall below the audio level (volume) threshold for the audio signal at which it transitions to DTX mode. In other words, in an environment such as a vehicle cabin where the noise environment changes significantly, particularly in an environment where the noise inside the vehicle cabin changes from a loud state to a quiet state, it can be said that there is a high possibility that mobile terminal 300 will transition to DTX mode.

[0047] In this case, when the mobile terminal 300 receives a voice signal (a voice signal including a voice level above the threshold) resulting from the user's next speech (after a pause), the mobile terminal 300 will cancel the DTX mode. At this time, the beginning of the user's speech may be lost due to a time lag until the DTX mode is canceled. In other words, the beginning of the user's speech may not be transmitted to the server device 400, resulting in incorrect speech recognition in the server device 400. In particular, when the volume of the user's speech is not sufficiently loud relative to the threshold for switching to the DTX mode, the time lag until the DTX mode is canceled becomes large, resulting in failure of speech recognition in the server device 400.

[0048] In this embodiment, because the portable terminal 300 receives a voice signal including comfort noise, the portable terminal 300 is prevented from transitioning to the DTX mode after the voice recognition process is started. As a result, even if a "pause" occurs in the user's speech and the volume of the user's speech is not sufficiently loud relative to the threshold for transitioning to the DTX mode, particularly in an environment where the noise level in the vehicle cabin changes from high to low, it is possible to prevent the beginning of the user's speech from being lost, and the server device 400 can perform correct voice recognition.

[0049] In SQ102 and SQ105, the control unit 102 of the in-vehicle information device 100 may not add comfort noise to the audio signal when the engine of the vehicle 10 is running. In this case, the control unit 102 constantly acquires information on whether the engine of the vehicle 10 is running from the engine detection unit of the vehicle information detection unit 200 via the communication IF 110. When the engine of the vehicle 10 is running, noise above a threshold is expected to be generated, and therefore the volume of the audio signal is considered to be above the threshold even without adding comfort noise. Therefore, in this case, the mobile terminal 300 does not transition to DTX mode. When the engine of the vehicle 10 is not running, the control unit 102 performs the same operations as in SQ102 and SQ105.

[0050] Furthermore, in SQ102 and SQ105, the control unit 102 of the in-vehicle information device 100 may not add comfort noise to the voice signal when the vehicle speed of the vehicle 10 is equal to or greater than a predetermined value. In this case, the control unit 102 constantly acquires information about the vehicle speed of the vehicle 10 from the vehicle speed detection unit of the vehicle information detection unit 200 via the communication IF 110. When the vehicle speed of the vehicle 10 is equal to or greater than the predetermined value, noise equal to or greater than a threshold is expected to be generated. Therefore, even if comfort noise is not added, the volume of the voice signal is considered to be equal to or greater than the threshold. Therefore, in this case, the mobile terminal 300 does not transition to DTX mode. When the vehicle speed of the vehicle 10 is less than the predetermined value, the control unit 102 performs the same processing as in SQ102 and SQ105. This enables the system of this embodiment to perform more accurate voice recognition processing even when the vehicle speed of the vehicle 10 decreases and the interior of the vehicle 10 becomes quieter.

[0051] Furthermore, in SQ102 and SQ105, the control unit 102 of the in-vehicle information device 100 may not add comfort noise to the audio signal when the level (volume) of the audio inside the vehicle 10 is equal to or greater than the threshold. In this case, even if the control unit 102 does not add comfort noise, the audio volume of the audio signal is equal to or greater than the threshold. Therefore, in this case, the mobile terminal 300 does not transition to DTX mode. When the level (volume) of the audio inside the vehicle 10 is less than the threshold, the control unit 102 performs the same operations as in SQ102 and SQ105. This allows the system of this embodiment to perform more accurate voice recognition processing even when the inside of the vehicle 10 is quiet.

[0052] Furthermore, in SQ105, the control unit 102 of the in-vehicle information device 100 may not add comfort noise to the audio signal when detecting a user's voice through the microphone of the input unit 106. Detection of the user's voice can be achieved by a well-known method. In this case, the control unit 102 considers that the volume of the audio signal is equal to or greater than a threshold without adding comfort noise. The control unit 102 may also measure the level (volume) of the user's voice (audio) and transmit an audio signal in which noise with a volume calculated by subtracting the level from the threshold is added to the voice (audio) as comfort noise. The noise with a volume calculated by subtracting the level from the threshold is an example of pseudo-noise with a volume based on the volume of the user's voice. In this case, the mobile terminal 300 does not transition to DTX mode. This prevents the system of this embodiment from transitioning to DTX mode, enabling more accurate voice recognition processing.

[0053] Furthermore, the mobile terminal 300 may constantly transmit information (notification) indicating whether the mobile terminal 300 itself is charging to the in-vehicle information device 100. In this case, when the control unit 102 of the in-vehicle information device 100 receives notification that the mobile terminal 300 is charging, the control unit 102 adds comfort noise to the audio signal even if the audio signal does not already include comfort noise. When the mobile terminal 300 is charging, the mobile terminal 300 does not need to transition to DTX mode, which is intended to save power. Therefore, the system of this embodiment prevents the mobile terminal 300 from transitioning to DTX mode by constantly including comfort noise in the audio signal. This allows for more accurate voice recognition processing by not transitioning to DTX mode while the mobile terminal 300 is charging.

[0054] (Operations and Effects of the Embodiment) In the system of this embodiment, the in-vehicle information device 100 accepts an input of a command to start voice recognition processing in the mobile terminal 300. The in-vehicle information device 100 transmits the command to the mobile terminal 300. Upon receiving the command, the mobile terminal 300 enters a state in which voice recognition processing is being executed. Furthermore, the in-vehicle information device 100 transmits an audio signal containing comfort noise to the mobile terminal 300 along with the command. When the mobile terminal 300 receives the command to start voice recognition, the mobile terminal 300 receives the audio signal containing comfort noise, thereby preventing the mobile terminal 300 from transitioning to DTX mode after entering the voice recognition state. This allows the mobile terminal 300 to transmit an audio signal containing voice for operating the in-vehicle information device 100, etc., to the server device 400 without missing the beginning of the voice. In other words, the system of this embodiment enables more accurate voice recognition.

[0055] Although the embodiments of the present invention have been described above, these are merely examples, and the present invention is not limited to these. Various modifications based on the knowledge of those skilled in the art are possible as long as they do not deviate from the spirit of the claims.

[0056] 10: Vehicle 90: Information processing device 91: Processor 92: Memory 93: Storage unit 94: Input unit 95: Output unit 96: Communication control unit 100: In-vehicle information device 102: Control unit 104: Storage unit 106: Input unit 108: Output unit 110: Communication IF 200: Vehicle information detection unit 300: Portable terminal 400: Server device

Claims

1. An in-vehicle information device that is mounted on a vehicle and transmits a voice signal including a voice spoken by a user to a server device that performs voice recognition processing via a mobile terminal, causing the server device to perform the voice recognition processing, the in-vehicle information device comprising a controller that transmits the voice signal including pseudo-noise to the mobile terminal when the voice recognition processing via the mobile terminal is being executed.

2. The in-vehicle information device according to claim 1, wherein the controller starts transmitting the voice signal including the pseudo-noise to the mobile terminal when a command to start the voice recognition process is input.

3. The in-vehicle information device of claim 1, wherein the controller starts transmitting the voice signal including the pseudo-noise to the mobile terminal when a command to start the voice recognition process is input and the volume of the voice inside the vehicle is less than a threshold value.

4. The in-vehicle information device of claim 1, wherein the controller starts transmitting the voice signal including the pseudo-noise to the mobile terminal when a command to start the voice recognition process is input and the vehicle speed is less than a predetermined value.

5. The in-vehicle information device according to claim 1, wherein the controller starts transmitting the voice signal including the pseudo-noise to the mobile terminal when a command to start the voice recognition process is input and the vehicle engine is not running.

6. The in-vehicle information device according to claim 1, wherein the controller transmits the voice signal including the pseudo-noise to the mobile terminal if the volume of the voice inside the vehicle is less than a threshold value when the voice recognition process is being performed.

7. The in-vehicle information device according to claim 1, wherein the controller transmits the voice signal including the pseudo noise to the mobile terminal if the vehicle speed is less than a predetermined value while the voice recognition process is being executed.

8. The in-vehicle information device according to claim 1, wherein the controller transmits the voice signal including the pseudo-noise to the mobile terminal when the voice recognition process is being executed and the engine of the vehicle is not running.

9. An in-vehicle information device according to any one of claims 6 to 8, wherein the controller starts transmitting the voice signal including the pseudo-noise to the portable terminal when the controller receives a notification from the portable terminal that the portable terminal is being charged while the voice recognition process is being executed.

10. An in-vehicle information device as described in any one of claims 1 to 8, wherein the controller does not transmit the voice signal including the pseudo-noise to the mobile terminal when it detects an utterance by the user while the voice recognition process is being executed.

11. An in-vehicle information device as described in any one of claims 1 to 8, wherein when the controller detects an utterance by the user while the voice recognition process is being executed, the controller transmits the voice signal including the pseudo-noise whose volume is based on the volume of the utterance by the user.

12. An information processing method using an in-vehicle information device that is mounted on a vehicle and transmits a voice signal including a voice uttered by a user to a server device that performs voice recognition processing via a mobile terminal, causing the server device to perform the voice recognition processing, wherein the in-vehicle information device transmits the voice signal including pseudo-noise to the mobile terminal when the voice recognition processing is being performed.

13. An information processing method in which a server device communicating with a mobile terminal performs voice recognition processing of a voice signal including voice spoken by an occupant of a vehicle equipped with an in-vehicle information device, thereby performing voice recognition of the voice spoken by the occupant, wherein the in-vehicle information device transmits a voice recognition command and a pseudo-noise signal to the mobile terminal, transmits the voice signal to the mobile terminal while continuing to transmit the pseudo-noise signal, and receives result data of the voice recognition processing performed by the server device via the mobile terminal.

Images