Voice guide device, vehicle, and non-transitory computer readable medium

Abstract

The present invention provides a voice guidance device, a vehicle, and a non-transitory computer-readable medium capable of enabling a user to set a voice guidance volume in a vehicle in consideration of the influence of noise having different volume levels. A voice guidance device (20) is provided with a control unit that accepts, for each volume level of noise detectable in a vehicle (12), a setting of the volume of voice guidance output in the vehicle (12), and performs a process that, when the voice guidance is output, if noise is detected in the vehicle (12), the setting of the volume of the voice guidance output in the vehicle (12) is accepted, and if the noise is detected in the vehicle (12), the setting of the volume of the voice guidance output in the vehicle (12) is accepted. The volume of the voice guide is adjusted to the set volume corresponding to the volume level of the detected noise.

Description

Technical Field

[0001] The present disclosure relates to a voice guidance device, a vehicle, and a program. Background Art

[0002] In Patent Document 1, there is disclosed a car audio system that automatically adjusts the volume according to the driving state of a vehicle.

[0003] Prior Art Documents

[0004] Patent Documents

[0005] Patent Document 1: Japanese Patent Laid-Open No. 11-184475 Summary of the Invention

[0006] Problems to be Solved by the Invention

[0007] Generally, regarding the volume of voice guidance in a vehicle, a user can set it on a setting screen. However, in a silent environment such as when the vehicle is stopped, the volume is set without considering the influence of various noises that may occur during vehicle driving, and as a result, it may be difficult to hear the voice guidance clearly during vehicle driving.

[0008] An object of the present disclosure is to enable a user to set the volume of voice guidance in a vehicle while considering the influence of noises with different volume levels.

[0009] Means for Solving the Problems

[0010] The voice guidance device according to the present disclosure includes a control unit that performs the following processing: for each volume level of noises that can be detected in the vehicle, accepts the setting of the volume of voice guidance input in the vehicle, and when a noise is detected in the vehicle during the output of the voice guidance, adjusts the volume of the voice guidance to the set volume corresponding to the detected volume level of the noise.

[0011] The program according to the present disclosure causes a computer to execute the following actions, which include: for each volume level of noises that can be detected in the vehicle, accepts the setting of the volume of voice guidance output in the vehicle; and when a noise is detected in the vehicle during the output of the volume guidance, adjusts the volume of the voice guidance to the set volume corresponding to the detected volume level of the noise.

[0012] Advantages of the Invention

[0013] According to the present disclosure, a user can set the volume of voice guidance in a vehicle while considering the influence of noises with different volume levels. Brief Description of the Drawings

[0014] Figure 1 A diagram showing an example of a vehicle equipped with the voice guidance device according to an embodiment of the present disclosure.

[0015] Figure 2 A table showing an example of the setting information stored in the voice guidance device according to an embodiment of the present disclosure.

[0016] Figure 3 A block diagram showing the structure of the voice guidance device according to an embodiment of the present disclosure.

[0017] Figure 4 A flowchart showing the operations related to the setting of the volume of the voice guidance of the voice guidance device according to an embodiment of the present disclosure.

[0018] Figure 5 A flowchart showing the operations related to the output of the voice guidance of the voice guidance device according to an embodiment of the present disclosure. Detailed Embodiment

[0019] Hereinafter, an embodiment of the present disclosure will be described with reference to the drawings.

[0020] In each drawing, the same or corresponding parts are denoted by the same reference numerals. In the description of the present embodiment, the description of the same or corresponding parts will be appropriately omitted or simplified.

[0021] Refer to Figure 1 and Figure 2 to describe the outline of the present embodiment.

[0022] The voice guidance device 20 is a computer having a voice guidance function. In the present embodiment, the voice guidance device 20 is an in-vehicle device such as a navigation device mounted on the vehicle 12. That is, as Figure 1 shown, the voice guidance device 20 is provided on the vehicle 12. As a modification example, the voice guidance device 20 may be a mobile device such as a mobile phone, a smart phone, or a tablet computer owned by the user 11. That is, the voice guidance device 20 may be used by the user 11 in the vehicle 12 instead of being provided on the vehicle 12.

[0023] The vehicle 12 is an automobile of any type such as a gasoline vehicle, a diesel vehicle, a hydrogen energy vehicle, an HEV, a PHEV, a BEV, or an FCEV. "HEV" is an abbreviation for hybrid electric vehicle. "PHEV" is an abbreviation for plug-in hybrid electric vehicle. "BEV" is an abbreviation for battery electric vehicle. "FCEV" is an abbreviation for fuel cell electric vehicle. The vehicle 12 can be driven by the user 11 or the driving can be automated at any level. The level of automation is any one of levels 1 to 5 in the level classification of, for example, SAE. "SAE" is an abbreviation for Society of Automotive Engineers. The vehicle 12 can be a vehicle dedicated to MaaS. "MaaS" is an abbreviation for Mobility as a Service.

[0024] The voice guidance device 20 determines a plurality of volume levels 31 for a first noise that can be detected inside the vehicle 12. For each volume level 31 of the first noise, the voice guidance device 20 accepts the setting of the volume 32 of the voice guidance played inside the vehicle 12. The voice guidance device 20 stores the setting information 30 including the set volume 32 in a manner corresponding to each volume level 31 of the first noise. When playing the voice guidance inside the vehicle 12, the voice guidance device 20 plays the voice guidance at the volume 32 corresponding to the volume level 31 equal to the volume level of the second noise actually detected inside the vehicle 12.

[0025] According to the present embodiment, it is possible to set the volume 32 of the voice guidance played inside the vehicle 12 for each volume level 31 of the first noise that can be detected inside the vehicle 12. Therefore, the user 11 can set the volume 32 of the voice guidance imagining the influence of the noise.

[0026] When the user 11 sets the volume 32 of the voice guidance for several volume levels 31 of the first noise, the voice guidance device 20 can also automatically set the volume 32 of the voice guidance for the remaining volume levels 31 of the first noise by interpolation. In Figure 2In the example shown, for the three volume levels 31 of "0", "2", and "4" in the range from "0" to "5", the volumes 32 are manually set to "10", "20", and "45" respectively. Therefore, for the volume level 31 of "1", the volume 32 is automatically set to the intermediate value "15" of the volumes 32 corresponding to the two volume levels 31 of "0" and "2". For the volume level 31 of "3", the volume 32 is automatically set to the intermediate value "32" of the volumes 32 corresponding to the two volume levels 31 of "2" and "4". As a modification example, the volume 32 corresponding to the volume level 31 of "3" can also be automatically set to "33" considering the digits after the decimal point. For the volume level 31 of "5", the volume 32 is automatically set to the upper limit value "50". As a modification example, if there is no upper limit value or the upper limit value is large enough to be ignored, the volume 32 corresponding to the volume level 31 of "5" can also be automatically set to "58" according to the changes in the volumes 32 corresponding to the two volume levels 31 of "3" and "4".

[0027] It can also be set that the voice guidance device 20 stores the sampling of the first noise as the noise sampling 33 in a manner corresponding to each volume level 31 of the first noise. Moreover, it can be set that when the voice guidance device 20 accepts the setting of the volume 32 of the voice guidance, while playing the noise sampling 33 corresponding to the volume level 31 specified by the user 11, it accepts the setting of the volume 32 corresponding to the same volume level 31.

[0028] It can also be set that the voice guidance device 20 stores the position of the vehicle 12 when the third noise is detected as the position information 34 in a manner corresponding to the volume level equal to the volume level of the third noise actually detected in the vehicle 12 in the past. Moreover, it can be set that when the voice guidance device 20 accepts the setting of the volume 32 of the voice guidance, it presents the position information 34 corresponding to the volume level 31 of the playing noise sampling 33 to the user 11. For example, the voice guidance device 20 can display on the screen or output by voice a message such as "Playing noise at the same volume level as when passing through...".

[0029] Alternatively, it can be set that the voice guidance device 20 stores the image outside the vehicle 12 when the third noise is detected as the scene image 35 in a manner corresponding to the volume level 31 equal to the volume level of the third noise actually detected inside the vehicle 12 in the past. Moreover, it can be set that when the voice guidance device 20 accepts the setting of the voice guidance volume 32, the voice guidance device 20 presents the scene image 35 corresponding to the volume level 31 of the currently playing noise sample 33 to the user 11. For example, the voice guidance device 20 can play the driving recorder image captured when the third noise with the same volume level as the currently playing noise sample 33 is detected.

[0030] Refer to Figure 3 , the structure of the voice guidance device 20 according to the present embodiment will be described.

[0031] The voice guidance device 20 includes a control unit 21, a storage unit 22, a communication unit 23, an input unit 24, an output unit 25, and a positioning unit 26.

[0032] The control unit 21 includes at least one processor, at least one programmable circuit, at least one dedicated circuit, or any combination thereof. The processor is a general-purpose processor such as a CPU or a GPU, or a dedicated processor dedicated to specific processing. "CPU" is the abbreviation of central processing unit (central processor). "GPU" is the abbreviation of graphics processing unit (graphics processor). The programmable circuit is, for example, an FPGA. "FPGA" is the abbreviation of field-programmable gate array (field programmable gate array). The dedicated circuit is, for example, an ASIC. "ASIC" is the abbreviation of application specific integrated circuit (application specific integrated circuit). While controlling each part of the voice guidance device 20, the control unit 21 executes processing related to the operation of the voice guidance device 20.

[0033] The storage unit 22 includes at least one semiconductor memory, at least one magnetic memory, at least one optical memory, or any combination thereof. The semiconductor memory is, for example, RAM, ROM, or flash memory. "RAM" is an abbreviation for random access memory. "ROM" is an abbreviation for read only memory. RAM is, for example, SRAM or DRAM. "SRAM" is an abbreviation for static random access memory. "DRAM" is an abbreviation for dynamic random access memory. ROM is, for example, EEPROM. "EEPROM" is an abbreviation for electrically erasable programmable read only memory. The flash memory is, for example, SSD. "SSD" is an abbreviation for solid-state drive. The magnetic memory is, for example, HDD. "HDD" is an abbreviation for hard disk drive. The storage unit 22 functions as, for example, a main storage device, an auxiliary storage device, or a cache memory. In the storage unit 22, information used in the operation of the voice guidance device 20 and information obtained through the operation of the voice guidance device 20 are stored. For example, setting information 30 is stored in the storage unit 22. The setting information 30 includes a volume 32 set for each volume level 31. As Figure 2 shown, for each volume level 31, the setting information 30 may further include a noise sample 33, position information 34, and a scene image 35.

[0034] The communication unit 23 includes at least one communication module. The communication module is, for example, a module corresponding to a mobile communication standard such as LTE, 4G standard, or 5G standard, or a wireless LAN communication standard such as IEEE 802.11. "LTE" is an abbreviation for Long Term Evolution. "4G" is an abbreviation for 4th generation. "5G" is an abbreviation for 5th generation. "IEEE" is an abbreviation for Institute of Electrical and Electronics Engineers. The communication unit 23 can also communicate with an external server such as a cloud server via a network such as the Internet. The communication unit 23 receives information used in the operation of the voice guidance device 20 and transmits information obtained through the operation of the voice guidance device 20.

[0035] The input unit 24 includes at least one input device. The input device is, for example, a physical key, a capacitive key, a pointing device, a touch screen integrated with a display, a visible light camera, a depth camera, LiDAR, or a microphone. "LiDAR" is an abbreviation for light detection and ranging. The input unit 24 accepts an operation for inputting information used in the operation of the voice guidance device 20. Instead of being provided on the voice guidance device 20, the input unit 24 may be connected to the voice guidance device 20 as an external input device. As a connection interface, an interface corresponding to standards such as USB, HDMI (registered trademark), or Bluetooth (registered trademark) can be used. "USB" is an abbreviation for Universal Serial Bus. "HDMI (registered trademark)" is an abbreviation for High-Definition Multimedia Interface.

[0036] The output unit 25 includes at least one output device. The output device is, for example, a display or a speaker. The display is, for example, an LCD or an organic EL display. "LCD" is an abbreviation for liquid crystal display. "EL" is an abbreviation for electro luminescent. The output unit 25 outputs the information obtained through the operation of the voice guidance device 20. Instead of being provided on the voice guidance device 20, the output unit 25 may be connected to the voice guidance device 20 as an external output device such as a display and audio. As a connection interface, an interface corresponding to standards such as USB, HDMI (registered trademark), or Bluetooth (registered trademark) can be used.

[0037] The positioning unit 26 includes at least one GNSS receiver. "GNSS" is an abbreviation for Global Navigation Satellite System. GNSS is, for example, GPS, QZSS, BDS, GLONASS, or Galileo. "GPS" is an abbreviation for Global Positioning System. "QZSS" is an abbreviation for Quasi-Zenith Satellite System. QZSS satellites are called quasi-zenith satellites. "BDS" is an abbreviation for Beidou Navigation Satellite System. "GLONASS" is an abbreviation for Global Navigation Satellite System. The positioning unit 26 measures the position of the voice guidance device 20.

[0038] The functions of the voice guidance device 20 are realized by a processor, which is the control unit 21, executing the program according to this embodiment. That is, the functions of the voice guidance device 20 are realized by software. The program enables a computer to function as the voice guidance device 20 by executing the operations of the voice guidance device 20. That is, the computer functions as the voice guidance device 20 by executing the operations of the voice guidance device 20 in accordance with the program.

[0039] The program can be pre-stored in a non-temporary computer-readable medium. The non-temporary computer-readable medium is, for example, a flash memory, a magnetic recording device, an optical disc, a magneto-optical recording medium, or a ROM. The distribution of the program is implemented, for example, by selling, transferring, or lending a removable medium such as an SD card, a DVD, or a CD-ROM storing the program. "SD" is an abbreviation for Secure Digital. "DVD" is an abbreviation for digital versatile disc. "CD-ROM" is an abbreviation for compact disc read only memory. The program can also be distributed by pre-storing the program in a server's memory and transmitting the program from the server to other computers. The program can also be provided as a program product.

[0040] A computer, for example, temporarily stores a program stored in a removable medium or a program transmitted from a server in a main storage device. Then, the computer reads the program stored in the main storage device by a processor and executes processing according to the read program by the processor. The computer can also directly read a program from a removable medium and execute processing according to the program. The computer can also execute processing according to the received program sequentially each time a program is transmitted from the server to the computer. It is also possible to execute processing not by transmitting a program from the server to the computer, but by a so-called ASP-type service that realizes functions only based on execution instructions and result acquisition. "ASP" is an abbreviation for application service provider. A program is information for processing to be performed by an electronic computer and includes content regarded as a program. For example, data that is not a direct instruction for a computer but has the property of prescribing the processing of the computer conforms to "content regarded as a program".

[0041] Part or all of the functions of the voice guidance device 20 can also be implemented by a programmable circuit or a dedicated circuit as the control unit 21. That is, part or all of the functions of the voice guidance device 20 can also be implemented by hardware.

[0042] Refer to Figure 4 and Figure 5 , the operation of the voice guidance device 20 according to the present embodiment will be described. The operations described below correspond to the voice guidance method according to the present embodiment. That is, the voice guidance method according to the present embodiment includes Figure 4 the steps of S101 to S107 shown in Figure 5 and the steps of S111 to S114 shown in

[0043] In Figure 4 the process shown, the control unit 21 accepts the setting of the volume 32 of the voice guidance output in the vehicle 12 for each volume level 31 of the noise that can be detected in the vehicle 12.

[0044] Specifically, in S101, the control unit 21 accepts the selection of one volume level 31 from among multiple volume levels 31 via an input unit 24 such as a touch screen or a microphone. In S102, the control unit 21 obtains a noise sample 33 of the volume level 31 selected by the user 11 in S101 from the storage unit 22. The control unit 21 plays the obtained noise sample 33 via an output unit 25 such as a speaker. In S103, the control unit 21 accepts the setting of a volume 32 corresponding to the volume level 31 selected by the user 11 in S101 via the input unit 24 such as a touch screen or a microphone. In S104, the control unit 21 stores the volume 32 manually set by the user 11 in S103 in the storage unit 22 in a manner corresponding to the volume level 31 selected by the user 11 in S101. In S105, the control unit 21 determines whether the manual setting of the volume 32 corresponding to two or more desired volume levels 31 among the multiple volume levels 31 has been completed. As Figure 2 in the example shown, if the volumes 32 corresponding to the three volume levels 31 of "0", "2", and "4" among "0" to "5" are the objects of manual setting, the control unit 21 determines whether the manual setting of the volumes 32 corresponding to these three volume levels 31 has been completed.

[0045] As long as the manual setting of the volume 32 corresponding to two or more desired volume levels 31 is not completed for one of them, in S101 to S104, the control unit 21 accepts the setting of the uncompleted volume 32.

[0046] On the other hand, in the case where the manual setting of the volumes 32 corresponding to two or more desired volume levels 31 is all completed, in S106, the control unit 21 automatically sets the volumes 32 corresponding to the remaining volume levels 31 among the multiple volume levels 31 based on the settings of these completed volumes 32. As Figure 2 in the example shown, if the volumes 32 corresponding to the three volume levels 31 of "1", "3", and "5" among "0" to "5" are the objects of automatic setting, the control unit 21 automatically sets the volumes 32 corresponding to the three volume levels 31 of "1", "3", and "5" by calculation methods such as interpolation based on the settings of the volumes 32 corresponding to the three volume levels 31 of "0", "2", and "4". Then, in S107, the control unit 21 stores the volumes 32 automatically set in S106 in the storage unit 22 in a manner corresponding to the remaining volume levels 31.

[0047] As described above, in S103, while the control unit 21 plays the noise sample 33 at a specific volume level 31, it accepts the setting of the volume 32 corresponding to the specific volume level 31. However, as a modification example, the control unit 21 may also accept the setting of the volume 32 corresponding to the specific volume level 31 without playing the noise sample 33. That is, the step of S102 may be omitted. Or, as another modification example, the control unit 21 may play the noise sample 33 at a specific volume level 31 and, while presenting the position information 34 corresponding to the specific volume level 31 to the user 11, accept the setting of the volume 32 corresponding to the specific volume level 31. That is, in S102, the control unit 21 may also obtain the position information 34 corresponding to the volume level 31 of the played noise sample 33 from the storage unit 22 and output it via the output unit 25 such as a display or a speaker. Or, as yet another modification example, the control unit 21 may play the noise sample 33 at a specific volume level 31 and, while playing the scene image 35 corresponding to the specific volume level 31, accept the setting of the volume 32 corresponding to the specific volume level 31. That is, in S102, the control unit 21 may also obtain the scene image 35 corresponding to the volume level 31 of the played noise sample 33 from the storage unit 22 and play it via the output unit 25 such as a display.

[0048] As described above, in S105, the control unit 21 determines whether the manual setting of the volume 32 corresponding to two or more desired volume levels 31 among the multiple volume levels 31 has been completed. However, as a modification example, the control unit 21 may also determine whether the manual setting of the volume 32 corresponding to all of the multiple volume levels 31 has been completed. That is, the steps of S106 and S107 may be omitted.

[0049] In Figure 5 the shown process, the control unit 21 outputs a voice guidance. When the control unit 21 outputs the voice guidance, if noise is detected inside the vehicle 12, it adjusts the volume of the voice guidance to the set volume 32 corresponding to the volume level 31 of the detected noise.

[0050] Specifically, in S111, the control unit 21 determines whether some noise such as noise generated by the vehicle 12 itself during the travel of the vehicle 12 or noise entering from outside the vehicle 12 is detected via the input unit 24 such as a microphone.

[0051] In the case where no noise is detected, in S112, the control unit 21 outputs the voice guidance via the output unit 25 such as a speaker at the volume 32 stored corresponding to the lowest volume level 31. In Figure 2In the example shown, the control unit 21 adjusts the volume of the voice guidance to the volume 32 corresponding to the volume level 31 of "0", that is, adjusts it to "10". The control unit 21 can also notify the user 11 of the current volume level "0" of the noise via the output unit 25 such as a display or a speaker.

[0052] On the other hand, in the case where noise is detected, in S113, the control unit 21 determines the volume level of the noise detected in S111. Then, in S114, the control unit 21 outputs a voice guidance via the output unit 25 such as a speaker at the volume 32 stored in the storage unit 22 corresponding to the volume level equal to the volume level determined in S113. In Figure 2 In the example shown, when it is assumed that the detected volume level of the noise coincides with the volume level 31 of "3", the control unit 21 adjusts the volume of the voice guidance to the volume 32 corresponding to the volume level 31 of "3", that is, adjusts it to "32". The control unit 21 can also notify the user 11 of the current volume level "3" of the noise via the output unit 25 such as a display or a speaker.

[0053] The present disclosure is not limited to the above-described embodiments. For example, two or more blocks described in the block diagram can be combined, or one block can be divided. Instead of performing two or more steps described in the flowchart in time series according to the description, they can be executed in parallel or in a different order according to the processing ability of the device that executes each step or as needed. In addition, changes can be made within the scope not departing from the gist of the present disclosure.

[0054] Symbol Explanation

[0055] 11: User;

[0056] 12: Vehicle;

[0057] 20: Voice guidance device;

[0058] 21: Control unit;

[0059] 22: Storage unit;

[0060] 23: Communication unit;

[0061] 24: Input unit;

[0062] 25: Output unit;

[0063] 26: Positioning unit;

[0064] 30: Setting information;

[0065] 31: Volume level;

[0066] 32: Volume;

[0067] 33: Noise sampling;

[0068] 34: Location information;

[0069] 35: Scene image.

Claims

1. A voice guidance device comprising a control unit, The control unit performs the following processing, namely: receiving, for each volume level of noise detectable in the vehicle, a setting of a volume of voice guidance output in the vehicle, When the voice guidance is output, if noise is detected in the vehicle, the volume of the voice guidance is adjusted to a set volume corresponding to a volume level of the detected noise.

2. The voice guidance device according to claim 1, wherein: The control unit performs the following processing, namely: receiving settings of volume corresponding to two or more volume levels among a plurality of volume levels, Based on the settings of the volumes corresponding to the two or more volume levels, the volumes corresponding to the remaining volume levels of the plurality of volume levels are automatically set.

3. The voice guidance device according to claim 1, wherein: The control unit receives a setting of a volume corresponding to the specific volume level while playing a noise sample at the specific volume level.

4. A vehicle, wherein: A voice guidance device according to any one of claims 1 to 3.

5. A non-transitory computer-readable medium storing a program for causing a computer to perform the following actions, the actions comprising: receiving, for each volume level of noise detectable in the vehicle, a setting of a volume of voice guidance output in the vehicle; When the volume guidance is output, when noise is detected in the vehicle, the volume of the voice guidance is adjusted to a set volume corresponding to a volume level of the detected noise.

Images