Speech recognition device, vehicle, non-transitory computer readable medium, and control method

Abstract

The present disclosure provides a voice recognition device, a vehicle, a non-transitory computer-readable medium, and a control method that enable a user to recognize a plurality of states during a period in which the device is performing information processing after a voice input by the user. A voice recognition device (20) is provided with a control unit that controls a specific function on the basis of a voice input from an occupant of a vehicle (12), and that executes an operation of controlling the specific function during a transition period from the reception of the voice input to the completion of at least the control of the specific function. And sequentially transitioning to each of the plurality of states, and performing screen display on which of the plurality of states is in.

Description

Technical Field

[0001] The present disclosure relates to a speech recognition device, a vehicle, a program, and a control method. Background Art

[0002] Patent document 1 discloses a method for assisting voice dialogue for operating a vehicle function. In this method, a non-voice signal is output as an acoustic signal according to the state of an audio control system such as a "voice output" state, a "voice input" state, or a "processing" state.

[0003] Prior Art Literature

[0004] Patent Literature

[0005] Patent Document 1: Japanese Patent Application No. 2007-503599 Summary of the invention

[0006] Problems to be solved by the invention

[0007] In the existing method, after the user's voice input and in the "processing" state, there is no response from the device, so the user cannot recognize the status of the device.

[0008] The present disclosure aims to enable a user to recognize a plurality of states of a device while performing information processing after a voice input by the user.

[0009] Methods for solving problems

[0010] The speech recognition device according to the present disclosure includes a control unit that controls a specific function according to a speech input from a vehicle occupant, and the control unit performs the following operations, namely:

[0011] During a transition period from when the voice input is accepted to when at least the control of the specific function is terminated, transition is sequentially performed to each of a plurality of states, and a screen displays which state is the current state among the plurality of states.

[0012] The control method involved in the present disclosure includes the following operations, namely:

[0013] The computer controls certain functions based on voice input from an occupant of the vehicle;

[0014] The computer sequentially transitions to each of a plurality of states during a transition period from when the voice input is accepted to when at least the control of the specific function ends;

[0015] The computer displays on a screen which state the computer is in among the plurality of states.

[0016] Effects of the Invention

[0017] According to the present disclosure, since the user can recognize multiple states of the device while performing information processing after the user's voice input, the convenience can be improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 It is a diagram showing the configuration of a system according to an embodiment of the present disclosure.

[0019] Figure 2 It is a block diagram showing the structure of a speech recognition device according to an embodiment of the present disclosure.

[0020] Figure 3 It is a flowchart showing the operation of the speech recognition device involved in the embodiment of the present disclosure.

[0021] Figure 4 The following is a state transition diagram showing a plurality of states of the speech recognition device according to the embodiment of the present disclosure. DETAILED DESCRIPTION

[0022] Hereinafter, one embodiment of the present disclosure will be described with reference to the drawings.

[0023] The same or corresponding parts in the drawings are denoted by the same reference numerals. In the description of the present embodiment, the description of the same or corresponding parts will be appropriately omitted or simplified.

[0024] Reference Figure 1 Next, the configuration of the system 10 according to the present embodiment will be described.

[0025] The system 10 according to the present embodiment includes a speech recognition device 20 and a server device 30 . The speech recognition device 20 can communicate with the server device 30 via a network 40 .

[0026] The speech recognition device 20 is a computer having a speech recognition function and mounted on the vehicle 12. The speech recognition device 20 is used by a user 11. The user 11 is an occupant of the vehicle 12.

[0027] The server device 30 is a computer that belongs to a cloud computing system or other computing system and is installed in a facility such as a data center. The server device 30 is operated by a service provider that provides network services and the like.

[0028] The vehicle 12 is any type of vehicle, such as a gasoline vehicle, a diesel vehicle, a hydrogen energy vehicle, an HEV, a PHEV, a BEV, or a FCEV. "HEV" is an abbreviation for a hybrid electric vehicle. "PHEV" is an abbreviation for a plug-in hybrid electric vehicle. "BEV" is an abbreviation for a battery electric vehicle. "FCEV" is an abbreviation for a fuel cell electric vehicle. The vehicle 12 can be driven by the user 11, or the driving can be automated at any level. The level of automation is, for example, any one of levels 1 to 5 under the SAE classification. "SAE" is the abbreviation for the Society of Automotive Engineers. The vehicle 12 can also be a MaaS dedicated vehicle. "MaaS" is an abbreviation for Mobility as a Service.

[0029] The network 40 includes the Internet, at least one WAN, at least one MAN, or any combination thereof. "WAN" is an abbreviation for wide area network. "MAN" is an abbreviation for metropolitan area network. The network 40 may also include at least one wireless network, at least one optical network, or any combination thereof. The wireless network is, for example, an ad hoc network, a cellular network, a wireless LAN, a satellite communication network, or a terrestrial microwave network. "LAN" is an abbreviation for local area network.

[0030] Reference Figure 1 The outline of this embodiment will be described.

[0031] The voice recognition device 20 controls a specific function Fp according to the voice input from the user 11. The voice recognition device 20 sequentially transitions to each of the multiple states Ts during a transition period Pt from when the voice input is received to when at least the control of the specific function Fp ends. The voice recognition device 20 displays on a screen which state the voice recognition device 20 is in among the multiple states Ts.

[0032] According to the present embodiment, after the user 11 inputs a voice, the user 11 can recognize a plurality of states Ts during which the voice recognition device 20 is performing information processing. Therefore, the convenience can be improved.

[0033] Reference Figure 2Next, the structure of the speech recognition device 20 according to the present embodiment will be described.

[0034] The speech recognition device 20 includes a control unit 21 , a storage unit 22 , a communication unit 23 , an input unit 24 , an output unit 25 , and a positioning unit 26 .

[0035] The control unit 21 includes at least one processor, at least one programmable circuit, at least one dedicated circuit, or any combination thereof. The processor is a general-purpose processor such as a CPU or a GPU, or a dedicated processor specialized for a specific process. "CPU" is the abbreviation of central processing unit. "GPU" is the abbreviation of graphics processing unit. A programmable circuit is, for example, an FPGA. "FPGA" is the abbreviation of field-programmable gate array. A dedicated circuit is, for example, an ASIC. "ASIC" is the abbreviation of application specific integrated circuit. The control unit 21 performs processing related to the operation of the speech recognition device 20 while controlling the various parts of the speech recognition device 20.

[0036] The storage unit 22 includes at least one semiconductor memory, at least one magnetic memory, at least one optical memory, or any combination thereof. The semiconductor memory is, for example, RAM, ROM, or flash memory. "RAM" is an abbreviation for random access memory. "ROM" is an abbreviation for read only memory. RAM is, for example, SRAM or DRAM. "SRAM" is an abbreviation for static random access memory. "DRAM" is an abbreviation for dynamic random access memory. ROM is, for example, EEPROM. "EEPROM" is an abbreviation for electrically erasable programmable read only memory. Flash memory is, for example, SSD. "SSD" is an abbreviation for solid-state drive. Magnetic memory is, for example, HDD. "HDD" is an abbreviation for hard disk drive. The storage unit 22 functions as, for example, a main storage device, an auxiliary storage device, or a cache memory. The storage unit 22 stores information used in the operation of the speech recognition device 20 and information obtained by the operation of the speech recognition device 20 .

[0037] The communication unit 23 includes at least one communication module. The communication module is, for example, a module corresponding to a mobile communication standard such as LTE, 4G standard, or 5G standard, or a wireless LAN communication standard such as IEEE802.11. "LTE" is an abbreviation for Long Term Evolution. "4G" is an abbreviation for 4th generation (fourth generation mobile communication technology). "5G" is an abbreviation for 5th generation (fifth generation mobile communication technology). "IEEE" is an abbreviation for the Institute of Electrical and Electronics Engineers. The communication unit 23 communicates with the server device 30. The communication unit 23 receives information used in the operation of the speech recognition device 20, and also sends information obtained by the operation of the speech recognition device 20.

[0038] The input unit 24 includes at least one input device. The input device is, for example, a physical key, an electrostatic capacitance key, a dot device, a touch screen integrated with a display, a visible light camera, a depth camera, LiDAR, or a microphone. "LiDAR" is an abbreviation for light detection and ranging. The input unit 24 accepts operations for inputting information used in the operation of the voice recognition device 20. The input unit 24 can also be connected to the voice recognition device 20 as an external input device instead of being provided in the voice recognition device 20. As a connection interface, an interface corresponding to a standard such as USB, HDMI (registered trademark), or Bluetooth (registered trademark) can be used. "USB" is an abbreviation for Universal Serial Bus. "HDMI (registered trademark)" is an abbreviation for High-Definition Multimedia Interface.

[0039] The output unit 25 includes at least one output device. The output device is, for example, a display or a speaker. The display is, for example, an LCD or an organic EL display. "LCD" is an abbreviation for liquid crystal display. "EL" is an abbreviation for electro luminescent. The output unit 25 outputs the information obtained by the operation of the voice recognition device 20. The output unit 25 can also be connected to the voice recognition device 20 as an external output device such as a display or a speaker instead of being provided in the voice recognition device 20. As a connection interface, an interface corresponding to a standard such as USB, HDMI (registered trademark), or Bluetooth (registered trademark) can be used.

[0040] The positioning unit 26 includes at least one GNSS receiver. "GNSS" is an abbreviation for global navigation satellite system. GNSS is, for example, GPS, QZSS, BDS, GLONASS, or Galileo. "GPS" is an abbreviation for Global Positioning System. "QZSS" is an abbreviation for Quasi-Zenith Satellite System. The satellites of QZSS are called quasi-zenith satellites. "BDS" is an abbreviation for BeiDou Navigation Satellite System. "GLONASS" is an abbreviation for Global Navigation Satellite System. The positioning unit 26 measures the position of the voice recognition device 20.

[0041] The functions of the speech recognition device 20 are realized by executing the program involved in this embodiment by the processor as the control unit 21. That is, the functions of the speech recognition device 20 are realized by software. The program enables the computer to function as the speech recognition device 20 by enabling the computer to perform the work of the speech recognition device 20. That is, the computer functions as the speech recognition device 20 by performing the work of the speech recognition device 20 according to the program.

[0042] The program can be pre-stored in a non-temporary computer-readable medium. Examples of non-temporary computer-readable media are flash memory, magnetic recording devices, optical disks, optical magnetic recording media, or ROMs. The circulation of the program is implemented, for example, by selling, transferring, or lending portable media such as SD cards, DVDs, or CD-ROMs that store the program. "SD" is the abbreviation for Secure Digital. "DVD" is the abbreviation for digital versatile disc. "CD-ROM" is the abbreviation for compact disc read only memory. The program can also be circulated by pre-storing the program in a storage device of a server and transferring the program from the server to other computers. The program can also be provided as a program product.

[0043] The computer temporarily stores the program stored in the portable medium or the program transferred from the server in the main storage device, for example. Moreover, the computer uses the processor to read the program stored in the main storage device, and uses the processor to execute the processing implemented according to the read program. The computer can also read the program directly from the portable medium and execute the processing implemented according to the program. The computer can also successively execute the processing implemented according to the received program each time a program is transferred from the server to the computer. The processing can also be performed by the so-called ASP-type service that implements the function only by executing instructions and obtaining results without transferring the program from the server to the computer. "ASP" is the abbreviation of application service provider. The program contains information used in the processing implemented by the electronic computer and based on the program. For example, data that is not a direct instruction to the computer but has the nature of regulating the processing of the computer meets the "content based on the program".

[0044] A part or all of the functions of the speech recognition device 20 may be realized by a programmable circuit or a dedicated circuit as the control unit 21. In other words, a part or all of the functions of the speech recognition device 20 may be realized by hardware.

[0045] Reference Figure 3 The operation of the speech recognition device 20 according to the present embodiment will be described below. The operation described below is equivalent to the control method according to the present embodiment. That is, the control method according to the present embodiment includes: Figure 3 The steps S1 to S10 are shown.

[0046] When the user 11 issues a start command such as “Hey, car!” or presses a start button displayed on the screen or physically arranged, step S1 is started.

[0047] In S1 to S8, the control unit 21 controls the specific function Fp according to the voice input from the user 11. The specific function Fp is a function of a device such as a navigation device or an audio device installed in the vehicle 12. Alternatively, the specific function Fp may be a function of the vehicle 12 itself.

[0048] The control unit 21 sequentially transitions to each of the multiple states Ts within a transition period Pt from when the voice input is accepted to when at least the control of the specific function Fp ends. In the present embodiment, the transition period Pt is the period from when the voice input is accepted to when the result of controlling the specific function Fp is notified to the user 11, but when the result is not notified to the user 11, the transition period Pt may also be the period from when the voice input is accepted to when the control of the specific function Fp is notified to the user 11.

[0049] The multiple states Ts are the states of the control unit 21 and the states of the speech recognition device 20. Figure 4 Four of the six states shown are states other than the initial state T0 and the exception state T5. In the order of state transition, the first state T1 is a state in which the control unit 21 is accepting voice input. The second state T2 is a state in which the control unit 21 is recognizing voice input. The third state T3 is a state in which the control unit 21 is performing a search in association with the control of a specific function Fp. The fourth state T4 is a state in which the control unit 21 is notifying the user 11 of the result of controlling the specific function Fp.

[0050] In S1, the control unit 21 changes from the initial state T0 to the first state T1. The control unit 21 displays the first state T1 on the screen. Specifically, the control unit 21 displays a message such as "Acceptance starts after the user speaks" on the display as the output unit 25.

[0051] In S2 , the control unit 21 receives a voice input from the user 11 . Specifically, the control unit 21 receives a voice input such as “I want to go to X” or “I want to listen to Y” via the microphone as the input unit 24 .

[0052] After S2, step S3 is started. However, if the user 11 issues a cancel command such as "stop" or presses a cancel button displayed on the screen or physically arranged before S2, step S9 is started. The operation of the user 11 issuing a cancel command and the user 11 pressing the cancel button are both equivalent to a cancel instruction from the user 11.

[0053] In S3 , the control unit 21 changes from the first state T1 to the second state T2 . The control unit 21 displays the second state T2 on the screen. Specifically, the control unit 21 displays a message such as “recognizing” on the display as the output unit 25 .

[0054] In S4, the control unit 21 recognizes the voice input received in S2. As a specific method of voice recognition, a known method can be used. Machine learning such as deep learning can also be used.

[0055] After S4, the step S5 is started. However, if the user 11 issues a cancel command or presses a cancel button before S4, the step S9 is started.

[0056] In S5 , the control unit 21 changes from the second state T2 to the third state T3 . The control unit 21 displays the third state T3 on the screen . Specifically, the control unit 21 displays a message such as “Recognized, searching” on the display as the output unit 25 .

[0057] In S6, the control unit 21 performs a search in association with the control of a specific function Fp. Specifically, the control unit 21 retrieves from the storage unit 22 information corresponding to the voice input recognized in S4 and required for controlling the functions of the devices mounted on the vehicle 12. For example, when the voice input "I want to go to X" is recognized in S4, the control unit 21 searches for the route to X with reference to the map database constructed in the storage unit 22. When the voice input "I want to listen to Y" is recognized in S4, the control unit 21 searches for Y with reference to the music database constructed in the storage unit 22. Alternatively, the control unit 21 may also retrieve from the storage unit 22 information corresponding to the voice input recognized in S4 and required for controlling the functions of the vehicle 12 itself.

[0058] After S6, the step S7 is started. However, if the user 11 issues a cancel command or presses a cancel button before S6, the step S9 is started.

[0059] In S7 , the control unit 21 changes from the third state T3 to the fourth state T4 . The control unit 21 displays the fourth state T4 on the screen . Specifically, the control unit 21 displays a message such as “Results are displayed after search” on the display as the output unit 25 .

[0060] In S8, the control unit 21 notifies the user 11 of the result of controlling the specific function Fp. Specifically, the control unit 21 uses the information retrieved in S6 to control the functions of the devices mounted on the vehicle 12, and displays the results on the display as the output unit 25, or outputs them by voice from the speaker as the output unit 25. For example, when a route to X is searched in S6, the control unit 21 sets the route to X in the navigation device and displays it on the display. When Y is searched in S6, the control unit 21 uses the audio equipment to play Y and outputs it from the speaker. Alternatively, the control unit 21 may use the information retrieved in S6 to control the functions of the vehicle 12 itself, and display the results on the display, or output them by voice from the speaker.

[0061] After S8, Figure 3 The process shown ends.

[0062] In S9, the control unit 21 changes from any state of the first state T1, the second state T2, the third state T3, and the fourth state T4 to the exceptional state T5. Furthermore, the control unit 21 displays the exceptional state T5 on the screen. Specifically, the control unit 21 displays a message such as "suspended" on the display as the output unit 25.

[0063] In S10 , the control unit 21 stops the control of the specific function Fp. That is, when receiving a cancel instruction from the user 11 during the transition period Pt, the control unit 21 stops the control of the specific function Fp.

[0064] After S10, Figure 3 The process shown ends.

[0065] As described above, in S1 to S8, whenever a state among the multiple states Ts is changed to another state, the control unit 21 displays the state among the multiple states Ts on the screen. Therefore, the user 11 can recognize the multiple states Ts during the period from voice input to result notification. As a result, in the process of the user 11 using the voice recognition device 20, the state of the voice recognition device 20 after the voice input becomes easy for the user 11 to know, thereby eliminating the user 11's anxiety.

[0066] The control unit 21 may continuously display on the screen which state the voice recognition device 20 is in among the multiple states Ts during the transition period Pt. According to this example, the user 11 can always confirm which state the voice recognition device 20 is in during the period from voice input to result notification.

[0067] In S1, S3, S5, or S7, the control unit 21 may also use an image to express which state Ts is in when displaying which state Ts is in the multiple states. The image may also include gestures or expressions. For example, the following situations are considered, that is, in S1, a character image of echoing is displayed, in S2, a character image of a thinking expression is displayed, in S5, a character image of a magnifying glass is displayed, and in S7, a character image of a satisfied expression is displayed. The character image may also be an animation.

[0068] In S1, S3, S5, or S7, the control unit 21 may also output a message indicating which state Ts is in when displaying the state Ts in the screen. Specifically, the control unit 21 may output a message such as "Acceptance starts after the user speaks", "Recognition in progress", "Searching in progress after recognition", or "Results display after search" through the speaker serving as the output unit 25.

[0069] In S1, S3, S5, or S7, the control unit 21 may output different sound effects depending on which state Ts is in when displaying the state Ts on the screen. The sound effects are, for example, beep sounds.

[0070] As a modification of this embodiment, the plurality of states Ts may further include states other than the first state T1 to the fourth state T4. For example, a sixth state T6 may be added between any two states. The sixth state T6 is a state in which the control unit 21 is communicating with the server device 30 in association with the control of a specific function Fp.

[0071] For example, when the sixth state T6 is added between the third state T3 and the fourth state T4, after S6, the control unit 21 changes from the third state T3 to the sixth state T6. Furthermore, the control unit 21 displays the situation in the sixth state T6 on the screen. Specifically, the control unit 21 displays a message such as "Communication in progress" on the display as the output unit 25.

[0072] In this example, the control unit 21 communicates with the server device 30 in association with the control of the specific function Fp. Specifically, the control unit 21 requests the server device 30 for additional information associated with the information retrieved in S6 via the communication unit 23. Then, the control unit 21 receives the requested additional information from the server device 30 via the communication unit 23.

[0073] In S7, the control unit 21 changes from the sixth state T6 to the fourth state T4. In S8, the control unit 21 uses not only the information retrieved in S6 but also the additional information received from the server device 30 to control the functions of the equipment mounted on the vehicle 12 or the functions of the vehicle 12 itself, and displays the results on the display of the output unit 25 or outputs the results through voice from the speaker of the output unit 25.

[0074] As another modification of this embodiment, the plurality of states Ts may not include any state from the first state T1 to the fourth state T4. For example, the third state T3 may be replaced by a state other than the first state T1 to the fourth state T4.

[0075] For example, when the third state T3 is replaced with the sixth state T6, in S5, the control unit 21 changes from the second state T2 to the sixth state T6. Furthermore, the control unit 21 displays the sixth state T6 on the screen. Specifically, the control unit 21 displays a message such as "Communication in progress" on the display as the output unit 25.

[0076] In S6, the control unit 21 communicates with the server device 30 in association with the control of a specific function Fp. Specifically, the control unit 21 requests the server device 30 via the communication unit 23 for information required for controlling the functions of the devices mounted on the vehicle 12, corresponding to the voice input recognized in S4. Furthermore, the control unit 21 receives the requested information from the server device 30 via the communication unit 23. For example, when the voice input "I want to go to X" is recognized in S4, the control unit 21 requests the server device 30 via the communication unit 23 to search for a route to X. Furthermore, the control unit 21 receives information related to the route to X from the server device 30 via the communication unit 23. When the voice input "I want to listen to Y" is recognized in S4, the control unit 21 requests the server device 30 via the communication unit 23 to search for Y. Furthermore, the control unit 21 receives Y from the server device 30 via the communication unit 23. Alternatively, the control unit 21 may receive information necessary for controlling the function of the vehicle 12 itself, corresponding to the voice input recognized in S4 , from the server device 30 via the communication unit 23 .

[0077] In S7, the control unit 21 changes from the sixth state T6 to the fourth state T4. In S8, the control unit 21 uses the information received in S6 to control the functions of the equipment mounted on the vehicle 12 or the functions of the vehicle 12 itself, and displays the results on the display of the output unit 25 or outputs voice from the speaker of the output unit 25.

[0078] As another modification of this embodiment, the plurality of states Ts may include any number of states, for example, the plurality of states Ts may include any one or more of the first state T1, the second state T2, the third state T3, the sixth state T6, and the fourth state T4.

[0079] The present disclosure is not limited to the above-mentioned embodiments. For example, two or more modules recorded in the block diagram may be integrated, or one module may be divided. Instead of executing two or more steps recorded in the flowchart according to the description and in a time sequence, the steps may be executed in parallel or in a different order according to the processing capability of the device executing each step or as needed. In addition, changes can be made within the scope of the subject matter of the present disclosure.

[0080] Some embodiments of the present disclosure are exemplified below, but please note that the embodiments of the present disclosure are not limited to these contents.

[0081] [Note 1]

[0082] A speech recognition device, comprising a control unit, which controls a specific function based on a speech input from a vehicle occupant, and the control unit performs the following operations, namely: during the transition period from acceptance of the speech input to the end of at least the control of the specific function, the control unit sequentially transitions to each of a plurality of states, and displays on a screen which state the device is in among the plurality of states.

[0083] [Note 2]

[0084] A speech recognition device as described in Appendix 1, wherein:

[0085] The transition period is a period from when the voice input is accepted to when the result of controlling the specific function is notified to the occupant.

[0086] [Note 3]

[0087] A speech recognition device as described in Appendix 1, wherein:

[0088] The transition period is a period from when the voice input is accepted until when the occupant is notified that the specific function has been controlled.

[0089] [Note 4]

[0090] A speech recognition device as described in any one of Appendix 1 to Appendix 3, wherein:

[0091] When displaying on the screen which state the device is in among the plurality of states, the control unit expresses which state the device is in among the plurality of states using an image.

[0092] [Note 5]

[0093] A speech recognition device as described in Supplement 4, wherein:

[0094] The image includes a gesture or an expression.

[0095] [Note 6]

[0096] A speech recognition device as described in any one of Appendix 1 to Appendix 5, wherein:

[0097] The control unit outputs a message indicating which state the device is in when displaying on the screen which state the device is in among the plurality of states by voice.

[0098] [Note 7]

[0099] A speech recognition device as described in any one of Appendix 1 to Appendix 6, wherein:

[0100] The control unit outputs a different sound effect depending on which state among the plurality of states the device is in when displaying on the screen which state the device is in.

[0101] [Note 8]

[0102] A speech recognition device as described in any one of Appendix 1 to Appendix 7, wherein:

[0103] The control unit displays on a screen which state the controller is in each of the plurality of states, each time the controller changes from one of the plurality of states to another state.

[0104] [Note 9]

[0105] A speech recognition device as described in any one of Appendix 1 to Appendix 7, wherein:

[0106] The control unit continuously displays on a screen which state the current state is among the plurality of states during the transition period.

[0107] [Note 10]

[0108] A speech recognition device as described in any one of Appendix 1 to Appendix 9, wherein:

[0109] The control unit stops controlling the specific function when receiving a cancellation instruction from the occupant during the transition period.

[0110] [Note 11]

[0111] A speech recognition device as described in any one of Appendix 1 to Appendix 10, wherein:

[0112] The plurality of states include a state in which the control unit is accepting the voice input.

[0113] [Note 12]

[0114] A speech recognition device as described in any one of Appendix 1 to Appendix 11, wherein:

[0115] The plurality of states include a state in which the control unit is recognizing the voice input.

[0116] [Note 13]

[0117] A speech recognition device as described in any one of Appendix 1 to Appendix 12, wherein:

[0118] The plurality of states include a state in which the control unit is performing a search in association with control of the specific function.

[0119] [Note 14]

[0120] A speech recognition device as described in any one of Appendix 1 to Appendix 13, wherein:

[0121] The plurality of states include a state in which the control unit is communicating with a server device in association with control of the specific function.

[0122] [Note 15]

[0123] A speech recognition device as described in any one of Appendix 1 to Appendix 14, wherein:

[0124] The plurality of states include a state in which the control unit is notifying the occupant of a result of controlling the specific function.

[0125] [Note 16]

[0126] A speech recognition device as described in any one of Appendix 1 to Appendix 15, wherein:

[0127] The specific function is a function possessed by the vehicle or a device mounted on the vehicle.

[0128] [Note 17]

[0129] A vehicle, wherein

[0130] A speech recognition device as set forth in any one of Supplementary Notes 1 to 16 is provided.

[0131] [Note 18]

[0132] A non-transitory computer-readable medium, wherein:

[0133] A program for causing a computer to function as the speech recognition device described in any one of Supplementary Notes 1 to 16 is stored.

[0134] [Note 19]

[0135] A control method, comprising the following operations:

[0136] The computer controls certain functions based on voice input from an occupant of the vehicle;

[0137] The computer sequentially transitions to each of a plurality of states during a transition period from when the voice input is accepted to when at least the control of the specific function ends;

[0138] The computer displays on a screen which state the computer is in among the plurality of states.

[0139] [Note 20]

[0140] A control method as described in Appendix 19, wherein:

[0141] The multiple states include one or more states in which the computer is accepting the voice input, in which the computer is recognizing the voice input, in which the computer is performing a search in association with the control of the specific function, in which the computer is communicating with a server device in association with the control of the specific function, and in which the computer is notifying the occupant of the result of controlling the specific function.

[0142] Explanation of symbols

[0143] 10…system;

[0144] 11…user;

[0145] 12…Vehicles;

[0146] 20…speech recognition device;

[0147] 21…Control Department;

[0148] 22… storage unit;

[0149] 23…Ministry of Communications;

[0150] 24…input unit;

[0151] 25…output unit;

[0152] 26…Positioning department;

[0153] 30… server device;

[0154] 40…network.

Claims

1. A speech recognition device, wherein: A control unit is provided, the control unit controls a specific function according to a voice input from a vehicle occupant, and the control unit performs the following operations, namely: During a transition period from when the voice input is accepted to when at least the control of the specific function is terminated, transition is sequentially performed to each of a plurality of states, and a screen displays which state is the current state among the plurality of states.

2. The speech recognition device according to claim 1, wherein: The transition period is a period from when the voice input is accepted until when the result of controlling the specific function is notified to the occupant.

3. The speech recognition device according to claim 1, wherein: The transition period is a period from when the voice input is accepted until when the occupant is notified that the specific function has been controlled.

4. The speech recognition device according to claim 1, wherein: When displaying on the screen which state the device is in among the plurality of states, the control unit expresses which state the device is in among the plurality of states using an image.

5. The speech recognition device according to claim 4, wherein: The image includes a gesture or an expression.

6. The speech recognition device according to claim 1, wherein: The control unit outputs a message indicating which state the device is in when displaying on the screen which state the device is in among the plurality of states by voice.

7. The speech recognition device according to claim 1, wherein: The control unit outputs a different sound effect depending on which state among the plurality of states the device is in when displaying on the screen which state the device is in.

8. The speech recognition device according to claim 1, wherein: The control unit displays on a screen which state the controller is in each of the plurality of states, each time the controller changes from one of the plurality of states to another state.

9. The speech recognition device according to claim 1, wherein: The control unit continuously displays on a screen which state the current state is among the plurality of states during the transition period.

10. The speech recognition device according to claim 1, wherein: The control unit stops controlling the specific function when receiving a cancellation instruction from the occupant during the transition period.

11. The speech recognition device according to claim 1, wherein: The plurality of states include a state in which the control unit is accepting the voice input.

12. The speech recognition device according to claim 1, wherein: The plurality of states include a state in which the control unit is recognizing the voice input.

13. The speech recognition device according to claim 1, wherein: The plurality of states include a state in which the control unit is performing a search in association with control of the specific function.

14. The speech recognition device according to claim 1, wherein: The plurality of states include a state in which the control unit is communicating with a server device in association with control of the specific function.

15. The speech recognition device according to claim 1, wherein: The plurality of states include a state in which the control unit is notifying the occupant of a result of controlling the specific function.

16. The speech recognition device according to claim 1, wherein: The specific function is a function possessed by the vehicle or a device mounted on the vehicle.

17. A vehicle, wherein: A speech recognition device comprising any one of claims 1 to 16.

18. A non-transitory computer-readable medium, wherein: A program for causing a computer to function as the speech recognition device according to any one of claims 1 to 16 is stored.

19. A control method, wherein: The following operations are included, namely: The computer controls certain functions based on voice input from an occupant of the vehicle; The computer sequentially transitions to each of a plurality of states during a transition period from when the voice input is accepted to when at least the control of the specific function ends; The computer displays on a screen which state the computer is in among the plurality of states.

20. The control method according to claim 19, wherein: The multiple states include one or more states in which the computer is accepting the voice input, in which the computer is recognizing the voice input, in which the computer is performing a search in association with the control of the specific function, in which the computer is communicating with a server device in association with the control of the specific function, and in which the computer is notifying the occupant of the result of controlling the specific function.

Images