Information processing apparatus, system, information processing method, and program

Abstract

One example is to reduce the user's inconvenience of waiting for a screen transition.SOLUTION: The voice recognition unit 130 of the information processing device 10 executes processing on the basis of the selection results for the plurality of commands associated with each of the plurality of states. The operation processing unit 150 of the information processing device 10 processes the received voice data to specify a selection result for the plurality of commands. The operation processing unit 150 transitions the state in accordance with the selection result. Further, the operation processing unit 150 causes the display unit to display an image associated with the state. Within a period in which a predetermined first condition is satisfied, the voice recognition unit 130 can receive voice data for specifying a selection result for a plurality of commands associated with a second state after transition regardless of whether or not an image associated with the second state is displayed on the display unit after the selection result in the first state is specified.SELECTED DRAWING: Figure 12

Description

[Technical Field]

[0001] The present invention relates to an information processing device, a system, an information processing method, and a program. [Background technology]

[0002] Devices that can be operated by voice recognition have been developed. An example of such a device is one in which voice commands are hierarchically structured so that a desired operation can be specified by going through multiple levels in order.

[0003] Patent Document 1 describes that voice recognition commands are hierarchically organized. Patent Document 1 also describes that a predetermined operation corresponding to a voice recognition command included in a user's utterance is executed, and that a voice recognition command that is likely to be used by the user is selected and displayed on a display. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2013-54074 Summary of the Invention [Problem to be solved by the invention]

[0005] However, it may be bothersome for the user to wait for the screen to change so that the next voice command can be displayed every time a voice command is input (uttered).

[0006] One example of a problem that the present invention aims to solve is to reduce the inconvenience that a user experiences when waiting for a screen transition. [Means for solving the problem]

[0007] The invention described in claim 1 is an operation processing unit that executes processing based on selection results for a plurality of commands associated with each of the plurality of states; a voice recognition unit that processes the received voice data to identify a selection result for the plurality of commands; Equipped with The operation processing unit transitioning the state according to the selection result; displaying an image associated with the state on a display unit; The voice recognition unit is capable of receiving, within a period in which a predetermined first condition is satisfied, voice data for specifying a selection result for the plurality of commands associated with the second state, after specifying a selection result in the first state, regardless of whether an image associated with the second state after the transition is displayed on the display unit. It is an information processing device.

[0008] The invention described in claim 8 is The information processing device according to claim 1; The display unit It is a system.

[0009] The invention described in claim 9 is 1. An information processing method executed by one or more computers, comprising: an operation processing step of executing a process based on selection results of a plurality of commands associated with each of the plurality of states; a speech recognition step of processing the received speech data to identify a selection result for the plurality of commands; Including, In the operation processing step, transitioning the state according to the selection result; displaying an image associated with the state on a display unit; In the voice recognition step, after a selection result in the first state is identified within a period in which a predetermined first condition is satisfied, voice data for identifying a selection result for the plurality of commands associated with the second state after the transition can be received regardless of whether an image associated with the second state after the transition is displayed on the display unit. It is an information processing method.

[0010] The invention described in claim 10 is Computer, operation processing means for executing a process based on selection results for a plurality of commands associated with each of the plurality of states; a voice recognition means for processing the received voice data to identify a selection result for the plurality of commands; It functions as The operation processing means transitioning the state according to the selection result; displaying an image associated with the state on a display unit; The voice recognition means is capable of receiving, within a period in which a predetermined first condition is satisfied, voice data for specifying a selection result for the plurality of commands associated with the second state, after specifying a selection result in the first state, regardless of whether an image associated with the second state after the transition is displayed on the display unit. It is a program. [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 2 is a diagram illustrating an example of a functional configuration of the information processing device according to the first embodiment. [Figure 2] FIG. 2 is a diagram illustrating an information processing method according to the first embodiment. [Figure 3] 1 is a diagram illustrating a configuration of a system according to a first embodiment. [Figure 4] FIG. 1 is a diagram illustrating a computer for realizing an information processing device. [Figure 5]FIG. 2 is a diagram illustrating an example of an image displayed on a display unit. [Figure 6] FIG. 2 is a diagram illustrating an example of an image displayed on a display unit. [Figure 7] FIG. 2 is a diagram illustrating an example of an image displayed on a display unit. [Figure 8] FIG. 2 is a diagram illustrating an example of an image displayed on a display unit. [Figure 9] FIG. 2 is a diagram illustrating an example of the configuration of reference data stored in a storage unit. [Figure 10] 4 is a flowchart illustrating the flow of processing executed by the information processing apparatus according to the first embodiment. [Figure 11] 10 is a flowchart illustrating the processing contents of a determination unit and a voice recognition unit in step S103. [Figure 12] FIG. 10 is a diagram illustrating an example of a functional configuration of an information processing device according to a second embodiment. [Figure 13] FIG. 10 is a diagram illustrating an information processing method according to a second embodiment. [Figure 14] 10 is a flowchart illustrating the flow of processing executed by an information processing apparatus according to a second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0012] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In all the drawings, like components are designated by like reference numerals, and the description thereof will be omitted as appropriate.

[0013] (First embodiment) FIG. 1 is a diagram illustrating an example of the functional configuration of an information processing device 10 according to the first embodiment. The information processing device 10 according to this embodiment includes a voice recognition unit 130. The voice recognition unit 130 identifies a selected command from among a plurality of commands based on a comparison result between a first voice pattern detected within a period that satisfies a predetermined first condition and one or more of a plurality of first candidate voice patterns. Each of the plurality of first candidate voice patterns is associated with one of the plurality of commands.

[0014] FIG. 2 is a diagram illustrating an information processing method according to this embodiment. The information processing method according to this embodiment is executed by one or more computers. The information processing method according to this embodiment includes a voice recognition step S10. In the voice recognition step S10, the one or more computers identify a selected command from among the plurality of commands based on a comparison result between a first voice pattern detected within a period that satisfies a predetermined first condition and one or more of a plurality of first candidate voice patterns. Each of the plurality of first candidate voice patterns is associated with one of the plurality of commands.

[0015] The information processing method according to this embodiment can be executed by the information processing device 10 according to this embodiment. The information processing device 10 and the information processing device according to this embodiment will be described in detail below.

[0016] 3 is a diagram illustrating an example of the configuration of a system 50 according to this embodiment. The system 50 according to this embodiment includes an information processing device 10, an operation unit 20, a sound collection unit 22, a display unit 30, and a sound output unit 32. In the example of FIG. 3, the information processing device 10 further includes a determination unit 110 and an operation processing unit 150.

[0017] The hardware configuration of the information processing device 10 will be described below. Each functional component of the information processing device 10 (the determination unit 110, the voice recognition unit 130, and the operation processing unit 150) may be realized by hardware that realizes each functional component (e.g., a hardwired electronic circuit, etc.), or may be realized by a combination of hardware and software (e.g., a combination of an electronic circuit and a program that controls it, etc.). Below, a case where each functional component of the information processing device 10 is realized by a combination of hardware and software will be further described.

[0018] FIG. 4 is a diagram illustrating an example of a computer 1000 for implementing the information processing device 10. The computer 1000 may be any computer. For example, the computer 1000 may be a system on chip (SoC), a personal computer (PC), a server machine, a tablet terminal, a smartphone, or the like. The computer 1000 may be a dedicated computer designed for implementing the information processing device 10, or a general-purpose computer. The information processing device 10 may be implemented by a single computer 1000 or by a combination of multiple computers 1000. When the information processing device 10 is implemented by a combination of multiple computers 1000, some of the multiple computers 1000 may be provided in a mobile object, and the other units may be provided as a server machine located away from the mobile object. In other words, some of the multiple functional components of the information processing device 10 (the determination unit 110, the voice recognition unit 130, and the operation processing unit 150) may be implemented by the computer 1000 provided in the mobile object, and the other units may be implemented as a server machine.

[0019] The computer 1000 includes a bus 1020, a processor 1040, a memory 1060, a storage device 1080, an input / output interface 1100, and a network interface 1120. The bus 1020 is a data transmission path through which the processor 1040, the memory 1060, the storage device 1080, the input / output interface 1100, and the network interface 1120 transmit and receive data to and from each other. However, the method of interconnecting the processor 1040 and other components is not limited to bus connection. The processor 1040 may be any of various processors, such as a central processing unit (CPU), a graphics processing unit (GPU), or a field-programmable gate array (FPGA). The memory 1060 is a main storage device implemented using a random access memory (RAM) or the like. The storage device 1080 is an auxiliary storage device implemented using a hard disk, a solid state drive (SSD), a memory card, a read-only memory (ROM), or the like.

[0020] The input / output interface 1100 is an interface for connecting the computer 1000 to an input / output device. For example, an input device such as a microphone and an output device such as a display are connected to the input / output interface 1100. The input / output interface 1100 may be connected to the input device or the output device wirelessly or by wire. In the example of FIG. 3, an operation unit 20, a sound collection unit 22, a display unit 30, and a sound output unit 32 are connected to the input / output interface 1100 of the computer 1000 that realizes the information processing device 10.

[0021] The network interface 1120 is an interface for connecting the computer 1000 to a network. Examples of this communication network include a LAN (Local Area Network) and a WAN (Wide Area Network). The network interface 1120 may connect to the network wirelessly or by wire.

[0022] When the information processing device 10 is realized by combining a plurality of computers 1000, the plurality of information processing devices 10 are connected to each other via a network interface 1120 or an input / output interface 1100.

[0023] The storage device 1080 stores program modules that realize each functional component of the information processing device 10. The processor 1040 reads each of these program modules into the memory 1060 and executes them to realize the function corresponding to each program module.

[0024] The system 50 can function as a navigation system for a mobile object. A user of the system 50 and the information processing device 10 can be a driver of the mobile object or a passenger other than the driver of the mobile object. The mobile object is not particularly limited, but can be, for example, a vehicle. Examples of vehicles include bicycles, motorcycles, and automobiles with three or more wheels.

[0025] The operation unit 20 is, for example, a physical button. Alternatively, the operation unit 20 and the display unit 30 may be integrated and realized by a touch panel. The information processing device 10 acquires operation information indicating operations performed on the operation unit 20 from the operation unit 20. The operation unit 20 is provided in a position where it can be operated by at least a driver in the mobile body. The operation unit 20 may also be provided in a position where it can be operated by a person other than the driver in the mobile body. The system 50 may include multiple operation units 20. In that case, the system 50 may include multiple types of operation units 20, such as physical buttons and touch panels.

[0026] The operation unit 20 may be configured integrally with the information processing device 10. For example, a computer 1000 that configures at least some of the functions of the information processing device 10 may be housed in a housing in which the operation unit 20 is provided. However, the operation unit 20 may be provided separately from the information processing device 10. In this case, the operation unit 20 independent of the information processing device 10 may be attached in a position that is easy for the driver to operate.

[0027] When the operation unit 20 is a button, the button is preferably provided on the steering wheel of the vehicle. This allows the driver to easily operate the button while driving. As described above, a device containing a computer 1000 that realizes at least some of the functions of the information processing device 10 in a housing in which the operation unit 20 is provided may be attached to the steering wheel, or the operation unit 20 independent of the information processing device 10 may be attached to the steering wheel.

[0028] As another example, the operation unit 20 may be a sensor for detecting the user's actions. Examples of the sensor include an acceleration sensor and a camera. The sensor is worn on the driver's head, for example. The sensor may also be provided in a headset worn by the driver. If the sensor is an acceleration sensor, the driver's head movements can be detected as gestures. If the sensor is a camera, changes in the camera's orientation due to the driver's head movements can be detected by analyzing images captured by the camera, and the driver's head movements can be detected as gestures. Note that a camera may be attached to a moving object at a position where it can capture an image of the driver's head, and head movements captured by the camera may be detected.

[0029] The sound collection unit 22 is, for example, a microphone. The sound collection unit 22 acquires sound and converts it into sound data. The sound data indicates the waveform of the sound acquired by the sound collection unit 22. The sound data is input to the information processing device 10 from the sound collection unit 22. Note that A / D conversion of the sound signal may be performed by the sound collection unit 22 or by the information processing device 10. The sound collection unit 22 is configured to be able to acquire at least sound uttered by a driver riding in the mobile object. The sound collection unit 22 may also be configured to be able to further acquire sound uttered by a person other than the driver riding in the mobile object. The system 50 may include multiple sound collection units 22.

[0030] The display unit 30 is, for example, a display. The display unit 30 is configured to display various images under the control of the information processing device 10. The information processing device 10 causes the display unit 30 to display, for example, a map for navigation, information for operation, etc. The display unit 30 is provided in a position visible to the driver. Specifically, the display unit 30 is preferably provided near the steering wheel of the vehicle or near the meter of the vehicle so that it is easily visible to the driver.

[0031] As described above, when the operation unit 20 and the display unit 30 are integrated and realized by a touch panel, virtual buttons for operation are displayed on the display unit 30. Then, the user can perform button operations by touching an area on the touch panel that corresponds to the button.

[0032] Examples of the sound output unit 32 include a speaker, an earphone, a headphone, etc. When the sound output unit 32 is an earphone or a headphone, the sound output unit 32 is worn by the driver, and the driver can hear the sound from the sound output unit 32. The sound output unit 32 is configured to be controlled by the information processing device 10 and to output various sounds. The information processing device 10 causes the sound output unit 32 to output, for example, a guidance voice for navigation.

[0033] Each functional component of the information processing device 10 will be described in detail below.

[0034] The determination unit 110 determines whether or not the first condition is satisfied. The determination unit 110 will be described in detail later.

[0035] The voice recognition unit 130 processes the received voice data to identify selection results for multiple commands, and the operation processing unit 150 then executes processing based on the commands identified by the voice recognition unit.

[0036] For example, a plurality of states are predefined. A plurality of commands are associated with each of the plurality of states. In each state, the operation processing unit 150 executes processing based on the selection results for the plurality of commands associated with that state. The processing executed by the operation processing unit 150 includes state transitions and the execution of specified processing other than state transitions. For example, the plurality of states are organized into layers. There are two types of commands: commands that cause a state transition (called "transition commands"), and commands that cause processing other than state transitions (called "execution commands"). Transition commands can be said to be commands at the top or middle layer of the layer. Execution commands can be said to be commands at the bottom layer of the layer.

[0037] When a transition command is selected, the operation processing unit 150 transitions the state according to the selection result of the command, and displays an image associated with the state after the transition on the display unit 30. For example, at least some of the commands associated with the state are presented by the image associated with the state. This allows the user to check the commands presented in the image and further select a desired command from among those commands.

[0038] When an execution command is selected, the operation processing unit 150 executes a process associated with the execution command. Examples of processes associated with execution commands include a process for displaying a specific spot on a map, a process related to a route (resetting a route, changing a destination, etc.), a process related to guidance (navigation) (changing the scale of a map, changing the volume of a guidance voice, etc.), etc. However, the processes associated with execution commands are not limited to these examples.

[0039] 5 to 8 are diagrams illustrating examples of images displayed on the display unit 30. The flow of processing executed by the information processing device 10 will be further explained using these diagrams. The following example shows the flow up to displaying additional spots on a map, but the processing of the information processing device 10 is not limited to this example.

[0040] 5, a mark 91 indicating the current location is displayed superimposed on a map 90. The map 90 and the mark 91 change in accordance with the movement of the mobile object. For example, when the user performs a predetermined operation (for example, pressing a button or uttering a wake word), the image displayed on the display unit 30 changes as shown in FIG. 6, and the voice recognition unit 130 enters a state in which it can accept a command input by voice.

[0041] In FIG. 6, a plurality of selectable commands ("convenience store," "toilet," and "gas station") are displayed. The user speaks one of the displayed commands. The voice recognition unit 130 recognizes the user's voice and identifies the spoken command. If the operation unit 20 and the display unit 30 are implemented as a touch panel, the user may select one of the commands by touching it on the screen instead of speaking.

[0042] For example, suppose "convenience store" is selected from the commands shown in Fig. 6. Then, the image displayed on the operation unit 20 changes to that shown in Fig. 7. In Fig. 7, multiple selectable commands ("aiueo store," "kakitsuke shop," and "sa-shi-suse mart") are also displayed. These commands are used to further narrow down the "convenience store" selected in the state of Fig. 6, and each of them indicates the name of a convenience store chain.

[0043] The user speaks one of the multiple commands displayed, as in the case of Fig. 6. The voice recognition unit 130 recognizes the user's voice and identifies the spoken command. If the operation unit 20 and the display unit 30 are implemented as a touch panel, the user may select one of the commands by touching it on the screen instead of speaking.

[0044] When any command is selected in the state of Fig. 7, the operation processing unit 150 searches for stores in the chain corresponding to the command and displays them on a map as shown in Fig. 8. The flow of the process executed by the information processing device 10 has been described above.

[0045] When specifying a command by voice, shortening the time from the user's utterance to the operation processing unit 150's response can reduce user stress and improve convenience. To this end, the voice recognition unit 130 identifies a selected command from among multiple commands based on a comparison result between the first voice pattern detected within a period in which a first condition is satisfied and one or more of multiple first candidate voice patterns. That is, the voice recognition unit 130 identifies the selected command by recognizing a voice corresponding to a portion of the beginning of the command within a period in which the first condition is satisfied. In other words, the voice recognition unit 130 does not need to recognize a voice corresponding to the entire command within a period in which the first condition is satisfied. By recognizing a portion of the beginning of the command, the voice recognition unit 130 can identify the selected command before the user finishes uttering the entire command. Furthermore, performing such voice recognition under the condition that the first condition is satisfied reduces erroneous recognition, such as recognizing an unrelated utterance as a command. That is, by realizing a situation in which the first condition is satisfied, the user can clearly indicate their intention to input voice.

[0046] The determination unit 110 determines whether or not the first condition is satisfied. The speech recognition unit 130 acquires information indicating whether or not the first condition is satisfied from the determination unit 110. An example of the first condition will be described below.

[0047] In one example, the first condition is that a predetermined button is pressed. In this example, the determination unit 110 acquires, as operation information, information indicating whether or not a button is pressed from the operation unit 20, and makes a determination based on the information. As described above, the operation unit 20 may be a physical button, or a button that is temporarily displayed on a touch panel. In this way, the user can clearly indicate their intention to issue a command by continuing to press the button.

[0048] In another example, the first condition is that the occurrence of a predetermined time T occurs after a predetermined gesture is made. The gesture is, for example, a motion of nodding the head multiple times. Note that a head shake from side to side is preferably not treated as a gesture because it may occur as a driving motion. The time T is, for example, 3 seconds or more and 10 seconds or less.

[0049] In this example, the determination unit 110 acquires, as operation information, information indicating the detection result by the sensor from the operation unit 20. By analyzing the detection result by the sensor, the determination unit 110 can detect a gesture by the movement of the driver's head, as described above. The determination unit 110 records the time when the gesture is detected, and determines that the first condition is satisfied until a predetermined time T has elapsed from that time.

[0050] The voice recognition performed by the voice recognition unit 130 will be described below. When the voice recognition unit 130 acquires voice data from the sound collection unit 22, it detects a voice pattern indicated in the voice data. A voice pattern indicates a waveform of a part of a voice waveform indicated in the voice data whose amplitude is equal to or exceeds a predetermined threshold, or a feature quantity of the waveform of that part. The voice recognition unit 130 performs voice recognition by comparing the detected voice pattern with candidate voice patterns prepared in advance. That is, among multiple candidate voice patterns, it identifies a candidate voice pattern that is highly similar to the detected voice pattern. Then, it identifies a command associated with that candidate voice pattern as the selected command.

[0051] The voice recognition unit 130 may determine the similarity for all or only some of the selectable commands in that state. When determining the similarity for all selectable commands, the voice recognition unit 130 determines the command with the highest similarity as the selected command. When determining the similarity for only some of the selectable commands, the voice recognition unit 130 determines the similarity for each command in turn, and when a similarity higher than a predetermined standard is determined, the voice recognition unit 130 determines the similarity for that command as the selected command. Then, it is not necessary to determine the similarity for the remaining commands.

[0052] In the example of FIG. 3, the information processing device 10 includes a storage unit 101. The storage unit 101 is realized, for example, by using a storage device 1080 of a computer 1000 that realizes the information processing device 10. The voice recognition unit 130 is able to access the storage unit 101. Note that while FIG. 3 shows an example in which the storage unit 101 is provided in the information processing device 10, the storage unit 101 may be provided outside the information processing device 10. Furthermore, the storage unit 101 may be provided as a part of the system 50, or may be provided outside the system 50.

[0053] 9 is a diagram illustrating an example of the configuration of reference data stored in the storage unit 101. In the reference data, a plurality of commands are associated with each of a plurality of states. Each command is also associated with a first candidate voice pattern and a second candidate voice pattern. The table illustrated in FIG. 9 shows the data names of the candidate voice patterns.

[0054] As described above, the speech recognition unit 130 identifies a selected command from among the multiple commands based on the comparison result between the first speech pattern detected within the period satisfying the first condition and one or more of the multiple first candidate speech patterns. Each of the multiple first candidate speech patterns corresponds to, for example, a speech with the minimum number of initial syllables that can identify the command associated with that first candidate speech pattern. That is, if the initial syllables of the multiple selectable commands are all different, the first candidate speech patterns for those multiple commands may all be speech patterns corresponding to one syllable. If the multiple selectable commands include two or more commands that have the same initial first syllable but different second syllables, the first candidate speech patterns for those two or more commands are speech patterns corresponding to two syllables. This enables speech recognition using the shortest speech patterns.

[0055] For each of the multiple commands, the second candidate voice pattern is a voice pattern longer than the first candidate voice pattern. Specifically, the second candidate voice pattern may be a voice pattern corresponding to the entire command. In other words, for each command, the first candidate voice pattern can be considered a portion of the second candidate voice pattern. The voice recognition unit 130 identifies the selected command based on the results of comparing the voice pattern detected during the period in which the first condition is not satisfied with one or more of the multiple second candidate voice patterns, each associated with one of the multiple commands. This enables highly accurate voice recognition when the first condition is not satisfied.

[0056] The speech recognition unit 130 may be configured to identify a speech period in the speech data where the amplitude of the speech waveform is equal to or greater than a predetermined threshold, and generate detected speech data indicating the speech waveform of that speech period. In this case, before the generation of the detected speech data is completed (for example, before the end point of that speech period is identified), the speech recognition unit 130 may compare a portion of the second candidate speech pattern, including at least the beginning thereof, with a portion of the speech waveform including the beginning of that speech period. If the comparison result satisfies a predetermined criterion, the speech recognition unit 130 may identify the command corresponding to the second candidate speech pattern as the selected command.

[0057] The operation processing unit 150 acquires information indicating the selected command identified by the voice recognition unit 130. The operation processing unit 150 can also access the storage unit 101. As shown in Fig. 9, the reference data associates each of a plurality of commands with a process to be executed by the operation processing unit 150. The operation processing unit 150 uses the reference data to identify and execute the process corresponding to the selected command.

[0058] FIG. 10 is a flowchart illustrating the flow of processing executed by the information processing device 10 according to this embodiment. In step S101, the voice recognition unit 130 determines whether an operation has been performed to enable command input reception. Examples of operations to enable command input reception include pressing a predetermined button and detecting a wake word. The voice recognition unit 130 can determine whether a predetermined button has been pressed based on operation information from the operation unit 20. The button may be a physical button or a button temporarily displayed on a touch panel. The voice recognition unit 130 can also detect a predetermined wake word by analyzing voice data from the sound collection unit 22.

[0059] The voice recognition unit 130 repeats step S101 until an operation is performed to enable reception of a command input. When the voice recognition unit 130 detects that an operation is performed to enable reception of a command input (Yes in step S101), the operation processing unit 150 causes the display unit 30 to display a plurality of selectable commands (step S102). Note that the plurality of commands that can be initially selected after an operation is performed to enable reception of a command input can be determined in advance.

[0060] In step S103, the voice recognition unit 130 accepts a voice input of a command.

[0061] 11 is a flowchart illustrating the process in step S103 by the determination unit 110 and the voice recognition unit 130. First, the determination unit 110 determines whether or not a first condition is satisfied (step S201).

[0062] If the first condition is met (Yes in step S201), the voice recognition unit 130 reads out first candidate voice patterns associated with each of the selectable commands from the storage unit 101. The voice recognition unit 130 also compares the voice data obtained by the sound collection unit 22 with the read out first candidate voice patterns, and identifies the selected command from the selectable commands, as described above (step S202).

[0063] On the other hand, if the first condition is not satisfied (No in step S201), the voice recognition unit 130 reads out second candidate voice patterns associated with each of the selectable commands from the storage unit 101. The voice recognition unit 130 also compares the voice patterns in the voice data obtained by the sound collection unit 22 with the read out second candidate voice patterns, and identifies the selected command from the selectable commands, as described above (step S203). When the selected command is identified, step S103 ends.

[0064] Returning to FIG. 10, step S104 is executed following step S103. In step S104, the operation processing unit 150 uses the reference data to identify a process associated with the selected command and executes the identified process. That is, if the identified process is a state transition (Yes in step S104), the operation processing unit 150 executes the state transition process associated with the selected command and causes the display unit 30 to display multiple commands associated with the state after the transition (S102). On the other hand, if the identified process is not a state transition (No in step S104), the operation processing unit 150 executes the process associated with the selected command (step S105). Then, the voice recognition unit 130 ends accepting command input (step S106). Note that the processes from step S101 to step S106 are repeated unless the operation of the information processing device 10 is turned off.

[0065] As described above, the information processing device 10 and information processing method according to this embodiment identify a selected command from among the multiple commands based on the comparison result between the first voice pattern detected within a period that satisfies a first condition and one or more of the multiple first candidate voice patterns. This makes it possible to reduce recognition errors and speed up the response according to the selection result.

[0066] (Second embodiment) FIG. 12 is a diagram illustrating a functional configuration of an information processing device 10 according to a second embodiment. The information processing device 10 according to this embodiment includes a voice recognition unit 130 and an operation processing unit 150. The operation processing unit 150 executes processing based on selection results for multiple commands associated with multiple states. The voice recognition unit 130 processes the received voice data to identify the selection results for the multiple commands. The operation processing unit 150 transitions the state according to the selection results. The operation processing unit 150 also displays an image associated with the state on the display unit. After identifying the selection result in the first state, the voice recognition unit 130 can accept voice data for identifying the selection results for the multiple commands associated with the second state, regardless of whether an image associated with the second state after the transition is displayed on the display unit, during a period in which a predetermined first condition is satisfied.

[0067] FIG. 13 is a diagram illustrating an information processing method according to this embodiment. The information processing method according to this embodiment is executed by one or more computers. The information processing method according to this embodiment includes an operation processing step S21 and a voice recognition step S20. In the operation processing step S21, the one or more computers execute processing based on selection results for multiple commands associated with each of multiple states. In the voice recognition step S20, the one or more computers identify the selection results for the multiple commands by processing the received voice data. In the operation processing step S21, the one or more computers transition the state according to the selection results and display an image associated with the state on a display unit. In the voice recognition step S20, the one or more computers can, within a period in which a predetermined first condition is satisfied, receive voice data for identifying the selection results for the multiple commands associated with the second state, regardless of whether an image associated with the second state after the transition is displayed on the display unit after identifying the selection result for the first state.

[0068] The information processing method according to this embodiment can be executed by the information processing device 10 according to this embodiment. The information processing device 10 and the system 50 according to this embodiment are the same as the information processing device 10 and the system 50 according to the first embodiment, respectively, except for the processing performed by the voice recognition unit 130. The information processing device 10 and the information processing device according to this embodiment will be described in detail below.

[0069] An example of the configuration of the system 50 according to this embodiment is shown in Fig. 3, as in the first embodiment. The system 50 according to this embodiment includes an information processing device 10, an operation unit 20, a sound collection unit 22, a display unit 30, and a sound output unit 32. The information processing device 10 according to this embodiment may further include a determination unit 110 and a storage unit 101.

[0070] The hardware configuration of a computer that realizes the information processing device 10 according to this embodiment is shown in Fig. 4, for example, similarly to the information processing device 10. However, a storage device 1080 of a computer 1000 that realizes the information processing device 10 according to this embodiment stores program modules that realize the functions of each functional component of the information processing device 10 according to this embodiment.

[0071] The determination unit 110, operation processing unit 150, operation unit 20, sound collection unit 22, display unit 30, and sound output unit 32 are as described in the first embodiment.

[0072] The flow of processing executed by the information processing device 10 according to this embodiment is the same as that described with reference to FIGS. 5 to 8 in the first embodiment.

[0073] In this embodiment, at least some of the multiple commands associated with a state are presented by an image associated with that state. Here, when multiple states (hierarchies) must be passed through before a desired process can be executed, the user may feel stressed if, after specifying one command, the next command cannot be specified until the image on the display unit 30 changes. In particular, a user familiar with the information processing device 10 may be able to determine the next command to be selected even before the next selectable commands are displayed on the display unit 30. Therefore, it is preferable to be able to specify the next command without waiting for the next selectable commands to be displayed on the display unit 30.

[0074] The voice recognition unit 130 according to the present embodiment, within a period in which the first condition is satisfied, can accept voice data for identifying the selection results for multiple commands associated with the second state after identifying the selection result in the first state, regardless of whether an image associated with the second state after the transition is displayed on the display unit. That is, within a period in which the first condition is satisfied, the voice recognition unit 130 according to the present embodiment can accept voice data for identifying the next selected command after identifying the selected command. Therefore, it is possible to suppress erroneous voice recognition and reduce the hassle of waiting for a screen transition.

[0075] 14 is a flowchart illustrating the flow of processing executed by the information processing device 10 according to this embodiment. Step S301 is the same as step S101 in FIG.

[0076] When the voice recognition unit 130 detects that an operation has been performed to make the device ready to accept command input (Yes in step S301), the judgment unit 110 judges whether or not a first condition is satisfied (step S302).

[0077] If the first condition is not satisfied (No in step S302), similarly to step S102 in FIG. 10, the operation processing unit 150 causes the display unit 30 to display a plurality of selectable commands (step S303). Then, in step S304, the voice recognition unit 130 accepts a voice input of a command. That is, the voice recognition unit 130 acquires voice data of a voice uttered while the plurality of selectable commands are displayed on the display unit 30, and performs voice recognition. In step S304, the voice recognition unit 130 performs voice recognition using the second candidate voice pattern. Once the selected command is identified, the process proceeds to step S306.

[0078] If the first condition is satisfied (Yes in step S302), in step S305, the voice recognition unit 130 accepts a voice input of a command. At this time, in parallel, the operation processing unit 150 performs processing for displaying a plurality of selectable commands on the display unit 30. That is, the voice recognition unit 130 can acquire voice data of a voice uttered when a plurality of selectable commands are not displayed on the display unit 30, and perform voice recognition. The relationship between the timing at which the plurality of commands are displayed on the display unit 30 and the timing at which the command is uttered does not matter, and the voice recognition unit 130 can accept both a command uttered before the plurality of commands are displayed on the display unit 30 and a command uttered while the plurality of commands are displayed. Once the selected command is identified, the process of step S306 is then executed.

[0079] In step S306, the operation processing unit 150 uses the reference data to identify a process associated with the selected command. If the identified process is a state transition (Yes in step S306), the process returns to step S302. On the other hand, if the identified process is not a state transition (No in step S306), the operation processing unit 150 executes the process associated with the selected command (step S307). Then, the voice recognition unit 130 ends accepting command input (step S308). Note that the processes from step S301 to step S308 are repeated unless the operation of the information processing device 10 is turned off.

[0080] When the first condition is satisfied, the speech recognition unit 130 according to this embodiment may not use the first candidate speech pattern for speech recognition, or may use the first candidate speech pattern as in the first embodiment.

[0081] If the first condition is satisfied and the first candidate speech pattern is not used for speech recognition, the speech recognition unit 130 uses the second candidate speech pattern for speech recognition in step S305. In this case, the reference data does not need to include the first candidate speech pattern.

[0082] When the first condition is satisfied, if the first candidate voice pattern is to be used for voice recognition as in the first embodiment, the voice recognition unit 130 uses the first candidate voice pattern in the voice recognition in step S305. That is, the voice recognition unit 130 identifies a selected command from among the multiple commands based on a comparison result between the first detected voice pattern of the voice data received within the period in which the first condition is satisfied and one or more of the multiple first candidate voice patterns, each of which is associated with one of the multiple commands.

[0083] When using the information processing device 10 according to this embodiment, the user can also utter a command for a first state and a command for a second state in succession. In this case, there is almost no silent interval between the two commands in the voice data. In response to this, the voice recognition unit 130 can identify the start point of the second command using a second candidate voice pattern, which is a voice pattern corresponding to the entire command. That is, when the voice recognition unit 130 receives voice data in the first state and identifies the selected command, it identifies a portion of the voice pattern indicated by the voice data that corresponds to the second candidate voice pattern of the command. Then, it treats the portion following the identified portion as the voice pattern of the voice data received for the next, second state.

[0084] As described above, according to the information processing device 10 and the information processing method of this embodiment, the voice recognition unit 130 can receive voice data for specifying the selection results for multiple commands associated with the second state after specifying the selection results in the first state within a period in which a predetermined first condition is satisfied, regardless of whether an image associated with the second state after the transition is displayed on the display unit. This reduces the user's annoyance of waiting for the screen transition.

[0085] Although the embodiments and examples have been described above with reference to the drawings, these are merely examples of the present invention, and various configurations other than those described above can also be adopted.

[0086] In addition, in the flowcharts used in the above description, multiple steps (processes) are described in order, but the order of execution of the steps performed in each embodiment is not limited to the order described. In each embodiment, the order of the steps shown in the drawings can be changed to the extent that the content is not affected. Furthermore, the above-mentioned embodiments can be combined to the extent that the content is not contradictory.

[0087] Below, examples of reference forms are added. 1-1. A voice recognition unit is provided that identifies a selected command from among a plurality of commands based on a comparison result between a first voice pattern detected within a period that satisfies a predetermined first condition and one or more of a plurality of first candidate voice patterns, each of which is associated with one of the plurality of commands. Information processing device. 1-2. In the information processing device described in 1-1, Each of the plurality of first candidate voice patterns corresponds to a voice with a minimum number of initial syllables that can identify a command associated with the first candidate voice pattern. Information processing device. 1-3. In the information processing device according to 1-1 or 1-2, The first condition is that a predetermined button is pressed. Information processing device. 1-4. In the information processing device described in 1-3, The button is provided on the handle of the vehicle. Information processing device. 1-5. In the information processing device described in 1-4, The moving body is a motorcycle. Information processing device. 1-6. In the information processing device according to 1-1 or 1-2, The first condition is that a predetermined time has elapsed since a predetermined gesture was made. Information processing device. 1-7. In the information processing device according to any one of 1-1 to 1-6, The device further includes a determination unit that determines whether the first condition is satisfied. Information processing device. 1-8. In the information processing device according to any one of 1-1 to 1-7, the voice recognition unit identifies the selected command based on a comparison result between a voice pattern detected during a period in which the first condition is not satisfied and one or more of a plurality of second candidate voice patterns, each of which is associated with one of the plurality of commands; For each of the plurality of commands, the second candidate voice pattern is longer than the first candidate voice pattern. Information processing device. 1-9. In the information processing device according to any one of 1-1 to 1-8, an operation processing unit that executes processing based on the command identified by the voice recognition unit; Information processing device. 1-10. In the information processing device according to any one of 1-1 to 1-9, Within the period in which the first condition is satisfied, the voice recognition unit is capable of continuously accepting voice data for identifying a next selected command after identifying the selected command. Information processing device. 1-11. An information processing method executed by one or more computers, comprising: and a voice recognition step of identifying a selected command from among the plurality of commands based on a comparison result between a first voice pattern detected within a period that satisfies a predetermined first condition and one or more of a plurality of first candidate voice patterns, each of which is associated with one of the plurality of commands. Information processing methods. 1-12. Computer, a voice recognition means for identifying a selected command from among the plurality of commands based on a comparison result between a first voice pattern detected within a period that satisfies a predetermined first condition and one or more of a plurality of first candidate voice patterns, each of which is associated with one of the plurality of commands; to function as program. 2-1. An operation processing unit that executes processing based on selection results for a plurality of commands associated with each of a plurality of states; a voice recognition unit that processes the received voice data to identify a selection result for the plurality of commands; Equipped with The operation processing unit transitioning the state according to the selection result; displaying an image associated with the state on a display unit; The voice recognition unit is capable of receiving, within a period in which a predetermined first condition is satisfied, voice data for specifying a selection result for the plurality of commands associated with the second state, after specifying a selection result in the first state, regardless of whether an image associated with the second state after the transition is displayed on the display unit. Information processing device. 2-2. In the information processing device described in 2-1, At least some of the commands associated with the state are presented by the image associated with the state. Information processing device. 2-3. In the information processing device according to 2-1 or 2-2, The first condition is that a predetermined button is pressed. Information processing device. 2-4. In the information processing device described in 2-3, The button is provided on the handle of the vehicle. Information processing device. 2-5. In the information processing device described in 2-4, The moving body is a motorcycle. Information processing device. 2-6. In the information processing device according to 2-1 or 2-2, The first condition is that a predetermined time has elapsed since a predetermined gesture was made. Information processing device. 2-7. In the information processing device according to any one of 2-1 to 2-6, The voice recognition unit identifies a selected command from among the plurality of commands based on a comparison result between a first detected voice pattern of the voice data received within a period in which the first condition is satisfied and one or more of a plurality of first candidate voice patterns, each of which is associated with one of the plurality of commands. Information processing device. 2-8. An information processing device according to any one of 2-1 to 2-7; The display unit system. 2-9. An information processing method executed by one or more computers, an operation processing step of executing a process based on selection results of a plurality of commands associated with each of the plurality of states; a speech recognition step of processing the received speech data to identify a selection result for the plurality of commands; Including, In the operation processing step, transitioning the state according to the selection result; displaying an image associated with the state on a display unit; In the voice recognition step, after a selection result in the first state is identified within a period in which a predetermined first condition is satisfied, voice data for identifying a selection result for the plurality of commands associated with the second state after the transition can be received regardless of whether an image associated with the second state after the transition is displayed on the display unit. Information processing methods. 2-10. Computer, operation processing means for executing a process based on selection results for a plurality of commands associated with each of the plurality of states; a voice recognition means for processing the received voice data to identify a selection result for the plurality of commands; It functions as The operation processing means transitioning the state according to the selection result; displaying an image associated with the state on a display unit; The voice recognition means is capable of receiving, within a period in which a predetermined first condition is satisfied, voice data for specifying a selection result for the plurality of commands associated with the second state, after specifying a selection result in the first state, regardless of whether an image associated with the second state after the transition is displayed on the display unit. program. [Explanation of symbols]

[0088] 10. Information processing equipment 20 Control section 22 Sound collection section 30 Display section 32 Sound output section 50 systems 90 Map 91 marks 101 Storage section 110 Judgment section 130 Voice Recognition Unit 150 Operation processing section 1000 calculator 1020 Bus 1040 processor 1060 memory 1080 storage device 1100 Input / Output Interface 1120 Network Interface

Claims

1. an operation processing unit that executes processing based on selection results for a plurality of commands associated with each of the plurality of states; a voice recognition unit that processes the received voice data to identify a selection result for the plurality of commands; Equipped with The operation processing unit transitioning the state according to the selection result; displaying an image associated with the state on a display unit; The voice recognition unit is capable of receiving, within a period in which a predetermined first condition is satisfied, voice data for specifying a selection result for the plurality of commands associated with the second state, after specifying a selection result in the first state, regardless of whether an image associated with the second state after the transition is displayed on the display unit. Information processing device.

2. 2. The information processing device according to claim 1, At least some of the commands associated with the state are presented by the image associated with the state. Information processing device.

3. 3. The information processing device according to claim 1, The first condition is that a predetermined button is pressed. Information processing device.

4. 4. The information processing device according to claim 3, The button is provided on the handle of the vehicle. Information processing device.

5. 5. The information processing device according to claim 4, The moving body is a motorcycle. Information processing device.

6. 3. The information processing device according to claim 1, The first condition is that a predetermined time has elapsed since a predetermined gesture was made. Information processing device.

7. 3. The information processing device according to claim 1, The voice recognition unit identifies a selected command from among the plurality of commands based on a comparison result between a first detected voice pattern of the voice data received within a period in which the first condition is satisfied and one or more of a plurality of first candidate voice patterns, each of which is associated with one of the plurality of commands. Information processing device.

8. The information processing device according to claim 1 or 2; The display unit system.

9. 1. An information processing method executed by one or more computers, comprising: an operation processing step of executing a process based on selection results of a plurality of commands associated with each of the plurality of states; a speech recognition step of processing the received speech data to identify a selection result for the plurality of commands; Including, In the operation processing step, transitioning the state according to the selection result; displaying an image associated with the state on a display unit; In the voice recognition step, after a selection result in the first state is identified within a period in which a predetermined first condition is satisfied, voice data for identifying a selection result for the plurality of commands associated with the second state can be received regardless of whether an image associated with the second state after the transition is displayed on the display unit. Information processing methods.

10. Computer, operation processing means for executing a process based on selection results for a plurality of commands associated with each of the plurality of states; a voice recognition means for processing the received voice data to identify a selection result for the plurality of commands; It functions as The operation processing means transitioning the state according to the selection result; displaying an image associated with the state on a display unit; The voice recognition means is capable of receiving, within a period in which a predetermined first condition is satisfied, voice data for specifying a selection result for the plurality of commands associated with the second state, regardless of whether an image associated with the second state after the transition is displayed on the display unit, after specifying a selection result in the first state. program.

Images