Information processing device and information processing method

The information processing device automatically executes voice commands after feedback, addressing delays in existing systems by allowing immediate cancellation during a defined feedback period.

JP7589789B2Active Publication Date: 2024-11-26NISSAN MOTOR CO LTD
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2023201655
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2023-11-29
Publication Date
2024-11-26
Estimated Expiration
2040-06-30

AI Technical Summary

Technical Problem

Existing voice-controlled devices require user confirmation and approval before executing control, leading to delays in actual execution.

Method used

An information processing device that recognizes voice commands, provides feedback audio, and automatically executes control unless a cancellation signal is received during the feedback period.

Benefits of technology

Enables prompt and automatic execution of control commands without user intervention after feedback, allowing immediate cancellation if necessary.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007589789000001
    Figure 0007589789000001
  • Figure 0007589789000002
    Figure 0007589789000002
  • Figure 0007589789000003
    Figure 0007589789000003
Patent Text Reader

Abstract

To provide an information processing apparatus and an information processing method in which control is stopped only when necessary, and control is automatically executed promptly unless a stop instruction is provided.SOLUTION: An information processing apparatus 1 comprises: a voice data input device (a microphone 11) to which voice data is input; user data input devices (the microphone 11, a touch panel 12, a switch 13, and a camera 14) to which user data is input by a user; and a controller 20. The controller 20 recognizes first voice data input to the voice data input device (the microphone 11), outputs second voice data indicating control of a prescribed device on the basis of a recognition result of the first voice data, and controls the prescribed device on the basis of the recognition result after notification of the second voice data is made, but stops the control of the prescribed device when user data indicating a stop of the control of the prescribed device is input while the notification of the second voice data is being made.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an information processing device and an information processing method. [Background technology]

[0002] Conventionally, there are known inventions that control devices such as remote controls using the user's voice (Patent Document 1). The invention described in Patent Document 1 recognizes the user's voice and displays control content corresponding to the user's command on the remote control. The user checks the control content displayed on the remote control, and the control is executed when the user approves the control content. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2007-286174 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, the invention described in Patent Document 1 has a problem in that it takes a long time before the control is actually executed because the user is required to confirm the control content and then approval is requested.

[0005] The present invention has been made in consideration of the above problems, and its purpose is to provide an information processing device and an information processing method in which control is stopped only when necessary, and control is automatically executed promptly unless a stop instruction is given. [Means for solving the problem]

[0006] An information processing device according to one aspect of the present invention recognizes first voice data input to a voice data input device, outputs second voice data indicating that a predetermined device is to be controlled based on a result of recognizing the first voice data, and controls the predetermined device based on the result of recognizing the first voice data after notification of the second voice data is completed;In the case where the specified equipment is equipment in which pinching may occur or equipment that affects operation, 2. If user data is input indicating that control of a specific device is to be stopped while voice data is being announced, , place Before executing the control of a specific device, In control Accept the stop, If the specified device is not a device where pinching may occur or a device that affects driving, and if user data indicating the suspension of control of the specified device is input while the second voice data is being notified, the suspension of control of the specified device is not accepted before the control of the specified device is executed. . Effect of the Invention

[0007] According to the present invention, the control is stopped only when necessary, and the control is executed automatically and immediately unless a stop instruction is given. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a configuration diagram of an information processing device 1 according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a sequence diagram illustrating an example of an operation of the information processing device 1 according to the embodiment of the present invention. [Diagram 3] FIG. 3 is a diagram for explaining a display example of the display 12. As shown in FIG. [Figure 4] FIG. 4 is a diagram showing a state in which the voice recognition function is activated. [Diagram 5] FIG. 5 is a display example during the time when feedback audio data is being announced from the speaker 31. In FIG. [Figure 6] FIG. 6 is a diagram illustrating an example of an operation performed by a user to stop control by the controller 20. In FIG. [Figure 7] FIG. 7 is a diagram illustrating another example of an operation performed by the user to stop control by the controller 20. In FIG. [Figure 8] FIG. 8 is a diagram illustrating another example of an operation performed by the user to stop the control by the controller 20. In FIG. [Figure 9] FIG. 9 is a diagram illustrating another example of an operation performed by the user to stop the control by the controller 20. In FIG. [Figure 10] FIG. 10 is a configuration diagram of an information processing device 2 according to a modified example of the present invention. [Figure 11]FIG. 11 is a sequence diagram illustrating an example of an operation of the information processing device 2 according to the modified example of the present invention. [Figure 12] FIG. 12 is a sequence diagram illustrating an example of an operation of the information processing device 2 according to the modified example of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In the description of the drawings, the same parts are given the same reference numerals and the description will be omitted.

[0010] An example of the configuration of an information processing device 1 according to this embodiment will be described with reference to Fig. 1. As an example, the information processing device 1 is mounted on a vehicle. As shown in Fig. 1, the information processing device 1 includes an input device 10, a controller 20, a database 30, and a speaker 31.

[0011] The input device 10 is a general term for equipment that accepts data from a user in a vehicle. As shown in FIG. 1, the input device 10 includes a microphone 11, a touch panel 12, a switch 13, and a camera 14. User voice data is input to the microphone 11. The microphone 11 is installed, for example, near the driver's seat. The touch panel 12 accepts input by a user's touch operation. The touch panel 12 is mainly used as a display for the navigation device. The switch 13 is provided on the steering wheel and accepts user input (switch on). The camera 14 is installed, for example, near the driver's seat and captures the user's posture, gestures, etc. The data input to the input device 10 is transmitted to a controller 20.

[0012] The controller 20 is a general-purpose computer equipped with a CPU (Central Processing Unit), memory, a storage device, an input / output unit, etc. The controller 20 processes data acquired from the input device 10. Specifically, the CPU loads various programs stored in the storage device into the memory and executes various commands included in the programs. This allows the controller 20 to function as multiple information processing circuits equipped in the information processing device 1. The controller 20 is equipped with a voice recognition unit 21, a voice output unit 22, a notification end determination unit 23, and a control signal transmission unit 24 as the multiple information processing circuits.

[0013] The voice recognition unit 21 recognizes the user's voice data input to the microphone 11. Well-known techniques such as frequency analysis are used for voice recognition. The voice recognition unit 21 outputs the recognition result to the voice output unit 22.

[0014] The voice output unit 22 refers to the database 30 to obtain voice data for feedback corresponding to the recognition result of the voice recognition unit 21. The voice data for feedback is used to prompt the user to confirm the control of a specific device that is about to be performed. For example, if the user's voice data is recognized as "open the driver's window," the corresponding voice data for feedback becomes "open the driver's window." A plurality of voice data for feedback are prepared in advance and stored in the database 30. In this embodiment, the database 30 is described as being stored in a storage device different from the storage device of the controller 20, but is not limited to this. The database 30 may be stored in the storage device of the controller 20.

[0015] The voice output unit 22 notifies the user of the voice data for feedback through the speaker 31. The voice output unit 22 may generate voice data for feedback each time based on the recognition result of the voice recognition unit 21. As a generation method, the voice output unit 22 may be programmed to generate voice data that echoes the voice data of the user.

[0016] When the audio output unit 22 starts outputting the audio data for feedback, it transmits a signal indicating the start to the notification end determination unit 23. When the audio output unit 22 ends outputting the audio data for feedback, it transmits a signal indicating the end to the notification end determination unit 23. Hereinafter, the signal indicating the start may be simply referred to as a start signal. Similarly, the signal indicating the end may be simply referred to as an end signal.

[0017] The notification end determination unit 23 determines whether the notification by the audio output unit 22 has ended. Specifically, when the notification end determination unit 23 receives an end signal after receiving a start signal from the audio output unit 22, it determines that the notification by the audio output unit 22 has ended. On the other hand, when the notification end determination unit 23 receives a start signal from the audio output unit 22 but does not receive an end signal thereafter, it determines that the notification by the audio output unit 22 has not ended. When the notification end determination unit 23 determines that the notification by the audio output unit 22 has ended, it transmits a signal indicating that the notification has ended to the control signal transmission unit 24.

[0018] When the control signal transmission unit 24 receives a signal indicating that the notification has ended from the notification end determination unit 23, it controls a predetermined device based on the user's instruction (voice data) obtained by the recognition result of the voice recognition unit 21. The predetermined device is a device mounted on the vehicle, and includes a power window 32, an air conditioner 33, a sunroof 34, a sunshade 35, a power back door 36, a power trunk 37, a navigation device 38, an audio device 39, and the like, as shown in FIG. 1. As an example, when the user's instruction is "open the driver's seat window," the control signal transmission unit 24 transmits a signal to open the window to the driver's seat power window 32. The power window 32 automatically opens the window based on the received signal. The predetermined device may include a device that performs driving control such as automatic driving.

[0019] Next, an example of the operation of the information processing device 1 will be described with reference to FIGS.

[0020] In step S101 shown in FIG. 2, a user in a vehicle activates a voice recognition function. In this embodiment, the voice recognition function is not always activated. The voice recognition function is activated by a user's instruction. An example of a method for activating the voice recognition function will be described with reference to FIG. 3. As shown in FIG. 3, route guidance by the navigation device 38 is displayed on the touch panel 12 while driving. An icon 50 indicating speech is displayed on the touch panel 12. The voice recognition function is activated when the user touches this icon 50. As another activation method, a switch 13 provided on the steering wheel may be provided with a trigger function for activation, or the voice recognition function may be activated when a user's utterance regarding a predetermined keyword is recognized.

[0021] When the voice recognition function is activated, the display on the touch panel 12 changes to the content shown in Fig. 4. After the voice recognition function is activated, as shown in Fig. 4, icons 51, 52, and devices that can be instructed by voice are displayed on the touch panel 12. Note that, although the air conditioner, power window, navigation device, and audio device are displayed as devices that can be instructed by voice in Fig. 4, this is only one example.

[0022] Icon 52 shown in Fig. 4 is an icon indicating that voice recognition is possible. After the user confirms that icon 52 is displayed on touch panel 12, the user inputs an instruction for operating a specific device by voice. That is, as shown in step S103 in Fig. 2, the user inputs voice data into microphone 11. In Fig. 2, the user's instruction is "Open the driver's window."

[0023] The process proceeds to step S105, where the voice recognition unit 21 that has acquired the user's voice data recognizes the voice data. The process proceeds to step S107, where the voice output unit 22 refers to the database 30 and acquires voice data for feedback corresponding to the recognition result of the voice recognition unit 21. Since the user's instruction is recognized as "open the driver's window," "open the driver's window" is selected as the voice data for feedback. The voice output unit 22 notifies the user of the voice data for feedback through the speaker 31. When notification of the voice data for feedback starts, that is, when output of the voice data for feedback starts from the speaker 31, the display on the touch panel 12 switches to the content shown in FIG. 5.

[0024] The process proceeds to step S109, where the notification end determination unit 23 determines whether or not the notification by the voice output unit 22 has ended. When the notification end determination unit 23 receives an end signal after receiving a start signal from the voice output unit 22, it determines that the notification by the voice output unit 22 has ended. In Fig. 2, the notification by the voice output unit 22 has ended means that the output of the voice data "The driver's seat window will be opened" has ended.

[0025] When the notification end determination unit 23 receives a start signal from the audio output unit 22 but does not subsequently receive an end signal, it determines that the notification by the audio output unit 22 has not ended. In other words, when the notification end determination unit 23 receives a start signal from the audio output unit 22 but does not subsequently receive an end signal, it determines that the feedback audio data is being notified from the speaker 31.

[0026] If it is determined that the notification by the voice output unit 22 has ended (NO in step S109), the process proceeds to step S111. In step S111, the notification end determination unit 23 transmits a signal indicating that the notification has ended to the control signal transmission unit 24. The control signal transmission unit 24, which has received this signal, transmits a control signal to the driver's seat power window 32 to open the window. The process proceeds to step S113, and the power window 32, which has received the control signal, automatically opens the window (step S115).

[0027] On the other hand, if it is determined that the notification by the audio output unit 22 has not ended (YES in step S109), the process proceeds to step S119.

[0028] In step S119, if the controller 20 receives a signal indicating control suspension from the user while the voice data for feedback is being notified from the speaker 31 (YES in step S119), the controller 20 suspends control of the predetermined device (step S121). Here, the signal indicating control suspension (hereinafter, may be simply referred to as suspension signal) will be described. The suspension signal is a signal transmitted to the controller 20 when the user performs a predetermined operation. When the user instructs by voice to "open the driver's seat window", the user receives feedback of "opening the driver's seat window" through the speaker 31. If there is an error in the voice recognition at this time, suspension of control is assumed as the user's request. In the example shown in FIG. 2, the user's voice instruction is accurately recognized, but there may be cases where the user's voice instruction is not accurately recognized, such as "opening the passenger seat window". In such a case, suspension of control is assumed as the user's request.

[0029] In this embodiment, the user can send a stop signal to the controller 20 by a plurality of methods while the feedback audio data is being notified from the speaker 31, and can stop the control by the controller 20. On the other hand, when the notification by the audio output unit 22 ends, the user cannot send a stop signal to the controller 20, or even if the user can send the stop signal, the controller 20 does not accept the stop signal. Therefore, in order to stop the control by the controller 20, the user needs to perform a predetermined operation while the feedback audio data is being notified from the speaker 31. Note that the period during which the feedback audio data is being notified from the speaker 31 is defined as the period from when the notification end determination unit 23 receives a start signal from the audio output unit 22 to when it receives an end signal.

[0030] A predetermined operation performed by the user to stop control by the controller 20 will be described with reference to FIGS.

[0031] 6, the user can stop control by the controller 20 by touching an icon 51 displayed on the touch panel 12. Specifically, when the user touches the icon 51 while feedback audio data is being announced from the speaker 31, a stop signal is transmitted to the controller 20. The controller 20 that receives the stop signal does not transmit a control signal to the power window 32 to open the window. This causes the control by the controller 20 to be stopped. The icon 51 is a so-called icon indicating a return.

[0032] 7, the user can stop control by the controller 20 by touching an icon 54 displayed on the touch panel 12. Specifically, if the user touches the icon 54 while feedback audio data is being announced from the speaker 31, a stop signal is transmitted to the controller 20. The word "stop" is displayed on the icon 54.

[0033] Alternatively, as shown in FIG. 8, the user can stop the control by the controller 20 by swiping the touch panel 12. Swiping refers to an operation of sliding a finger while touching the touch panel 12. If the user swipes the touch panel 12 while the feedback audio data is being notified from the speaker 31, a stop signal is transmitted to the controller 20. In the example shown in FIG. 8, the swipe is from left to right, but is not limited to this. The user may swipe from top to bottom or from right to left. Regardless of the swipe direction, if the swipe is performed while the feedback audio data is being notified from the speaker 31, a stop signal is transmitted to the controller 20.

[0034] Alternatively, as shown in Fig. 9, the user can stop control by the controller 20 by pressing a specific switch (switch 61 in Fig. 9) among the switches 13 provided on the steering wheel 60. Specifically, when the user presses switch 61 while feedback audio data is being announced from the speaker 31, a stop signal is transmitted to the controller 20. Note that switch 61 is a so-called return switch.

[0035] Alternatively, the user can use voice to stop control by the controller 20. Specifically, if the user gives a voice command saying "stop" into the microphone 11 while feedback voice data is being announced from the speaker 31, control by the controller 20 is stopped. If voice data is input while feedback voice data is being announced from the speaker 31, the voice recognition unit 21 recognizes the input voice data. If the recognized voice data indicates the stop of control, the controller 20 stops control. In this case, the voice data input while feedback voice data is being announced from the speaker 31 becomes a stop signal.

[0036] As another example, the user can use a gesture to stop control by the controller 20. Specifically, if the user makes a gesture indicating stop in front of the camera 14 while the feedback voice data is being announced from the speaker 31, a stop signal is transmitted to the controller 20. An example of a gesture indicating stop is a gesture of holding a hand in front of the camera 14. If image data is input from the camera 14 while the feedback voice data is being announced from the speaker 31, the controller 20 analyzes the image data. If a gesture indicating stop is detected from the image data, the controller 20 stops control. In this case, the image data input while the feedback voice data is being announced from the speaker 31 becomes a stop signal.

[0037] The cause of the control interruption is not limited to erroneous recognition of voice data. For example, the user may wish to cancel an instruction. That is, the user may have given a voice instruction to "open the driver's seat window," but may simply wish to cancel that instruction. In such a case, the user may perform a predetermined operation while the feedback voice data is being announced from the speaker 31, as described above.

[0038] Return to FIG. 2. In step S117, if the user performs an operation to transmit a stop signal while the feedback audio data is being notified from the speaker 31, the stop signal is transmitted to the controller 20. Steps S119 and S121 have already been described. The example shown in FIG. 2 is a case where a stop signal is transmitted, but there are of course cases where the stop signal is not transmitted. If the user does nothing while the feedback audio data is being notified from the speaker 31, the stop signal is naturally not transmitted. In this case, the window is opened promptly after the notification ends.

[0039] The end of the notification by the audio output unit 22 in step S109 in FIG. 2 means that the notification has ended without a stop signal being transmitted from the user while the feedback audio data is being notified from the speaker 31.

[0040] It should be noted that, although it has been explained that when the notification by the audio output unit 22 ends, the user is no longer able to transmit a stop signal to the controller 20, it should be noted that when the notification by the audio output unit 22 ends, the display on the touch panel 12 switches from the content shown in Fig. 5 to the content shown in Fig. 3. Therefore, when the notification by the audio output unit 22 ends, the user is no longer able to transmit a stop signal using the touch panel 12.

[0041] (Action and effect) As described above, the information processing device 1 according to this embodiment provides the following advantageous effects.

[0042] The information processing device 1 includes a voice data input device (microphone 11) to which voice data of a user riding in a vehicle is input, a user data input device (microphone 11, touch panel 12, switch 13, camera 14) to which user data is input from the user, and a controller 20. The controller 20 recognizes first voice data input to the voice data input device. The first voice data is voice data indicating an instruction to operate a specific device, and an example is the above-mentioned "open the driver's window." The controller 20 outputs second voice data indicating to control a specific device from a speaker 31 based on the recognition result of the first voice data. An example of the second voice data is the above-mentioned "open the driver's window."

[0043] After the second voice data is notified, the controller 20 controls the predetermined device based on the recognition result, while the controller 20 stops the control of the predetermined device if user data indicating the stop of control of the predetermined device is input while the second voice data is being notified. The user data indicating the stop of control is the stop signal described above. According to the information processing device 1 having such a configuration, after feedback to the user, the control is automatically executed immediately unless the user instructs the control to be stopped. Furthermore, the user can stop the control as necessary.

[0044] The predetermined devices are devices mounted on the vehicle, and include at least one of a power window 32, an air conditioner 33, a sunroof 34, a sunshade 35, a power back door 36, a power trunk 37, a navigation device 38, and an audio device 39.

[0045] The notification by the second voice data is a notification to control a predetermined device. For example, the notification by the second voice data is a notification to open the power window 32.

[0046] When the notification by the second voice data ends without input of user data indicating the stop of the control of the predetermined device, the controller 20 executes the control of the predetermined device. As a result, after feedback to the user, the control is executed automatically and promptly unless the user instructs to stop. Also, when the notification by the second voice data ends without input of user data indicating the stop of the control of the predetermined device, the controller 20 executes the control of the predetermined device without accepting input of other user data.

[0047] The user data is data indicating that the user has operated the touch panel 12, image data capturing an image of the user's posture, data indicating that the user has operated a switch 61 provided on the steering wheel, or voice data input to a voice data input device.

[0048] "After the second voice data has been announced" is defined as "after the output of the second voice data has finished," and "while the second voice data is being announced" is defined as the period from when the output of the second voice data starts to when it ends.

[0049] (Modification) Next, a modification of this embodiment will be described with reference to FIG.

[0050] Compared to the information processing device 1, the information processing device 2 according to the modified example further includes a determination unit 25 and a waiting time setting unit 26. Configurations that overlap with those of the information processing device 1 will be referred to by reference numerals and descriptions thereof will be omitted. The following description will focus on the differences.

[0051] The identification unit 25 identifies a device that can be used by the user from among the input devices 10. The available device here means a device that can be used to stop control by the controller 20. In other words, the available device means a device that can be used while the feedback audio data is being announced from the speaker 31.

[0052] In Fig. 10, a microphone 11, a touch panel 12, a switch 13, and a camera 14 are shown as input devices 10, but not all of these are necessarily available at all times. They may be unavailable due to a malfunction or other reasons. Or they may be unavailable due to some constraint. As a method for determining whether they are available or not, it is possible to determine whether they are available or not by checking the presence or absence of a signal indicating that they are operating normally.

[0053] When the identification unit 25 receives signals indicating normal operation from the microphone 11, the touch panel 12, the switch 13, or the camera 14, it identifies the device as being available for use while the feedback audio data is being announced from the speaker 31. The identification unit 25 transmits a signal indicating the identification result to the standby time setting unit 26.

[0054] The standby time setting unit 26 sets the standby time based on the signal received from the identification unit 25. The standby time is the time for accepting a stop signal from the user after the notification by the audio output unit 22 has ended. In the above embodiment, it has been described that the controller 20 does not accept a stop signal when the notification by the audio output unit 22 has ended, but in the modified example, the controller 20 accepts a stop signal for the set standby time even after the notification by the audio output unit 22 has ended. For example, if the notification by the audio output unit 22 lasts for 2 seconds and the standby time set by the standby time setting unit 26 is 3 seconds, the time during which the user can send a stop signal is 5 seconds (2 seconds + 3 seconds) in the modified example.

[0055] Next, a method for setting the standby time will be described. The standby time is set according to the available device identified by the identification unit 25. For example, assume that the only device identified as available is the camera 14. In this case, the standby time is set to the longest compared to the case where other devices are identified. The reason is that the user needs to hold his / her hand in front of the camera 14 to send a stop signal, and the time required for this action must be secured. This standby time is called the first standby time.

[0056] Next, assume that the only device identified as available is the microphone 11. In this case, the waiting time is set to be shorter than when the camera 14 is identified. This is because the time required to speak is shorter than the time required to hold a hand in front of the camera 14. This waiting time is called a second waiting time.

[0057] Next, assume that the only device identified as available is the touch panel 12. In this case, the waiting time is set to be shorter than when the camera 14 is identified. This is because the time required to operate the touch panel 12 is shorter than the time required to hold a hand in front of the camera 14. This waiting time is called a third waiting time.

[0058] Next, assume that the only device identified as available is switch 13 (switch 61). In this case, the waiting time is set shorter than when camera 14 is identified. This is because the time required to operate switch 61 is shorter than the time required to hold a hand in front of camera 14. This waiting time is called a fourth waiting time.

[0059] The relationship between the first to fourth standby times is first standby time>second standby time>third standby time>fourth standby time.

[0060] Next, an operation example of the information processing device 2 will be described with reference to Figures 11 and 12. However, since the processes of steps S201 to S205, S211, and S215 to S225 are similar to the processes of steps S101 to S105, S107, and S111 to S121 shown in Figure 2, the description thereof will be omitted.

[0061] In step S207, the identification unit 25 receives signals indicating that the microphone 11, the touch panel 12, the switch 13, and the camera 14 are operating normally. If the signals are received, the identification unit 25 identifies the device as available. The identification unit 25 transmits a signal indicating the identification result to the standby time setting unit 26.

[0062] In step S209, the waiting time setting unit 26 sets a waiting time based on the signal received from the identifying unit 25.

[0063] In step S213, the notification end determination unit 23 determines whether the standby time has ended. When the notification end determination unit 23 receives a signal indicating that the standby time has ended from the standby time setting unit 26 after receiving a start signal from the audio output unit 22, the notification end determination unit 23 determines that the standby time has ended. As an example, when the notification by the audio output unit 22 is 2 seconds and the standby time set by the standby time setting unit 26 is 3 seconds, it is determined that the standby time has ended when 5 seconds have elapsed after the notification by the audio output unit 22 started. Note that the end of the standby time in step S213 means that the standby time has ended without a stop signal being transmitted from the user.

[0064] (Action and effect) User data includes multiple types. Specifically, devices capable of transmitting a stop signal include multiple types (microphone 11, touch panel 12, switch 13, camera 14). The controller 20 changes the time (standby time) for accepting user data indicating the stop of control of a specific device according to the type of user data. According to the information processing device 2 having such a configuration, after feedback to the user, control is automatically executed promptly after the waiting time has elapsed unless the user issues a stop instruction. In addition, since the type of user data is used to set the waiting time, it is possible to set it according to the user interface.

[0065] Although the standby time is set according to the available device identified by the identification unit 25 as described above, the standby time may be set according to the device corresponding to the user's instruction. As described above, if the user's instruction is "open the driver's window", the device corresponding to the user's instruction is the power window 32. In another example, if the user's instruction is "play the radio", the device corresponding to the user's instruction is the audio device 39. If the device corresponding to the user's instruction is a device in which pinching may occur, such as the power window 32, the sunroof 34, the power back door 36, or the power trunk 37, the standby time may be set longer than that for devices in which pinching does not occur. This allows the user to have time to decide whether or not to cancel the instruction.

[0066] Furthermore, if the device corresponding to the user's instruction is a device that performs driving control such as automatic driving, the standby time may be set longer than if the device does not perform driving control. This is because the driving environment changes from moment to moment, and it may take time to determine whether to cancel the instruction regarding driving control.

[0067] The waiting time may be set depending on whether the vehicle is moving or stopped. Specifically, the waiting time may be set longer when the vehicle is moving than when the vehicle is stopped. This is because it is expected that the user's response will be slower when the vehicle is moving than when the vehicle is stopped.

[0068] Each of the functions described in the above embodiments may be implemented by one or more processing circuits. A processing circuit includes a programmed processing device, such as a processor including electrical circuitry. A processing circuit also includes devices such as application specific integrated circuits (ASICs) or circuit components arranged to perform the described functions.

[0069] As described above, the embodiment of the present invention has been described, but the description and drawings forming a part of this disclosure should not be understood as limiting this invention. From this disclosure, various alternative embodiments, examples and operating techniques will become apparent to those skilled in the art.

[0070] For example, a signal other than a stop signal may be input from the user while the feedback voice data is being notified from the speaker 31. The controller 20 may have a function of determining whether or not the signal input while the feedback voice data is being notified from the speaker 31 is a stop signal.

[0071] The controller 20 is a device that mechanically operates a given device or Devices that control the in-car environment The user data indicating the stop of control of the predetermined device may be accepted only when the device is a mechanically operated device. The mechanically operated devices are the power windows 32, the sunroof 34, the power back door 36, and the power trunk 37. The device that controls the interior environment of the vehicle is the air conditioner 33. This allows the user to stop control of devices that may cause entrapment or affect driving when activated.

[0072] Recent navigation devices have many functions in addition to route guidance. For example, these functions include providing weather information, news, etc. Therefore, the user's instructions input to the microphone 11 include requests for weather information, news, etc.

[0073] It should be noted that the controller 20 does not need to accept a stop signal for an instruction requesting weather information and news, because providing weather information and news does not involve any mechanical operation or operation that may affect driving.

[0074] The microphone 11 is not limited to one installed in the vehicle. A microphone of a mobile terminal (for example, a smartphone) may be used instead. In this case, the mobile terminal is connected to the controller 20 so as to be able to communicate with the controller 20. [Explanation of symbols]

[0075] 1, 2 Information processing device 10 Input Devices 11. Mike 12 Touch Panel 13. Switch 14 Camera 20 Controller 21 Voice Recognition Unit 22 Audio output section 23 Notification end determination unit 24 Control signal transmitter 25 Specific section 26 Waiting time setting section 30 Databases 31 Speaker

Claims

1. a voice data input device for inputting voice data; a user data input device into which user data is input by a user; A controller, The controller: Recognizing first voice data input to the voice data input device; outputting second voice data indicating that a predetermined device is to be controlled based on a result of recognizing the first voice data; After the notification of the second voice data is completed, the predetermined device is controlled based on a result of the recognition of the first voice data. When the predetermined device is a device where pinching may occur or a device that affects driving, and when user data indicating a stop of control of the predetermined device is input while the second voice data is being notified, accepting the stop of control of the predetermined device before executing the control of the predetermined device, When the predetermined device is not a device where pinching may occur or a device that affects driving, and when user data indicating a stop of control of the predetermined device is input while the second voice data is being notified, the stop of control of the predetermined device is not accepted before the control of the predetermined device is executed.

23. An information processing apparatus comprising:

2. Recognizing first voice data input to a voice data input device; outputting second voice data indicating that a predetermined device is to be controlled based on a result of recognizing the first voice data; After the notification of the second voice data is completed, the predetermined device is controlled based on a result of the recognition of the first voice data. When the predetermined device is a device where pinching may occur or a device that may affect driving, and when user data indicating a stop of control of the predetermined device is input while the second voice data is being notified, the stop of the predetermined device is accepted before executing the control of the predetermined device, When the predetermined device is not a device where pinching may occur or a device that affects driving, and when user data indicating a stop of control of the predetermined device is input while the second voice data is being notified, the stop of control of the predetermined device is not accepted before the control of the predetermined device is executed.

23. An information processing method comprising:

Citation Information

Patent Citations

  • On-vehicle voice recognition device

    JP1995219582A

  • Voice input device

    JP2001216130A

  • Speech interaction method and apparatus

    JP2003208196A

  • Electronic apparatus

    JP2007286174A

  • Attention attracting device to vehicle driver

    JP2016179813A