Voice command and approval device

Abstract

To provide a voice instruction authorization device allowing a crew member to grasp acceptance state of change instruction by voice accurately.SOLUTION: A voice instruction authorization device 1 comprises a change acceptance part 51 which accepts change instruction by voice, a presentation part 3 which presents information, an authorization request indication part 52 which indicates presentation indication of authorization request requesting authorization operation of execution of change instruction for the presentation part 3, an authorization operation reception part 54 which accepts authorization operation by the crew member, a presentation monitoring part 53 which monitors whether or not the presentation part 3 is in state capable of presenting the authorization request, a determination part 56 which determines that the change instruction is refused if the presentation part 3 is in a state which cannot present the authorization request and a re-operation instruction part 57 which indicates presentation instruction of re-operation to the presentation part 3 if the presentation part 3 cannot present the authorization request.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to a voice instruction approval device that approves an instruction to change a setting state of driving assistance control given by a vehicle occupant through voice. [Background technology]

[0002] For example, Patent Document 1 describes a device that receives an instruction to change the setting state of the driving assistance control of the vehicle by the voice of a vehicle occupant. This device recognizes the content of the received change instruction and presents the occupant with an approval request for approval as to whether or not the recognized change instruction can be executed. Then, when the occupant performs an approval operation, this device changes the setting state of the driving assistance control according to the change instruction. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-066226 Summary of the Invention [Problem to be solved by the invention]

[0004] Here, when performing a process of presenting an approval request for execution of the change instruction to the occupant, there may be cases where the approval request cannot be presented, such as when it is necessary to present information with a higher priority, etc. In such cases, the occupant will not know whether the voice change instruction has been correctly accepted or not.

[0005] For this reason, the present disclosure describes a voice instruction acceptance device that enables an occupant to accurately grasp the acceptance status of voice change instructions. [Means for solving the problem]

[0006] One aspect of the present disclosure is a voice instruction approval device that approves an instruction to change a setting state of a driving assistance control given by a vehicle occupant by voice, a change receiving unit that receives the change instruction given by the occupant through voice; A presentation unit that presents information to the occupant; an approval request instructing unit that, when the change instruction is accepted, issues an approval request to the presentation unit to request an approval operation for the execution of the change instruction; an approval operation receiving unit that receives the approval operation by the occupant after the approval request is presented by the presentation unit; a presentation monitoring unit that monitors whether the presentation unit is in a state where the approval request can be presented; a determination unit that determines that the change instruction is approved when the approval request is presented and the approval operation receiving unit receives the approval operation, and that determines that the change instruction is rejected when the presentation monitoring unit detects that the presentation unit is in a state in which the approval request cannot be presented; and a re-operation instruction unit that, when the presentation monitoring unit detects that the presentation unit is in a state in which it is unable to present the approval request, issues a re-operation presentation instruction to the presentation unit to encourage the presentation unit to make the change instruction again."

[0007] This voice instruction approval device includes a presentation monitoring unit that monitors whether the presentation unit is in a state where it can present an approval request. Therefore, even if the presentation unit is unable to present an approval request for some reason, the voice instruction approval device can grasp that the approval request cannot be presented. Then, when the approval request cannot be presented, the voice instruction approval device issues a re-operation presentation instruction to the presentation unit to encourage the change instruction to be made again. This allows the occupant to understand that the voice change instruction was not accepted from the re-operation instruction presented by the presentation unit. In this way, the voice instruction approval device allows the occupant to accurately grasp the acceptance status of the voice change instruction.

[0008] The voice instruction approval device of the present disclosure further includes: [2] "a cancellation receiving unit that receives a cancellation instruction of the approval request instructed by the occupant after the approval request is presented by the presentation unit; The voice instruction acceptance device according to the above-mentioned [1] may be configured such that, when the cancellation instruction is accepted by the cancellation acceptance unit, the judgment unit judges that the change instruction is to be rejected. In this way, even if the change instruction is accepted, if a cancellation instruction is given by the intention of the occupant, the voice instruction acceptance device can reject the accepted change instruction.

[0009] The voice instruction approval device of the present disclosure may be the voice instruction approval device described in [1] or [2] above, [3] "wherein the determination unit determines to reject the change instruction when the presentation monitoring unit detects that the presentation unit is unable to present the approval request after the presentation of the approval request by the presentation unit." In this way, the voice instruction approval device can reject the accepted change instruction when the approval request cannot be presented after the presentation of the approval request but before the occupant performs the approval operation.

[0010] The voice instruction approval device of the present disclosure may be the voice instruction approval device described in [3] above, [4] "wherein, when the presentation monitoring unit detects that the presentation unit is in a state in which it is unable to present the approval request after the presentation unit has presented the approval request, the re-operation instruction unit issues a presentation instruction for the re-operation to the presentation unit." In this way, when the approval request is presented but the occupant is unable to present the approval request before performing the approval operation, the voice instruction approval device can urge the occupant to give a voice change instruction again while rejecting the accepted change instruction. Effect of the Invention

[0011] According to one aspect of the present disclosure, the occupant can accurately grasp the acceptance status of the voice change instruction. [Brief description of the drawings]

[0012] [Figure 1] FIG. 1 is a block diagram illustrating an example of a voice instruction approval device according to an embodiment. [Diagram 2]FIG. 2 is a flowchart showing the flow of a change instruction approval process performed in the voice instruction approval device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] Hereinafter, exemplary embodiments will be described with reference to the drawings. In each drawing, the same or corresponding elements are denoted by the same reference numerals, and duplicated explanations will be omitted.

[0014] As shown in FIG. 1, the voice instruction acceptance device 1 in this embodiment is mounted on, for example, an autonomous driving vehicle. In addition, this vehicle is mounted with a driving assistance device 6. The driving assistance device 6 executes various driving assistance controls of the vehicle. The voice instruction acceptance device 1 accepts an instruction to change the setting state of the driving assistance control (control performed by the driving assistance device 6) instructed by a vehicle occupant (e.g., the driver) by voice. The voice instruction acceptance device 1 inputs the approval result of the change instruction to the driving assistance device 6. The driving assistance device 6 changes the setting state of the driving assistance control based on the approval result.

[0015] More specifically, the voice instruction acceptance device 1 includes a microphone 2, a presentation unit 3, an input switch 4, and a calculation unit 5. The microphone 2 detects the voice of the occupant. The presentation unit 3 presents information to the occupant by various methods. In this embodiment, the presentation unit 3 includes a speaker 31 and a display 32. The speaker 31 presents information to the occupant by sound (voice). The display 32 presents information to the occupant by characters and / or images.

[0016] The presentation unit 3 presents various pieces of information based on instructions from the calculation unit 5. The presentation unit 3 can also present various pieces of information based on instructions from devices other than the calculation unit 5 (for example, the driving support device 6, etc.). Here, when the presentation unit 3 receives information presentation instructions from multiple devices such as the calculation unit 5 at the same time, the presentation unit 3 presents the information according to a predetermined presentation order. For example, the presentation unit 3 can present information based on a presentation instruction with a high predetermined priority among multiple information presentation instructions. In other words, for example, even if the calculation unit 5 issues an instruction to present information, it may happen that the information based on the presentation instruction from the calculation unit 5 is not presented because other information is being presented.

[0017] The input switch 4 is a device that accepts various input operations performed by the occupant. Here, an example will be described in which the voice instruction acceptance device 1 includes the input switch 4 as a device that accepts the input operation of the occupant. However, the voice instruction acceptance device 1 may include a device other than the input switch 4 (such as a touch panel) as a device that accepts the input operation of the occupant.

[0018] The calculation unit 5 performs an approval process for the change instruction input by the occupant through voice. The calculation unit 5 is, for example, an electronic control unit having a CPU [Central Processing Unit], a ROM [Read Only Memory], a RAM [Random Access Memory], etc. In the calculation unit 5, for example, various functions are realized by the CPU executing a program recorded in the ROM or RAM. The calculation unit 5 may be composed of multiple electronic units.

[0019] The calculation unit 5 functionally comprises a change acceptance unit 51, an approval request instruction unit 52, a presentation monitoring unit 53, an approval operation acceptance unit 54, a cancellation acceptance unit 55, a judgment unit 56, a re-operation instruction unit 57, and an instruction output unit 58.

[0020] The change receiving unit 51 receives a change instruction given by the occupant through the microphone 2. As described above, the change instruction received by the change receiving unit 51 is an instruction to change the setting state of the driving assistance control. The change receiving unit 51 can recognize the change instruction given through the voice (the instruction content of the change instruction) using a well-known voice recognition technology.

[0021] When a change instruction is accepted (recognized) by the change acceptance unit 51, the approval request instruction unit 52 instructs the presentation unit 3 to issue an instruction to present an approval request requesting an approval operation for the execution of the change instruction. In other words, when a change instruction is issued by an occupant by voice, the voice instruction approval device 1 requests the occupant's approval as to whether the change instruction may be executed. The presentation unit 3 presents the approval request to the occupant using the speaker 31 and / or the display 32 based on the instruction to present the approval request by the approval request instruction unit 52. Note that the approval request presented using the speaker 31 and the display 32 continues to be presented until, for example, the occupant performs an approval operation or a cancellation instruction.

[0022] The presentation monitoring unit 53 monitors whether the presentation unit 3 (speaker 31 and display 32) is in a state where it can present an approval request. As described above, when an instruction to present a plurality of pieces of information is input at the same time, the presentation unit 3 may not be able to present the approval request instructed by the approval request instructing unit 52 depending on the priority, etc. For this reason, the presentation monitoring unit 53 monitors whether the presentation unit 3 is in a state where it can present an approval request.

[0023] The approval operation receiving unit 54 receives an approval operation by the occupant after the approval request is presented by the presentation unit 3. For example, the approval operation receiving unit 54 can receive an input operation of the input switch 4 by the occupant as an approval operation for the approval request.

[0024] The cancellation receiving unit 55 receives an instruction to cancel the approval request instructed by the occupant after the approval request is presented by the presentation unit 3. For example, the cancellation receiving unit 55 can receive, as an instruction to cancel the approval request, an operation by the occupant to select (press) a predetermined mark (e.g., a cross mark) for canceling the presentation screen of the approval request displayed on the display 32. The cancellation operation of the approval request received by the cancellation receiving unit 55 is not limited to an operation by the occupant to select a mark displayed on the display 32, and the cancellation operation may also include an operation of another cancel switch or the like.

[0025] The determination unit 56 determines whether or not to approve the change instruction given by the occupant by voice. Specifically, when an approval request is presented and the approval operation is accepted by the approval operation accepting unit 54, the determination unit 56 determines that the change instruction is approved. On the other hand, when the change accepting unit 51 accepts the change instruction and the presentation monitoring unit 53 detects that the presentation unit 3 is in a state in which it cannot present an approval request, the determination unit 56 determines that the change instruction is rejected.

[0026] Furthermore, the determination unit 56 determines to reject the change instruction when a cancellation instruction is received by the cancellation receiving unit 55. Here, when the occupant issues a cancellation instruction rather than an approval operation, the determination unit 56 determines that the occupant no longer has the intention to execute the change instruction and therefore determines to reject the change instruction. In this case, the re-operation instruction unit 57 described later does not issue an instruction to present a re-operation.

[0027] Furthermore, when the presentation monitoring unit 53 detects that the presentation unit 3 is in a state where it cannot present an approval request after the presentation of an approval request by the presentation unit 3, the determination unit 56 determines that the change instruction is to be rejected. A case where the presentation unit 3 is in a state where it cannot present an approval request is, for example, a case where an instruction to present other information with a higher priority is input to the presentation unit 3 after the presentation of an approval request by the presentation unit 3 and before the occupant performs an approval operation or the like. In this case, the re-operation instruction unit 57 described later issues an instruction to present the re-operation.

[0028] Furthermore, if a predetermined time has elapsed with the approval request being presented after the presentation unit 3 has presented the approval request, the determination unit 56 determines that the occupant no longer intends to execute the change instruction and rejects the change instruction. In this case, the re-operation instruction unit 57, which will be described later, does not provide an instruction to present a re-operation.

[0029] When the presentation monitoring unit 53 detects that the presentation unit 3 is in a state in which it cannot present an approval request, the re-operation presentation unit 57 issues a re-operation presentation instruction to the presentation unit 3. This re-operation presentation instruction is an instruction to encourage the user to give a voice change instruction again after a predetermined time has elapsed. When the presentation unit 3 presents a re-operation, the occupant can recognize that the previous change instruction was not approved. Then, the occupant gives a voice change instruction again after the predetermined time has elapsed.

[0030] As described above, although the presentation monitoring unit 53 detects that an approval request has been presented, the approval request may not be presented thereafter. For this reason, when the presentation monitoring unit 53 detects that the presentation unit 3 is in a state in which it cannot present an approval request after the presentation unit 3 has presented an approval request, the re-operation instructing unit 57 instructs the presentation unit 3 to issue a presentation instruction for re-operation.

[0031] When the determination unit 56 determines that the change instruction is to be approved, the instruction output unit 58 outputs the approved change instruction to the driving assistance device 6. As a result, the driving assistance device 6 changes the setting state of the driving assistance control in accordance with the change instruction.

[0032] Next, the approval process of a change instruction by voice performed in the voice instruction approval device 1 will be described with reference to the flowchart of Fig. 2. The process shown in Fig. 2 is started when an occupant issues a change instruction by voice. As shown in Fig. 2, when an occupant issues a change instruction by voice, the change acceptance unit 51 accepts the change instruction via the input switch 4. Then, the change acceptance unit 51 recognizes the content of the change instruction (S101).

[0033] When the change instruction is recognized, the presentation monitoring unit 53 judges whether the presentation unit 3 is in a state where it can present an approval request (S102). If it is in a state where it can present an approval request (S102: YES), the approval request instructing unit 52 instructs the presentation unit 3 to present an approval request requesting an approval operation for the execution of the change instruction. As a result, the presentation unit 3 presents the approval request to the occupant (S103).

[0034] After the approval request is presented, the determination unit 56 determines whether or not an approval operation by the occupant has been accepted by the approval operation accepting unit 54 (S104). If the approval operation has been accepted (S104: YES), the determination unit 56 determines that the accepted change instruction is approved (S105). If the change instruction is approved, the instruction output unit 58 outputs the approved change instruction to the driving assistance device 6 (S106).

[0035] On the other hand, if it is determined in the process of S102 that the approval request cannot be presented (S102: NO), the re-operation presentation instruction is instructed to the presentation unit 3 to give a voice change instruction again after a predetermined time has elapsed (S107).Then, the determination unit 56 determines to reject the accepted change instruction (S108).

[0036] In the process of S104, if the approval operation has not been accepted (S104: NO), the determination unit 56 determines whether or not a cancellation operation by the occupant has been accepted by the cancellation acceptance unit 55 (S109). If a cancellation operation has been accepted (S109: YES), the determination unit 56 determines to reject the accepted change instruction (S108).

[0037] In the process of S109, if the cancel operation has not been accepted (S109: NO), the determination unit 56 determines whether or not the presentation monitoring unit 53 has detected that the presentation unit 3 is in a state in which it can present an approval request (S110). That is, the determination unit 56 determines whether or not the presentation unit 3 is in a state in which it can present an approval request and the approval request has been presented based on an instruction to present the approval request.

[0038] If the approval request can be presented (S110: YES), the judgment unit 56 judges whether or not a predetermined time has elapsed since the approval request was presented in S103 (S111). If the predetermined time has elapsed (S111: YES), the judgment unit 56 judges that the accepted change instruction is to be rejected (S108). On the other hand, if the predetermined time has not elapsed (S111: NO), the judgment unit 56 performs the process of S104 described above again.

[0039] Furthermore, if it is determined in the process of S110 that the approval request cannot be presented (S110: NO), a re-operation presentation instruction is issued to the presentation unit 3 (S112). Then, the determination unit 56 determines to reject the accepted change instruction (S108).

[0040] As described above, the voice instruction approval device 1 includes the presentation monitoring unit 53 that monitors whether the presentation unit 3 is in a state where it can present an approval request. Therefore, even if the presentation unit 3 cannot present an approval request for some reason, the voice instruction approval device 1 can grasp that the approval request cannot be presented. Then, when the approval request cannot be presented, the voice instruction approval device 1 issues a re-operation presentation instruction to the presentation unit 3 to prompt the user to give a change instruction again when the approval request cannot be presented. This allows the occupant to understand that the voice change instruction was not accepted by the re-operation presentation instruction presented by the presentation unit 3. In this way, the voice instruction approval device 1 allows the occupant to accurately grasp the acceptance status of the voice change instruction.

[0041] The determination unit 56 determines to reject the change instruction when the cancellation instruction is accepted by the cancellation acceptance unit 55. In this way, even if the change instruction is accepted, the voice instruction acceptance device 1 can reject the accepted change instruction when the cancellation instruction is issued by the occupant's will.

[0042] In addition, after the presentation unit 3 presents an approval request, the presentation unit 3 may be in a state where it is unable to present the approval request. In this case, the determination unit 56 determines to reject the accepted change instruction. In this way, the voice instruction approval device 1 can reject the accepted change instruction when it becomes unable to present the approval request after presenting the approval request before the occupant performs the approval operation. In this case, the determination unit 56 also instructs the presentation unit to issue a presentation instruction for re-operation. In this way, the voice instruction approval device 1 can urge the occupant to give a voice change instruction again when the presentation unit 3 is unable to present the approval request. [Explanation of symbols]

[0043] 1...voice instruction approval device, 3...presentation unit, 51...change acceptance unit, 52...approval request instruction unit, 53...presentation monitoring unit, 54...approval operation acceptance unit, 55...cancellation acceptance unit, 56...determination unit, 57...re-operation instruction unit.

Claims

1. A voice instruction approval device that approves an instruction to change a setting state of a driving assistance control given by a vehicle occupant through voice, a change receiving unit that receives the change instruction given by the occupant through voice; A presentation unit that presents information to the occupant; an approval request instructing unit that, when the change instruction is accepted, issues an approval request to the presentation unit to request an approval operation for the execution of the change instruction; an approval operation receiving unit that receives the approval operation by the occupant after the approval request is presented by the presentation unit; a presentation monitoring unit that monitors whether the presentation unit is in a state where the approval request can be presented; a determination unit that determines that the change instruction is approved when the approval request is presented and the approval operation receiving unit receives the approval operation, and that determines that the change instruction is rejected when the presentation monitoring unit detects that the presentation unit is in a state in which the approval request cannot be presented; A voice instruction approval device comprising: a re-operation instruction unit that, when the presentation monitoring unit detects that the presentation unit is in a state in which it is unable to present the approval request, instructs the presentation unit to issue a re-operation presentation instruction to encourage the presentation unit to make the change instruction again.

2. a cancellation receiving unit configured to receive a cancellation instruction for the approval request, the cancellation instruction being given by the occupant after the approval request is presented by the presentation unit, The voice instruction approval device according to claim 1 , wherein the determination unit determines that the change instruction is to be rejected when the cancellation instruction is accepted by the cancellation acceptance unit.

3. The voice instruction approval device according to claim 1 or 2, wherein the determination unit determines to reject the change instruction when the presentation monitoring unit detects that after the approval request is presented by the presentation unit, the presentation unit is in a state where the presentation unit is unable to present the approval request.

4. The voice instruction approval device of claim 3, wherein the re-operation instruction unit instructs the presentation unit to present the re-operation when the presentation monitoring unit detects that the presentation unit is in a state where it is unable to present the approval request after the approval request has been presented by the presentation unit.

Images