Voice-operated device, program, and method

Abstract

To provide an improved technique for voice-operating in-vehicle equipment installed in a vehicle.SOLUTION: An in-vehicle voice-operated device is provided, comprising a control unit configured to identify a first seat position of a vehicle occupant who has spoken when the occupant makes a request to operate in-vehicle equipment by voice and, when the in-vehicle equipment requested by the speaker is not located in a position corresponding to the first seat position, operate in-vehicle equipment associated with a second seat position.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present disclosure relates to a voice operation device, a program, and a method.

Background Art

[0002] Conventionally, various techniques for voice-operating in-vehicle equipment provided in vehicles have been studied.

[0003] For example, Patent Document 1 discloses a voice dialogue control device that controls voice operations on a plurality of operating devices that can operate independently at each of a plurality of execution locations.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] Patent Document 1 discloses a voice operation technique for a plurality of operating devices that can operate independently at each of a plurality of execution locations. However, in the technique of Patent Document 1, no consideration has been given to the case where the in-vehicle equipment for which the speaker requests an operation is not provided at the position corresponding to the seat position. Thus, there has been room for improvement in the voice operation technique.

[0006] An object of the present disclosure is to improve a technique for voice-operating in-vehicle equipment provided in a vehicle.

Means for Solving the Problems

[0007] A voice operation device according to an embodiment of the present disclosure is a voice operation device in a vehicle including a control unit, wherein the control unit is When a passenger requests an operation of in-vehicle equipment by voice, identify the first seat position of the passenger who made the utterance, When the in-vehicle equipment that the speaker requests an operation for is not provided at the position corresponding to the first seat position, execute the operation of the in-vehicle equipment associated with the second seat position.

[0008] A program according to an embodiment of the present disclosure, When a passenger requests an operation of in-vehicle equipment by voice, identify the first seat position of the passenger who made the utterance, When the in-vehicle equipment that the speaker requests an operation for is not provided at the position corresponding to the first seat position, execute the operation of the in-vehicle equipment associated with the second seat position, and cause the execution of operations including this.

[0009] A method according to an embodiment of the present disclosure, is a method executed by a voice operation device in a vehicle, including identifying the first seat position of the passenger who made the utterance when the passenger requests an operation of in-vehicle equipment by voice, and when the in-vehicle equipment that the speaker requests an operation for is not provided at the position corresponding to the first seat position, executing the operation of the in-vehicle equipment associated with the second seat position. is included.

Advantages of the Invention

[0010] According to the present disclosure, the technology for voice-operating in-vehicle equipment provided in a vehicle can be improved.

Brief Description of the Drawings

[0011]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Mode for Carrying Out the Invention

[0012] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.

[0013] (Embodiment 1) With reference to FIG. 1, an overview of a system 1 including a voice operation device according to an embodiment of the present disclosure will be described. The system 1 is provided in a vehicle 2. The system 1 includes a voice operation device 10, a plurality of microphones 20, a speaker 30, a display device 40, and in-vehicle equipment 50.

[0014] The vehicle 2 is, for example, an automobile, but is not limited thereto and may be any vehicle. The vehicle 2 is, for example, a gasoline vehicle, an electric vehicle (EV), a hybrid vehicle (HV), a plug-in hybrid vehicle (PHV), or a fuel cell vehicle (FCV), etc., but is not limited to these. The vehicle 2 may be a manned vehicle or any autonomous driving vehicle that travels without a driver.

[0015] First, an overview of this embodiment will be described, and details will be described later. The voice operation device 10 in the vehicle 2 identifies the seat position of the occupant who spoke when the occupant requests an operation of the in-vehicle equipment by voice (hereinafter, also referred to as the first seat position). Further, when the in-vehicle equipment that the occupant requests to operate is not provided at a position corresponding to the first seat position, the voice operation device 10 executes an operation of the in-vehicle equipment associated with a seat position different from the first seat position (hereinafter, also referred to as the second seat position).

[0016] As described above, according to the present embodiment, when in-vehicle equipment that requires an operation by the speaker is not provided at a position corresponding to the first seat position, which is the seat position of the occupant who spoke by the voice operation device 10, an operation of the in-vehicle equipment associated with the second seat position is executed. For this reason, even when in-vehicle equipment that requires an operation by the occupant is not provided at a position corresponding to the occupant's seat position, the voice operation technology is improved in that an operation of the in-vehicle equipment at another second seat position can be executed.

[0017] Next, each component of the system 1 will be described in detail.

[0018] As shown in FIG. 1, the voice operation device 10 includes a control unit 11, a storage unit 12, and a communication unit 13.

[0019] The control unit 11 includes one or more processors, one or more programmable circuits, one or more dedicated circuits, or a combination thereof. The processor is, for example, a general-purpose processor such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit), or a dedicated processor specialized for a specific process, but is not limited thereto. The programmable circuit is, for example, an FPGA (Field-Programmable Gate Array), but is not limited thereto. The dedicated circuit is, for example, an ASIC (Application Specific Integrated Circuit), but is not limited thereto. The control unit 11 controls the operation of the entire voice operation device 10.

[0020] The storage unit 12 includes at least one semiconductor memory, at least one magnetic memory, at least one optical memory, or a combination of at least two of these. The semiconductor memory is, for example, a RAM (random access memory) or a ROM (read only memory). The RAM is, for example, an SRAM (static random access memory) or a DRAM (dynamic random access memory). The ROM is, for example, an EEPROM (electrically erasable programmable read only memory). The storage unit 12 functions as, for example, a main memory device, an auxiliary storage device, or a cache memory. The storage unit 12 stores data used for the operation of the voice operation device 10 and data obtained by the operation of the voice operation device 10. For example, the storage unit 12 stores a program related to voice processing (hereinafter also referred to as a voice assistant), data, and the like. The voice assistant is a program that is activated by a predetermined voice instruction (hereinafter also referred to as a wake word). The voice assistant performs voice recognition of the uttered content uttered after activation and estimates the user's intention. The voice assistant executes a predetermined process based on the estimated intention.

[0021] The communication unit 13 includes at least one interface for external communication. The communication interface may be either a wired communication interface or a wireless communication interface. In the case of wired communication, the communication interface may be an interface corresponding to a communication standard such as a LAN (Local Area Network) interface, a USB (Universal Serial Bus), an HDMI (registered trademark) (High-Definition Multimedia Interface), etc. In the case of wireless communication, the communication interface may be an interface corresponding to a mobile communication standard such as LTE (Long Term Evolution), 4G (4th generation), or 5G (5th generation), or an interface corresponding to a short-range wireless communication such as Bluetooth (registered trademark). The communication unit 13 receives data used for the operation of the voice operation device 10 and transmits data obtained by the operation of the voice operation device 10.

[0022] The functions of the voice operation device 10 are realized by executing the program according to the present embodiment on a processor corresponding to the voice operation device 10. That is, the functions of the voice operation device 10 are realized by software. The program causes a computer to execute the operations of the voice operation device 10, enabling the computer to function as the voice operation device 10. That is, the computer functions as the voice operation device 10 by executing the operations of the voice operation device 10 according to the program.

[0023] In this embodiment, the program can be recorded on a computer-readable recording medium. The computer-readable recording medium includes non-transitory computer-readable media, such as magnetic recording devices, optical discs, magneto-optical recording media, or semiconductor memories. The distribution of the program is performed, for example, by selling, transferring, or lending a portable recording medium such as a DVD (Digital Versatile Disc) or a CD-ROM (Compact Disc Read Only Memory) on which the program is recorded. Also, the distribution of the program may be performed by storing the program in the storage of an external server and transmitting the program from the external server to other computers. The program may also be provided as a program product.

[0024] Some or all of the functions of the voice operation device 10 may be realized by a dedicated circuit corresponding to the control unit 11. That is, some or all of the functions of the voice operation device 10 may be realized by hardware.

[0025] The system 1 also includes a plurality of microphones 20. The plurality of microphones 20 are provided, for example, at each seat in the vehicle 2. The plurality of microphones 20 receive voice input from the speech of the passengers in each seat. The plurality of microphones 20 transmit the received voice input to the voice operation device 10 via the communication unit 13.

[0026] The system 1 also includes a speaker 30. The speaker 30 outputs information as voice. The number of speakers 30 may be one or a plurality. When there are a plurality of speakers 30, for example, the speakers 30 may be provided at each seat in the vehicle 2.

[0027] The system 1 also includes a display device 40. The display device 40 includes at least one output interface. The output interface is, for example, a display that outputs information as video. The display is, for example, an LCD (liquid crystal display) or an organic EL (electro luminescence) display. The display device 40 displays and outputs data obtained by the operation of the voice operation device 10. The display device 40 may include a touch screen. In this case, it accepts an operation for inputting data used in the operation of the voice operation device 10, and displays and outputs data obtained by the operation of the voice operation device 10. In the present embodiment, the display device 40 is described as including a touch screen. For example, the display device 40 may be provided on the center console.

[0028] The system 1 also includes in-vehicle equipment 50. The in-vehicle equipment 50 includes at least one of an air conditioner, power windows, a sunroof, speakers, and interior lights. The in-vehicle equipment 50 is controlled by a control instruction from the voice assistant of the voice operation device 10.

[0029] Referring to FIG. 2, the operation of the system 1 according to Embodiment 1 will be described.

[0030] Step S10: The control unit 11 of the voice operation device 10 activates the voice assistant by receiving the utterance of the wake word by the occupant from the microphone 20. The activation of the voice assistant is not limited to this, and it may be activated by detecting the pressing of a physical button or the like by the occupant. Such a physical button may be provided on some seats, or may be provided on each seat. For example, the physical button may be a steering switch provided on the steering wheel. After the voice assistant is activated, it can receive a request for operating the in-vehicle equipment 50 by voice from the occupant.

[0031] Step S20: The control unit 11 checks for the presence of in-vehicle equipment 50. Specifically, the control unit 11 checks for the presence of in-vehicle equipment 50 that can be controlled by a voice assistant and is installed in the vehicle 2. Thereby, the in-vehicle equipment 50 that can be controlled after the activation of the voice assistant is grasped.

[0032] Step S30: When the occupant requests an operation of the in-vehicle equipment 50 by voice, the control unit 11 first identifies the first seat position of the occupant. In other words, when the occupant requests an operation of the in-vehicle equipment by voice, the first seat position is identified. Any method can be adopted for the identification process of the first seat position. For example, the control unit 11 identifies the first seat position of the occupant based on the volume of the voice input to the plurality of microphones 20.

[0033] Step S40: The control unit 11 performs voice recognition processing to recognize the uttered content from the occupant. The algorithm related to the voice recognition processing may include a deep neural network or the like.

[0034] Step S50: The control unit 11 performs an intention estimation process for the occupant based on the voice recognition result. The algorithm related to the intention estimation process may include a deep neural network or the like. For example, the control unit 11 estimates the in-vehicle equipment 50 to be operated and the specific content of the operation. For example, if the uttered content of the occupant based on the voice recognition result is to lower the temperature in the passenger compartment, the control unit 11 estimates, as the intention estimation process, that the intention of the uttered content is to lower the temperature of the air conditioner to a predetermined temperature.

[0035] Step S60: The control unit 11 determines whether there is in-vehicle equipment 50 at the position corresponding to the first seat position. Since in step S20, information regarding the in-vehicle equipment 50 that can be controlled after activation of the voice assistant has been grasped, the control unit 11 can determine the presence or absence of the in-vehicle equipment 50 at the position corresponding to the first seat position based on this information. The position corresponding to the first seat position is a position close to the first seat position. If it is determined that there is in-vehicle equipment 50 at the position corresponding to the first seat position, the process proceeds to step S70. On the other hand, if it is determined that there is no in-vehicle equipment 50 at the position corresponding to the first seat position, the process proceeds to step S80.

[0036] Step S70: If it is determined that there is in-vehicle equipment 50 at the position corresponding to the first seat position, the control unit 11 executes the function related to the in-vehicle equipment 50. For example, if the intention of the uttered content is to lower the temperature of the air conditioner to a predetermined temperature, the control unit 11 executes a process of lowering the set temperature of the air conditioner provided at the position corresponding to the first seat position.

[0037] Step S80: If it is determined that there is no in-vehicle equipment 50 at the position corresponding to the first seat position, the control unit 11 executes the function related to the in-vehicle equipment 50 associated with the second seat position. The in-vehicle equipment 50 associated with the second seat position represents the in-vehicle equipment 50 provided at the position corresponding to the second seat position. For example, if the intention of the uttered content is to lower the temperature of the air conditioner to a predetermined temperature, the control unit 11 executes a process of lowering the set temperature of the air conditioner associated with the second seat position. Here, the correspondence relationship between the first seat position and the second seat position may be predetermined.

[0038] For example, the above-mentioned second seat position may be the seat position closest to the first seat position. By doing so, it is possible to operate the in-vehicle equipment 50 at the seat position closest to the first seat position, and the possibility of satisfying the passenger's request is improved by the function of the in-vehicle equipment 50.

[0039] Note that the first seat position may be a position corresponding to the seat in the third row. In this case, the second seat position may be a position corresponding to the seat in the second row. FIG. 3 shows an example of the positional relationship between each seat and in-vehicle equipment 50 and the like. Here, an example in which the in-vehicle equipment 50 includes air conditioners 501 to 504 and power windows 511 to 514 will be described.

[0040] The vehicle 2 shown in FIG. 3 has three rows of seats and includes seats 61 to 66. Seat 61 is the driver's seat (D seat). Seat 62 is the passenger seat (P seat). Seat 63 is the right seat in the second row (2RR seat). Seat 64 is the left seat in the second row (2RL seat). Seat 65 is the right seat in the third row (3RR seat). Seat 66 is the left seat in the third row (3RL seat). Near the front of each of the seats 61 to 66, microphones 201 to 206 for detecting the voices of the passengers in each seat are mounted.

[0041] Here, the air conditioner 501 and the power window 511 are provided at positions corresponding to the seat position of seat 61. In other words, the air conditioner 501 and the power window 511 are associated with seat 61. Also, the air conditioner 502 and the power window 512 are provided at positions corresponding to the seat position of seat 62. In other words, the air conditioner 502 and the power window 512 are associated with seat 62. Also, the air conditioner 503 and the power window 513 are provided at positions corresponding to the seat position of seat 63. In other words, the air conditioner 503 and the power window 513 are associated with seat 63. Similarly, the air conditioner 504 and the power window 514 are provided at positions corresponding to the seat position of seat 64. In other words, the air conditioner 504 and the power window 514 are associated with seat 64. On the other hand, no air conditioner or power window is provided at the position corresponding to the seat position of seat 65. Similarly, no air conditioner or power window is provided at the position corresponding to the seat position of seat 66.

[0042] For example, when there is a voice request for operating the air conditioner or power window from the occupant of seat 65, which is a seat in the third row of seats, there is no in-vehicle equipment for which the speaker requests an operation at the position corresponding to seat 65. Therefore, the control unit 11 executes the operation of the air conditioner 503 or the power window 513 associated with seat 63, which is a seat in the second row of seats. Here, seat 63, which is closest to seat 65, the first seat position, is a second seat position.

[0043] Also, for example, when there is a voice request for operating the air conditioner or power window from the occupant of seat 66, which is a seat in the third row of seats, there is no in-vehicle equipment for which the speaker requests an operation at the position corresponding to seat 66. Therefore, the control unit 11 executes the operation of the air conditioner 504 or the power window 514 associated with seat 64, which is a seat in the second row of seats. Here, seat 64, which is closest to seat 66, the first seat position, is a second seat position.

[0044] As described above, according to the present embodiment, when there is no in-vehicle equipment for which the speaker requests an operation at the position corresponding to the first seat position, which is the seat position of the occupant who made the voice using the voice operation device 10, the operation of the in-vehicle equipment associated with the second seat position is executed. For this reason, even when there is no in-vehicle equipment for which the occupant requests an operation at the position corresponding to the occupant's seat position, the voice operation technology is improved in that the operation of the in-vehicle equipment at another second seat position can be executed.

[0045] (Embodiment 2) The following describes System 1' according to Embodiment 2 of the present disclosure. FIG. 4 is a block diagram showing the configuration of System 1' according to Embodiment 2 of the present disclosure. The same components as those in Embodiment 1 are denoted by the same reference numerals, and the description thereof is omitted. System 1' according to Embodiment 2 is different from the configuration according to Embodiment 1 in that it includes an occupant recognition device 60. The occupant recognition device 60 is a device that determines whether there is an occupant in each seat. The occupant recognition device 60 may include, for example, a weight sensor, a sensor provided in the buckle of the seat belt, etc., and based on the detection results of these sensors, it detects whether there is an occupant in each seat. The occupant recognition device 60 transmits the detection result to the voice operation device 10. Generally, the voice operation device 10 of System 1' adjusts whether the operation of in-vehicle equipment associated with the second seat position can be executed according to the presence or absence of an occupant in the second seat position.

[0046] Referring to FIG. 5, the operation of System 1' according to Embodiment 2 will be described. The same operations (Steps S10 to S70) as those of System 1 according to Embodiment 1 are denoted by the same reference numerals, and the description thereof is omitted.

[0047] Step S90: When it is determined in Step S60 that there is no in-vehicle equipment 50 at the position corresponding to the first seat position, the control unit 11 determines whether there is an occupant (hereinafter, also referred to as another occupant) in the second seat position. The control unit 11 receives the detection result from the occupant recognition device 60 and executes a determination process based on the detection result. If it is determined that there is another occupant, the process proceeds to Step S100. If it is determined that there is no other occupant in the second seat position, the process proceeds to Step S150.

[0048] Step S100: The control unit 11 determines whether the inquiry setting is ON. The inquiry setting is a setting item indicating whether to make an inquiry to the occupant in the second seat position about whether the operation of the in-vehicle equipment associated with the second seat position can be performed. If the inquiry setting is ON, an inquiry is made to the occupant in the second seat position about whether the operation of the in-vehicle equipment associated with the second seat position can be performed. On the other hand, if the inquiry setting is OFF, an inquiry is made to the occupant in the second seat position about whether the operation of the in-vehicle equipment associated with the second seat position can be performed. The inquiry setting may be set to ON by default, for example, or may be set to OFF by default. The occupant can change the inquiry setting by, for example, an input operation to the display device 40. If the inquiry setting is ON, the process proceeds to S110. On the other hand, if the inquiry setting is not ON, the process proceeds to S150.

[0049] Step S110: The control unit 11 generates an inquiry response and outputs the generated inquiry response by the speaker 30. The inquiry response is generated based on the intention estimation processing result in step S50. For example, when the intention of the uttered content is to lower the temperature of the air conditioner to a predetermined temperature, for example, the content of the inquiry response may be "May I lower the temperature of the air conditioner?"

[0050] Step S120: The control unit 11 performs voice recognition processing to recognize the uttered content from another occupant.

[0051] Step S130: The control unit 11 performs intention estimation processing for another occupant based on the voice recognition result. Specifically, the control unit 11 estimates whether another occupant has approved the operation of the in-vehicle equipment 50.

[0052] Step S140: The control unit 11 determines whether another occupant has approved based on the estimation result in step S130. If it is determined that another occupant has approved, the process proceeds to step S150. On the other hand, if it is determined that another occupant has not approved, the process ends.

[0053] Step S150: When it is determined in step S90 that there is no other occupant in the second seat position, when the inquiry setting is not ON in step S100 (when the inquiry setting is OFF), or when it is determined in step S140 that another occupant has given consent, the control unit 11 executes the function related to the in-vehicle equipment 50 associated with the second seat position.

[0054] As described above, according to the present embodiment, when there is no in-vehicle equipment for which the speaker requests an operation at the position corresponding to the first seat position, which is the seat position of the occupant who spoke using the voice operation device 10, based on the consent of another occupant sitting in the second seat position, the operation of the in-vehicle equipment associated with the second seat position is executed. Therefore, even when there is no in-vehicle equipment for which the occupant requests an operation at the position corresponding to the occupant's seat position, the voice operation technology is improved in that the operation of the in-vehicle equipment at another second seat position can be executed. Also, the voice operation technology is improved in that the satisfaction of another occupant can be increased by obtaining the consent of another occupant.

[0055] Also, according to the second embodiment, the control unit 11 confirms the consent of another occupant based on the inquiry setting. Therefore, it is possible to switch whether or not to inquire about consent according to the situation, and the convenience of the occupants can be improved. For example, when only family members are riding in the vehicle 2 and it is highly likely that the consent of other occupants is not particularly required, the voice operation device 10 can be adaptively controlled according to the situation, such as turning off the inquiry setting.

[0056] In the above, in step S100, the control unit 11 executed the determination process related to the inquiry setting, but such a determination process may be omitted. For example, when it is determined in step S90 that there is an occupant in the second seat position, the process may proceed to step S110. That is, when the control unit 11 determines that there is an occupant in the second seat position, it may inquire of another occupant whether the operation of the in-vehicle equipment 50 can be executed.

[0057] Although the present disclosure has been described based on the drawings and examples, it should be noted that those skilled in the art may make various modifications and alterations based on the present disclosure. Therefore, it should be noted that these modifications and alterations are included in the scope of the present disclosure. For example, the functions included in each component or each step, etc. can be rearranged so as not to be logically contradictory, and it is possible to combine or divide a plurality of components or steps, etc. into one.

[0058] For example, in the above-described embodiment, an embodiment in which the configuration and operation of the voice operation device 10 are distributed to a plurality of computers capable of communicating with each other is also possible. Also, for example, an embodiment in which some or all of the components of the voice operation device 10 are provided in the devices mounted on the vehicle 2 is also possible. For example, the navigation device mounted on the vehicle 2 may include some or all of the components of the voice operation device 10.

[0059] Also, for example, an embodiment in which a general-purpose computer functions as the voice operation device 10 according to the above-described embodiment is also possible. Specifically, a program describing the processing content for realizing each function of the voice operation device 10 according to the above-described embodiment is stored in the memory of the general-purpose computer, and the program is read and executed by the processor. Therefore, the invention of the present embodiment of the present disclosure can also be realized as a program executable by a processor or a non-transitory computer-readable medium storing the program.

[0060] Also, for example, a configuration in which a general-purpose electronic device such as a smartphone or a computer functions as the voice operation device 10 according to the above-described embodiment is also possible. Specifically, it is also conceivable to store a program describing the processing content for realizing each function of the voice operation device 10 according to the embodiment in the memory of the electronic device and read and execute the program by the processor of the electronic device. Therefore, the disclosure according to one embodiment can also be realized as a program executable by a processor.

[0061] Examples of some embodiments of the present disclosure are illustrated below. However, note that the embodiments of the present disclosure are not limited to these. [Appendix 1] An in-vehicle voice operation device including a control unit, wherein the control unit identifies the first seat position of the occupant who spoke when the occupant requests an operation of in-vehicle equipment by voice, A voice operation device that executes an operation of in-vehicle equipment associated with a second seat position when there is no in-vehicle equipment for which the speaker requests an operation at the position corresponding to the first seat position. [Appendix 2] The voice operation device according to Appendix 1, wherein the second seat position is the seat position closest to the first seat position. [Appendix 3] The voice operation device according to Appendix 1 or 2, wherein the first seat position is a position related to the seat in the third row, and the second seat position is a position related to the seat in the second row. [Appendix 4] The control unit of the voice operation device according to any one of Appendices 1 to 3 inquires of the other occupant whether the operation of the in-vehicle equipment can be executed when another occupant is in the second seat position. [Appendix 5] The control unit of the voice operation device according to any one of Appendices 1 to 4 inquires of the other occupant whether the operation of the in-vehicle equipment can be executed when another occupant is in the second seat position and the inquiry setting is ON. [Appendix 6] The control unit of the voice operation device according to Appendix 5 does not inquire of the other occupant whether the operation of the in-vehicle equipment can be executed when the inquiry setting is OFF. [Appendix 7] The in-vehicle equipment of the voice operation device according to any one of Appendices 1 to 6 includes at least one of an air conditioner, a power window, a sunroof, a speaker, and an interior light. [Appendix 8] In an in-vehicle voice operation device, identifying the first seat position of the occupant who spoke when the occupant requests an operation of in-vehicle equipment by voice, When there is no in-vehicle equipment that requires an operation by the speaker at the position corresponding to the first seat position, execute the operation of the in-vehicle equipment associated with the second seat position; A program that causes an operation including this to be executed. [Appendix 9] The program according to Appendix 8, wherein the second seat position is the seat position closest to the first seat position. [Appendix 10] The program according to Appendix 8 or 9, wherein the first seat position is a position related to the seat in the third row, and the second seat position is a position related to the seat in the second row. [Appendix 11] The program according to any one of Appendices 8 to 10, which, when another passenger is in the second seat position, inquires of the other passenger whether the operation of the in-vehicle equipment can be executed. [Appendix 12] The program according to any one of Appendices 8 to 11, which, when another passenger is in the second seat position and the inquiry setting is ON, inquires of the other passenger whether the operation of the in-vehicle equipment can be executed. [Appendix 13] The program according to Appendix 12, wherein the control unit does not inquire of the other passenger whether the operation of the in-vehicle equipment can be executed when the inquiry setting is OFF. [Appendix 14] The program according to any one of Appendices 8 to 13, wherein the in-vehicle equipment includes at least any one of an air conditioner, a power window, a sunroof, a speaker, and an interior light. [Appendix 15] A method executed by a voice operation device in a vehicle, comprising: Identifying the first seat position of the passenger who spoke when the passenger requests an operation of the in-vehicle equipment by voice; When there is no in-vehicle equipment that requires an operation by the speaker at the position corresponding to the first seat position, execute the operation of the in-vehicle equipment associated with the second seat position; A method including this. [Appendix 16] The method according to Supplementary Note 15, wherein the second seat position is the seat position closest to the first seat position. [Supplementary Note 17] The program according to Supplementary Note 15 or Supplementary Note 16, wherein the first seat position is a position related to the seat in the third row of seats, and the second seat position is a position related to the seat in the second row of seats. [Supplementary Note 18] The program according to any one of Supplementary Notes 15 to 17, wherein when another passenger is sitting in the second seat position, the permission to execute the operation of the in-vehicle equipment is inquired of the other passenger. [Supplementary Note 19] The program according to any one of Supplementary Notes 15 to 18, wherein when another passenger is sitting in the second seat position and the inquiry setting is ON, the permission to execute the operation of the in-vehicle equipment is inquired of the other passenger. [Supplementary Note 20] The program according to Supplementary Note 19, wherein when the inquiry setting is OFF, the control unit does not inquire the other passenger about the permission to execute the operation of the in-vehicle equipment.

Explanation of Signs

[0062] 1 System 2 Vehicle 10 Voice operation device 11 Control unit 12 Storage unit 13 Communication unit 20 Multiple microphones 30 Speaker 40 Display device 50 In-vehicle equipment 60 Passenger recognition device 61 - 66 Seats 201 - 206 Microphones 501 - 504 Air conditioners 511 - 514 Power windows

Claims

1. A voice operation device in a vehicle equipped with a control unit, wherein the control unit identifies the first seat position of the occupant who spoke when the occupant requests an operation of in-vehicle equipment by voice, and when there is no in-vehicle equipment for which the speaker requests an operation at the position corresponding to the first seat position, executes an operation of the in-vehicle equipment associated with the second seat position. A voice operation device.

2. The voice operation device according to claim 1, wherein the second seat position is the seat position closest to the first seat position.

3. The voice operation device according to claim 1, wherein the first seat position is a position related to the seat in the third row, and the second seat position is a position related to the seat in the second row.

4. The voice operation device according to claim 1, wherein when another occupant is in the second seat position, the control unit inquires of the other occupant whether the operation of the in-vehicle equipment can be executed.

5. The voice operation device according to claim 1, wherein when another occupant is in the second seat position and the inquiry setting is ON, the control unit inquires of the other occupant whether the operation of the in-vehicle equipment can be executed.

6. The voice operation device according to claim 5, wherein when the inquiry setting is OFF, the control unit does not inquire of the other occupant whether the operation of the in-vehicle equipment can be executed.

7. The in-vehicle equipment includes at least any one of an air conditioner, a power window, a sunroof, a speaker, and an interior light. The voice operation device according to any one of claims 1 to 6.

8. In a voice operation device in a vehicle, identifying the first seat position of the occupant who spoke when the occupant requests an operation of in-vehicle equipment by voice; when there is no in-vehicle equipment for which the speaker requests an operation at the position corresponding to the first seat position, executing an operation of the in-vehicle equipment associated with the second seat position; A program that causes the above operations to be executed.

9. The program according to claim 8, wherein the second seat position is the seat position closest to the first seat position.

10. The program according to claim 8, wherein the first seat position is a position related to the seat in the third row, and the second seat position is a position related to the seat in the second row.

11. The program according to claim 8, wherein when another occupant is in the second seat position, the program inquires of the other occupant whether the operation of the in-vehicle equipment can be executed.

12. The program according to claim 8, wherein when another occupant is in the second seat position and the confirmation setting is ON, the other occupant is asked whether the vehicle equipment operation can be executed.

13. The program according to claim 12, wherein when the confirmation setting is OFF, the other occupant is not asked whether the vehicle equipment operation can be executed.

14. The vehicle equipment according to any one of claims 8 to 13 includes at least one of an air conditioner, a power window, a sunroof, a speaker, and an interior light.

15. A method executed by a voice operation device in a vehicle, comprising: identifying a first seat position of an occupant who spoke when the occupant requests an operation of vehicle equipment by voice; when the vehicle equipment that the speaker requests an operation for is not provided at a position corresponding to the first seat position, executing an operation of vehicle equipment associated with a second seat position; The method includes.

16. The method according to claim 15, wherein the second seat position is the seat position closest to the first seat position.

17. The method according to claim 15, wherein the first seat position is a position related to a seat in the third row of seats, and the second seat position is a position related to a seat in the second row of seats.

18. The method according to claim 15, wherein when another occupant is in the second seat position, the other occupant is asked whether the vehicle equipment operation can be executed.

19. The method according to claim 15, wherein when another occupant is in the second seat position and the confirmation setting is ON, the other occupant is asked whether the vehicle equipment operation can be executed.

20. The method according to claim 19, wherein when the confirmation setting is OFF, the other occupant is not asked whether the vehicle equipment operation can be executed.

Images