Voice operation device, program and method

Abstract

[Problem] To improve the technology for voice operation of in-vehicle equipment. [Solution] A voice operation device in a vehicle equipped with a control unit, wherein the control unit determines the first seat position of the occupant who made the request when the occupant requests operation of the in-vehicle equipment via voice, and if there is no in-vehicle equipment requested by the occupant at the position corresponding to the first seat position, it executes the operation of the in-vehicle equipment associated with the second seat position.

Description

Technical Field

[0001] This disclosure relates to voice operation devices, programs, and methods. Prior Technology

[0002] In the past, various reviews have been conducted on the technology of voice operation of in-vehicle equipment.

[0003] For example, Patent Document 1 discloses a voice dialogue control device for controlling the voice operation of multiple operating machines that are independent and operable in multiple execution locations. [Previous Technical Documents] [Patent Literature]

[0004] [Patent Document 1] International Publication No. 2020 / 240789 Summary of the Invention

[0005] [The problem the invention aims to solve] Patent Document 1 discloses a voice operation technique for multiple operating machines that are independently operable in multiple execution locations. However, the technology in Patent Document 1 does not address situations where the location corresponding to the seat position does not have an onboard device that the speaker requests to operate. Therefore, there is room for improvement in the voice operation technology.

[0006] The purpose of this disclosure is to improve the technology for voice operation of in-vehicle equipment. [Methods used to solve problems]

[0007] The voice operation device disclosed herein is an in-vehicle voice operation device equipped with a control unit, wherein the aforementioned control unit is... When a passenger makes a voice request to operate the in-vehicle equipment, the location of the passenger who made the request is determined as seat number 1. If the location corresponding to the first seat does not have the in-vehicle equipment that the speaker requests to operate, the operation of the in-vehicle equipment associated with the second seat is performed.

[0008] The program relating to one embodiment of this disclosure performs actions, the aforementioned actions including: The procedure for determining the seat position of the passenger who made the voice request to operate the in-vehicle equipment is as follows: If the vehicle-mounted device that the speaker requests to operate is not available at the location corresponding to the first seat position, the steps for operating the vehicle-mounted device associated with the second seat position shall be performed.

[0009] One embodiment of the method disclosed herein is a method performed by a voice operation device in a vehicle, comprising: The procedure for determining the seat position of the passenger who made the voice request to operate the in-vehicle equipment is as follows: If the vehicle-mounted device that the speaker requests to operate is not available at the location corresponding to the first seat position, the steps for operating the vehicle-mounted device associated with the second seat position shall be performed. [Invention Effects]

[0010] According to this disclosure, the technology for voice operation of in-vehicle equipment can be improved. Simple Explanation of the Diagram

[0011] [Figure 1] shows the configuration of a system including a voice operation device according to Embodiment 1 of this disclosure. [Figure 2] shows a flowchart of the operation of the system according to Embodiment 1 of this disclosure. [Figure 3] shows the interior configuration of the system according to Embodiment 1 of this disclosure. [Figure 4] shows the configuration of a system including a voice operation device according to Embodiment 2 of this disclosure. [Figure 5] shows a flowchart of the operation of the system according to Embodiment 2 of this disclosure. Implementation

[0012] The following description of the embodiments disclosed herein will be based on the accompanying drawings.

[0013] (Implementation Method 1) Referring to Figure 1, an overview of a system 1 including a voice operation device according to an embodiment of the present disclosure is illustrated. System 1 is provided in a vehicle 2. System 1 includes: a voice operation device 10, multiple microphones 20, a speaker 30, a display device 40, and in-vehicle equipment 50.

[0014] Vehicle 2 is, for example, a car, but is not limited to this; it can be any vehicle. Vehicle 2 can be, for example, a gasoline-powered vehicle, an electric vehicle (EV), a hybrid vehicle (HV), a plug-in hybrid vehicle (PHV), or a fuel cell vehicle (FCV), but is not limited to these. Vehicle 2 can be a manned vehicle or any autonomous vehicle without human intervention.

[0015] First, an overview of this embodiment will be given, with details to follow. The voice operation device 10 in vehicle 2 determines the seat position (hereinafter referred to as the first seat position) of the occupant who made the request when the occupant requests operation of the in-vehicle equipment via voice. Furthermore, if the in-vehicle equipment requested by the occupant is not present at the position corresponding to the first seat position, the voice operation device 10 executes the operation of the in-vehicle equipment associated with a different seat position (hereinafter referred to as the second seat position).

[0016] Thus, according to this embodiment, when the seat position of the passenger who made the speech (i.e., the position corresponding to the first seat position) does not have the vehicle-mounted device that the speaker requested to operate, the voice operation device 10 executes the operation of the vehicle-mounted device associated with the second seat position. Therefore, even if the position corresponding to the passenger's seat position does not have the vehicle-mounted device that the passenger requested to operate, the ability to execute the operation of other vehicle-mounted devices in the second seat position is an improvement in voice operation technology.

[0017] Next, the various components of System 1 will be described in detail.

[0018] As shown in Figure 1, the voice operation device 10 includes a control unit 11, a memory unit 12, and a communication unit 13.

[0019] The control unit 11 includes: one or more processors, one or more programmable circuits, one or more dedicated circuits, or combinations of these components. The processor may be a general-purpose processor such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit), or a dedicated processor specialized for a specific process, but is not limited to these. The programmable circuit may be, for example, a FPGA (Field-Programmable Gate Array), but is not limited to these. The dedicated circuit may be, for example, an ASIC (Application Specific Integrated Circuit), but is not limited to these. The control unit 11 controls the overall operation of the voice operation device 10.

[0020] The memory unit 12 includes at least one semiconductor memory, at least one magnetic memory, at least one optical memory, or a combination of at least two of these elements. The semiconductor memory is, for example, RAM (random access memory) or ROM (read-only memory). RAM is, for example, SRAM (static random access memory) or DRAM (dynamic random access memory). ROM is, for example, EEPROM (electrically erasable programmable read-only memory). The memory unit 12 functions as, for example, a main memory device, an auxiliary memory device, or a cache memory. The memory unit 12 stores: data used in the operation of the voice operation device 10, and data obtained through the operation of the voice operation device 10. For example, the memory unit 12 stores programs related to voice processing (hereinafter also referred to as voice assistants), data, etc. The voice assistant is a program activated by a predetermined voice instruction (hereinafter also referred to as a wake word). After activation, the voice assistant performs voice recognition of the spoken content and infers the user's intent. The voice assistant performs predetermined processing based on the inferred intent.

[0021] The communication unit 13 includes at least one external communication interface. The communication interface can be either a wired or wireless communication interface. In the case of wired communication, the communication interface can be, for example, a LAN (Local Area Network) interface, a USB (Universal Serial Bus) interface, an HDMI (High-Definition Multimedia Interface) interface, or an interface corresponding to communication standards. In the case of wireless communication, the communication interface can be, for example, an interface corresponding to mobile communication standards such as LTE (Long Term Evolution), 4G (4th generation), or 5G (5th generation), or an interface corresponding to short-range wireless communication such as Bluetooth. The communication unit 13 receives data used in the operation of the voice operation device 10 and transmits data obtained through the operation of the voice operation device 10.

[0022] The functions of the voice operation device 10 are implemented by executing a program related to this embodiment using a processor equivalent to the voice operation device 10. That is, the functions of the voice operation device 10 are implemented via software. The program causes the computer to perform the actions of the voice operation device 10, thereby enabling the computer to function as the voice operation device 10. In other words, the computer executes the actions of the voice operation device 10 according to the program, and thus functions as the voice operation device 10.

[0023] In this embodiment, the program can be first recorded on a computer-readable recording medium. Computer-readable recording media includes non-transitory computer-readable media, such as magnetic recording devices, optical discs, optical-magnetic recording media, or semiconductor memory. Program distribution can be achieved, for example, by selling, transferring, or lending portable recording media such as DVDs (digital versatile discs) or CD-ROMs (compact disc read-only memory) containing the program. Furthermore, program distribution can also involve storing the program in an external server's storage library and sending the program from the external server to other computers. Moreover, the program can also be provided as a program product.

[0024] Some or all of the functions of the voice operation device 10 can also be implemented via a dedicated circuit equivalent to the control unit 11. That is, some or all of the functions of the voice operation device 10 can also be implemented via hardware.

[0025] Furthermore, system 1 is equipped with multiple microphones 20. These multiple microphones 20 are located, for example, in each seat within vehicle 2. The multiple microphones 20 receive voice input from the occupants of each seat. The multiple microphones 20 transmit the received voice input to the voice operation device 10 via the communication unit 13.

[0026] Furthermore, system 1 includes a speaker 30. The speaker 30 outputs information via voice. There can be one speaker 30 or multiple speakers 30. In the case of multiple speakers 30, for example, speakers 30 can be installed in each seat within vehicle 2.

[0027] Furthermore, System 1 includes a display device 40. The display device 40 includes at least one output interface. The output interface may be, for example, a display that outputs information as an image. The display may be, for example, an LCD (liquid crystal display) or an electroluminescence (OLED) display. The display device 40 displays and outputs data obtained through the actions of the voice-operated device 10. The display device 40 may include a touchscreen. In this case, it accepts the input of data used in the actions of the voice-operated device 10 and displays and outputs the data obtained through the actions of the voice-operated device 10. In this embodiment, the display device 40 is described as including a touchscreen. For example, the display device 40 may be located on a central control panel.

[0028] Furthermore, System 1 includes in-vehicle equipment 50. In-vehicle equipment 50 includes at least one of the following: air conditioning, power windows, sunroof, speakers, and interior lighting. In-vehicle equipment 50 is controlled via control instructions from the voice assistant of voice operation device 10.

[0029] Referring to Figure 2, the operation of system 1 in embodiment 1 is explained.

[0030] Step S10: The control unit 11 of the voice operation device 10 activates the voice assistant by receiving a wake-up word spoken by the occupant from the microphone 20. Activation of the voice assistant is not limited to this; it can also be activated by detecting the pressing of a physical button or similar device by the occupant. This physical button can be located on some seats or on all seats. For example, the physical button could be a turn signal switch. After activation, the voice assistant can handle requests for operation of the in-vehicle equipment 50 via voice commands from the occupant.

[0031] Step S20: The control unit 11 confirms the presence of in-vehicle equipment 50. Specifically, the control unit 11 uses the voice assistant equipped in the vehicle 2 to confirm the presence of controllable in-vehicle equipment 50. In this way, after the voice assistant is activated, the controllable in-vehicle equipment 50 can be identified.

[0032] Step S30: When an occupant requests operation of the in-vehicle device 50 via voice, the control unit 11 first determines the occupant's first seat position. In other words, the first seat position is determined when an occupant requests operation of the in-vehicle device via voice. The determination of the first seat position can be performed using any method. For example, the control unit 11 determines the occupant's first seat position based on factors such as the volume of voice input to the multiple microphones 20.

[0033] Step S40: The control unit 11 performs speech recognition processing to identify the content of the speech produced by the occupant. The algorithms related to speech recognition processing may include deep neural networks, etc.

[0034] Step S50: The control unit 11 performs occupant intent estimation processing based on the speech recognition results. The algorithm related to intent estimation processing may include deep neural networks, etc. For example, the control unit 11 estimates the vehicle-mounted device 50 to be operated and the specific content of the operation. For example, if the occupant's voice content, based on the speech recognition results, is intended to lower the temperature inside the vehicle, the control unit 11 performs intent estimation processing, estimating that the intent of the voice content is to lower the air conditioning temperature to the original set temperature.

[0035] Step S60: The control unit 11 determines whether there is an in-vehicle device 50 at the location corresponding to the first seat position. In step S20, because information related to the controllable in-vehicle device 50 is obtained after the voice assistant is activated, the control unit 11 can determine whether there is an in-vehicle device 50 at the location corresponding to the first seat position based on this information. The location corresponding to the first seat position is a location close to the first seat position. If it is determined that there is an in-vehicle device 50 at the location corresponding to the first seat position, the program proceeds to step S70. On the other hand, if it is determined that there is no in-vehicle device 50 at the location corresponding to the first seat position, the program proceeds to step S80.

[0036] Step S70: If it is determined that there is an in-vehicle device 50 at the position corresponding to the first seat position, the control unit 11 executes a function related to the in-vehicle device 50. For example, if the intention of the sound content is to lower the temperature of the air conditioner to the original temperature, the control unit 11 executes a process to lower the set temperature of the air conditioner at the position corresponding to the first seat position.

[0037] Step S80: If it is determined that there is no vehicle-mounted device 50 at the position corresponding to the first seat position, the control unit 11 executes functions related to the vehicle-mounted device 50 associated with the second seat position. The vehicle-mounted device 50 associated with the second seat position refers to the vehicle-mounted device 50 installed at the position corresponding to the second seat position. For example, if the intention of the audio content is to lower the air conditioning temperature to a set temperature, the control unit 11 executes a process to lower the set temperature of the air conditioning associated with the second seat position. Here, the correspondence between the first and second seat positions can be predetermined.

[0038] For example, the second seat mentioned above could be the seat closest to the first seat. In this way, the operation of the in-vehicle device 50 in the seat closest to the first seat can be performed, thereby increasing the possibility of meeting the needs of the passengers through the functions of the in-vehicle device 50.

[0039] Furthermore, the first seat position can also be a position related to the third train seat. In this case, the second seat position can also be a position related to the second train seat. Figure 3 shows one example of the positional relationship between each seat and the onboard equipment 50, etc. Here, the onboard equipment 50 is described as an example of air conditioners 501-504 and electric windows 511-514.

[0040] Figure 3 shows vehicle 2, which has 3 seats, including seats 61-66. Seat 61 is the driver's seat (D). Seat 62 is the assistant's seat (P). Seat 63 is the right-hand seat in the second row (2RR seat). Seat 64 is the left-hand seat in the second row (2RL seat). Seat 65 is the right-hand seat in the third row (3RR seat). Seat 66 is the left-hand seat in the third row (3RL seat). Microphones 201-206 for detecting the voices of the occupants in each seat are installed near the front of each seat 61-66.

[0041] Here, air conditioner 501 and power window 511 are located at positions corresponding to the seating position of seat 61. In other words, air conditioner 501 and power window 511 are associated with seat 61. Similarly, air conditioner 502 and power window 512 are located at positions corresponding to the seating position of seat 62. Likewise, air conditioner 503 and power window 513 are located at positions corresponding to the seating position of seat 63. Likewise, air conditioner 504 and power window 514 are located at positions corresponding to the seating position of seat 64. On the other hand, no air conditioner or power window is provided at the position corresponding to the seating position of seat 65. Similarly, no air conditioner or power window is provided at the position corresponding to the seating position of seat 66.

[0042] For example, if a passenger in seat 65 (seat 3) requests operation of the air conditioning or power window, there is no onboard device corresponding to seat 65 that can be operated. Therefore, the control unit 11 operates the air conditioning 503 or power window 513 associated with seat 63 (seat 2). Here, seat 63, closest to seat 65 (seat 1), is considered seat 2.

[0043] Furthermore, for example, if a passenger in seat 66 (the third seat) requests operation of the air conditioning or power window, there is no onboard equipment corresponding to seat 66 that can be used to perform the request. Therefore, the control unit 11 operates the air conditioning 504 or power window 514 associated with seat 64 (the second seat). Here, seat 64, which is closest to seat 66 (the first seat), is the second seat.

[0044] Thus, according to this embodiment, when the seat position of the passenger who made the speech (i.e., the position corresponding to the first seat position) does not have the vehicle-mounted device that the speaker requested to operate, the voice operation device 10 executes the operation of the vehicle-mounted device associated with the second seat position. Therefore, even if the position corresponding to the passenger's seat position does not have the vehicle-mounted device that the passenger requested to operate, the ability to execute the operation of other vehicle-mounted devices in the second seat position is an improvement in voice operation technology.

[0045] (Implementation Method 2) The following describes System 1' according to Embodiment 2 of this disclosure. Figure 4 shows a block diagram of the configuration of System 1' according to Embodiment 2 of this disclosure. Configurations identical to those in Embodiment 1 are given the same component symbols, and descriptions are omitted. The difference between System 1' in Embodiment 2 and the configuration described in Embodiment 1 is the inclusion of an occupant identification device 60. The occupant identification device 60 is a device for determining whether there is an occupant in each seat. The occupant identification device 60 may include, for example, a weight sensor, a sensor included in the seatbelt buckle, etc., and detects whether there is an occupant in each seat based on the detection results of these sensors. The occupant identification device 60 sends the detection results to the voice operation device 10. In general, the voice operation device 10 of System 1' is adjusted to determine whether the operation of the vehicle equipment associated with the second seat position can be performed based on the presence or absence of an occupant in the second seat position.

[0046] Referring to Figure 5, the operation of system 1' in embodiment 2 will be explained. Furthermore, the same element symbols are assigned to the same operations (steps S10 to S70) as those in system 1 in embodiment 1, and their descriptions are omitted.

[0047] Step S90: In step S60, if it is determined that there is no on-board equipment 50 in the position corresponding to the first seat position, the control unit 11 determines whether there is an occupant (hereinafter also referred to as other occupants) in the second seat position. The control unit 11 receives the detection result from the occupant identification device 60 and performs the determination process based on the detection result. If it is determined that there are other occupants, the procedure proceeds to step S100. If it is determined that there are no other occupants in the second seat position, the procedure proceeds to step S150.

[0048] Step S100: Control unit 11 determines whether the query setting is ON. The so-called re-query setting is a setting that displays whether the occupant in the second seat needs to perform an operation on the vehicle-mounted device associated with that seat. When the query setting is ON, the occupant in the second seat is queried about whether to perform an operation on the vehicle-mounted device associated with that seat. Conversely, when the query setting is OFF, the occupant in the second seat is queried about whether to perform an operation on the vehicle-mounted device associated with that seat. The query setting can be set to ON or OFF by default. The occupant can change the query setting, for example, by inputting an operation on the display device 40. When the query setting is ON, the procedure proceeds to S110. Conversely, when the query setting is NOT ON, the procedure proceeds to S150.

[0049] Step S110: The control unit 11 generates a query response and outputs the generated query response via the speaker 30. The query response is generated based on the intent estimation processing result of step S50. For example, if the intent of the spoken content is to lower the air conditioner temperature to a specified temperature, the query response could be something like, "Would you like to lower the air conditioner temperature?"

[0050] Step S120: The control unit 11 performs voice recognition processing, which is the voice content from other passengers.

[0051] Step S130: Based on the voice recognition results, the control unit 11 performs intention estimation processing for other occupants. Specifically, the control unit 11 estimates whether other occupants have consented to the operation of the on-board equipment 50.

[0052] Step S140: Based on the estimation result of step S130, the control unit 11 determines whether the other passengers have already agreed. If it is determined that the other passengers have agreed, the procedure proceeds to step S150. On the other hand, if it is determined that the other passengers have not yet agreed, the procedure ends.

[0053] Step S150: If it is determined in step S90 that there are no other occupants in the second seat position, and if the query setting is not ON in step S100 (the query setting is OFF), or if it is determined in step S140 that other occupants have given their consent, the control unit 11 executes the function related to the vehicle equipment 50 associated with the second seat position.

[0054] Thus, according to this embodiment, when there is no in-vehicle device corresponding to the seat position of the passenger who spoke (i.e., the first seat position) that the speaker requests to operate, the voice operation device 10 executes the operation of the in-vehicle device associated with the second seat position based on the consent of other passengers sitting in the second seat position. Therefore, the ability to execute the operation of other in-vehicle devices in the second seat position even when there is no in-vehicle device corresponding to the passenger's seat position improves voice operation technology. Furthermore, by invoking the consent of other passengers, the sense of acceptance among other passengers is increased, which also improves voice operation technology.

[0055] Furthermore, according to Embodiment 2, the control unit 11 confirms the consent of other passengers based on the query settings. Therefore, the query for consent can be switched according to the situation, which can improve the convenience of passengers. For example, in cases where only the family is traveling in vehicle 2, and there is a high probability that the consent of other passengers is not particularly needed, the query setting can be set to OFF, and the voice operation device 10 can be controlled adaptively according to the situation.

[0056] Furthermore, in the above-described step S100, the control unit 11 performs a determination process related to the query settings; however, this determination process can also be omitted. For example, if it is determined in step S90 that there is an occupant in the second seat, the program can proceed to step S110. That is, if the control unit 11 determines that there is an occupant in the second seat, it can also query other occupants to see if the operation of the vehicle-mounted device 50 can be performed.

[0057] This disclosure has been described with reference to the drawings and embodiments. However, those skilled in the art will note that various modifications and alterations can be made based on this disclosure. Therefore, it should be noted that such modifications and alterations are also included within the scope of this disclosure. For example, the functions of each component or step can be reconfigured without logical contradiction, and multiple components or steps can be combined into one or divided.

[0058] For example, in the above-described embodiments, it is also possible to distribute the configuration and operation of the voice operation device 10 among multiple computers that can communicate with each other. Furthermore, it is also possible to include some or all of the components of the voice operation device 10 in a machine mounted on the vehicle 2. For example, a navigation device mounted on the vehicle 2 may also include some or all of the components of the voice operation device 10.

[0059] Furthermore, it is also possible to use a general-purpose computer as an implementation method for enabling the voice operation device 10 to function as described in the above-described embodiments. Specifically, a program describing the processing content for implementing the various functions of the voice operation device 10 related to the above-described embodiments is stored in the memory of a general-purpose computer, and the program is read and executed by a processor. Therefore, the present invention disclosure regarding this embodiment can also be implemented as a program executable by a processor, or as a non-transitory computer-readable medium storing the program.

[0060] Furthermore, for example, general-purpose electronic devices such as smartphones or computers can be used as the configuration for the voice operation device 10 related to the above-described embodiment to perform its functions. Specifically, it is considered that a program describing the processing content for implementing the various functions of the voice operation device 10 related to the embodiment is stored in the memory of the electronic device, and the processor of the electronic device reads and executes the program. Therefore, the disclosure related to one embodiment can also realize a program that can be executed by a processor.

[0061] The following are some examples of embodiments of this disclosure. However, it should be noted that the embodiments of this disclosure are not limited to these. [Note 1] A voice-operated device for use in a vehicle equipped with a control unit, wherein the aforementioned control unit is... When a passenger makes a voice request to operate the in-vehicle equipment, the location of the passenger who made the request is determined as seat number 1. If the location corresponding to the first seat does not have the in-vehicle equipment that the speaker requests to operate, the operation of the in-vehicle equipment associated with the second seat is performed. [Note 2] As shown in Note 1, the voice operation device, in which, The aforementioned second seat is the seat closest to the aforementioned first seat. [Note 3] As shown in Note 1 or 2, the voice-operated device, in which, The aforementioned first seat position is a position related to the seat in the third column, and the aforementioned second seat position is a position related to the seat in the second column. [Note 4] The voice-operated device, as described in any of Notes 1 to 3, wherein, The aforementioned control unit, when there are other passengers in the second seat, inquires with those other passengers whether they can operate the aforementioned in-vehicle equipment. [Note 5] The voice-operated device, as described in any of notes 1 to 4, wherein, The aforementioned control unit, when there is another passenger in the second seat and the setting is ON, inquires with the other passenger whether the operation of the aforementioned vehicle equipment can be performed. [Note 6] As shown in Note 5, the voice operation device, in which, When the aforementioned control unit is asked again if the setting is OFF, it does not inquire with the other occupants whether the operation of the aforementioned on-board equipment can be performed. [Note 7] The voice-operated device, as described in any of notes 1 to 6, wherein, The aforementioned in-vehicle equipment includes at least one of the following: air conditioning, power windows, sunroof, speakers, and interior light sources. [Note 8] A program that causes a voice control device in a vehicle to perform actions, the aforementioned actions including: The procedure for determining the seat position of the passenger who made the voice request to operate the in-vehicle equipment is as follows: If the vehicle-mounted device that the speaker requests to operate is not available at the location corresponding to the first seat position, the steps for operating the vehicle-mounted device associated with the second seat position shall be performed. [Note 9] As shown in Note 8, in which, The aforementioned second seat is the seat closest to the aforementioned first seat. [Note 10] As in the program in footnote 8 or 9, where, The aforementioned first seat position is a position related to the seat in the third column, and the aforementioned second seat position is a position related to the seat in the second column. [Note 11] For example, in any of the procedures in notes 8 to 10, where, If there are other passengers in the second seat, inquire with those other passengers whether they can operate the aforementioned in-vehicle equipment. [Note 12] For example, in any of the procedures in notes 8 to 11, where, If there are other passengers in the second seat, and the setting is again set to ON, inquire with the other passengers whether they can operate the aforementioned in-vehicle equipment. [Note 13] As shown in Note 12, in which, When the aforementioned control unit is asked again if the setting is OFF, it does not inquire with the other occupants whether the operation of the aforementioned on-board equipment can be performed. [Note 14] For example, in any of the procedures in notes 8 to 13, where, The aforementioned in-vehicle equipment includes at least one of the following: air conditioning, power windows, sunroof, speakers, and interior light sources. [Note 15] A method performed by a voice control device in a vehicle, comprising: The procedure for determining the seat position of the passenger who made the voice request to operate the in-vehicle equipment is as follows: If the vehicle-mounted device that the speaker requests to operate is not available at the location corresponding to the first seat position, the steps for operating the vehicle-mounted device associated with the second seat position shall be performed. [Note 16] As in the method in Note 15, where, The aforementioned second seat is the seat closest to the aforementioned first seat. [Note 17] For example, in the program in footnote 15 or 16, where, The aforementioned first seat position is a position related to the seat in the third column, and the aforementioned second seat position is a position related to the seat in the second column. [Note 18] For example, in any of the procedures in notes 15 to 17, where, If there are other passengers in the second seat, inquire with those other passengers whether they can operate the aforementioned in-vehicle equipment. [Note 19] For example, in any of the procedures in notes 15 to 18, where, If there are other passengers in the second seat, and the setting is again set to ON, inquire with the other passengers whether they can operate the aforementioned in-vehicle equipment. [Note 20] As shown in Note 19, in which, When the aforementioned control unit is asked again if the setting is OFF, it does not inquire with the other occupants whether the operation of the aforementioned on-board equipment can be performed.

[0062] 1: System 2: Vehicles 10: Voice control device 11: Control Department 12: Memory Department 13: Communications Department 20: Multiple microphones 30: Speaker 40: Display device 50: Vehicle-mounted equipment 60: Occupant identification device 61-66: Seats 201-206: Microphone 501-504: Air Conditioner 511-514: Electric windows

Claims

1. A voice-operated device for use in a vehicle with a control unit, wherein, The aforementioned control system determines the first seat position of the passenger who made the request when the passenger makes a voice request to operate the in-vehicle equipment. If the in-vehicle equipment requested by the passenger is not available at the position corresponding to the first seat position, the system executes the operation of the in-vehicle equipment associated with the second seat position.

2. The voice-operated device as described in request item 1, wherein, The aforementioned second seat is the seat closest to the aforementioned first seat.

3. The voice operation device as described in request item 1, wherein, The aforementioned first seat position is a position related to the seat in the third column, and the aforementioned second seat position is a position related to the seat in the second column.

4. The voice operation device as described in request item 1, wherein, The aforementioned control unit queries other passengers in the second seat whether they can operate the aforementioned in-vehicle equipment.

5. The voice-operated device as described in request item 1, wherein, When there are other passengers in the second seat, and the setting is set to ON, the aforementioned control unit queries the other passengers to see if they can operate the aforementioned in-vehicle equipment.

6. The voice-operated device as described in request item 5, wherein, When the aforementioned control unit is asked again if the setting is OFF, it does not inquire with the other occupants whether the operation of the aforementioned on-board equipment can be performed.

7. A voice-operated device as described in any of requests 1 to 6, wherein, The aforementioned in-vehicle equipment includes at least one of the following: air conditioning, power windows, sunroof, speakers, and interior light sources.

8. A program that causes a voice control device in a vehicle to perform actions, the actions comprising: determining the first seat position of the occupant who made the request via voice when the occupant requests operation of the in-vehicle device; and performing operation of the in-vehicle device associated with a second seat position when the in-vehicle device requested by the occupant is not present at the position corresponding to the first seat position.

9. As in request item 8, where, The aforementioned second seat is the seat closest to the aforementioned first seat.

10. As in request item 8, where, The aforementioned first seat position is a position related to the seat in the third column, and the aforementioned second seat position is a position related to the seat in the second column.

11. As in request item 8, where, If there are other passengers in the second seat, inquire with those other passengers whether they can operate the aforementioned in-vehicle equipment.

12. As in request item 8, where, If there are other passengers in the second seat, and the setting is again set to ON, inquire with the other passengers whether they can operate the aforementioned in-vehicle equipment.

13. As in request item 12, where, If the setting is set to OFF when asked again, the system will not ask the other occupants whether they can perform the operation of the aforementioned on-board equipment.

14. A program as requested in any of items 8 to 13, wherein, The aforementioned in-vehicle equipment includes at least one of the following: air conditioning, power windows, sunroof, speakers, and interior light sources.

15. A method performed by a voice operation device in a vehicle, comprising: determining the first seat position of the occupant who made the request via voice when the occupant requests operation of an in-vehicle device; and performing operation of an in-vehicle device associated with a second seat position when there is no in-vehicle device requested by the occupant at a position corresponding to the first seat position.

16. As in request item 15, where, The aforementioned second seat is the seat closest to the aforementioned first seat.

17. As in request item 15, where, The aforementioned first seat position is a position related to the seat in the third column, and the aforementioned second seat position is a position related to the seat in the second column.

18. As in request item 15, where, If there are other passengers in the second seat, inquire with those other passengers whether they can operate the aforementioned in-vehicle equipment.

19. As in request item 15, where, If there are other passengers in the second seat, and the setting is again set to ON, inquire with the other passengers whether they can operate the aforementioned in-vehicle equipment.

20. As in request item 19, where, If the setting is set to OFF when asked again, the system will not ask the other occupants whether they can perform the operation of the aforementioned on-board equipment.

Images