Information processing device and control method

Abstract

To provide an information processing device and a control method of the same that improve the convenience of a technique for outputting responses to voice inputs.SOLUTION: In a system 10, an information processing device 20 includes a control unit that controls functions according to the voice input from an occupant of a vehicle 12. The control unit identifies the occupant, adjusts the level of conciseness of the response to the voice input by the identified occupant, and improves the convenience by changing the level of conciseness of the response as the output to the voice input according to the user.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus and a control method.

Background Art

[0002] Patent Document 1 discloses a method for answering voice input from a user.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the conventional method, the answer to voice input is given uniformly to any speaker. Therefore, the convenience is insufficient.

[0005] An object of the present disclosure is to improve the convenience of a technique for outputting a response to voice input.

Means for Solving the Problems

[0006] The information processing apparatus according to the present disclosure is a control unit that controls functions according to voice input from a vehicle occupant, the control unit identifying the occupant and adjusting the conciseness of the response to the voice input by the identified occupant.

[0007] The control method according to the present disclosure is a computer controlling functions according to voice input from a vehicle occupant, the computer identifying the occupant, and the computer adjusting the conciseness of the response to the voice input by the identified occupant and including.

Advantages of the Invention

[0008] According to the present disclosure, the simplicity degree of the response as the output for voice input can be changed according to the user, so that the convenience is improved.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Modes for Carrying Out the Invention

[0010] Hereinafter, an embodiment of the present disclosure will be described with reference to the drawings.

[0011] In each figure, the same or corresponding parts are denoted by the same reference numerals. In the description of the present embodiment, the description of the same or corresponding parts will be omitted or simplified as appropriate.

[0012] With reference to FIG. 1, the configuration of the system 10 according to the present embodiment will be described.

[0013] The system 10 according to the present embodiment includes an information processing apparatus 20 and a server apparatus 30. The information processing apparatus 20 can communicate with the server apparatus 30 via a network 40.

[0014] The information processing device 20 is a computer with a voice recognition function mounted on the vehicle 12. The information processing device 20 is used by the user 11. The user 11 is a passenger in the vehicle 12.

[0015] The server device 30 is a computer belonging to a cloud computing system or other computing system installed in a facility such as a data center. The server device 30 is operated by an operator providing services such as web services.

[0016] The vehicle 12 is, for example, an automobile of any type such as a gasoline vehicle, a diesel vehicle, a hydrogen vehicle, an HEV, a PHEV, a BEV, or an FCEV. "HEV" is an abbreviation for hybrid electric vehicle. "PHEV" is an abbreviation for plug-in hybrid electric vehicle. "BEV" is an abbreviation for battery electric vehicle. "FCEV" is an abbreviation for fuel cell electric vehicle. The vehicle 12 may be driven by the user 11 or may have its driving automated at any level. The level of automation is, for example, any one of levels 1 to 5 in the SAE level classification. "SAE" is the abbreviation of Society of Automotive Engineers. The vehicle 12 may also be a vehicle dedicated to MaaS. "MaaS" is an abbreviation for Mobility as a Service.

[0017] Network 40 includes the Internet, at least one WAN, at least one MAN, or any combination thereof. "WAN" is an abbreviation for wide area network. "MAN" is an abbreviation for metropolitan area network. Network 40 may include at least one wireless network, at least one optical network, or any combination thereof. The wireless network is, for example, an ad hoc network, a cellular network, a wireless LAN, a satellite communication network, or a terrestrial microwave network. "LAN" is an abbreviation for local area network.

[0018] Referring to FIG. 1, the outline of this embodiment will be described.

[0019] The information processing apparatus 20 controls functions according to voice input from the user 11. The information processing apparatus 20 identifies the user 11. The information processing apparatus 20 adjusts the conciseness of the response to the voice input according to the identified user 11.

[0020] According to this embodiment, since the conciseness of the response as the output to the voice input can be changed according to the user 11, the convenience is improved.

[0021] Referring to FIG. 2, the configuration of the information processing apparatus 20 according to this embodiment will be described.

[0022] The information processing apparatus 20 includes a control unit 21, a storage unit 22, a communication unit 23, an input unit 24, and an output unit 25. In the storage unit 22, usage status data 50 indicating the usage status of the information processing apparatus 20 of the user 11 is stored.

[0023] The control unit 21 includes at least one processor, at least one programmable circuit, at least one dedicated circuit, or any combination thereof. The processor is a general-purpose processor such as a CPU or GPU, or a dedicated processor specialized for specific processing. "CPU" is an abbreviation for central processing unit. "GPU" is an abbreviation for graphics processing unit. The programmable circuit is, for example, an FPGA. "FPGA" is an abbreviation for field-programmable gate array. The dedicated circuit is, for example, an ASIC. "ASIC" is an abbreviation for application specific integrated circuit. While controlling each part of the information processing device 20, the control unit 21 executes processing related to the operation of the information processing device 20.

[0024] The storage unit 22 includes at least one semiconductor memory, at least one magnetic memory, at least one optical memory, or any combination thereof. The semiconductor memory is, for example, a RAM, ROM, or flash memory. "RAM" is an abbreviation for random access memory. "ROM" is an abbreviation for read only memory. The RAM is, for example, an SRAM or DRAM. "SRAM" is an abbreviation for static random access memory. "DRAM" is an abbreviation for dynamic random access memory. The ROM is, for example, an EEPROM. "EEPROM" is an abbreviation for electrically erasable programmable read only memory. The flash memory is, for example, an SSD. "SSD" is an abbreviation for solid-state drive. The magnetic memory is, for example, an HDD. "HDD" is an abbreviation for hard disk drive. The storage unit 22 functions as, for example, a main memory device, an auxiliary storage device, or a cache memory. In the storage unit 22, data used for the operation of the information processing device 20 and data obtained by the operation of the information processing device 20 are stored.

[0025] The communication unit 23 includes at least one communication module. The communication module is a module compatible with mobile communication standards such as LTE, 4G standard, or 5G standard, or wireless LAN communication standards such as IEEE 802.11. "LTE" is an abbreviation for Long Term Evolution. "4G" is an abbreviation for 4th generation. "5G" is an abbreviation for 5th generation. "IEEE" is an abbreviation for Institute of Electrical and Electronics Engineers. The communication unit 23 communicates with the server device 30. The communication unit 23 receives data used for the operation of the information processing device 20 and transmits data obtained by the operation of the information processing device 20.

[0026] The input unit 24 includes at least one input device. The input device is, for example, a physical key, a capacitive key, a pointing device, a touch screen provided integrally with a display, a visible light camera, a depth camera, LiDAR, or a microphone. "LiDAR" is an abbreviation for light detection and ranging. The input unit 24 receives an operation for inputting data used for the operation of the information processing device 20. Instead of being provided in the information processing device 20, the input unit 24 may be connected to the information processing device 20 as an external input device. As the connection interface, an interface compatible with standards such as USB, HDMI (registered trademark), or Bluetooth (registered trademark) can be used. "USB" is an abbreviation for Universal Serial Bus. "HDMI (registered trademark)" is an abbreviation for High-Definition Multimedia Interface.

[0027] The output unit 25 includes at least one output device. The output device is, for example, a display or a speaker. The display is, for example, an LCD or an organic EL display. "LCD" is an abbreviation for liquid crystal display. "EL" is an abbreviation for electro luminescent. The output unit 25 outputs data obtained by the operation of the information processing apparatus 20. Instead of being provided in the information processing apparatus 20, the output unit 25 may be connected to the information processing apparatus 20 as an external output device such as a display and audio. As the connection interface, an interface corresponding to a standard such as USB, HDMI (registered trademark), or Bluetooth (registered trademark) can be used.

[0028] The functions of the information processing apparatus 20 are realized by executing the program according to the present embodiment with a processor as the control unit 21. That is, the functions of the information processing apparatus 20 are realized by software. The program causes a computer to execute the operations of the information processing apparatus 20, thereby causing the computer to function as the information processing apparatus 20. That is, the computer functions as the information processing apparatus 20 by executing the operations of the information processing apparatus 20 according to the program.

[0029] The program can be stored in a non-transitory computer-readable medium. The non-transitory computer-readable medium is, for example, a flash memory, a magnetic recording device, an optical disk, a magneto-optical recording medium, or a ROM. The distribution of the program is performed, for example, by selling, transferring, or lending a portable medium such as an SD card, a DVD, or a CD-ROM storing the program. "SD" is an abbreviation for Secure Digital. "DVD" is an abbreviation for digital versatile disc. "CD-ROM" is an abbreviation for compact disc read only memory. The program may be stored in the storage of a server and transferred from the server to another computer to distribute the program. The program may be provided as a program product.

[0030] The computer temporarily stores, for example, a program stored in a portable medium or a program transferred from a server in the main memory device. Then, the computer reads the program stored in the main memory device with the processor and executes the processing according to the read program with the processor. The computer may directly read the program from the portable medium and execute the processing according to the program. The computer may sequentially execute the processing according to the received program each time a program is transferred from the server to the computer. The processing may be executed by a so-called ASP-type service that realizes the function only by execution instructions and result acquisition without transferring the program from the server to the computer. "ASP" is an abbreviation for application service provider. The program includes information for use in processing by an electronic computer and those conforming to the program. For example, data that is not a direct instruction to the computer but has the property of defining the processing of the computer corresponds to "those conforming to the program".

[0031] Some or all of the functions of the information processing apparatus 20 may be realized by a programmable circuit or a dedicated circuit as the control unit 21. That is, some or all of the functions of the information processing apparatus 20 may be realized by hardware.

[0032] Referring to FIG. 3, the configuration of the usage status data 50 according to the present embodiment will be described.

[0033] The usage status data 50 is configured as a table including three columns of user ID, relationship, and usage count. "ID" is an abbreviation of identifier. The "user ID" in the usage status data 50 is an ID pre-assigned to a user who can use the information processing device 20. Voice data obtained by recording the voice of the corresponding user is pre-associated with the user ID. The "relationship" in the usage status data 50 is the relationship between each user and the owner of the vehicle 12. Here, each user is classified into one of "oneself", "spouse", "child", and "others". The "usage count" in the usage status data 50 is the cumulative number of times each user has used the information processing device 20, that is, the cumulative number of times the information processing device 20 has recognized voice input for each user. In addition to this, the date when each user has used the information processing device 20 may be recorded in the usage status data 50.

[0034] In this embodiment, the usage status data 50 is stored in the storage unit 22 of the information processing device 20, but it may be stored in the server device 30 or an external storage device.

[0035] Referring to FIG. 4, the operation of the information processing device 20 according to this embodiment will be described. The operations described below correspond to the control method according to this embodiment. That is, the control method according to this embodiment includes the steps of S101 to S105 shown in FIG. 4.

[0036] When the user 11 issues an activation command such as "Hey, car!" or presses an activation button displayed on the screen or physically arranged, the step of S101 is started.

[0037] In S101, the control unit 21 receives a voice input from the user 11. For example, the control unit 21 receives a voice input such as "want to go to X" or "want to listen to Y" from the user 11 via a microphone as the input unit 24.

[0038] In S102, the control unit 21 identifies the user 11. Specifically, the control unit 21 collates the voice input in S101 with the voice data of the user 11 pre-recorded in the storage unit 22 to identify the user 11.

[0039] In S103, the control unit 21 determines whether the proficiency regarding the use of the information processing apparatus 20 of the user 11 is equal to or higher than a threshold value. Specifically, the control unit 21 refers to the usage status data 50 as shown in FIG. 3 to determine the proficiency. If the proficiency is equal to or higher than the threshold value (S103 - YES), the process proceeds to S104. If the proficiency is less than the threshold value (S103 - NO), the process proceeds to S105.

[0040] "Proficiency" is an index indicating how familiar the user 11 is with the use of the information processing apparatus 20. In the present embodiment, the proficiency is determined from the number of times the information processing apparatus 20 has been used, which is recorded in the usage status data 50. For example, taking the "number of times of use" in the usage status data 50 as the proficiency and setting the threshold value to 30. If the passenger who voice - inputs "want to go to X" in S101 is identified as the user corresponding to the user ID "198702" in the example shown in FIG. 3, the corresponding number of times of use is 85 times. Therefore, the control unit 21 determines that the proficiency is equal to or higher than the threshold value, and the process proceeds to S104. If the passenger who voice - inputs "want to listen to Y" in S101 is identified as the user corresponding to the user ID "202111" in the example shown in FIG. 3, the corresponding number of times of use is 8 times. Therefore, the control unit 21 determines that the proficiency is less than the threshold value, and the process proceeds to S105. Even when the user 11 is a user not registered in the usage status data 50, the process proceeds to S105.

[0041] The threshold value is pre - stored in the storage unit 22, but it may also be received by the control unit 21 from the server device 30.

[0042] In S104, the control unit 21 outputs a first voice as a response to the voice input received in S101. Specifically, the control unit 21 outputs, as the first voice, a voice that omits confirmation regarding the function corresponding to the voice input from the user 11. Thereby, the control unit 21 increases the degree of conciseness of the response to the voice input. For example, for a passenger who inputs "want to go to X" by voice in S101, when it is determined in S103 that the proficiency level is equal to or higher than the threshold value, as the first voice, the control unit 21 outputs, from the speaker as the output unit 25, only the message "Understood" that omits confirmation regarding the function of the navigation device, such as "Set X as the destination". In this way, by making the response to a user who is familiar with using the information processing device 20 concise, the convenience can be further improved.

[0043] After S104, the flow shown in FIG. 4 ends.

[0044] In S105, the control unit 21 outputs a second voice different from the first voice as a response to the voice input received in S101. Specifically, the control unit 21 outputs, as the second voice, a voice that includes confirmation regarding the function corresponding to the voice input from the user 11. For example, for a passenger who inputs "want to listen to Y" by voice in S101, when it is determined in S103 that the proficiency level is less than the threshold value, as the second voice, the control unit 21 outputs, from the speaker as the output unit 25, a message that includes confirmation regarding the function of the audio device, such as "Play Y", instead of a concise message such as "Understood".

[0045] After S105, the flow shown in FIG. 4 ends.

[0046] As described above, in the present embodiment, the control unit 21 controls the function corresponding to the voice input from the user 11. The control unit 21 identifies the user 11. The control unit 21 adjusts the degree of conciseness of the response to the voice input according to the identified user 11.

[0047] According to the present embodiment, since the conciseness of the response as the output to the voice input can be changed according to the user 11, the convenience is improved.

[0048] With reference to FIG. 5, a modified example of the operation of the information processing apparatus 20 according to the present embodiment will be described. However, since the steps of S201, S202, S204, and S205 are the same as the steps of S101, S102, S104, and S105 shown in FIG. 4, the description thereof will be omitted.

[0049] In S203, the control unit 21 determines the relationship between the user 11 and the owner of the vehicle 12. Specifically, the control unit 21 refers to the usage status data 50 as shown in FIG. 3 to determine the relationship between the user 11 and the owner of the vehicle 12. For example, when the user 11 is the "owner himself / herself" of the vehicle 12, the process proceeds to S204. For example, when the user 11 is a registered user other than the owner himself / herself, specifically, a user registered as "spouse", "child", or "other" in the usage status data 50, the process proceeds to S205. For example, when the user 11 is "unregistered", that is, a user not registered in the usage status data 50, the process proceeds to S206. As another example, the process may proceed to S205 only when the user 11 is a family member of the owner, specifically, a user registered as "spouse" or "child" in the usage status data 50. When the user 11 is neither the owner himself / herself nor a family member, that is, a user registered as "other" in the usage status data 50 or a user not registered in the usage status data 50, the process may proceed to S206.

[0050] In S206, the control unit 21 outputs a third voice that is different from both the first voice and the second voice as a response to the voice input received in S101. Specifically, the control unit 21 outputs, as the third voice, a voice including confirmation about the function corresponding to the voice input from the user 11 and additional explanation about the function. For example, if the passenger who input "want to listen to Y" in S201 is unidentifiable in S202, that is, if the passenger is not registered in the usage status data 50, the control unit 21 determines that the passenger is "unregistered" in S203. Then, the control unit 21 outputs, as the third voice, not a simple message such as "Understood", but a message including confirmation about the function of the audio device such as "Play Y" followed by additional explanation about the function of the audio device such as "You can request the next song during playback" from the speaker as the output unit 25.

[0051] After S206, the flow shown in FIG. 5 ends.

[0052] In this embodiment, the control unit 21 increases the simplicity of the response to the voice input by outputting a voice that omits confirmation about the function corresponding to the voice input from the user 11. However, the control unit 21 may increase the simplicity in other ways. Specifically, the control unit 21 may increase the simplicity by reducing one or more terms from the message as the response. For example, in S104 or S204, for the voice input of "want to go to X", the control unit 21 may output, as the response, not the message "Set X as the destination" but the message "Set X" with the term "as the destination" reduced. Alternatively, the control unit 21 may increase the simplicity by outputting the message as the response in broken words instead of polite language. Furthermore, the control unit 21 may increase the simplicity by rephrasing the expressions included in the message as the response with other shorter expressions.

[0053] As another modification of this embodiment, the control unit 21 may increase the conciseness of voice input as the proficiency level increases. For example, taking the "number of uses" in the usage status data 50 as the proficiency level, setting the first threshold value to 50, and the second threshold value to 10. When the number of uses of the user 11 is 50 or more, the control unit 21 outputs the first voice; when the number of uses of the user 11 is 10 or more and 49 or less, the second voice; and when the number of uses of the user 11 is 9 or less, the third voice. For the process of outputting the first voice to the third voice, the same processes as the steps of S204 to S206 shown in FIG. 5 can be applied respectively.

[0054] The present disclosure is not limited to the above-described embodiments. For example, two or more blocks described in the block diagram may be integrated, or one block may be divided. Instead of executing two or more steps described in the flowchart in chronological order according to the description, each step may be executed in parallel or in a different order according to the processing capabilities of the device that executes the steps, or as necessary. In addition, changes can be made without departing from the spirit of the present disclosure.

Description of Reference Numerals

[0055] 10 System 11 User 12 Vehicle 20 Information Processing Apparatus 21 Control Unit 22 Storage Unit 23 Communication Unit 24 Input Unit 25 Output Unit 30 Server Apparatus 40 Network 50 Usage Status Data

Claims

1. An information processing apparatus including a control unit that controls functions according to voice input from a vehicle occupant, the control unit identifying the occupant and adjusting the conciseness level of a response to the voice input by the identified occupant.

2. The information processing apparatus according to claim 1, wherein the control unit increases the conciseness level by outputting, as the response, a voice that omits confirmation about the function.

3. The information processing apparatus according to claim 1, wherein when the control unit identifies the occupant, the control unit refers to usage status data indicating the usage status of the information processing apparatus by the occupant, determines the proficiency level of the occupant regarding the use of the information processing apparatus, and increases the conciseness level as the determined proficiency level is higher.

4. The information processing apparatus according to claim 1, wherein the control unit also adjusts the conciseness level according to the relationship between the occupant and the owner of the vehicle.

5. A control method including: a computer controlling functions according to voice input from a vehicle occupant; the computer identifying the occupant; and the computer adjusting the conciseness level of a response to the voice input by the identified occupant.

Images