Information processing device and control method

Abstract

To provide an information processing device and a control method of the same that improve the convenience of a technique for outputting responses to voice inputs.SOLUTION: In a system 10, an information processing device 20 includes a control unit that controls functions according to the voice input from an occupant of a vehicle 12. The control unit identifies the occupant, adjusts the level of conciseness of the response to the voice input by the identified occupant, and improves the convenience by changing the level of conciseness of the response as the output to the voice input according to the user.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus and a control method.

Background Art

[0002] Patent Document 1 discloses a method for answering voice input from a user.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the conventional method, the answer to voice input is given uniformly to any speaker. Therefore, the convenience is insufficient.

[0005] An object of the present disclosure is to improve the convenience of a technology for outputting a response to voice input.

Means for Solving the Problems

[0006] The information processing apparatus according to the present disclosure is a control unit that controls functions according to voice input from a vehicle occupant, and includes a control unit that identifies the occupant and adjusts the conciseness of a response to the voice input according to the identified occupant.

[0007] The control method according to the present disclosure is that a computer controls functions according to voice input from a vehicle occupant, the computer identifies the occupant, and the computer adjusts the conciseness of a response to the voice input according to the identified occupant and includes the above. [Effects of the Invention]

[0008] According to this disclosure, the level of conciseness of the response to voice input can be changed to suit the user, thereby improving convenience. [Brief explanation of the drawing]

[0009] [Figure 1] This figure shows the configuration of the system according to the embodiment of this disclosure. [Figure 2] This is a block diagram showing the configuration of an information processing device according to an embodiment of this disclosure. [Figure 3] This is a table showing an example of usage data according to the embodiments of this disclosure. [Figure 4] This is a flowchart showing the operation of the information processing device according to the embodiment of this disclosure. [Figure 5] This is a flowchart illustrating a modified example of the operation of an information processing device according to the present disclosure. [Modes for carrying out the invention]

[0010] Hereinafter, one embodiment of this disclosure will be described with reference to the figures.

[0011] In each figure, identical or corresponding parts are denoted by the same reference numerals. In the description of this embodiment, the description of identical or corresponding parts will be omitted or simplified as appropriate.

[0012] Referring to Figure 1, the configuration of the system 10 according to this embodiment will be described.

[0013] The system 10 according to this embodiment comprises an information processing device 20 and a server device 30. The information processing device 20 can communicate with the server device 30 via a network 40.

[0014] The information processing device 20 is a computer with voice recognition capabilities installed in the vehicle 12. The information processing device 20 is used by user 11, who is an occupant of the vehicle 12.

[0015] Server device 30 is a computer belonging to a cloud computing system or other computing system, installed in a facility such as a data center. Server device 30 is operated by a service provider that provides web services or similar services.

[0016] Vehicle 12 is any type of automobile, such as a gasoline car, diesel car, hydrogen car, HEV, PHEV, BEV, or FCEV. "HEV" is an abbreviation for hybrid electric vehicle. "PHEV" is an abbreviation for plug-in hybrid electric vehicle. "BEV" is an abbreviation for battery electric vehicle. "FCEV" is an abbreviation for fuel cell electric vehicle. Vehicle 12 may be driven by user 11, or its operation may be automated to any level. The level of automation may be, for example, one of levels 1 to 5 in the SAE classification. "SAE" is an abbreviation for Society of Automotive Engineers. Vehicle 12 may also be a vehicle dedicated to MaaS. "MaaS" is an abbreviation for Mobility as a Service.

[0017] Network 40 includes the Internet, at least one WAN, at least one MAN, or any combination thereof. "WAN" is an abbreviation for wide area network. "MAN" is an abbreviation for metropolitan area network. Network 40 may include at least one wireless network, at least one optical network, or any combination thereof. The wireless network may be, for example, an ad hoc network, a cellular network, a wireless LAN, a satellite communication network, or a terrestrial microwave network. "LAN" is an abbreviation for local area network.

[0018] Referring to FIG. 1, the outline of this embodiment will be described.

[0019] The information processing apparatus 20 controls functions according to voice input from the user 11. The information processing apparatus 20 identifies the user 11. The information processing apparatus 20 adjusts the conciseness of the response to the voice input according to the identified user 11.

[0020] According to this embodiment, the convenience is improved because the conciseness of the response as the output to the voice input can be changed according to the user 11.

[0021] Referring to FIG. 2, the configuration of the information processing apparatus 20 according to this embodiment will be described.

[0022] The information processing apparatus 20 includes a control unit 21, a storage unit 22, a communication unit 23, an input unit 24, and an output unit 25. In the storage unit 22, usage status data 50 indicating the usage status of the information processing apparatus 20 by the user 11 is stored.

[0023] The control unit 21 includes at least one processor, at least one programmable circuit, at least one dedicated circuit, or any combination thereof. The processor is a general-purpose processor such as a CPU or GPU, or a dedicated processor specialized for a specific process. "CPU" is an abbreviation for central processing unit. "GPU" is an abbreviation for graphics processing unit. The programmable circuit is, for example, an FPGA. "FPGA" is an abbreviation for field-programmable gate array. The dedicated circuit is, for example, an ASIC. "ASIC" is an abbreviation for application specific integrated circuit. The control unit 21 controls each part of the information processing device 20 and executes processes related to the operation of the information processing device 20.

[0024] The storage unit 22 includes at least one semiconductor memory, at least one magnetic memory, at least one optical memory, or any combination thereof. The semiconductor memory is, for example, RAM, ROM, or flash memory. "RAM" is an abbreviation for random access memory. "ROM" is an abbreviation for read-only memory. RAM is, for example, SRAM or DRAM. "SRAM" is an abbreviation for static random access memory. "DRAM" is an abbreviation for dynamic random access memory. ROM is, for example, EEPROM. "EEPROM" is an abbreviation for electrically erasable programmable read-only memory. Flash memory is, for example, SSD. "SSD" is an abbreviation for solid-state drive. Magnetic memory is, for example, HDD. "HDD" is an abbreviation for hard disk drive. The storage unit 22 functions, for example, as main memory, auxiliary memory, or cache memory. The memory unit 22 stores data used for the operation of the information processing device 20 and data obtained through the operation of the information processing device 20.

[0025] The communication unit 23 includes at least one communication module. The communication module is, for example, a module compatible with a mobile communication standard such as LTE, 4G, or 5G, or a wireless LAN communication standard such as IEEE 802.11. "LTE" is an abbreviation for Long Term Evolution. "4G" is an abbreviation for 4th generation. "5G" is an abbreviation for 5th generation. "IEEE" is an abbreviation for Institute of Electrical and Electronics Engineers. The communication unit 23 communicates with the server device 30. The communication unit 23 receives data used for the operation of the information processing device 20 and transmits data obtained by the operation of the information processing device 20.

[0026] The input unit 24 includes at least one input device. The input device may be, for example, a physical key, a capacitive key, a pointing device, a touchscreen integrated with a display, a visible light camera, a depth camera, LiDAR, or a microphone. "LiDAR" is an abbreviation for light detection and ranging. The input unit 24 accepts operations to input data used for the operation of the information processing device 20. The input unit 24 may be connected to the information processing device 20 as an external input device instead of being provided in the information processing device 20. As a connection interface, an interface compatible with standards such as USB, HDMI®, or Bluetooth® can be used. "USB" is an abbreviation for Universal Serial Bus. "HDMI®" is an abbreviation for High-Definition Multimedia Interface.

[0027] The output unit 25 includes at least one output device. The output device is, for example, a display or a speaker. The display is, for example, an LCD or an organic EL display. "LCD" is an abbreviation for liquid crystal display. "EL" is an abbreviation for electroluminescent. The output unit 25 outputs data obtained by the operation of the information processing device 20. Instead of being provided in the information processing device 20, the output unit 25 may be connected to the information processing device 20 as an external output device, such as a display audio. As a connection interface, an interface compatible with standards such as USB, HDMI®, or Bluetooth® can be used.

[0028] The functions of the information processing device 20 are realized by executing the program according to this embodiment on the processor acting as the control unit 21. In other words, the functions of the information processing device 20 are realized by software. The program causes the computer to perform the operations of the information processing device 20, thereby causing the computer to function as the information processing device 20. That is, the computer functions as the information processing device 20 by performing the operations of the information processing device 20 according to the program.

[0029] The program can be stored on a non-temporary computer-readable medium. Examples of non-temporary computer-readable media include flash memory, magnetic recording devices, optical discs, magneto-optical recording media, or ROM. The program can be distributed, for example, by selling, transferring, or lending portable media such as SD cards, DVDs, or CD-ROMs containing the program. "SD" is an abbreviation for Secure Digital. "DVD" is an abbreviation for digital versatile disc. "CD-ROM" is an abbreviation for compact disc read only memory. The program may also be distributed by storing it in server storage and transferring it from the server to other computers. The program may also be provided as a program product.

[0030] A computer, for example, stores a program stored on a portable medium or a program transferred from a server in its main memory. Then, the computer reads the program stored in the main memory with its processor and executes the processing according to the read program. The computer may also read the program directly from the portable medium and execute the processing according to the program. The computer may also execute the processing according to the received program sequentially each time a program is transferred to the computer from a server. Processing may also be performed by a so-called ASP-type service, which does not transfer programs from the server to the computer, but realizes its function only through execution instructions and result retrieval. "ASP" is an abbreviation for application service provider. A program includes information used for processing by an electronic computer that is equivalent to a program. For example, data that is not a direct instruction to the computer but has the nature of defining the computer's processing falls under "equivalent to a program".

[0031] Some or all of the functions of the information processing device 20 may be implemented by a programmable circuit or a dedicated circuit as a control unit 21. In other words, some or all of the functions of the information processing device 20 may be implemented by hardware.

[0032] Referring to Figure 3, the configuration of the usage data 50 according to this embodiment will be described.

[0033] The usage data 50 is structured as a table containing three columns: User ID, Relationship, and Number of Uses. "ID" is an abbreviation for identifier. The "User ID" in the usage data 50 is an ID pre-assigned to users who are eligible to use the information processing device 20. The User ID is pre-associated with voice data obtained by recording the voice of the corresponding user. The "Relationship" in the usage data 50 is the relationship between each user and the owner of the vehicle 12. Here, each user is classified as either "Self," "Spouse," "Child," or "Other." The "Number of Uses" in the usage data 50 is the cumulative number of times each user has used the information processing device 20, that is, the cumulative number of times the information processing device 20 has recognized voice input for each user. The usage data 50 may also record other information, such as the date each user used the information processing device 20.

[0034] In this embodiment, the usage data 50 is stored in the storage unit 22 of the information processing device 20, but it may also be stored in the server device 30 or an external storage device.

[0035] Referring to Figure 4, the operation of the information processing device 20 according to this embodiment will be described. The operation described below corresponds to the control method according to this embodiment. That is, the control method according to this embodiment includes steps S101 to S105 shown in Figure 4.

[0036] Step S101 begins when user 11 issues a startup command such as "Hey, car!" or presses a startup button displayed on the screen or physically located on the device.

[0037] In S101, the control unit 21 receives voice input from the user 11. For example, the control unit 21 receives voice input from the user 11 such as "I want to go to X" or "I want to listen to Y" via the microphone, which acts as the input unit 24.

[0038] In S102, the control unit 21 identifies user 11. Specifically, the control unit 21 identifies user 11 by comparing the voice input in S101 with the voice data of user 11 that has been previously recorded in the storage unit 22.

[0039] In S103, the control unit 21 determines whether the user 11's proficiency in using the information processing device 20 is above a threshold. Specifically, the control unit 21 determines the proficiency by referring to the usage status data 50 as shown in Figure 3. If the proficiency is above the threshold (S103-YES), the process proceeds to S104. If the proficiency is below the threshold (S103-NO), the process proceeds to S105.

[0040] "Proficiency" is an indicator of how familiar user 11 is with using the information processing device 20. In this embodiment, proficiency is determined from the number of times the information processing device 20 has been used, as recorded in the usage data 50. For example, the "number of uses" in the usage data 50 is used as the proficiency, and the threshold is set to 30. If a crew member who voice-inputs "I want to go to X" in S101 is identified as the user corresponding to user ID "198702" in the example shown in Figure 3, the corresponding number of uses is 85. Therefore, the control unit 21 determines that the proficiency is above the threshold, and the process proceeds to S104. If a crew member who voice-inputs "I want to listen to Y" in S101 is identified as the user corresponding to user ID "202111" in the example shown in Figure 3, the corresponding number of uses is 8. Therefore, the control unit 21 determines that the proficiency is below the threshold, and the process proceeds to S105. The process also proceeds to S105 if user 11 is not registered in the usage data 50.

[0041] The threshold value is stored in the storage unit 22 beforehand, but the control unit 21 may receive it from the server device 30.

[0042] In S104, the control unit 21 outputs a first voice message as a response to the voice input received in S101. Specifically, the control unit 21 outputs a first voice message that omits confirmation of the function corresponding to the voice input from the user 11. This increases the conciseness of the response to the voice input. For example, if the control unit 21 determines in S103 that the proficiency level of a passenger who voice-inputted "I want to go to X" in S101 is above a threshold, it outputs a message from the speaker (output unit 25) as the first voice message, omitting confirmation of the function of the navigation device, such as "X has been set as the destination." In this way, the convenience can be further improved by making the response to a user familiar with the information processing device 20 concise.

[0043] After S104, the flow shown in Figure 4 ends.

[0044] In S105, the control unit 21 outputs a second voice message, different from the first voice message, as a response to the voice input received in S101. Specifically, the control unit 21 outputs a second voice message that includes confirmation about the function corresponding to the voice input from the user 11. For example, if the control unit 21 determines in S103 that the proficiency level of a crew member who voice-inputted "I want to listen to Y" in S101 is below a threshold, it outputs a second voice message from the speaker (output unit 25) that includes confirmation about the function of the audio equipment, such as "We will play Y," rather than a simple message such as "Understood."

[0045] After S105, the flow shown in Figure 4 ends.

[0046] As described above, in this embodiment, the control unit 21 controls functions in response to voice input from the user 11. The control unit 21 identifies the user 11. The control unit 21 adjusts the degree of conciseness of the response to the voice input based on the identified user 11.

[0047] According to this embodiment, the degree of conciseness of the response as output to the voice input can be changed to suit the user 11, thereby improving convenience.

[0048] A modified example of the operation of the information processing device 20 according to this embodiment will be described with reference to Figure 5. However, steps S201, S202, S204, and S205 are the same as steps S101, S102, S104, and S105 shown in Figure 4, respectively, so their explanation will be omitted.

[0049] In S203, the control unit 21 determines the relationship between user 11 and the owner of vehicle 12. Specifically, the control unit 21 determines the relationship between user 11 and the owner of vehicle 12 by referring to the usage data 50 as shown in Figure 3. For example, if user 11 is the owner of vehicle 12, the process proceeds to S204. For example, if user 11 is a registered user other than the owner, specifically a user registered as "spouse," "child," or "other" in the usage data 50, the process proceeds to S205. For example, if user 11 is "unregistered," that is, a user not registered in the usage data 50, the process proceeds to S206. As another example, the process may proceed to S205 only if user 11 is a family member of the owner, specifically a user registered as "spouse" or "child" in the usage data 50. If user 11 is neither the owner nor a family member, that is, if the user is registered as "other" in the usage data 50, or if the user is not registered in the usage data 50, the process may proceed to S206.

[0050] In S206, the control unit 21 outputs a third voice message, which is different from both the first and second voice messages, as a response to the voice input received in S101. Specifically, the control unit 21 outputs a third voice message that includes confirmation of the function corresponding to the voice input from the user 11 and additional explanation of that function. For example, if the control unit 21 determines in S202 that a crew member who voice-inputted "I want to listen to Y" in S201 is unidentifiable, that is, that the crew member is not registered in the usage status data 50, then in S203 the control unit 21 determines that the crew member is "unregistered". Then, as the third voice message, the control unit 21 outputs from the speaker (output unit 25) a message that includes confirmation of the function of the audio equipment, "We will play Y", followed by additional explanation of the function of the audio equipment, "You can request the next song while it is playing".

[0051] After S206, the flow shown in Figure 5 ends.

[0052] In this embodiment, the control unit 21 increases the conciseness of its response to voice input by outputting voice that omits confirmation of the function corresponding to the voice input from the user 11. However, the control unit 21 may increase the conciseness in other ways. Specifically, the control unit 21 may increase the conciseness by reducing the number of terms in the response message by one or more. For example, in S104 or S204, in response to the voice input "I want to go to X", the control unit 21 may output the message "X has been set as the destination" as a response, instead of the message "X has been set as the destination". Alternatively, the control unit 21 may increase the conciseness by outputting the response message in informal language rather than polite language. Furthermore, the control unit 21 may increase the conciseness by rephrasing expressions included in the response message with shorter alternative expressions.

[0053] As another modification of this embodiment, the control unit 21 may increase the degree of conciseness in response to voice input as the user's proficiency level increases. For example, the "number of uses" in the usage status data 50 may be used as the proficiency level, with a first threshold of 50 and a second threshold of 10. The control unit 21 outputs a first voice message if the user 11 has used the system 50 times or more, a second voice message if the user 11 has used the system 10 times or more but 49 times or less, and a third voice message if the user 11 has used the system 9 times or less. The process of outputting the first to third voice messages can be performed using the same process as steps S204 to S206 shown in Figure 5, respectively.

[0054] This disclosure is not limited to the embodiments described above. For example, two or more blocks described in the block diagram may be combined, or one block may be divided. Instead of executing two or more steps described in the flowchart in chronological order as described, they may be executed in parallel or in a different order, depending on the processing capacity of the device performing each step, or as necessary. Other modifications are possible without departing from the spirit of this disclosure. [Explanation of Symbols]

[0055] 10 Systems 11 users 12 vehicles 20 Information Processing Devices 21 Control Unit 22 Memory section 23 Communications Department 24 Input section 25 Output section 30 Server devices 40 Networks 50. Usage Data

Claims

1. A control unit that controls a function in response to voice input from a vehicle occupant, comprising: a control unit that identifies the occupant and adjusts whether to output a voice response to the voice input that omits confirmation of the function or a voice that includes such confirmation, based on the identified occupant; The aforementioned function is a function performed by equipment installed in the vehicle, The aforementioned confirmation is an information processing device, which is a statement representing the content of the execution of the aforementioned function.

2. The information processing device according to claim 1, wherein the control unit identifies the occupant, refers to usage data indicating the occupant's usage of the information processing device, determines the occupant's proficiency in using the information processing device, outputs a voice response omitting the confirmation if the determined proficiency is above a threshold, and outputs a voice response including the confirmation if the determined proficiency is below the threshold.

3. An information processing device comprising a control unit for controlling a function in response to voice input from a vehicle occupant, the control unit for identifying the occupant and adjusting whether to output a voice response to the voice input that omits confirmation of the function or a voice that includes such confirmation, depending on whether the identified occupant is the owner of the vehicle.

4. The computer controls functions in response to voice input from the vehicle's occupants, The computer identifies the crew member, The computer adjusts whether to output, based on the identified occupant, a voice response to the voice input that omits the confirmation of the function or a voice that includes the confirmation. Includes, The aforementioned function is a function performed by equipment installed in the vehicle, The aforementioned confirmation is a control method in which the wording represents the content of the execution of the aforementioned function.

5. The computer controls functions in response to voice input from the vehicle's occupants, The computer identifies the crew member, The computer adjusts whether to output a voice response to the voice input that omits the confirmation of the function, or a voice that includes the confirmation, depending on whether the identified occupant is the owner of the vehicle. A control method including

Images