Method executed by an information processing apparatus

Abstract

A method executed by an information processing device is provided. The object of the present invention is to improve a voice recognition-based function of a vehicle. The information processing device stores vehicle state information including position information in a case where an operation associated with a stop of a function activated by voice is performed on the function. The information processing device determines whether activation of the function is a false operation based on the vehicle state information and a current position at the time of activation of the function by voice.

Description

Technical Field

[0001] This invention relates to a method performed by an information processing device. Background Technology

[0002] Previously, voice recognition-based functions for vehicles were known. For example, Patent Document 1 discloses a technology in which, during the motion control of in-vehicle equipment, it is determined whether the occupant has uttered any emergency words, and if an emergency word is determined to have been uttered, a safety action of the in-vehicle equipment is executed.

[0003] Patent Document 1: Japanese Patent Application Publication No. 2016-203815 Summary of the Invention

[0004] We hope to improve the vehicle's voice recognition-based functions.

[0005] The present invention, which was made in view of this situation, aims to improve the voice recognition-based functionality of vehicles.

[0006] An embodiment of the present invention relates to a method executed by an information processing device, the method comprising the following steps: storing vehicle status information including location information when an operation associated with stopping a function activated by voice is performed; and determining, based on the vehicle status information and the current location, whether the activation of the function is a malfunction when the function is activated by voice.

[0007] Invention Effects

[0008] According to one embodiment of the present invention, the voice recognition-based functionality of a vehicle can be improved. Attached Figure Description

[0009] Figure 1 This is a block diagram illustrating the general structure of the information processing apparatus involved in this invention.

[0010] Figure 2 This is a flowchart illustrating the operation of the information processing device involved in this invention. Detailed Implementation

[0011] The embodiments of the present invention will be described below.

[0012] (Summary of the implementation method)

[0013] refer to Figure 1The structure of the information processing apparatus 10 according to this embodiment will be described. The information processing apparatus 10 is, for example, an in-vehicle device mounted on a vehicle, a server device that communicates with the vehicle, a personal computer (PC), a smartphone, or other computer or general-purpose or special-purpose electronic device. Furthermore, the information processing apparatus 10 may be composed of, for example, an in-vehicle device and a server device, or it may be composed of multiple devices, including a user-carried terminal device such as a smartphone.

[0014] First, an overview of this embodiment will be given; detailed information will be described later. When the information processing device 10 performs an operation associated with stopping a function activated via voice, it stores vehicle status information, including location information. When the function is activated via voice, the information processing device 10 determines, based on the vehicle status information and the current location, whether the activation of the function is a malfunction.

[0015] The activation of voice recognition-based functions may result in erroneous actions due to misdetection of environmental sounds, such as external sounds, as the registered user's voice. In contrast, according to this embodiment, when a function is activated by voice, it can be determined whether the activation is erroneous based on whether the function has been stopped in the vicinity of the current location in the past. Therefore, if the information processing device 10 determines that it is erroneous, it can stop the function without requiring the user to manually stop the function, thus improving the convenience of voice recognition-based functions for the user. Therefore, according to this embodiment, from the viewpoint of improving the convenience of voice recognition-based functions for the user, the voice recognition function of the vehicle can be improved.

[0016] Next, the structure of the information processing device 10 will be described in detail.

[0017] (Structure of an information processing device)

[0018] The information processing device 10 includes a communication unit 11, an output unit 12, an input unit 13, a storage unit 14, a control unit 15, and a sensor unit 16.

[0019] The communication unit 11 includes one or more communication interfaces connected to a network. These communication interfaces may correspond to, for example, fourth-generation (4G) or fifth-generation (5G) mobile communication standards, but are not limited to these. The communication unit 11 receives information for the operation of the information processing device 10 and transmits information obtained through the operation of the information processing device 10. The communication unit 11 enables the information processing device 10 to communicate with servers or the like constituting this embodiment via a network.

[0020] The output unit 12 includes one or more output devices for outputting information. These output devices may be, for example, a display that outputs image information or a speaker that outputs sound information, but are not limited to these. Alternatively, the output unit 12 may also include an interface for connecting an external output device.

[0021] The input unit 13 includes one or more input devices for detecting user input operations. These input devices may be, for example, physical keys, electrostatic capacitive keys, a mouse, a touch panel, a touchscreen integrated with the display of the output unit 12, or a microphone, but are not limited to these. Alternatively, the input unit 13 may also include an interface for connecting external input devices.

[0022] The storage unit 14 includes one or more memories. These memories may be, for example, semiconductor memories, magnetic memories, or optical memories, but are not limited to these. Each memory included in the storage unit 14 may function as a main storage device, an auxiliary storage device, or a cache memory. The storage unit 14 stores any information for the operation of the information processing device 10. Furthermore, for example, the storage unit 14 may store system programs, application programs, and embedded software. For example, information stored in the storage unit 14 can be updated via information obtained from a network through the communication unit 11. Additionally, in this embodiment, the storage unit 14 stores vehicle status information when an operation associated with stopping a function initiated via voice is performed.

[0023] The control unit 15 includes at least one processor, at least one programmable circuit such as a field-programmable gate array (FPGA), at least one application-specific integrated circuit (ASIC), or any combination thereof. The processor is a general-purpose processor such as a central processing unit (CPU) or a graphics processing unit (GPU), or a dedicated processor specifically designed for particular processing. The control unit 15 controls the various parts of the information processing device 10 while performing processing related to the operation of the information processing device 10.

[0024] The sensor unit 16 may include, for example, any sensor used to acquire driving information, such as a steering angle sensor, an acceleration sensor, a vehicle speed sensor, a position sensor, and a gyroscope sensor. The sensor unit 16 may also include, for example, a Global Positioning System (GPS) receiver. Furthermore, the sensor unit 16 may include, for example, a camera capable of capturing information about the interior of the vehicle to determine the number of passengers.

[0025] (The first operation flow of the information processing device)

[0026] refer to Figure 2 (a) The first operation of the information processing apparatus 10 according to this embodiment will be described.

[0027] S100: The control unit 15 of the information processing device 10 detects that an operation associated with stopping the function has been performed on the function that was started by voice.

[0028] Specifically, the control unit 15 detects that a function that can be activated via voice recognition has been started. Furthermore, the control unit 15 monitors whether the user performs any operation associated with stopping the function. If such an operation is detected, the process proceeds to S101. Alternatively, the control unit 15 may, within a first predetermined period, only cause the process to proceed to S101 if an operation associated with stopping the function is performed. The first predetermined period may also vary depending on the specific function and can be modified.

[0029] "Operations associated with stopping a function" can include, for example, pressing the function's stop button to put the function into the background, or any operation to stop the function, such as canceling the function via voice command. Furthermore, the operations associated with stopping a function can vary depending on the specific function.

[0030] S101: The control unit 15 stores vehicle status information, including location information.

[0031] Specifically, if it is determined in S100 that the system has entered S101, the control unit 15 uses the sensor unit 16 to acquire the vehicle's location information. Then, the control unit 15 stores the vehicle status information, which includes a unique function ID that identifies the function and the location information, in the storage unit 14.

[0032] In addition to the aforementioned function ID and location information, the "vehicle status information" also includes information related to the vehicle's status during the execution of S101. This "vehicle status information" may include, for example, the vehicle's status during movement or rest, and the number of passengers acquired using sensor unit 16. Furthermore, if storage unit 14 exists on a server managing multiple vehicles, the vehicle status information may include a vehicle ID used to uniquely identify the vehicle. The vehicle status information may also include date and time information indicating the date and time the operation was performed.

[0033] The "Function ID" can be any unique combination of letters and numbers, or it can be a function name uniquely identified by hiragana, katakana, kanji, or numerals. Similarly, the "Vehicle ID" can be any unique combination of letters and numbers, or it can be a function name uniquely identified by hiragana, katakana, kanji, or numerals.

[0034] (Second action flow of the information processing device)

[0035] refer to Figure 2 (b) The second operation of the information processing apparatus 10 according to this embodiment will be described.

[0036] S200: The control unit 15 detects that the function is activated by voice.

[0037] Specifically, if a function is activated via voice, the control unit 15 searches whether the function ID of this function matches any of the multiple vehicle status information stored in the storage unit 14. If a matching status information is found, the process proceeds to S201. If no matching is found, the process ends. Furthermore, if the storage unit 14 is located on a server, the control unit 15 may determine whether any vehicle ID among the multiple vehicle status information matches its own vehicle's vehicle ID, or it may choose not to make this determination. Moreover, the control unit 15 may end the process if the function activated via voice is a specific function. For example, if the function is related to emergency safety, the control unit 15 may end the process. This is because, in this case, safety is prioritized over the inconvenience of accidental user operation.

[0038] S201: The control unit 15 determines whether the activation of this function is a malfunction based on the vehicle status information and the current location.

[0039] Specifically, the control unit 15 determines whether the location information of the vehicle status information searched in S200 is consistent with or within a specified distance of the current location information obtained by the sensor unit 16. If they are consistent or within the specified distance, the control unit 15 determines that the activation of this function is a malfunction. In addition, the specified distance may vary depending on the function and may also be changed.

[0040] Furthermore, if the vehicle status information includes date and time information, the control unit 15 can further determine whether the activation of the function is a malfunction based on the current date and time. Specifically, the control unit 15 acquires the current date and time simultaneously with the location information. Moreover, if the location information of the vehicle status information matches the current location information or is within a specified distance, the control unit 15 determines whether the date and time information of the vehicle status information searched in S200 matches the month, day, or hour of the current date and time, or is within a second specified period. If they match or are within the second specified period, the control unit 15 determines that the activation of the function is a malfunction. Additionally, the second specified period may vary depending on the function and may be changed. Alternatively, the control unit 15 can determine whether the date and time information of the vehicle status information matches the weekday of the current date and time. Furthermore, the control unit 15 can determine whether the date and time information of the vehicle status information and the current date and time are both weekends or holidays, or whether it is a weekday. In any case, if they match or correspond, the control unit 15 can determine that the activation of the function is a malfunction.

[0041] Furthermore, if the vehicle status information includes passenger number information, the control unit 15 can further determine whether the activation of this function is a malfunction based on the current passenger number. Specifically, the control unit 15 acquires the passenger number using the sensor unit 16 while acquiring the location information. Moreover, if the location information of the vehicle status information matches the current location information or is within a specified distance, the control unit 15 determines whether the passenger number information of the vehicle status information searched in S200 matches the current passenger number. If they match, the control unit 15 determines that the activation of this function is a malfunction. Alternatively, the control unit 15 can determine whether the passenger number information of the vehicle status information and the current passenger number are both the specified number, or whether they are more than or less than the specified number. If they are more than or less than the specified number, the control unit 15 can determine that the activation of this function is a malfunction. Furthermore, the specified number can vary depending on the function and can be changed.

[0042] Furthermore, the control unit 15 can determine whether the activation of this function is a malfunction based on the existence of a predetermined number or more vehicle status information corresponding to the above conditions. For example, if there are three or more vehicle status information entries where the current location information matches the location information, or vehicle status information entries within a predetermined distance, the control unit 15 can determine that the activation of this function is a malfunction. In addition, the predetermined number may vary depending on the function and may also be changed.

[0043] Although the invention has been described with reference to the accompanying drawings and embodiments, those skilled in the art will understand that various modifications and variations can be made based on the invention. Therefore, it should be noted that these modifications and variations are included within the scope of the invention. For example, the functions included in each structural part or step can be reconfigured in a logically consistent manner, and multiple structural parts or steps can be combined into one or divided.

[0044] For example, in the above embodiments, it is also possible to implement an embodiment in which the structure and operation of the information processing device 10 are distributed among multiple computers capable of communicating with each other. For example, in the case where the information processing device 10 is composed of an in-vehicle device and a server, the in-vehicle device can perform some operations, and the server can perform operations that the in-vehicle device does not perform.

[0045] Furthermore, for example, in the above embodiment, if the activation of the function is determined to be a malfunction in S201, the control unit 15 can stop the function.

[0046] Alternatively, if the activation of the function is determined to be a malfunction in S201, the control unit 15 may suggest to the user that the function be stopped. Furthermore, if the user accepts the suggestion, the control unit 15 may stop the function.

[0047] Specifically, the control unit 15 may, for example, use the speaker of the output unit 12 to output any voice message to the user, such as "Was the start of this function due to a malfunction? If so, please answer 'Yes'; if not, please answer 'No'," to stop the function. Furthermore, if the user answers "Yes," the control unit 15 stops the function. If the user answers "No," the control unit 15 does not stop the function.

[0048] Furthermore, in the aforementioned variation, if the user does not accept the suggestion, the control unit 15 can store the suggestion cancellation information in the storage unit 14. Additionally, the suggestion cancellation information may include information identical to the vehicle status information. In this case, the control unit 15 can determine whether the activation of the function is a malfunction based on the difference between the number of vehicle status information items and the number of suggestion cancellation information items in S201. Specifically, the control unit 15 acquires the number of vehicle status information items and the number of suggestion cancellation information items corresponding to each condition in S201. Moreover, if the difference between the number of vehicle status information items and the number of suggestion cancellation information items is greater than or equal to a predetermined number, the control unit 15 determines that the activation of the function is a malfunction.

[0049] Furthermore, for example, it is also possible to implement a general-purpose computer as the information processing apparatus 10 according to the above embodiments. Specifically, a program containing processing content for implementing the various functions of the information processing apparatus 10 according to the above embodiments is stored in the memory of a general-purpose computer, and the program is read and executed by a processor. Therefore, the present invention can also be implemented as a program executable by a processor or as a non-transitory computer-readable medium storing the program.

[0050] Symbol Explanation

[0051] 10-Information processing device, 11-Communication unit, 12-Output unit, 13-Input unit, 14-Storage unit, 15-Control unit, 16-Sensor unit.

Claims

1. A method performed by an information processing device, the method being characterized by comprising the following steps: In the event that an operation associated with stopping a function activated via voice is performed, vehicle status information including location information is stored; and when the function is activated via voice, the vehicle status information and the current location are used to determine whether the activation of the function is a malfunction.

2. The method according to claim 1, characterized in that, It also includes the following steps: If the action is determined to be a malfunction, the function will be stopped.

3. The method according to claim 1, characterized in that, The vehicle status information also includes date and time information. When the function is activated by voice, the information processing device further determines, based on the current date and time, whether the activation of the function is a malfunction.

4. The method according to claim 1, characterized in that, The vehicle status information also includes passenger information. When the function is activated by voice, the information processing device further determines, based on the current number of passengers, whether the activation of the function is a malfunction.

5. The method according to claim 1, characterized in that, If, during a first predetermined period, the information processing device performs an operation associated with stopping the function activated by voice, it stores the vehicle status information including the location information.

Images