Smart information terminal equipped with voice command, biometric authentication, and interactive character

Abstract

To solve the problem that operation procedures are complicated when a user activates an application or performs payment with an information terminal, and this complexity imposes a heavy burden on those who are unfamiliar with authentication or data input.SOLUTION: This invention relates to an information terminal including voice input, biometric authentication, and interactive character functions, the information terminal interpreting a voice command through natural language processing and automatically executing activation, logging-in, and payment of a target application. The character performs confirmation, correction, and approval of the content in a dialogue manner, thereby providing operation assistance and result guidance.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to voice input, natural language processing, biometric authentication, interactive user interfaces, application integration, and payment processing, and in particular to a smart information terminal that integrates voice commands and multiple types of biometric authentication and consistently supports application launch, authentication, operation, and payment through user assistance functions using interactive characters. [Background technology]

[0002] In recent years, voice input and biometric authentication have become commonplace in information terminals such as smartphones and smart speakers. Voice assistants such as Apple's Siri and Google's Google Assistant allow some functions to be executed by voice commands. In addition, biometric authentication functions such as facial recognition and fingerprint recognition are also being installed in terminals.

[0003] However, these functions are still limited and fragmented, and do not provide comprehensive support tailored to the user's context and situation. In particular, for elderly people and users with low IT literacy, there remain many situations where voice commands, application switching, payment operations, etc. are complicated and difficult to understand.

[0004] The object of the present invention is to provide an information terminal that goes beyond the conventional fragmented voice input functions and biometric authentication processing and allows users to intuitively and safely perform desired application operations and payment processing using only natural language voice commands.

[0005] Furthermore, the interactive character function aims to realize a natural interface with the user, providing step-by-step and contextual support for authentication procedures, app linking, payment confirmation, input assistance, etc.

[0006] This invention relates to an information terminal that integrates the functions of processing natural language commands based on voice input, identity verification through biometric authentication, and user assistance through an interactive character. This allows users to safely and intuitively perform operations such as launching applications, logging in, and making payments through natural voice dialogue, making it easy for even users unfamiliar with IT to perform various operations. In addition, by combining multiple biometric authentication methods (voiceprint, face, fingerprint), it is possible to achieve both security and operability, and the character function provides guidance, confirmation, and assistance according to the situation, reducing the burden on the user while enabling smooth application integration and payment processing. DETAILED DESCRIPTION OF THE INVENTION

[0007] The present invention includes a microphone for receiving natural language commands by voice input, a natural language processing module, and a command processing unit, and also includes a biometric authentication module capable of performing at least one of voiceprint authentication, face authentication, and fingerprint authentication.

[0008] In addition, the core of the service is an interactive character function for user assistance, which analyzes voice input to identify the target application, launch the application, log in, process payments, change settings, and assist with form entry, providing step-by-step assistance and guidance.

[0009] At each stage, the character interacts with the user to obtain confirmation, agreement, correction, and approval, ensuring a consistent user experience.

[0010] It authenticates users by identifying voice phrases and characteristics of their voice quality, and after authentication, it enables the automatic entry of login information and the setting of app linkages. Even if the target application is not linked, the character will guide the user through dialogue to obtain access permissions, encourage the entry of information, and execute setting changes, and in some cases automatically perform the processing, reducing the burden on the user.

[0011] Furthermore, the system is configured to support multiple users, and by storing and identifying individual voiceprints, faces, and fingerprint data, it is possible to dynamically switch operation permissions, payment restrictions, and app usage ranges for each user.

[0012] In addition, the system uses machine learning to accumulate information such as a user's past operation history, app usage trends, and command patterns, and predicts which applications are likely to be launched next, enabling pre-emptive processing to prepare for authentication and login in advance.

[0013] During each process, such as voice command processing, identity authentication, app operation, and payment processing, the character will provide step-by-step guidance on the current progress and check items, allowing the user to understand the situation and continue, interrupt, or correct the operation.

[0014] The character function interactively presents the personal information and payment method to be used when making payments or filling out forms based on voice commands, and then executes the process after obtaining correction instructions or final approval from the user.

[0015] The form is automatically filled in based on stored user information, and if any fields are missing, additional information is obtained through voice dialogue, and the form is automatically submitted after the input is complete.

[0016] It detects input fields and transitions on the application screen in real time, and if it determines that the user is stuck on an operation, it presents appropriate operation guides and auxiliary information in the form of a speech bubble based on the cursor position and the length of time the user has been idling.

[0017] In the configuration of the present invention, by linking with an external document creation application, template-based document creation and storage processes can also be completed with voice commands.

[0018] The character function allows users to store multiple profiles, and switch between voice tone, display style, and some of the corresponding actions according to their preferences.

[0019] Furthermore, various functions are provided as plug-in modules, and the scope of function activation and billing system can be dynamically controlled according to the user's contract status, frequency of use, attributes, etc.

[0020] According to the present invention, it is possible to realize voice commands, biometric authentication, app linkage, payment support, and operation assistance in an integrated and integrative manner.

[0021] The interactive character interface guides users through the entire operation flow naturally and safely, minimizing the burden on the user and preventing problems and operational errors.

[0022] Processing can be optimized and predicted based on each user's operation history, authentication information, and operation trends, leading to improved processing speed and response accuracy, and ultimately to increased user satisfaction.

[0023] In addition, it includes multiple layers of mechanisms that are difficult to imitate with conventional technology, such as multi-user identification, character switching control, and plug-in charge linkage design, providing high defensive capabilities against imitation and evasion designs. [Brief explanation of the drawings]

[0024] [Figure 1] A block diagram showing the functional configuration of an information terminal according to the present invention. [Figure 2] Flow diagram of authentication support and access control using character functions [Figure 3] An explanatory diagram showing an example of detecting input congestion and displaying a speech bubble by a character.

Claims

1. An information terminal equipped with a command processing function based on voice input, multiple types of biometric authentication functions, and an interactive character function for user assistance, wherein the character function interprets voice commands in natural language from the user, identifies the target application based on the command, and performs the launch process for the application, as well as the login process or payment process required to use the application by combining at least one or more of the user's voiceprint authentication, face authentication, and fingerprint authentication, and in the process of executing each of the above processes, confirms with, guides, or obtains approval from the user via an interactive character interface.

2. 2. The information terminal according to claim 1, wherein the character function performs identity authentication based on specific voice phrases, speech rhythms, or voice quality preset by the user, and, depending on the authentication results, performs link settings with target applications, automatic input of login information, or payment processing.

3. 3. An information terminal according to claim 1 or 2, characterized in that the character function, when the target application is not yet linked to the terminal, completes the link setting process by gradually guiding the user through a series of operations such as authentication procedures, access permission, information input, or setting changes required for link setting through voice dialogue with the user, or by automatically performing some of the processing.

4. An information terminal according to any one of claims 1 to 3, characterized in that the character function registers and manages the voice information, face information, and fingerprint information of each user in order to accommodate multiple users, identifies the speaker of voice input in real time, and dynamically switches the operating authority, payment limit, or application access settings corresponding to the identified speaker.

5. An information terminal according to any one of claims 1 to 4, characterized in that the character function predicts the application that the user is likely to use next based on the user's past operation history, frequency of application use, or voice command patterns, and prepares to launch the application, obtains login information, or performs personal authentication in advance.

6. In any one of claims 1 to 5, the character function of the information terminal is characterized in that it provides the user with information on the progress, completion status, or confirmation items by voice output or screen display at each stage of voice command processing, identity authentication, app operation, and payment processing, and controls the processing to continue, interrupt, or complete with the user's understanding and consent.

7. In any one of claims 1 to 6, the character function of the information terminal is characterized in that when performing form input or payment processing by the user's voice command, the character function accepts confirmation of the content, instructions for correction, or final approval of the content of the personal information or payment method to be used through voice dialogue with the user, and performs input, transmission, and payment in accordance with said instructions.

8. In any one of claims 1 to 7, the character function of the information terminal is characterized in that when performing input processing for an application or registration form, the character function automatically inputs pre-stored user information, and if there are any missing input items in the form, obtains additional information through voice dialogue with the user, and automatically performs input processing after the information has been obtained.

9. In any one of claims 1 to 8, the character function detects input items and transition statuses on the screen of a target application in real time while the user is operating the application, and provides corresponding support information sequentially by displaying a character or outputting voice, thereby providing the necessary input assistance or operation guidance without the user having to switch screens.

10. 10. An information terminal according to claim 9, wherein the character function detects a user's operation jam based on the contents of an input field, cursor position, input time stagnation, etc., even when the user is not speaking, and presents auxiliary information related to the operation in the form of a speech bubble.

11. An information terminal according to any one of claims 1 to 10, wherein the character function cooperates with an external document editing application in response to a user's voice command, automatically generates a document file based on a predetermined template, and edits and saves the document.

12. An information terminal according to any one of claims 1 to 11, characterized in that the character function holds a plurality of character profiles and changes at least a part of the tone of voice response, display interface, guidance procedure, or execution function in response to switching of the character.

13. In any one of claims 1 to 12, the information terminal is configured to selectively install or enable various functions as plug-in modules, and is characterized in that the scope of provision or billing system of each function is dynamically controlled depending on the user's contract status, frequency of use, or user attributes.

Images