System

Abstract

A system is provided.SOLUTION: A system for making a contract for a product or a service via a network accessible by a user, comprising: means for receiving an access request from a user terminal and displaying information on a contract product; means for providing customer support using generative artificial intelligence and guiding selection of a contract form or a plan; means for performing electronic identity verification in order to perform identity verification of the user; and means for storing contract information in a database and transmitting a contract completion notification to the user terminal.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Conventional mobile phone contract procedures required visiting a shop, which was time-consuming and labor-intensive. Even when completing the contract procedures at home, numerous documents had to be prepared and mailed, making the process cumbersome. Furthermore, customer support was handled by a staff member, leaving issues with speed and accuracy. These factors created a high barrier to entry for users. Therefore, there is a need for a method that allows users to complete the mobile phone contract procedures quickly and easily, whether at a shop or at home. [Means for solving the problem]

[0005] This invention proposes a system for entering into contracts for products and services via a user-accessible network. The system includes means for accepting access requests from a user terminal and displaying information about the contracted products. It also includes means for providing customer support using generative artificial intelligence and guiding the selection of contract types and plans. To verify the user's identity, the system includes means for performing electronic identity verification, analyzing the results of the electronic identity verification, and proceeding with the contract procedure. Furthermore, by including means for storing contract information in a database and sending a contract completion notification to the user terminal, the system enables users to easily complete the contract procedure from home or a shop. This system eliminates the complexity of conventional procedures and provides fast and accurate contract procedures.

[0006] A "user terminal" is a device that a user accesses via a network and uses to carry out contract procedures.

[0007] "Generative AI" is AI that generates documents in response to user questions or requests based on pre-learned data and provides appropriate answers.

[0008] "Customer Support" means assistance and guidance provided to users to facilitate the contract process, including chat or voice support.

[0009] "Electronic identity verification" refers to an electronic verification method used to verify the identity of a user in an online contract transaction.

[0010] A "database" is an information structure for efficiently storing, managing, and retrieving data collected within a system.

[0011] "Information about contracted products" is detailed information about products and services that a user contracts for, such as mobile phone plans and options.

[0012] An "access request" is a request sent when a user attempts to connect to a system over a network.

[0013] "Contract information" is data that includes the product or plan that the user has contracted for, as well as all necessary information related to it. [Brief explanation of the drawings]

[0014] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0015] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0016] First, the terms used in the following description will be explained.

[0017] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0018] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0019] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0020] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0021] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0022] [First embodiment]

[0023] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0024] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0025] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0026] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0027] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0029] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0030] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0031] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0032] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0033] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0034] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0035] The present invention relates to a system for contracting for goods and services over a user-accessible network. The system is implemented by the following operations.

[0036] First, a user uses a device to access a mobile phone carrier's website or app via the network from a shop or home. The device receives the access request from the user and displays the mobile phone carrier's home screen.

[0037] Next, the user selects customer support provided by generative artificial intelligence (AI). The device allows the user to select chat or voice support as the AI ​​support format, and the AI ​​begins providing guidance based on the selected format. The AI ​​guides the user through the contract type, plan selection, and various procedures. The user specifies the desired plan and options through questions and selections. The AI ​​explains the features and benefits of the selected plan and answers the user's questions as needed.

[0038] When proceeding with the contract procedure, eKYC (electronic identity verification) is used. The terminal instructs the user to upload identification documents (e.g., driver's license, My Number card). The user uploads the identification documents to the terminal, and the image data is sent to the server. The server analyzes the received image data and automatically collates the identification information. The result of the collation is sent back from the server to the terminal and notified to the user.

[0039] After eKYC is complete, the user checks the contract details on the final confirmation screen. If there are no problems with the contract, the user presses the final confirmation button to confirm the contract. The server saves the contract information in the database and notifies the terminal that the contract has been successfully completed. The terminal displays this notification to the user and displays the message "The contract has been completed."

[0040] For example, when a user signs up for a mobile phone at home, the process proceeds as follows.

[0041] Example 1: Procedures at home

[0042] The user accesses the mobile phone company's website on their computer and selects chat-style AI support. The AI ​​asks questions about the plan and options they wish to sign up for, and the user selects a family plan. As they go through the contract process, eKYC is carried out using their driver's license. The user uploads an image of their driver's license, which the server analyzes to verify their identity. The user checks the contract details on the final confirmation screen and presses the final confirmation button to complete the contract. The system displays a notification that "the contract has been completed."

[0043] Example 2: Shop procedure

[0044] The user uses a dedicated terminal in the shop to select voice-based AI support. The AI ​​asks questions about the plan via voice, and the user selects the plan they want. eKYC is performed using the My Number card, and identity verification is completed. The user checks the contract details and presses the final confirmation button to complete the contract. The system displays a notification that the contract has been completed.

[0045] This system allows customers to complete the contract procedure quickly and easily from a store or from home, and by utilizing AI, it is possible to provide accurate and consistent customer support.

[0046] The processing flow will be explained below.

[0047] Step 1:

[0048] A user accesses a mobile phone carrier's website or app via the network from a shop or home. The device receives the access request from the user and displays the home screen.

[0049] Step 2:

[0050] A user selects generative artificial intelligence (AI) customer support on a website or app. The device presents the user with the option to choose between chat or voice support. The user selects the format.

[0051] Step 3:

[0052] The device will launch AI support based on the selected format. The AI ​​will display or speak initial questions about contract type and plan selection. The user will answer the questions and specify the desired plan and options.

[0053] Step 4:

[0054] The AI ​​explains the details and features of the appropriate plan based on the user's answers. The user asks questions and the AI ​​responds. The user finally selects the plan they want.

[0055] Step 5:

[0056] The contract procedure will proceed based on the plan selected by the user. The terminal will notify the user of the need for identity verification and explain the procedure for electronic identity verification (eKYC).

[0057] Step 6:

[0058] The device instructs the user to upload an identification document (e.g., driver's license, My Number card). The user uploads an image of the identification document to the device.

[0059] Step 7:

[0060] The device sends the uploaded image data to the server. The server analyzes the received image data and automatically collates it with the identity verification information. The server then returns the collation results to the device.

[0061] Step 8:

[0062] The terminal notifies the user of the result of the verification. The user confirms that identity verification has been completed and selects to continue the contract procedure.

[0063] Step 9:

[0064] The user checks the contract details on the final confirmation screen. If there are no problems with the contract, the user presses the final confirmation button to confirm the contract. The server saves the contract information in the database.

[0065] Step 10:

[0066] The server notifies the terminal that the contract has been successfully completed. The terminal displays the message "Contract completed" to the user.

[0067] Example 1

[0068] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0069] Conventional systems require users to manually complete multiple steps when signing up for products or services, making the process time-consuming and cumbersome. Furthermore, the analog identity verification process makes it difficult to prevent fraudulent applications. Furthermore, customer support is often inconsistent, resulting in an unsatisfactory experience for users.

[0070] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0071] In this invention, the server includes: means for accepting access requests from a user terminal and displaying information about the contracted product; means for providing customer support using generative artificial intelligence and guiding the selection of contract type and plan; means for conducting electronic identity verification to verify the user's identity; means for analyzing images of verification documents uploaded by the user and verifying identity verification information; means for storing contract information in a database and sending a contract completion notification to the user terminal; and means for the generative artificial intelligence to interact with the user in real time. This allows users to easily complete complicated procedures and quickly complete contract procedures while preventing fraudulent applications. In addition, consistent customer support using AI is expected to improve the user experience.

[0072] "User terminal" is a general term for devices that are connected to a network and used to process contracts for products and services.

[0073] An "access request" is a request sent from a user terminal to a server via a network, requesting the display of a specific web page or data.

[0074] "Information about contracted products" is detailed data about products and services that can be selected by the user, including plan contents, fees, features, and the like.

[0075] "Generative artificial intelligence" refers to AI technology that is a program for interacting with users and has a guide function for handling contract procedures and inquiries.

[0076] "Customer support" refers to the assistance and guidance provided to users when selecting or subscribing to products or services, including answering questions and explaining procedures.

[0077] "Electronic identity verification" is a procedure for verifying a user's identity in an online environment, a process that involves the submission of verification documents and the analysis of that data.

[0078] "Verification documents" are official documents submitted to verify the identity of a user, and include driver's licenses and identification cards.

[0079] "Analysis" refers to the procedure for processing the image data of the verification document to extract and verify the necessary information.

[0080] "Matching" is the process of comparing and matching the data provided by the user with existing database information based on the information obtained from the analysis.

[0081] "Contract information" includes all data related to the contract, such as the plan and options selected by the user, personal information, etc.

[0082] A "database" is a system for systematically storing and managing data such as contract information.

[0083] The "contract completion notification" is a notification message sent from the server to notify the user that the contract procedure has been successfully completed.

[0084] "Real-time" refers to a state in which interactions with users and information processing are carried out immediately, and is characterized by a response without delay.

[0085] The present invention relates to a system for contracting for goods and services over a user-accessible network. The system is implemented by the following operations.

[0086] First, a user uses their own device (e.g., a PC or smartphone) to access a service provider's website or application via a network from a shop or home. The device receives the user's access request and displays the service provider's home screen.

[0087] Next, the user can select customer support using generative artificial intelligence (AI). The device prompts the user to choose chat or voice support as the AI ​​support format. Based on the selection, the AI ​​guides the user in selecting the appropriate contract type and plan. For example, if the user answers "Family plan" to the question "Which contract plan would you like to choose?", the AI ​​will explain the details and benefits of that plan.

[0088] As the contract procedure progresses, user identity verification is a necessary process for electronic user verification (eKYC). The terminal instructs the user to upload identification documents (e.g., driver's license or other official document). The user follows the instructions and uploads the identification documents to the terminal. The image data is then sent to the server. The server analyzes the received image data and extracts character information using, for example, OCR (optical character recognition) technology (e.g., OpenCV or Tesseract), and collates it with the identity verification information. The result of this collation is sent from the server back to the terminal and notified to the user.

[0089] After eKYC is complete, the user confirms the contract details on the final confirmation screen. When the user presses the final confirmation button to confirm the contract, the contract information is sent to the server. The server saves the contract information in the database and notifies the terminal that the contract has been successfully completed. The terminal displays a message to the user saying, "The contract has been completed."

[0090] For example, here are some specific examples:

[0091] Example 1: Procedures at home

[0092] Operation steps:

[0093] 1. The user accesses the service provider's website on their computer and the home screen appears.

[0094] 2. The user selects chat-style AI support.

[0095] 3. The AI ​​asks questions about the plan and options you want, and the user selects a family plan.

[0096] 4. The device prompts the user to upload a driver's license, and the user uploads an image. The server analyzes it and returns the match result.

[0097] 5. The user presses the final confirmation button and a notification stating "The contract has been completed" appears on the device.

[0098] Example 2: Shop procedure

[0099] Operation steps:

[0100] 1. The user accesses the home screen using a dedicated terminal in the shop.

[0101] 2. The user selects AI support in the form of voice support.

[0102] 3. The AI ​​will ask questions about the plan via voice, and the user will select the desired plan.

[0103] 4. The terminal instructs the user to upload the My Number card, and the user uploads the image. The server analyzes it and returns the matching results.

[0104] 5. The user presses the final confirmation button and a notification stating "The contract has been completed" appears on the device.

[0105] Example prompt sentence:

[0106] "I would like to sign up for a family cell phone plan at home. I would like to use my driver's license as identification. Please guide me through the contract process."

[0107] This system allows users to complete contract procedures quickly and easily from a shop or at home, and utilizes AI to provide consistent customer support and improve the user experience.

[0108] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0109] Step 1:

[0110] Users use their devices (PCs or smartphones) to access the service provider's websites and applications.

[0111] Input: The user enters a URL in a web browser or app and submits an access request.

[0112] Output: The device sends an HTTP request and the server returns a response such as HTML or JSON.

[0113] Specific operation: The service provider's home screen is displayed on the device.

[0114] Step 2:

[0115] Users can choose to receive customer support through generative artificial intelligence (AI).

[0116] Input: User selects support option (chat or voice) on the home screen.

[0117] Output: The device launches the selected AI support module.

[0118] Specific operation: The chatbot interface or voice input screen will be displayed on the device.

[0119] Step 3:

[0120] AI guides users in choosing contract types and plans.

[0121] Input: The user answers the AI's questions and specifies the desired contract plan and options.

[0122] Data processing: AI analyzes the user's answers and suggests an appropriate plan.

[0123] Output: The AI ​​explains the plan's features and benefits to the user.

[0124] Specific behavior: For example, the AI ​​asks, "Which contract plan would you like?" and the user answers, "Family plan."

[0125] Step 4:

[0126] Initiate the electronic know your customer (eKYC) process.

[0127] Input: The AI ​​prompts the user to upload their identification document. The user uploads an image of their identification document (e.g., driver's license).

[0128] Output: The device sends the image data to the server.

[0129] Specific operation: The user takes a photo of the verification document using the device's camera function and uploads it.

[0130] Step 5:

[0131] The server analyzes the image of the verification document received and verifies the identity verification information.

[0132] Input: The server receives the image data and extracts the text information using OCR technology (e.g., OpenCV or Tesseract).

[0133] Data calculation: The server checks the extracted information against an existing database.

[0134] Output: The matching result is returned to the terminal.

[0135] Specific operation: The server analyzes the contents of the verification document (name, address, etc.) and checks whether it matches the information registered in the database. The result of the match is notified to the terminal.

[0136] Step 6:

[0137] The user confirms the contract details on the final confirmation screen.

[0138] Input: The user confirms the match results sent from the server.

[0139] Output: The device displays a final confirmation screen.

[0140] Specific operation: The user confirms the contract details and presses the "Complete contract" button.

[0141] Step 7:

[0142] The contract information is sent to the server to complete the contract.

[0143] Input: When the user presses the final confirmation button, the contract information is sent to the server.

[0144] Output: The server saves the contract information to the database and sends a contract completion notification.

[0145] Specific operation: The contract information is stored in the database and the message "Contract completed" is displayed on the terminal.

[0146] In this way, this system allows users to easily complete complicated procedures, preventing fraudulent applications and quickly completing contract procedures. Furthermore, the use of AI will enable consistent customer support and an improved user experience.

[0147] (Application example 1)

[0148] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0149] One issue facing modern electronic payment services is the lack of a process that allows users to complete contract procedures quickly and easily. Conventional systems require users to visit a store in person, which takes time and effort. Furthermore, the electronic customer verification (eKYC) process is complicated, making it difficult for users to smoothly complete a contract. Furthermore, there is a lack of support using generative artificial intelligence, which can make it difficult for users to select an appropriate plan.

[0150] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0151] In this invention, the server includes means for receiving access requests from a user terminal and displaying information about the contracted product, means for providing customer support using generative artificial intelligence and guiding the selection of a contract type and plan, means for conducting electronic identity verification to verify the user's identity, means for analyzing the results of the electronic identity verification and proceeding with the contract procedure, means for saving the contract information in a database and sending a contract completion notification to the user terminal, means for using a smart device as the user terminal and conducting the contract procedure for the electronic payment service on the device, means for the user to select AI support in chat format or voice format and respond to the input based on a generative AI model, and means for receiving images of confirmation documents uploaded by the user and analyzing the images to verify the user's identity, thereby enabling the user to quickly and easily complete the contract procedure for the electronic payment service.

[0152] A "user terminal" is a device used by a user, and is equipment that can carry out contract procedures for products and services via a network.

[0153] An "access request" is a request sent from a user terminal to a server to initiate processing for displaying information about a contracted product.

[0154] "Generative AI" is an AI that independently interacts with users and guides them in selecting contract types and plans.

[0155] "Electronic identity verification" is a procedure that allows users to verify their identity online by analyzing images of verification documents and verifying identity information.

[0156] The "contract procedure" is a procedure in which the user confirms the necessary information based on the contract type and plan selected by the user and finally finalizes the contract.

[0157] A "database" is an information system for efficiently storing and managing contract information and user information.

[0158] The "contract completion notification" is a message that notifies the user that the contract procedure has been successfully completed.

[0159] "Smart devices" are digital devices with advanced computing power and communication functions, such as smartphones and smart glasses.

[0160] "Chat format" is a format in which users interact with generative artificial intelligence in a text-based manner.

[0161] The "voice format" is a format in which the user interacts with the generative artificial intelligence using voice.

[0162] A "generative AI model" is an artificial intelligence algorithm or program that automatically generates a response based on given information.

[0163] "Verification documents" are official documents required to verify the identity of a user, such as a driver's license or My Number card.

[0164] "Image analysis" is a technology that processes images of uploaded verification documents, recognizes their contents, and extracts information.

[0165] MODE FOR CARRYING OUT THE INVENTION

[0166] The program for the system for implementing this invention comprises the following means: A user uses a smart device (such as a smartphone or smart glasses) to complete contract procedures for a product or service. The server accepts an access request from the user terminal and displays information about the contracted product. In doing so, it utilizes a generative AI model to provide the user with appropriate guidance.

[0167] As an interface, users can choose chat or voice AI support. User input generates a response in real time based on the generative AI model. For example, if a user inputs, "I would like to sign up for a new credit card," the AI ​​will respond, "What kind of credit card plan would you like?" In this way, users can proceed with the contract process in an interactive manner.

[0168] The server then performs electronic identity verification (eKYC) to verify the user's identity. The user uses a smart device to upload an image of their identification document (such as a driver's license or My Number card). The image is sent to the server, which performs image analysis using OpenCV and the face_recognition library. The resulting identity verification information is then matched, facilitating electronic identity verification.

[0169] Once identity verification is complete, the server will provide instructions to the user to proceed with the contract. The contract information will be saved in the database, and the user will finally receive a contract completion notification. For example, a prompt such as "I'm interested in the family plan" can be used, and after confirmation, a message will be displayed saying "Contract completed."

[0170] Specific examples of main processing flows

[0171] 1. Access request from user: The user accesses the application on a smart device and sends a request to the server.

[0172] 2. Displaying contracted product information: The server displays contracted product information on the user terminal.

[0173] 3. Guided by a generative AI model: The user enters, "I would like to sign up for a new credit card," and the generative AI model responds, "What kind of credit card plan would you like?"

[0174] 4. Electronic Identity Verification (eKYC): The user uploads an image of their driver's license using a smart device, and the server performs image analysis using OpenCV and the face_recognition library to verify the user's identity.

[0175] 5. Contract procedure progress: Based on the analysis results, the server proceeds with the contract procedure and saves the contract information in the database.

[0176] 6. Contract completion notification: After the user makes a final confirmation, the server sends a notification to the user terminal stating that the contract has been completed.

[0177] Prompt Sentence Examples

[0178] I want to apply for a new credit card.

[0179] "Please tell me more about the women's plan."

[0180] "I'm interested in a family plan."

[0181] The system allows users to quickly and easily complete contract procedures for electronic payment services using their smart devices, and utilizes generative AI models to provide appropriate and consistent customer support.

[0182] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0183] Step 1:

[0184] The user terminal accesses the contract application. The user launches the contract application using a smart device such as a smartphone or smart glasses. The terminal sends an access request to the server. This request includes the user's identification information.

[0185] Step 2:

[0186] The server accepts the access request. The server analyzes the received access request and retrieves information about the contracted product from the database. The information about the contracted product is then displayed on the user's device. At this stage, the generative artificial intelligence (AI) is ready to support the user.

[0187] Step 3:

[0188] Users can choose chat or voice support from the generative AI model. Users select "chat" or "voice" and type or speak questions about their desired contract product or service plan.

[0189] Step 4:

[0190] The server passes the input to the generative AI model, which generates a response. The server sends the user's input as a prompt to the generative AI model, which generates an appropriate response. For example, if the user enters, "I would like to sign up for a new credit card," the AI ​​replies, "What kind of credit card plan would you like?"

[0191] Step 5:

[0192] The user selects the desired contract plan. The user is guided by the generative AI model to select the contract type and plan. The selected information is sent to the server, which determines the next step based on the contract plan.

[0193] Step 6:

[0194] The server instructs the user to start electronic identity verification (eKYC), and the user uses a smart device to upload an image of a verification document such as a driver's license or My Number card.

[0195] Step 7:

[0196] The server receives the uploaded image of the verification document and performs image analysis. The server uses OpenCV and the face_recognition library to analyze the received image. Specifically, it performs facial recognition and character recognition (OCR) in the image to extract identity verification information. Based on this analysis, it compares it with existing information in the database.

[0197] Step 8:

[0198] The server notifies the user of the results of the electronic identity verification. If the analysis is successful, the server sends the user a message saying "Identity verification completed." If the analysis is unsuccessful, the server displays the message "Identity verification failed. Please try again."

[0199] Step 9:

[0200] The user performs a final confirmation and completes the contract procedure. After identity verification is complete, the server displays a final confirmation screen for the contract details. The user confirms the contract details and presses the "Final Confirmation" button.

[0201] Step 10:

[0202] The server saves the contract information in a database and sends a contract completion notice to the user. The server saves the final confirmation information in a database and notifies the user that the contract has been successfully completed. The message "The contract has been completed" is displayed on the user's terminal.

[0203] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0204] The present invention provides a system for providing customer support using generative artificial intelligence and an emotion engine when a user makes a contract for a product or service over a network. This system is implemented by the following operations.

[0205] First, a user accesses a mobile phone carrier's website or app via the network from a shop or home using a device. The device receives the access request from the user and displays the home screen.

[0206] Next, the user selects customer support via generative artificial intelligence (AI). The device presents the user with the option to choose between chat or voice support. Once the user selects the format, the device activates the AI ​​and begins guiding them based on the selected format.

[0207] The AI ​​guides users through the process of selecting a contract type and plan, as well as various procedures. Users specify the plan and options they want through questions and selections. The AI ​​explains the features and benefits of the selected plan and answers any questions the user may have, if necessary.

[0208] At this time, an emotion engine runs in parallel, analyzing the user's emotions in real time. The emotion engine analyzes the user's emotional data acquired through chat and voice support, and dynamically adjusts the AI's response content based on the user's emotions.

[0209] When proceeding with the contract procedure, electronic identity verification (eKYC) is used. The terminal instructs the user to upload identification documents (e.g., driver's license, My Number card). The user uploads the identification document, and the image data is sent to the server. The server analyzes the received image data and automatically collates the identification information. The server returns the result of the collation to the terminal and notifies the user.

[0210] After eKYC is complete, the user checks the contract details on the final confirmation screen. If there are no problems with the contract, the user presses the final confirmation button to confirm the contract. The server saves the contract information in the database and notifies the terminal that the contract has been successfully completed. The terminal displays this notification to the user and displays the message "The contract has been completed."

[0211] A specific example is given below.

[0212] Example 1: Procedures at home

[0213] The user accesses the mobile phone company's website from their computer at home. The user selects chat-style AI support, and the AI ​​asks questions about the plan and options they wish to sign up for. The user selects a family plan and proceeds with the contract procedure. eKYC is performed using a driver's license, and the user uploads an image of the license. The server analyzes the image to verify the user's identity, and the contract details are confirmed on the final confirmation screen. When the user presses the final confirmation button to confirm the contract, the system displays a notification that "the contract has been completed." At this time, the emotion engine analyzes the user's emotions in real time and adjusts the AI's response to provide the user with the most appropriate support.

[0214] Example 2: Shop procedure

[0215] The user selects voice-based AI support using a dedicated terminal in the shop. The AI ​​asks questions about plans via voice, and the user selects the plan they want. eKYC is performed using the My Number card, and the user uploads an image. The server analyzes the image and verifies the user's identity. The user confirms the contract details on the final confirmation screen, and presses the final confirmation button to complete the contract. The system displays a notification that the contract has been completed. The emotion engine analyzes the user's emotional changes and triggers appropriate responses and responses, providing high-quality support to the user.

[0216] This system allows customers to complete the contract process quickly and easily from home or in a store, and also allows them to receive more personalized support thanks to the emotional engine.

[0217] The processing flow will be explained below.

[0218] The present invention provides a system for providing customer support using generative artificial intelligence and an emotion engine when a user makes a contract for a product or service over a network. This system is implemented by the following operations.

[0219] Step 1:

[0220] A user accesses a mobile phone carrier's website or app via the network from a shop or home. The device receives the access request from the user and displays the home screen.

[0221] Step 2:

[0222] A user selects generative artificial intelligence (AI) customer support on a website or app. The device presents the user with the option to choose between chat or voice support. The user selects the format.

[0223] Step 3:

[0224] Based on the user's selection, the device will activate AI support. The AI ​​will ask the user initial questions about the contract type and plan selection via chat or voice. The emotion engine will analyze the user's emotions in real time.

[0225] Step 4:

[0226] Users answer questions and specify the plan and options they want to sign up for. The AI ​​explains the plan's features and benefits based on the user's answers. At the same time, the emotion engine dynamically adjusts the response based on the user's emotions.

[0227] Step 5:

[0228] The user finally selects the plan they want, and the terminal then explains to the user the steps for electronic customer verification (eKYC) required to proceed with the contract procedure.

[0229] Step 6:

[0230] The device requests the user to upload an identification document (e.g., driver's license, My Number card). The user uploads an image of the identification document to the device.

[0231] Step 7:

[0232] The device sends the uploaded image data to the server. The server analyzes the received image data and automatically collates it with the personal identification information. The server returns the collation results to the device.

[0233] Step 8:

[0234] The terminal notifies the user of the result of the verification, and after the user has completed the identity verification, the user can continue with the contract procedure.

[0235] Step 9:

[0236] The user checks the contract details on the final confirmation screen. If there are no problems, the user presses the final confirmation button to confirm the contract. The server saves the contract information in the database.

[0237] Step 10:

[0238] The server notifies the terminal that the contract has been successfully completed. The terminal displays the message "Contract completed" to the user.

[0239] As a specific example, there is the following case.

[0240] Example 1: Procedures at home

[0241] The user accesses the mobile phone company's website from their computer at home. The user selects chat-style AI support, and the AI ​​asks questions about the plan and options they wish to sign up for. The user selects a family plan, and the AI ​​explains the features of the selected plan. As the contract procedure progresses, the device performs eKYC using the user's driver's license. The user uploads an image of their driver's license, which the server analyzes to verify their identity. The user confirms the contract details on the final confirmation screen and presses the final confirmation button to confirm the contract. The system displays a notification that the contract has been completed. During this process, the emotion engine analyzes the user's emotions and adjusts the AI's responses to provide the user with optimal support.

[0242] Example 2: Shop procedure

[0243] The user uses a dedicated terminal in the shop to select voice-based AI support. The AI ​​asks questions about plans via voice, and the user selects the plan they want. The terminal then performs eKYC using their My Number card. The user uploads an image of their My Number card, and the server analyzes the image to verify their identity. The user checks the contract details on the final confirmation screen, and presses the final confirmation button to complete the contract. The system displays a notification that the contract has been completed. The emotion engine analyzes the user's emotional changes and triggers appropriate responses and responses, providing high-quality support to the user.

[0244] The system allows customers to complete the contract process quickly and easily from a store or at home, and receives more personalized support thanks to an emotion engine.

[0245] Example 2

[0246] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0247] Conventional systems have faced challenges when users sign contracts for products or services over the network, including the need for complex procedures and the lack of appropriate support to resolve any questions that arise. Furthermore, personalized support based on the user's emotional state was not provided, leaving a need for an improved user experience.

[0248] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for receiving an access request from a user terminal and displaying information about the contracted product; means for providing customer support using generative artificial intelligence and guiding the selection of a contract type and plan; means for performing electronic identity verification to verify the user's identity; means for analyzing the user's emotions in real time and dynamically adjusting the AI's response content based on the user's emotions; means for analyzing the results of the electronic identity verification and proceeding with the contract procedure; and means for storing the contract information in a database and sending a contract completion notification to the user terminal. This allows the user's procedures to be completed easily and quickly, and further makes it possible to provide optimal support according to the user's emotional state.

[0249] A "network" is a communications infrastructure that connects user terminals and servers and allows data to be sent and received.

[0250] A "user terminal" refers to a device used by a user, such as a personal computer or smartphone, that is used to access a server via a network.

[0251] "Generative AI" is an AI system that responds to user questions and requests using natural language processing and learning algorithms.

[0252] "Customer support" refers to a general service that provides information and guidance on procedures required when users sign contracts for products or services.

[0253] "Contract type" refers to the type of product or service provided or plan structure selected by the user.

[0254] "Plan" means the specific terms, conditions, and pricing offered for a particular product or service.

[0255] "Electronic Customer Verification (eKYC)" is a process that analyzes image data of identification documents to verify a user's identity online.

[0256] The "emotion engine" is a system that analyzes the user's emotions in real time and dynamically adjusts the response content based on that information.

[0257] A "database" is an information system for systematically storing and managing contract information and user-related information.

[0258] The "contract completion notification" is an information message used to notify the user terminal that the user's contract procedures have been successfully completed.

[0259] This invention is a system that provides customer support using a generative artificial intelligence and an emotion engine when a user contracts for products or services over a network. This system includes hardware and software such as a user terminal, a server, the generative artificial intelligence, the emotion engine, an electronic customer verification (eKYC) system, and a database.

[0260] System Configuration

[0261] User terminal: A device used by a user, such as a PC or smartphone. The user terminal sends access requests from the user to the server, receives responses from the server, and displays them.

[0262] Server: A server that accepts requests from user devices and provides information on contracted products. The server also analyzes the user's emotional data, performs electronic customer verification (eKYC), and proceeds with the contract procedure.

[0263] Generative artificial intelligence (AI): A system that responds to user questions and requests using natural language processing and learning algorithms. AI guides users through the process by guiding them through the selection of contract types and plans.

[0264] Emotion engine: A system that analyzes user emotions in real time and dynamically adjusts the AI's response based on that information.

[0265] Electronic identity verification (eKYC) system: A system that analyzes image data of identity verification documents uploaded by users to verify their identity. The server compares the identity verification information with a database.

[0266] Database: An information system that systematically stores and manages contract information and user-related information.

[0267] Hardware and software used

[0268] Hardware: User devices (PCs, smartphones), servers

[0269] Software: Generative AI model, emotion engine, eKYC system, database management system

[0270] Detailed explanation of operation

[0271] 1. User Access and Home Screen Display:

[0272] Users access the mobile phone company's website or app via a network using a user terminal from home or a shop.

[0273] The server accepts an access request from the user terminal and transmits home screen data to the user terminal.

[0274] The user terminal displays the home screen based on the received data.

[0275] 2. Customer Support Options:

[0276] Users can opt into generative AI customer support and choose between chat or voice support.

[0277] The user's device notifies the server of the user's selection, and the server activates the generative AI.

[0278] 3. Contract type and plan selection guide:

[0279] The generative AI guides users in selecting contract types and plans and responds to their questions.

[0280] Based on data provided by the server, the AI ​​explains the features and benefits of each plan to users.

[0281] 4. Sentiment Analysis and Response Adjustment:

[0282] The emotion engine analyzes the user's emotions in real time based on the user's chat and voice data.

[0283] The generative AI adjusts the response to the user based on the analysis results of the emotion engine.

[0284] 5. Electronic Identity Verification (eKYC):

[0285] The user will be prompted to upload identification documents.

[0286] The server analyzes the uploaded image data and compares the personal identification information with a database.

[0287] 6. Final confirmation and completion of the contract:

[0288] After completing eKYC, the user will confirm the contract details on the final confirmation screen.

[0289] When the user presses the final confirmation button, the server saves the contract information in a database and notifies the user terminal that the contract has been completed.

[0290] The user terminal displays the message "Contract completed."

[0291] Specific examples

[0292] Example 1: Procedures at home

[0293] A user accesses a mobile phone company's website from a computer at home.

[0294] Users can choose chat-based AI support and select a family plan.

[0295] Users will complete eKYC using their driver's license and upload an image.

[0296] The server analyzes the image to verify the identity of the user, and then confirms the contract details on the final confirmation screen.

[0297] When the user presses the final confirmation button to confirm the contract, a notification stating "Contract completed" is displayed.

[0298] The emotion engine analyzes and adjusts the AI's response.

[0299] Example 2: Shop procedure

[0300] The user selects AI support in the form of voice support using a dedicated terminal in the shop.

[0301] The AI ​​will ask questions about the plan via voice, and the user will be able to select the plan they want.

[0302] Users will use their My Number card to complete eKYC and upload an image.

[0303] The server analyzes the image and verifies the identity of the person.

[0304] The user confirms the contract details on the final confirmation screen and presses the final confirmation button to complete the contract.

[0305] A notification will appear stating that the contract has been completed.

[0306] The emotion engine analyzes the user's emotional changes and triggers appropriate responses.

[0307] Prompt Sentence Examples

[0308] "I'm interested in a family plan. Which plan is best for me?"

[0309] "I would like to proceed with the contract procedures, so please let me know what documents I need."

[0310] "I don't understand how to do eKYC. Please explain."

[0311] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0312] Step 1:

[0313] Receiving an access request

[0314] User: From home or a shop, the user uses a user device (PC or smartphone) to access the mobile phone carrier's website or app via the network.

[0315] Input: Access request from user device (URL request)

[0316] Terminal: Sends an access request to the server.

[0317] Server: Accepts access requests and generates home screen data.

[0318] Output: Home screen data (HTML and JSON format)

[0319] Device: Receives the home screen data and displays it to the user.

[0320] Specific operation: A user accesses a mobile phone company's website using a browser or a dedicated app, and the request is sent to the server, which then generates the corresponding homepage content and returns it to the user's device.

[0321] Step 2:

[0322] Selecting a support format

[0323] Users: Select Generative AI Support from the home screen and choose between chat or voice support.

[0324] Input: Support data of the user's choice (chat or voice)

[0325] Terminal: Notifies the server of the user's choice.

[0326] Server: Launches AI based on the support format and generates initial guide information.

[0327] Output: Initial guide information (text or audio data)

[0328] Terminal: Display or play initial guide information to the user.

[0329] Specific operation: The user selects the desired support format (chat or voice) from the options on the screen, and that information is sent to the server, which then activates the corresponding AI-guided mode to provide the user with initial guidance.

[0330] Step 3:

[0331] Contract type and plan selection guide

[0332] Terminal: Displays the AI's guide screen to the user.

[0333] User: Enters questions about the contract type and plan into the AI.

[0334] Input: User question data (text or voice input)

[0335] AI (on the server): Analyzes user data and generates information on the appropriate contract plan.

[0336] Output: Contract plan information (text or audio data)

[0337] Device: Display or play subscription plan information to the user.

[0338] Specific operation: The user enters questions about the contract type and plan, and the AI ​​analyzes the data and provides detailed information about the most suitable contract plan.

[0339] Step 4:

[0340] Sentiment Analysis and Response Adjustment

[0341] Terminal: Sends user chat and voice data to the emotion engine.

[0342] Input: User chat or voice data

[0343] Emotion engine (on the server): Analyzes user emotions in real time.

[0344] Output: Emotion analysis results (emotional state data)

[0345] AI (in the server): Dynamically adjusts responses to users based on the results of sentiment analysis.

[0346] Output: Tailored response (text or audio data)

[0347] Terminal: Displays or plays the adjusted response to the user.

[0348] Specific operation: The emotion engine analyzes chat and voice data entered by the user, and adjusts the AI's response based on the user's emotional state.

[0349] Step 5:

[0350] Electronic identity verification (eKYC)

[0351] On the device: Prompt the user to upload their identification documents.

[0352] Input: Image data of the ID document uploaded by the user

[0353] User: Upload an image of their ID.

[0354] Terminal: Sends the uploaded image data to the server.

[0355] Server: Analyzes the image data and automatically checks the identity information against a database.

[0356] Output: Matching result (identity verification success or failure)

[0357] Terminal: Display the match results to the user.

[0358] Specific operation: The user uploads identification documents such as a driver's license or My Number card, and the data is analyzed on the server to complete identity verification.

[0359] Step 6:

[0360] Final confirmation of contract details and completion of contract

[0361] User: Check the contract details on the final confirmation screen.

[0362] Input: Click of final confirmation button (user operation data)

[0363] Terminal: Sends user operation data to the server.

[0364] Server: Saves the contract information in a database and notifies the terminal when the contract is completed.

[0365] Output: Contract completion notification data

[0366] On the device: Display a contract completion notification to the user, displaying the message "Contract completed."

[0367] Specific operation: The user confirms the contract details and presses the final confirmation button if there are no problems. The server then saves the contract information and sends a contract completion notice to the terminal, which then displays the completion notice to the user.

[0368] (Application example 2)

[0369] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0370] Conventionally, when users contract for products or services over a network, they sometimes find it difficult to select the contract type or plan they desire, and it is also difficult to receive personalized support throughout the entire process. This can result in a poor user experience. Furthermore, there is also the problem of increased stress during the contract process due to fixed responses that do not take into account the user's emotional data. The present invention aims to solve these problems and provide users with optimal support that responds to their emotions.

[0371] The specification processing by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for accepting an access request from a user terminal and displaying information about the contract product, means for providing customer support using generative artificial intelligence and guiding the selection of a contract type and plan, means for conducting electronic identity verification to verify the user's identity, means for analyzing the results of the electronic identity verification and proceeding with the contract procedure, means for storing the contract information in a database and sending a contract completion notification to the user terminal, and means for analyzing the user's emotional data using an emotion analysis device and dynamically adjusting the response of the generative artificial intelligence based on the user's emotions. This allows the user to easily complete the contract procedure via a network and complete the contract with peace of mind while receiving personalized support based on the emotional data.

[0372] A "network" is a system in which computers and devices in different locations are connected to each other using multiple communication methods, enabling the exchange of information.

[0373] "Generative AI" is AI that has the ability to automatically generate responses and suggestions based on user input.

[0374] "Customer support" refers to a service that provides information and assistance with procedures necessary when a user signs a contract for a product or service.

[0375] "Contract type" refers to the method of providing products and services and the types of plans that users can select.

[0376] "Plan selection" refers to a user selecting an appropriate plan from multiple subscription options based on their needs and preferences.

[0377] "Electronic identity verification" is the process of verifying your identity online using an image or digital information of your ID uploaded by the user.

[0378] "Emotion data" is data that indicates the emotional state of a user extracted from facial expressions, voice, text, and the like.

[0379] An "emotion analysis device" is a device that analyzes a user's emotional data in real time and provides appropriate responses and suggestions based on the results.

[0380] "Dynamic adjustment" refers to making instant changes and optimizations based on given conditions and circumstances.

[0381] The "contract completion notification" is a communication message to notify the user that all contract procedures have been completed.

[0382] A "database" is a system for efficiently storing, managing, and searching large amounts of data.

[0383] MODE FOR CARRYING OUT THE INVENTION

[0384] The present invention provides a system for providing customer support using generative artificial intelligence and an emotion analysis device when a user makes a contract for a product or service via a network. This system is implemented with the following configuration.

[0385] First, a user uses a terminal (such as a smartphone or PC) to access a website or application that provides the product or service they wish to subscribe to via a network. This access request is sent to a server, which then displays information about the contracted product on the user's terminal.

[0386] Next, the user selects customer support via generative AI. The user device presents the user with the option to choose between chat or voice support. Once the user selects the format, the corresponding generative AI is activated, providing guidance on selecting a contract type and plan. The generative AI responds to the user's questions in real time and helps them select the most appropriate plan.

[0387] At this time, an emotion analysis device operates in parallel, analyzing the user's emotional data in real time. This emotion analysis includes, for example, facial expressions, tone of voice, and text content. The emotion analysis device dynamically adjusts the response content of the generative AI based on the analysis results, providing optimal support based on the user's emotions.

[0388] If user identity verification is required during the contract procedure, electronic user verification (eKYC) is carried out. To do this, the server instructs the user to upload an identity verification document (such as a driver's license or My Number card). The user's device takes a photo of the image data and sends it to the server.

[0389] The server analyzes the received image data and performs electronic identity verification. The analyzed identity verification information is automatically compared with the information registered in the database. Once identity verification is complete, the server displays a final confirmation screen on the user's device. The user confirms the contract details and presses the final confirmation button to finalize the contract. The server saves the contract information in the database and sends a contract completion notification to the user's device.

[0390] As a concrete example, the following scenario can be considered.

[0391] Example 1: Procedure via home network

[0392] The user opens the online shopping site's app on their smartphone at home and selects the "Smart Shopping Support" function. When the user selects chat-style AI support, a generative artificial intelligence is activated, guiding the user in selecting products and plans to purchase. At this time, an emotion analyzer operates in parallel, analyzing the user's emotional data and adjusting the AI's response. When the user takes a photo of their driver's license with their smartphone and uploads it, the server analyzes the image to verify the user's identity. After confirming the contract details on the final confirmation screen and pressing the final confirmation button, the system displays a notification that the contract has been completed.

[0393] Example prompt sentence:

[0394] A user opens an online shopping app on their smartphone and uses smart shopping support. First, the user accesses the online store and selects AI chat support. The user selects the category of product they want, and the AI ​​recommends the best products in that category. At this time, the emotion engine analyzes the user's preferences in real time and recommends products based on their emotions. Furthermore, when proceeding to the purchase process, the eKYC module prompts the user to upload their driver's license. The uploaded image is sent to the server, where identity verification is completed after analysis. After confirming the purchase details on the final confirmation screen, the user presses the final confirmation button to complete the purchase.

[0395] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0396] Step 1:

[0397] A user uses a smartphone or PC to access an application or website on an online shopping site. The device sends an access request to the server, and the server displays information about the contracted product on the user's device. The input here is the user's access request, and the output is a screen containing information about the contracted product.

[0398] Step 2:

[0399] The user selects customer support via generative artificial intelligence. The device displays an option to the user to choose between chat or voice, and the user selects the desired format. The input is the support format selected by the user, and the output is the launch of the corresponding generative artificial intelligence.

[0400] Step 3:

[0401] Based on the format selected by the user, a generative AI is launched. The generative AI presents the user with questions regarding the contract type and plan selection. The user responds to these questions, and the user's response data is sent from the terminal to the server. The input is the user's response data, and the output is the guide questions of the generative AI.

[0402] Step 4:

[0403] In parallel, an emotion analysis device operates, analyzing the user's emotional data in real time. The emotion analysis device takes the user's facial expressions, voice tone, and text content as input, analyzes them, and outputs emotional data. The emotional data is sent to the generative AI, which dynamically adjusts the response content according to the user's emotions. The input is the user's emotional data, and the output is the adjusted response of the generative AI.

[0404] Step 5:

[0405] In order for the user to proceed with the contract procedure, an electronic identity verification (eKYC) guide is displayed. The server requests the user to upload their identity verification document, and the terminal sends the uploaded image data to the server. The input is the image data of the identity verification document uploaded by the user, and the output is the image data sent to the server.

[0406] Step 6:

[0407] The server analyzes the received image data and automatically verifies the identity of the user. This is done using image recognition technology and OCR (optical character recognition). The analysis results are compared in a database as identity verification information. The input is the uploaded image data, and the output is the result of whether or not identity verification has been completed.

[0408] Step 7:

[0409] Once identity verification is complete, the server displays a final confirmation screen on the user's terminal. The user checks the contract details and presses the final confirmation button. The input is an instruction from the server to display the final confirmation screen, and the output is the user's final confirmation action.

[0410] Step 8:

[0411] When the user presses the final confirmation button, the server saves the contract information in the database and sends a contract completion notice to the user's terminal. The terminal displays the message "The contract has been completed" to the user. The input is the user's final confirmation action, and the output is the display of the contract completion notice.

[0412] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0413] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0414] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0415] [Second embodiment]

[0416] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0417] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0418] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0419] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0420] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0421] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0422] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0423] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0424] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0425] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0426] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0427] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0428] The present invention relates to a system for contracting for goods and services over a user-accessible network. The system is implemented by the following operations.

[0429] First, a user uses a device to access a mobile phone carrier's website or app via the network from a shop or home. The device receives the access request from the user and displays the mobile phone carrier's home screen.

[0430] Next, the user selects customer support provided by generative artificial intelligence (AI). The device allows the user to select chat or voice support as the AI ​​support format, and the AI ​​begins providing guidance based on the selected format. The AI ​​guides the user through the contract type, plan selection, and various procedures. The user specifies the desired plan and options through questions and selections. The AI ​​explains the features and benefits of the selected plan and answers the user's questions as needed.

[0431] When proceeding with the contract procedure, eKYC (electronic identity verification) is used. The terminal instructs the user to upload identification documents (e.g., driver's license, My Number card). The user uploads the identification documents to the terminal, and the image data is sent to the server. The server analyzes the received image data and automatically collates the identification information. The result of the collation is sent back from the server to the terminal and notified to the user.

[0432] After eKYC is complete, the user checks the contract details on the final confirmation screen. If there are no problems with the contract, the user presses the final confirmation button to confirm the contract. The server saves the contract information in the database and notifies the terminal that the contract has been successfully completed. The terminal displays this notification to the user and displays the message "The contract has been completed."

[0433] For example, when a user signs up for a mobile phone at home, the process proceeds as follows.

[0434] Example 1: Procedures at home

[0435] The user accesses the mobile phone company's website on their computer and selects chat-style AI support. The AI ​​asks questions about the plan and options they wish to sign up for, and the user selects a family plan. As they go through the contract process, eKYC is carried out using their driver's license. The user uploads an image of their driver's license, which the server analyzes to verify their identity. The user checks the contract details on the final confirmation screen and presses the final confirmation button to complete the contract. The system displays a notification that "the contract has been completed."

[0436] Example 2: Shop procedure

[0437] The user uses a dedicated terminal in the shop to select voice-based AI support. The AI ​​asks questions about the plan via voice, and the user selects the plan they want. eKYC is performed using the My Number card, and identity verification is completed. The user checks the contract details and presses the final confirmation button to complete the contract. The system displays a notification that the contract has been completed.

[0438] This system allows customers to complete the contract procedure quickly and easily from a store or from home, and by utilizing AI, it is possible to provide accurate and consistent customer support.

[0439] The processing flow will be explained below.

[0440] Step 1:

[0441] A user accesses a mobile phone carrier's website or app via the network from a shop or home. The device receives the access request from the user and displays the home screen.

[0442] Step 2:

[0443] A user selects generative artificial intelligence (AI) customer support on a website or app. The device presents the user with the option to choose between chat or voice support. The user selects the format.

[0444] Step 3:

[0445] The device will launch AI support based on the selected format. The AI ​​will display or speak initial questions about contract type and plan selection. The user will answer the questions and specify the desired plan and options.

[0446] Step 4:

[0447] The AI ​​explains the details and features of the appropriate plan based on the user's answers. The user asks questions and the AI ​​responds. The user finally selects the plan they want.

[0448] Step 5:

[0449] The contract procedure will proceed based on the plan selected by the user. The terminal will notify the user of the need for identity verification and explain the procedure for electronic identity verification (eKYC).

[0450] Step 6:

[0451] The device instructs the user to upload an identification document (e.g., driver's license, My Number card). The user uploads an image of the identification document to the device.

[0452] Step 7:

[0453] The device sends the uploaded image data to the server. The server analyzes the received image data and automatically collates it with the identity verification information. The server then returns the collation results to the device.

[0454] Step 8:

[0455] The terminal notifies the user of the result of the verification. The user confirms that identity verification has been completed and selects to continue the contract procedure.

[0456] Step 9:

[0457] The user checks the contract details on the final confirmation screen. If there are no problems with the contract, the user presses the final confirmation button to confirm the contract. The server saves the contract information in the database.

[0458] Step 10:

[0459] The server notifies the terminal that the contract has been successfully completed. The terminal displays the message "Contract completed" to the user.

[0460] Example 1

[0461] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0462] Conventional systems require users to manually complete multiple steps when signing up for products or services, making the process time-consuming and cumbersome. Furthermore, the analog identity verification process makes it difficult to prevent fraudulent applications. Furthermore, customer support is often inconsistent, resulting in an unsatisfactory experience for users.

[0463] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0464] In this invention, the server includes: means for accepting access requests from a user terminal and displaying information about the contracted product; means for providing customer support using generative artificial intelligence and guiding the selection of contract type and plan; means for conducting electronic identity verification to verify the user's identity; means for analyzing images of verification documents uploaded by the user and verifying identity verification information; means for storing contract information in a database and sending a contract completion notification to the user terminal; and means for the generative artificial intelligence to interact with the user in real time. This allows users to easily complete complicated procedures and quickly complete contract procedures while preventing fraudulent applications. In addition, consistent customer support using AI is expected to improve the user experience.

[0465] "User terminal" is a general term for devices that are connected to a network and used to process contracts for products and services.

[0466] An "access request" is a request sent from a user terminal to a server via a network, requesting the display of a specific web page or data.

[0467] "Information about contracted products" is detailed data about products and services that can be selected by the user, including plan contents, fees, features, and the like.

[0468] "Generative artificial intelligence" refers to AI technology that is a program for interacting with users and has a guide function for handling contract procedures and inquiries.

[0469] "Customer support" refers to the assistance and guidance provided to users when selecting or subscribing to products or services, including answering questions and explaining procedures.

[0470] "Electronic identity verification" is a procedure for verifying a user's identity in an online environment, a process that involves the submission of verification documents and the analysis of that data.

[0471] "Verification documents" are official documents submitted to verify the identity of a user, and include driver's licenses and identification cards.

[0472] "Analysis" refers to the procedure for processing the image data of the verification document to extract and verify the necessary information.

[0473] "Matching" is the process of comparing and matching the data provided by the user with existing database information based on the information obtained from the analysis.

[0474] "Contract information" includes all data related to the contract, such as the plan and options selected by the user, personal information, etc.

[0475] A "database" is a system for systematically storing and managing data such as contract information.

[0476] The "contract completion notification" is a notification message sent from the server to notify the user that the contract procedure has been successfully completed.

[0477] "Real-time" refers to a state in which interactions with users and information processing are carried out immediately, and is characterized by a response without delay.

[0478] The present invention relates to a system for contracting for goods and services over a user-accessible network. The system is implemented by the following operations.

[0479] First, a user uses their own device (e.g., a PC or smartphone) to access a service provider's website or application via a network from a shop or home. The device receives the user's access request and displays the service provider's home screen.

[0480] Next, the user can select customer support using generative artificial intelligence (AI). The device prompts the user to choose chat or voice support as the AI ​​support format. Based on the selection, the AI ​​guides the user in selecting the appropriate contract type and plan. For example, if the user answers "Family plan" to the question "Which contract plan would you like to choose?", the AI ​​will explain the details and benefits of that plan.

[0481] As the contract procedure progresses, user identity verification is a necessary process for electronic user verification (eKYC). The terminal instructs the user to upload identification documents (e.g., driver's license or other official document). The user follows the instructions and uploads the identification documents to the terminal. The image data is then sent to the server. The server analyzes the received image data and extracts character information using, for example, OCR (optical character recognition) technology (e.g., OpenCV or Tesseract), and collates it with the identity verification information. The result of this collation is sent from the server back to the terminal and notified to the user.

[0482] After eKYC is complete, the user confirms the contract details on the final confirmation screen. When the user presses the final confirmation button to confirm the contract, the contract information is sent to the server. The server saves the contract information in the database and notifies the terminal that the contract has been successfully completed. The terminal displays a message to the user saying, "The contract has been completed."

[0483] For example, here are some specific examples:

[0484] Example 1: Procedures at home

[0485] Operation steps:

[0486] 1. The user accesses the service provider's website on their computer and the home screen appears.

[0487] 2. The user selects chat-style AI support.

[0488] 3. The AI ​​asks questions about the plan and options you want, and the user selects a family plan.

[0489] 4. The device prompts the user to upload a driver's license, and the user uploads an image. The server analyzes it and returns the match result.

[0490] 5. The user presses the final confirmation button and a notification stating "The contract has been completed" appears on the device.

[0491] Example 2: Shop procedure

[0492] Operation steps:

[0493] 1. The user accesses the home screen using a dedicated terminal in the shop.

[0494] 2. The user selects AI support in the form of voice support.

[0495] 3. The AI ​​will ask questions about the plan via voice, and the user will select the desired plan.

[0496] 4. The terminal instructs the user to upload the My Number card, and the user uploads the image. The server analyzes it and returns the matching results.

[0497] 5. The user presses the final confirmation button and a notification stating "The contract has been completed" appears on the device.

[0498] Example prompt sentence:

[0499] "I would like to sign up for a family cell phone plan at home. I would like to use my driver's license as identification. Please guide me through the contract process."

[0500] This system allows users to complete contract procedures quickly and easily from a shop or at home, and utilizes AI to provide consistent customer support and improve the user experience.

[0501] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0502] Step 1:

[0503] Users use their devices (PCs or smartphones) to access the service provider's websites and applications.

[0504] Input: The user enters a URL in a web browser or app and submits an access request.

[0505] Output: The device sends an HTTP request and the server returns a response such as HTML or JSON.

[0506] Specific operation: The service provider's home screen is displayed on the device.

[0507] Step 2:

[0508] Users can choose to receive customer support through generative artificial intelligence (AI).

[0509] Input: User selects support option (chat or voice) on the home screen.

[0510] Output: The device launches the selected AI support module.

[0511] Specific operation: The chatbot interface or voice input screen will be displayed on the device.

[0512] Step 3:

[0513] AI guides users in choosing contract types and plans.

[0514] Input: The user answers the AI's questions and specifies the desired contract plan and options.

[0515] Data processing: AI analyzes the user's answers and suggests an appropriate plan.

[0516] Output: The AI ​​explains the plan's features and benefits to the user.

[0517] Specific behavior: For example, the AI ​​asks, "Which contract plan would you like?" and the user answers, "Family plan."

[0518] Step 4:

[0519] Initiate the electronic know your customer (eKYC) process.

[0520] Input: The AI ​​prompts the user to upload their identification document. The user uploads an image of their identification document (e.g., driver's license).

[0521] Output: The device sends the image data to the server.

[0522] Specific operation: The user takes a photo of the verification document using the device's camera function and uploads it.

[0523] Step 5:

[0524] The server analyzes the image of the verification document received and verifies the identity verification information.

[0525] Input: The server receives the image data and extracts the text information using OCR technology (e.g., OpenCV or Tesseract).

[0526] Data calculation: The server checks the extracted information against an existing database.

[0527] Output: The matching result is returned to the terminal.

[0528] Specific operation: The server analyzes the contents of the verification document (name, address, etc.) and checks whether it matches the information registered in the database. The result of the match is notified to the terminal.

[0529] Step 6:

[0530] The user confirms the contract details on the final confirmation screen.

[0531] Input: The user confirms the match results sent from the server.

[0532] Output: The device displays a final confirmation screen.

[0533] Specific operation: The user confirms the contract details and presses the "Complete contract" button.

[0534] Step 7:

[0535] The contract information is sent to the server to complete the contract.

[0536] Input: When the user presses the final confirmation button, the contract information is sent to the server.

[0537] Output: The server saves the contract information to the database and sends a contract completion notification.

[0538] Specific operation: The contract information is stored in the database and the message "Contract completed" is displayed on the terminal.

[0539] In this way, this system allows users to easily complete complicated procedures, preventing fraudulent applications and quickly completing contract procedures. Furthermore, the use of AI will enable consistent customer support and an improved user experience.

[0540] (Application example 1)

[0541] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0542] One issue facing modern electronic payment services is the lack of a process that allows users to complete contract procedures quickly and easily. Conventional systems require users to visit a store in person, which takes time and effort. Furthermore, the electronic customer verification (eKYC) process is complicated, making it difficult for users to smoothly complete a contract. Furthermore, there is a lack of support using generative artificial intelligence, which can make it difficult for users to select an appropriate plan.

[0543] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0544] In this invention, the server includes means for receiving access requests from a user terminal and displaying information about the contracted product, means for providing customer support using generative artificial intelligence and guiding the selection of a contract type and plan, means for conducting electronic identity verification to verify the user's identity, means for analyzing the results of the electronic identity verification and proceeding with the contract procedure, means for saving the contract information in a database and sending a contract completion notification to the user terminal, means for using a smart device as the user terminal and conducting the contract procedure for the electronic payment service on the device, means for the user to select AI support in chat format or voice format and respond to the input based on a generative AI model, and means for receiving images of confirmation documents uploaded by the user and analyzing the images to verify the user's identity, thereby enabling the user to quickly and easily complete the contract procedure for the electronic payment service.

[0545] A "user terminal" is a device used by a user, and is equipment that can carry out contract procedures for products and services via a network.

[0546] An "access request" is a request sent from a user terminal to a server to initiate processing for displaying information about a contracted product.

[0547] "Generative AI" is an AI that independently interacts with users and guides them in selecting contract types and plans.

[0548] "Electronic identity verification" is a procedure that allows users to verify their identity online by analyzing images of verification documents and verifying identity information.

[0549] The "contract procedure" is a procedure in which the user confirms the necessary information based on the contract type and plan selected by the user and finally finalizes the contract.

[0550] A "database" is an information system for efficiently storing and managing contract information and user information.

[0551] The "contract completion notification" is a message that notifies the user that the contract procedure has been successfully completed.

[0552] "Smart devices" are digital devices with advanced computing power and communication functions, such as smartphones and smart glasses.

[0553] "Chat format" is a format in which users interact with generative artificial intelligence in a text-based manner.

[0554] The "voice format" is a format in which the user interacts with the generative artificial intelligence using voice.

[0555] A "generative AI model" is an artificial intelligence algorithm or program that automatically generates a response based on given information.

[0556] "Verification documents" are official documents required to verify the identity of a user, such as a driver's license or My Number card.

[0557] "Image analysis" is a technology that processes images of uploaded verification documents, recognizes their contents, and extracts information.

[0558] MODE FOR CARRYING OUT THE INVENTION

[0559] The program for the system for implementing this invention comprises the following means: A user uses a smart device (such as a smartphone or smart glasses) to complete contract procedures for a product or service. The server accepts an access request from the user terminal and displays information about the contracted product. In doing so, it utilizes a generative AI model to provide the user with appropriate guidance.

[0560] As an interface, users can choose chat or voice AI support. User input generates a response in real time based on the generative AI model. For example, if a user inputs, "I would like to sign up for a new credit card," the AI ​​will respond, "What kind of credit card plan would you like?" In this way, users can proceed with the contract process in an interactive manner.

[0561] The server then performs electronic identity verification (eKYC) to verify the user's identity. The user uses a smart device to upload an image of their identification document (such as a driver's license or My Number card). The image is sent to the server, which performs image analysis using OpenCV and the face_recognition library. The resulting identity verification information is then matched, facilitating electronic identity verification.

[0562] Once identity verification is complete, the server will provide instructions to the user to proceed with the contract. The contract information will be saved in the database, and the user will finally receive a contract completion notification. For example, a prompt such as "I'm interested in the family plan" can be used, and after confirmation, a message will be displayed saying "Contract completed."

[0563] Specific examples of main processing flows

[0564] 1. Access request from user: The user accesses the application on a smart device and sends a request to the server.

[0565] 2. Displaying contracted product information: The server displays contracted product information on the user terminal.

[0566] 3. Guided by a generative AI model: The user enters, "I would like to sign up for a new credit card," and the generative AI model responds, "What kind of credit card plan would you like?"

[0567] 4. Electronic Identity Verification (eKYC): The user uploads an image of their driver's license using a smart device, and the server performs image analysis using OpenCV and the face_recognition library to verify the user's identity.

[0568] 5. Contract procedure progress: Based on the analysis results, the server proceeds with the contract procedure and saves the contract information in the database.

[0569] 6. Contract completion notification: After the user makes a final confirmation, the server sends a notification to the user terminal stating that the contract has been completed.

[0570] Prompt Sentence Examples

[0571] I want to apply for a new credit card.

[0572] "Please tell me more about the women's plan."

[0573] "I'm interested in a family plan."

[0574] The system allows users to quickly and easily complete contract procedures for electronic payment services using their smart devices, and utilizes generative AI models to provide appropriate and consistent customer support.

[0575] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0576] Step 1:

[0577] The user terminal accesses the contract application. The user launches the contract application using a smart device such as a smartphone or smart glasses. The terminal sends an access request to the server. This request includes the user's identification information.

[0578] Step 2:

[0579] The server accepts the access request. The server analyzes the received access request and retrieves information about the contracted product from the database. The information about the contracted product is then displayed on the user's device. At this stage, the generative artificial intelligence (AI) is ready to support the user.

[0580] Step 3:

[0581] Users can choose chat or voice support from the generative AI model. Users select "chat" or "voice" and type or speak questions about their desired contract product or service plan.

[0582] Step 4:

[0583] The server passes the input to the generative AI model, which generates a response. The server sends the user's input as a prompt to the generative AI model, which generates an appropriate response. For example, if the user enters, "I would like to sign up for a new credit card," the AI ​​replies, "What kind of credit card plan would you like?"

[0584] Step 5:

[0585] The user selects the desired contract plan. The user is guided by the generative AI model to select the contract type and plan. The selected information is sent to the server, which determines the next step based on the contract plan.

[0586] Step 6:

[0587] The server instructs the user to start electronic identity verification (eKYC), and the user uses a smart device to upload an image of a verification document such as a driver's license or My Number card.

[0588] Step 7:

[0589] The server receives the uploaded image of the verification document and performs image analysis. The server uses OpenCV and the face_recognition library to analyze the received image. Specifically, it performs facial recognition and character recognition (OCR) in the image to extract identity verification information. Based on this analysis, it compares it with existing information in the database.

[0590] Step 8:

[0591] The server notifies the user of the results of the electronic identity verification. If the analysis is successful, the server sends the user a message saying "Identity verification completed." If the analysis is unsuccessful, the server displays the message "Identity verification failed. Please try again."

[0592] Step 9:

[0593] The user performs a final confirmation and completes the contract procedure. After identity verification is complete, the server displays a final confirmation screen for the contract details. The user confirms the contract details and presses the "Final Confirmation" button.

[0594] Step 10:

[0595] The server saves the contract information in a database and sends a contract completion notice to the user. The server saves the final confirmation information in a database and notifies the user that the contract has been successfully completed. The message "The contract has been completed" is displayed on the user's terminal.

[0596] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0597] The present invention provides a system for providing customer support using generative artificial intelligence and an emotion engine when a user makes a contract for a product or service over a network. This system is implemented by the following operations.

[0598] First, a user accesses a mobile phone carrier's website or app via the network from a shop or home using a device. The device receives the access request from the user and displays the home screen.

[0599] Next, the user selects customer support via generative artificial intelligence (AI). The device presents the user with the option to choose between chat or voice support. Once the user selects the format, the device activates the AI ​​and begins guiding them based on the selected format.

[0600] The AI ​​guides users through the process of selecting a contract type and plan, as well as various procedures. Users specify the plan and options they want through questions and selections. The AI ​​explains the features and benefits of the selected plan and answers any questions the user may have, if necessary.

[0601] At this time, an emotion engine runs in parallel, analyzing the user's emotions in real time. The emotion engine analyzes the user's emotional data acquired through chat and voice support, and dynamically adjusts the AI's response content based on the user's emotions.

[0602] When proceeding with the contract procedure, electronic identity verification (eKYC) is used. The terminal instructs the user to upload identification documents (e.g., driver's license, My Number card). The user uploads the identification document, and the image data is sent to the server. The server analyzes the received image data and automatically collates the identification information. The server returns the result of the collation to the terminal and notifies the user.

[0603] After eKYC is complete, the user checks the contract details on the final confirmation screen. If there are no problems with the contract, the user presses the final confirmation button to confirm the contract. The server saves the contract information in the database and notifies the terminal that the contract has been successfully completed. The terminal displays this notification to the user and displays the message "The contract has been completed."

[0604] A specific example is given below.

[0605] Example 1: Procedures at home

[0606] The user accesses the mobile phone company's website from their computer at home. The user selects chat-style AI support, and the AI ​​asks questions about the plan and options they wish to sign up for. The user selects a family plan and proceeds with the contract procedure. eKYC is performed using a driver's license, and the user uploads an image of the license. The server analyzes the image to verify the user's identity, and the contract details are confirmed on the final confirmation screen. When the user presses the final confirmation button to confirm the contract, the system displays a notification that "the contract has been completed." At this time, the emotion engine analyzes the user's emotions in real time and adjusts the AI's response to provide the user with the most appropriate support.

[0607] Example 2: Shop procedure

[0608] The user selects voice-based AI support using a dedicated terminal in the shop. The AI ​​asks questions about plans via voice, and the user selects the plan they want. eKYC is performed using the My Number card, and the user uploads an image. The server analyzes the image and verifies the user's identity. The user confirms the contract details on the final confirmation screen, and presses the final confirmation button to complete the contract. The system displays a notification that the contract has been completed. The emotion engine analyzes the user's emotional changes and triggers appropriate responses and responses, providing high-quality support to the user.

[0609] This system allows customers to complete the contract process quickly and easily from home or in a store, and also allows them to receive more personalized support thanks to the emotional engine.

[0610] The processing flow will be explained below.

[0611] The present invention provides a system for providing customer support using generative artificial intelligence and an emotion engine when a user makes a contract for a product or service over a network. This system is implemented by the following operations.

[0612] Step 1:

[0613] A user accesses a mobile phone carrier's website or app via the network from a shop or home. The device receives the access request from the user and displays the home screen.

[0614] Step 2:

[0615] A user selects generative artificial intelligence (AI) customer support on a website or app. The device presents the user with the option to choose between chat or voice support. The user selects the format.

[0616] Step 3:

[0617] Based on the user's selection, the device will activate AI support. The AI ​​will ask the user initial questions about the contract type and plan selection via chat or voice. The emotion engine will analyze the user's emotions in real time.

[0618] Step 4:

[0619] Users answer questions and specify the plan and options they want to sign up for. The AI ​​explains the plan's features and benefits based on the user's answers. At the same time, the emotion engine dynamically adjusts the response based on the user's emotions.

[0620] Step 5:

[0621] The user finally selects the plan they want, and the terminal then explains to the user the steps for electronic customer verification (eKYC) required to proceed with the contract procedure.

[0622] Step 6:

[0623] The device requests the user to upload an identification document (e.g., driver's license, My Number card). The user uploads an image of the identification document to the device.

[0624] Step 7:

[0625] The device sends the uploaded image data to the server. The server analyzes the received image data and automatically collates it with the personal identification information. The server returns the collation results to the device.

[0626] Step 8:

[0627] The terminal notifies the user of the result of the verification, and after the user has completed the identity verification, the user can continue with the contract procedure.

[0628] Step 9:

[0629] The user checks the contract details on the final confirmation screen. If there are no problems, the user presses the final confirmation button to confirm the contract. The server saves the contract information in the database.

[0630] Step 10:

[0631] The server notifies the terminal that the contract has been successfully completed. The terminal displays the message "Contract completed" to the user.

[0632] As a specific example, there is the following case.

[0633] Example 1: Procedures at home

[0634] The user accesses the mobile phone company's website from their computer at home. The user selects chat-style AI support, and the AI ​​asks questions about the plan and options they wish to sign up for. The user selects a family plan, and the AI ​​explains the features of the selected plan. As the contract procedure progresses, the device performs eKYC using the user's driver's license. The user uploads an image of their driver's license, which the server analyzes to verify their identity. The user confirms the contract details on the final confirmation screen and presses the final confirmation button to confirm the contract. The system displays a notification that the contract has been completed. During this process, the emotion engine analyzes the user's emotions and adjusts the AI's responses to provide the user with optimal support.

[0635] Example 2: Shop procedure

[0636] The user uses a dedicated terminal in the shop to select voice-based AI support. The AI ​​asks questions about plans via voice, and the user selects the plan they want. The terminal then performs eKYC using their My Number card. The user uploads an image of their My Number card, and the server analyzes the image to verify their identity. The user checks the contract details on the final confirmation screen, and presses the final confirmation button to complete the contract. The system displays a notification that the contract has been completed. The emotion engine analyzes the user's emotional changes and triggers appropriate responses and responses, providing high-quality support to the user.

[0637] The system allows customers to complete the contract process quickly and easily from a store or at home, and receives more personalized support thanks to an emotion engine.

[0638] Example 2

[0639] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0640] Conventional systems have faced challenges when users sign contracts for products or services over the network, including the need for complex procedures and the lack of appropriate support to resolve any questions that arise. Furthermore, personalized support based on the user's emotional state was not provided, leaving a need for an improved user experience.

[0641] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for receiving an access request from a user terminal and displaying information about the contracted product; means for providing customer support using generative artificial intelligence and guiding the selection of a contract type and plan; means for performing electronic identity verification to verify the user's identity; means for analyzing the user's emotions in real time and dynamically adjusting the AI's response content based on the user's emotions; means for analyzing the results of the electronic identity verification and proceeding with the contract procedure; and means for storing the contract information in a database and sending a contract completion notification to the user terminal. This allows the user's procedures to be completed easily and quickly, and further makes it possible to provide optimal support according to the user's emotional state.

[0642] A "network" is a communications infrastructure that connects user terminals and servers and allows data to be sent and received.

[0643] A "user terminal" refers to a device used by a user, such as a personal computer or smartphone, that is used to access a server via a network.

[0644] "Generative AI" is an AI system that responds to user questions and requests using natural language processing and learning algorithms.

[0645] "Customer support" refers to a general service that provides information and guidance on procedures required when users sign contracts for products or services.

[0646] "Contract type" refers to the type of product or service provided or plan structure selected by the user.

[0647] "Plan" means the specific terms, conditions, and pricing offered for a particular product or service.

[0648] "Electronic Customer Verification (eKYC)" is a process that analyzes image data of identification documents to verify a user's identity online.

[0649] The "emotion engine" is a system that analyzes the user's emotions in real time and dynamically adjusts the response content based on that information.

[0650] A "database" is an information system for systematically storing and managing contract information and user-related information.

[0651] The "contract completion notification" is an information message used to notify the user terminal that the user's contract procedures have been successfully completed.

[0652] This invention is a system that provides customer support using a generative artificial intelligence and an emotion engine when a user contracts for products or services over a network. This system includes hardware and software such as a user terminal, a server, the generative artificial intelligence, the emotion engine, an electronic customer verification (eKYC) system, and a database.

[0653] System Configuration

[0654] User terminal: A device used by a user, such as a PC or smartphone. The user terminal sends access requests from the user to the server, receives responses from the server, and displays them.

[0655] Server: A server that accepts requests from user devices and provides information on contracted products. The server also analyzes the user's emotional data, performs electronic customer verification (eKYC), and proceeds with the contract procedure.

[0656] Generative artificial intelligence (AI): A system that responds to user questions and requests using natural language processing and learning algorithms. AI guides users through the process by guiding them through the selection of contract types and plans.

[0657] Emotion engine: A system that analyzes user emotions in real time and dynamically adjusts the AI's response based on that information.

[0658] Electronic identity verification (eKYC) system: A system that analyzes image data of identity verification documents uploaded by users to verify their identity. The server compares the identity verification information with a database.

[0659] Database: An information system that systematically stores and manages contract information and user-related information.

[0660] Hardware and software used

[0661] Hardware: User devices (PCs, smartphones), servers

[0662] Software: Generative AI model, emotion engine, eKYC system, database management system

[0663] Detailed explanation of operation

[0664] 1. User Access and Home Screen Display:

[0665] Users access the mobile phone company's website or app via a network using a user terminal from home or a shop.

[0666] The server accepts an access request from the user terminal and transmits home screen data to the user terminal.

[0667] The user terminal displays the home screen based on the received data.

[0668] 2. Customer Support Options:

[0669] Users can opt into generative AI customer support and choose between chat or voice support.

[0670] The user's device notifies the server of the user's selection, and the server activates the generative AI.

[0671] 3. Contract type and plan selection guide:

[0672] The generative AI guides users in selecting contract types and plans and responds to their questions.

[0673] Based on data provided by the server, the AI ​​explains the features and benefits of each plan to users.

[0674] 4. Sentiment Analysis and Response Adjustment:

[0675] The emotion engine analyzes the user's emotions in real time based on the user's chat and voice data.

[0676] The generative AI adjusts the response to the user based on the analysis results of the emotion engine.

[0677] 5. Electronic Identity Verification (eKYC):

[0678] The user will be prompted to upload identification documents.

[0679] The server analyzes the uploaded image data and compares the personal identification information with a database.

[0680] 6. Final confirmation and completion of the contract:

[0681] After completing eKYC, the user will confirm the contract details on the final confirmation screen.

[0682] When the user presses the final confirmation button, the server saves the contract information in a database and notifies the user terminal that the contract has been completed.

[0683] The user terminal displays the message "Contract completed."

[0684] Specific examples

[0685] Example 1: Procedures at home

[0686] A user accesses a mobile phone company's website from a computer at home.

[0687] Users can choose chat-based AI support and select a family plan.

[0688] Users will complete eKYC using their driver's license and upload an image.

[0689] The server analyzes the image to verify the identity of the user, and then confirms the contract details on the final confirmation screen.

[0690] When the user presses the final confirmation button to confirm the contract, a notification stating "Contract completed" is displayed.

[0691] The emotion engine analyzes and adjusts the AI's response.

[0692] Example 2: Shop procedure

[0693] The user selects AI support in the form of voice support using a dedicated terminal in the shop.

[0694] The AI ​​will ask questions about the plan via voice, and the user will be able to select the plan they want.

[0695] Users will use their My Number card to complete eKYC and upload an image.

[0696] The server analyzes the image and verifies the identity of the person.

[0697] The user confirms the contract details on the final confirmation screen and presses the final confirmation button to complete the contract.

[0698] A notification will appear stating that the contract has been completed.

[0699] The emotion engine analyzes the user's emotional changes and triggers appropriate responses.

[0700] Prompt Sentence Examples

[0701] "I'm interested in a family plan. Which plan is best for me?"

[0702] "I would like to proceed with the contract procedures, so please let me know what documents I need."

[0703] "I don't understand how to do eKYC. Please explain."

[0704] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0705] Step 1:

[0706] Receiving an access request

[0707] User: From home or a shop, the user uses a user device (PC or smartphone) to access the mobile phone carrier's website or app via the network.

[0708] Input: Access request from user device (URL request)

[0709] Terminal: Sends an access request to the server.

[0710] Server: Accepts access requests and generates home screen data.

[0711] Output: Home screen data (HTML and JSON format)

[0712] Device: Receives the home screen data and displays it to the user.

[0713] Specific operation: A user accesses a mobile phone company's website using a browser or a dedicated app, and the request is sent to the server, which then generates the corresponding homepage content and returns it to the user's device.

[0714] Step 2:

[0715] Selecting a support format

[0716] Users: Select Generative AI Support from the home screen and choose between chat or voice support.

[0717] Input: Support data of the user's choice (chat or voice)

[0718] Terminal: Notifies the server of the user's choice.

[0719] Server: Launches AI based on the support format and generates initial guide information.

[0720] Output: Initial guide information (text or audio data)

[0721] Terminal: Display or play initial guide information to the user.

[0722] Specific operation: The user selects the desired support format (chat or voice) from the options on the screen, and that information is sent to the server, which then activates the corresponding AI-guided mode to provide the user with initial guidance.

[0723] Step 3:

[0724] Contract type and plan selection guide

[0725] Terminal: Displays the AI's guide screen to the user.

[0726] User: Enters questions about the contract type and plan into the AI.

[0727] Input: User question data (text or voice input)

[0728] AI (on the server): Analyzes user data and generates information on the appropriate contract plan.

[0729] Output: Contract plan information (text or audio data)

[0730] Device: Display or play subscription plan information to the user.

[0731] Specific operation: The user enters questions about the contract type and plan, and the AI ​​analyzes the data and provides detailed information about the most suitable contract plan.

[0732] Step 4:

[0733] Sentiment Analysis and Response Adjustment

[0734] Terminal: Sends user chat and voice data to the emotion engine.

[0735] Input: User chat or voice data

[0736] Emotion engine (on the server): Analyzes user emotions in real time.

[0737] Output: Emotion analysis results (emotional state data)

[0738] AI (in the server): Dynamically adjusts responses to users based on the results of sentiment analysis.

[0739] Output: Tailored response (text or audio data)

[0740] Terminal: Displays or plays the adjusted response to the user.

[0741] Specific operation: The emotion engine analyzes chat and voice data entered by the user, and adjusts the AI's response based on the user's emotional state.

[0742] Step 5:

[0743] Electronic identity verification (eKYC)

[0744] On the device: Prompt the user to upload their identification documents.

[0745] Input: Image data of the ID document uploaded by the user

[0746] User: Upload an image of their ID.

[0747] Terminal: Sends the uploaded image data to the server.

[0748] Server: Analyzes the image data and automatically checks the identity information against a database.

[0749] Output: Matching result (identity verification success or failure)

[0750] Terminal: Display the match results to the user.

[0751] Specific operation: The user uploads identification documents such as a driver's license or My Number card, and the data is analyzed on the server to complete identity verification.

[0752] Step 6:

[0753] Final confirmation of contract details and completion of contract

[0754] User: Check the contract details on the final confirmation screen.

[0755] Input: Click of final confirmation button (user operation data)

[0756] Terminal: Sends user operation data to the server.

[0757] Server: Saves the contract information in a database and notifies the terminal when the contract is completed.

[0758] Output: Contract completion notification data

[0759] On the device: Display a contract completion notification to the user, displaying the message "Contract completed."

[0760] Specific operation: The user confirms the contract details and presses the final confirmation button if there are no problems. The server then saves the contract information and sends a contract completion notice to the terminal, which then displays the completion notice to the user.

[0761] (Application example 2)

[0762] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0763] Conventionally, when users contract for products or services over a network, they sometimes find it difficult to select the contract type or plan they desire, and it is also difficult to receive personalized support throughout the entire process. This can result in a poor user experience. Furthermore, there is also the problem of increased stress during the contract process due to fixed responses that do not take into account the user's emotional data. The present invention aims to solve these problems and provide users with optimal support that responds to their emotions.

[0764] The specification processing by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for accepting an access request from a user terminal and displaying information about the contract product, means for providing customer support using generative artificial intelligence and guiding the selection of a contract type and plan, means for conducting electronic identity verification to verify the user's identity, means for analyzing the results of the electronic identity verification and proceeding with the contract procedure, means for storing the contract information in a database and sending a contract completion notification to the user terminal, and means for analyzing the user's emotional data using an emotion analysis device and dynamically adjusting the response of the generative artificial intelligence based on the user's emotions. This allows the user to easily complete the contract procedure via a network and complete the contract with peace of mind while receiving personalized support based on the emotional data.

[0765] A "network" is a system in which computers and devices in different locations are connected to each other using multiple communication methods, enabling the exchange of information.

[0766] "Generative AI" is AI that has the ability to automatically generate responses and suggestions based on user input.

[0767] "Customer support" refers to a service that provides information and assistance with procedures necessary when a user signs a contract for a product or service.

[0768] "Contract type" refers to the method of providing products and services and the types of plans that users can select.

[0769] "Plan selection" refers to a user selecting an appropriate plan from multiple subscription options based on their needs and preferences.

[0770] "Electronic identity verification" is the process of verifying your identity online using an image or digital information of your ID uploaded by the user.

[0771] "Emotion data" is data that indicates the emotional state of a user extracted from facial expressions, voice, text, and the like.

[0772] An "emotion analysis device" is a device that analyzes a user's emotional data in real time and provides appropriate responses and suggestions based on the results.

[0773] "Dynamic adjustment" refers to making instant changes and optimizations based on given conditions and circumstances.

[0774] The "contract completion notification" is a communication message to notify the user that all contract procedures have been completed.

[0775] A "database" is a system for efficiently storing, managing, and searching large amounts of data.

[0776] MODE FOR CARRYING OUT THE INVENTION

[0777] The present invention provides a system for providing customer support using generative artificial intelligence and an emotion analysis device when a user makes a contract for a product or service via a network. This system is implemented with the following configuration.

[0778] First, a user uses a terminal (such as a smartphone or PC) to access a website or application that provides the product or service they wish to subscribe to via a network. This access request is sent to a server, which then displays information about the contracted product on the user's terminal.

[0779] Next, the user selects customer support via generative AI. The user device presents the user with the option to choose between chat or voice support. Once the user selects the format, the corresponding generative AI is activated, providing guidance on selecting a contract type and plan. The generative AI responds to the user's questions in real time and helps them select the most appropriate plan.

[0780] At this time, an emotion analysis device operates in parallel, analyzing the user's emotional data in real time. This emotion analysis includes, for example, facial expressions, tone of voice, and text content. The emotion analysis device dynamically adjusts the response content of the generative AI based on the analysis results, providing optimal support based on the user's emotions.

[0781] If user identity verification is required during the contract procedure, electronic user verification (eKYC) is carried out. To do this, the server instructs the user to upload an identity verification document (such as a driver's license or My Number card). The user's device takes a photo of the image data and sends it to the server.

[0782] The server analyzes the received image data and performs electronic identity verification. The analyzed identity verification information is automatically compared with the information registered in the database. Once identity verification is complete, the server displays a final confirmation screen on the user's device. The user confirms the contract details and presses the final confirmation button to finalize the contract. The server saves the contract information in the database and sends a contract completion notification to the user's device.

[0783] As a concrete example, the following scenario can be considered.

[0784] Example 1: Procedure via home network

[0785] The user opens the online shopping site's app on their smartphone at home and selects the "Smart Shopping Support" function. When the user selects chat-style AI support, a generative artificial intelligence is activated, guiding the user in selecting products and plans to purchase. At this time, an emotion analyzer operates in parallel, analyzing the user's emotional data and adjusting the AI's response. When the user takes a photo of their driver's license with their smartphone and uploads it, the server analyzes the image to verify the user's identity. After confirming the contract details on the final confirmation screen and pressing the final confirmation button, the system displays a notification that the contract has been completed.

[0786] Example prompt sentence:

[0787] A user opens an online shopping app on their smartphone and uses smart shopping support. First, the user accesses the online store and selects AI chat support. The user selects the category of product they want, and the AI ​​recommends the best products in that category. At this time, the emotion engine analyzes the user's preferences in real time and recommends products based on their emotions. Furthermore, when proceeding to the purchase process, the eKYC module prompts the user to upload their driver's license. The uploaded image is sent to the server, where identity verification is completed after analysis. After confirming the purchase details on the final confirmation screen, the user presses the final confirmation button to complete the purchase.

[0788] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0789] Step 1:

[0790] A user uses a smartphone or PC to access an application or website on an online shopping site. The device sends an access request to the server, and the server displays information about the contracted product on the user's device. The input here is the user's access request, and the output is a screen containing information about the contracted product.

[0791] Step 2:

[0792] The user selects customer support via generative artificial intelligence. The device displays an option to the user to choose between chat or voice, and the user selects the desired format. The input is the support format selected by the user, and the output is the launch of the corresponding generative artificial intelligence.

[0793] Step 3:

[0794] Based on the format selected by the user, a generative AI is launched. The generative AI presents the user with questions regarding the contract type and plan selection. The user responds to these questions, and the user's response data is sent from the terminal to the server. The input is the user's response data, and the output is the guide questions of the generative AI.

[0795] Step 4:

[0796] In parallel, an emotion analysis device operates, analyzing the user's emotional data in real time. The emotion analysis device takes the user's facial expressions, voice tone, and text content as input, analyzes them, and outputs emotional data. The emotional data is sent to the generative AI, which dynamically adjusts the response content according to the user's emotions. The input is the user's emotional data, and the output is the adjusted response of the generative AI.

[0797] Step 5:

[0798] In order for the user to proceed with the contract procedure, an electronic identity verification (eKYC) guide is displayed. The server requests the user to upload their identity verification document, and the terminal sends the uploaded image data to the server. The input is the image data of the identity verification document uploaded by the user, and the output is the image data sent to the server.

[0799] Step 6:

[0800] The server analyzes the received image data and automatically verifies the identity of the user. This is done using image recognition technology and OCR (optical character recognition). The analysis results are compared in a database as identity verification information. The input is the uploaded image data, and the output is the result of whether or not identity verification has been completed.

[0801] Step 7:

[0802] Once identity verification is complete, the server displays a final confirmation screen on the user's terminal. The user checks the contract details and presses the final confirmation button. The input is an instruction from the server to display the final confirmation screen, and the output is the user's final confirmation action.

[0803] Step 8:

[0804] When the user presses the final confirmation button, the server saves the contract information in the database and sends a contract completion notice to the user's terminal. The terminal displays the message "The contract has been completed" to the user. The input is the user's final confirmation action, and the output is the display of the contract completion notice.

[0805] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0806] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0807] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0808] [Third embodiment]

[0809] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0810] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0811] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0812] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0813] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0814] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0815] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0816] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0817] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0818] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0819] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0820] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0821] The present invention relates to a system for contracting for goods and services over a user-accessible network. The system is implemented by the following operations.

[0822] First, a user uses a device to access a mobile phone carrier's website or app via the network from a shop or home. The device receives the access request from the user and displays the mobile phone carrier's home screen.

[0823] Next, the user selects customer support provided by generative artificial intelligence (AI). The device allows the user to select chat or voice support as the AI ​​support format, and the AI ​​begins providing guidance based on the selected format. The AI ​​guides the user through the contract type, plan selection, and various procedures. The user specifies the desired plan and options through questions and selections. The AI ​​explains the features and benefits of the selected plan and answers the user's questions as needed.

[0824] When proceeding with the contract procedure, eKYC (electronic identity verification) is used. The terminal instructs the user to upload identification documents (e.g., driver's license, My Number card). The user uploads the identification documents to the terminal, and the image data is sent to the server. The server analyzes the received image data and automatically collates the identification information. The result of the collation is sent back from the server to the terminal and notified to the user.

[0825] After eKYC is complete, the user checks the contract details on the final confirmation screen. If there are no problems with the contract, the user presses the final confirmation button to confirm the contract. The server saves the contract information in the database and notifies the terminal that the contract has been successfully completed. The terminal displays this notification to the user and displays the message "The contract has been completed."

[0826] For example, when a user signs up for a mobile phone at home, the process proceeds as follows.

[0827] Example 1: Procedures at home

[0828] The user accesses the mobile phone company's website on their computer and selects chat-style AI support. The AI ​​asks questions about the plan and options they wish to sign up for, and the user selects a family plan. As they go through the contract process, eKYC is carried out using their driver's license. The user uploads an image of their driver's license, which the server analyzes to verify their identity. The user checks the contract details on the final confirmation screen and presses the final confirmation button to complete the contract. The system displays a notification that "the contract has been completed."

[0829] Example 2: Shop procedure

[0830] The user uses a dedicated terminal in the shop to select voice-based AI support. The AI ​​asks questions about the plan via voice, and the user selects the plan they want. eKYC is performed using the My Number card, and identity verification is completed. The user checks the contract details and presses the final confirmation button to complete the contract. The system displays a notification that the contract has been completed.

[0831] This system allows customers to complete the contract procedure quickly and easily from a store or from home, and by utilizing AI, it is possible to provide accurate and consistent customer support.

[0832] The processing flow will be explained below.

[0833] Step 1:

[0834] A user accesses a mobile phone carrier's website or app via the network from a shop or home. The device receives the access request from the user and displays the home screen.

[0835] Step 2:

[0836] A user selects generative artificial intelligence (AI) customer support on a website or app. The device presents the user with the option to choose between chat or voice support. The user selects the format.

[0837] Step 3:

[0838] The device will launch AI support based on the selected format. The AI ​​will display or speak initial questions about contract type and plan selection. The user will answer the questions and specify the desired plan and options.

[0839] Step 4:

[0840] The AI ​​explains the details and features of the appropriate plan based on the user's answers. The user asks questions and the AI ​​responds. The user finally selects the plan they want.

[0841] Step 5:

[0842] The contract procedure will proceed based on the plan selected by the user. The terminal will notify the user of the need for identity verification and explain the procedure for electronic identity verification (eKYC).

[0843] Step 6:

[0844] The device instructs the user to upload an identification document (e.g., driver's license, My Number card). The user uploads an image of the identification document to the device.

[0845] Step 7:

[0846] The device sends the uploaded image data to the server. The server analyzes the received image data and automatically collates it with the identity verification information. The server then returns the collation results to the device.

[0847] Step 8:

[0848] The terminal notifies the user of the result of the verification. The user confirms that identity verification has been completed and selects to continue the contract procedure.

[0849] Step 9:

[0850] The user checks the contract details on the final confirmation screen. If there are no problems with the contract, the user presses the final confirmation button to confirm the contract. The server saves the contract information in the database.

[0851] Step 10:

[0852] The server notifies the terminal that the contract has been successfully completed. The terminal displays the message "Contract completed" to the user.

[0853] Example 1

[0854] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0855] Conventional systems require users to manually complete multiple steps when signing up for products or services, making the process time-consuming and cumbersome. Furthermore, the analog identity verification process makes it difficult to prevent fraudulent applications. Furthermore, customer support is often inconsistent, resulting in an unsatisfactory experience for users.

[0856] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0857] In this invention, the server includes: means for accepting access requests from a user terminal and displaying information about the contracted product; means for providing customer support using generative artificial intelligence and guiding the selection of contract type and plan; means for conducting electronic identity verification to verify the user's identity; means for analyzing images of verification documents uploaded by the user and verifying identity verification information; means for storing contract information in a database and sending a contract completion notification to the user terminal; and means for the generative artificial intelligence to interact with the user in real time. This allows users to easily complete complicated procedures and quickly complete contract procedures while preventing fraudulent applications. In addition, consistent customer support using AI is expected to improve the user experience.

[0858] "User terminal" is a general term for devices that are connected to a network and used to process contracts for products and services.

[0859] An "access request" is a request sent from a user terminal to a server via a network, requesting the display of a specific web page or data.

[0860] "Information about contracted products" is detailed data about products and services that can be selected by the user, including plan contents, fees, features, and the like.

[0861] "Generative artificial intelligence" refers to AI technology that is a program for interacting with users and has a guide function for handling contract procedures and inquiries.

[0862] "Customer support" refers to the assistance and guidance provided to users when selecting or subscribing to products or services, including answering questions and explaining procedures.

[0863] "Electronic identity verification" is a procedure for verifying a user's identity in an online environment, a process that involves the submission of verification documents and the analysis of that data.

[0864] "Verification documents" are official documents submitted to verify the identity of a user, and include driver's licenses and identification cards.

[0865] "Analysis" refers to the procedure for processing the image data of the verification document to extract and verify the necessary information.

[0866] "Matching" is the process of comparing and matching the data provided by the user with existing database information based on the information obtained from the analysis.

[0867] "Contract information" includes all data related to the contract, such as the plan and options selected by the user, personal information, etc.

[0868] A "database" is a system for systematically storing and managing data such as contract information.

[0869] The "contract completion notification" is a notification message sent from the server to notify the user that the contract procedure has been successfully completed.

[0870] "Real-time" refers to a state in which interactions with users and information processing are carried out immediately, and is characterized by a response without delay.

[0871] The present invention relates to a system for contracting for goods and services over a user-accessible network. The system is implemented by the following operations.

[0872] First, a user uses their own device (e.g., a PC or smartphone) to access a service provider's website or application via a network from a shop or home. The device receives the user's access request and displays the service provider's home screen.

[0873] Next, the user can select customer support using generative artificial intelligence (AI). The device prompts the user to choose chat or voice support as the AI ​​support format. Based on the selection, the AI ​​guides the user in selecting the appropriate contract type and plan. For example, if the user answers "Family plan" to the question "Which contract plan would you like to choose?", the AI ​​will explain the details and benefits of that plan.

[0874] As the contract procedure progresses, user identity verification is a necessary process for electronic user verification (eKYC). The terminal instructs the user to upload identification documents (e.g., driver's license or other official document). The user follows the instructions and uploads the identification documents to the terminal. The image data is then sent to the server. The server analyzes the received image data and extracts character information using, for example, OCR (optical character recognition) technology (e.g., OpenCV or Tesseract), and collates it with the identity verification information. The result of this collation is sent from the server back to the terminal and notified to the user.

[0875] After eKYC is complete, the user confirms the contract details on the final confirmation screen. When the user presses the final confirmation button to confirm the contract, the contract information is sent to the server. The server saves the contract information in the database and notifies the terminal that the contract has been successfully completed. The terminal displays a message to the user saying, "The contract has been completed."

[0876] For example, here are some specific examples:

[0877] Example 1: Procedures at home

[0878] Operation steps:

[0879] 1. The user accesses the service provider's website on their computer and the home screen appears.

[0880] 2. The user selects chat-style AI support.

[0881] 3. The AI ​​asks questions about the plan and options you want, and the user selects a family plan.

[0882] 4. The device prompts the user to upload a driver's license, and the user uploads an image. The server analyzes it and returns the match result.

[0883] 5. The user presses the final confirmation button and a notification stating "The contract has been completed" appears on the device.

[0884] Example 2: Shop procedure

[0885] Operation steps:

[0886] 1. The user accesses the home screen using a dedicated terminal in the shop.

[0887] 2. The user selects AI support in the form of voice support.

[0888] 3. The AI ​​will ask questions about the plan via voice, and the user will select the desired plan.

[0889] 4. The terminal instructs the user to upload the My Number card, and the user uploads the image. The server analyzes it and returns the matching results.

[0890] 5. The user presses the final confirmation button and a notification stating "The contract has been completed" appears on the device.

[0891] Example prompt sentence:

[0892] "I would like to sign up for a family cell phone plan at home. I would like to use my driver's license as identification. Please guide me through the contract process."

[0893] This system allows users to complete contract procedures quickly and easily from a shop or at home, and utilizes AI to provide consistent customer support and improve the user experience.

[0894] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0895] Step 1:

[0896] Users use their devices (PCs or smartphones) to access the service provider's websites and applications.

[0897] Input: The user enters a URL in a web browser or app and submits an access request.

[0898] Output: The device sends an HTTP request and the server returns a response such as HTML or JSON.

[0899] Specific operation: The service provider's home screen is displayed on the device.

[0900] Step 2:

[0901] Users can choose to receive customer support through generative artificial intelligence (AI).

[0902] Input: User selects support option (chat or voice) on the home screen.

[0903] Output: The device launches the selected AI support module.

[0904] Specific operation: The chatbot interface or voice input screen will be displayed on the device.

[0905] Step 3:

[0906] AI guides users in choosing contract types and plans.

[0907] Input: The user answers the AI's questions and specifies the desired contract plan and options.

[0908] Data processing: AI analyzes the user's answers and suggests an appropriate plan.

[0909] Output: The AI ​​explains the plan's features and benefits to the user.

[0910] Specific behavior: For example, the AI ​​asks, "Which contract plan would you like?" and the user answers, "Family plan."

[0911] Step 4:

[0912] Initiate the electronic know your customer (eKYC) process.

[0913] Input: The AI ​​prompts the user to upload their identification document. The user uploads an image of their identification document (e.g., driver's license).

[0914] Output: The device sends the image data to the server.

[0915] Specific operation: The user takes a photo of the verification document using the device's camera function and uploads it.

[0916] Step 5:

[0917] The server analyzes the image of the verification document received and verifies the identity verification information.

[0918] Input: The server receives the image data and extracts the text information using OCR technology (e.g., OpenCV or Tesseract).

[0919] Data calculation: The server checks the extracted information against an existing database.

[0920] Output: The matching result is returned to the terminal.

[0921] Specific operation: The server analyzes the contents of the verification document (name, address, etc.) and checks whether it matches the information registered in the database. The result of the match is notified to the terminal.

[0922] Step 6:

[0923] The user confirms the contract details on the final confirmation screen.

[0924] Input: The user confirms the match results sent from the server.

[0925] Output: The device displays a final confirmation screen.

[0926] Specific operation: The user confirms the contract details and presses the "Complete contract" button.

[0927] Step 7:

[0928] The contract information is sent to the server to complete the contract.

[0929] Input: When the user presses the final confirmation button, the contract information is sent to the server.

[0930] Output: The server saves the contract information to the database and sends a contract completion notification.

[0931] Specific operation: The contract information is stored in the database and the message "Contract completed" is displayed on the terminal.

[0932] In this way, this system allows users to easily complete complicated procedures, preventing fraudulent applications and quickly completing contract procedures. Furthermore, the use of AI will enable consistent customer support and an improved user experience.

[0933] (Application example 1)

[0934] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0935] One issue facing modern electronic payment services is the lack of a process that allows users to complete contract procedures quickly and easily. Conventional systems require users to visit a store in person, which takes time and effort. Furthermore, the electronic customer verification (eKYC) process is complicated, making it difficult for users to smoothly complete a contract. Furthermore, there is a lack of support using generative artificial intelligence, which can make it difficult for users to select an appropriate plan.

[0936] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0937] In this invention, the server includes means for receiving access requests from a user terminal and displaying information about the contracted product, means for providing customer support using generative artificial intelligence and guiding the selection of a contract type and plan, means for conducting electronic identity verification to verify the user's identity, means for analyzing the results of the electronic identity verification and proceeding with the contract procedure, means for saving the contract information in a database and sending a contract completion notification to the user terminal, means for using a smart device as the user terminal and conducting the contract procedure for the electronic payment service on the device, means for the user to select AI support in chat format or voice format and respond to the input based on a generative AI model, and means for receiving images of confirmation documents uploaded by the user and analyzing the images to verify the user's identity, thereby enabling the user to quickly and easily complete the contract procedure for the electronic payment service.

[0938] A "user terminal" is a device used by a user, and is equipment that can carry out contract procedures for products and services via a network.

[0939] An "access request" is a request sent from a user terminal to a server to initiate processing for displaying information about a contracted product.

[0940] "Generative AI" is an AI that independently interacts with users and guides them in selecting contract types and plans.

[0941] "Electronic identity verification" is a procedure that allows users to verify their identity online by analyzing images of verification documents and verifying identity information.

[0942] The "contract procedure" is a procedure in which the user confirms the necessary information based on the contract type and plan selected by the user and finally finalizes the contract.

[0943] A "database" is an information system for efficiently storing and managing contract information and user information.

[0944] The "contract completion notification" is a message that notifies the user that the contract procedure has been successfully completed.

[0945] "Smart devices" are digital devices with advanced computing power and communication functions, such as smartphones and smart glasses.

[0946] "Chat format" is a format in which users interact with generative artificial intelligence in a text-based manner.

[0947] The "voice format" is a format in which the user interacts with the generative artificial intelligence using voice.

[0948] A "generative AI model" is an artificial intelligence algorithm or program that automatically generates a response based on given information.

[0949] "Verification documents" are official documents required to verify the identity of a user, such as a driver's license or My Number card.

[0950] "Image analysis" is a technology that processes images of uploaded verification documents, recognizes their contents, and extracts information.

[0951] MODE FOR CARRYING OUT THE INVENTION

[0952] The program for the system for implementing this invention comprises the following means: A user uses a smart device (such as a smartphone or smart glasses) to complete contract procedures for a product or service. The server accepts an access request from the user terminal and displays information about the contracted product. In doing so, it utilizes a generative AI model to provide the user with appropriate guidance.

[0953] As an interface, users can choose chat or voice AI support. User input generates a response in real time based on the generative AI model. For example, if a user inputs, "I would like to sign up for a new credit card," the AI ​​will respond, "What kind of credit card plan would you like?" In this way, users can proceed with the contract process in an interactive manner.

[0954] The server then performs electronic identity verification (eKYC) to verify the user's identity. The user uses a smart device to upload an image of their identification document (such as a driver's license or My Number card). The image is sent to the server, which performs image analysis using OpenCV and the face_recognition library. The resulting identity verification information is then matched, facilitating electronic identity verification.

[0955] Once identity verification is complete, the server will provide instructions to the user to proceed with the contract. The contract information will be saved in the database, and the user will finally receive a contract completion notification. For example, a prompt such as "I'm interested in the family plan" can be used, and after confirmation, a message will be displayed saying "Contract completed."

[0956] Specific examples of main processing flows

[0957] 1. Access request from user: The user accesses the application on a smart device and sends a request to the server.

[0958] 2. Displaying contracted product information: The server displays contracted product information on the user terminal.

[0959] 3. Guided by a generative AI model: The user enters, "I would like to sign up for a new credit card," and the generative AI model responds, "What kind of credit card plan would you like?"

[0960] 4. Electronic Identity Verification (eKYC): The user uploads an image of their driver's license using a smart device, and the server performs image analysis using OpenCV and the face_recognition library to verify the user's identity.

[0961] 5. Contract procedure progress: Based on the analysis results, the server proceeds with the contract procedure and saves the contract information in the database.

[0962] 6. Contract completion notification: After the user makes a final confirmation, the server sends a notification to the user terminal stating that the contract has been completed.

[0963] Prompt Sentence Examples

[0964] I want to apply for a new credit card.

[0965] "Please tell me more about the women's plan."

[0966] "I'm interested in a family plan."

[0967] The system allows users to quickly and easily complete contract procedures for electronic payment services using their smart devices, and utilizes generative AI models to provide appropriate and consistent customer support.

[0968] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0969] Step 1:

[0970] The user terminal accesses the contract application. The user launches the contract application using a smart device such as a smartphone or smart glasses. The terminal sends an access request to the server. This request includes the user's identification information.

[0971] Step 2:

[0972] The server accepts the access request. The server analyzes the received access request and retrieves information about the contracted product from the database. The information about the contracted product is then displayed on the user's device. At this stage, the generative artificial intelligence (AI) is ready to support the user.

[0973] Step 3:

[0974] Users can choose chat or voice support from the generative AI model. Users select "chat" or "voice" and type or speak questions about their desired contract product or service plan.

[0975] Step 4:

[0976] The server passes the input to the generative AI model, which generates a response. The server sends the user's input as a prompt to the generative AI model, which generates an appropriate response. For example, if the user enters, "I would like to sign up for a new credit card," the AI ​​replies, "What kind of credit card plan would you like?"

[0977] Step 5:

[0978] The user selects the desired contract plan. The user is guided by the generative AI model to select the contract type and plan. The selected information is sent to the server, which determines the next step based on the contract plan.

[0979] Step 6:

[0980] The server instructs the user to start electronic identity verification (eKYC), and the user uses a smart device to upload an image of a verification document such as a driver's license or My Number card.

[0981] Step 7:

[0982] The server receives the uploaded image of the verification document and performs image analysis. The server uses OpenCV and the face_recognition library to analyze the received image. Specifically, it performs facial recognition and character recognition (OCR) in the image to extract identity verification information. Based on this analysis, it compares it with existing information in the database.

[0983] Step 8:

[0984] The server notifies the user of the results of the electronic identity verification. If the analysis is successful, the server sends the user a message saying "Identity verification completed." If the analysis is unsuccessful, the server displays the message "Identity verification failed. Please try again."

[0985] Step 9:

[0986] The user performs a final confirmation and completes the contract procedure. After identity verification is complete, the server displays a final confirmation screen for the contract details. The user confirms the contract details and presses the "Final Confirmation" button.

[0987] Step 10:

[0988] The server saves the contract information in a database and sends a contract completion notice to the user. The server saves the final confirmation information in a database and notifies the user that the contract has been successfully completed. The message "The contract has been completed" is displayed on the user's terminal.

[0989] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0990] The present invention provides a system for providing customer support using generative artificial intelligence and an emotion engine when a user makes a contract for a product or service over a network. This system is implemented by the following operations.

[0991] First, a user accesses a mobile phone carrier's website or app via the network from a shop or home using a device. The device receives the access request from the user and displays the home screen.

[0992] Next, the user selects customer support via generative artificial intelligence (AI). The device presents the user with the option to choose between chat or voice support. Once the user selects the format, the device activates the AI ​​and begins guiding them based on the selected format.

[0993] The AI ​​guides users through the process of selecting a contract type and plan, as well as various procedures. Users specify the plan and options they want through questions and selections. The AI ​​explains the features and benefits of the selected plan and answers any questions the user may have, if necessary.

[0994] At this time, an emotion engine runs in parallel, analyzing the user's emotions in real time. The emotion engine analyzes the user's emotional data acquired through chat and voice support, and dynamically adjusts the AI's response content based on the user's emotions.

[0995] When proceeding with the contract procedure, electronic identity verification (eKYC) is used. The terminal instructs the user to upload identification documents (e.g., driver's license, My Number card). The user uploads the identification document, and the image data is sent to the server. The server analyzes the received image data and automatically collates the identification information. The server returns the result of the collation to the terminal and notifies the user.

[0996] After eKYC is complete, the user checks the contract details on the final confirmation screen. If there are no problems with the contract, the user presses the final confirmation button to confirm the contract. The server saves the contract information in the database and notifies the terminal that the contract has been successfully completed. The terminal displays this notification to the user and displays the message "The contract has been completed."

[0997] A specific example is given below.

[0998] Example 1: Procedures at home

[0999] The user accesses the mobile phone company's website from their computer at home. The user selects chat-style AI support, and the AI ​​asks questions about the plan and options they wish to sign up for. The user selects a family plan and proceeds with the contract procedure. eKYC is performed using a driver's license, and the user uploads an image of the license. The server analyzes the image to verify the user's identity, and the contract details are confirmed on the final confirmation screen. When the user presses the final confirmation button to confirm the contract, the system displays a notification that "the contract has been completed." At this time, the emotion engine analyzes the user's emotions in real time and adjusts the AI's response to provide the user with the most appropriate support.

[1000] Example 2: Shop procedure

[1001] The user selects voice-based AI support using a dedicated terminal in the shop. The AI ​​asks questions about plans via voice, and the user selects the plan they want. eKYC is performed using the My Number card, and the user uploads an image. The server analyzes the image and verifies the user's identity. The user confirms the contract details on the final confirmation screen, and presses the final confirmation button to complete the contract. The system displays a notification that the contract has been completed. The emotion engine analyzes the user's emotional changes and triggers appropriate responses and responses, providing high-quality support to the user.

[1002] This system allows customers to complete the contract process quickly and easily from home or in a store, and also allows them to receive more personalized support thanks to the emotional engine.

[1003] The processing flow will be explained below.

[1004] The present invention provides a system for providing customer support using generative artificial intelligence and an emotion engine when a user makes a contract for a product or service over a network. This system is implemented by the following operations.

[1005] Step 1:

[1006] A user accesses a mobile phone carrier's website or app via the network from a shop or home. The device receives the access request from the user and displays the home screen.

[1007] Step 2:

[1008] A user selects generative artificial intelligence (AI) customer support on a website or app. The device presents the user with the option to choose between chat or voice support. The user selects the format.

[1009] Step 3:

[1010] Based on the user's selection, the device will activate AI support. The AI ​​will ask the user initial questions about the contract type and plan selection via chat or voice. The emotion engine will analyze the user's emotions in real time.

[1011] Step 4:

[1012] Users answer questions and specify the plan and options they want to sign up for. The AI ​​explains the plan's features and benefits based on the user's answers. At the same time, the emotion engine dynamically adjusts the response based on the user's emotions.

[1013] Step 5:

[1014] The user finally selects the plan they want, and the terminal then explains to the user the steps for electronic customer verification (eKYC) required to proceed with the contract procedure.

[1015] Step 6:

[1016] The device requests the user to upload an identification document (e.g., driver's license, My Number card). The user uploads an image of the identification document to the device.

[1017] Step 7:

[1018] The device sends the uploaded image data to the server. The server analyzes the received image data and automatically collates it with the personal identification information. The server returns the collation results to the device.

[1019] Step 8:

[1020] The terminal notifies the user of the result of the verification, and after the user has completed the identity verification, the user can continue with the contract procedure.

[1021] Step 9:

[1022] The user checks the contract details on the final confirmation screen. If there are no problems, the user presses the final confirmation button to confirm the contract. The server saves the contract information in the database.

[1023] Step 10:

[1024] The server notifies the terminal that the contract has been successfully completed. The terminal displays the message "Contract completed" to the user.

[1025] As a specific example, there is the following case.

[1026] Example 1: Procedures at home

[1027] The user accesses the mobile phone company's website from their computer at home. The user selects chat-style AI support, and the AI ​​asks questions about the plan and options they wish to sign up for. The user selects a family plan, and the AI ​​explains the features of the selected plan. As the contract procedure progresses, the device performs eKYC using the user's driver's license. The user uploads an image of their driver's license, which the server analyzes to verify their identity. The user confirms the contract details on the final confirmation screen and presses the final confirmation button to confirm the contract. The system displays a notification that the contract has been completed. During this process, the emotion engine analyzes the user's emotions and adjusts the AI's responses to provide the user with optimal support.

[1028] Example 2: Shop procedure

[1029] The user uses a dedicated terminal in the shop to select voice-based AI support. The AI ​​asks questions about plans via voice, and the user selects the plan they want. The terminal then performs eKYC using their My Number card. The user uploads an image of their My Number card, and the server analyzes the image to verify their identity. The user checks the contract details on the final confirmation screen, and presses the final confirmation button to complete the contract. The system displays a notification that the contract has been completed. The emotion engine analyzes the user's emotional changes and triggers appropriate responses and responses, providing high-quality support to the user.

[1030] The system allows customers to complete the contract process quickly and easily from a store or at home, and receives more personalized support thanks to an emotion engine.

[1031] Example 2

[1032] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1033] Conventional systems have faced challenges when users sign contracts for products or services over the network, including the need for complex procedures and the lack of appropriate support to resolve any questions that arise. Furthermore, personalized support based on the user's emotional state was not provided, leaving a need for an improved user experience.

[1034] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for receiving an access request from a user terminal and displaying information about the contracted product; means for providing customer support using generative artificial intelligence and guiding the selection of a contract type and plan; means for performing electronic identity verification to verify the user's identity; means for analyzing the user's emotions in real time and dynamically adjusting the AI's response content based on the user's emotions; means for analyzing the results of the electronic identity verification and proceeding with the contract procedure; and means for storing the contract information in a database and sending a contract completion notification to the user terminal. This allows the user's procedures to be completed easily and quickly, and further makes it possible to provide optimal support according to the user's emotional state.

[1035] A "network" is a communications infrastructure that connects user terminals and servers and allows data to be sent and received.

[1036] A "user terminal" refers to a device used by a user, such as a personal computer or smartphone, that is used to access a server via a network.

[1037] "Generative AI" is an AI system that responds to user questions and requests using natural language processing and learning algorithms.

[1038] "Customer support" refers to a general service that provides information and guidance on procedures required when users sign contracts for products or services.

[1039] "Contract type" refers to the type of product or service provided or plan structure selected by the user.

[1040] "Plan" means the specific terms, conditions, and pricing offered for a particular product or service.

[1041] "Electronic Customer Verification (eKYC)" is a process that analyzes image data of identification documents to verify a user's identity online.

[1042] The "emotion engine" is a system that analyzes the user's emotions in real time and dynamically adjusts the response content based on that information.

[1043] A "database" is an information system for systematically storing and managing contract information and user-related information.

[1044] The "contract completion notification" is an information message used to notify the user terminal that the user's contract procedures have been successfully completed.

[1045] This invention is a system that provides customer support using a generative artificial intelligence and an emotion engine when a user contracts for products or services over a network. This system includes hardware and software such as a user terminal, a server, the generative artificial intelligence, the emotion engine, an electronic customer verification (eKYC) system, and a database.

[1046] System Configuration

[1047] User terminal: A device used by a user, such as a PC or smartphone. The user terminal sends access requests from the user to the server, receives responses from the server, and displays them.

[1048] Server: A server that accepts requests from user devices and provides information on contracted products. The server also analyzes the user's emotional data, performs electronic customer verification (eKYC), and proceeds with the contract procedure.

[1049] Generative artificial intelligence (AI): A system that responds to user questions and requests using natural language processing and learning algorithms. AI guides users through the process by guiding them through the selection of contract types and plans.

[1050] Emotion engine: A system that analyzes user emotions in real time and dynamically adjusts the AI's response based on that information.

[1051] Electronic identity verification (eKYC) system: A system that analyzes image data of identity verification documents uploaded by users to verify their identity. The server compares the identity verification information with a database.

[1052] Database: An information system that systematically stores and manages contract information and user-related information.

[1053] Hardware and software used

[1054] Hardware: User devices (PCs, smartphones), servers

[1055] Software: Generative AI model, emotion engine, eKYC system, database management system

[1056] Detailed explanation of operation

[1057] 1. User Access and Home Screen Display:

[1058] Users access the mobile phone company's website or app via a network using a user terminal from home or a shop.

[1059] The server accepts an access request from the user terminal and transmits home screen data to the user terminal.

[1060] The user terminal displays the home screen based on the received data.

[1061] 2. Customer Support Options:

[1062] Users can opt into generative AI customer support and choose between chat or voice support.

[1063] The user's device notifies the server of the user's selection, and the server activates the generative AI.

[1064] 3. Contract type and plan selection guide:

[1065] The generative AI guides users in selecting contract types and plans and responds to their questions.

[1066] Based on data provided by the server, the AI ​​explains the features and benefits of each plan to users.

[1067] 4. Sentiment Analysis and Response Adjustment:

[1068] The emotion engine analyzes the user's emotions in real time based on the user's chat and voice data.

[1069] The generative AI adjusts the response to the user based on the analysis results of the emotion engine.

[1070] 5. Electronic Identity Verification (eKYC):

[1071] The user will be prompted to upload identification documents.

[1072] The server analyzes the uploaded image data and compares the personal identification information with a database.

[1073] 6. Final confirmation and completion of the contract:

[1074] After completing eKYC, the user will confirm the contract details on the final confirmation screen.

[1075] When the user presses the final confirmation button, the server saves the contract information in a database and notifies the user terminal that the contract has been completed.

[1076] The user terminal displays the message "Contract completed."

[1077] Specific examples

[1078] Example 1: Procedures at home

[1079] A user accesses a mobile phone company's website from a computer at home.

[1080] Users can choose chat-based AI support and select a family plan.

[1081] Users will complete eKYC using their driver's license and upload an image.

[1082] The server analyzes the image to verify the identity of the user, and then confirms the contract details on the final confirmation screen.

[1083] When the user presses the final confirmation button to confirm the contract, a notification stating "Contract completed" is displayed.

[1084] The emotion engine analyzes and adjusts the AI's response.

[1085] Example 2: Shop procedure

[1086] The user selects AI support in the form of voice support using a dedicated terminal in the shop.

[1087] The AI ​​will ask questions about the plan via voice, and the user will be able to select the plan they want.

[1088] Users will use their My Number card to complete eKYC and upload an image.

[1089] The server analyzes the image and verifies the identity of the person.

[1090] The user confirms the contract details on the final confirmation screen and presses the final confirmation button to complete the contract.

[1091] A notification will appear stating that the contract has been completed.

[1092] The emotion engine analyzes the user's emotional changes and triggers appropriate responses.

[1093] Prompt Sentence Examples

[1094] "I'm interested in a family plan. Which plan is best for me?"

[1095] "I would like to proceed with the contract procedures, so please let me know what documents I need."

[1096] "I don't understand how to do eKYC. Please explain."

[1097] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1098] Step 1:

[1099] Receiving an access request

[1100] User: From home or a shop, the user uses a user device (PC or smartphone) to access the mobile phone carrier's website or app via the network.

[1101] Input: Access request from user device (URL request)

[1102] Terminal: Sends an access request to the server.

[1103] Server: Accepts access requests and generates home screen data.

[1104] Output: Home screen data (HTML and JSON format)

[1105] Device: Receives the home screen data and displays it to the user.

[1106] Specific operation: A user accesses a mobile phone company's website using a browser or a dedicated app, and the request is sent to the server, which then generates the corresponding homepage content and returns it to the user's device.

[1107] Step 2:

[1108] Selecting a support format

[1109] Users: Select Generative AI Support from the home screen and choose between chat or voice support.

[1110] Input: Support data of the user's choice (chat or voice)

[1111] Terminal: Notifies the server of the user's choice.

[1112] Server: Launches AI based on the support format and generates initial guide information.

[1113] Output: Initial guide information (text or audio data)

[1114] Terminal: Display or play initial guide information to the user.

[1115] Specific operation: The user selects the desired support format (chat or voice) from the options on the screen, and that information is sent to the server, which then activates the corresponding AI-guided mode to provide the user with initial guidance.

[1116] Step 3:

[1117] Contract type and plan selection guide

[1118] Terminal: Displays the AI's guide screen to the user.

[1119] User: Enters questions about the contract type and plan into the AI.

[1120] Input: User question data (text or voice input)

[1121] AI (on the server): Analyzes user data and generates information on the appropriate contract plan.

[1122] Output: Contract plan information (text or audio data)

[1123] Device: Display or play subscription plan information to the user.

[1124] Specific operation: The user enters questions about the contract type and plan, and the AI ​​analyzes the data and provides detailed information about the most suitable contract plan.

[1125] Step 4:

[1126] Sentiment Analysis and Response Adjustment

[1127] Terminal: Sends user chat and voice data to the emotion engine.

[1128] Input: User chat or voice data

[1129] Emotion engine (on the server): Analyzes user emotions in real time.

[1130] Output: Emotion analysis results (emotional state data)

[1131] AI (in the server): Dynamically adjusts responses to users based on the results of sentiment analysis.

[1132] Output: Tailored response (text or audio data)

[1133] Terminal: Displays or plays the adjusted response to the user.

[1134] Specific operation: The emotion engine analyzes chat and voice data entered by the user, and adjusts the AI's response based on the user's emotional state.

[1135] Step 5:

[1136] Electronic identity verification (eKYC)

[1137] On the device: Prompt the user to upload their identification documents.

[1138] Input: Image data of the ID document uploaded by the user

[1139] User: Upload an image of their ID.

[1140] Terminal: Sends the uploaded image data to the server.

[1141] Server: Analyzes the image data and automatically checks the identity information against a database.

[1142] Output: Matching result (identity verification success or failure)

[1143] Terminal: Display the match results to the user.

[1144] Specific operation: The user uploads identification documents such as a driver's license or My Number card, and the data is analyzed on the server to complete identity verification.

[1145] Step 6:

[1146] Final confirmation of contract details and completion of contract

[1147] User: Check the contract details on the final confirmation screen.

[1148] Input: Click of final confirmation button (user operation data)

[1149] Terminal: Sends user operation data to the server.

[1150] Server: Saves the contract information in a database and notifies the terminal when the contract is completed.

[1151] Output: Contract completion notification data

[1152] On the device: Display a contract completion notification to the user, displaying the message "Contract completed."

[1153] Specific operation: The user confirms the contract details and presses the final confirmation button if there are no problems. The server then saves the contract information and sends a contract completion notice to the terminal, which then displays the completion notice to the user.

[1154] (Application example 2)

[1155] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1156] Conventionally, when users contract for products or services over a network, they sometimes find it difficult to select the contract type or plan they desire, and it is also difficult to receive personalized support throughout the entire process. This can result in a poor user experience. Furthermore, there is also the problem of increased stress during the contract process due to fixed responses that do not take into account the user's emotional data. The present invention aims to solve these problems and provide users with optimal support that responds to their emotions.

[1157] The specification processing by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for accepting an access request from a user terminal and displaying information about the contract product, means for providing customer support using generative artificial intelligence and guiding the selection of a contract type and plan, means for conducting electronic identity verification to verify the user's identity, means for analyzing the results of the electronic identity verification and proceeding with the contract procedure, means for storing the contract information in a database and sending a contract completion notification to the user terminal, and means for analyzing the user's emotional data using an emotion analysis device and dynamically adjusting the response of the generative artificial intelligence based on the user's emotions. This allows the user to easily complete the contract procedure via a network and complete the contract with peace of mind while receiving personalized support based on the emotional data.

[1158] A "network" is a system in which computers and devices in different locations are connected to each other using multiple communication methods, enabling the exchange of information.

[1159] "Generative AI" is AI that has the ability to automatically generate responses and suggestions based on user input.

[1160] "Customer support" refers to a service that provides information and assistance with procedures necessary when a user signs a contract for a product or service.

[1161] "Contract type" refers to the method of providing products and services and the types of plans that users can select.

[1162] "Plan selection" refers to a user selecting an appropriate plan from multiple subscription options based on their needs and preferences.

[1163] "Electronic identity verification" is the process of verifying your identity online using an image or digital information of your ID uploaded by the user.

[1164] "Emotion data" is data that indicates the emotional state of a user extracted from facial expressions, voice, text, and the like.

[1165] An "emotion analysis device" is a device that analyzes a user's emotional data in real time and provides appropriate responses and suggestions based on the results.

[1166] "Dynamic adjustment" refers to making instant changes and optimizations based on given conditions and circumstances.

[1167] The "contract completion notification" is a communication message to notify the user that all contract procedures have been completed.

[1168] A "database" is a system for efficiently storing, managing, and searching large amounts of data.

[1169] MODE FOR CARRYING OUT THE INVENTION

[1170] The present invention provides a system for providing customer support using generative artificial intelligence and an emotion analysis device when a user makes a contract for a product or service via a network. This system is implemented with the following configuration.

[1171] First, a user uses a terminal (such as a smartphone or PC) to access a website or application that provides the product or service they wish to subscribe to via a network. This access request is sent to a server, which then displays information about the contracted product on the user's terminal.

[1172] Next, the user selects customer support via generative AI. The user device presents the user with the option to choose between chat or voice support. Once the user selects the format, the corresponding generative AI is activated, providing guidance on selecting a contract type and plan. The generative AI responds to the user's questions in real time and helps them select the most appropriate plan.

[1173] At this time, an emotion analysis device operates in parallel, analyzing the user's emotional data in real time. This emotion analysis includes, for example, facial expressions, tone of voice, and text content. The emotion analysis device dynamically adjusts the response content of the generative AI based on the analysis results, providing optimal support based on the user's emotions.

[1174] If user identity verification is required during the contract procedure, electronic user verification (eKYC) is carried out. To do this, the server instructs the user to upload an identity verification document (such as a driver's license or My Number card). The user's device takes a photo of the image data and sends it to the server.

[1175] The server analyzes the received image data and performs electronic identity verification. The analyzed identity verification information is automatically compared with the information registered in the database. Once identity verification is complete, the server displays a final confirmation screen on the user's device. The user confirms the contract details and presses the final confirmation button to finalize the contract. The server saves the contract information in the database and sends a contract completion notification to the user's device.

[1176] As a concrete example, the following scenario can be considered.

[1177] Example 1: Procedure via home network

[1178] The user opens the online shopping site's app on their smartphone at home and selects the "Smart Shopping Support" function. When the user selects chat-style AI support, a generative artificial intelligence is activated, guiding the user in selecting products and plans to purchase. At this time, an emotion analyzer operates in parallel, analyzing the user's emotional data and adjusting the AI's response. When the user takes a photo of their driver's license with their smartphone and uploads it, the server analyzes the image to verify the user's identity. After confirming the contract details on the final confirmation screen and pressing the final confirmation button, the system displays a notification that the contract has been completed.

[1179] Example prompt sentence:

[1180] A user opens an online shopping app on their smartphone and uses smart shopping support. First, the user accesses the online store and selects AI chat support. The user selects the category of product they want, and the AI ​​recommends the best products in that category. At this time, the emotion engine analyzes the user's preferences in real time and recommends products based on their emotions. Furthermore, when proceeding to the purchase process, the eKYC module prompts the user to upload their driver's license. The uploaded image is sent to the server, where identity verification is completed after analysis. After confirming the purchase details on the final confirmation screen, the user presses the final confirmation button to complete the purchase.

[1181] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1182] Step 1:

[1183] A user uses a smartphone or PC to access an application or website on an online shopping site. The device sends an access request to the server, and the server displays information about the contracted product on the user's device. The input here is the user's access request, and the output is a screen containing information about the contracted product.

[1184] Step 2:

[1185] The user selects customer support via generative artificial intelligence. The device displays an option to the user to choose between chat or voice, and the user selects the desired format. The input is the support format selected by the user, and the output is the launch of the corresponding generative artificial intelligence.

[1186] Step 3:

[1187] Based on the format selected by the user, a generative AI is launched. The generative AI presents the user with questions regarding the contract type and plan selection. The user responds to these questions, and the user's response data is sent from the terminal to the server. The input is the user's response data, and the output is the guide questions of the generative AI.

[1188] Step 4:

[1189] In parallel, an emotion analysis device operates, analyzing the user's emotional data in real time. The emotion analysis device takes the user's facial expressions, voice tone, and text content as input, analyzes them, and outputs emotional data. The emotional data is sent to the generative AI, which dynamically adjusts the response content according to the user's emotions. The input is the user's emotional data, and the output is the adjusted response of the generative AI.

[1190] Step 5:

[1191] In order for the user to proceed with the contract procedure, an electronic identity verification (eKYC) guide is displayed. The server requests the user to upload their identity verification document, and the terminal sends the uploaded image data to the server. The input is the image data of the identity verification document uploaded by the user, and the output is the image data sent to the server.

[1192] Step 6:

[1193] The server analyzes the received image data and automatically verifies the identity of the user. This is done using image recognition technology and OCR (optical character recognition). The analysis results are compared in a database as identity verification information. The input is the uploaded image data, and the output is the result of whether or not identity verification has been completed.

[1194] Step 7:

[1195] Once identity verification is complete, the server displays a final confirmation screen on the user's terminal. The user checks the contract details and presses the final confirmation button. The input is an instruction from the server to display the final confirmation screen, and the output is the user's final confirmation action.

[1196] Step 8:

[1197] When the user presses the final confirmation button, the server saves the contract information in the database and sends a contract completion notice to the user's terminal. The terminal displays the message "The contract has been completed" to the user. The input is the user's final confirmation action, and the output is the display of the contract completion notice.

[1198] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1199] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1200] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1201] [Fourth embodiment]

[1202] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1203] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1204] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1205] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1206] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1207] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1208] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1209] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1210] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1211] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1212] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1213] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1214] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1215] The present invention relates to a system for contracting for goods and services over a user-accessible network. The system is implemented by the following operations.

[1216] First, a user uses a device to access a mobile phone carrier's website or app via the network from a shop or home. The device receives the access request from the user and displays the mobile phone carrier's home screen.

[1217] Next, the user selects customer support provided by generative artificial intelligence (AI). The device allows the user to select chat or voice support as the AI ​​support format, and the AI ​​begins providing guidance based on the selected format. The AI ​​guides the user through the contract type, plan selection, and various procedures. The user specifies the desired plan and options through questions and selections. The AI ​​explains the features and benefits of the selected plan and answers the user's questions as needed.

[1218] When proceeding with the contract procedure, eKYC (electronic identity verification) is used. The terminal instructs the user to upload identification documents (e.g., driver's license, My Number card). The user uploads the identification documents to the terminal, and the image data is sent to the server. The server analyzes the received image data and automatically collates the identification information. The result of the collation is sent back from the server to the terminal and notified to the user.

[1219] After eKYC is complete, the user checks the contract details on the final confirmation screen. If there are no problems with the contract, the user presses the final confirmation button to confirm the contract. The server saves the contract information in the database and notifies the terminal that the contract has been successfully completed. The terminal displays this notification to the user and displays the message "The contract has been completed."

[1220] For example, when a user signs up for a mobile phone at home, the process proceeds as follows.

[1221] Example 1: Procedures at home

[1222] The user accesses the mobile phone company's website on their computer and selects chat-style AI support. The AI ​​asks questions about the plan and options they wish to sign up for, and the user selects a family plan. As they go through the contract process, eKYC is carried out using their driver's license. The user uploads an image of their driver's license, which the server analyzes to verify their identity. The user checks the contract details on the final confirmation screen and presses the final confirmation button to complete the contract. The system displays a notification that "the contract has been completed."

[1223] Example 2: Shop procedure

[1224] The user uses a dedicated terminal in the shop to select voice-based AI support. The AI ​​asks questions about the plan via voice, and the user selects the plan they want. eKYC is performed using the My Number card, and identity verification is completed. The user checks the contract details and presses the final confirmation button to complete the contract. The system displays a notification that the contract has been completed.

[1225] This system allows customers to complete the contract procedure quickly and easily from a store or from home, and by utilizing AI, it is possible to provide accurate and consistent customer support.

[1226] The processing flow will be explained below.

[1227] Step 1:

[1228] A user accesses a mobile phone carrier's website or app via the network from a shop or home. The device receives the access request from the user and displays the home screen.

[1229] Step 2:

[1230] A user selects generative artificial intelligence (AI) customer support on a website or app. The device presents the user with the option to choose between chat or voice support. The user selects the format.

[1231] Step 3:

[1232] The device will launch AI support based on the selected format. The AI ​​will display or speak initial questions about contract type and plan selection. The user will answer the questions and specify the desired plan and options.

[1233] Step 4:

[1234] The AI ​​explains the details and features of the appropriate plan based on the user's answers. The user asks questions and the AI ​​responds. The user finally selects the plan they want.

[1235] Step 5:

[1236] The contract procedure will proceed based on the plan selected by the user. The terminal will notify the user of the need for identity verification and explain the procedure for electronic identity verification (eKYC).

[1237] Step 6:

[1238] The device instructs the user to upload an identification document (e.g., driver's license, My Number card). The user uploads an image of the identification document to the device.

[1239] Step 7:

[1240] The device sends the uploaded image data to the server. The server analyzes the received image data and automatically collates it with the identity verification information. The server then returns the collation results to the device.

[1241] Step 8:

[1242] The terminal notifies the user of the result of the verification. The user confirms that identity verification has been completed and selects to continue the contract procedure.

[1243] Step 9:

[1244] The user checks the contract details on the final confirmation screen. If there are no problems with the contract, the user presses the final confirmation button to confirm the contract. The server saves the contract information in the database.

[1245] Step 10:

[1246] The server notifies the terminal that the contract has been successfully completed. The terminal displays the message "Contract completed" to the user.

[1247] Example 1

[1248] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1249] Conventional systems require users to manually complete multiple steps when signing up for products or services, making the process time-consuming and cumbersome. Furthermore, the analog identity verification process makes it difficult to prevent fraudulent applications. Furthermore, customer support is often inconsistent, resulting in an unsatisfactory experience for users.

[1250] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1251] In this invention, the server includes: means for accepting access requests from a user terminal and displaying information about the contracted product; means for providing customer support using generative artificial intelligence and guiding the selection of contract type and plan; means for conducting electronic identity verification to verify the user's identity; means for analyzing images of verification documents uploaded by the user and verifying identity verification information; means for storing contract information in a database and sending a contract completion notification to the user terminal; and means for the generative artificial intelligence to interact with the user in real time. This allows users to easily complete complicated procedures and quickly complete contract procedures while preventing fraudulent applications. In addition, consistent customer support using AI is expected to improve the user experience.

[1252] "User terminal" is a general term for devices that are connected to a network and used to process contracts for products and services.

[1253] An "access request" is a request sent from a user terminal to a server via a network, requesting the display of a specific web page or data.

[1254] "Information about contracted products" is detailed data about products and services that can be selected by the user, including plan contents, fees, features, and the like.

[1255] "Generative artificial intelligence" refers to AI technology that is a program for interacting with users and has a guide function for handling contract procedures and inquiries.

[1256] "Customer support" refers to the assistance and guidance provided to users when selecting or subscribing to products or services, including answering questions and explaining procedures.

[1257] "Electronic identity verification" is a procedure for verifying a user's identity in an online environment, a process that involves the submission of verification documents and the analysis of that data.

[1258] "Verification documents" are official documents submitted to verify the identity of a user, and include driver's licenses and identification cards.

[1259] "Analysis" refers to the procedure for processing the image data of the verification document to extract and verify the necessary information.

[1260] "Matching" is the process of comparing and matching the data provided by the user with existing database information based on the information obtained from the analysis.

[1261] "Contract information" includes all data related to the contract, such as the plan and options selected by the user, personal information, etc.

[1262] A "database" is a system for systematically storing and managing data such as contract information.

[1263] The "contract completion notification" is a notification message sent from the server to notify the user that the contract procedure has been successfully completed.

[1264] "Real-time" refers to a state in which interactions with users and information processing are carried out immediately, and is characterized by a response without delay.

[1265] The present invention relates to a system for contracting for goods and services over a user-accessible network. The system is implemented by the following operations.

[1266] First, a user uses their own device (e.g., a PC or smartphone) to access a service provider's website or application via a network from a shop or home. The device receives the user's access request and displays the service provider's home screen.

[1267] Next, the user can select customer support using generative artificial intelligence (AI). The device prompts the user to choose chat or voice support as the AI ​​support format. Based on the selection, the AI ​​guides the user in selecting the appropriate contract type and plan. For example, if the user answers "Family plan" to the question "Which contract plan would you like to choose?", the AI ​​will explain the details and benefits of that plan.

[1268] As the contract procedure progresses, user identity verification is a necessary process for electronic user verification (eKYC). The terminal instructs the user to upload identification documents (e.g., driver's license or other official document). The user follows the instructions and uploads the identification documents to the terminal. The image data is then sent to the server. The server analyzes the received image data and extracts character information using, for example, OCR (optical character recognition) technology (e.g., OpenCV or Tesseract), and collates it with the identity verification information. The result of this collation is sent from the server back to the terminal and notified to the user.

[1269] After eKYC is complete, the user confirms the contract details on the final confirmation screen. When the user presses the final confirmation button to confirm the contract, the contract information is sent to the server. The server saves the contract information in the database and notifies the terminal that the contract has been successfully completed. The terminal displays a message to the user saying, "The contract has been completed."

[1270] For example, here are some specific examples:

[1271] Example 1: Procedures at home

[1272] Operation steps:

[1273] 1. The user accesses the service provider's website on their computer and the home screen appears.

[1274] 2. The user selects chat-style AI support.

[1275] 3. The AI ​​asks questions about the plan and options you want, and the user selects a family plan.

[1276] 4. The device prompts the user to upload a driver's license, and the user uploads an image. The server analyzes it and returns the match result.

[1277] 5. The user presses the final confirmation button and a notification stating "The contract has been completed" appears on the device.

[1278] Example 2: Shop procedure

[1279] Operation steps:

[1280] 1. The user accesses the home screen using a dedicated terminal in the shop.

[1281] 2. The user selects AI support in the form of voice support.

[1282] 3. The AI ​​will ask questions about the plan via voice, and the user will select the desired plan.

[1283] 4. The terminal instructs the user to upload the My Number card, and the user uploads the image. The server analyzes it and returns the matching results.

[1284] 5. The user presses the final confirmation button and a notification stating "The contract has been completed" appears on the device.

[1285] Example prompt sentence:

[1286] "I would like to sign up for a family cell phone plan at home. I would like to use my driver's license as identification. Please guide me through the contract process."

[1287] This system allows users to complete contract procedures quickly and easily from a shop or at home, and utilizes AI to provide consistent customer support and improve the user experience.

[1288] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1289] Step 1:

[1290] Users use their devices (PCs or smartphones) to access the service provider's websites and applications.

[1291] Input: The user enters a URL in a web browser or app and submits an access request.

[1292] Output: The device sends an HTTP request and the server returns a response such as HTML or JSON.

[1293] Specific operation: The service provider's home screen is displayed on the device.

[1294] Step 2:

[1295] Users can choose to receive customer support through generative artificial intelligence (AI).

[1296] Input: User selects support option (chat or voice) on the home screen.

[1297] Output: The device launches the selected AI support module.

[1298] Specific operation: The chatbot interface or voice input screen will be displayed on the device.

[1299] Step 3:

[1300] AI guides users in choosing contract types and plans.

[1301] Input: The user answers the AI's questions and specifies the desired contract plan and options.

[1302] Data processing: AI analyzes the user's answers and suggests an appropriate plan.

[1303] Output: The AI ​​explains the plan's features and benefits to the user.

[1304] Specific behavior: For example, the AI ​​asks, "Which contract plan would you like?" and the user answers, "Family plan."

[1305] Step 4:

[1306] Initiate the electronic know your customer (eKYC) process.

[1307] Input: The AI ​​prompts the user to upload their identification document. The user uploads an image of their identification document (e.g., driver's license).

[1308] Output: The device sends the image data to the server.

[1309] Specific operation: The user takes a photo of the verification document using the device's camera function and uploads it.

[1310] Step 5:

[1311] The server analyzes the image of the verification document received and verifies the identity verification information.

[1312] Input: The server receives the image data and extracts the text information using OCR technology (e.g., OpenCV or Tesseract).

[1313] Data calculation: The server checks the extracted information against an existing database.

[1314] Output: The matching result is returned to the terminal.

[1315] Specific operation: The server analyzes the contents of the verification document (name, address, etc.) and checks whether it matches the information registered in the database. The result of the match is notified to the terminal.

[1316] Step 6:

[1317] The user confirms the contract details on the final confirmation screen.

[1318] Input: The user confirms the match results sent from the server.

[1319] Output: The device displays a final confirmation screen.

[1320] Specific operation: The user confirms the contract details and presses the "Complete contract" button.

[1321] Step 7:

[1322] The contract information is sent to the server to complete the contract.

[1323] Input: When the user presses the final confirmation button, the contract information is sent to the server.

[1324] Output: The server saves the contract information to the database and sends a contract completion notification.

[1325] Specific operation: The contract information is stored in the database and the message "Contract completed" is displayed on the terminal.

[1326] In this way, this system allows users to easily complete complicated procedures, preventing fraudulent applications and quickly completing contract procedures. Furthermore, the use of AI will enable consistent customer support and an improved user experience.

[1327] (Application example 1)

[1328] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1329] One issue facing modern electronic payment services is the lack of a process that allows users to complete contract procedures quickly and easily. Conventional systems require users to visit a store in person, which takes time and effort. Furthermore, the electronic customer verification (eKYC) process is complicated, making it difficult for users to smoothly complete a contract. Furthermore, there is a lack of support using generative artificial intelligence, which can make it difficult for users to select an appropriate plan.

[1330] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1331] In this invention, the server includes means for receiving access requests from a user terminal and displaying information about the contracted product, means for providing customer support using generative artificial intelligence and guiding the selection of a contract type and plan, means for conducting electronic identity verification to verify the user's identity, means for analyzing the results of the electronic identity verification and proceeding with the contract procedure, means for saving the contract information in a database and sending a contract completion notification to the user terminal, means for using a smart device as the user terminal and conducting the contract procedure for the electronic payment service on the device, means for the user to select AI support in chat format or voice format and respond to the input based on a generative AI model, and means for receiving images of confirmation documents uploaded by the user and analyzing the images to verify the user's identity, thereby enabling the user to quickly and easily complete the contract procedure for the electronic payment service.

[1332] A "user terminal" is a device used by a user, and is equipment that can carry out contract procedures for products and services via a network.

[1333] An "access request" is a request sent from a user terminal to a server to initiate processing for displaying information about a contracted product.

[1334] "Generative AI" is an AI that independently interacts with users and guides them in selecting contract types and plans.

[1335] "Electronic identity verification" is a procedure that allows users to verify their identity online by analyzing images of verification documents and verifying identity information.

[1336] The "contract procedure" is a procedure in which the user confirms the necessary information based on the contract type and plan selected by the user and finally finalizes the contract.

[1337] A "database" is an information system for efficiently storing and managing contract information and user information.

[1338] The "contract completion notification" is a message that notifies the user that the contract procedure has been successfully completed.

[1339] "Smart devices" are digital devices with advanced computing power and communication functions, such as smartphones and smart glasses.

[1340] "Chat format" is a format in which users interact with generative artificial intelligence in a text-based manner.

[1341] The "voice format" is a format in which the user interacts with the generative artificial intelligence using voice.

[1342] A "generative AI model" is an artificial intelligence algorithm or program that automatically generates a response based on given information.

[1343] "Verification documents" are official documents required to verify the identity of a user, such as a driver's license or My Number card.

[1344] "Image analysis" is a technology that processes images of uploaded verification documents, recognizes their contents, and extracts information.

[1345] MODE FOR CARRYING OUT THE INVENTION

[1346] The program for the system for implementing this invention comprises the following means: A user uses a smart device (such as a smartphone or smart glasses) to complete contract procedures for a product or service. The server accepts an access request from the user terminal and displays information about the contracted product. In doing so, it utilizes a generative AI model to provide the user with appropriate guidance.

[1347] As an interface, users can choose chat or voice AI support. User input generates a response in real time based on the generative AI model. For example, if a user inputs, "I would like to sign up for a new credit card," the AI ​​will respond, "What kind of credit card plan would you like?" In this way, users can proceed with the contract process in an interactive manner.

[1348] The server then performs electronic identity verification (eKYC) to verify the user's identity. The user uses a smart device to upload an image of their identification document (such as a driver's license or My Number card). The image is sent to the server, which performs image analysis using OpenCV and the face_recognition library. The resulting identity verification information is then matched, facilitating electronic identity verification.

[1349] Once identity verification is complete, the server will provide instructions to the user to proceed with the contract. The contract information will be saved in the database, and the user will finally receive a contract completion notification. For example, a prompt such as "I'm interested in the family plan" can be used, and after confirmation, a message will be displayed saying "Contract completed."

[1350] Specific examples of main processing flows

[1351] 1. Access request from user: The user accesses the application on a smart device and sends a request to the server.

[1352] 2. Displaying contracted product information: The server displays contracted product information on the user terminal.

[1353] 3. Guided by a generative AI model: The user enters, "I would like to sign up for a new credit card," and the generative AI model responds, "What kind of credit card plan would you like?"

[1354] 4. Electronic Identity Verification (eKYC): The user uploads an image of their driver's license using a smart device, and the server performs image analysis using OpenCV and the face_recognition library to verify the user's identity.

[1355] 5. Contract procedure progress: Based on the analysis results, the server proceeds with the contract procedure and saves the contract information in the database.

[1356] 6. Contract completion notification: After the user makes a final confirmation, the server sends a notification to the user terminal stating that the contract has been completed.

[1357] Prompt Sentence Examples

[1358] I want to apply for a new credit card.

[1359] "Please tell me more about the women's plan."

[1360] "I'm interested in a family plan."

[1361] The system allows users to quickly and easily complete contract procedures for electronic payment services using their smart devices, and utilizes generative AI models to provide appropriate and consistent customer support.

[1362] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1363] Step 1:

[1364] The user terminal accesses the contract application. The user launches the contract application using a smart device such as a smartphone or smart glasses. The terminal sends an access request to the server. This request includes the user's identification information.

[1365] Step 2:

[1366] The server accepts the access request. The server analyzes the received access request and retrieves information about the contracted product from the database. The information about the contracted product is then displayed on the user's device. At this stage, the generative artificial intelligence (AI) is ready to support the user.

[1367] Step 3:

[1368] Users can choose chat or voice support from the generative AI model. Users select "chat" or "voice" and type or speak questions about their desired contract product or service plan.

[1369] Step 4:

[1370] The server passes the input to the generative AI model, which generates a response. The server sends the user's input as a prompt to the generative AI model, which generates an appropriate response. For example, if the user enters, "I would like to sign up for a new credit card," the AI ​​replies, "What kind of credit card plan would you like?"

[1371] Step 5:

[1372] The user selects the desired contract plan. The user is guided by the generative AI model to select the contract type and plan. The selected information is sent to the server, which determines the next step based on the contract plan.

[1373] Step 6:

[1374] The server instructs the user to start electronic identity verification (eKYC), and the user uses a smart device to upload an image of a verification document such as a driver's license or My Number card.

[1375] Step 7:

[1376] The server receives the uploaded image of the verification document and performs image analysis. The server uses OpenCV and the face_recognition library to analyze the received image. Specifically, it performs facial recognition and character recognition (OCR) in the image to extract identity verification information. Based on this analysis, it compares it with existing information in the database.

[1377] Step 8:

[1378] The server notifies the user of the results of the electronic identity verification. If the analysis is successful, the server sends the user a message saying "Identity verification completed." If the analysis is unsuccessful, the server displays the message "Identity verification failed. Please try again."

[1379] Step 9:

[1380] The user performs a final confirmation and completes the contract procedure. After identity verification is complete, the server displays a final confirmation screen for the contract details. The user confirms the contract details and presses the "Final Confirmation" button.

[1381] Step 10:

[1382] The server saves the contract information in a database and sends a contract completion notice to the user. The server saves the final confirmation information in a database and notifies the user that the contract has been successfully completed. The message "The contract has been completed" is displayed on the user's terminal.

[1383] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1384] The present invention provides a system for providing customer support using generative artificial intelligence and an emotion engine when a user makes a contract for a product or service over a network. This system is implemented by the following operations.

[1385] First, a user accesses a mobile phone carrier's website or app via the network from a shop or home using a device. The device receives the access request from the user and displays the home screen.

[1386] Next, the user selects customer support via generative artificial intelligence (AI). The device presents the user with the option to choose between chat or voice support. Once the user selects the format, the device activates the AI ​​and begins guiding them based on the selected format.

[1387] The AI ​​guides users through the process of selecting a contract type and plan, as well as various procedures. Users specify the plan and options they want through questions and selections. The AI ​​explains the features and benefits of the selected plan and answers any questions the user may have, if necessary.

[1388] At this time, an emotion engine runs in parallel, analyzing the user's emotions in real time. The emotion engine analyzes the user's emotional data acquired through chat and voice support, and dynamically adjusts the AI's response content based on the user's emotions.

[1389] When proceeding with the contract procedure, electronic identity verification (eKYC) is used. The terminal instructs the user to upload identification documents (e.g., driver's license, My Number card). The user uploads the identification document, and the image data is sent to the server. The server analyzes the received image data and automatically collates the identification information. The server returns the result of the collation to the terminal and notifies the user.

[1390] After eKYC is complete, the user checks the contract details on the final confirmation screen. If there are no problems with the contract, the user presses the final confirmation button to confirm the contract. The server saves the contract information in the database and notifies the terminal that the contract has been successfully completed. The terminal displays this notification to the user and displays the message "The contract has been completed."

[1391] A specific example is given below.

[1392] Example 1: Procedures at home

[1393] The user accesses the mobile phone company's website from their computer at home. The user selects chat-style AI support, and the AI ​​asks questions about the plan and options they wish to sign up for. The user selects a family plan and proceeds with the contract procedure. eKYC is performed using a driver's license, and the user uploads an image of the license. The server analyzes the image to verify the user's identity, and the contract details are confirmed on the final confirmation screen. When the user presses the final confirmation button to confirm the contract, the system displays a notification that "the contract has been completed." At this time, the emotion engine analyzes the user's emotions in real time and adjusts the AI's response to provide the user with the most appropriate support.

[1394] Example 2: Shop procedure

[1395] The user selects voice-based AI support using a dedicated terminal in the shop. The AI ​​asks questions about plans via voice, and the user selects the plan they want. eKYC is performed using the My Number card, and the user uploads an image. The server analyzes the image and verifies the user's identity. The user confirms the contract details on the final confirmation screen, and presses the final confirmation button to complete the contract. The system displays a notification that the contract has been completed. The emotion engine analyzes the user's emotional changes and triggers appropriate responses and responses, providing high-quality support to the user.

[1396] This system allows customers to complete the contract process quickly and easily from home or in a store, and also allows them to receive more personalized support thanks to the emotional engine.

[1397] The processing flow will be explained below.

[1398] The present invention provides a system for providing customer support using generative artificial intelligence and an emotion engine when a user makes a contract for a product or service over a network. This system is implemented by the following operations.

[1399] Step 1:

[1400] A user accesses a mobile phone carrier's website or app via the network from a shop or home. The device receives the access request from the user and displays the home screen.

[1401] Step 2:

[1402] A user selects generative artificial intelligence (AI) customer support on a website or app. The device presents the user with the option to choose between chat or voice support. The user selects the format.

[1403] Step 3:

[1404] Based on the user's selection, the device will activate AI support. The AI ​​will ask the user initial questions about the contract type and plan selection via chat or voice. The emotion engine will analyze the user's emotions in real time.

[1405] Step 4:

[1406] Users answer questions and specify the plan and options they want to sign up for. The AI ​​explains the plan's features and benefits based on the user's answers. At the same time, the emotion engine dynamically adjusts the response based on the user's emotions.

[1407] Step 5:

[1408] The user finally selects the plan they want, and the terminal then explains to the user the steps for electronic customer verification (eKYC) required to proceed with the contract procedure.

[1409] Step 6:

[1410] The device requests the user to upload an identification document (e.g., driver's license, My Number card). The user uploads an image of the identification document to the device.

[1411] Step 7:

[1412] The device sends the uploaded image data to the server. The server analyzes the received image data and automatically collates it with the personal identification information. The server returns the collation results to the device.

[1413] Step 8:

[1414] The terminal notifies the user of the result of the verification, and after the user has completed the identity verification, the user can continue with the contract procedure.

[1415] Step 9:

[1416] The user checks the contract details on the final confirmation screen. If there are no problems, the user presses the final confirmation button to confirm the contract. The server saves the contract information in the database.

[1417] Step 10:

[1418] The server notifies the terminal that the contract has been successfully completed. The terminal displays the message "Contract completed" to the user.

[1419] As a specific example, there is the following case.

[1420] Example 1: Procedures at home

[1421] The user accesses the mobile phone company's website from their computer at home. The user selects chat-style AI support, and the AI ​​asks questions about the plan and options they wish to sign up for. The user selects a family plan, and the AI ​​explains the features of the selected plan. As the contract procedure progresses, the device performs eKYC using the user's driver's license. The user uploads an image of their driver's license, which the server analyzes to verify their identity. The user confirms the contract details on the final confirmation screen and presses the final confirmation button to confirm the contract. The system displays a notification that the contract has been completed. During this process, the emotion engine analyzes the user's emotions and adjusts the AI's responses to provide the user with optimal support.

[1422] Example 2: Shop procedure

[1423] The user uses a dedicated terminal in the shop to select voice-based AI support. The AI ​​asks questions about plans via voice, and the user selects the plan they want. The terminal then performs eKYC using their My Number card. The user uploads an image of their My Number card, and the server analyzes the image to verify their identity. The user checks the contract details on the final confirmation screen, and presses the final confirmation button to complete the contract. The system displays a notification that the contract has been completed. The emotion engine analyzes the user's emotional changes and triggers appropriate responses and responses, providing high-quality support to the user.

[1424] The system allows customers to complete the contract process quickly and easily from a store or at home, and receives more personalized support thanks to an emotion engine.

[1425] Example 2

[1426] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1427] Conventional systems have faced challenges when users sign contracts for products or services over the network, including the need for complex procedures and the lack of appropriate support to resolve any questions that arise. Furthermore, personalized support based on the user's emotional state was not provided, leaving a need for an improved user experience.

[1428] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for receiving an access request from a user terminal and displaying information about the contracted product; means for providing customer support using generative artificial intelligence and guiding the selection of a contract type and plan; means for performing electronic identity verification to verify the user's identity; means for analyzing the user's emotions in real time and dynamically adjusting the AI's response content based on the user's emotions; means for analyzing the results of the electronic identity verification and proceeding with the contract procedure; and means for storing the contract information in a database and sending a contract completion notification to the user terminal. This allows the user's procedures to be completed easily and quickly, and further makes it possible to provide optimal support according to the user's emotional state.

[1429] A "network" is a communications infrastructure that connects user terminals and servers and allows data to be sent and received.

[1430] A "user terminal" refers to a device used by a user, such as a personal computer or smartphone, that is used to access a server via a network.

[1431] "Generative AI" is an AI system that responds to user questions and requests using natural language processing and learning algorithms.

[1432] "Customer support" refers to a general service that provides information and guidance on procedures required when users sign contracts for products or services.

[1433] "Contract type" refers to the type of product or service provided or plan structure selected by the user.

[1434] "Plan" means the specific terms, conditions, and pricing offered for a particular product or service.

[1435] "Electronic Customer Verification (eKYC)" is a process that analyzes image data of identification documents to verify a user's identity online.

[1436] The "emotion engine" is a system that analyzes the user's emotions in real time and dynamically adjusts the response content based on that information.

[1437] A "database" is an information system for systematically storing and managing contract information and user-related information.

[1438] The "contract completion notification" is an information message used to notify the user terminal that the user's contract procedures have been successfully completed.

[1439] This invention is a system that provides customer support using a generative artificial intelligence and an emotion engine when a user contracts for products or services over a network. This system includes hardware and software such as a user terminal, a server, the generative artificial intelligence, the emotion engine, an electronic customer verification (eKYC) system, and a database.

[1440] System Configuration

[1441] User terminal: A device used by a user, such as a PC or smartphone. The user terminal sends access requests from the user to the server, receives responses from the server, and displays them.

[1442] Server: A server that accepts requests from user devices and provides information on contracted products. The server also analyzes the user's emotional data, performs electronic customer verification (eKYC), and proceeds with the contract procedure.

[1443] Generative artificial intelligence (AI): A system that responds to user questions and requests using natural language processing and learning algorithms. AI guides users through the process by guiding them through the selection of contract types and plans.

[1444] Emotion engine: A system that analyzes user emotions in real time and dynamically adjusts the AI's response based on that information.

[1445] Electronic identity verification (eKYC) system: A system that analyzes image data of identity verification documents uploaded by users to verify their identity. The server compares the identity verification information with a database.

[1446] Database: An information system that systematically stores and manages contract information and user-related information.

[1447] Hardware and software used

[1448] Hardware: User devices (PCs, smartphones), servers

[1449] Software: Generative AI model, emotion engine, eKYC system, database management system

[1450] Detailed explanation of operation

[1451] 1. User Access and Home Screen Display:

[1452] Users access the mobile phone company's website or app via a network using a user terminal from home or a shop.

[1453] The server accepts an access request from the user terminal and transmits home screen data to the user terminal.

[1454] The user terminal displays the home screen based on the received data.

[1455] 2. Customer Support Options:

[1456] Users can opt into generative AI customer support and choose between chat or voice support.

[1457] The user's device notifies the server of the user's selection, and the server activates the generative AI.

[1458] 3. Contract type and plan selection guide:

[1459] The generative AI guides users in selecting contract types and plans and responds to their questions.

[1460] Based on data provided by the server, the AI ​​explains the features and benefits of each plan to users.

[1461] 4. Sentiment Analysis and Response Adjustment:

[1462] The emotion engine analyzes the user's emotions in real time based on the user's chat and voice data.

[1463] The generative AI adjusts the response to the user based on the analysis results of the emotion engine.

[1464] 5. Electronic Identity Verification (eKYC):

[1465] The user will be prompted to upload identification documents.

[1466] The server analyzes the uploaded image data and compares the personal identification information with a database.

[1467] 6. Final confirmation and completion of the contract:

[1468] After completing eKYC, the user will confirm the contract details on the final confirmation screen.

[1469] When the user presses the final confirmation button, the server saves the contract information in a database and notifies the user terminal that the contract has been completed.

[1470] The user terminal displays the message "Contract completed."

[1471] Specific examples

[1472] Example 1: Procedures at home

[1473] A user accesses a mobile phone company's website from a computer at home.

[1474] Users can choose chat-based AI support and select a family plan.

[1475] Users will complete eKYC using their driver's license and upload an image.

[1476] The server analyzes the image to verify the identity of the user, and then confirms the contract details on the final confirmation screen.

[1477] When the user presses the final confirmation button to confirm the contract, a notification stating "Contract completed" is displayed.

[1478] The emotion engine analyzes and adjusts the AI's response.

[1479] Example 2: Shop procedure

[1480] The user selects AI support in the form of voice support using a dedicated terminal in the shop.

[1481] The AI ​​will ask questions about the plan via voice, and the user will be able to select the plan they want.

[1482] Users will use their My Number card to complete eKYC and upload an image.

[1483] The server analyzes the image and verifies the identity of the person.

[1484] The user confirms the contract details on the final confirmation screen and presses the final confirmation button to complete the contract.

[1485] A notification will appear stating that the contract has been completed.

[1486] The emotion engine analyzes the user's emotional changes and triggers appropriate responses.

[1487] Prompt Sentence Examples

[1488] "I'm interested in a family plan. Which plan is best for me?"

[1489] "I would like to proceed with the contract procedures, so please let me know what documents I need."

[1490] "I don't understand how to do eKYC. Please explain."

[1491] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1492] Step 1:

[1493] Receiving an access request

[1494] User: From home or a shop, the user uses a user device (PC or smartphone) to access the mobile phone carrier's website or app via the network.

[1495] Input: Access request from user device (URL request)

[1496] Terminal: Sends an access request to the server.

[1497] Server: Accepts access requests and generates home screen data.

[1498] Output: Home screen data (HTML and JSON format)

[1499] Device: Receives the home screen data and displays it to the user.

[1500] Specific operation: A user accesses a mobile phone company's website using a browser or a dedicated app, and the request is sent to the server, which then generates the corresponding homepage content and returns it to the user's device.

[1501] Step 2:

[1502] Selecting a support format

[1503] Users: Select Generative AI Support from the home screen and choose between chat or voice support.

[1504] Input: Support data of the user's choice (chat or voice)

[1505] Terminal: Notifies the server of the user's choice.

[1506] Server: Launches AI based on the support format and generates initial guide information.

[1507] Output: Initial guide information (text or audio data)

[1508] Terminal: Display or play initial guide information to the user.

[1509] Specific operation: The user selects the desired support format (chat or voice) from the options on the screen, and that information is sent to the server, which then activates the corresponding AI-guided mode to provide the user with initial guidance.

[1510] Step 3:

[1511] Contract type and plan selection guide

[1512] Terminal: Displays the AI's guide screen to the user.

[1513] User: Enters questions about the contract type and plan into the AI.

[1514] Input: User question data (text or voice input)

[1515] AI (on the server): Analyzes user data and generates information on the appropriate contract plan.

[1516] Output: Contract plan information (text or audio data)

[1517] Device: Display or play subscription plan information to the user.

[1518] Specific operation: The user enters questions about the contract type and plan, and the AI ​​analyzes the data and provides detailed information about the most suitable contract plan.

[1519] Step 4:

[1520] Sentiment Analysis and Response Adjustment

[1521] Terminal: Sends user chat and voice data to the emotion engine.

[1522] Input: User chat or voice data

[1523] Emotion engine (on the server): Analyzes user emotions in real time.

[1524] Output: Emotion analysis results (emotional state data)

[1525] AI (in the server): Dynamically adjusts responses to users based on the results of sentiment analysis.

[1526] Output: Tailored response (text or audio data)

[1527] Terminal: Displays or plays the adjusted response to the user.

[1528] Specific operation: The emotion engine analyzes chat and voice data entered by the user, and adjusts the AI's response based on the user's emotional state.

[1529] Step 5:

[1530] Electronic identity verification (eKYC)

[1531] On the device: Prompt the user to upload their identification documents.

[1532] Input: Image data of the ID document uploaded by the user

[1533] User: Upload an image of their ID.

[1534] Terminal: Sends the uploaded image data to the server.

[1535] Server: Analyzes the image data and automatically checks the identity information against a database.

[1536] Output: Matching result (identity verification success or failure)

[1537] Terminal: Display the match results to the user.

[1538] Specific operation: The user uploads identification documents such as a driver's license or My Number card, and the data is analyzed on the server to complete identity verification.

[1539] Step 6:

[1540] Final confirmation of contract details and completion of contract

[1541] User: Check the contract details on the final confirmation screen.

[1542] Input: Click of final confirmation button (user operation data)

[1543] Terminal: Sends user operation data to the server.

[1544] Server: Saves the contract information in a database and notifies the terminal when the contract is completed.

[1545] Output: Contract completion notification data

[1546] On the device: Display a contract completion notification to the user, displaying the message "Contract completed."

[1547] Specific operation: The user confirms the contract details and presses the final confirmation button if there are no problems. The server then saves the contract information and sends a contract completion notice to the terminal, which then displays the completion notice to the user.

[1548] (Application example 2)

[1549] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1550] Conventionally, when users contract for products or services over a network, they sometimes find it difficult to select the contract type or plan they desire, and it is also difficult to receive personalized support throughout the entire process. This can result in a poor user experience. Furthermore, there is also the problem of increased stress during the contract process due to fixed responses that do not take into account the user's emotional data. The present invention aims to solve these problems and provide users with optimal support that responds to their emotions.

[1551] The specification processing by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for accepting an access request from a user terminal and displaying information about the contract product, means for providing customer support using generative artificial intelligence and guiding the selection of a contract type and plan, means for conducting electronic identity verification to verify the user's identity, means for analyzing the results of the electronic identity verification and proceeding with the contract procedure, means for storing the contract information in a database and sending a contract completion notification to the user terminal, and means for analyzing the user's emotional data using an emotion analysis device and dynamically adjusting the response of the generative artificial intelligence based on the user's emotions. This allows the user to easily complete the contract procedure via a network and complete the contract with peace of mind while receiving personalized support based on the emotional data.

[1552] A "network" is a system in which computers and devices in different locations are connected to each other using multiple communication methods, enabling the exchange of information.

[1553] "Generative AI" is AI that has the ability to automatically generate responses and suggestions based on user input.

[1554] "Customer support" refers to a service that provides information and assistance with procedures necessary when a user signs a contract for a product or service.

[1555] "Contract type" refers to the method of providing products and services and the types of plans that users can select.

[1556] "Plan selection" refers to a user selecting an appropriate plan from multiple subscription options based on their needs and preferences.

[1557] "Electronic identity verification" is the process of verifying your identity online using an image or digital information of your ID uploaded by the user.

[1558] "Emotion data" is data that indicates the emotional state of a user extracted from facial expressions, voice, text, and the like.

[1559] An "emotion analysis device" is a device that analyzes a user's emotional data in real time and provides appropriate responses and suggestions based on the results.

[1560] "Dynamic adjustment" refers to making instant changes and optimizations based on given conditions and circumstances.

[1561] The "contract completion notification" is a communication message to notify the user that all contract procedures have been completed.

[1562] A "database" is a system for efficiently storing, managing, and searching large amounts of data.

[1563] MODE FOR CARRYING OUT THE INVENTION

[1564] The present invention provides a system for providing customer support using generative artificial intelligence and an emotion analysis device when a user makes a contract for a product or service via a network. This system is implemented with the following configuration.

[1565] First, a user uses a terminal (such as a smartphone or PC) to access a website or application that provides the product or service they wish to subscribe to via a network. This access request is sent to a server, which then displays information about the contracted product on the user's terminal.

[1566] Next, the user selects customer support via generative AI. The user device presents the user with the option to choose between chat or voice support. Once the user selects the format, the corresponding generative AI is activated, providing guidance on selecting a contract type and plan. The generative AI responds to the user's questions in real time and helps them select the most appropriate plan.

[1567] At this time, an emotion analysis device operates in parallel, analyzing the user's emotional data in real time. This emotion analysis includes, for example, facial expressions, tone of voice, and text content. The emotion analysis device dynamically adjusts the response content of the generative AI based on the analysis results, providing optimal support based on the user's emotions.

[1568] If user identity verification is required during the contract procedure, electronic user verification (eKYC) is carried out. To do this, the server instructs the user to upload an identity verification document (such as a driver's license or My Number card). The user's device takes a photo of the image data and sends it to the server.

[1569] The server analyzes the received image data and performs electronic identity verification. The analyzed identity verification information is automatically compared with the information registered in the database. Once identity verification is complete, the server displays a final confirmation screen on the user's device. The user confirms the contract details and presses the final confirmation button to finalize the contract. The server saves the contract information in the database and sends a contract completion notification to the user's device.

[1570] As a concrete example, the following scenario can be considered.

[1571] Example 1: Procedure via home network

[1572] The user opens the online shopping site's app on their smartphone at home and selects the "Smart Shopping Support" function. When the user selects chat-style AI support, a generative artificial intelligence is activated, guiding the user in selecting products and plans to purchase. At this time, an emotion analyzer operates in parallel, analyzing the user's emotional data and adjusting the AI's response. When the user takes a photo of their driver's license with their smartphone and uploads it, the server analyzes the image to verify the user's identity. After confirming the contract details on the final confirmation screen and pressing the final confirmation button, the system displays a notification that the contract has been completed.

[1573] Example prompt sentence:

[1574] A user opens an online shopping app on their smartphone and uses smart shopping support. First, the user accesses the online store and selects AI chat support. The user selects the category of product they want, and the AI ​​recommends the best products in that category. At this time, the emotion engine analyzes the user's preferences in real time and recommends products based on their emotions. Furthermore, when proceeding to the purchase process, the eKYC module prompts the user to upload their driver's license. The uploaded image is sent to the server, where identity verification is completed after analysis. After confirming the purchase details on the final confirmation screen, the user presses the final confirmation button to complete the purchase.

[1575] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1576] Step 1:

[1577] A user uses a smartphone or PC to access an application or website on an online shopping site. The device sends an access request to the server, and the server displays information about the contracted product on the user's device. The input here is the user's access request, and the output is a screen containing information about the contracted product.

[1578] Step 2:

[1579] The user selects customer support via generative artificial intelligence. The device displays an option to the user to choose between chat or voice, and the user selects the desired format. The input is the support format selected by the user, and the output is the launch of the corresponding generative artificial intelligence.

[1580] Step 3:

[1581] Based on the format selected by the user, a generative AI is launched. The generative AI presents the user with questions regarding the contract type and plan selection. The user responds to these questions, and the user's response data is sent from the terminal to the server. The input is the user's response data, and the output is the guide questions of the generative AI.

[1582] Step 4:

[1583] In parallel, an emotion analysis device operates, analyzing the user's emotional data in real time. The emotion analysis device takes the user's facial expressions, voice tone, and text content as input, analyzes them, and outputs emotional data. The emotional data is sent to the generative AI, which dynamically adjusts the response content according to the user's emotions. The input is the user's emotional data, and the output is the adjusted response of the generative AI.

[1584] Step 5:

[1585] In order for the user to proceed with the contract procedure, an electronic identity verification (eKYC) guide is displayed. The server requests the user to upload their identity verification document, and the terminal sends the uploaded image data to the server. The input is the image data of the identity verification document uploaded by the user, and the output is the image data sent to the server.

[1586] Step 6:

[1587] The server analyzes the received image data and automatically verifies the identity of the user. This is done using image recognition technology and OCR (optical character recognition). The analysis results are compared in a database as identity verification information. The input is the uploaded image data, and the output is the result of whether or not identity verification has been completed.

[1588] Step 7:

[1589] Once identity verification is complete, the server displays a final confirmation screen on the user's terminal. The user checks the contract details and presses the final confirmation button. The input is an instruction from the server to display the final confirmation screen, and the output is the user's final confirmation action.

[1590] Step 8:

[1591] When the user presses the final confirmation button, the server saves the contract information in the database and sends a contract completion notice to the user's terminal. The terminal displays the message "The contract has been completed" to the user. The input is the user's final confirmation action, and the output is the display of the contract completion notice.

[1592] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1593] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1594] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1595] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1596] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1597] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1598] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1599] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1600] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1601] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1602] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1603] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1604] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1605] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1606] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1607] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1608] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1609] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1610] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1611] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1612] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1613] The following is further disclosed regarding the above embodiment.

[1614] (Claim 1)

[1615] 1. A system for contracting for goods and services over a user-accessible network, comprising:

[1616] means for receiving an access request from a user terminal and displaying information about the contracted product;

[1617] Providing customer support using generative artificial intelligence to guide customers in choosing contract types and plans;

[1618] means for performing electronic authentication to verify the identity of the user;

[1619] A means for analyzing the results of electronic identity verification and proceeding with the contract procedure;

[1620] means for storing contract information in a database and sending a contract completion notification to a user terminal;

[1621] A system including:

[1622] (Claim 2)

[1623] The system according to claim 1, characterized in that customer support provided by generative artificial intelligence can be selected to be in the form of chat or voice support.

[1624] (Claim 3)

[1625] The system according to claim 1, characterized in that in electronic identity verification, an image of a verification document uploaded by a user is received, and the image is analyzed to verify identity information.

[1626] "Example 1"

[1627] (Claim 1)

[1628] 1. A system for contracting for goods and services over a user-accessible network, comprising:

[1629] means for receiving an access request from a user terminal and displaying information about the contracted product;

[1630] Providing customer support using generative artificial intelligence to guide customers in choosing contract types and plans;

[1631] means for performing electronic authentication to verify the identity of the user;

[1632] means for analyzing images of verification documents uploaded by users and verifying their identity;

[1633] means for storing contract information in a database and sending a contract completion notification to a user terminal;

[1634] A means for generative AI to interact with users in real time;

[1635] A system including:

[1636] (Claim 2)

[1637] The system according to claim 1, characterized in that customer support provided by generative artificial intelligence can be selected to be in the form of chat or voice support.

[1638] (Claim 3)

[1639] The system according to claim 1, characterized in that in electronic identity verification, an image of a verification document uploaded by a user is received, and the image is analyzed to verify identity information.

[1640] "Application Example 1"

[1641] (Claim 1)

[1642] 1. A system for contracting for goods and services over a user-accessible network, comprising:

[1643] means for receiving an access request from a user terminal and displaying information about the contracted product;

[1644] Providing customer support using generative artificial intelligence to guide customers in choosing contract types and plans;

[1645] means for performing electronic authentication to verify the identity of the user;

[1646] A means for analyzing the results of electronic identity verification and proceeding with the contract procedure;

[1647] means for storing contract information in a database and sending a contract completion notification to a user terminal;

[1648] A means for using a smart device as a user terminal and performing contract procedures for the electronic payment service on the device;

[1649] a means for the user to select AI support in chat or voice format and respond to that input based on a generative AI model;

[1650] A means for receiving an image of a verification document uploaded by a user and performing image analysis to verify the user's identity;

[1651] A system including:

[1652] (Claim 2)

[1653] The system of claim 1, characterized in that the generative artificial intelligence customer support can be selected as either chat or voice support, and further generates responses using prompt sentences.

[1654] (Claim 3)

[1655] The system of claim 1, characterized in that, in electronic identity verification, it receives an image of a verification document uploaded by a user and analyzes the image using OpenCV and face_recognition library to verify identity information.

[1656] "Example 2: Combining Emotion Engines"

[1657] (Claim 1)

[1658] 1. A system for contracting for goods and services over a user-accessible network, comprising:

[1659] means for receiving an access request from a user terminal and displaying information about the contracted product;

[1660] Provid...

Claims

1. 1. A system for contracting for goods and services over a user-accessible network, comprising: means for receiving an access request from a user terminal and displaying information about the contracted product; Providing customer support using generative artificial intelligence to guide customers in choosing contract types and plans; means for performing electronic authentication to verify the identity of the user; A means for analyzing the results of electronic identity verification and proceeding with the contract procedure; means for storing contract information in a database and sending a contract completion notification to a user terminal; A system including:

2. 2. The system according to claim 1, wherein customer support using generative artificial intelligence can be selected from chat format or voice support.

3. 2. The system according to claim 1, wherein in electronic identity verification, an image of a verification document uploaded by a user is received, and the image is analyzed to verify identity information.

Images