system

Abstract

We provide the system. [Solution] A means of receiving initial information from the user, Analysis means including a generation engine that analyzes the aforementioned initial information and generates multiple contract plans in response to user requests, A means for presenting a contract plan generated from the analysis means to the user, A means of accepting contract plans selected or adjusted by the user, A means for finalizing the contract and generating contract documents based on the aforementioned selected or adjusted contract plan, Means for providing the aforementioned contract documents to the user, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a persona chatbot control method performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance as a response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Currently, in contracts for smartphones and landline phones, it is difficult for users to select the most suitable option from many choices and complex plans. Also, for stores not covered by mass retailers and online contract procedures, there is no in - person support, often resulting in anxiety and inconvenience. Furthermore, the procedures from information input to contract conclusion are cumbersome, causing a problem of reduced user convenience.

Means for Solving the Problems

[0005] This invention provides a system that receives initial information from a user, analyzes it, and automatically generates multiple contract plans using generative artificial intelligence. Specifically, it includes means for the user to input initial information such as budget, data capacity, and functional requirements; means for analyzing the input information and generating an optimal contract plan that meets the user's needs; means for presenting the generated plans to the user and accepting selections and adjustments from the user; means for finalizing the contract based on the selected or adjusted plans and generating contract documents; and means for providing the contract documents to the user. Through this invention, users can easily select, adjust, and contract for the optimal plan from many options, thereby improving convenience and reducing the complexity of procedures.

[0006] A "user" is a person who uses the system to complete the contract procedures for a smartphone or landline phone.

[0007] "Initial information" refers to basic contract information entered by the user, such as budget, data capacity, and functional requirements.

[0008] "Means of receiving" refers to a part of a device or system that has the function of receiving input from a user and converting it into a format that can be processed.

[0009] "Analysis means" refers to a part of a device or system that analyzes initial information received from a user and processes it to generate an appropriate contract plan.

[0010] The "generation engine" is the part that uses artificial intelligence technology to automatically generate multiple contract plans based on the analyzed information.

[0011] "Means of presentation" refers to a device or system component for visually displaying the generated contract plan to the user.

[0012] A "selected or adjusted contract plan" refers to a contract plan that the user has selected or adjusted from the plans presented to them.

[0013] "Means of finalizing the contract" refers to a part of a device or system that has the function of finalizing the contract plan selected or adjusted by the user as the formal contract terms.

[0014] "Means for generating contract documents" refers to a part of a device or system that has the function of creating contract documents based on the finalized contract terms.

[0015] "Means of provision" refers to a part of the device or system used to provide the generated contract documents to the user. [Brief explanation of the drawing]

[0016] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11]It is a sequence diagram showing the processing flow of the data processing system in Embodiment 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Embodiment 2 when the emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when the emotion engine is combined.

Mode for Carrying Out the Invention

[0017] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0018] First, the language used in the following description will be explained.

[0019] In the following embodiments, the numbered processor (hereinafter simply referred to as "processor") may be one arithmetic unit or a combination of a plurality of arithmetic units. Also, the processor may be one type of arithmetic unit or a combination of a plurality of types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0020] In the following embodiments, the numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0021] In the following embodiments, the signed storage is one or more non-volatile storage devices that store various programs and various parameters. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes.

[0022] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0024] [First Embodiment]

[0025] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0026] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0027] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0028] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0029] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0031] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0032] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0033] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0034] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0035] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0036] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0037] This invention provides a system for users to smoothly complete smartphone or landline phone contract procedures using terminals installed in stores not yet operated by mass retailers or through an online environment. This system receives and analyzes the user's initial information, automatically generates and presents multiple contract plans using generative artificial intelligence, and provides the user with the most suitable plan, thereby simplifying the contract procedure.

[0038] Components

[0039] 1. User terminal: A device that provides an interface for user operation. This terminal may be installed in stores not affiliated with mass retailers, or it may be provided as an online web interface or mobile application.

[0040] 2. Server: This is the central processing unit that receives and analyzes data sent from users and generates multiple contract plans using generative artificial intelligence.

[0041] Program Processing Description

[0042] Acceptance of initial information

[0043] The device provides an interface that allows the user to input their budget, desired data capacity, and required features (e.g., camera performance, battery life, etc.).

[0044] The user enters the necessary information using the terminal's interface.

[0045] The terminal converts the initial information entered into the appropriate data format (e.g., JSON) and sends it to the server.

[0046] Information analysis and contract plan generation

[0047] The server receives data sent from the user and analyzes that information using generative artificial intelligence.

[0048] The server generates multiple optimal contract plans based on the analysis results. For example, pricing plans based on budget and communication plans based on data capacity are automatically generated.

[0049] The server sends the generated contract plan to the terminal.

[0050] Proposal and adjustment of contract plans

[0051] The device visually displays the contract plans it has received to the user. The user can then select the plan that best suits them from the multiple plans offered.

[0052] The user selects one of the displayed plans or adjusts options (e.g., adding insurance).

[0053] The device then resends the user's selections and adjustments to the server.

[0054] Final contract confirmation and document generation

[0055] The server receives the adjustment details sent by the user and finalizes the contract plan.

[0056] The server generates contract documents based on the contract plan and sends a download link to the device.

[0057] The device displays a final confirmation screen to the user, prompting them to approve the contract.

[0058] The user grants approval.

[0059] The device provides a download link for the contract documents, and the contract is officially concluded.

[0060] Specific example

[0061] As a concrete example, here is a scenario for a new smartphone contract:

[0062] 1. The user accesses the store's tablet terminal and selects "New smartphone contract".

[0063] 2. The device displays a form that prompts the user to enter their budget, desired data capacity, and required features (e.g., latest camera features).

[0064] 3. The user enters the information and presses the submit button.

[0065] 4. The terminal converts the input content into JSON format and sends it to the server.

[0066] 5. The server analyzes the received data and uses generative artificial intelligence to generate multiple contract plans. For example, "Budget of 3000 yen / month, 5GB data capacity, latest camera features."

[0067] 6. The server sends the generated plan to the terminal.

[0068] 7. The device displays the suggested plan to the user.

[0069] 8. The user selects "I want to add an insurance option" and makes adjustments to the device.

[0070] 9. The device sends the adjustment data to the server.

[0071] 10. The server finalizes the plan, generates the contract documents, and sends them to the terminal.

[0072] 11. The device displays a final confirmation screen, and the user approves the contract.

[0073] 12. The server records the conclusion of the contract and sends a download link for the contract documents to the terminal.

[0074] 13. The device displays to the user that the contract has been concluded and a download link is available.

[0075] Thus, this system allows users to complete smartphone and landline phone contracts easily and quickly. Furthermore, by using generative artificial intelligence, it is possible to provide plans that are optimally suited to the user's needs, greatly improving the efficiency and convenience of the contract process.

[0076] The following describes the processing flow.

[0077] Step 1:

[0078] The device boots up and displays a welcome screen. The user is presented with the option of either a "smartphone contract" or a "landline phone contract."

[0079] Step 2:

[0080] When the user selects "Smartphone Contract," a form appears on the device for them to enter the necessary initial information (budget, data capacity, required features).

[0081] Step 3:

[0082] The user enters their budget, data capacity, and required features into the form and presses the submit button.

[0083] Step 4:

[0084] The terminal converts the initial information entered into it into JSON format and sends it to the server via the network.

[0085] Step 5:

[0086] The server parses the JSON data received from the terminal to identify the user's request.

[0087] Step 6:

[0088] The server uses generative artificial intelligence to analyze the received information and generate multiple contract plans tailored to the user's needs.

[0089] Step 7:

[0090] The server encodes the multiple contract plans it generates into JSON format and sends them to the terminal.

[0091] Step 8:

[0092] The device decodes the received JSON data and displays the plan to the user in a visually easy-to-understand format.

[0093] Step 9:

[0094] The user selects one of several contract plans displayed. They can also adjust options (e.g., add insurance) as needed.

[0095] Step 10:

[0096] The device converts the user's selections or adjustments back into JSON format and sends them to the server.

[0097] Step 11:

[0098] The server analyzes the adjustment data received from the terminal and determines the final contract plan.

[0099] Step 12:

[0100] The server generates contract documents based on the confirmed contract plan and sends a download link for the contract documents to the terminal in JSON format.

[0101] Step 13:

[0102] The device displays a final confirmation screen to the user, prompting them to approve the contract.

[0103] Step 14:

[0104] The user performs a final review and clicks the "Approve" button.

[0105] Step 15:

[0106] The device sends the authorization information to the server.

[0107] Step 16:

[0108] The server confirms the contract is finalized and records the contract information.

[0109] Step 17:

[0110] The server sends a download link for the contract documents to the user's device.

[0111] Step 18:

[0112] The device will display a notification that the contract has been concluded, along with a link to download the contract documents to the user.

[0113] The above outlines the detailed processing steps of the program. This process allows users to easily and smoothly sign up for smartphone or landline phone contracts.

[0114] (Example 1)

[0115] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0116] Traditional smartphone and landline phone contract procedures were cumbersome, making it difficult for users to find a contract plan that best suited their needs. In particular, manually searching for a contract plan that met diverse requirements such as budget, data capacity, and functional requirements was extremely time-consuming and laborious. Furthermore, the contract procedures were often divided into multiple steps, making them confusing for users. Therefore, there is a need to improve the efficiency and convenience of the contract process.

[0117] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0118] In this invention, the server includes terminal means for receiving initial information from a user, analysis means including generative artificial intelligence for analyzing the initial information and generating multiple contract plans in response to the user's requests, terminal means for presenting the contract plans generated by the analysis means to the user, terminal means for receiving a contract plan selected or adjusted by the user, server means for finalizing the contract based on the selected or adjusted contract plan and generating contract documents, and terminal means for providing the contract documents to the user. This enables users to complete smartphone and landline phone contracts easily and quickly. Furthermore, by using generative artificial intelligence, it is possible to provide a contract plan that is optimal for the user's requests, greatly improving the efficiency and convenience of the contract procedure.

[0119] 1. "Terminal means" refers to a device that a user operates, inputs or selects information, and communicates with a server.

[0120] 2. "Analysis means" refers to a part of a system that analyzes initial information received from the user and generates multiple contract plans using generative artificial intelligence.

[0121] 3. The "generation engine" refers to the part that includes generative artificial intelligence and has the function of automatically generating contract plans based on user requests.

[0122] 4. The "server" is the central device of a system that receives data sent from the user, analyzes it, generates a contract plan, confirms the contract, and generates contract documents.

[0123] 5. "Generative artificial intelligence" refers to artificial intelligence technology used to analyze a user's initial information and generate multiple contract plans based on that information.

[0124] 6. A "contract plan" is a selection of communication contract options offered based on the user's budget, data capacity, and functional requirements.

[0125] 7. "Initial information" refers to information such as budget, desired data capacity, and functional requirements that the user enters when completing the contract procedures.

[0126] 8. "Adjustment details" refers to the requests for additions or changes made by the user to the presented contract plan.

[0127] 9. "Contract documents" are formal documents that record the final terms of the contract and are provided to the user.

[0128] 10. The "final confirmation screen" is an interface that allows the user to review and finally approve the contract plan they have selected or adjusted.

[0129] This invention is a system that enables users to smoothly complete contract procedures for smartphones and landlines. This system is used via terminals installed in stores not yet operated by mass retailers, or through an online environment. It receives and analyzes the user's initial information, automatically generates and presents multiple contract plans using generative artificial intelligence, and provides the user with the most suitable plan, thereby simplifying the contract procedure.

[0130] Components

[0131] 1. User terminal: A device that provides an interface for user operation. This terminal may be installed in stores not affiliated with mass retailers, or it may be provided as an online web interface or mobile application. Examples include tablet devices, PCs, and smartphones.

[0132] 2. Server: This is the central processing unit that receives and analyzes data sent from users and generates multiple contract plans using generative artificial intelligence. The server requires a high-performance CPU and sufficient memory, and a database (e.g., MySQL®) is used for data storage.

[0133] 3. Generative Artificial Intelligence: This is an artificial intelligence model for automatically generating contract plans based on user requests. For example, ChatGPT (registered trademark) by OpenAI (registered trademark) falls into this category.

[0134] Program processing

[0135] Acceptance of initial information

[0136] The device provides an interface that allows the user to input their budget, desired data capacity, and required features (e.g., camera performance, battery life). This can be done using HTML forms or a mobile app UI.

[0137] The user enters the necessary information through the device's interface. For example, they might enter "3000 yen / month" in the budget field, "5GB" in the data capacity field, and "latest camera performance" in the required features field.

[0138] The terminal converts the entered information into JSON format and securely sends it to the server using the HTTPS protocol.

[0139] Information analysis and contract plan generation

[0140] The server receives JSON data sent by the user.

[0141] The server analyzes the received data and sends prompts to the generative artificial intelligence (AI). This is done using a Python script or similar to send prompts like the following to the generative AI (e.g., OpenAI's ChatGPT):

[0142] "The user has a budget of 3000 yen / month and wants 5GB of data and the latest camera features. Please propose three optimal smartphone contract plans that meet these conditions."

[0143] Generative artificial intelligence generates multiple subscription plans based on prompts. For example, "Plan A: 3000 yen / month, 5GB, latest camera," "Plan B: 2800 yen / month, 4GB, superior camera," "Plan C: 3200 yen / month, 6GB, latest camera," etc.

[0144] The server converts the generated contract plan into JSON format and sends it to the terminal.

[0145] Proposal and adjustment of contract plans

[0146] The device visually displays the contract plans received by the user. Multiple contract plans are displayed in a list format in the user interface.

[0147] The user selects the most suitable plan from those presented. They can also select or adjust additional options (e.g., insurance options) as needed.

[0148] The device converts the user's selections and adjustments back into JSON format and sends them to the server.

[0149] Final contract confirmation and document generation

[0150] The server receives the adjustment details sent by the user and finalizes the contract plan.

[0151] The server stores contract information in a database (e.g., MySQL) and generates contract documents. These documents include user information and contract details.

[0152] The server sends a download link for the generated contract documents to the user.

[0153] The device displays a final confirmation screen to the user, prompting them to approve the contract.

[0154] The user clicks the approve button on the final confirmation screen.

[0155] The device provides a download link for the contract documents, allowing the user to download them. The contract is then formally concluded.

[0156] Specific example

[0157] For example, if a user wants to sign up for a new smartphone contract, they input their desired budget of 3000 yen / month, 5GB of data capacity, and the latest camera performance into the device and send the information. The generative artificial intelligence then generates several contract plans, which the device presents to the user. After the user selects a plan and makes adjustments such as adding insurance options, the final contract plan is confirmed, and the contract documents are generated and provided to the user.

[0158] This allows users to complete smartphone and landline phone contract procedures simply and quickly. Furthermore, by utilizing generative artificial intelligence, the system can provide contract plans that are best suited to the user's needs, improving the efficiency and convenience of the contract process.

[0159] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0160] Step 1:

[0161] The user accesses a smartphone, tablet, or online web interface to begin the contract process. The device displays a form for the user to enter their budget, desired data capacity, and required features (e.g., camera performance, battery life). This form is provided as HTML or a mobile app UI. Input is done in the form of text fields or dropdown menus.

[0162] Input: User's desired budget, data capacity, and feature requirements

[0163] Output: User-entered information (unprocessed)

[0164] Step 2:

[0165] The user enters information such as budget, data capacity, and required functions through the device's interface and clicks the submit button. At this time, the device converts the information entered by the user into JSON format.

[0166] Input: Information entered by the user

[0167] Data processing: Convert user input information into JSON format.

[0168] Output: User information in JSON format

[0169] Step 3:

[0170] The terminal securely sends the converted JSON data to the server using the HTTPS protocol. The server receives this data and prepares it for analysis.

[0171] Input: User information in JSON format

[0172] Data processing: Secure transmission of data

[0173] Output: User information sent to the server

[0174] Step 4:

[0175] The server analyzes the received data and prepares to send a prompt to a generative artificial intelligence (e.g., ChatGPT). This prompt includes the user's budget, desired data volume, and required functions. The server then formats the data into the appropriate format and sends it to the generative artificial intelligence.

[0176] Input: User information sent to the server

[0177] Data processing: Creating prompts for generative artificial intelligence.

[0178] Output: Prompt to send to the generative artificial intelligence.

[0179] Step 5:

[0180] The server sends a prompt to the generative artificial intelligence. For example, it might use a prompt like this:

[0181] "The user has a budget of 3000 yen / month and wants 5GB of data and the latest camera features. Please propose three optimal smartphone contract plans that meet these conditions."

[0182] Input: Prompt to send to generative AI

[0183] Data processing: Artificial intelligence generates multiple contract plans based on prompts.

[0184] Output: Generated contract plan

[0185] Step 6:

[0186] Generative artificial intelligence generates multiple subscription plans based on prompts. For example, "Plan A: 3000 yen / month, 5GB, latest camera," "Plan B: 2800 yen / month, 4GB, superior camera," "Plan C: 3200 yen / month, 6GB, latest camera," etc. This is then converted to JSON format and sent back to the server.

[0187] Input: Prompt sent to a generative artificial intelligence system

[0188] Data processing: Data analysis and contract plan generation using artificial intelligence.

[0189] Output: Contract plan in JSON format

[0190] Step 7:

[0191] The server sends the contract plan received from the generative artificial intelligence to the terminal. The terminal then displays the received contract plan visually to the user by reflecting it in the web interface or mobile UI.

[0192] Input: Contract plan in JSON format

[0193] Data processing: Convert received data for UI use.

[0194] Output: Visually displayed contract plan

[0195] Step 8:

[0196] The user selects the most suitable plan from those presented. They can also select or adjust additional options (e.g., insurance options) as needed. This adjusted information is then re-entered into the device.

[0197] Input: User selections and adjustments

[0198] Output: Selected and adjusted contract plan

[0199] Step 9:

[0200] The terminal converts the user's selections and adjustments into JSON format and sends them back to the server. The server receives this data and begins the process of finalizing the contract plan.

[0201] Input: User selections and adjustments

[0202] Data processing: Convert the selected content to JSON format and send it to the server.

[0203] Output: Final adjustments sent to the server

[0204] Step 10:

[0205] The server finalizes the contract plan and saves the contract information to a database (e.g., MySQL). Simultaneously, it generates the contract documents and sends a download link for the documents to the user's device.

[0206] Input: Final adjustments sent to the server

[0207] Data processing: Confirmation of contract information and storage in the database.

[0208] Output: Contract documents and download links

[0209] Step 11:

[0210] The device displays a final confirmation screen to the user, prompting them to approve the contract. The contract is officially concluded when the user clicks the approve button on the final confirmation screen.

[0211] Input: Contract documents and download links

[0212] Output: Final confirmation screen

[0213] Step 12:

[0214] The device provides a download link for the contract documents, allowing the user to download them. Simultaneously, the contract becomes formally concluded.

[0215] Input: Final confirmation approval

[0216] Output: Provision of download link and conclusion of contract

[0217] In this way, through this system, users can complete smartphone and landline phone contract procedures simply and quickly, and by utilizing generative artificial intelligence, the system can provide contract plans that are best suited to the user's needs.

[0218] (Application Example 1)

[0219] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0220] Traditional smartphone or landline phone contract procedures required users to visit electronics stores, which was time-consuming and laborious. Online contracts were also cumbersome, requiring users to manually review a large amount of information to choose the optimal plan. Furthermore, with the advancement of virtual reality (VR) technology, there was a growing demand for simplified contract procedures utilizing this technology.

[0221] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0222] In this invention, the server includes means for receiving initial information from a user; analysis means including a generation engine that analyzes the initial information and generates multiple contract plans in response to the user's requests; means for presenting the contract plans generated from the analysis means to the user; means for receiving a contract plan selected or adjusted by the user; means for finalizing the contract based on the selected or adjusted contract plan and generating contract documents; means for providing the contract documents to the user; and means for visually displaying multiple contract plans to the user in a virtual reality environment, allowing the user to select or adjust a plan. This enables the user to easily and quickly perform complex contract procedures using the virtual reality environment.

[0223] A "user terminal" is a device that provides an interface for user operation.

[0224] A "server" is a central processing unit that receives data sent from users, analyzes it, and generates multiple contract plans using generative artificial intelligence.

[0225] "Initial information" refers to information necessary for a user to complete the contract process, such as budget, data capacity, and required functions.

[0226] "Analysis means" refers to a method for analyzing initial information from the user and generating multiple contract plans based on that analysis.

[0227] A "generation engine" is an engine that uses generative artificial intelligence to generate multiple contract plans in response to user requests.

[0228] A "virtual reality environment" is a virtual space or environment that a user interacts with using virtual reality technology.

[0229] A "contract plan" is a selection of contract options proposed based on the user's requests and initial information.

[0230] "Contract documents" are official documents generated based on the contract plan selected or adjusted by the user.

[0231] A "user interface" refers to the screens and components provided for users to input initial information, and to review, select, and adjust their contract plans.

[0232] This invention provides a system that allows users to easily and quickly complete smartphone or landline phone contract procedures at home using a virtual reality environment. The system includes a user terminal, a server, and a user interface for operations within the virtual reality environment.

[0233] System Overview

[0234] The system receives and analyzes initial information from the user and generates multiple contract plans using generative artificial intelligence. These generated contract plans are presented to the user in a virtual reality environment, allowing the user to visually review, select, and adjust them. Once the final contract plan is confirmed, the contract documents are automatically generated and provided to the user.

[0235] Hardware and software to be used

[0236] Hardware:

[0237] Smartphone or tablet

[0238] Virtual reality goggles

[0239] Servers (for example, Amazon Web Services as a cloud environment)

[0240] Database (for example, MySQL)

[0241] software:

[0242] Virtual store application (based on the Unity engine)

[0243] Generative artificial intelligence models (e.g., OpenAI GPT-4®)

[0244] Frontend libraries (e.g., React Native)

[0245] Backend framework (e.g., Node.js)

[0246] Program processing

[0247] 1. The user accesses a terminal within the virtual reality environment and begins the contract process. The user terminal displays an initial information input form, where the user enters their desired budget, data capacity, required functions, etc.

[0248] 2. The terminal converts the input data into JSON format and sends it to the server. The server then uses a generative artificial intelligence model (GPT-4) to perform data analysis and generate a contract plan.

[0249] 3. The generated contract plan is temporarily stored in the database and sent from the server to the terminal. The terminal visually projects the contract plan onto a holographic display in the virtual reality environment.

[0250] 4. The user reviews, selects, or adjusts the plan. The user's actions are sent back to the server, and the final contract plan is confirmed.

[0251] 5. The server generates contract documents based on the confirmed contract plan and provides a download link to the user's terminal. The contract is concluded when the user confirms and downloads the documents.

[0252] Specific example

[0253] As a specific scenario, the procedure for a new smartphone contract is shown below.

[0254] 1. The user puts on virtual reality goggles and launches the virtual store application.

[0255] 2. The device displays the "New Smartphone Contract" option within the virtual environment.

[0256] 3. The user controls an avatar and enters their budget, desired data capacity, and required functions.

[0257] 4. The terminal converts the input content into JSON format and sends it to the server.

[0258] 5. The server analyzes the received data and generates multiple subscription plans using a generative artificial intelligence model (GPT-4). For example, "Budget of 3000 yen / month, 5GB data capacity, latest camera features."

[0259] 6. The server sends the generated plan to the terminal and projects it onto a holographic display in the virtual reality environment.

[0260] 7. The user visually reviews the presented contract plan and selects "I want to add insurance options."

[0261] 8. The device sends the adjustment details back to the server.

[0262] 9. The server finalizes the plan, generates the contract documents, and sends them to the terminal.

[0263] 10. The device displays a final confirmation screen, and the user approves the contract.

[0264] 11. The server records the conclusion of the contract and provides a download link for the contract documents.

[0265] 12. The user downloads the contract documents, and the contract is officially concluded.

[0266] Example of a prompt

[0267] The following are examples of prompts to input into the generated AI model:

[0268] Please propose the optimal contract plan based on the user's budget, data capacity, and required features. Please use the following information:

[0269] Budget: 3000 yen / month

[0270] Data capacity: 5GB

[0271] Required features: Latest camera features

[0272] Please provide multiple contract plans.

[0273] In this way, the present invention enables users to easily and quickly complete contract procedures using a virtual reality environment.

[0274] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0275] Step 1:

[0276] The user puts on virtual reality goggles and launches a virtual store application. The device displays the "New Smartphone Contract" option within the virtual environment. The user controls an avatar and enters information such as budget, desired data capacity, and required features. The device converts the entered data into JSON format and sends it to the server.

[0277] Step 2:

[0278] The server analyzes the initial user information it receives. This analysis uses a generative AI model (e.g., GPT-4). The server generates multiple contract plans based on the user's input data. This prompt is then input into the generative AI model, the analysis results are obtained, and a contract plan is generated.

[0279] Step 3:

[0280] The server temporarily stores the generated contract plan in a database and sends it to the terminal. The terminal visually projects the contract plan onto a holographic display in the virtual reality environment. The user reviews the multiple plans presented.

[0281] Step 4:

[0282] The user selects or adjusts their desired subscription plan within the virtual reality environment. The device then converts this selected or adjusted information back into JSON format and sends it to the server.

[0283] Step 5:

[0284] The server receives the adjustment content sent by the user and determines the final contract plan. The server generates contract documents based on the final plan and sends a download link to the terminal.

[0285] Step 6:

[0286] The terminal displays a final confirmation screen within the virtual reality environment, and the user approves the contract. The server records the conclusion of the contract and provides the user with a download link for the contract documents. The user downloads the contract documents, and the contract is formally established.

[0287] The above is the processing flow of the program of the system for realizing the application example.

[0288] Furthermore, an emotion engine for estimating the user's emotion may be combined. That is, the specific processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform specific processing using the user's emotion.

[0289] The present invention is a system for enabling a user to smoothly perform a contract procedure for a smartphone or a fixed telephone using a terminal installed in an unopened mass merchandiser store or an online environment. In particular, the present invention incorporates an emotion engine that recognizes the user's emotion and adjusts the contract plan accordingly. This system simplifies the contract procedure by receiving and analyzing the user's initial information, automatically generating and presenting multiple contract plans using a generative artificial intelligence, and providing the optimal plan to the user. In addition, it responds according to the user's emotion and provides a more personalized service.

[0290] Components

[0291] 1. User terminal: A device that provides an interface for user operation. This terminal may be installed in stores not affiliated with mass retailers, or it may be provided as an online web interface or mobile application.

[0292] 2. Server: This is the central processing unit that receives and analyzes data sent from users and generates multiple contract plans using generative artificial intelligence.

[0293] 3. Emotion Engine: This engine includes technology to recognize the user's emotions by analyzing the user's voice, facial expressions, input speed, etc.

[0294] Program Processing Description

[0295] Acceptance of initial information

[0296] The device provides an interface that allows the user to input their budget, desired data capacity, and required features (e.g., camera performance, battery life, etc.).

[0297] The user enters the necessary information using the terminal's interface.

[0298] The terminal converts the initial information entered into the appropriate data format (e.g., JSON) and sends it to the server.

[0299] Emotional analysis

[0300] The device captures the user's voice tone, facial expressions, and input speed in real time and sends this information to the server.

[0301] The server utilizes an emotion engine to analyze the transmitted data and recognize the user's emotional state. Recognized emotions include, for example, joy, excitement, confusion, and anger.

[0302] Information analysis and contract plan generation

[0303] The server receives the initial information and emotional state sent by the user, and analyzes both using a generative artificial intelligence.

[0304] The server generates a plurality of optimal contract plans based on the analysis results. For example, if the user is confused, a simpler and more understandable plan is proposed.

[0305] The server sends the contract plan it generated to the terminal.

[0306] Presentation and adjustment of the contract plan

[0307] The terminal visually displays the contract plan received from the server in an easy-to-understand form for the user. The user can select the most suitable one for themselves from the plurality of proposed plans.

[0308] The user selects one from the displayed plans or adjusts an option (e.g., adding insurance).

[0309] The terminal sends the user's selection and adjustment content to the server again.

[0310] Finalization of the contract and generation of documents

[0311] The server analyzes the adjustment content sent by the user and finalizes the final contract plan.

[0312] Based on the contract plan finalized by the server, the server generates contract documents and sends a download link for the contract documents to the terminal.

[0313] The terminal displays a final confirmation screen to the user and prompts for approval for the contract to be established.

[0314] The user gives approval.

[0315] The terminal provides a download link for the contract documents, and the contract is formally established.

[0316] Specific example

[0317] As a concrete example, here is a scenario for a new smartphone contract:

[0318] 1. The user accesses the store's tablet terminal and selects "New smartphone contract".

[0319] 2. The device displays a form that prompts the user to enter their budget, desired data capacity, and required features (e.g., latest camera features).

[0320] 3. The user enters the information and presses the submit button.

[0321] 4. The terminal converts the input content into JSON format and sends it to the server.

[0322] 5. The terminal captures the user's voice tone, facial expressions, and input speed in real time and sends this information to the server.

[0323] 6. The server analyzes received data and sentiment data, and uses generative artificial intelligence to generate multiple contract plans. For example, "Budget of 3000 yen / month, 5GB data capacity, latest camera features." If the user is confused, it will suggest a simpler and easier-to-understand plan.

[0324] 7. The server sends the generated plan to the terminal.

[0325] 8. The device displays the suggested plan to the user.

[0326] 9. The user selects "I want to add an insurance option" and makes adjustments to the device.

[0327] 10. The device sends the adjustment data to the server.

[0328] 11. The server finalizes the plan, generates the contract documents, and sends them to the terminal.

[0329] 12. The device displays a final confirmation screen, and the user approves the contract.

[0330] 13. The server records the conclusion of the contract and sends a download link for the contract documents to the terminal.

[0331] 14. The device displays to the user that the contract has been concluded and a download link is available.

[0332] Thus, this system allows users to complete smartphone and landline phone contracts easily and quickly. Furthermore, by using an emotion engine, personalized responses tailored to the user's emotions become possible, greatly improving convenience and satisfaction.

[0333] The following describes the processing flow.

[0334] Step 1:

[0335] The device boots up and displays a welcome screen. The user is presented with the option of either a "smartphone contract" or a "landline phone contract."

[0336] Step 2:

[0337] When the user selects "Smartphone Contract," a form appears on the device for them to enter the necessary initial information (budget, data capacity, required features).

[0338] Step 3:

[0339] The user enters their budget, data capacity, and required features into the form and presses the submit button.

[0340] Step 4:

[0341] The device captures the user's voice tone, facial expressions, and typing speed. This information is then analyzed by an emotion engine.

[0342] Step 5:

[0343] The device converts the user's initial information and sentiment data into JSON format and sends it to the server over the network.

[0344] Step 6:

[0345] The server parses the JSON data received from the terminal. Based on budget, data volume, and functional requirements, it identifies the user's requirements.

[0346] Step 7:

[0347] The server's emotion engine analyzes the user's voice tone, facial expressions, and typing speed to recognize the user's emotional state.

[0348] Step 8:

[0349] The server's generative artificial intelligence generates the optimal contract plan for the user based on the initial information and emotion data received. For example, if the user is confused, it prioritizes a simpler and easier-to-understand plan.

[0350] Step 9:

[0351] The server encodes the multiple contract plans it generates into JSON format and sends them to the terminal.

[0352] Step 10:

[0353] The device decodes the received JSON data and displays the plan to the user in a visually easy-to-understand format.

[0354] Step 11:

[0355] The user selects one of several contract plans displayed. They can also adjust options as needed (e.g., add insurance).

[0356] Step 12:

[0357] The device converts the user's selections and adjustments back into JSON format and sends them to the server.

[0358] Step 13:

[0359] The server analyzes the adjustment data received from the terminal and determines the final contract plan.

[0360] Step 14:

[0361] Based on the confirmed contract plan, the server generates the contract documents and sends a download link for the contract documents to the user.

[0362] Step 15:

[0363] The device displays a final confirmation screen to the user, prompting them to approve the contract.

[0364] Step 16:

[0365] The user performs a final review and clicks the "Approve" button.

[0366] Step 17:

[0367] The device sends the authorization information to the server.

[0368] Step 18:

[0369] The server confirms the contract is finalized and records the contract information.

[0370] Step 19:

[0371] The server sends a download link for the contract documents to the user's device.

[0372] Step 20:

[0373] The device will display a notification that the contract has been concluded, along with a link to download the contract documents to the user.

[0374] This process allows users to complete smartphone and landline phone contract procedures simply and quickly using this system. Furthermore, by utilizing the emotion engine, personalized responses that respond to the user's emotions become possible, increasing user satisfaction.

[0375] (Example 2)

[0376] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0377] Traditional contract procedures often result in a poor user experience because they don't consider the user's emotions or psychological state when users input necessary information and choose the best plan from the provided options. In particular, users may feel confused or dissatisfied when selecting the optimal plan from a complex selection. Furthermore, the inability to provide flexible plans tailored to the user's emotional state is a significant challenge.

[0378] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0379] In this invention, the server includes means for receiving initial information from the user, analysis means including a generation engine that analyzes the initial information and generates multiple contract plans based on the user's requests and emotional state, and emotion recognition means that analyzes the user's voice tone, facial expressions, and input speed to recognize the emotional state. This makes it possible to provide personalized contract plans that are tailored to the user's psychological state.

[0380] A "user" refers to an individual who operates the system and selects or adjusts their contract plan.

[0381] "Initial information" refers to the basic information that users input into the system, such as budget, data capacity, and functional requirements.

[0382] A "generation engine" refers to a program and algorithm that analyzes a user's initial information and emotional state, and automatically generates multiple contract plans based on that analysis.

[0383] "Analysis means" refers to a series of processes for processing initial information obtained from the user and generating a contract plan using a generation engine.

[0384] "Emotion recognition means" refers to technologies and devices that analyze the user's voice tone, facial expressions, and input speed to recognize the user's emotional state.

[0385] "Contract documents" refer to formal documents that contain the final terms of the agreement and require confirmation and approval by the user.

[0386] "Adjustment" refers to the act of adding or changing the contract plan selected by the user.

[0387] "Provision" refers to the act of the system displaying or making available to the user, via a download link, a contract plan or contract documents that it has generated.

[0388] This invention provides a system for users to smoothly complete smartphone or landline phone contract procedures using terminals installed in stores not yet stocked in mass retailers or through an online environment. In particular, this invention incorporates an emotion engine that recognizes the user's emotions and adjusts the contract plan accordingly. This system receives and analyzes the user's initial information, automatically generates and presents multiple contract plans using generative artificial intelligence, and provides the user with the optimal plan, thereby simplifying the contract procedure. Furthermore, it provides a more personalized service by responding to the user's emotions.

[0389] Components

[0390] 1. User terminal: A device that provides an interface for user operation. This terminal may be installed in stores not affiliated with mass retailers, or it may be provided as an online web interface or mobile application. For example, tablet devices and smartphones are used.

[0391] 2. Server: This is the central processing unit that receives and analyzes data sent from users and generates multiple contract plans using generative artificial intelligence. For example, a cloud server is used.

[0392] 3. Emotion Engine: This engine includes technologies for recognizing the user's emotions by analyzing their voice, facial expressions, input speed, etc. For example, voice tone analysis software and facial recognition software may be used.

[0393] Process Overview

[0394] The device provides an interface that allows the user to input their budget, desired data capacity, and required features (e.g., camera performance, battery life). Once the user inputs the necessary information using the device's interface, the device converts it into an appropriate data format (e.g., JSON) and sends it to the server. Furthermore, the device captures the user's voice tone, facial expressions, and input speed in real time and sends this information to the server.

[0395] The server utilizes an emotion engine to analyze the transmitted data and recognize the user's emotional state. Recognized emotions include, for example, joy, excitement, confusion, and anger. Next, the server receives the initial information and emotional state transmitted by the user and analyzes both using generative artificial intelligence. Based on this analysis, the server generates several optimal contract plans and sends them to the terminal.

[0396] The terminal displays the received contract plan to the user in a visually easy-to-understand format. The user can select the plan that best suits them from the multiple plans offered. Once the user selects one of the displayed plans or adjusts options (e.g., adding insurance), the selection and adjustments are sent back from the terminal to the server. The server analyzes the adjustments sent by the user and finalizes the contract plan. Based on the finalized contract plan, the server generates the contract documents and sends a download link for the contract documents to the terminal. The terminal displays a final confirmation screen to the user, prompting them to approve the contract. Once the user approves, the terminal provides the download link for the contract documents, and the contract is officially concluded.

[0397] Specific example

[0398] For example, a possible prompt for a new smartphone contract scenario might look like this:

[0399] "I'd like to sign up for a new smartphone contract. My monthly budget is under 3000 yen, I need at least 5GB of data, and camera performance is a priority."

[0400] Thus, this system allows users to complete smartphone and landline phone contracts easily and quickly. Furthermore, by using an emotion engine, personalized responses tailored to the user's emotions become possible, greatly improving convenience and satisfaction.

[0401] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0402] Step 1:

[0403] The device provides an interface that allows the user to input their budget, desired data capacity, and required features (e.g., camera performance, battery life, etc.).

[0404] Input: User budget, desired data capacity, required features

[0405] Action: The terminal displays a form, and the user completes the input.

[0406] Output: Information entered by the user

[0407] Step 2:

[0408] The user enters the necessary information using the terminal's interface and presses the submit button.

[0409] Input: Budget entered by the user, desired data capacity, required functions

[0410] Operation: The user enters information into each field of the form and presses the submit button.

[0411] Output: Initial information from form input

[0412] Step 3:

[0413] The terminal converts the initial information entered into the appropriate data format (e.g., JSON) and sends it to the server.

[0414] Input: Initial information entered via form

[0415] Operation: The terminal converts the input data into a JSON object and sends it to the server as an HTTP request.

[0416] Output: Initial information data in JSON format

[0417] Step 4:

[0418] The device captures the user's voice tone, facial expressions, and input speed in real time and sends this information to the server.

[0419] Input: User's voice tone, facial expression, input speed

[0420] Operation: The device uses its camera and microphone to capture data and send it to the server.

[0421] Output: Voice tone data, facial expression data, input speed data

[0422] Step 5:

[0423] The server utilizes an emotion engine to analyze the transmitted data and recognize the user's emotional state.

[0424] Input: Voice tone data, facial expression data, input speed data

[0425] Operation: The server uses emotion recognition software to analyze data and classify the user's emotional state.

[0426] Output: User's emotional state (e.g., joy, excitement, confusion, anger)

[0427] Step 6:

[0428] The server receives initial information and emotional state sent by the user and analyzes both using generative artificial intelligence.

[0429] Input: Initial information data in JSON format, user's emotional state

[0430] Operation: The server uses generative artificial intelligence to analyze the input data.

[0431] Output: Analysis results (data based on user requests and emotional state)

[0432] Step 7:

[0433] The server generates multiple optimal contract plans based on the analysis results and sends them to the terminal.

[0434] Input: Analysis results

[0435] Operation: The server generates multiple contract plans and sends them to the terminal in JSON format.

[0436] Output: Contract plan data in JSON format

[0437] Step 8:

[0438] The device displays the received contract plan to the user in a visually easy-to-understand format.

[0439] Input: Contract plan data in JSON format

[0440] Operation: The terminal appropriately lays out and displays the proposed contract plan to the user.

[0441] Output: Displayed contract plan

[0442] Step 9:

[0443] The user selects one of the displayed plans or adjusts options (e.g., adding insurance).

[0444] Input: Displayed contract plan

[0445] Operation: Users select a plan and add options.

[0446] Output: Selected or adjusted contract plan

[0447] Step 10:

[0448] The device then resends the user's selections and adjustments to the server.

[0449] Input: Selected or adjusted contract plan

[0450] Operation: The terminal converts the selected data into JSON format and sends it to the server.

[0451] Output: Selected or adjusted contract plan data in JSON format

[0452] Step 11:

[0453] The server analyzes the adjustment details sent by the user and determines the final contract plan.

[0454] Input: Selected or adjusted contract plan data in JSON format

[0455] Operation: The server calculates and confirms the final contract details based on the selected options.

[0456] Output: Confirmed contract plan data

[0457] Step 12:

[0458] The server generates contract documents based on the confirmed contract plan and sends a download link for the contract documents to the user's device.

[0459] Input: Confirmed contract plan data

[0460] Operation: The server generates the contract documents in PDF format and sends a download link to the device.

[0461] Output: Download link for contract documents

[0462] Step 13:

[0463] The device displays a final confirmation screen to the user, prompting them to approve the contract.

[0464] Input: Download link for contract documents

[0465] Action: The device displays the contract details and presents an approval button.

[0466] Output: Final confirmation screen and approval button

[0467] Step 14:

[0468] The user grants approval.

[0469] Input: Final confirmation screen and approval button

[0470] Action: The user clicks the approve button.

[0471] Output: Approved contract details

[0472] Step 15:

[0473] The device provides a download link for the contract documents, and the contract is officially concluded.

[0474] Input: Approved contract details

[0475] Operation: The device displays a download link, and the user downloads the contract documents.

[0476] Output: Download link and downloaded contract documents

[0477] (Application Example 2)

[0478] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0479] In today's world, the contract procedures for smartphones and landlines have become cumbersome and stressful for users. In particular, first-time users and those with limited technical knowledge find it difficult to select the appropriate plan, resulting in the problem of not being able to choose the optimal contract plan. Furthermore, traditional online contract systems fail to consider the user's emotional state, leading to confusion and anxiety. There is a need to solve these problems and provide a system that allows users to complete contract procedures more easily and with greater peace of mind.

[0480] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving initial information from the user; analysis means including a generation engine that analyzes the initial information and generates multiple contract plans in response to the user's requests; means for adjusting the contract plan according to the user's emotions using an emotion recognition engine that recognizes the user's emotions from voice, facial expressions, input speed, etc.; means for displaying the multiple contract plans generated based on the user's emotions on the interface of the virtual store and providing them to the user in a visually easy-to-understand manner; means for presenting the contract plan generated from the analysis means to the user; means for receiving the contract plan selected or adjusted by the user; means for finalizing the contract based on the selected or adjusted contract plan and generating contract documents; and means for providing the contract documents to the user. As a result, the user can easily and quickly select the optimal contract plan according to their emotional state. Furthermore, by using the virtual store, convenience and satisfaction are improved, and contract procedures can be carried out with peace of mind.

[0481] A "user terminal" is a device that provides an interface for user operation and enables access to virtual stores.

[0482] The "analysis means" refers to a system that includes an engine for analyzing the user's initial information and generating multiple contract plans based on the user's requests.

[0483] A "generation engine" is an engine that includes artificial intelligence to generate multiple contract plans based on the user's initial information.

[0484] An "emotion recognition engine" is an engine that includes technology to recognize the user's emotions by analyzing the user's voice, facial expressions, input speed, etc.

[0485] "Means of adjusting contract plans according to user emotions" refers to means of appropriately adjusting contract plans based on the user's emotions recognized by an emotion recognition engine.

[0486] A "virtual store" is a virtual store environment that users can access using VR or smart glasses, where they can select products and complete contract procedures.

[0487] An "interface" refers to the means by which a user interacts with a system, such as inputting, selecting, and displaying information.

[0488] "Means for generating contract documents" refers to the means of creating final contract documents based on the contract plan selected or adjusted by the user.

[0489] "Voice tone" refers to the characteristics of the user's voice, such as pitch, intonation, and volume, and is data used to analyze emotions in speech recognition.

[0490] "Facial expressions" refer to changes in a user's facial expressions and subtle movements, and are data used to analyze emotions using facial recognition technology.

[0491] "Input speed" refers to the speed and rhythm at which a user inputs information, and is an indicator used to infer the user's emotional state based on this.

[0492] "Visually easy to understand" refers to providing information to users in a format that is easy to grasp intuitively, and includes elements such as graphs, icons, and animations.

[0493] Modes for carrying out the invention

[0494] This invention is a system designed to analyze a user's emotions in real time and provide optimal responses when they ask questions or make purchases in a virtual store. This system allows users to easily and quickly complete smartphone or landline phone contract procedures. Furthermore, by providing personalized responses tailored to the user's emotional state, it can increase user satisfaction.

[0495] Hardware and software

[0496] This system uses the following hardware and software.

[0497] hardware

[0498] 1. VR goggles or smart glasses: These are devices used by users to access virtual stores.

[0499] 2. Microphone: A device used to record speech for speech recognition.

[0500] 3. Camera: A device that collects facial data for facial expression analysis.

[0501] software

[0502] 1. Application Server (Python®-based): Operates as the central processing unit for the entire system.

[0503] 2. Emotion Engine Module: Analyzes the user's voice tone, facial expressions, and input speed to recognize their emotional state.

[0504] 3. Generative Artificial Intelligence Planner (AIPlanner): Generates multiple contract plans based on the user's initial information and emotional state.

[0505] 4. Virtual Shop Interface Module (VirtualShopTerminal): Collects information from the user and visually displays the contract plan.

[0506] Program processing

[0507] The server first collects initial information (budget, data capacity, functional requirements) from the user via the user's terminal. This initial information is sent to the server in JSON format. At the same time, emotional data such as the user's voice tone, facial expressions, and typing speed is also collected and sent to the server.

[0508] The server uses an emotion engine module to analyze the user's emotional state. For example, if the user is agitated, it adjusts the contract plan based on that emotional state, suggesting a state-of-the-art model.

[0509] Next, a generative artificial intelligence planner generates multiple contract plans based on the user's initial information and emotional state. The generated plans are then visually presented to the user through the virtual store interface.

[0510] The user makes selections and adjustments from the presented plans, and the results are sent back to the server. The server then finalizes the contract plan based on the user's selections and adjustments, and generates the contract documents.

[0511] Ultimately, the contract documents are presented to the user via the virtual store interface, and the contract is finalized upon user approval. A download link for the contract documents is provided, allowing the user to download and save them.

[0512] Specific example

[0513] For example, if a user accesses a virtual store and wants to sign up for a new smartphone contract, they would follow these steps:

[0514] 1. The user puts on VR goggles and logs into the virtual shop.

[0515] 2. A virtual assistant appears and asks questions about your budget, desired data capacity, and feature requirements.

[0516] 3. The user enters this information and provides answers via voice.

[0517] 4. The server analyzes the user's tone of voice and facial expressions to detect if the user is excited.

[0518] 5. A generative artificial intelligence planner generates the optimal contract plan for the user based on emotional data.

[0519] 6. Multiple generated contract plans are presented to the user through the virtual store interface.

[0520] 7. The user selects the most suitable plan and makes adjustments as needed.

[0521] 8. The final contract plan is confirmed on the server, and the contract documents are generated.

[0522] 9. The contract is concluded when the user reviews and approves the contract documents.

[0523] 10. A download link for the contract documents is provided, and the user saves it.

[0524] Example of a prompt

[0525] Examples of prompts to input into a generative AI model:

[0526] "Based on the user's voice tone and facial expression data, recognize their emotional state. If the user is excited, generate a plan recommending the latest model and create a confirmation message in simple language. Also, consider their budget and desired specifications."

[0527] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0528] Step 1:

[0529] The user wears VR goggles or smart glasses and logs into a virtual store. The terminal displays an interface prompting the user to enter their budget, desired data capacity, and required features (e.g., latest camera, battery life, etc.). The user enters this information via voice or text. The entered information is converted to JSON format and sent to the server.

[0530] Input: User budget, data capacity, and feature requirements

[0531] Output: Initial information (JSON format)

[0532] Specific operation: The terminal receives voice and text input from the user, converts it into the appropriate data format, and prepares it for transmission.

[0533] Step 2:

[0534] The device simultaneously collects data on the user's facial expressions, voice tone, and input speed. This emotional data is transmitted to the server in real time.

[0535] Input: User's voice tone, facial expression, and input speed

[0536] Output: Sentiment data

[0537] Specific operation: The device analyzes the user's camera video and microphone audio and sends it to the server as emotion data.

[0538] Step 3:

[0539] The server analyzes the initial information it receives. The analysis includes a generation engine that generates multiple contract plans based on the user's requests.

[0540] Input: Initial information (JSON format)

[0541] Output: Multiple contract plans

[0542] Specific operation: The server analyzes initial information and uses generative artificial intelligence to generate a contract plan suitable for the user.

[0543] Step 4:

[0544] The server uses an emotion recognition engine to analyze the user's emotional state. Based on the user's voice tone, facial expressions, and input speed, it recognizes the user's emotional state and reflects the results in the contract plan.

[0545] Input: Sentiment data

[0546] Output: Adjusted contract plan

[0547] Specific operation: The server analyzes emotional data using an emotion recognition engine and generates a plan that corresponds to the user's emotions.

[0548] Step 5:

[0549] The server presents the generated contract plan to the user through the virtual store interface. It is designed to be displayed in a visually easy-to-understand format for the user.

[0550] Input: Adjusted contract plan

[0551] Output: Visual presentation on the user interface

[0552] Specific operation: The server sends the generated plan to the terminal, and the terminal displays it in the user interface.

[0553] Step 6:

[0554] The user selects the most suitable plan from several options presented and makes further adjustments as needed. The selection and adjustments are sent to the server via the device.

[0555] Input: User selections and adjustments

[0556] Output: Adjusted contract plan

[0557] Specific operation: The terminal receives the user's selections and adjustments, and then sends them back to the server.

[0558] Step 7:

[0559] The server analyzes the selections and adjustments submitted by the user to determine the final contract plan. Based on this finalized plan, it then generates the contract documents.

[0560] Input: Adjusted contract plan

[0561] Output: Final contract plan and contract documents

[0562] Specific actions: The server analyzes the adjustments and finalizes the contract plan. It then generates the contract documents.

[0563] Step 8:

[0564] The server sends the generated contract documents to the terminal, which then displays them to the user. A screen prompting the user for confirmation and approval is then displayed.

[0565] Input: Contract documents

[0566] Output: Presentation of contract documents to the user

[0567] Specific actions: The device receives the contract documents and displays them to the user. A message requesting confirmation and approval is displayed.

[0568] Step 9:

[0569] The user reviews and approves the contract documents. The contract is officially concluded when the approval is sent to the server.

[0570] Input: User approval

[0571] Output: Contract concluded

[0572] Specific operation: The user reviews the contract documents and enters their approval. This information is then sent to the server.

[0573] Step 10:

[0574] After the contract is finalized, the server generates a download link for the contract documents and provides it to the user via their device. The user can then download and save the contract documents.

[0575] Input: Record of contract formation

[0576] Output: Download link

[0577] Specific operation: The server records the conclusion of the contract and generates a link to download the contract documents. This link is then provided to the user via the terminal.

[0578] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0579] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0580] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0581] [Second Embodiment]

[0582] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0583] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0584] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0585] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0586] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0587] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0588] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0589] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0590] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0591] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0592] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0593] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0594] This invention provides a system for users to smoothly complete smartphone or landline phone contract procedures using terminals installed in stores not yet operated by mass retailers or through an online environment. This system receives and analyzes the user's initial information, automatically generates and presents multiple contract plans using generative artificial intelligence, and provides the user with the most suitable plan, thereby simplifying the contract procedure.

[0595] Components

[0596] 1. User terminal: A device that provides an interface for user operation. This terminal may be installed in stores not affiliated with mass retailers, or it may be provided as an online web interface or mobile application.

[0597] 2. Server: This is the central processing unit that receives and analyzes data sent from users and generates multiple contract plans using generative artificial intelligence.

[0598] Program Processing Description

[0599] Acceptance of initial information

[0600] The device provides an interface that allows the user to input their budget, desired data capacity, and required features (e.g., camera performance, battery life, etc.).

[0601] The user enters the necessary information using the terminal's interface.

[0602] The terminal converts the initial information entered into the appropriate data format (e.g., JSON) and sends it to the server.

[0603] Information analysis and contract plan generation

[0604] The server receives data sent from the user and analyzes that information using generative artificial intelligence.

[0605] The server generates multiple optimal contract plans based on the analysis results. For example, pricing plans based on budget and communication plans based on data capacity are automatically generated.

[0606] The server sends the generated contract plan to the terminal.

[0607] Proposal and adjustment of contract plans

[0608] The device visually displays the contract plans it has received to the user. The user can then select the plan that best suits them from the multiple plans offered.

[0609] The user selects one of the displayed plans or adjusts options (e.g., adding insurance).

[0610] The device then resends the user's selections and adjustments to the server.

[0611] Final contract confirmation and document generation

[0612] The server receives the adjustment details sent by the user and finalizes the contract plan.

[0613] The server generates contract documents based on the contract plan and sends a download link to the device.

[0614] The device displays a final confirmation screen to the user, prompting them to approve the contract.

[0615] The user grants approval.

[0616] The device provides a download link for the contract documents, and the contract is officially concluded.

[0617] Specific example

[0618] As a concrete example, here is a scenario for a new smartphone contract:

[0619] 1. The user accesses the store's tablet terminal and selects "New smartphone contract".

[0620] 2. The device displays a form that prompts the user to enter their budget, desired data capacity, and required features (e.g., latest camera features).

[0621] 3. The user enters the information and presses the submit button.

[0622] 4. The terminal converts the input content into JSON format and sends it to the server.

[0623] 5. The server analyzes the received data and uses generative artificial intelligence to generate multiple contract plans. For example, "Budget of 3000 yen / month, 5GB data capacity, latest camera features."

[0624] 6. The server sends the generated plan to the terminal.

[0625] 7. The device displays the suggested plan to the user.

[0626] 8. The user selects "I want to add an insurance option" and makes adjustments to the device.

[0627] 9. The device sends the adjustment data to the server.

[0628] 10. The server finalizes the plan, generates the contract documents, and sends them to the terminal.

[0629] 11. The device displays a final confirmation screen, and the user approves the contract.

[0630] 12. The server records the conclusion of the contract and sends a download link for the contract documents to the terminal.

[0631] 13. The device displays to the user that the contract has been concluded and a download link is available.

[0632] Thus, this system allows users to complete smartphone and landline phone contracts easily and quickly. Furthermore, by using generative artificial intelligence, it is possible to provide plans that are optimally suited to the user's needs, greatly improving the efficiency and convenience of the contract process.

[0633] The following describes the processing flow.

[0634] Step 1:

[0635] The device boots up and displays a welcome screen. The user is presented with the option of either a "smartphone contract" or a "landline phone contract."

[0636] Step 2:

[0637] When the user selects "Smartphone Contract," a form appears on the device for them to enter the necessary initial information (budget, data capacity, required features).

[0638] Step 3:

[0639] The user enters their budget, data capacity, and required features into the form and presses the submit button.

[0640] Step 4:

[0641] The terminal converts the initial information entered into it into JSON format and sends it to the server via the network.

[0642] Step 5:

[0643] The server parses the JSON data received from the terminal to identify the user's request.

[0644] Step 6:

[0645] The server uses generative artificial intelligence to analyze the received information and generate multiple contract plans tailored to the user's needs.

[0646] Step 7:

[0647] The server encodes the multiple contract plans it generates into JSON format and sends them to the terminal.

[0648] Step 8:

[0649] The device decodes the received JSON data and displays the plan to the user in a visually easy-to-understand format.

[0650] Step 9:

[0651] The user selects one of several contract plans displayed. They can also adjust options (e.g., add insurance) as needed.

[0652] Step 10:

[0653] The device converts the user's selections or adjustments back into JSON format and sends them to the server.

[0654] Step 11:

[0655] The server analyzes the adjustment data received from the terminal and determines the final contract plan.

[0656] Step 12:

[0657] The server generates contract documents based on the confirmed contract plan and sends a download link for the contract documents to the terminal in JSON format.

[0658] Step 13:

[0659] The device displays a final confirmation screen to the user, prompting them to approve the contract.

[0660] Step 14:

[0661] The user performs a final review and clicks the "Approve" button.

[0662] Step 15:

[0663] The device sends the authorization information to the server.

[0664] Step 16:

[0665] The server confirms the contract is finalized and records the contract information.

[0666] Step 17:

[0667] The server sends a download link for the contract documents to the user's device.

[0668] Step 18:

[0669] The device will display a notification that the contract has been concluded, along with a link to download the contract documents to the user.

[0670] The above outlines the detailed processing steps of the program. This process allows users to easily and smoothly sign up for smartphone or landline phone contracts.

[0671] (Example 1)

[0672] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0673] Traditional smartphone and landline phone contract procedures were cumbersome, making it difficult for users to find a contract plan that best suited their needs. In particular, manually searching for a contract plan that met diverse requirements such as budget, data capacity, and functional requirements was extremely time-consuming and laborious. Furthermore, the contract procedures were often divided into multiple steps, making them confusing for users. Therefore, there is a need to improve the efficiency and convenience of the contract process.

[0674] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0675] In this invention, the server includes terminal means for receiving initial information from a user, analysis means including generative artificial intelligence for analyzing the initial information and generating multiple contract plans in response to the user's requests, terminal means for presenting the contract plans generated by the analysis means to the user, terminal means for receiving a contract plan selected or adjusted by the user, server means for finalizing the contract based on the selected or adjusted contract plan and generating contract documents, and terminal means for providing the contract documents to the user. This enables users to complete smartphone and landline phone contracts easily and quickly. Furthermore, by using generative artificial intelligence, it is possible to provide a contract plan that is optimal for the user's requests, greatly improving the efficiency and convenience of the contract procedure.

[0676] 1. "Terminal means" refers to a device that a user operates, inputs or selects information, and communicates with a server.

[0677] 2. "Analysis means" refers to a part of a system that analyzes initial information received from the user and generates multiple contract plans using generative artificial intelligence.

[0678] 3. The "generation engine" refers to the part that includes generative artificial intelligence and has the function of automatically generating contract plans based on user requests.

[0679] 4. The "server" is the central device of a system that receives data sent from the user, analyzes it, generates a contract plan, confirms the contract, and generates contract documents.

[0680] 5. "Generative artificial intelligence" refers to artificial intelligence technology used to analyze a user's initial information and generate multiple contract plans based on that information.

[0681] 6. A "contract plan" is a selection of communication contract options offered based on the user's budget, data capacity, and functional requirements.

[0682] 7. "Initial information" refers to information such as budget, desired data capacity, and functional requirements that the user enters when completing the contract procedures.

[0683] 8. "Adjustment details" refers to the requests for additions or changes made by the user to the presented contract plan.

[0684] 9. "Contract documents" are formal documents that record the final terms of the contract and are provided to the user.

[0685] 10. The "final confirmation screen" is an interface that allows the user to review and finally approve the contract plan they have selected or adjusted.

[0686] This invention is a system that enables users to smoothly complete contract procedures for smartphones and landlines. This system is used via terminals installed in stores not yet operated by mass retailers, or through an online environment. It receives and analyzes the user's initial information, automatically generates and presents multiple contract plans using generative artificial intelligence, and provides the user with the most suitable plan, thereby simplifying the contract procedure.

[0687] Components

[0688] 1. User terminal: A device that provides an interface for user operation. This terminal may be installed in stores not affiliated with mass retailers, or it may be provided as an online web interface or mobile application. Examples include tablet devices, PCs, and smartphones.

[0689] 2. Server: This is the central processing unit that receives and analyzes data sent from users and generates multiple contract plans using generative artificial intelligence. The server requires a high-performance CPU and sufficient memory, and a database (e.g., MySQL) is used for data storage.

[0690] 3. Generative Artificial Intelligence: This is an artificial intelligence model for automatically generating contract plans based on user requests. For example, OpenAI's ChatGPT falls into this category.

[0691] Program processing

[0692] Acceptance of initial information

[0693] The device provides an interface that allows the user to input their budget, desired data capacity, and required features (e.g., camera performance, battery life). This can be done using HTML forms or a mobile app UI.

[0694] The user enters the necessary information through the device's interface. For example, they might enter "3000 yen / month" in the budget field, "5GB" in the data capacity field, and "latest camera performance" in the required features field.

[0695] The terminal converts the entered information into JSON format and securely sends it to the server using the HTTPS protocol.

[0696] Information analysis and contract plan generation

[0697] The server receives JSON data sent by the user.

[0698] The server analyzes the received data and sends prompts to the generative artificial intelligence (AI). This is done using a Python script or similar to send prompts like the following to the generative AI (e.g., OpenAI's ChatGPT):

[0699] "The user has a budget of 3000 yen / month and wants 5GB of data and the latest camera features. Please propose three optimal smartphone contract plans that meet these conditions."

[0700] Generative artificial intelligence generates multiple subscription plans based on prompts. For example, "Plan A: 3000 yen / month, 5GB, latest camera," "Plan B: 2800 yen / month, 4GB, superior camera," "Plan C: 3200 yen / month, 6GB, latest camera," etc.

[0701] The server converts the generated contract plan into JSON format and sends it to the terminal.

[0702] Proposal and adjustment of contract plans

[0703] The device visually displays the contract plans received by the user. Multiple contract plans are displayed in a list format in the user interface.

[0704] The user selects the most suitable plan from those presented. They can also select or adjust additional options (e.g., insurance options) as needed.

[0705] The device converts the user's selections and adjustments back into JSON format and sends them to the server.

[0706] Final contract confirmation and document generation

[0707] The server receives the adjustment details sent by the user and finalizes the contract plan.

[0708] The server stores contract information in a database (e.g., MySQL) and generates contract documents. These documents include user information and contract details.

[0709] The server sends a download link for the generated contract documents to the user.

[0710] The device displays a final confirmation screen to the user, prompting them to approve the contract.

[0711] The user clicks the approve button on the final confirmation screen.

[0712] The device provides a download link for the contract documents, allowing the user to download them. The contract is then formally concluded.

[0713] Specific example

[0714] For example, if a user wants to sign up for a new smartphone contract, they input their desired budget of 3000 yen / month, 5GB of data capacity, and the latest camera performance into the device and send the information. The generative artificial intelligence then generates several contract plans, which the device presents to the user. After the user selects a plan and makes adjustments such as adding insurance options, the final contract plan is confirmed, and the contract documents are generated and provided to the user.

[0715] This allows users to complete smartphone and landline phone contract procedures simply and quickly. Furthermore, by utilizing generative artificial intelligence, the system can provide contract plans that are best suited to the user's needs, improving the efficiency and convenience of the contract process.

[0716] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0717] Step 1:

[0718] The user accesses a smartphone, tablet, or online web interface to begin the contract process. The device displays a form for the user to enter their budget, desired data capacity, and required features (e.g., camera performance, battery life). This form is provided as HTML or a mobile app UI. Input is done in the form of text fields or dropdown menus.

[0719] Input: User's desired budget, data capacity, and feature requirements

[0720] Output: User-entered information (unprocessed)

[0721] Step 2:

[0722] The user enters information such as budget, data capacity, and required functions through the device's interface and clicks the submit button. At this time, the device converts the information entered by the user into JSON format.

[0723] Input: Information entered by the user

[0724] Data processing: Convert user input information into JSON format.

[0725] Output: User information in JSON format

[0726] Step 3:

[0727] The terminal securely sends the converted JSON data to the server using the HTTPS protocol. The server receives this data and prepares it for analysis.

[0728] Input: User information in JSON format

[0729] Data processing: Secure transmission of data

[0730] Output: User information sent to the server

[0731] Step 4:

[0732] The server analyzes the received data and prepares to send a prompt to a generative artificial intelligence (e.g., ChatGPT). This prompt includes the user's budget, desired data volume, and required functions. The server then formats the data into the appropriate format and sends it to the generative artificial intelligence.

[0733] Input: User information sent to the server

[0734] Data processing: Creating prompts for generative artificial intelligence.

[0735] Output: Prompt to send to the generative artificial intelligence.

[0736] Step 5:

[0737] The server sends a prompt to the generative artificial intelligence. For example, it might use a prompt like this:

[0738] "The user has a budget of 3000 yen / month and wants 5GB of data and the latest camera features. Please propose three optimal smartphone contract plans that meet these conditions."

[0739] Input: Prompt to send to generative AI

[0740] Data processing: Artificial intelligence generates multiple contract plans based on prompts.

[0741] Output: Generated contract plan

[0742] Step 6:

[0743] Generative artificial intelligence generates multiple subscription plans based on prompts. For example, "Plan A: 3000 yen / month, 5GB, latest camera," "Plan B: 2800 yen / month, 4GB, superior camera," "Plan C: 3200 yen / month, 6GB, latest camera," etc. This is then converted to JSON format and sent back to the server.

[0744] Input: Prompt sent to a generative artificial intelligence system

[0745] Data processing: Data analysis and contract plan generation using artificial intelligence.

[0746] Output: Contract plan in JSON format

[0747] Step 7:

[0748] The server sends the contract plan received from the generative artificial intelligence to the terminal. The terminal then displays the received contract plan visually to the user by reflecting it in the web interface or mobile UI.

[0749] Input: Contract plan in JSON format

[0750] Data processing: Convert received data for UI use.

[0751] Output: Visually displayed contract plan

[0752] Step 8:

[0753] The user selects the most suitable plan from those presented. They can also select or adjust additional options (e.g., insurance options) as needed. This adjusted information is then re-entered into the device.

[0754] Input: User selections and adjustments

[0755] Output: Selected and adjusted contract plan

[0756] Step 9:

[0757] The terminal converts the user's selections and adjustments into JSON format and sends them back to the server. The server receives this data and begins the process of finalizing the contract plan.

[0758] Input: User selections and adjustments

[0759] Data processing: Convert the selected content to JSON format and send it to the server.

[0760] Output: Final adjustments sent to the server

[0761] Step 10:

[0762] The server finalizes the contract plan and saves the contract information to a database (e.g., MySQL). Simultaneously, it generates the contract documents and sends a download link for the documents to the user's device.

[0763] Input: Final adjustments sent to the server

[0764] Data processing: Confirmation of contract information and storage in the database.

[0765] Output: Contract documents and download links

[0766] Step 11:

[0767] The device displays a final confirmation screen to the user, prompting them to approve the contract. The contract is officially concluded when the user clicks the approve button on the final confirmation screen.

[0768] Input: Contract documents and download links

[0769] Output: Final confirmation screen

[0770] Step 12:

[0771] The device provides a download link for the contract documents, allowing the user to download them. Simultaneously, the contract becomes formally concluded.

[0772] Input: Final confirmation approval

[0773] Output: Provision of download link and conclusion of contract

[0774] In this way, through this system, users can complete smartphone and landline phone contract procedures simply and quickly, and by utilizing generative artificial intelligence, the system can provide contract plans that are best suited to the user's needs.

[0775] (Application Example 1)

[0776] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0777] Traditional smartphone or landline phone contract procedures required users to visit electronics stores, which was time-consuming and laborious. Online contracts were also cumbersome, requiring users to manually review a large amount of information to choose the optimal plan. Furthermore, with the advancement of virtual reality (VR) technology, there was a growing demand for simplified contract procedures utilizing this technology.

[0778] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0779] In this invention, the server includes means for receiving initial information from a user; analysis means including a generation engine that analyzes the initial information and generates multiple contract plans in response to the user's requests; means for presenting the contract plans generated from the analysis means to the user; means for receiving a contract plan selected or adjusted by the user; means for finalizing the contract based on the selected or adjusted contract plan and generating contract documents; means for providing the contract documents to the user; and means for visually displaying multiple contract plans to the user in a virtual reality environment, allowing the user to select or adjust a plan. This enables the user to easily and quickly perform complex contract procedures using the virtual reality environment.

[0780] A "user terminal" is a device that provides an interface for user operation.

[0781] A "server" is a central processing unit that receives data sent from users, analyzes it, and generates multiple contract plans using generative artificial intelligence.

[0782] "Initial information" refers to information necessary for a user to complete the contract process, such as budget, data capacity, and required functions.

[0783] "Analysis means" refers to a method for analyzing initial information from the user and generating multiple contract plans based on that analysis.

[0784] A "generation engine" is an engine that uses generative artificial intelligence to generate multiple contract plans in response to user requests.

[0785] A "virtual reality environment" is a virtual space or environment that a user interacts with using virtual reality technology.

[0786] A "contract plan" is a selection of contract options proposed based on the user's requests and initial information.

[0787] "Contract documents" are official documents generated based on the contract plan selected or adjusted by the user.

[0788] A "user interface" refers to the screens and components provided for users to input initial information, and to review, select, and adjust their contract plans.

[0789] This invention provides a system that allows users to easily and quickly complete smartphone or landline phone contract procedures at home using a virtual reality environment. The system includes a user terminal, a server, and a user interface for operations within the virtual reality environment.

[0790] System Overview

[0791] The system receives and analyzes initial information from the user and generates multiple contract plans using generative artificial intelligence. These generated contract plans are presented to the user in a virtual reality environment, allowing the user to visually review, select, and adjust them. Once the final contract plan is confirmed, the contract documents are automatically generated and provided to the user.

[0792] Hardware and software to be used

[0793] Hardware:

[0794] Smartphone or tablet

[0795] Virtual reality goggles

[0796] Servers (for example, Amazon Web Services as a cloud environment)

[0797] Database (for example, MySQL)

[0798] software:

[0799] Virtual store application (based on the Unity engine)

[0800] Generative artificial intelligence models (e.g., OpenAI GPT-4)

[0801] Frontend libraries (e.g., React Native)

[0802] Backend framework (e.g., Node.js)

[0803] Program processing

[0804] 1. The user accesses a terminal within the virtual reality environment and begins the contract process. The user terminal displays an initial information input form, where the user enters their desired budget, data capacity, required functions, etc.

[0805] 2. The terminal converts the input data into JSON format and sends it to the server. The server then uses a generative artificial intelligence model (GPT-4) to perform data analysis and generate a contract plan.

[0806] 3. The generated contract plan is temporarily stored in the database and sent from the server to the terminal. The terminal visually projects the contract plan onto a holographic display in the virtual reality environment.

[0807] 4. The user reviews, selects, or adjusts the plan. The user's actions are sent back to the server, and the final contract plan is confirmed.

[0808] 5. The server generates contract documents based on the confirmed contract plan and provides a download link to the user's terminal. The contract is concluded when the user confirms and downloads the documents.

[0809] Specific example

[0810] As a specific scenario, the procedure for a new smartphone contract is shown below.

[0811] 1. The user puts on virtual reality goggles and launches the virtual store application.

[0812] 2. The device displays the "New Smartphone Contract" option within the virtual environment.

[0813] 3. The user controls an avatar and enters their budget, desired data capacity, and required functions.

[0814] 4. The terminal converts the input content into JSON format and sends it to the server.

[0815] 5. The server analyzes the received data and generates multiple subscription plans using a generative artificial intelligence model (GPT-4). For example, "Budget of 3000 yen / month, 5GB data capacity, latest camera features."

[0816] 6. The server sends the generated plan to the terminal and projects it onto a holographic display in the virtual reality environment.

[0817] 7. The user visually reviews the presented contract plan and selects "I want to add insurance options."

[0818] 8. The device sends the adjustment details back to the server.

[0819] 9. The server finalizes the plan, generates the contract documents, and sends them to the terminal.

[0820] 10. The device displays a final confirmation screen, and the user approves the contract.

[0821] 11. The server records the conclusion of the contract and provides a download link for the contract documents.

[0822] 12. The user downloads the contract documents, and the contract is officially concluded.

[0823] Example of a prompt

[0824] The following are examples of prompts to input into the generated AI model:

[0825] Please propose the optimal contract plan based on the user's budget, data capacity, and required features. Please use the following information:

[0826] Budget: 3000 yen / month

[0827] Data capacity: 5GB

[0828] Required features: Latest camera features

[0829] Please provide multiple contract plans.

[0830] In this way, the present invention enables users to easily and quickly complete contract procedures using a virtual reality environment.

[0831] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0832] Step 1:

[0833] The user puts on virtual reality goggles and launches a virtual store application. The device displays the "New Smartphone Contract" option within the virtual environment. The user controls an avatar and enters information such as budget, desired data capacity, and required features. The device converts the entered data into JSON format and sends it to the server.

[0834] Step 2:

[0835] The server analyzes the initial user information it receives. This analysis uses a generative AI model (e.g., GPT-4). The server generates multiple contract plans based on the user's input data. This prompt is then input into the generative AI model, the analysis results are obtained, and a contract plan is generated.

[0836] Step 3:

[0837] The server temporarily stores the generated contract plan in a database and sends it to the terminal. The terminal visually projects the contract plan onto a holographic display in the virtual reality environment. The user reviews the multiple plans presented.

[0838] Step 4:

[0839] The user selects or adjusts their desired subscription plan within the virtual reality environment. The device then converts this selected or adjusted information back into JSON format and sends it to the server.

[0840] Step 5:

[0841] The server receives the adjustments submitted by the user and finalizes the contract plan. Based on the final plan, the server generates the contract documents and sends a download link to the user's device.

[0842] Step 6:

[0843] The terminal displays a final confirmation screen within the virtual reality environment, and the user approves the contract. The server records the conclusion of the contract and provides the user with a download link for the contract documents. The user downloads the contract documents, and the contract is officially concluded.

[0844] The above describes the processing flow of the system program that implements the application example.

[0845] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0846] This invention provides a system for users to smoothly complete smartphone or landline phone contract procedures using terminals installed in stores not yet stocked in mass retailers or through an online environment. In particular, this invention incorporates an emotion engine that recognizes the user's emotions and adjusts the contract plan accordingly. This system receives and analyzes the user's initial information, automatically generates and presents multiple contract plans using generative artificial intelligence, and provides the user with the optimal plan, thereby simplifying the contract procedure. Furthermore, it provides a more personalized service by responding to the user's emotions.

[0847] Components

[0848] 1. User terminal: A device that provides an interface for user operation. This terminal may be installed in stores not affiliated with mass retailers, or it may be provided as an online web interface or mobile application.

[0849] 2. Server: This is the central processing unit that receives and analyzes data sent from users and generates multiple contract plans using generative artificial intelligence.

[0850] 3. Emotion Engine: This engine includes technology to recognize the user's emotions by analyzing the user's voice, facial expressions, input speed, etc.

[0851] Program Processing Description

[0852] Acceptance of initial information

[0853] The device provides an interface that allows the user to input their budget, desired data capacity, and required features (e.g., camera performance, battery life, etc.).

[0854] The user enters the necessary information using the terminal's interface.

[0855] The terminal converts the initial information entered into the appropriate data format (e.g., JSON) and sends it to the server.

[0856] Emotional analysis

[0857] The device captures the user's voice tone, facial expressions, and input speed in real time and sends this information to the server.

[0858] The server utilizes an emotion engine to analyze the transmitted data and recognize the user's emotional state. Recognized emotions include, for example, joy, excitement, confusion, and anger.

[0859] Information analysis and contract plan generation

[0860] The server receives initial information and emotional state sent by the user and analyzes both using generative artificial intelligence.

[0861] The server generates multiple optimal contract plans based on the analysis results. For example, if the user is confused, it will suggest a simpler and easier-to-understand plan.

[0862] The server sends the generated contract plan to the terminal.

[0863] Proposal and adjustment of contract plans

[0864] The device displays the received contract plan to the user in a visually easy-to-understand format. The user can then select the plan that best suits them from the multiple plans offered.

[0865] The user selects one of the displayed plans or adjusts options (e.g., adding insurance).

[0866] The device then resends the user's selections and adjustments to the server.

[0867] Final contract confirmation and document generation

[0868] The server analyzes the adjustment details sent by the user and determines the final contract plan.

[0869] The server generates contract documents based on the confirmed contract plan and sends a download link for the contract documents to the user's device.

[0870] The device displays a final confirmation screen to the user, prompting them to approve the contract.

[0871] The user grants approval.

[0872] The device provides a download link for the contract documents, and the contract is officially concluded.

[0873] Specific example

[0874] As a concrete example, here is a scenario for a new smartphone contract:

[0875] 1. The user accesses the store's tablet terminal and selects "New smartphone contract".

[0876] 2. The device displays a form that prompts the user to enter their budget, desired data capacity, and required features (e.g., latest camera features).

[0877] 3. The user enters the information and presses the submit button.

[0878] 4. The terminal converts the input content into JSON format and sends it to the server.

[0879] 5. The terminal captures the user's voice tone, facial expressions, and input speed in real time and sends this information to the server.

[0880] 6. The server analyzes received data and sentiment data, and uses generative artificial intelligence to generate multiple contract plans. For example, "Budget of 3000 yen / month, 5GB data capacity, latest camera features." If the user is confused, it will suggest a simpler and easier-to-understand plan.

[0881] 7. The server sends the generated plan to the terminal.

[0882] 8. The device displays the suggested plan to the user.

[0883] 9. The user selects "I want to add an insurance option" and makes adjustments to the device.

[0884] 10. The device sends the adjustment data to the server.

[0885] 11. The server finalizes the plan, generates the contract documents, and sends them to the terminal.

[0886] 12. The device displays a final confirmation screen, and the user approves the contract.

[0887] 13. The server records the conclusion of the contract and sends a download link for the contract documents to the terminal.

[0888] 14. The device displays to the user that the contract has been concluded and a download link is available.

[0889] Thus, this system allows users to complete smartphone and landline phone contracts easily and quickly. Furthermore, by using an emotion engine, personalized responses tailored to the user's emotions become possible, greatly improving convenience and satisfaction.

[0890] The following describes the processing flow.

[0891] Step 1:

[0892] The device boots up and displays a welcome screen. The user is presented with the option of either a "smartphone contract" or a "landline phone contract."

[0893] Step 2:

[0894] When the user selects "Smartphone Contract," a form appears on the device for them to enter the necessary initial information (budget, data capacity, required features).

[0895] Step 3:

[0896] The user enters their budget, data capacity, and required features into the form and presses the submit button.

[0897] Step 4:

[0898] The device captures the user's voice tone, facial expressions, and typing speed. This information is then analyzed by an emotion engine.

[0899] Step 5:

[0900] The device converts the user's initial information and sentiment data into JSON format and sends it to the server over the network.

[0901] Step 6:

[0902] The server parses the JSON data received from the terminal. Based on budget, data volume, and functional requirements, it identifies the user's requirements.

[0903] Step 7:

[0904] The server's emotion engine analyzes the user's voice tone, facial expressions, and typing speed to recognize the user's emotional state.

[0905] Step 8:

[0906] The server's generative artificial intelligence generates the optimal contract plan for the user based on the initial information and emotion data received. For example, if the user is confused, it prioritizes a simpler and easier-to-understand plan.

[0907] Step 9:

[0908] The server encodes the multiple contract plans it generates into JSON format and sends them to the terminal.

[0909] Step 10:

[0910] The device decodes the received JSON data and displays the plan to the user in a visually easy-to-understand format.

[0911] Step 11:

[0912] The user selects one of several contract plans displayed. They can also adjust options as needed (e.g., add insurance).

[0913] Step 12:

[0914] The device converts the user's selections and adjustments back into JSON format and sends them to the server.

[0915] Step 13:

[0916] The server analyzes the adjustment data received from the terminal and determines the final contract plan.

[0917] Step 14:

[0918] Based on the confirmed contract plan, the server generates the contract documents and sends a download link for the contract documents to the user.

[0919] Step 15:

[0920] The device displays a final confirmation screen to the user, prompting them to approve the contract.

[0921] Step 16:

[0922] The user performs a final review and clicks the "Approve" button.

[0923] Step 17:

[0924] The device sends the authorization information to the server.

[0925] Step 18:

[0926] The server confirms the contract is finalized and records the contract information.

[0927] Step 19:

[0928] The server sends a download link for the contract documents to the user's device.

[0929] Step 20:

[0930] The device will display a notification that the contract has been concluded, along with a link to download the contract documents to the user.

[0931] This process allows users to complete smartphone and landline phone contract procedures simply and quickly using this system. Furthermore, by utilizing the emotion engine, personalized responses that respond to the user's emotions become possible, increasing user satisfaction.

[0932] (Example 2)

[0933] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0934] Traditional contract procedures often result in a poor user experience because they don't consider the user's emotions or psychological state when users input necessary information and choose the best plan from the provided options. In particular, users may feel confused or dissatisfied when selecting the optimal plan from a complex selection. Furthermore, the inability to provide flexible plans tailored to the user's emotional state is a significant challenge.

[0935] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0936] In this invention, the server includes means for receiving initial information from the user, analysis means including a generation engine that analyzes the initial information and generates multiple contract plans based on the user's requests and emotional state, and emotion recognition means that analyzes the user's voice tone, facial expressions, and input speed to recognize the emotional state. This makes it possible to provide personalized contract plans that are tailored to the user's psychological state.

[0937] A "user" refers to an individual who operates the system and selects or adjusts their contract plan.

[0938] "Initial information" refers to the basic information that users input into the system, such as budget, data capacity, and functional requirements.

[0939] A "generation engine" refers to a program and algorithm that analyzes a user's initial information and emotional state, and automatically generates multiple contract plans based on that analysis.

[0940] "Analysis means" refers to a series of processes for processing initial information obtained from the user and generating a contract plan using a generation engine.

[0941] "Emotion recognition means" refers to technologies and devices that analyze the user's voice tone, facial expressions, and input speed to recognize the user's emotional state.

[0942] "Contract documents" refer to formal documents that contain the final terms of the agreement and require confirmation and approval by the user.

[0943] "Adjustment" refers to the act of adding or changing the contract plan selected by the user.

[0944] "Provision" refers to the act of the system displaying or making available to the user, via a download link, a contract plan or contract documents that it has generated.

[0945] This invention provides a system for users to smoothly complete smartphone or landline phone contract procedures using terminals installed in stores not yet stocked in mass retailers or through an online environment. In particular, this invention incorporates an emotion engine that recognizes the user's emotions and adjusts the contract plan accordingly. This system receives and analyzes the user's initial information, automatically generates and presents multiple contract plans using generative artificial intelligence, and provides the user with the optimal plan, thereby simplifying the contract procedure. Furthermore, it provides a more personalized service by responding to the user's emotions.

[0946] Components

[0947] 1. User terminal: A device that provides an interface for user operation. This terminal may be installed in stores not affiliated with mass retailers, or it may be provided as an online web interface or mobile application. For example, tablet devices and smartphones are used.

[0948] 2. Server: This is the central processing unit that receives and analyzes data sent from users and generates multiple contract plans using generative artificial intelligence. For example, a cloud server is used.

[0949] 3. Emotion Engine: This engine includes technologies for recognizing the user's emotions by analyzing their voice, facial expressions, input speed, etc. For example, voice tone analysis software and facial recognition software may be used.

[0950] Process Overview

[0951] The device provides an interface that allows the user to input their budget, desired data capacity, and required features (e.g., camera performance, battery life). Once the user inputs the necessary information using the device's interface, the device converts it into an appropriate data format (e.g., JSON) and sends it to the server. Furthermore, the device captures the user's voice tone, facial expressions, and input speed in real time and sends this information to the server.

[0952] The server utilizes an emotion engine to analyze the transmitted data and recognize the user's emotional state. Recognized emotions include, for example, joy, excitement, confusion, and anger. Next, the server receives the initial information and emotional state transmitted by the user and analyzes both using generative artificial intelligence. Based on this analysis, the server generates several optimal contract plans and sends them to the terminal.

[0953] The terminal displays the received contract plan to the user in a visually easy-to-understand format. The user can select the plan that best suits them from the multiple plans offered. Once the user selects one of the displayed plans or adjusts options (e.g., adding insurance), the selection and adjustments are sent back from the terminal to the server. The server analyzes the adjustments sent by the user and finalizes the contract plan. Based on the finalized contract plan, the server generates the contract documents and sends a download link for the contract documents to the terminal. The terminal displays a final confirmation screen to the user, prompting them to approve the contract. Once the user approves, the terminal provides the download link for the contract documents, and the contract is officially concluded.

[0954] Specific example

[0955] For example, a possible prompt for a new smartphone contract scenario might look like this:

[0956] "I'd like to sign up for a new smartphone contract. My monthly budget is under 3000 yen, I need at least 5GB of data, and camera performance is a priority."

[0957] Thus, this system allows users to complete smartphone and landline phone contracts easily and quickly. Furthermore, by using an emotion engine, personalized responses tailored to the user's emotions become possible, greatly improving convenience and satisfaction.

[0958] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0959] Step 1:

[0960] The device provides an interface that allows the user to input their budget, desired data capacity, and required features (e.g., camera performance, battery life, etc.).

[0961] Input: User budget, desired data capacity, required features

[0962] Action: The terminal displays a form, and the user completes the input.

[0963] Output: Information entered by the user

[0964] Step 2:

[0965] The user enters the necessary information using the terminal's interface and presses the submit button.

[0966] Input: Budget entered by the user, desired data capacity, required functions

[0967] Operation: The user enters information into each field of the form and presses the submit button.

[0968] Output: Initial information from form input

[0969] Step 3:

[0970] The terminal converts the initial information entered into the appropriate data format (e.g., JSON) and sends it to the server.

[0971] Input: Initial information entered via form

[0972] Operation: The terminal converts the input data into a JSON object and sends it to the server as an HTTP request.

[0973] Output: Initial information data in JSON format

[0974] Step 4:

[0975] The device captures the user's voice tone, facial expressions, and input speed in real time and sends this information to the server.

[0976] Input: User's voice tone, facial expression, input speed

[0977] Operation: The device uses its camera and microphone to capture data and send it to the server.

[0978] Output: Voice tone data, facial expression data, input speed data

[0979] Step 5:

[0980] The server utilizes an emotion engine to analyze the transmitted data and recognize the user's emotional state.

[0981] Input: Voice tone data, facial expression data, input speed data

[0982] Operation: The server uses emotion recognition software to analyze data and classify the user's emotional state.

[0983] Output: User's emotional state (e.g., joy, excitement, confusion, anger)

[0984] Step 6:

[0985] The server receives initial information and emotional state sent by the user and analyzes both using generative artificial intelligence.

[0986] Input: Initial information data in JSON format, user's emotional state

[0987] Operation: The server uses generative artificial intelligence to analyze the input data.

[0988] Output: Analysis results (data based on user requests and emotional state)

[0989] Step 7:

[0990] The server generates multiple optimal contract plans based on the analysis results and sends them to the terminal.

[0991] Input: Analysis results

[0992] Operation: The server generates multiple contract plans and sends them to the terminal in JSON format.

[0993] Output: Contract plan data in JSON format

[0994] Step 8:

[0995] The device displays the received contract plan to the user in a visually easy-to-understand format.

[0996] Input: Contract plan data in JSON format

[0997] Operation: The terminal appropriately lays out and displays the proposed contract plan to the user.

[0998] Output: Displayed contract plan

[0999] Step 9:

[1000] The user selects one of the displayed plans or adjusts options (e.g., adding insurance).

[1001] Input: Displayed contract plan

[1002] Operation: Users select a plan and add options.

[1003] Output: Selected or adjusted contract plan

[1004] Step 10:

[1005] The device then resends the user's selections and adjustments to the server.

[1006] Input: Selected or adjusted contract plan

[1007] Operation: The terminal converts the selected data into JSON format and sends it to the server.

[1008] Output: Selected or adjusted contract plan data in JSON format

[1009] Step 11:

[1010] The server analyzes the adjustment details sent by the user and determines the final contract plan.

[1011] Input: Selected or adjusted contract plan data in JSON format

[1012] Operation: The server calculates and confirms the final contract details based on the selected options.

[1013] Output: Confirmed contract plan data

[1014] Step 12:

[1015] The server generates contract documents based on the confirmed contract plan and sends a download link for the contract documents to the user's device.

[1016] Input: Confirmed contract plan data

[1017] Operation: The server generates the contract documents in PDF format and sends a download link to the device.

[1018] Output: Download link for contract documents

[1019] Step 13:

[1020] The device displays a final confirmation screen to the user, prompting them to approve the contract.

[1021] Input: Download link for contract documents

[1022] Action: The device displays the contract details and presents an approval button.

[1023] Output: Final confirmation screen and approval button

[1024] Step 14:

[1025] The user grants approval.

[1026] Input: Final confirmation screen and approval button

[1027] Action: The user clicks the approve button.

[1028] Output: Approved contract details

[1029] Step 15:

[1030] The device provides a download link for the contract documents, and the contract is officially concluded.

[1031] Input: Approved contract details

[1032] Operation: The device displays a download link, and the user downloads the contract documents.

[1033] Output: Download link and downloaded contract documents

[1034] (Application Example 2)

[1035] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[1036] In today's world, the contract procedures for smartphones and landlines have become cumbersome and stressful for users. In particular, first-time users and those with limited technical knowledge find it difficult to select the appropriate plan, resulting in the problem of not being able to choose the optimal contract plan. Furthermore, traditional online contract systems fail to consider the user's emotional state, leading to confusion and anxiety. There is a need to solve these problems and provide a system that allows users to complete contract procedures more easily and with greater peace of mind.

[1037] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving initial information from the user; analysis means including a generation engine that analyzes the initial information and generates multiple contract plans in response to the user's requests; means for adjusting the contract plan according to the user's emotions using an emotion recognition engine that recognizes the user's emotions from voice, facial expressions, input speed, etc.; means for displaying the multiple contract plans generated based on the user's emotions on the interface of the virtual store and providing them to the user in a visually easy-to-understand manner; means for presenting the contract plan generated from the analysis means to the user; means for receiving the contract plan selected or adjusted by the user; means for finalizing the contract based on the selected or adjusted contract plan and generating contract documents; and means for providing the contract documents to the user. As a result, the user can easily and quickly select the optimal contract plan according to their emotional state. Furthermore, by using the virtual store, convenience and satisfaction are improved, and contract procedures can be carried out with peace of mind.

[1038] A "user terminal" is a device that provides an interface for user operation and enables access to virtual stores.

[1039] The "analysis means" refers to a system that includes an engine for analyzing the user's initial information and generating multiple contract plans based on the user's requests.

[1040] A "generation engine" is an engine that includes artificial intelligence to generate multiple contract plans based on the user's initial information.

[1041] An "emotion recognition engine" is an engine that includes technology to recognize the user's emotions by analyzing the user's voice, facial expressions, input speed, etc.

[1042] "Means of adjusting contract plans according to user emotions" refers to means of appropriately adjusting contract plans based on the user's emotions recognized by an emotion recognition engine.

[1043] A "virtual store" is a virtual store environment that users can access using VR or smart glasses, where they can select products and complete contract procedures.

[1044] An "interface" refers to the means by which a user interacts with a system, such as inputting, selecting, and displaying information.

[1045] "Means for generating contract documents" refers to the means of creating final contract documents based on the contract plan selected or adjusted by the user.

[1046] "Voice tone" refers to the characteristics of the user's voice, such as pitch, intonation, and volume, and is data used to analyze emotions in speech recognition.

[1047] "Facial expressions" refer to changes in a user's facial expressions and subtle movements, and are data used to analyze emotions using facial recognition technology.

[1048] "Input speed" refers to the speed and rhythm at which a user inputs information, and is an indicator used to infer the user's emotional state based on this.

[1049] "Visually easy to understand" refers to providing information to users in a format that is easy to grasp intuitively, and includes elements such as graphs, icons, and animations.

[1050] Modes for carrying out the invention

[1051] This invention is a system designed to analyze a user's emotions in real time and provide optimal responses when they ask questions or make purchases in a virtual store. This system allows users to easily and quickly complete smartphone or landline phone contract procedures. Furthermore, by providing personalized responses tailored to the user's emotional state, it can increase user satisfaction.

[1052] Hardware and software

[1053] This system uses the following hardware and software.

[1054] hardware

[1055] 1. VR goggles or smart glasses: These are devices used by users to access virtual stores.

[1056] 2. Microphone: A device used to record speech for speech recognition.

[1057] 3. Camera: A device that collects facial data for facial expression analysis.

[1058] software

[1059] 1. Application Server (Python-based): Operates as the central processing unit for the entire system.

[1060] 2. Emotion Engine Module: Analyzes the user's voice tone, facial expressions, and input speed to recognize their emotional state.

[1061] 3. Generative Artificial Intelligence Planner (AIPlanner): Generates multiple contract plans based on the user's initial information and emotional state.

[1062] 4. Virtual Shop Interface Module (VirtualShopTerminal): Collects information from the user and visually displays the contract plan.

[1063] Program processing

[1064] The server first collects initial information (budget, data capacity, functional requirements) from the user via the user's terminal. This initial information is sent to the server in JSON format. At the same time, emotional data such as the user's voice tone, facial expressions, and typing speed is also collected and sent to the server.

[1065] The server uses an emotion engine module to analyze the user's emotional state. For example, if the user is agitated, it adjusts the contract plan based on that emotional state, suggesting a state-of-the-art model.

[1066] Next, a generative artificial intelligence planner generates multiple contract plans based on the user's initial information and emotional state. The generated plans are then visually presented to the user through the virtual store interface.

[1067] The user makes selections and adjustments from the presented plans, and the results are sent back to the server. The server then finalizes the contract plan based on the user's selections and adjustments, and generates the contract documents.

[1068] Ultimately, the contract documents are presented to the user via the virtual store interface, and the contract is finalized upon user approval. A download link for the contract documents is provided, allowing the user to download and save them.

[1069] Specific example

[1070] For example, if a user accesses a virtual store and wants to sign up for a new smartphone contract, they would follow these steps:

[1071] 1. The user puts on VR goggles and logs into the virtual shop.

[1072] 2. A virtual assistant appears and asks questions about your budget, desired data capacity, and feature requirements.

[1073] 3. The user enters this information and provides answers via voice.

[1074] 4. The server analyzes the user's tone of voice and facial expressions to detect if the user is excited.

[1075] 5. A generative artificial intelligence planner generates the optimal contract plan for the user based on emotional data.

[1076] 6. Multiple generated contract plans are presented to the user through the virtual store interface.

[1077] 7. The user selects the most suitable plan and makes adjustments as needed.

[1078] 8. The final contract plan is confirmed on the server, and the contract documents are generated.

[1079] 9. The contract is concluded when the user reviews and approves the contract documents.

[1080] 10. A download link for the contract documents is provided, and the user saves it.

[1081] Example of a prompt

[1082] Examples of prompts to input into a generative AI model:

[1083] "Based on the user's voice tone and facial expression data, recognize their emotional state. If the user is excited, generate a plan recommending the latest model and create a confirmation message in simple language. Also, consider their budget and desired specifications."

[1084] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1085] Step 1:

[1086] The user wears VR goggles or smart glasses and logs into a virtual store. The terminal displays an interface prompting the user to enter their budget, desired data capacity, and required features (e.g., latest camera, battery life, etc.). The user enters this information via voice or text. The entered information is converted to JSON format and sent to the server.

[1087] Input: User budget, data capacity, and feature requirements

[1088] Output: Initial information (JSON format)

[1089] Specific operation: The terminal receives voice and text input from the user, converts it into the appropriate data format, and prepares it for transmission.

[1090] Step 2:

[1091] The device simultaneously collects data on the user's facial expressions, voice tone, and input speed. This emotional data is transmitted to the server in real time.

[1092] Input: User's voice tone, facial expression, and input speed

[1093] Output: Sentiment data

[1094] Specific operation: The device analyzes the user's camera video and microphone audio and sends it to the server as emotion data.

[1095] Step 3:

[1096] The server analyzes the initial information it receives. The analysis includes a generation engine that generates multiple contract plans based on the user's requests.

[1097] Input: Initial information (JSON format)

[1098] Output: Multiple contract plans

[1099] Specific operation: The server analyzes initial information and uses generative artificial intelligence to generate a contract plan suitable for the user.

[1100] Step 4:

[1101] The server uses an emotion recognition engine to analyze the user's emotional state. Based on the user's voice tone, facial expressions, and input speed, it recognizes the user's emotional state and reflects the results in the contract plan.

[1102] Input: Sentiment data

[1103] Output: Adjusted contract plan

[1104] Specific operation: The server analyzes emotional data using an emotion recognition engine and generates a plan that corresponds to the user's emotions.

[1105] Step 5:

[1106] The server presents the generated contract plan to the user through the virtual store interface. It is designed to be displayed in a visually easy-to-understand format for the user.

[1107] Input: Adjusted contract plan

[1108] Output: Visual presentation on the user interface

[1109] Specific operation: The server sends the generated plan to the terminal, and the terminal displays it in the user interface.

[1110] Step 6:

[1111] The user selects the most suitable plan from several options presented and makes further adjustments as needed. The selection and adjustments are sent to the server via the device.

[1112] Input: User selections and adjustments

[1113] Output: Adjusted contract plan

[1114] Specific operation: The terminal receives the user's selections and adjustments, and then sends them back to the server.

[1115] Step 7:

[1116] The server analyzes the selections and adjustments submitted by the user to determine the final contract plan. Based on this finalized plan, it then generates the contract documents.

[1117] Input: Adjusted contract plan

[1118] Output: Final contract plan and contract documents

[1119] Specific actions: The server analyzes the adjustments and finalizes the contract plan. It then generates the contract documents.

[1120] Step 8:

[1121] The server sends the generated contract documents to the terminal, which then displays them to the user. A screen prompting the user for confirmation and approval is then displayed.

[1122] Input: Contract documents

[1123] Output: Presentation of contract documents to the user

[1124] Specific actions: The device receives the contract documents and displays them to the user. A message requesting confirmation and approval is displayed.

[1125] Step 9:

[1126] The user reviews and approves the contract documents. The contract is officially concluded when the approval is sent to the server.

[1127] Input: User approval

[1128] Output: Contract concluded

[1129] Specific operation: The user reviews the contract documents and enters their approval. This information is then sent to the server.

[1130] Step 10:

[1131] After the contract is finalized, the server generates a download link for the contract documents and provides it to the user via their device. The user can then download and save the contract documents.

[1132] Input: Record of contract formation

[1133] Output: Download link

[1134] Specific operation: The server records the conclusion of the contract and generates a link to download the contract documents. This link is then provided to the user via the terminal.

[1135] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1136] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1137] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[1138] [Third Embodiment]

[1139] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[1140] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1141] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1142] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[1143] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1144] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1145] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1146] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1147] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1148] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1149] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1150] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[1151] This invention provides a system for users to smoothly complete smartphone or landline phone contract procedures using terminals installed in stores not yet operated by mass retailers or through an online environment. This system receives and analyzes the user's initial information, automatically generates and presents multiple contract plans using generative artificial intelligence, and provides the user with the most suitable plan, thereby simplifying the contract procedure.

[1152] Components

[1153] 1. User terminal: A device that provides an interface for user operation. This terminal may be installed in stores not affiliated with mass retailers, or it may be provided as an online web interface or mobile application.

[1154] 2. Server: This is the central processing unit that receives and analyzes data sent from users and generates multiple contract plans using generative artificial intelligence.

[1155] Program Processing Description

[1156] Acceptance of initial information

[1157] The device provides an interface that allows the user to input their budget, desired data capacity, and required features (e.g., camera performance, battery life, etc.).

[1158] The user enters the necessary information using the terminal's interface.

[1159] The terminal converts the initial information entered into the appropriate data format (e.g., JSON) and sends it to the server.

[1160] Information analysis and contract plan generation

[1161] The server receives data sent from the user and analyzes that information using generative artificial intelligence.

[1162] The server generates multiple optimal contract plans based on the analysis results. For example, pricing plans based on budget and communication plans based on data capacity are automatically generated.

[1163] The server sends the generated contract plan to the terminal.

[1164] Proposal and adjustment of contract plans

[1165] The device visually displays the contract plans it has received to the user. The user can then select the plan that best suits them from the multiple plans offered.

[1166] The user selects one of the displayed plans or adjusts options (e.g., adding insurance).

[1167] The device then resends the user's selections and adjustments to the server.

[1168] Final contract confirmation and document generation

[1169] The server receives the adjustment details sent by the user and finalizes the contract plan.

[1170] The server generates contract documents based on the contract plan and sends a download link to the device.

[1171] The device displays a final confirmation screen to the user, prompting them to approve the contract.

[1172] The user grants approval.

[1173] The device provides a download link for the contract documents, and the contract is officially concluded.

[1174] Specific example

[1175] As a concrete example, here is a scenario for a new smartphone contract:

[1176] 1. The user accesses the store's tablet terminal and selects "New smartphone contract".

[1177] 2. The device displays a form that prompts the user to enter their budget, desired data capacity, and required features (e.g., latest camera features).

[1178] 3. The user enters the information and presses the submit button.

[1179] 4. The terminal converts the input content into JSON format and sends it to the server.

[1180] 5. The server analyzes the received data and uses generative artificial intelligence to generate multiple contract plans. For example, "Budget of 3000 yen / month, 5GB data capacity, latest camera features."

[1181] 6. The server sends the generated plan to the terminal.

[1182] 7. The device displays the suggested plan to the user.

[1183] 8. The user selects "I want to add an insurance option" and makes adjustments to the device.

[1184] 9. The device sends the adjustment data to the server.

[1185] 10. The server finalizes the plan, generates the contract documents, and sends them to the terminal.

[1186] 11. The device displays a final confirmation screen, and the user approves the contract.

[1187] 12. The server records the conclusion of the contract and sends a download link for the contract documents to the terminal.

[1188] 13. The device displays to the user that the contract has been concluded and a download link is available.

[1189] Thus, this system allows users to complete smartphone and landline phone contracts easily and quickly. Furthermore, by using generative artificial intelligence, it is possible to provide plans that are optimally suited to the user's needs, greatly improving the efficiency and convenience of the contract process.

[1190] The following describes the processing flow.

[1191] Step 1:

[1192] The device boots up and displays a welcome screen. The user is presented with the option of either a "smartphone contract" or a "landline phone contract."

[1193] Step 2:

[1194] When the user selects "Smartphone Contract," a form appears on the device for them to enter the necessary initial information (budget, data capacity, required features).

[1195] Step 3:

[1196] The user enters their budget, data capacity, and required features into the form and presses the submit button.

[1197] Step 4:

[1198] The terminal converts the initial information entered into it into JSON format and sends it to the server via the network.

[1199] Step 5:

[1200] The server parses the JSON data received from the terminal to identify the user's request.

[1201] Step 6:

[1202] The server uses generative artificial intelligence to analyze the received information and generate multiple contract plans tailored to the user's needs.

[1203] Step 7:

[1204] The server encodes the multiple contract plans it generates into JSON format and sends them to the terminal.

[1205] Step 8:

[1206] The device decodes the received JSON data and displays the plan to the user in a visually easy-to-understand format.

[1207] Step 9:

[1208] The user selects one of several contract plans displayed. They can also adjust options (e.g., add insurance) as needed.

[1209] Step 10:

[1210] The device converts the user's selections or adjustments back into JSON format and sends them to the server.

[1211] Step 11:

[1212] The server analyzes the adjustment data received from the terminal and determines the final contract plan.

[1213] Step 12:

[1214] The server generates contract documents based on the confirmed contract plan and sends a download link for the contract documents to the terminal in JSON format.

[1215] Step 13:

[1216] The device displays a final confirmation screen to the user, prompting them to approve the contract.

[1217] Step 14:

[1218] The user performs a final review and clicks the "Approve" button.

[1219] Step 15:

[1220] The device sends the authorization information to the server.

[1221] Step 16:

[1222] The server confirms the contract is finalized and records the contract information.

[1223] Step 17:

[1224] The server sends a download link for the contract documents to the user's device.

[1225] Step 18:

[1226] The device will display a notification that the contract has been concluded, along with a link to download the contract documents to the user.

[1227] The above outlines the detailed processing steps of the program. This process allows users to easily and smoothly sign up for smartphone or landline phone contracts.

[1228] (Example 1)

[1229] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1230] Traditional smartphone and landline phone contract procedures were cumbersome, making it difficult for users to find a contract plan that best suited their needs. In particular, manually searching for a contract plan that met diverse requirements such as budget, data capacity, and functional requirements was extremely time-consuming and laborious. Furthermore, the contract procedures were often divided into multiple steps, making them confusing for users. Therefore, there is a need to improve the efficiency and convenience of the contract process.

[1231] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1232] In this invention, the server includes terminal means for receiving initial information from a user, analysis means including generative artificial intelligence for analyzing the initial information and generating multiple contract plans in response to the user's requests, terminal means for presenting the contract plans generated by the analysis means to the user, terminal means for receiving a contract plan selected or adjusted by the user, server means for finalizing the contract based on the selected or adjusted contract plan and generating contract documents, and terminal means for providing the contract documents to the user. This enables users to complete smartphone and landline phone contracts easily and quickly. Furthermore, by using generative artificial intelligence, it is possible to provide a contract plan that is optimal for the user's requests, greatly improving the efficiency and convenience of the contract procedure.

[1233] 1. "Terminal means" refers to a device that a user operates, inputs or selects information, and communicates with a server.

[1234] 2. "Analysis means" refers to a part of a system that analyzes initial information received from the user and generates multiple contract plans using generative artificial intelligence.

[1235] 3. The "generation engine" refers to the part that includes generative artificial intelligence and has the function of automatically generating contract plans based on user requests.

[1236] 4. The "server" is the central device of a system that receives data sent from the user, analyzes it, generates a contract plan, confirms the contract, and generates contract documents.

[1237] 5. "Generative artificial intelligence" refers to artificial intelligence technology used to analyze a user's initial information and generate multiple contract plans based on that information.

[1238] 6. A "contract plan" is a selection of communication contract options offered based on the user's budget, data capacity, and functional requirements.

[1239] 7. "Initial information" refers to information such as budget, desired data capacity, and functional requirements that the user enters when completing the contract procedures.

[1240] 8. "Adjustment details" refers to the requests for additions or changes made by the user to the presented contract plan.

[1241] 9. "Contract documents" are formal documents that record the final terms of the contract and are provided to the user.

[1242] 10. The "final confirmation screen" is an interface that allows the user to review and finally approve the contract plan they have selected or adjusted.

[1243] This invention is a system that enables users to smoothly complete contract procedures for smartphones and landlines. This system is used via terminals installed in stores not yet operated by mass retailers, or through an online environment. It receives and analyzes the user's initial information, automatically generates and presents multiple contract plans using generative artificial intelligence, and provides the user with the most suitable plan, thereby simplifying the contract procedure.

[1244] Components

[1245] 1. User terminal: A device that provides an interface for user operation. This terminal may be installed in stores not affiliated with mass retailers, or it may be provided as an online web interface or mobile application. Examples include tablet devices, PCs, and smartphones.

[1246] 2. Server: This is the central processing unit that receives and analyzes data sent from users and generates multiple contract plans using generative artificial intelligence. The server requires a high-performance CPU and sufficient memory, and a database (e.g., MySQL) is used for data storage.

[1247] 3. Generative Artificial Intelligence: This is an artificial intelligence model for automatically generating contract plans based on user requests. For example, OpenAI's ChatGPT falls into this category.

[1248] Program processing

[1249] Acceptance of initial information

[1250] The device provides an interface that allows the user to input their budget, desired data capacity, and required features (e.g., camera performance, battery life). This can be done using HTML forms or a mobile app UI.

[1251] The user enters the necessary information through the device's interface. For example, they might enter "3000 yen / month" in the budget field, "5GB" in the data capacity field, and "latest camera performance" in the required features field.

[1252] The terminal converts the entered information into JSON format and securely sends it to the server using the HTTPS protocol.

[1253] Information analysis and contract plan generation

[1254] The server receives JSON data sent by the user.

[1255] The server analyzes the received data and sends prompts to the generative artificial intelligence (AI). This is done using a Python script or similar to send prompts like the following to the generative AI (e.g., OpenAI's ChatGPT):

[1256] "The user has a budget of 3000 yen / month and wants 5GB of data and the latest camera features. Please propose three optimal smartphone contract plans that meet these conditions."

[1257] Generative artificial intelligence generates multiple subscription plans based on prompts. For example, "Plan A: 3000 yen / month, 5GB, latest camera," "Plan B: 2800 yen / month, 4GB, superior camera," "Plan C: 3200 yen / month, 6GB, latest camera," etc.

[1258] The server converts the generated contract plan into JSON format and sends it to the terminal.

[1259] Proposal and adjustment of contract plans

[1260] The device visually displays the contract plans received by the user. Multiple contract plans are displayed in a list format in the user interface.

[1261] The user selects the most suitable plan from those presented. They can also select or adjust additional options (e.g., insurance options) as needed.

[1262] The device converts the user's selections and adjustments back into JSON format and sends them to the server.

[1263] Final contract confirmation and document generation

[1264] The server receives the adjustment details sent by the user and finalizes the contract plan.

[1265] The server stores contract information in a database (e.g., MySQL) and generates contract documents. These documents include user information and contract details.

[1266] The server sends a download link for the generated contract documents to the user.

[1267] The device displays a final confirmation screen to the user, prompting them to approve the contract.

[1268] The user clicks the approve button on the final confirmation screen.

[1269] The device provides a download link for the contract documents, allowing the user to download them. The contract is then formally concluded.

[1270] Specific example

[1271] For example, if a user wants to sign up for a new smartphone contract, they input their desired budget of 3000 yen / month, 5GB of data capacity, and the latest camera performance into the device and send the information. The generative artificial intelligence then generates several contract plans, which the device presents to the user. After the user selects a plan and makes adjustments such as adding insurance options, the final contract plan is confirmed, and the contract documents are generated and provided to the user.

[1272] This allows users to complete smartphone and landline phone contract procedures simply and quickly. Furthermore, by utilizing generative artificial intelligence, the system can provide contract plans that are best suited to the user's needs, improving the efficiency and convenience of the contract process.

[1273] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1274] Step 1:

[1275] The user accesses a smartphone, tablet, or online web interface to begin the contract process. The device displays a form for the user to enter their budget, desired data capacity, and required features (e.g., camera performance, battery life). This form is provided as HTML or a mobile app UI. Input is done in the form of text fields or dropdown menus.

[1276] Input: User's desired budget, data capacity, and feature requirements

[1277] Output: User-entered information (unprocessed)

[1278] Step 2:

[1279] The user enters information such as budget, data capacity, and required functions through the device's interface and clicks the submit button. At this time, the device converts the information entered by the user into JSON format.

[1280] Input: Information entered by the user

[1281] Data processing: Convert user input information into JSON format.

[1282] Output: User information in JSON format

[1283] Step 3:

[1284] The terminal securely sends the converted JSON data to the server using the HTTPS protocol. The server receives this data and prepares it for analysis.

[1285] Input: User information in JSON format

[1286] Data processing: Secure transmission of data

[1287] Output: User information sent to the server

[1288] Step 4:

[1289] The server analyzes the received data and prepares to send a prompt to a generative artificial intelligence (e.g., ChatGPT). This prompt includes the user's budget, desired data volume, and required functions. The server then formats the data into the appropriate format and sends it to the generative artificial intelligence.

[1290] Input: User information sent to the server

[1291] Data processing: Creating prompts for generative artificial intelligence.

[1292] Output: Prompt to send to the generative artificial intelligence.

[1293] Step 5:

[1294] The server sends a prompt to the generative artificial intelligence. For example, it might use a prompt like this:

[1295] "The user has a budget of 3000 yen / month and wants 5GB of data and the latest camera features. Please propose three optimal smartphone contract plans that meet these conditions."

[1296] Input: Prompt to send to generative AI

[1297] Data processing: Artificial intelligence generates multiple contract plans based on prompts.

[1298] Output: Generated contract plan

[1299] Step 6:

[1300] Generative artificial intelligence generates multiple subscription plans based on prompts. For example, "Plan A: 3000 yen / month, 5GB, latest camera," "Plan B: 2800 yen / month, 4GB, superior camera," "Plan C: 3200 yen / month, 6GB, latest camera," etc. This is then converted to JSON format and sent back to the server.

[1301] Input: Prompt sent to a generative artificial intelligence system

[1302] Data processing: Data analysis and contract plan generation using artificial intelligence.

[1303] Output: Contract plan in JSON format

[1304] Step 7:

[1305] The server sends the contract plan received from the generative artificial intelligence to the terminal. The terminal then displays the received contract plan visually to the user by reflecting it in the web interface or mobile UI.

[1306] Input: Contract plan in JSON format

[1307] Data processing: Convert received data for UI use.

[1308] Output: Visually displayed contract plan

[1309] Step 8:

[1310] The user selects the most suitable plan from those presented. They can also select or adjust additional options (e.g., insurance options) as needed. This adjusted information is then re-entered into the device.

[1311] Input: User selections and adjustments

[1312] Output: Selected and adjusted contract plan

[1313] Step 9:

[1314] The terminal converts the user's selections and adjustments into JSON format and sends them back to the server. The server receives this data and begins the process of finalizing the contract plan.

[1315] Input: User selections and adjustments

[1316] Data processing: Convert the selected content to JSON format and send it to the server.

[1317] Output: Final adjustments sent to the server

[1318] Step 10:

[1319] The server finalizes the contract plan and saves the contract information to a database (e.g., MySQL). Simultaneously, it generates the contract documents and sends a download link for the documents to the user's device.

[1320] Input: Final adjustments sent to the server

[1321] Data processing: Confirmation of contract information and storage in the database.

[1322] Output: Contract documents and download links

[1323] Step 11:

[1324] The device displays a final confirmation screen to the user, prompting them to approve the contract. The contract is officially concluded when the user clicks the approve button on the final confirmation screen.

[1325] Input: Contract documents and download links

[1326] Output: Final confirmation screen

[1327] Step 12:

[1328] The device provides a download link for the contract documents, allowing the user to download them. Simultaneously, the contract becomes formally concluded.

[1329] Input: Final confirmation approval

[1330] Output: Provision of download link and conclusion of contract

[1331] In this way, through this system, users can complete smartphone and landline phone contract procedures simply and quickly, and by utilizing generative artificial intelligence, the system can provide contract plans that are best suited to the user's needs.

[1332] (Application Example 1)

[1333] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1334] Traditional smartphone or landline phone contract procedures required users to visit electronics stores, which was time-consuming and laborious. Online contracts were also cumbersome, requiring users to manually review a large amount of information to choose the optimal plan. Furthermore, with the advancement of virtual reality (VR) technology, there was a growing demand for simplified contract procedures utilizing this technology.

[1335] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1336] In this invention, the server includes means for receiving initial information from a user; analysis means including a generation engine that analyzes the initial information and generates multiple contract plans in response to the user's requests; means for presenting the contract plans generated from the analysis means to the user; means for receiving a contract plan selected or adjusted by the user; means for finalizing the contract based on the selected or adjusted contract plan and generating contract documents; means for providing the contract documents to the user; and means for visually displaying multiple contract plans to the user in a virtual reality environment, allowing the user to select or adjust a plan. This enables the user to easily and quickly perform complex contract procedures using the virtual reality environment.

[1337] A "user terminal" is a device that provides an interface for user operation.

[1338] A "server" is a central processing unit that receives data sent from users, analyzes it, and generates multiple contract plans using generative artificial intelligence.

[1339] "Initial information" refers to information necessary for a user to complete the contract process, such as budget, data capacity, and required functions.

[1340] "Analysis means" refers to a method for analyzing initial information from the user and generating multiple contract plans based on that analysis.

[1341] A "generation engine" is an engine that uses generative artificial intelligence to generate multiple contract plans in response to user requests.

[1342] A "virtual reality environment" is a virtual space or environment that a user interacts with using virtual reality technology.

[1343] A "contract plan" is a selection of contract options proposed based on the user's requests and initial information.

[1344] "Contract documents" are official documents generated based on the contract plan selected or adjusted by the user.

[1345] A "user interface" refers to the screens and components provided for users to input initial information, and to review, select, and adjust their contract plans.

[1346] This invention provides a system that allows users to easily and quickly complete smartphone or landline phone contract procedures at home using a virtual reality environment. The system includes a user terminal, a server, and a user interface for operations within the virtual reality environment.

[1347] System Overview

[1348] The system receives and analyzes initial information from the user and generates multiple contract plans using generative artificial intelligence. These generated contract plans are presented to the user in a virtual reality environment, allowing the user to visually review, select, and adjust them. Once the final contract plan is confirmed, the contract documents are automatically generated and provided to the user.

[1349] Hardware and software to be used

[1350] Hardware:

[1351] Smartphone or tablet

[1352] Virtual reality goggles

[1353] Servers (for example, Amazon Web Services as a cloud environment)

[1354] Database (for example, MySQL)

[1355] software:

[1356] Virtual store application (based on the Unity engine)

[1357] Generative artificial intelligence models (e.g., OpenAI GPT-4)

[1358] Frontend libraries (e.g., React Native)

[1359] Backend framework (e.g., Node.js)

[1360] Program processing

[1361] 1. The user accesses a terminal within the virtual reality environment and begins the contract process. The user terminal displays an initial information input form, where the user enters their desired budget, data capacity, required functions, etc.

[1362] 2. The terminal converts the input data into JSON format and sends it to the server. The server then uses a generative artificial intelligence model (GPT-4) to perform data analysis and generate a contract plan.

[1363] 3. The generated contract plan is temporarily stored in the database and sent from the server to the terminal. The terminal visually projects the contract plan onto a holographic display in the virtual reality environment.

[1364] 4. The user reviews, selects, or adjusts the plan. The user's actions are sent back to the server, and the final contract plan is confirmed.

[1365] 5. The server generates contract documents based on the confirmed contract plan and provides a download link to the user's terminal. The contract is concluded when the user confirms and downloads the documents.

[1366] Specific example

[1367] As a specific scenario, the procedure for a new smartphone contract is shown below.

[1368] 1. The user puts on virtual reality goggles and launches the virtual store application.

[1369] 2. The device displays the "New Smartphone Contract" option within the virtual environment.

[1370] 3. The user controls an avatar and enters their budget, desired data capacity, and required functions.

[1371] 4. The terminal converts the input content into JSON format and sends it to the server.

[1372] 5. The server analyzes the received data and generates multiple subscription plans using a generative artificial intelligence model (GPT-4). For example, "Budget of 3000 yen / month, 5GB data capacity, latest camera features."

[1373] 6. The server sends the generated plan to the terminal and projects it onto a holographic display in the virtual reality environment.

[1374] 7. The user visually reviews the presented contract plan and selects "I want to add insurance options."

[1375] 8. The device sends the adjustment details back to the server.

[1376] 9. The server finalizes the plan, generates the contract documents, and sends them to the terminal.

[1377] 10. The device displays a final confirmation screen, and the user approves the contract.

[1378] 11. The server records the conclusion of the contract and provides a download link for the contract documents.

[1379] 12. The user downloads the contract documents, and the contract is officially concluded.

[1380] Example of a prompt

[1381] The following are examples of prompts to input into the generated AI model:

[1382] Please propose the optimal contract plan based on the user's budget, data capacity, and required features. Please use the following information:

[1383] Budget: 3000 yen / month

[1384] Data capacity: 5GB

[1385] Required features: Latest camera features

[1386] Please provide multiple contract plans.

[1387] In this way, the present invention enables users to easily and quickly complete contract procedures using a virtual reality environment.

[1388] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1389] Step 1:

[1390] The user puts on virtual reality goggles and launches a virtual store application. The device displays the "New Smartphone Contract" option within the virtual environment. The user controls an avatar and enters information such as budget, desired data capacity, and required features. The device converts the entered data into JSON format and sends it to the server.

[1391] Step 2:

[1392] The server analyzes the initial user information it receives. This analysis uses a generative AI model (e.g., GPT-4). The server generates multiple contract plans based on the user's input data. This prompt is then input into the generative AI model, the analysis results are obtained, and a contract plan is generated.

[1393] Step 3:

[1394] The server temporarily stores the generated contract plan in a database and sends it to the terminal. The terminal visually projects the contract plan onto a holographic display in the virtual reality environment. The user reviews the multiple plans presented.

[1395] Step 4:

[1396] The user selects or adjusts their desired subscription plan within the virtual reality environment. The device then converts this selected or adjusted information back into JSON format and sends it to the server.

[1397] Step 5:

[1398] The server receives the adjustments submitted by the user and finalizes the contract plan. Based on the final plan, the server generates the contract documents and sends a download link to the user's device.

[1399] Step 6:

[1400] The terminal displays a final confirmation screen within the virtual reality environment, and the user approves the contract. The server records the conclusion of the contract and provides the user with a download link for the contract documents. The user downloads the contract documents, and the contract is officially concluded.

[1401] The above describes the processing flow of the system program that implements the application example.

[1402] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1403] This invention provides a system for users to smoothly complete smartphone or landline phone contract procedures using terminals installed in stores not yet stocked in mass retailers or through an online environment. In particular, this invention incorporates an emotion engine that recognizes the user's emotions and adjusts the contract plan accordingly. This system receives and analyzes the user's initial information, automatically generates and presents multiple contract plans using generative artificial intelligence, and provides the user with the optimal plan, thereby simplifying the contract procedure. Furthermore, it provides a more personalized service by responding to the user's emotions.

[1404] Components

[1405] 1. User terminal: A device that provides an interface for user operation. This terminal may be installed in stores not affiliated with mass retailers, or it may be provided as an online web interface or mobile application.

[1406] 2. Server: This is the central processing unit that receives and analyzes data sent from users and generates multiple contract plans using generative artificial intelligence.

[1407] 3. Emotion Engine: This engine includes technology to recognize the user's emotions by analyzing the user's voice, facial expressions, input speed, etc.

[1408] Program Processing Description

[1409] Acceptance of initial information

[1410] The device provides an interface that allows the user to input their budget, desired data capacity, and required features (e.g., camera performance, battery life, etc.).

[1411] The user enters the necessary information using the terminal's interface.

[1412] The terminal converts the initial information entered into the appropriate data format (e.g., JSON) and sends it to the server.

[1413] Emotional analysis

[1414] The device captures the user's voice tone, facial expressions, and input speed in real time and sends this information to the server.

[1415] The server utilizes an emotion engine to analyze the transmitted data and recognize the user's emotional state. Recognized emotions include, for example, joy, excitement, confusion, and anger.

[1416] Information analysis and contract plan generation

[1417] The server receives initial information and emotional state sent by the user and analyzes both using generative artificial intelligence.

[1418] The server generates multiple optimal contract plans based on the analysis results. For example, if the user is confused, it will suggest a simpler and easier-to-understand plan.

[1419] The server sends the generated contract plan to the terminal.

[1420] Proposal and adjustment of contract plans

[1421] The device displays the received contract plan to the user in a visually easy-to-understand format. The user can then select the plan that best suits them from the multiple plans offered.

[1422] The user selects one of the displayed plans or adjusts options (e.g., adding insurance).

[1423] The device then resends the user's selections and adjustments to the server.

[1424] Final contract confirmation and document generation

[1425] The server analyzes the adjustment details sent by the user and determines the final contract plan.

[1426] The server generates contract documents based on the confirmed contract plan and sends a download link for the contract documents to the user's device.

[1427] The device displays a final confirmation screen to the user, prompting them to approve the contract.

[1428] The user grants approval.

[1429] The device provides a download link for the contract documents, and the contract is officially concluded.

[1430] Specific example

[1431] As a concrete example, here is a scenario for a new smartphone contract:

[1432] 1. The user accesses the store's tablet terminal and selects "New smartphone contract".

[1433] 2. The device displays a form that prompts the user to enter their budget, desired data capacity, and required features (e.g., latest camera features).

[1434] 3. The user enters the information and presses the submit button.

[1435] 4. The terminal converts the input content into JSON format and sends it to the server.

[1436] 5. The terminal captures the user's voice tone, facial expressions, and input speed in real time and sends this information to the server.

[1437] 6. The server analyzes received data and sentiment data, and uses generative artificial intelligence to generate multiple contract plans. For example, "Budget of 3000 yen / month, 5GB data capacity, latest camera features." If the user is confused, it will suggest a simpler and easier-to-understand plan.

[1438] 7. The server sends the generated plan to the terminal.

[1439] 8. The device displays the suggested plan to the user.

[1440] 9. The user selects "I want to add an insurance option" and makes adjustments to the device.

[1441] 10. The device sends the adjustment data to the server.

[1442] 11. The server finalizes the plan, generates the contract documents, and sends them to the terminal.

[1443] 12. The device displays a final confirmation screen, and the user approves the contract.

[1444] 13. The server records the conclusion of the contract and sends a download link for the contract documents to the terminal.

[1445] 14. The device displays to the user that the contract has been concluded and a download link is available.

[1446] Thus, this system allows users to complete smartphone and landline phone contracts easily and quickly. Furthermore, by using an emotion engine, personalized responses tailored to the user's emotions become possible, greatly improving convenience and satisfaction.

[1447] The following describes the processing flow.

[1448] Step 1:

[1449] The device boots up and displays a welcome screen. The user is presented with the option of either a "smartphone contract" or a "landline phone contract."

[1450] Step 2:

[1451] When the user selects "Smartphone Contract," a form appears on the device for them to enter the necessary initial information (budget, data capacity, required features).

[1452] Step 3:

[1453] The user enters their budget, data capacity, and required features into the form and presses the submit button.

[1454] Step 4:

[1455] The device captures the user's voice tone, facial expressions, and typing speed. This information is then analyzed by an emotion engine.

[1456] Step 5:

[1457] The device converts the user's initial information and sentiment data into JSON format and sends it to the server over the network.

[1458] Step 6:

[1459] The server parses the JSON data received from the terminal. Based on budget, data volume, and functional requirements, it identifies the user's requirements.

[1460] Step 7:

[1461] The server's emotion engine analyzes the user's voice tone, facial expressions, and typing speed to recognize the user's emotional state.

[1462] Step 8:

[1463] The server's generative artificial intelligence generates the optimal contract plan for the user based on the initial information and emotion data received. For example, if the user is confused, it prioritizes a simpler and easier-to-understand plan.

[1464] Step 9:

[1465] The server encodes the multiple contract plans it generates into JSON format and sends them to the terminal.

[1466] Step 10:

[1467] The device decodes the received JSON data and displays the plan to the user in a visually easy-to-understand format.

[1468] Step 11:

[1469] The user selects one of several contract plans displayed. They can also adjust options as needed (e.g., add insurance).

[1470] Step 12:

[1471] The device converts the user's selections and adjustments back into JSON format and sends them to the server.

[1472] Step 13:

[1473] The server analyzes the adjustment data received from the terminal and determines the final contract plan.

[1474] Step 14:

[1475] Based on the confirmed contract plan, the server generates the contract documents and sends a download link for the contract documents to the user.

[1476] Step 15:

[1477] The device displays a final confirmation screen to the user, prompting them to approve the contract.

[1478] Step 16:

[1479] The user performs a final review and clicks the "Approve" button.

[1480] Step 17:

[1481] The device sends the authorization information to the server.

[1482] Step 18:

[1483] The server confirms the contract is finalized and records the contract information.

[1484] Step 19:

[1485] The server sends a download link for the contract documents to the user's device.

[1486] Step 20:

[1487] The device will display a notification that the contract has been concluded, along with a link to download the contract documents to the user.

[1488] This process allows users to complete smartphone and landline phone contract procedures simply and quickly using this system. Furthermore, by utilizing the emotion engine, personalized responses that respond to the user's emotions become possible, increasing user satisfaction.

[1489] (Example 2)

[1490] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1491] Traditional contract procedures often result in a poor user experience because they don't consider the user's emotions or psychological state when users input necessary information and choose the best plan from the provided options. In particular, users may feel confused or dissatisfied when selecting the optimal plan from a complex selection. Furthermore, the inability to provide flexible plans tailored to the user's emotional state is a significant challenge.

[1492] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[1493] In this invention, the server includes means for receiving initial information from the user, analysis means including a generation engine that analyzes the initial information and generates multiple contract plans based on the user's requests and emotional state, and emotion recognition means that analyzes the user's voice tone, facial expressions, and input speed to recognize the emotional state. This makes it possible to provide personalized contract plans that are tailored to the user's psychological state.

[1494] A "user" refers to an individual who operates the system and selects or adjusts their contract plan.

[1495] "Initial information" refers to the basic information that users input into the system, such as budget, data capacity, and functional requirements.

[1496] A "generation engine" refers to a program and algorithm that analyzes a user's initial information and emotional state, and automatically generates multiple contract plans based on that analysis.

[1497] "Analysis means" refers to a series of processes for processing initial information obtained from the user and generating a contract plan using a generation engine.

[1498] "Emotion recognition means" refers to technologies and devices that analyze the user's voice tone, facial expressions, and input speed to recognize the user's emotional state.

[1499] "Contract documents" refer to formal documents that contain the final terms of the agreement and require confirmation and approval by the user.

[1500] "Adjustment" refers to the act of adding or changing the contract plan selected by the user.

[1501] "Provision" refers to the act of the system displaying or making available to the user, via a download link, a contract plan or contract documents that it has generated.

[1502] This invention provides a system for users to smoothly complete smartphone or landline phone contract procedures using terminals installed in stores not yet stocked in mass retailers or through an online environment. In particular, this invention incorporates an emotion engine that recognizes the user's emotions and adjusts the contract plan accordingly. This system receives and analyzes the user's initial information, automatically generates and presents multiple contract plans using generative artificial intelligence, and provides the user with the optimal plan, thereby simplifying the contract procedure. Furthermore, it provides a more personalized service by responding to the user's emotions.

[1503] Components

[1504] 1. User terminal: A device that provides an interface for user operation. This terminal may be installed in stores not affiliated with mass retailers, or it may be provided as an online web interface or mobile application. For example, tablet devices and smartphones are used.

[1505] 2. Server: This is the central processing unit that receives and analyzes data sent from users and generates multiple contract plans using generative artificial intelligence. For example, a cloud server is used.

[1506] 3. Emotion Engine: This engine includes technologies for recognizing the user's emotions by analyzing their voice, facial expressions, input speed, etc. For example, voice tone analysis software and facial recognition software may be used.

[1507] Process Overview

[1508] The device provides an interface that allows the user to input their budget, desired data capacity, and required features (e.g., camera performance, battery life). Once the user inputs the necessary information using the device's interface, the device converts it into an appropriate data format (e.g., JSON) and sends it to the server. Furthermore, the device captures the user's voice tone, facial expressions, and input speed in real time and sends this information to the server.

[1509] The server utilizes an emotion engine to analyze the transmitted data and recognize the user's emotional state. Recognized emotions include, for example, joy, excitement, confusion, and anger. Next, the server receives the initial information and emotional state transmitted by the user and analyzes both using generative artificial intelligence. Based on this analysis, the server generates several optimal contract plans and sends them to the terminal.

[1510] The terminal displays the received contract plan to the user in a visually easy-to-understand format. The user can select the plan that best suits them from the multiple plans offered. Once the user selects one of the displayed plans or adjusts options (e.g., adding insurance), the selection and adjustments are sent back from the terminal to the server. The server analyzes the adjustments sent by the user and finalizes the contract plan. Based on the finalized contract plan, the server generates the contract documents and sends a download link for the contract documents to the terminal. The terminal displays a final confirmation screen to the user, prompting them to approve the contract. Once the user approves, the terminal provides the download link for the contract documents, and the contract is officially concluded.

[1511] Specific example

[1512] For example, a possible prompt for a new smartphone contract scenario might look like this:

[1513] "I'd like to sign up for a new smartphone contract. My monthly budget is under 3000 yen, I need at least 5GB of data, and camera performance is a priority."

[1514] Thus, this system allows users to complete smartphone and landline phone contracts easily and quickly. Furthermore, by using an emotion engine, personalized responses tailored to the user's emotions become possible, greatly improving convenience and satisfaction.

[1515] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1516] Step 1:

[1517] The device provides an interface that allows the user to input their budget, desired data capacity, and required features (e.g., camera performance, battery life, etc.).

[1518] Input: User budget, desired data capacity, required features

[1519] Action: The terminal displays a form, and the user completes the input.

[1520] Output: Information entered by the user

[1521] Step 2:

[1522] The user enters the necessary information using the terminal's interface and presses the submit button.

[1523] Input: Budget entered by the user, desired data capacity, required functions

[1524] Operation: The user enters information into each field of the form and presses the submit button.

[1525] Output: Initial information from form input

[1526] Step 3:

[1527] The terminal converts the initial information entered into the appropriate data format (e.g., JSON) and sends it to the server.

[1528] Input: Initial information entered via form

[1529] Operation: The terminal converts the input data into a JSON object and sends it to the server as an HTTP request.

[1530] Output: Initial information data in JSON format

[1531] Step 4:

[1532] The device captures the user's voice tone, facial expressions, and input speed in real time and sends this information to the server.

[1533] Input: User's voice tone, facial expression, input speed

[1534] Operation: The device uses its camera and microphone to capture data and send it to the server.

[1535] Output: Voice tone data, facial expression data, input speed data

[1536] Step 5:

[1537] The server utilizes an emotion engine to analyze the transmitted data and recognize the user's emotional state.

[1538] Input: Voice tone data, facial expression data, input speed data

[1539] Operation: The server uses emotion recognition software to analyze data and classify the user's emotional state.

[1540] Output: User's emotional state (e.g., joy, excitement, confusion, anger)

[1541] Step 6:

[1542] The server receives initial information and emotional state sent by the user and analyzes both using generative artificial intelligence.

[1543] Input: Initial information data in JSON format, user's emotional state

[1544] Operation: The server uses generative artificial intelligence to analyze the input data.

[1545] Output: Analysis results (data based on user requests and emotional state)

[1546] Step 7:

[1547] The server generates multiple optimal contract plans based on the analysis results and sends them to the terminal.

[1548] Input: Analysis results

[1549] Operation: The server generates multiple contract plans and sends them to the terminal in JSON format.

[1550] Output: Contract plan data in JSON format

[1551] Step 8:

[1552] The device displays the received contract plan to the user in a visually easy-to-understand format.

[1553] Input: Contract plan data in JSON format

[1554] Operation: The terminal appropriately lays out and displays the proposed contract plan to the user.

[1555] Output: Displayed contract plan

[1556] Step 9:

[1557] The user selects one of the displayed plans or adjusts options (e.g., adding insurance).

[1558] Input: Displayed contract plan

[1559] Operation: Users select a plan and add options.

[1560] Output: Selected or adjusted contract plan

[1561] Step 10:

[1562] The device then resends the user's selections and adjustments to the server.

[1563] Input: Selected or adjusted contract plan

[1564] Operation: The terminal converts the selected data into JSON format and sends it to the server.

[1565] Output: Selected or adjusted contract plan data in JSON format

[1566] Step 11:

[1567] The server analyzes the adjustment details sent by the user and determines the final contract plan.

[1568] Input: Selected or adjusted contract plan data in JSON format

[1569] Operation: The server calculates and confirms the final contract details based on the selected options.

[1570] Output: Confirmed contract plan data

[1571] Step 12:

[1572] The server generates contract documents based on the confirmed contract plan and sends a download link for the contract documents to the user's device.

[1573] Input: Confirmed contract plan data

[1574] Operation: The server generates the contract documents in PDF format and sends a download link to the device.

[1575] Output: Download link for contract documents

[1576] Step 13:

[1577] The device displays a final confirmation screen to the user, prompting them to approve the contract.

[1578] Input: Download link for contract documents

[1579] Action: The device displays the contract details and presents an approval button.

[1580] Output: Final confirmation screen and approval button

[1581] Step 14:

[1582] The user grants approval.

[1583] Input: Final confirmation screen and approval button

[1584] Action: The user clicks the approve button.

[1585] Output: Approved contract details

[1586] Step 15:

[1587] The device provides a download link for the contract documents, and the contract is officially concluded.

[1588] Input: Approved contract details

[1589] Operation: The device displays a download link, and the user downloads the contract documents.

[1590] Output: Download link and downloaded contract documents

[1591] (Application Example 2)

[1592] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1593] In today's world, the contract procedures for smartphones and landlines have become cumbersome and stressful for users. In particular, first-time users and those with limited technical knowledge find it difficult to select the appropriate plan, resulting in the problem of not being able to choose the optimal contract plan. Furthermore, traditional online contract systems fail to consider the user's emotional state, leading to confusion and anxiety. There is a need to solve these problems and provide a system that allows users to complete contract procedures more easily and with greater peace of mind.

[1594] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving initial information from the user; analysis means including a generation engine that analyzes the initial information and generates multiple contract plans in response to the user's requests; means for adjusting the contract plan according to the user's emotions using an emotion recognition engine that recognizes the user's emotions from voice, facial expressions, input speed, etc.; means for displaying the multiple contract plans generated based on the user's emotions on the interface of the virtual store and providing them to the user in a visually easy-to-understand manner; means for presenting the contract plan generated from the analysis means to the user; means for receiving the contract plan selected or adjusted by the user; means for finalizing the contract based on the selected or adjusted contract plan and generating contract documents; and means for providing the contract documents to the user. As a result, the user can easily and quickly select the optimal contract plan according to their emotional state. Furthermore, by using the virtual store, convenience and satisfaction are improved, and contract procedures can be carried out with peace of mind.

[1595] A "user terminal" is a device that provides an interface for user operation and enables access to virtual stores.

[1596] The "analysis means" refers to a system that includes an engine for analyzing the user's initial information and generating multiple contract plans based on the user's requests.

[1597] A "generation engine" is an engine that includes artificial intelligence to generate multiple contract plans based on the user's initial information.

[1598] An "emotion recognition engine" is an engine that includes technology to recognize the user's emotions by analyzing the user's voice, facial expressions, input speed, etc.

[1599] "Means of adjusting contract plans according to user emotions" refers to means of appropriately adjusting contract plans based on the user's emotions recognized by an emotion recognition engine.

[1600] A "virtual store" is a virtual store environment that users can access using VR or smart glasses, where they can select products and complete contract procedures.

[1601] An "interface" refers to the means by which a user interacts with a system, such as inputting, selecting, and displaying information.

[1602] "Means for generating contract documents" refers to the means of creating final contract documents based on the contract plan selected or adjusted by the user.

[1603] "Voice tone" refers to the characteristics of the user's voice, such as pitch, intonation, and volume, and is data used to analyze emotions in speech recognition.

[1604] "Facial expressions" refer to changes in a user's facial expressions and subtle movements, and are data used to analyze emotions using facial recognition technology.

[1605] "Input speed" refers to the speed and rhythm at which a user inputs information, and is an indicator used to infer the user's emotional state based on this.

[1606] "Visually easy to understand" refers to providing information to users in a format that is easy to grasp intuitively, and includes elements such as graphs, icons, and animations.

[1607] Modes for carrying out the invention

[1608] This invention is a system designed to analyze a user's emotions in real time and provide optimal responses when they ask questions or make purchases in a virtual store. This system allows users to easily and quickly complete smartphone or landline phone contract procedures. Furthermore, by providing personalized responses tailored to the user's emotional state, it can increase user satisfaction.

[1609] Hardware and software

[1610] This system uses the following hardware and software.

[1611] hardware

[1612] 1. VR goggles or smart glasses: These are devices used by users to access virtual stores.

[1613] 2. Microphone: A device used to record speech for speech recognition.

[1614] 3. Camera: A device that collects facial data for facial expression analysis.

[1615] software

[1616] 1. Application Server (Python-based): Operates as the central processing unit for the entire system.

[1617] 2. Emotion Engine Module: Analyzes the user's voice tone, facial expressions, and input speed to recognize their emotional state.

[1618] 3. Generative Artificial Intelligence Planner (AIPlanner): Generates multiple contract plans based on the user's initial information and emotional state.

[1619] 4. Virtual Shop Interface Module (VirtualShopTerminal): Collects information from the user and visually displays the contract plan.

[1620] Program processing

[1621] The server first collects initial information (budget, data capacity, functional requirements) from the user via the user's terminal. This initial information is sent to the server in JSON format. At the same time, emotional data such as the user's voice tone, facial expressions, and typing speed is also collected and sent to the server.

[1622] The server uses an emotion engine module to analyze the user's emotional state. For example, if the user is agitated, it adjusts the contract plan based on that emotional state, suggesting a state-of-the-art model.

[1623] Next, a generative artificial intelligence planner generates multiple contract plans based on the user's initial information and emotional state. The generated plans are then visually presented to the user through the virtual store interface.

[1624] The user makes selections and adjustments from the presented plans, and the results are sent back to the server. The server then finalizes the contract plan based on the user's selections and adjustments, and generates the contract documents.

[1625] Ultimately, the contract documents are presented to the user via the virtual store interface, and the contract is finalized upon user approval. A download link for the contract documents is provided, allowing the user to download and save them.

[1626] Specific example

[1627] For example, if a user accesses a virtual store and wants to sign up for a new smartphone contract, they would follow these steps:

[1628] 1. The user puts on VR goggles and logs into the virtual shop.

[1629] 2. A virtual assistant appears and asks questions about your budget, desired data capacity, and feature requirements.

[1630] 3. The user enters this information and provides answers via voice.

[1631] 4. The server analyzes the user's tone of voice and facial expressions to detect if the user is excited.

[1632] 5. A generative artificial intelligence planner generates the optimal contract plan for the user based on emotional data.

[1633] 6. Multiple generated contract plans are presented to the user through the virtual store interface.

[1634] 7. The user selects the most suitable plan and makes adjustments as needed.

[1635] 8. The final contract plan is confirmed on the server, and the contract documents are generated.

[1636] 9. The contract is concluded when the user reviews and approves the contract documents.

[1637] 10. A download link for the contract documents is provided, and the user saves it.

[1638] Example of a prompt

[1639] Examples of prompts to input into a generative AI model:

[1640] "Based on the user's voice tone and facial expression data, recognize their emotional state. If the user is excited, generate a plan recommending the latest model and create a confirmation message in simple language. Also, consider their budget and desired specifications."

[1641] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1642] Step 1:

[1643] The user wears VR goggles or smart glasses and logs into a virtual store. The terminal displays an interface prompting the user to enter their budget, desired data capacity, and required features (e.g., latest camera, battery life, etc.). The user enters this information via voice or text. The entered information is converted to JSON format and sent to the server.

[1644] Input: User budget, data capacity, and feature requirements

[1645] Output: Initial information (JSON format)

[1646] Specific operation: The terminal receives voice and text input from the user, converts it into the appropriate data format, and prepares it for transmission.

[1647] Step 2:

[1648] The device simultaneously collects data on the user's facial expressions, voice tone, and input speed. This emotional data is transmitted to the server in real time.

[1649] Input: User's voice tone, facial expression, and input speed

[1650] Output: Sentiment data

[1651] Specific operation: The device analyzes the user's camera video and microphone audio and sends it to the server as emotion data.

[1652] Step 3:

[1653] The server analyzes the initial information it receives. The analysis includes a generation engine that generates multiple contract plans based on the user's requests.

[1654] Input: Initial information (JSON format)

[1655] Output: Multiple contract plans

[1656] Specific operation: The server analyzes initial information and uses generative artificial intelligence to generate a contract plan suitable for the user.

[1657] Step 4:

[1658] The server uses an emotion recognition engine to analyze the user's emotional state. Based on the user's voice tone, facial expressions, and input speed, it recognizes the user's emotional state and reflects the results in the contract plan.

[1659] Input: Sentiment data

[1660] Output: Adjusted contract plan

[1661] Specific operation: The server analyzes emotional data using an emotion recognition engine and generates a plan that corresponds to the user's emotions.

[1662] Step 5:

[1663] The server presents the generated contract plan to the user through the virtual store interface. It is designed to be displayed in a visually easy-to-understand format for the user.

[1664] Input: Adjusted contract plan

[1665] Output: Visual presentation on the user interface

[1666] Specific operation: The server sends the generated plan to the terminal, and the terminal displays it in the user interface.

[1667] Step 6:

[1668] The user selects the most suitable plan from several options presented and makes further adjustments as needed. The selection and adjustments are sent to the server via the device.

[1669] Input: User selections and adjustments

[1670] Output: Adjusted contract plan

[1671] Specific operation: The terminal receives the user's selections and adjustments, and then sends them back to the server.

[1672] Step 7:

[1673] The server analyzes the selections and adjustments submitted by the user to determine the final contract plan. Based on this finalized plan, it then generates the contract documents.

[1674] Input: Adjusted contract plan

[1675] Output: Final contract plan and contract documents

[1676] Specific actions: The server analyzes the adjustments and finalizes the contract plan. It then generates the contract documents.

[1677] Step 8:

[1678] The server sends the generated contract documents to the terminal, which then displays them to the user. A screen prompting the user for confirmation and approval is then displayed.

[1679] Input: Contract documents

[1680] Output: Presentation of contract documents to the user

[1681] Specific actions: The device receives the contract documents and displays them to the user. A message requesting confirmation and approval is displayed.

[1682] Step 9:

[1683] The user reviews and approves the contract documents. The contract is officially concluded when the approval is sent to the server.

[1684] Input: User approval

[1685] Output: Contract concluded

[1686] Specific operation: The user reviews the contract documents and enters their approval. This information is then sent to the server.

[1687] Step 10:

[1688] After the contract is finalized, the server generates a download link for the contract documents and provides it to the user via their device. The user can then download and save the contract documents.

[1689] Input: Record of contract formation

[1690] Output: Download link

[1691] Specific operation: The server records the conclusion of the contract and generates a link to download the contract documents. This link is then provided to the user via the terminal.

[1692] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1693] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1694] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[1695] [Fourth Embodiment]

[1696] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[1697] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1698] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1699] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[1700] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1701] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1702] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1703] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[1704] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1705] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1706] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1707] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1708] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1709] This invention provides a system for users to smoothly complete smartphone or landline phone contract procedures using terminals installed in stores not yet operated by mass retailers or through an online environment. This system receives and analyzes the user's initial information, automatically generates and presents multiple contract plans using generative artificial intelligence, and provides the user with the most suitable plan, thereby simplifying the contract procedure.

[1710] Components

[1711] 1. User terminal: A device that provides an interface for user operation. This terminal may be installed in stores not affiliated with mass retailers, or it may be provided as an online web interface or mobile application.

[1712] 2. Server: This is the central processing unit that receives and analyzes data sent from users and generates multiple contract plans using generative artificial intelligence.

[1713] Program Processing Description

[1714] Acceptance of initial information

[1715] The device provides an interface that allows the user to input their budget, desired data capacity, and required features (e.g., camera performance, battery life, etc.).

[1716] The user enters the necessary information using the terminal's interface.

[1717] The terminal converts the initial information entered into the appropriate data format (e.g., JSON) and sends it to the server.

[1718] Information analysis and contract plan generation

[1719] The server receives data sent from the user and analyzes that information using generative artificial intelligence.

[1720] The server generates multiple optimal contract plans based on the analysis results. For example, pricing plans based on budget and communication plans based on data capacity are automatically generated.

[1721] The server sends the generated contract plan to the terminal.

[1722] Proposal and adjustment of contract plans

[1723] The device visually displays the contract plans it has received to the user. The user can then select the plan that best suits them from the multiple plans offered.

[1724] The user selects one of the displayed plans or adjusts options (e.g., adding insurance).

[1725] The device then resends the user's selections and adjustments to the server.

[1726] Final contract confirmation and document generation

[1727] The server receives the adjustment details sent by the user and finalizes the contract plan.

[1728] The server generates contract documents based on the contract plan and sends a download link to the device.

[1729] The device displays a final confirmation screen to the user, prompting them to approve the contract.

[1730] The user grants approval.

[1731] The device provides a download link for the contract documents, and the contract is officially concluded.

[1732] Specific example

[1733] As a concrete example, here is a scenario for a new smartphone contract:

[1734] 1. The user accesses the store's tablet terminal and selects "New smartphone contract".

[1735] 2. The device displays a form that prompts the user to enter their budget, desired data capacity, and required features (e.g., latest camera features).

[1736] 3. The user enters the information and presses the submit button.

[1737] 4. The terminal converts the input content into JSON format and sends it to the server.

[1738] 5. The server analyzes the received data and uses generative artificial intelligence to generate multiple contract plans. For example, "Budget of 3000 yen / month, 5GB data capacity, latest camera features."

[1739] 6. The server sends the generated plan to the terminal.

[1740] 7. The device displays the suggested plan to the user.

[1741] 8. The user selects "I want to add an insurance option" and makes adjustments to the device.

[1742] 9. The device sends the adjustment data to the server.

[1743] 10. The server finalizes the plan, generates the contract documents, and sends them to the terminal.

[1744] 11. The device displays a final confirmation screen, and the user approves the contract.

[1745] 12. The server records the conclusion of the contract and sends a download link for the contract documents to the terminal.

[1746] 13. The device displays to the user that the contract has been concluded and a download link is available.

[1747] Thus, this system allows users to complete smartphone and landline phone contracts easily and quickly. Furthermore, by using generative artificial intelligence, it is possible to provide plans that are optimally suited to the user's needs, greatly improving the efficiency and convenience of the contract process.

[1748] The following describes the processing flow.

[1749] Step 1:

[1750] The device boots up and displays a welcome screen. The user is presented with the option of either a "smartphone contract" or a "landline phone contract."

[1751] Step 2:

[1752] When the user selects "Smartphone Contract," a form appears on the device for them to enter the necessary initial information (budget, data capacity, required features).

[1753] Step 3:

[1754] The user enters their budget, data capacity, and required features into the form and presses the submit button.

[1755] Step 4:

[1756] The terminal converts the initial information entered into it into JSON format and sends it to the server via the network.

[1757] Step 5:

[1758] The server parses the JSON data received from the terminal to identify the user's request.

[1759] Step 6:

[1760] The server uses generative artificial intelligence to analyze the received information and generate multiple contract plans tailored to the user's needs.

[1761] Step 7:

[1762] The server encodes the multiple contract plans it generates into JSON format and sends them to the terminal.

[1763] Step 8:

[1764] The device decodes the received JSON data and displays the plan to the user in a visually easy-to-understand format.

[1765] Step 9:

[1766] The user selects one of several contract plans displayed. They can also adjust options (e.g., add insurance) as needed.

[1767] Step 10:

[1768] The device converts the user's selections or adjustments back into JSON format and sends them to the server.

[1769] Step 11:

[1770] The server analyzes the adjustment data received from the terminal and determines the final contract plan.

[1771] Step 12:

[1772] The server generates contract documents based on the confirmed contract plan and sends a download link for the contract documents to the terminal in JSON format.

[1773] Step 13:

[1774] The device displays a final confirmation screen to the user, prompting them to approve the contract.

[1775] Step 14:

[1776] The user performs a final review and clicks the "Approve" button.

[1777] Step 15:

[1778] The device sends the authorization information to the server.

[1779] Step 16:

[1780] The server confirms the contract is finalized and records the contract information.

[1781] Step 17:

[1782] The server sends a download link for the contract documents to the user's device.

[1783] Step 18:

[1784] The device will display a notification that the contract has been concluded, along with a link to download the contract documents to the user.

[1785] The above outlines the detailed processing steps of the program. This process allows users to easily and smoothly sign up for smartphone or landline phone contracts.

[1786] (Example 1)

[1787] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1788] Traditional smartphone and landline phone contract procedures were cumbersome, making it difficult for users to find a contract plan that best suited their needs. In particular, manually searching for a contract plan that met diverse requirements such as budget, data capacity, and functional requirements was extremely time-consuming and laborious. Furthermore, the contract procedures were often divided into multiple steps, making them confusing for users. Therefore, there is a need to improve the efficiency and convenience of the contract process.

[1789] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1790] In this invention, the server includes terminal means for receiving initial information from a user, analysis means including generative artificial intelligence for analyzing the initial information and generating multiple contract plans in response to the user's requests, terminal means for presenting the contract plans generated by the analysis means to the user, terminal means for receiving a contract plan selected or adjusted by the user, server means for finalizing the contract based on the selected or adjusted contract plan and generating contract documents, and terminal means for providing the contract documents to the user. This enables users to complete smartphone and landline phone contracts easily and quickly. Furthermore, by using generative artificial intelligence, it is possible to provide a contract plan that is optimal for the user's requests, greatly improving the efficiency and convenience of the contract procedure.

[1791] 1. "Terminal means" refers to a device that a user operates, inputs or selects information, and communicates with a server.

[1792] 2. "Analysis means" refers to a part of a system that analyzes initial information received from the user and generates multiple contract plans using generative artificial intelligence.

[1793] 3. The "generation engine" refers to the part that includes generative artificial intelligence and has the function of automatically generating contract plans based on user requests.

[1794] 4. The "server" is the central device of a system that receives data sent from the user, analyzes it, generates a contract plan, confirms the contract, and generates contract documents.

[1795] 5. "Generative artificial intelligence" refers to artificial intelligence technology used to analyze a user's initial information and generate multiple contract plans based on that information.

[1796] 6. A "contract plan" is a selection of communication contract options offered based on the user's budget, data capacity, and functional requirements.

[1797] 7. "Initial information" refers to information such as budget, desired data capacity, and functional requirements that the user enters when completing the contract procedures.

[1798] 8. "Adjustment details" refers to the requests for additions or changes made by the user to the presented contract plan.

[1799] 9. "Contract documents" are formal documents that record the final terms of the contract and are provided to the user.

[1800] 10. The "final confirmation screen" is an interface that allows the user to review and finally approve the contract plan they have selected or adjusted.

[1801] This invention is a system that enables users to smoothly complete contract procedures for smartphones and landlines. This system is used via terminals installed in stores not yet operated by mass retailers, or through an online environment. It receives and analyzes the user's initial information, automatically generates and presents multiple contract plans using generative artificial intelligence, and provides the user with the most suitable plan, thereby simplifying the contract procedure.

[1802] Components

[1803] 1. User terminal: A device that provides an interface for user operation. This terminal may be installed in stores not affiliated with mass retailers, or it may be provided as an online web interface or mobile application. Examples include tablet devices, PCs, and smartphones.

[1804] 2. Server: This is the central processing unit that receives and analyzes data sent from users and generates multiple contract plans using generative artificial intelligence. The server requires a high-performance CPU and sufficient memory, and a database (e.g., MySQL) is used for data storage.

[1805] 3. Generative Artificial Intelligence: This is an artificial intelligence model for automatically generating contract plans based on user requests. For example, OpenAI's ChatGPT falls into this category.

[1806] Program processing

[1807] Acceptance of initial information

[1808] The device provides an interface that allows the user to input their budget, desired data capacity, and required features (e.g., camera performance, battery life). This can be done using HTML forms or a mobile app UI.

[1809] The user enters the necessary information through the device's interface. For example, they might enter "3000 yen / month" in the budget field, "5GB" in the data capacity field, and "latest camera performance" in the required features field.

[1810] The terminal converts the entered information into JSON format and securely sends it to the server using the HTTPS protocol.

[1811] Information analysis and contract plan generation

[1812] The server receives JSON data sent by the user.

[1813] The server analyzes the received data and sends prompts to the generative artificial intelligence (AI). This is done using a Python script or similar to send prompts like the following to the generative AI (e.g., OpenAI's ChatGPT):

[1814] "The user has a budget of 3000 yen / month and wants 5GB of data and the latest camera features. Please propose three optimal smartphone contract plans that meet these conditions."

[1815] Generative artificial intelligence generates multiple subscription plans based on prompts. For example, "Plan A: 3000 yen / month, 5GB, latest camera," "Plan B: 2800 yen / month, 4GB, superior camera," "Plan C: 3200 yen / month, 6GB, latest camera," etc.

[1816] The server converts the generated contract plan into JSON format and sends it to the terminal.

[1817] Proposal and adjustment of contract plans

[1818] The device visually displays the contract plans received by the user. Multiple contract plans are displayed in a list format in the user interface.

[1819] The user selects the most suitable plan from those presented. They can also select or adjust additional options (e.g., insurance options) as needed.

[1820] The device converts the user's selections and adjustments back into JSON format and sends them to the server.

[1821] Final contract confirmation and document generation

[1822] The server receives the adjustment details sent by the user and finalizes the contract plan.

[1823] The server stores contract information in a database (e.g., MySQL) and generates contract documents. These documents include user information and contract details.

[1824] The server sends a download link for the generated contract documents to the user.

[1825] The device displays a final confirmation screen to the user, prompting them to approve the contract.

[1826] The user clicks the approve button on the final confirmation screen.

[1827] The device provides a download link for the contract documents, allowing the user to download them. The contract is then formally concluded.

[1828] Specific example

[1829] For example, if a user wants to sign up for a new smartphone contract, they input their desired budget of 3000 yen / month, 5GB of data capacity, and the latest camera performance into the device and send the information. The generative artificial intelligence then generates several contract plans, which the device presents to the user. After the user selects a plan and makes adjustments such as adding insurance options, the final contract plan is confirmed, and the contract documents are generated and provided to the user.

[1830] This allows users to complete smartphone and landline phone contract procedures simply and quickly. Furthermore, by utilizing generative artificial intelligence, the system can provide contract plans that are best suited to the user's needs, improving the efficiency and convenience of the contract process.

[1831] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1832] Step 1:

[1833] The user accesses a smartphone, tablet, or online web interface to begin the contract process. The device displays a form for the user to enter their budget, desired data capacity, and required features (e.g., camera performance, battery life). This form is provided as HTML or a mobile app UI. Input is done in the form of text fields or dropdown menus.

[1834] Input: User's desired budget, data capacity, and feature requirements

[1835] Output: User-entered information (unprocessed)

[1836] Step 2:

[1837] The user enters information such as budget, data capacity, and required functions through the device's interface and clicks the submit button. At this time, the device converts the information entered by the user into JSON format.

[1838] Input: Information entered by the user

[1839] Data processing: Convert user input information into JSON format.

[1840] Output: User information in JSON format

[1841] Step 3:

[1842] The terminal securely sends the converted JSON data to the server using the HTTPS protocol. The server receives this data and prepares it for analysis.

[1843] Input: User information in JSON format

[1844] Data processing: Secure transmission of data

[1845] Output: User information sent to the server

[1846] Step 4:

[1847] The server analyzes the received data and prepares to send a prompt to a generative artificial intelligence (e.g., ChatGPT). This prompt includes the user's budget, desired data volume, and required functions. The server then formats the data into the appropriate format and sends it to the generative artificial intelligence.

[1848] Input: User information sent to the server

[1849] Data processing: Creating prompts for generative artificial intelligence.

[1850] Output: Prompt to send to the generative artificial intelligence.

[1851] Step 5:

[1852] The server sends a prompt to the generative artificial intelligence. For example, it might use a prompt like this:

[1853] "The user has a budget of 3000 yen / month and wants 5GB of data and the latest camera features. Please propose three optimal smartphone contract plans that meet these conditions."

[1854] Input: Prompt to send to generative AI

[1855] Data processing: Artificial intelligence generates multiple contract plans based on prompts.

[1856] Output: Generated contract plan

[1857] Step 6:

[1858] Generative artificial intelligence generates multiple subscription plans based on prompts. For example, "Plan A: 3000 yen / month, 5GB, latest camera," "Plan B: 2800 yen / month, 4GB, superior camera," "Plan C: 3200 yen / month, 6GB, latest camera," etc. This is then converted to JSON format and sent back to the server.

[1859] Input: Prompt sent to a generative artificial intelligence system

[1860] Data processing: Data analysis and contract plan generation using artificial intelligence.

[1861] Output: Contract plan in JSON format

[1862] Step 7:

[1863] The server sends the contract plan received from the generative artificial intelligence to the terminal. The terminal then displays the received contract plan visually to the user by reflecting it in the web interface or mobile UI.

[1864] Input: Contract plan in JSON format

[1865] Data processing: Convert received data for UI use.

[1866] Output: Visually displayed contract plan

[1867] Step 8:

[1868] The user selects the most suitable plan from those presented. They can also select or adjust additional options (e.g., insurance options) as needed. This adjusted information is then re-entered into the device.

[1869] Input: User selections and adjustments

[1870] Output: Selected and adjusted contract plan

[1871] Step 9:

[1872] The terminal converts the user's selections and adjustments into JSON format and sends them back to the server. The server receives this data and begins the process of finalizing the contract plan.

[1873] Input: User selections and adjustments

[1874] Data processing: Convert the selected content to JSON format and send it to the server.

[1875] Output: Final adjustments sent to the server

[1876] Step 10:

[1877] The server finalizes the contract plan and saves the contract information to a database (e.g., MySQL). Simultaneously, it generates the contract documents and sends a download link for the documents to the user's device.

[1878] Input: Final adjustments sent to the server

[1879] Data processing: Confirmation of contract information and storage in the database.

[1880] Output: Contract documents and download links

[1881] Step 11:

[1882] The device displays a final confirmation screen to the user, prompting them to approve the contract. The contract is officially concluded when the user clicks the approve button on the final confirmation screen.

[1883] Input: Contract documents and download links

[1884] Output: Final confirmation screen

[1885] Step 12:

[1886] The device provides a download link for the contract documents, allowing the user to download them. Simultaneously, the contract becomes formally concluded.

[1887] Input: Final confirmation approval

[1888] Output: Provision of download link and conclusion of contract

[1889] In this way, through this system, users can complete smartphone and landline phone contract procedures simply and quickly, and by utilizing generative artificial intelligence, the system can provide contract plans that are best suited to the user's needs.

[1890] (Application Example 1)

[1891] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1892] Traditional smartphone or landline phone contract procedures required users to visit electronics stores, which was time-consuming and laborious. Online contracts were also cumbersome, requiring users to manually review a large amount of information to choose the optimal plan. Furthermore, with the advancement of virtual reality (VR) technology, there was a growing demand for simplified contract procedures utilizing this technology.

[1893] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1894] In this invention, the server includes means for receiving initial information from a user; analysis means including a generation engine that analyzes the initial information and generates multiple contract plans in response to the user's requests; means for presenting the contract plans generated from the analysis means to the user; means for receiving a contract plan selected or adjusted by the user; means for finalizing the contract based on the selected or adjusted contract plan and generating contract documents; means for providing the contract documents to the user; and means for visually displaying multiple contract plans to the user in a virtual reality environment, allowing the user to select or adjust a plan. This enables the user to easily and quickly perform complex contract procedures using the virtual reality environment.

[1895] A "user terminal" is a device that provides an interface for user operation.

[1896] A "server" is a central processing unit that receives data sent from users, analyzes it, and generates multiple contract plans using generative artificial intelligence.

[1897] "Initial information" refers to information necessary for a user to complete the contract process, such as budget, data capacity, and required functions.

[1898] "Analysis means" refers to a method for analyzing initial information from the user and generating multiple contract plans based on that analysis.

[1899] A "generation engine" is an engine that uses generative artificial intelligence to generate multiple contract plans in response to user requests.

[1900] A "virtual reality environment" is a virtual space or environment that a user interacts with using virtual reality technology.

[1901] A "contract plan" is a selection of contract options proposed based on the user's requests and initial information.

[1902] "Contract documents" are official documents generated based on the contract plan selected or adjusted by the user.

[1903] A "user interface" refers to the screens and components provided for users to input initial information, and to review, select, and adjust their contract plans.

[1904] This invention provides a system that allows users to easily and quickly complete smartphone or landline phone contract procedures at home using a virtual reality environment. The system includes a user terminal, a server, and a user interface for operations within the virtual reality environment.

[1905] System Overview

[1906] The system receives and analyzes initial information from the user and generates multiple contract plans using generative artificial intelligence. These generated contract plans are presented to the user in a virtual reality environment, allowing the user to visually review, select, and adjust them. Once the final contract plan is confirmed, the contract documents are automatically generated and provided to the user.

[1907] Hardware and software to be used

[1908] Hardware:

[1909] Smartphone or tablet

[1910] Virtual reality goggles

[1911] Servers (for example, Amazon Web Services as a cloud environment)

[1912] Database (for example, MySQL)

[1913] software:

[1914] Virtual store application (based on the Unity engine)

[1915] Generative artificial intelligence models (e.g., OpenAI GPT-4)

[1916] Frontend libraries (e.g., React Native)

[1917] Backend framework (e.g., Node.js)

[1918] Program processing

[1919] 1. The user accesses a terminal within the virtual reality environment and begins the contract process. The user terminal displays an initial information input form, where the user enters their desired budget, data capacity, required functions, etc.

[1920] 2. The terminal converts the input data into JSON format and sends it to the server. The server then uses a generative artificial intelligence model (GPT-4) to perform data analysis and generate a contract plan.

[1921] 3. The generated contract plan is temporarily stored in the database and sent from the server to the terminal. The terminal visually projects the contract plan onto a holographic display in the virtual reality environment.

[1922] 4. The user reviews, selects, or adjusts the plan. The user's actions are sent back to the server, and the final contract plan is confirmed.

[1923] 5. The server generates contract documents based on the confirmed contract plan and provides a download link to the user's terminal. The contract is concluded when the user confirms and downloads the documents.

[1924] Specific example

[1925] As a specific scenario, the procedure for a new smartphone contract is shown below.

[1926] 1. The user puts on virtual reality goggles and launches the virtual store application.

[1927] 2. The device displays the "New Smartphone Contract" option within the virtual environment.

[1928] 3. The user controls an avatar and enters their budget, desired data capacity, and required functions.

[1929] 4. The terminal converts the input content into JSON format and sends it to the server.

[1930] 5. The server analyzes the received data and generates multiple subscription plans using a generative artificial intelligence model (GPT-4). For example, "Budget of 3000 yen / month, 5GB data capacity, latest camera features."

[1931] 6. The server sends the generated plan to the terminal and projects it onto a holographic display in the virtual reality environment.

[1932] 7. The user visually reviews the presented contract plan and selects "I want to add insurance options."

[1933] 8. The device sends the adjustment details back to the server.

[1934] 9. The server finalizes the plan, generates the contract documents, and sends them to the terminal.

[1935] 10. The device displays a final confirmation screen, and the user approves the contract.

[1936] 11. The server records the conclusion of the contract and provides a download link for the contract documents.

[1937] 12. The user downloads the contract documents, and the contract is officially concluded.

[1938] Example of a prompt

[1939] The following are examples of prompts to input into the generated AI model:

[1940] Please propose the optimal contract plan based on the user's budget, data capacity, and required features. Please use the following information:

[1941] Budget: 3000 yen / month

[1942] Data capacity: 5GB

[1943] Required features: Latest camera features

[1944] Please provide multiple contract plans.

[1945] In this way, the present invention enables users to easily and quickly complete contract procedures using a virtual reality environment.

[1946] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1947] Step 1:

[1948] The user puts on virtual reality goggles and launches a virtual store application. The device displays the "New Smartphone Contract" option within the virtual environment. The user controls an avatar and enters information such as budget, desired data capacity, and required features. The device converts the entered data into JSON format and sends it to the server.

[1949] Step 2:

[1950] The server analyzes the initial user information it receives. This analysis uses a generative AI model (e.g., GPT-4). The server generates multiple contract plans based on the user's input data. This prompt is then input into the generative AI model, the analysis results are obtained, and a contract plan is generated.

[1951] Step 3:

[1952] The server temporarily stores the generated contract plan in a database and sends it to the terminal. The terminal visually projects the contract plan onto a holographic display in the virtual reality environment. The user reviews the multiple plans presented.

[1953] Step 4:

[1954] The user selects or adjusts their desired subscription plan within the virtual reality environment. The device then converts this selected or adjusted information back into JSON format and sends it to the server.

[1955] Step 5:

[1956] The server receives the adjustments submitted by the user and finalizes the contract plan. Based on the final plan, the server generates the contract documents and sends a download link to the user's device.

[1957] Step 6:

[1958] The terminal displays a final confirmation screen within the virtual reality environment, and the user approves the contract. The server records the conclusion of the contract and provides the user with a download link for the contract documents. The user downloads the contract documents, and the contract is officially concluded.

[1959] The above describes the processing flow of the system program that implements the application example.

[1960] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1961] This invention provides a system for users to smoothly complete smartphone or landline phone contract procedures using terminals installed in stores not yet stocked in mass retailers or through an online environment. In particular, this invention incorporates an emotion engine that recognizes the user's emotions and adjusts the contract plan accordingly. This system receives and analyzes the user's initial information, automatically generates and presents multiple contract plans using generative artificial intelligence, and provides the user with the optimal plan, thereby simplifying the contract procedure. Furthermore, it provides a more personalized service by responding to the user's emotions.

[1962] Components

[1963] 1. User terminal: A device that provides an interface for user operation. This terminal may be installed in stores not affiliated with mass retailers, or it may be provided as an online web interface or mobile application.

[1964] 2. Server: This is the central processing unit that receives and analyzes data sent from users and generates multiple contract plans using generative artificial intelligence.

[1965] 3. Emotion Engine: This engine includes technology to recognize the user's emotions by analyzing the user's voice, facial expressions, input speed, etc.

[1966] Program Processing Description

[1967] Acceptance of initial information

[1968] The device provides an interface that allows the user to input their budget, desired data capacity, and required features (e.g., camera performance, battery life, etc.).

[1969] The user enters the necessary information using the terminal's interface.

[1970] The terminal converts the initial information entered into the appropriate data format (e.g., JSON) and sends it to the server.

[1971] Emotional analysis

[1972] The device captures the user's voice tone, facial expressions, and input speed in real time and sends this information to the server.

[1973] The server utilizes an emotion engine to analyze the transmitted data and recognize the user's emotional state. Recognized emotions include, for example, joy, excitement, confusion, and anger.

[1974] Information analysis and contract plan generation

[1975] The server receives initial information and emotional state sent by the user and analyzes both using generative artificial intelligence.

[1976] The server generates multiple optimal contract plans based on the analysis results. For example, if the user is confused, it will suggest a simpler and easier-to-understand plan.

[1977] The server sends the generated contract plan to the terminal.

[1978] Proposal and adjustment of contract plans

[1979] The device displays the received contract plan to the user in a visually easy-to-understand format. The user can then select the plan that best suits them from the multiple plans offered.

[1980] The user selects one of the displayed plans or adjusts options (e.g., adding insurance).

[1981] The device then resends the user's selections and adjustments to the server.

[1982] Final contract confirmation and document generation

[1983] The server analyzes the adjustment details sent by the user and determines the final contract plan.

[1984] The server generates contract documents based on the confirmed contract plan and sends a download link for the contract documents to the user's device.

[1985] The device displays a final confirmation screen to the user, prompting them to approve the contract.

[1986] The user grants approval.

[1987] The device provides a download link for the contract documents, and the contract is officially concluded.

[1988] Specific example

[1989] As a concrete example, here is a scenario for a new smartphone contract:

[1990] 1. The user accesses the store's tablet terminal and selects "New smartphone contract".

[1991] 2. The device displays a form that prompts the user to enter their budget, desired data capacity, and required features (e.g., latest camera features).

[1992] 3. The user enters the information and presses the submit button.

[1993] 4. The terminal converts the input content into JSON format and sends it to the server.

[1994] 5. The terminal captures the user's voice tone, facial expressions, and input speed in real time and sends this information to the server.

[1995] 6. The server analyzes received data and sentiment data, and uses generative artificial intelligence to generate multiple contract plans. For example, "Budget of 3000 yen / month, 5GB data capacity, latest camera features." If the user is confused, it will suggest a simpler and easier-to-understand plan.

[1996] 7. The server sends the generated plan to the terminal.

[1997] 8. The device displays the suggested plan to the user.

[1998] 9. The user selects "I want to add an insurance option" and makes adjustments to the device.

[1999] 10. The device sends the adjustment data to the server.

[2000] 11. The server finalizes the plan, generates the contract documents, and sends them to the terminal.

[2001] 12. The device displays a final confirmation screen, and the user approves the contract.

[2002] 13. The server records the conclusion of the contract and sends a download link for the contract documents to the terminal.

[2003] 14. The device displays to the user that the contract has been concluded and a download link is available.

[2004] Thus, this system allows users to complete smartphone and landline phone contracts easily and quickly. Furthermore, by using an emotion engine, personalized responses tailored to the user's emotions become possible, greatly improving convenience and satisfaction.

[2005] The following describes the processing flow.

[2006] Step 1:

[2007] The device boots up and displays a welcome screen. The user is presented with the option of either a "smartphone contract" or a "landline phone contract."

[2008] Step 2:

[2009] When the user selects "Smartphone Contract," a form appears on the device for them to enter the necessary initial information (budget, data capacity, required features).

[2010] Step 3:

[2011] The user enters their budget, data capacity, and required features into the form and presses the submit button.

[2012] Step 4:

[2013] The device captures the user's voice tone, facial expressions, and typing speed. This information is then analyzed by an emotion engine.

[2014] Step 5:

[2015] The device converts the user's initial information and sentiment data into JSON format and sends it to the server over the network.

[2016] Step 6:

[2017] The server parses the JSON data received from the terminal. Based on budget, data volume, and functional requirements, it identifies the user's requirements.

[2018] Step 7:

[2019] The server's emotion engine analyzes the user's voice tone, facial expressions, and typing speed to recognize the user's emotional state.

[2020] Step 8:

[2021] The server's generative artificial intelligence generates the optimal contract plan for the user based on the initial information and emotion data received. For example, if the user is confused, it prioritizes a simpler and easier-to-understand plan.

[2022] Step 9:

[2023] The server encodes the multiple contract plans it generates into JSON format and sends them to the terminal.

[2024] Step 10:

[2025] The device decodes the received JSON data and displays the plan to the user in a visually easy-to-understand format.

[2026] Step 11:

[2027] The user selects one of several contract plans displayed. They can also adjust options as needed (e.g., add insurance).

[2028] Step 12:

[2029] The device converts the user's selections and adjustments back into JSON format and sends them to the server.

[2030] Step 13:

[2031] The server analyzes the adjustment data received from the terminal and determines the final contract plan.

[2032] Step 14:

[2033] Based on the confirmed contract plan, the server generates the contract documents and sends a download link for the contract documents to the user.

[2034] Step 15:

[2035] The device displays a final confirmation screen to the user, prompting them to approve the contract.

[2036] Step 16:

[2037] The user performs a final review and clicks the "Approve" button.

[2038] Step 17:

[2039] The device sends the authorization information to the server.

[2040] Step 18:

[2041] The server confirms the contract is finalized and records the contract information.

[2042] Step 19:

[2043] The server sends a download link for the contract documents to the user's device.

[2044] Step 20:

[2045] The device will display a notification that the contract has been concluded, along with a link to download the contract documents to the user.

[2046] This process allows users to complete smartphone and landline phone contract procedures simply and quickly using this system. Furthermore, by utilizing the emotion engine, personalized responses that respond to the user's emotions become possible, increasing user satisfaction.

[2047] (Example 2)

[2048] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[2049] Traditional contract procedures often result in a poor user experience because they don't consider the user's emotions or psychological state when users input necessary information and choose the best plan from the provided options. In particular, users may feel confused or dissatisfied when selecting the optimal plan from a complex selection. Furthermore, the inability to provide flexible plans tailored to the user's emotional state is a significant challenge.

[2050] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[2051] In this invention, the server includes means for receiving initial information from the user, analysis means including a generation engine that analyzes the initial information and generates multiple contract plans based on the user's requests and emotional state, and emotion recognition means that analyzes the user's voice tone, facial expressions, and input speed to recognize the emotional state. This makes it possible to provide personalized contract plans that are tailored to the user's psychological state.

[2052] A "user" refers to an individual who operates the system and selects or adjusts their contract plan.

[2053] "Initial information" refers to the basic information that users input into the system, such as budget, data capacity, and functional requirements.

[2054] A "generation engine" refers to a program and algorithm that analyzes a user's initial information and emotional state, and automatically generates multiple contract plans based on that analysis.

[2055] "Analysis means" refers to a series of processes for processing initial information obtained from the user and generating a contract plan using a generation engine.

[2056] "Emotion recognition means" refers to technologies and devices that analyze the user's voice tone, facial expressions, and input speed to recognize the user's emotional state.

[2057] "Contract documents" refer to formal documents that contain the final terms of the agreement and require confirmation and approval by the user.

[2058] "Adjustment" refers to the act of adding or changing the contract plan selected by the user.

[2059] "Provision" refers to the act of the system displaying or making available to the user, via a download link, a contract plan or contract documents that it has generated.

[2060] This invention provides a system for users to smoothly complete smartphone or landline phone contract procedures using terminals installed in stores not yet stocked in mass retailers or through an online environment. In particular, this invention incorporates an emotion engine that recognizes the user's emotions and adjusts the contract plan accordingly. This system receives and analyzes the user's initial information, automatically generates and presents multiple contract plans using generative artificial intelligence, and provides the user with the optimal plan, thereby simplifying the contract procedure. Furthermore, it provides a more personalized service by responding to the user's emotions.

[2061] Components

[2062] 1. User terminal: A device that provides an interface for user operation. This terminal may be installed in stores not affiliated with mass retailers, or it may be provided as an online web interface or mobile application. For example, tablet devices and smartphones are used.

[2063] 2. Server: This is the central processing unit that receives and analyzes data sent from users and generates multiple contract plans using generative artificial intelligence. For example, a cloud server is used.

[2064] 3. Emotion Engine: This engine includes technologies for recognizing the user's emotions by analyzing their voice, facial expressions, input speed, etc. For example, voice tone analysis software and facial recognition software may be used.

[2065] Process Overview

[2066] The device provides an interface that allows the user to input their budget, desired data capacity, and required features (e.g., camera performance, battery life). Once the user inputs the necessary information using the device's interface, the device converts it into an appropriate data format (e.g., JSON) and sends it to the server. Furthermore, the device captures the user's voice tone, facial expressions, and input speed in real time and sends this information to the server.

[2067] The server utilizes an emotion engine to analyze the transmitted data and recognize the user's emotional state. Recognized emotions include, for example, joy, excitement, confusion, and anger. Next, the server receives the initial information and emotional state transmitted by the user and analyzes both using generative artificial intelligence. Based on this analysis, the server generates several optimal contract plans and sends them to the terminal.

[2068] The terminal displays the received contract plan to the user in a visually easy-to-understand format. The user can select the plan that best suits them from the multiple plans offered. Once the user selects one of the displayed plans or adjusts options (e.g., adding insurance), the selection and adjustments are sent back from the terminal to the server. The server analyzes the adjustments sent by the user and finalizes the contract plan. Based on the finalized contract plan, the server generates the contract documents and sends a download link for the contract documents to the terminal. The terminal displays a final confirmation screen to the user, prompting them to approve the contract. Once the user approves, the terminal provides the download link for the contract documents, and the contract is officially concluded.

[2069] Specific example

[2070] For example, a possible prompt for a new smartphone contract scenario might look like this:

[2071] "I'd like to sign up for a new smartphone contract. My monthly budget is under 3000 yen, I need at least 5GB of data, and camera performance is a priority."

[2072] Thus, this system allows users to complete smartphone and landline phone contracts easily and quickly. Furthermore, by using an emotion engine, personalized responses tailored to the user's emotions become possible, greatly improving convenience and satisfaction.

[2073] The flow of the specific processing in Example 2 will be explained using Figure 13.

[2074] Step 1:

[2075] The device provides an interface that allows the user to input their budget, desired data capacity, and required features (e.g., camera performance, battery life, etc.).

[2076] Input: User budget, desired data capacity, required features

[2077] Action: The terminal displays a form, and the user completes the input.

[2078] Output: Information entered by the user

[2079] Step 2:

[2080] The user enters the necessary information using the terminal's interface and presses the submit button.

[2081] Input: Budget entered by the user, desired data capacity, required functions

[2082] Operation: The user enters information into each field of the form and presses the submit button.

[2083] Output: Initial information from form input

[2084] Step 3:

[2085] The terminal converts the initial information entered into the appropriate data format (e.g., JSON) and sends it to the server.

[2086] Input: Initial information entered via form

[2087] Operation: The terminal converts the input data into a JSON object and sends it to the server as an HTTP request.

[2088] Output: Initial information data in JSON format

[2089] Step 4:

[2090] The device captures the user's voice tone, facial expressions, and input speed in real time and sends this information to the server.

[2091] Input: User's voice tone, facial expression, input speed

[2092] Operation: The device uses its camera and microphone to capture data and send it to the server.

[2093] Output: Voice tone data, facial expression data, input speed data

[2094] Step 5:

[2095] The server utilizes an emotion engine to analyze the transmitted data and recognize the user's emotional state.

[2096] Input: Voice tone data, facial expression data, input speed data

[2097] Operation: The server uses emotion recognition software to analyze data and classify the user's emotional state.

[2098] Output: User's emotional state (e.g., joy, excitement, confusion, anger)

[2099] Step 6:

[2100] The server receives initial information and emotional state sent by the user and analyzes both using generative artificial intelligence.

[2101] Input: Initial information data in JSON format, user's emotional state

[2102] Operation: The server uses generative artificial intelligence to analyze the input data.

[2103] Output: Analysis results (data based on user requests and emotional state)

[2104] Step 7:

[2105] The server generates multiple optimal contract plans based on the analysis results and sends them to the terminal.

[2106] Input: Analysis results

[2107] Operation: The server generates multiple contract plans and sends them to the terminal in JSON format.

[2108] Output: Contract plan data in JSON format

[2109] Step 8:

[2110] The device displays the received contract plan to the user in a visually easy-to-understand format.

[2111] Input: Contract plan data in JSON format

[2112] Operation: The terminal appropriately lays out and displays the proposed contract plan to the user.

[2113] Output: Displayed contract plan

[2114] Step 9:

[2115] The user selects one of the displayed plans or adjusts options (e.g., adding insurance).

[2116] Input: Displayed contract plan

[2117] Operation: Users select a plan and add options.

[2118] Output: Selected or adjusted contract plan

[2119] Step 10:

[2120] The device then resends the user's selections and adjustments to the server.

[2121] Input: Selected or adjusted contract plan

[2122] Operation: The terminal converts the selected data into JSON format and sends it to the server.

[2123] Output: Selected or adjusted contract plan data in JSON format

[2124] Step 11:

[2125] The server analyzes the adjustment details sent by the user and determines the final contract plan.

[2126] Input: Selected or adjusted contract plan data in JSON format

[2127] Operation: The server calculates and confirms the final contract details based on the selected options.

[2128] Output: Confirmed contract plan data

[2129] Step 12:

[2130] The server generates contract documents based on the confirmed contract plan and sends a download link for the contract documents to the user's device.

[2131] Input: Confirmed contract plan data

[2132] Operation: The server generates the contract documents in PDF format and sends a download link to the device.

[2133] Output: Download link for contract documents

[2134] Step 13:

[2135] The device displays a final confirmation screen to the user, prompting them to approve the contract.

[2136] Input: Download link for contract documents

[2137] Action: The device displays the contract details and presents an approval button.

[2138] Output: Final confirmation screen and approval button

[2139] Step 14:

[2140] The user grants approval.

[2141] Input: Final confirmation screen and approval button

[2142] Action: The user clicks the approve button.

[2143] Output: Approved contract details

[2144] Step 15:

[2145] The device provides a download link for the contract documents, and the contract is officially concluded.

[2146] Input: Approved contract details

[2147] Operation: The device displays a download link, and the user downloads the contract documents.

[2148] Output: Download link and downloaded contract documents

[2149] (Application Example 2)

[2150] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[2151] In today's world, the contract procedures for smartphones and landlines have become cumbersome and stressful for users. In particular, first-time users and those with limited technical knowledge find it difficult to select the appropriate plan, resulting in the problem of not being able to choose the optimal contract plan. Furthermore, traditional online contract systems fail to consider the user's emotional state, leading to confusion and anxiety. There is a need to solve these problems and provide a system that allows users to complete contract procedures more easily and with greater peace of mind.

[2152] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving initial information from the user; analysis means including a generation engine that analyzes the initial information and generates multiple contract plans in response to the user's requests; means for adjusting the contract plan according to the user's emotions using an emotion recognition engine that recognizes the user's emotions from voice, facial expressions, input speed, etc.; means for displaying the multiple contract plans generated based on the user's emotions on the interface of the virtual store and providing them to the user in a visually easy-to-understand manner; means for presenting the contract plan generated from the analysis means to the user; means for receiving the contract plan selected or adjusted by the user; means for finalizing the contract based on the selected or adjusted contract plan and generating contract documents; and means for providing the contract documents to the user. As a result, the user can easily and quickly select the optimal contract plan according to their emotional state. Furthermore, by using the virtual store, convenience and satisfaction are improved, and contract procedures can be carried out with peace of mind.

[2153] A "user terminal" is a device that provides an interface for user operation and enables access to virtual stores.

[2154] The "analysis means" refers to a system that includes an engine for analyzing the user's initial information and generating multiple contract plans based on the user's requests.

[2155] A "generation engine" is an engine that includes artificial intelligence to generate multiple contract plans based on the user's initial information.

[2156] An "emotion recognition engine" is an engine that includes technology to recognize the user's emotions by analyzing the user's voice, facial expressions, input speed, etc.

[2157] "Means of adjusting contract plans according to user emotions" refers to means of appropriately adjusting contract plans based on the user's emotions recognized by an emotion recognition engine.

[2158] A "virtual store" is a virtual store environment that users can access using VR or smart glasses, where they can select products and complete contract procedures.

[2159] An "interface" refers to the means by which a user interacts with a system, such as inputting, selecting, and displaying information.

[2160] "Means for generating contract documents" refers to the means of creating final contract documents based on the contract plan selected or adjusted by the user.

[2161] "Voice tone" refers to the characteristics of the user's voice, such as pitch, intonation, and volume, and is data used to analyze emotions in speech recognition.

[2162] "Facial expressions" refer to changes in a user's facial expressions and subtle movements, and are data used to analyze emotions using facial recognition technology.

[2163] "Input speed" refers to the speed and rhythm at which a user inputs information, and is an indicator used to infer the user's emotional state based on this.

[2164] "Visually easy to understand" refers to providing information to users in a format that is easy to grasp intuitively, and includes elements such as graphs, icons, and animations.

[2165] Modes for carrying out the invention

[2166] This invention is a system designed to analyze a user's emotions in real time and provide optimal responses when they ask questions or make purchases in a virtual store. This system allows users to easily and quickly complete smartphone or landline phone contract procedures. Furthermore, by providing personalized responses tailored to the user's emotional state, it can increase user satisfaction.

[2167] Hardware and software

[2168] This system uses the following hardware and software.

[2169] hardware

[2170] 1. VR goggles or smart glasses: These are devices used by users to access virtual stores.

[2171] 2. Microphone: A device used to record speech for speech recognition.

[2172] 3. Camera: A device that collects facial data for facial expression analysis.

[2173] software

[2174] 1. Application Server (Python-based): Operates as the central processing unit for the entire system.

[2175] 2. Emotion Engine Module: Analyzes the user's voice tone, facial expressions, and input speed to recognize their emotional state.

[2176] 3. Generative Artificial Intelligence Planner (AIPlanner): Generates multiple contract plans based on the user's initial information and emotional state.

[2177] 4. Virtual Shop Interface Module (VirtualShopTerminal): Collects information from the user and visually displays the contract plan.

[2178] Program processing

[2179] The server first collects initial information (budget, data capacity, functional requirements) from the user via the user's terminal. This initial information is sent to the server in JSON format. At the same time, emotional data such as the user's voice tone, facial expressions, and typing speed is also collected and sent to the server.

[2180] The server uses an emotion engine module to analyze the user's emotional state. For example, if the user is agitated, it adjusts the contract plan based on that emotional state, suggesting a state-of-the-art model.

[2181] Next, a generative artificial intelligence planner generates multiple contract plans based on the user's initial information and emotional state. The generated plans are then visually presented to the user through the virtual store interface.

[2182] The user makes selections and adjustments from the presented plans, and the results are sent back to the server. The server then finalizes the contract plan based on the user's selections and adjustments, and generates the contract documents.

[2183] Ultimately, the contract documents are presented to the user via the virtual store interface, and the contract is finalized upon user approval. A download link for the contract documents is provided, allowing the user to download and save them.

[2184] Specific example

[2185] For example, if a user accesses a virtual store and wants to sign up for a new smartphone contract, they would follow these steps:

[2186] 1. The user puts on VR goggles and logs into the virtual shop.

[2187] 2. A virtual assistant appears and asks questions about your budget, desired data capacity, and feature requirements.

[2188] 3. The user enters this information and provides answers via voice.

[2189] 4. The server analyzes the user's tone of voice and facial expressions to detect if the user is excited.

[2190] 5. A generative artificial intelligence planner generates the optimal contract plan for the user based on emotional data.

[2191] 6. Multiple generated contract plans are presented to the user through the virtual store interface.

[2192] 7. The user selects the most suitable plan and makes adjustments as needed.

[2193] 8. The final contract plan is confirmed on the server, and the contract documents are generated.

[2194] 9. The contract is concluded when the user reviews and approves the contract documents.

[2195] 10. A download link for the contract documents is provided, and the user saves it.

[2196] ...

Claims

1. A means of receiving initial information from the user, Analysis means including a generation engine that analyzes the aforementioned initial information and generates multiple contract plans in response to user requests, A means for presenting a contract plan generated from the analysis means to the user, A means of accepting contract plans selected or adjusted by the user, A means for finalizing the contract and generating contract documents based on the aforementioned selected or adjusted contract plan, Means for providing the aforementioned contract documents to the user, A system that includes this.

2. The system according to claim 1, which receives initial information from the user, including budget, data capacity, and functional requirements.

3. The system according to claim 1, wherein the generation engine generates multiple contract plans using a generative artificial intelligence system.

Images