system

Abstract

We provide the system. [Solution] A terminal means for the user to input their desired plan, device under consideration, and content they wish to use, A server means for receiving user input transmitted from the terminal means and generating an optimal plan and terminal suggestion based on the user input, A display means for receiving a proposal transmitted from the server means and displaying it to the user, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a persona chatbot control method performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance as a response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the process of terminal sales and plan proposals in conventional stores, a large amount of manpower is required, and the problem is that the customer service time becomes long. In addition, the quality of service may vary depending on the knowledge and response ability of salespersons, and there is concern about a decrease in customer satisfaction. For this reason, a system that can quickly and accurately respond to user demands is required.

Means for Solving the Problems

[0005] To solve the above problems, the present invention provides the following means: a system comprising terminal means for the user to input their desired plan, terminal under consideration, and content they wish to use; server means for receiving user input transmitted from the terminal means and generating optimal plan and terminal suggestions based on the user input; and display means for receiving suggestions transmitted from the server means and displaying them to the user. Furthermore, by providing the server means with means for analyzing user input and extracting necessary information, means for selecting the optimal plan, and means for selecting the optimal terminal, it is possible to respond quickly and accurately to user requests. This makes it possible to shorten customer service time and standardize the quality of service.

[0006] A "terminal device" is a device used by a user to input their desired plan, the device they are considering, and the content they wish to use.

[0007] "Server means" refers to a device or system that receives user input transmitted from terminal means, and generates and transmits an optimal plan and terminal suggestion based on that input.

[0008] A "display means" is a device that receives a proposal transmitted from a server means and displays it visually to the user.

[0009] "User input" refers to information about the user's desired plan, the device under consideration, and the content they wish to use, which is entered via a terminal device.

[0010] The "optimal plan" is a service plan that is best suited to the user's usage pattern, selected based on the user's wishes and usage conditions.

[0011] The "optimal device" is the device best suited to the user's usage pattern, selected based on the user's preferences and usage conditions.

[0012] "Analysis" is the process of examining user-entered information in detail to understand its meaning and intent.

[0013] "Selection" is the act of choosing the most suitable option from among several choices based on specific conditions or criteria.

[0014] A "suggestion" is a recommendation regarding the optimal plan and terminal generated by the server based on user input. [Brief explanation of the drawing]

[0015] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13]It is a sequence diagram showing the processing flow of the data processing system in Embodiment 2 when combined with an emotion engine. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when combined with an emotion engine.

Mode for Carrying Out the Invention

[0016] Hereinafter, an example of an embodiment of the system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0017] First, the language used in the following description will be explained.

[0018] In the following embodiments, the numbered processor (hereinafter simply referred to as "processor") may be one arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be one type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include CPU (Central Processing Unit), GPU (Graphics Processing Unit), GPGPU (General-Purpose computing on Graphics Processing Units), APU (Accelerated Processing Unit), etc.

[0019] In the following embodiments, the numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0020] In the following embodiments, the numbered storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disk (e.g., hard disk), or magnetic tape, etc.

[0021] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0022] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0023] [First Embodiment]

[0024] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0025] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0026] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0027] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0028] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0029] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0030] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0031] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0032] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0033] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0034] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0035] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0036] This invention relates to a system for streamlining the process of terminal sales and plan proposals in stores. The system includes terminal means for users to input their desired plan, terminal, and content, and server means for receiving the input information and generating optimal plan and terminal proposals. It also includes display means for receiving the proposals generated by the server means and displaying them to the user.

[0037] Program processing

[0038] User processing

[0039] Users access a form displayed on a terminal in the store and enter their desired plan, the device they are considering, and the content they want to use. For example, they might enter information such as "unlimited data plan," "latest smartphone," and "streaming, games." The terminal receives this information and sends the input data to the server.

[0040] Terminal processing

[0041] The terminal not only transmits user input to the server but also receives optimal plans and terminal suggestions from the server. Upon receiving suggestions from the server, the terminal displays the results to the user. This allows the user to obtain information quickly and accurately.

[0042] Server Processing

[0043] The server receives user input sent from the terminal device. This received data is analyzed, and an algorithm is executed to select the optimal plan and device according to the user's preferences. Specifically, if the user wants an "unlimited data plan," the algorithm selects a communication contract that provides an unlimited data plan; if the user is considering a "latest smartphone," it selects the optimal device to support that.

[0044] The server then sends back the optimal plan and terminal suggestion generated in this manner to the terminal device.

[0045] Explanation of specific examples

[0046] For example, if person A is considering a new smartphone and an unlimited data plan, the following process will occur:

[0047] 1. The user (Person A) enters "unlimited data plan," "latest smartphone," and "streaming, games" into the in-store terminal.

[0048] 2. The terminal sends this input data to the server.

[0049] 3. The server analyzes user input and selects the most suitable plan from the "unlimited data plans" and the most suitable device from the "latest smartphones."

[0050] 4. The server sends back the selected plan and terminal proposal results to the terminal.

[0051] 5. The terminal displays the proposal results sent from the server to person A.

[0052] In this way, users can quickly receive proposals for the optimal plan and device that meets their needs, so store staff only need to provide supplementary explanations based on the user's needs, which can significantly reduce the time spent with customers.

[0053] The above describes the configuration for implementing the system of the present invention. This system can improve customer satisfaction and increase sales efficiency by quickly and accurately proposing the optimal plan and terminal based on user input.

[0054] The following describes the processing flow.

[0055] Step 1:

[0056] Users access in-store terminals and enter their desired plan, device under consideration, and content they wish to use. Specifically, they enter information such as "unlimited data plan," "latest smartphone," and "streaming and games" into the form.

[0057] Step 2:

[0058] The terminal sends information entered by the user to the server. This includes formatting the input data and sending the data according to the transmission protocol.

[0059] Step 3:

[0060] The server receives user input data sent from the terminal. This allows the server to retrieve data regarding the user's preferences and requirements.

[0061] Step 4:

[0062] The server analyzes the user's input data received. Specifically, it analyzes the data to extract information about the desired plan, the device under consideration, and the content the user wants to use.

[0063] Step 5:

[0064] Based on the analysis results, the server selects the plan that best suits the user's desired conditions. For example, for a user who requests an "unlimited data plan," the server matches and selects the applicable plan.

[0065] Step 6:

[0066] Based on the analysis results, the server selects the most suitable device for the user's needs. For example, for a user considering the "latest smartphone," it selects the latest and best-performing device on the market.

[0067] Step 7:

[0068] The server generates a suggestion for the optimal plan and device. The generated suggestion includes specific information about the selected plan and device.

[0069] Step 8:

[0070] The server generates a proposal and sends it to the terminal. The proposal is formatted and sent to the terminal quickly.

[0071] Step 9:

[0072] The device receives a proposal sent from the server. The received proposal includes the optimal plan and device information based on the conditions entered by the user.

[0073] Step 10:

[0074] The device displays the suggested results it has received to the user. Specifically, the screen shows detailed information about the best plan and device.

[0075] Step 11:

[0076] The user reviews the displayed suggestions and, if necessary, asks the sales associate for further explanation. The sales associate then provides prompt and accurate supplementary explanations based on the suggestions.

[0077] This series of processing steps allows users to quickly find the optimal plan and device, and enables sales staff to provide efficient customer service.

[0078] (Example 1)

[0079] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0080] In traditional retail store sales and plan proposals, users often spent a significant amount of time trying to find the best plan and device for them, frequently receiving conflicting explanations from multiple sales representatives. This led to decreased user satisfaction, longer waiting times in stores, and reduced sales efficiency. Furthermore, understanding complex plan and device information required specialized knowledge, and without it, there was a risk of making the wrong choice.

[0081] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0082] In this invention, the server includes an information processing device for the user to input their desired contract, equipment under consideration, and functions they wish to use; a computing device for receiving user input transmitted from the information processing device and generating optimal contract and equipment suggestions based on the user input; and a display device for receiving suggestions transmitted from the computing device and displaying them to the user. This enables the user to receive prompt and accurate suggestions for the optimal plan and equipment.

[0083] A "user" refers to an individual or legal entity that uses this system to input their desired contract, equipment under consideration, and desired functions.

[0084] "Contract" refers to the agreement for the use of communication plans, data plans, and other services that the user desires.

[0085] "Equipment" refers to the electronic devices and hardware that the user is considering.

[0086] "Function" refers to the purpose of use of content, applications, etc., that a user wishes to use.

[0087] An "information processing device" refers to a terminal device used by users to input their desired contract, equipment under consideration, and desired functions.

[0088] A "computation device" refers to a server that receives user input transmitted from an information processing device and generates optimal contract and equipment proposals based on that data.

[0089] A "display device" refers to a device that receives suggestions transmitted from a computing device and displays them to the user.

[0090] "User input" refers to information entered by the user via an information processing device regarding contract preferences, equipment under consideration, and desired functions.

[0091] "Proposal" refers to the optimal combination of contracts and equipment for the user, as generated by the computing device.

[0092] "Transmission" refers to the act of transferring data to another device in the exchange of information.

[0093] "Receiving" refers to the act of receiving data transmitted from another device.

[0094] This invention relates to a system for streamlining the contract sales and plan proposal processes in retail stores. The system includes an information processing device for users to input their desired contracts, equipment, and functions, and a computing device to receive this input information and generate optimal contract and equipment proposals. It also includes a display device that receives the proposals generated by the computing device and displays them to the user.

[0095] User processing

[0096] Users access an information processing device installed in the store and enter their desired contract, equipment under consideration, and desired functions into the displayed form. For example, they might enter information such as "unlimited data plan," "latest smartphone," and "streaming and gaming." The input data is received by the information processing device and transmitted to the computer.

[0097] Terminal processing

[0098] The terminal (information processing device) not only transmits user input data to the computing device, but also receives optimal contract and equipment suggestions from the computing device. Upon receiving suggestions from the computing device, the terminal displays the results to the user. This allows the user to obtain information quickly and accurately.

[0099] Server (Computer) Processing

[0100] The server (computer) receives user input data sent from the terminal. Next, an algorithm is executed to analyze the received data and select the optimal contract and equipment according to the user's preferences. Specifically, if the user wants an "unlimited data plan," the server selects a communication contract that provides an unlimited data plan; if the user is considering a "latest smartphone," the server selects the optimal device to support it. The selected optimal contract and equipment proposal is then sent back from the server to the terminal.

[0101] Explanation of specific examples

[0102] For example, if user A is considering a new smartphone and an unlimited data plan, the following process will occur:

[0103] 1. User (Person A) enters "unlimited data plan," "latest smartphone," and "streaming, games" into the terminal in the store.

[0104] 2. The terminal sends this input data to the server.

[0105] 3. The server analyzes user input and selects the most suitable plan from the "unlimited data plans" and the most suitable device from the "latest smartphones."

[0106] 4. The server sends back the selected plan and terminal proposal results to the terminal.

[0107] 5. The terminal displays the proposal results sent from the server to person A.

[0108] Example of a prompt

[0109] When using a generative AI model to request a detailed explanation of this system, you can use prompt statements like the following:

[0110] Please describe in detail the system for streamlining the contract sales and plan proposal processes in stores, including the information entered by users, terminal processing, and server-based analysis and proposal processes. Furthermore, please explain the specific benefits this system offers and the hardware and software used.

[0111] The above describes the configuration for implementing the system of the present invention. This system can improve customer satisfaction and increase sales efficiency by quickly and accurately proposing the most suitable contracts and equipment based on user input.

[0112] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0113] Step 1: The user enters their desired information.

[0114] Users access an information processing device installed in the store and enter their desired contract, equipment under consideration, and desired functions into the displayed form. Specifically, they enter information such as "unlimited data plan," "latest smartphone," and "streaming and gaming" using touch controls or a keyboard. Once the entered data is confirmed, the submit button is pressed.

[0115] Input: User's preferences (contract, equipment, functions)

[0116] Output: Input data (contract, equipment, and function information)

[0117] Specific actions:

[0118] The user enters their desired information into the form and presses the submit button.

[0119] Step 2: The device sends data to the server.

[0120] The terminal temporarily stores the input data obtained from the user in memory and sends the data to the server using network communication. Specifically, the data is transferred to the server via an HTTP request.

[0121] Input: Input data (contract, equipment, and function information)

[0122] Output: Data sent to the server

[0123] Specific actions:

[0124] The terminal saves the input data to memory, generates an HTTP request, and sends it.

[0125] Step 3: The server receives and analyzes the data.

[0126] The server receives user input data sent from the terminal. The received data is first stored in the database, and data validation (checking for correctness) is performed as needed.

[0127] Input: User input data

[0128] Output: Analyzed data

[0129] Specific actions:

[0130] The server receives an HTTP request and parses and stores the data that has been sent.

[0131] Perform validation to confirm the validity of the data.

[0132] Step 4: The server selects the optimal plan and equipment.

[0133] The server executes an algorithm that selects the optimal contract and equipment according to the user's preferences based on the stored data. Specifically, it compares contract and equipment information in the database and selects the most suitable plan.

[0134] Input: Analyzed data

[0135] Output: Information on the selected optimal contracts and equipment.

[0136] Specific actions:

[0137] The server executes an algorithm and selects the optimal plan and equipment based on the information in the database.

[0138] Step 5: The server sends the proposal back to the terminal.

[0139] The server sends back a proposal for the most suitable contract and equipment selected by the terminal. The output data is converted by the server into HTML or JSON format and sent to the terminal as an HTTP response.

[0140] Input: Information on selected contracts and equipment

[0141] Output: Proposal data sent to the terminal

[0142] Specific actions:

[0143] The server converts the proposed data into a format and sends it to the terminal as an HTTP response.

[0144] Step 6: The device displays a suggestion.

[0145] The terminal analyzes the suggestion data received from the server and displays it to the user. This allows the user to view suggestions for the most suitable contract plan and equipment.

[0146] Input: Proposal data sent from the server

[0147] Output: Suggestion results displayed to the user

[0148] Specific actions:

[0149] The device analyzes the suggested data and displays the information on the screen. For example, it might show the user "unlimited data plan" and "latest smartphone."

[0150] The above outlines the specific processing steps of the system program. This process allows users to receive prompt, accurate, and optimal contract and equipment recommendations.

[0151] (Application Example 1)

[0152] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0153] In traditional retail store sales and plan proposal processes, users had to compare multiple options and gather a lot of information through conversations with sales staff in order to find the best plan and device that suited their needs. This cumbersome process led to decreased user satisfaction and reduced sales efficiency. Furthermore, the process for users to make immediate purchases or reservations was complicated, making quick decision-making difficult.

[0154] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0155] In this invention, the server includes input means for inputting the user's desired data plan, terminal under consideration, and content to be used; analysis means for receiving user input transmitted from the input means and generating optimal plan and terminal suggestions based on the user input; display means for receiving suggestions transmitted from the analysis means and displaying them to the user; and purchase support means for performing purchase procedures or reservations for the suggested plan and terminal if desired by the user. This enables the user to quickly and accurately receive optimal plan and terminal suggestions, and to smoothly perform purchase procedures or reservations on the spot.

[0156] A "user" is someone who uses the system to receive suggestions for their desired data plan, device, and content.

[0157] A "data plan" is a pricing plan for communication services and data usage that a user contracts for.

[0158] A "device" refers to a smartphone, tablet, or other device that the user is considering purchasing.

[0159] "Content" refers to digital services and applications such as streaming services and games that users want to use.

[0160] "Input means" refers to a device or interface in which the user inputs information about their desired data plan, device, and content.

[0161] "Analysis means" refers to a system or algorithm that receives user input transmitted from an input means, analyzes that information, and generates optimal plan and terminal suggestions.

[0162] "Display means" refers to a device or interface for displaying the suggested results transmitted from the analysis means to the user.

[0163] "Purchase support means" refers to a system or interface that allows users to purchase or reserve proposed plans and devices if they so desire.

[0164] This invention provides a system for streamlining terminal sales and plan proposals in physical stores. Based on user input, it makes optimal suggestions, displays them, and supports the purchase procedure as needed. This system mainly consists of input means, analysis means, display means, and purchase support means.

[0165] 1. System Configuration

[0166] Input means

[0167] Users use a smartphone app to input their desired data plan, the device they are considering, and the content they want to use. This input method is software that provides a user interface, designed to allow users to intuitively input information.

[0168] Analysis means

[0169] The smartphone app sends user input to a server. This server uses a cloud-based analytics system (e.g., AWS® Lambda) to receive the transmitted data and uses a generated AI model and an existing database to select the best plan and device for the user's needs. This analytics process uses software such as Python and Tensorflow®.

[0170] Display means

[0171] The suggestions sent from the server are returned to the smartphone app and displayed to the user. The user reviews the displayed suggestions, and if they are satisfied with the content, they can proceed to the next step.

[0172] Purchase support methods

[0173] If a user wishes to purchase or reserve based on the suggestions, the smartphone app will support the purchase process. This method is linked to electronic payment and reservation systems, helping users complete the process smoothly.

[0174] 2. Explanation of Program Processing

[0175] Server Processing

[0176] When the server receives user input data, it analyzes the data using a generative AI model. This analysis employs an algorithm that derives the optimal combination of the user's desired data plan, devices under consideration, and content they wish to use. As a result, the server generates a suggestion of the plan and device that best matches the user's desired conditions.

[0177] Terminal processing

[0178] When the smartphone app receives a suggestion, it displays the details to the user. The user can review the suggested plan and device and make a selection based on the content they want to use. If necessary, they can proceed directly to purchase or reserve the suggested items within the app.

[0179] 3. Explanation of specific examples

[0180] For example, if a user wants an "unlimited data plan," a "latest smartphone," and "video streaming," enter the following prompt message.

[0181] Example of a prompt:

[0182] Please enter your desired data plan: Unlimited Data Plan

[0183] Please enter the device you are considering: Latest smartphone

[0184] Please enter the content you wish to use: Video viewing

[0185] When a user enters this prompt, the analysis system proposes and displays the most suitable plan and device based on that input. If the user is satisfied with the proposal, they can proceed with the purchase or reservation on the spot, enabling quick and efficient service delivery.

[0186] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0187] Step 1:

[0188] User input

[0189] The user opens the smartphone app and enters their desired data plan, the device they are considering, and the content they want to use. Specifically, the user enters information such as "unlimited data plan," "latest smartphone," and "video viewing" into the input form. This quantifies the user's needs and generates data that forms the basis for analysis in the next step.

[0190] Input: User's preferred data plan, device, and content information.

[0191] Output: User input data

[0192] Step 2:

[0193] Sending input data

[0194] The device sends the data entered by the user to a cloud server. Specifically, this involves the application's backend sending this input data to an analysis system in the cloud via an API.

[0195] Input: User input data

[0196] Output: Input data sent to the cloud server

[0197] Step 3:

[0198] Data analysis

[0199] The server analyzes the received user input data using a generating AI model and database. This allows for calculations to select the optimal data plan and device that meet the user's needs. Specifically, the previously trained AI model uses this dataset to generate a list of relevant data plans and devices.

[0200] Input: User input data sent to the cloud server

[0201] Output: Suggestions for the optimal data plan and device for the user.

[0202] Step 4:

[0203] Generation of proposal results

[0204] The server generates suggestions for the user based on the analysis results. These suggestions include the optimal data plan and device combination, and are provided in a way that best suits the user's needs. Here, software such as Python and TensorFlow are used to generate the suggestion results.

[0205] Input: Suggesting the optimal data plan and device for the user.

[0206] Output: Specific proposal details (list of optimal data plans and devices)

[0207] Step 5:

[0208] Submission of proposal results

[0209] The server sends the generated suggestion results to the terminal. Specifically, this involves a process where the suggestion data generated on the server side is returned to the user's smartphone via an API.

[0210] Input: Specific proposal details (list of optimal data plans and devices)

[0211] Output: Proposal results sent to the user terminal

[0212] Step 6:

[0213] Display of proposal results

[0214] The device receives the suggested results sent from the server and displays them to the user. Specifically, the suggested content is displayed in a rich format (e.g., list format or card format) through the user interface of the smartphone app.

[0215] Input: Suggestion results received from the server

[0216] Output: Suggestions displayed in the user interface

[0217] Step 7:

[0218] Support for the purchase process

[0219] If a user wishes to purchase or reserve an item based on a suggestion, the terminal provides an interface to assist with the purchase process. Specifically, it integrates with electronic payment and reservation systems, implementing a workflow that allows users to complete the process smoothly.

[0220] Input: User's intention to purchase or reserve

[0221] Output: Completed purchase or reservation information

[0222] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0223] This invention relates to a system that streamlines the process of terminal sales and plan proposals in stores and provides more appropriate suggestions based on the user's emotional state. The system includes terminal means for the user to input their desired plan, terminal, and content, and server means for receiving the input information and generating optimal plan and terminal suggestions. It also includes display means for receiving the suggestions generated by the server means and displaying them to the user, and further includes an emotion engine that recognizes the user's emotions.

[0224] Program processing

[0225] User processing

[0226] Users access a terminal in the store and enter their desired plan, the device they are considering, and the content they want to use. For example, they might enter information such as "unlimited data plan," "latest smartphone," and "streaming, games" into the form. The terminal receives this information and sends it to the server.

[0227] Terminal processing

[0228] The terminal transmits user input data to the server, along with data from the emotion engine. Upon receiving the optimal plan and terminal suggestions from the server, the results are displayed to the user. This allows the user to obtain information quickly and accurately.

[0229] Server Processing

[0230] The server receives user input data and emotion engine data transmitted from the terminal device. It analyzes the received data and executes an algorithm to select the optimal plan and terminal based on the user's preferences. Furthermore, it adjusts the suggested content and display method, taking into account the user's emotional state detected by the emotion engine. For example, if the user appears anxious, it will provide suggestions that include more detailed explanations.

[0231] Explanation of specific examples

[0232] For example, if person B is considering a new smartphone and an unlimited data plan but is feeling anxious, the following process will occur:

[0233] 1. User (Person B) enters "unlimited data plan," "latest smartphone," and "streaming, games" into the in-store terminal.

[0234] 2. The emotion engine analyzes Person B's facial expressions and voice tone to detect feelings of anxiety.

[0235] 3. The device sends input data and emotion data to the server.

[0236] 4. The server analyzes user input and selects the most suitable plan from the "unlimited data plans" and the most suitable device from the "latest smartphones."

[0237] 5. The server generates the selected plan and terminal suggestions, providing them with detailed explanations that take into account the user's concerns.

[0238] 6. The server sends the proposal to the terminal.

[0239] 7. The terminal displays the suggested results sent from the server to Person B. The displayed content includes detailed explanations and additional information to alleviate user anxiety.

[0240] This series of processing steps allows users to quickly receive optimal plan and device suggestions tailored to their preferences, as well as be provided with appropriate information based on their emotional state, enabling them to make choices with confidence. As a result, in-store sales staff only need to provide supplementary explanations based on the user's needs, significantly reducing the time spent with customers.

[0241] The following describes the processing flow.

[0242] Step 1:

[0243] Users access in-store terminals and enter their desired plan, device under consideration, and content they wish to use. Specifically, they enter information such as "unlimited data plan," "latest smartphone," and "streaming and games" into the form.

[0244] Step 2:

[0245] The device receives user input information and sends it to the server. Additionally, the device's emotion engine analyzes the user's facial expressions and voice tone to generate emotion data, which is also sent to the server.

[0246] Step 3:

[0247] The server receives user input data and emotion data sent from the terminal. This allows the server to acquire data regarding the user's preferences, conditions, and emotional state.

[0248] Step 4:

[0249] The server analyzes user data, extracting information about the desired plan, devices under consideration, and content the user wants to use from the input data. It also analyzes sentiment data simultaneously.

[0250] Step 5:

[0251] Based on the analysis results, the server selects the plan that best suits the user's desired conditions. For example, for a user who requests an "unlimited data plan," the server matches and selects the applicable plan.

[0252] Step 6:

[0253] Based on the analysis results, the server selects the most suitable device for the user's needs. For example, for a user considering the "latest smartphone," it selects the latest and best-performing device on the market.

[0254] Step 7:

[0255] The server takes emotional data into account and adjusts the suggestions accordingly. For example, if the user is feeling anxious, it will generate suggestions that include detailed explanations.

[0256] Step 8:

[0257] The server generates optimal plan and device suggestions. These suggestions include specific information about the selected plan and device, as well as adjustments based on sentiment data.

[0258] Step 9:

[0259] The server generates a proposal and sends it to the terminal. The proposal is formatted and sent to the terminal quickly.

[0260] Step 10:

[0261] The device receives a suggestion sent from the server. The received suggestion includes the optimal plan based on the conditions entered by the user, device information, and adjustments based on sentiment data.

[0262] Step 11:

[0263] The device displays the suggested results to the user. Specifically, the screen shows detailed information about the best plan and device, along with explanations based on sentiment data.

[0264] Step 12:

[0265] The user reviews the displayed suggestions and, if necessary, asks the sales associate for further explanation. The sales associate then provides prompt and accurate supplementary explanations based on the suggestions.

[0266] This series of processing steps allows users to quickly find the optimal plan and device that matches their preferences, and to make informed choices with confidence as they are provided with appropriate information tailored to their emotional state. This enables sales staff to provide effective supplementary explanations based on the user's needs, significantly reducing customer service time.

[0267] (Example 2)

[0268] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0269] In current retail store systems, users often spend a lot of time selecting their desired communication plan and devices, increasing user stress and the burden on sales staff. Furthermore, suggestions are not made that take into account the user's emotional state, making it difficult for users to obtain appropriate information.

[0270] The identification processing by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes input means for inputting the communication plan desired by the user, the device under consideration, and the content to be used; calculation means for receiving user input and emotion data transmitted from the input means and generating a proposal for the optimal communication plan and device based on the user's wishes and emotional state; and display means for receiving the proposal transmitted from the calculation means and displaying it to the user. As a result, the user can quickly obtain the optimal proposal and make a choice with confidence through detailed explanations based on their emotional state. Furthermore, the burden on store sales staff is reduced, and efficient customer service is realized.

[0271] A "user" refers to a consumer who utilizes the system and provides information regarding the selection of communication plans, devices, and content.

[0272] A "communication plan" refers to the pricing structure and service details for data communication and calls that a user contracts for and uses.

[0273] "Device" is a general term for communication equipment and related devices used by users, including smartphones and tablets.

[0274] "Content" refers to applications and services that users access through their devices, including streaming services and games.

[0275] "Input means" refers to methods and devices for users to input their desired communication plans, devices, and content, including terminals installed in stores.

[0276] "Calculation means" refers to a processing device or algorithm for analyzing information and emotion data input from a user and generating an optimal proposal.

[0277] "Display means" refers to a device or method for visually presenting the proposal result generated by the calculation means to the user.

[0278] "Emotion data" refers to information related to the emotional state analyzed from the user's expression, voice tone, etc.

[0279] "Proposal" refers to the selection result of an optimal communication plan and device generated based on the user's wishes and emotional state.

[0280] The present invention relates to a system for improving the efficiency of terminal sales and communication plan proposals in a store and making more appropriate proposals based on the emotional state of the user. This system includes an input means for the user to input a communication plan, device, and content to be used, a calculation means for receiving and analyzing the input data and emotion data from the user and generating an optimal proposal, and a display means for displaying the proposal to the user.

[0281] System configuration

[0282] Hardware configuration

[0283] As the input means, a tablet terminal or a personal computer installed in the store is used. A form screen for the user to input a communication plan, device, and content to be used is displayed on this.

[0284] The emotion engine refers to a device that uses the camera and microphone of the terminal to analyze the user's expression and voice tone in real time.

[0285] As the calculation means, a high-performance server is used, which is responsible for complex data analysis and execution of the generated AI model.

[0286] As display means, the user's terminal screen, digital signage in the store, etc. are used.

[0287] Software Configuration

[0288] The front-end part is configured using HTML, CSS, and JavaScript (registered trademark) to provide a user interface.

[0289] The back-end part is configured using Python, Node.js, etc., and receives user input, executes data analysis, and calls the generated AI model.

[0290] The emotion engine utilizes a machine learning model (e.g., using TensorFlow or PyTorch) to analyze the user's emotional state in real time.

[0291] The generated AI model is used to generate detailed proposals for plan and device selection.

[0292] Specific Operations

[0293] The user operates the store terminal and enters the desired communication plan (e.g., "unlimited data plan"), device (e.g., "latest smartphone"), and content to be used (e.g., "streaming, games"). The terminal transmits this input data along with emotion data (e.g., "uneasy") analyzed from the user's expression and voice to the server.

[0294] The server receives these data and first selects the optimal communication plan and device based on the user's wishes. Next, it utilizes the generated AI model to generate a detailed explanation considering the user's emotional state. For example, a proposal such as "Since the data is unlimited, you can enjoy streaming and games comfortably. 24-hour support will be provided even after signing the contract" is generated.

[0295] The generated suggestions are sent back from the server to the terminal and displayed to the user. Based on this information, the user can confidently select a communication plan and device.

[0296] Explanation of specific examples

[0297] For example, if person B is considering a new smartphone and an unlimited data plan but is hesitant to purchase it, the following process will occur:

[0298] 1. Person B enters "unlimited data plan," "latest smartphone," and "streaming, games" into the store terminal screen.

[0299] 2. The emotion engine analyzes Person B's facial expressions and voice tone and detects the emotion data of "anxiety."

[0300] 3. The device sends input data and emotion data to the server.

[0301] 4. The server analyzes user input and selects the optimal communication plan and device.

[0302] 5. The server uses an AI model to generate suggestions with detailed explanations. For example, a suggestion might be: "An unlimited data plan and the latest smartphone are ideal. With unlimited data, you can comfortably enjoy streaming and gaming. We also provide 24-hour support after signing up so you can use it without any worries."

[0303] 6. The server sends this proposal result to the terminal.

[0304] 7. The device displays the proposed results to person B. Person B can make a selection with confidence through the detailed explanations.

[0305] Example of a prompt

[0306] The following is an example of a prompt to input into a generative AI model:

[0307] Based on the desired communication plan, device, content information entered by the user on the store terminal, and the analysis results of the emotion engine, please generate a proposal for the optimal plan and device. If the user looks anxious, please add a detailed explanation.

[0308] Input information:

[0309] Plan: Unlimited data plan

[0310] Device: Latest smartphone

[0311] Content: Streaming, games

[0312] Emotion: Anxious

[0313] With the system configured in this way, the user can obtain quick and appropriate proposals. By providing detailed explanations based on the emotional state, the user can make a choice with confidence. As a result, the store side can also conduct sales activities efficiently.

[0314] The flow of the specific process in Example 2 will be described using FIG. 13.

[0315] Step 1:

[0316] The user operates the store terminal and enters the desired communication plan, device, and content to be used. Specifically, information such as "unlimited data plan", "latest smartphone", and "streaming, games" is entered into the form displayed on the terminal screen, and the send button is pressed. The input data is saved in the terminal, and at the same time, the terminal uses the built-in camera and microphone to analyze the user's expression and voice by the emotion engine to obtain emotion data such as anxiety and satisfaction.

[0317] Input: The communication plan, device, content information entered by the user, and the user's expression and voice data

[0318] Output: User preference data and sentiment data

[0319] Step 2:

[0320] The device transmits user input data and sentiment data to the server. Specifically, it uses a communication module within the device to transmit data via a secure communication protocol such as HTTPS. This data includes the desired communication plan, device, content information, and sentiment data analyzed by the sentiment engine.

[0321] Input: Communication plan, device, content information, and sentiment data obtained from the user.

[0322] Output: User input and sentiment data sent to the server

[0323] Step 3:

[0324] The server receives user input data and sentiment data transmitted from the terminal. First, the server processes the user's desired communication plan, device, and content information using an analysis algorithm, and selects the communication plan and device that best suit the user's needs.

[0325] Input: Communication plan, device, content information, and sentiment data sent from the device.

[0326] Output: Selection results for the optimal communication plan and devices.

[0327] Step 4:

[0328] The server analyzes the emotion engine data and generates suggestions using a generative AI model. You construct a prompt for the generative AI model, inputting it in the format of "Plan: Unlimited data plan, Device: Latest smartphone, Content: Streaming, Games, Emotion: Anxiety." The generative AI model then generates detailed suggestions and explanations.

[0329] Input: Selection results for optimal communication plan and device, sentiment data

[0330] Output: Detailed suggestions that take into account the user's emotional state.

[0331] Step 5:

[0332] The server generates proposal results, which are then compiled into data packets and securely transmitted to the terminal. This also uses communication protocols such as HTTPS.

[0333] Input: Generated proposal content

[0334] Output: Proposal results sent to the terminal

[0335] Step 6:

[0336] The device analyzes the suggestion result data packets received from the server and displays them appropriately on the user interface. Specifically, the suggestion content is formatted in an easy-to-read way on the screen, and detailed explanations such as "An unlimited data plan and the latest smartphone are ideal. With unlimited data, you can comfortably enjoy streaming and gaming. We also provide 24-hour support after the contract is signed so you can use it without worry" are displayed.

[0337] Input: Suggestion result data packet received from the server

[0338] Output: Optimal plan and device suggestions displayed to the user.

[0339] Step 7:

[0340] Users review the suggested options displayed on their devices and select the most suitable communication plan and device. Specifically, users review the displayed information and make their selections after they are satisfied with the results. This allows users to confidently choose a plan and device that meets their needs.

[0341] Input: Suggestions displayed on the device

[0342] Output: User's final selection

[0343] (Application Example 2)

[0344] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0345] Traditional in-store terminal sales and plan proposal systems had the problem of a complex user selection process, which often led to user anxiety and confusion. Furthermore, because proposals were generated solely based on user input, it was difficult to provide appropriate suggestions that took the user's emotional state into consideration. This could lead to decreased user satisfaction and reduced sales efficiency.

[0346] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes terminal means for the user to input their desired plan, terminal under consideration, and content they wish to use; server means for receiving user input transmitted from the terminal means and generating optimal plan and terminal suggestions based on the user input; display means for receiving suggestions transmitted from the server means and displaying them to the user; and emotion analysis means for analyzing the user's facial expressions and voice tone and recognizing their emotional state. This makes it possible to propose more appropriate plans and terminals based on the user's emotional state, reducing user anxiety and confusion, and improving user satisfaction and sales efficiency.

[0347] "A device for users to input their desired plan, devices under consideration, and content they wish to use" refers to a device for users to input their specific needs, such as a smartphone or tablet.

[0348] "Server means for receiving user input transmitted from the terminal means and generating optimal plan and terminal suggestions based on the user input" refers to a computer system that receives information entered by the user, analyzes that information, and automatically calculates and generates the most suitable suggestions.

[0349] "Display means for receiving and displaying suggestions transmitted from the server means to the user" refers to a device for displaying the suggestion results from the server to the user in a visually and easily understandable manner, and includes displays and monitors.

[0350] "An emotion analysis method that analyzes a user's facial expressions and voice tone to recognize their emotional state" is a technology that uses a camera and microphone to collect a user's facial expressions and voice tone, analyzes them, and identifies the emotional state the user is experiencing.

[0351] This invention relates to a system that streamlines the process of terminal sales and plan proposals in stores and provides more appropriate suggestions based on the user's emotional state. This system comprehensively covers each stage of user input, emotion analysis, suggestion generation, and display.

[0352] 1. Structure

[0353] This system includes the following main components:

[0354] Terminal device: This is the device used by the user to input their desired plan, device under consideration, and content they wish to use. Smartphones and tablets are commonly used as terminal devices.

[0355] Server: A computing system that receives user input transmitted from the terminal and generates optimal plan and terminal suggestions based on that information. The server executes AI algorithms that analyze user data and sentiment data.

[0356] Display means: A device that visually displays suggestions sent from the server means to the user. The display of the terminal means is used as the display means.

[0357] Emotion analysis method: This is a technology for recognizing an emotional state by analyzing the user's facial expressions and voice tone. Specifically, it uses a camera and microphone and the "DeepFace" library.

[0358] 2. Program Processing Flow

[0359] 1. User input:

[0360] Users input their desired plan, the device they are considering, and the content they want to use using their device. For example, they might enter information such as "unlimited data plan," "latest smartphone," and "streaming, games" into the input form.

[0361] 2. Emotion analysis:

[0362] As the user inputs data, the camera and microphone are used to collect the user's facial expressions and voice tone in real time. This data is then analyzed using the "DeepFace" library to recognize the user's emotional state (e.g., anxiety, joy).

[0363] 3. Data transmission:

[0364] The terminal device transmits user input data and sentiment data to the server device. This series of data is sent to the server via an API.

[0365] 4. Proposal generation:

[0366] The server analyzes the received user input data and sentiment data, and executes an algorithm to select the optimal plan and terminal combination. If the sentiment data indicates anxiety, adjustments such as adding detailed explanations are made.

[0367] 5. Suggestion display:

[0368] The suggestions generated by the server are sent back to the terminal and displayed to the user. The user can view detailed suggestions and explanations.

[0369] 3. Usage example

[0370] User prompt message:

[0371] "I have a dark green smartphone and I'm looking for a plan that allows unlimited data usage when exchanging contacts. I've also been enjoying a lot of movies and games lately."

[0372] Based on this prompt, the system will make appropriate suggestions.

[0373] 4. Hardware and Software

[0374] Hardware:

[0375] Smartphones and tablets (devices and display devices)

[0376] Camera and microphone (means of sentiment analysis)

[0377] software:

[0378] Requests library (data transmission)

[0379] DeepFace Library (emotion analysis)

[0380] Server-side AI algorithm (proposal generation)

[0381] In this way, the present invention can efficiently propose optimal plans and devices based on the user's emotional state, thereby improving user satisfaction and sales efficiency.

[0382] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0383] Step 1:

[0384] The user enters their desired plan, device under consideration, and content they wish to use using their device. The information entered by the user (e.g., "unlimited data plan," "latest smartphone," "streaming, games") is collected from the input form on the device. The entered data is then prepared for transmission, reflecting the user's specific preferences.

[0385] Step 2:

[0386] The device collects the user's facial expressions and voice tone using the camera and microphone as the user inputs data. Emotional data is acquired in real time and analyzed using the DeepFace library. As a result of the analysis, the user's emotional state (e.g., anxiety, joy) is recognized. This process provides data on the user's psychological state.

[0387] Step 3:

[0388] The device sends user input data and sentiment data to the server. The data sent via the API includes the user's specific preferences and sentiment analysis results. This allows the server to receive comprehensive user information.

[0389] Step 4:

[0390] The server analyzes the received user input data and selects the optimal plan and device that best suits the user's preferences. The analysis algorithm simultaneously evaluates the user's preferences and emotional state to generate the most suitable recommendations. If the emotional data indicates anxiety, adjustments are made to generate recommendations that include detailed explanations.

[0391] Step 5:

[0392] The server sends the generated proposal results to the terminal. The sent proposal results include details about the selected plan and terminal. Additional information and explanations that correspond to the user's emotional state are also added.

[0393] Step 6:

[0394] The terminal displays the suggested results received from the server to the user. The suggested results displayed on the screen are visually arranged for easy understanding by the user and presented with detailed explanations. This display allows the user to confidently make the choice that best suits their needs.

[0395] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0396] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0397] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0398] [Second Embodiment]

[0399] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0400] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0401] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0402] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0403] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0404] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0405] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0406] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0407] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0408] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0409] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0410] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0411] This invention relates to a system for streamlining the process of terminal sales and plan proposals in stores. The system includes terminal means for users to input their desired plan, terminal, and content, and server means for receiving the input information and generating optimal plan and terminal proposals. It also includes display means for receiving the proposals generated by the server means and displaying them to the user.

[0412] Program processing

[0413] User processing

[0414] Users access a form displayed on a terminal in the store and enter their desired plan, the device they are considering, and the content they want to use. For example, they might enter information such as "unlimited data plan," "latest smartphone," and "streaming, games." The terminal receives this information and sends the input data to the server.

[0415] Terminal processing

[0416] The terminal not only transmits user input to the server but also receives optimal plans and terminal suggestions from the server. Upon receiving suggestions from the server, the terminal displays the results to the user. This allows the user to obtain information quickly and accurately.

[0417] Server Processing

[0418] The server receives user input sent from the terminal device. This received data is analyzed, and an algorithm is executed to select the optimal plan and device according to the user's preferences. Specifically, if the user wants an "unlimited data plan," the algorithm selects a communication contract that provides an unlimited data plan; if the user is considering a "latest smartphone," it selects the optimal device to support that.

[0419] The server then sends back the optimal plan and terminal suggestion generated in this manner to the terminal device.

[0420] Explanation of specific examples

[0421] For example, if person A is considering a new smartphone and an unlimited data plan, the following process will occur:

[0422] 1. The user (Person A) enters "unlimited data plan," "latest smartphone," and "streaming, games" into the in-store terminal.

[0423] 2. The terminal sends this input data to the server.

[0424] 3. The server analyzes user input and selects the most suitable plan from the "unlimited data plans" and the most suitable device from the "latest smartphones."

[0425] 4. The server sends back the selected plan and terminal proposal results to the terminal.

[0426] 5. The terminal displays the proposal results sent from the server to person A.

[0427] In this way, users can quickly receive proposals for the optimal plan and device that meets their needs, so store staff only need to provide supplementary explanations based on the user's needs, which can significantly reduce the time spent with customers.

[0428] The above describes the configuration for implementing the system of the present invention. This system can improve customer satisfaction and increase sales efficiency by quickly and accurately proposing the optimal plan and terminal based on user input.

[0429] The following describes the processing flow.

[0430] Step 1:

[0431] Users access in-store terminals and enter their desired plan, device under consideration, and content they wish to use. Specifically, they enter information such as "unlimited data plan," "latest smartphone," and "streaming and games" into the form.

[0432] Step 2:

[0433] The terminal sends information entered by the user to the server. This includes formatting the input data and sending the data according to the transmission protocol.

[0434] Step 3:

[0435] The server receives user input data sent from the terminal. This allows the server to retrieve data regarding the user's preferences and requirements.

[0436] Step 4:

[0437] The server analyzes the user's input data received. Specifically, it analyzes the data to extract information about the desired plan, the device under consideration, and the content the user wants to use.

[0438] Step 5:

[0439] Based on the analysis results, the server selects the plan that best suits the user's desired conditions. For example, for a user who requests an "unlimited data plan," the server matches and selects the applicable plan.

[0440] Step 6:

[0441] Based on the analysis results, the server selects the most suitable device for the user's needs. For example, for a user considering the "latest smartphone," it selects the latest and best-performing device on the market.

[0442] Step 7:

[0443] The server generates a suggestion for the optimal plan and device. The generated suggestion includes specific information about the selected plan and device.

[0444] Step 8:

[0445] The server generates a proposal and sends it to the terminal. The proposal is formatted and sent to the terminal quickly.

[0446] Step 9:

[0447] The device receives a proposal sent from the server. The received proposal includes the optimal plan and device information based on the conditions entered by the user.

[0448] Step 10:

[0449] The device displays the suggested results it has received to the user. Specifically, the screen shows detailed information about the best plan and device.

[0450] Step 11:

[0451] The user reviews the displayed suggestions and, if necessary, asks the sales associate for further explanation. The sales associate then provides prompt and accurate supplementary explanations based on the suggestions.

[0452] This series of processing steps allows users to quickly find the optimal plan and device, and enables sales staff to provide efficient customer service.

[0453] (Example 1)

[0454] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0455] In traditional retail store sales and plan proposals, users often spent a significant amount of time trying to find the best plan and device for them, frequently receiving conflicting explanations from multiple sales representatives. This led to decreased user satisfaction, longer waiting times in stores, and reduced sales efficiency. Furthermore, understanding complex plan and device information required specialized knowledge, and without it, there was a risk of making the wrong choice.

[0456] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0457] In this invention, the server includes an information processing device for the user to input their desired contract, equipment under consideration, and functions they wish to use; a computing device for receiving user input transmitted from the information processing device and generating optimal contract and equipment suggestions based on the user input; and a display device for receiving suggestions transmitted from the computing device and displaying them to the user. This enables the user to receive prompt and accurate suggestions for the optimal plan and equipment.

[0458] A "user" refers to an individual or legal entity that uses this system to input their desired contract, equipment under consideration, and desired functions.

[0459] "Contract" refers to the agreement for the use of communication plans, data plans, and other services that the user desires.

[0460] "Equipment" refers to the electronic devices and hardware that the user is considering.

[0461] "Function" refers to the purpose of use of content, applications, etc., that a user wishes to use.

[0462] An "information processing device" refers to a terminal device used by users to input their desired contract, equipment under consideration, and desired functions.

[0463] A "computation device" refers to a server that receives user input transmitted from an information processing device and generates optimal contract and equipment proposals based on that data.

[0464] A "display device" refers to a device that receives suggestions transmitted from a computing device and displays them to the user.

[0465] "User input" refers to information entered by the user via an information processing device regarding contract preferences, equipment under consideration, and desired functions.

[0466] "Proposal" refers to the optimal combination of contracts and equipment for the user, as generated by the computing device.

[0467] "Transmission" refers to the act of transferring data to another device in the exchange of information.

[0468] "Receiving" refers to the act of receiving data transmitted from another device.

[0469] This invention relates to a system for streamlining the contract sales and plan proposal processes in retail stores. The system includes an information processing device for users to input their desired contracts, equipment, and functions, and a computing device to receive this input information and generate optimal contract and equipment proposals. It also includes a display device that receives the proposals generated by the computing device and displays them to the user.

[0470] User processing

[0471] Users access an information processing device installed in the store and enter their desired contract, equipment under consideration, and desired functions into the displayed form. For example, they might enter information such as "unlimited data plan," "latest smartphone," and "streaming and gaming." The input data is received by the information processing device and transmitted to the computer.

[0472] Terminal processing

[0473] The terminal (information processing device) not only transmits user input data to the computing device, but also receives optimal contract and equipment suggestions from the computing device. Upon receiving suggestions from the computing device, the terminal displays the results to the user. This allows the user to obtain information quickly and accurately.

[0474] Server (Computer) Processing

[0475] The server (computer) receives user input data sent from the terminal. Next, an algorithm is executed to analyze the received data and select the optimal contract and equipment according to the user's preferences. Specifically, if the user wants an "unlimited data plan," the server selects a communication contract that provides an unlimited data plan; if the user is considering a "latest smartphone," the server selects the optimal device to support it. The selected optimal contract and equipment proposal is then sent back from the server to the terminal.

[0476] Explanation of specific examples

[0477] For example, if user A is considering a new smartphone and an unlimited data plan, the following process will occur:

[0478] 1. User (Person A) enters "unlimited data plan," "latest smartphone," and "streaming, games" into the terminal in the store.

[0479] 2. The terminal sends this input data to the server.

[0480] 3. The server analyzes user input and selects the most suitable plan from the "unlimited data plans" and the most suitable device from the "latest smartphones."

[0481] 4. The server sends back the selected plan and terminal proposal results to the terminal.

[0482] 5. The terminal displays the proposal results sent from the server to person A.

[0483] Example of a prompt

[0484] When using a generative AI model to request a detailed explanation of this system, you can use prompt statements like the following:

[0485] Please describe in detail the system for streamlining the contract sales and plan proposal processes in stores, including the information entered by users, terminal processing, and server-based analysis and proposal processes. Furthermore, please explain the specific benefits this system offers and the hardware and software used.

[0486] The above describes the configuration for implementing the system of the present invention. This system can improve customer satisfaction and increase sales efficiency by quickly and accurately proposing the most suitable contracts and equipment based on user input.

[0487] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0488] Step 1: The user enters their desired information.

[0489] Users access an information processing device installed in the store and enter their desired contract, equipment under consideration, and desired functions into the displayed form. Specifically, they enter information such as "unlimited data plan," "latest smartphone," and "streaming and gaming" using touch controls or a keyboard. Once the entered data is confirmed, the submit button is pressed.

[0490] Input: User's preferences (contract, equipment, functions)

[0491] Output: Input data (contract, equipment, and function information)

[0492] Specific actions:

[0493] The user enters their desired information into the form and presses the submit button.

[0494] Step 2: The device sends data to the server.

[0495] The terminal temporarily stores the input data obtained from the user in memory and sends the data to the server using network communication. Specifically, the data is transferred to the server via an HTTP request.

[0496] Input: Input data (contract, equipment, and function information)

[0497] Output: Data sent to the server

[0498] Specific actions:

[0499] The terminal saves the input data to memory, generates an HTTP request, and sends it.

[0500] Step 3: The server receives and analyzes the data.

[0501] The server receives user input data sent from the terminal. The received data is first stored in the database, and data validation (checking for correctness) is performed as needed.

[0502] Input: User input data

[0503] Output: Analyzed data

[0504] Specific actions:

[0505] The server receives an HTTP request and parses and stores the data that has been sent.

[0506] Perform validation to confirm the validity of the data.

[0507] Step 4: The server selects the optimal plan and equipment.

[0508] The server executes an algorithm that selects the optimal contract and equipment according to the user's preferences based on the stored data. Specifically, it compares contract and equipment information in the database and selects the most suitable plan.

[0509] Input: Analyzed data

[0510] Output: Information on the selected optimal contracts and equipment.

[0511] Specific actions:

[0512] The server executes an algorithm and selects the optimal plan and equipment based on the information in the database.

[0513] Step 5: The server sends the proposal back to the terminal.

[0514] The server sends back a proposal for the most suitable contract and equipment selected by the terminal. The output data is converted by the server into HTML or JSON format and sent to the terminal as an HTTP response.

[0515] Input: Information on selected contracts and equipment

[0516] Output: Proposal data sent to the terminal

[0517] Specific actions:

[0518] The server converts the proposed data into a format and sends it to the terminal as an HTTP response.

[0519] Step 6: The device displays a suggestion.

[0520] The terminal analyzes the suggestion data received from the server and displays it to the user. This allows the user to view suggestions for the most suitable contract plan and equipment.

[0521] Input: Proposal data sent from the server

[0522] Output: Suggestion results displayed to the user

[0523] Specific actions:

[0524] The device analyzes the suggested data and displays the information on the screen. For example, it might show the user "unlimited data plan" and "latest smartphone."

[0525] The above outlines the specific processing steps of the system program. This process allows users to receive prompt, accurate, and optimal contract and equipment recommendations.

[0526] (Application Example 1)

[0527] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0528] In traditional retail store sales and plan proposal processes, users had to compare multiple options and gather a lot of information through conversations with sales staff in order to find the best plan and device that suited their needs. This cumbersome process led to decreased user satisfaction and reduced sales efficiency. Furthermore, the process for users to make immediate purchases or reservations was complicated, making quick decision-making difficult.

[0529] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0530] In this invention, the server includes input means for inputting the user's desired data plan, terminal under consideration, and content to be used; analysis means for receiving user input transmitted from the input means and generating optimal plan and terminal suggestions based on the user input; display means for receiving suggestions transmitted from the analysis means and displaying them to the user; and purchase support means for performing purchase procedures or reservations for the suggested plan and terminal if desired by the user. This enables the user to quickly and accurately receive optimal plan and terminal suggestions, and to smoothly perform purchase procedures or reservations on the spot.

[0531] A "user" is someone who uses the system to receive suggestions for their desired data plan, device, and content.

[0532] A "data plan" is a pricing plan for communication services and data usage that a user contracts for.

[0533] A "device" refers to a smartphone, tablet, or other device that the user is considering purchasing.

[0534] "Content" refers to digital services and applications such as streaming services and games that users want to use.

[0535] "Input means" refers to a device or interface in which the user inputs information about their desired data plan, device, and content.

[0536] "Analysis means" refers to a system or algorithm that receives user input transmitted from an input means, analyzes that information, and generates optimal plan and terminal suggestions.

[0537] "Display means" refers to a device or interface for displaying the suggested results transmitted from the analysis means to the user.

[0538] "Purchase support means" refers to a system or interface that allows users to purchase or reserve proposed plans and devices if they so desire.

[0539] This invention provides a system for streamlining terminal sales and plan proposals in physical stores. Based on user input, it makes optimal suggestions, displays them, and supports the purchase procedure as needed. This system mainly consists of input means, analysis means, display means, and purchase support means.

[0540] 1. System Configuration

[0541] Input means

[0542] Users use a smartphone app to input their desired data plan, the device they are considering, and the content they want to use. This input method is software that provides a user interface, designed to allow users to intuitively input information.

[0543] Analysis means

[0544] The smartphone app sends user input to a server. This server utilizes a cloud-based analysis system (e.g., AWS Lambda) to receive the transmitted data and use a generated AI model and an existing database to select the best plan and device for the user's needs. This analysis process uses software such as Python and TensorFlow.

[0545] Display means

[0546] The suggestions sent from the server are returned to the smartphone app and displayed to the user. The user reviews the displayed suggestions, and if they are satisfied with the content, they can proceed to the next step.

[0547] Purchase support methods

[0548] If a user wishes to purchase or reserve based on the suggestions, the smartphone app will support the purchase process. This method is linked to electronic payment and reservation systems, helping users complete the process smoothly.

[0549] 2. Explanation of Program Processing

[0550] Server Processing

[0551] When the server receives user input data, it analyzes the data using a generative AI model. This analysis employs an algorithm that derives the optimal combination of the user's desired data plan, devices under consideration, and content they wish to use. As a result, the server generates a suggestion of the plan and device that best matches the user's desired conditions.

[0552] Terminal processing

[0553] When the smartphone app receives a suggestion, it displays the details to the user. The user can review the suggested plan and device and make a selection based on the content they want to use. If necessary, they can proceed directly to purchase or reserve the suggested items within the app.

[0554] 3. Explanation of specific examples

[0555] For example, if a user wants an "unlimited data plan," a "latest smartphone," and "video streaming," enter the following prompt message.

[0556] Example of a prompt:

[0557] Please enter your desired data plan: Unlimited Data Plan

[0558] Please enter the device you are considering: Latest smartphone

[0559] Please enter the content you wish to use: Video viewing

[0560] When a user enters this prompt, the analysis system proposes and displays the most suitable plan and device based on that input. If the user is satisfied with the proposal, they can proceed with the purchase or reservation on the spot, enabling quick and efficient service delivery.

[0561] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0562] Step 1:

[0563] User input

[0564] The user opens the smartphone app and enters their desired data plan, the device they are considering, and the content they want to use. Specifically, the user enters information such as "unlimited data plan," "latest smartphone," and "video viewing" into the input form. This quantifies the user's needs and generates data that forms the basis for analysis in the next step.

[0565] Input: User's preferred data plan, device, and content information.

[0566] Output: User input data

[0567] Step 2:

[0568] Sending input data

[0569] The device sends the data entered by the user to a cloud server. Specifically, this involves the application's backend sending this input data to an analysis system in the cloud via an API.

[0570] Input: User input data

[0571] Output: Input data sent to the cloud server

[0572] Step 3:

[0573] Data analysis

[0574] The server analyzes the received user input data using a generating AI model and database. This allows for calculations to select the optimal data plan and device that meet the user's needs. Specifically, the previously trained AI model uses this dataset to generate a list of relevant data plans and devices.

[0575] Input: User input data sent to the cloud server

[0576] Output: Suggestions for the optimal data plan and device for the user.

[0577] Step 4:

[0578] Generation of proposal results

[0579] The server generates suggestions for the user based on the analysis results. These suggestions include the optimal data plan and device combination, and are provided in a way that best suits the user's needs. Here, software such as Python and TensorFlow are used to generate the suggestion results.

[0580] Input: Suggesting the optimal data plan and device for the user.

[0581] Output: Specific proposal details (list of optimal data plans and devices)

[0582] Step 5:

[0583] Submission of proposal results

[0584] The server sends the generated suggestion results to the terminal. Specifically, this involves a process where the suggestion data generated on the server side is returned to the user's smartphone via an API.

[0585] Input: Specific proposal details (list of optimal data plans and devices)

[0586] Output: Proposal results sent to the user terminal

[0587] Step 6:

[0588] Display of proposal results

[0589] The device receives the suggested results sent from the server and displays them to the user. Specifically, the suggested content is displayed in a rich format (e.g., list format or card format) through the user interface of the smartphone app.

[0590] Input: Suggestion results received from the server

[0591] Output: Suggestions displayed in the user interface

[0592] Step 7:

[0593] Support for the purchase process

[0594] If a user wishes to purchase or reserve an item based on a suggestion, the terminal provides an interface to assist with the purchase process. Specifically, it integrates with electronic payment and reservation systems, implementing a workflow that allows users to complete the process smoothly.

[0595] Input: User's intention to purchase or reserve

[0596] Output: Completed purchase or reservation information

[0597] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0598] This invention relates to a system that streamlines the process of terminal sales and plan proposals in stores and provides more appropriate suggestions based on the user's emotional state. The system includes terminal means for the user to input their desired plan, terminal, and content, and server means for receiving the input information and generating optimal plan and terminal suggestions. It also includes display means for receiving the suggestions generated by the server means and displaying them to the user, and further includes an emotion engine that recognizes the user's emotions.

[0599] Program processing

[0600] User processing

[0601] Users access a terminal in the store and enter their desired plan, the device they are considering, and the content they want to use. For example, they might enter information such as "unlimited data plan," "latest smartphone," and "streaming, games" into the form. The terminal receives this information and sends it to the server.

[0602] Terminal processing

[0603] The terminal transmits user input data to the server, along with data from the emotion engine. Upon receiving the optimal plan and terminal suggestions from the server, the results are displayed to the user. This allows the user to obtain information quickly and accurately.

[0604] Server Processing

[0605] The server receives user input data and emotion engine data transmitted from the terminal device. It analyzes the received data and executes an algorithm to select the optimal plan and terminal based on the user's preferences. Furthermore, it adjusts the suggested content and display method, taking into account the user's emotional state detected by the emotion engine. For example, if the user appears anxious, it will provide suggestions that include more detailed explanations.

[0606] Explanation of specific examples

[0607] For example, if person B is considering a new smartphone and an unlimited data plan but is feeling anxious, the following process will occur:

[0608] 1. User (Person B) enters "unlimited data plan," "latest smartphone," and "streaming, games" into the in-store terminal.

[0609] 2. The emotion engine analyzes Person B's facial expressions and voice tone to detect feelings of anxiety.

[0610] 3. The device sends input data and emotion data to the server.

[0611] 4. The server analyzes user input and selects the most suitable plan from the "unlimited data plans" and the most suitable device from the "latest smartphones."

[0612] 5. The server generates the selected plan and terminal suggestions, providing them with detailed explanations that take into account the user's concerns.

[0613] 6. The server sends the proposal to the terminal.

[0614] 7. The terminal displays the suggested results sent from the server to Person B. The displayed content includes detailed explanations and additional information to alleviate user anxiety.

[0615] This series of processing steps allows users to quickly receive optimal plan and device suggestions tailored to their preferences, as well as be provided with appropriate information based on their emotional state, enabling them to make choices with confidence. As a result, in-store sales staff only need to provide supplementary explanations based on the user's needs, significantly reducing the time spent with customers.

[0616] The following describes the processing flow.

[0617] Step 1:

[0618] Users access in-store terminals and enter their desired plan, device under consideration, and content they wish to use. Specifically, they enter information such as "unlimited data plan," "latest smartphone," and "streaming and games" into the form.

[0619] Step 2:

[0620] The device receives user input information and sends it to the server. Additionally, the device's emotion engine analyzes the user's facial expressions and voice tone to generate emotion data, which is also sent to the server.

[0621] Step 3:

[0622] The server receives user input data and emotion data sent from the terminal. This allows the server to acquire data regarding the user's preferences, conditions, and emotional state.

[0623] Step 4:

[0624] The server analyzes user data, extracting information about the desired plan, devices under consideration, and content the user wants to use from the input data. It also analyzes sentiment data simultaneously.

[0625] Step 5:

[0626] Based on the analysis results, the server selects the plan that best suits the user's desired conditions. For example, for a user who requests an "unlimited data plan," the server matches and selects the applicable plan.

[0627] Step 6:

[0628] Based on the analysis results, the server selects the most suitable device for the user's needs. For example, for a user considering the "latest smartphone," it selects the latest and best-performing device on the market.

[0629] Step 7:

[0630] The server takes emotional data into account and adjusts the suggestions accordingly. For example, if the user is feeling anxious, it will generate suggestions that include detailed explanations.

[0631] Step 8:

[0632] The server generates optimal plan and device suggestions. These suggestions include specific information about the selected plan and device, as well as adjustments based on sentiment data.

[0633] Step 9:

[0634] The server generates a proposal and sends it to the terminal. The proposal is formatted and sent to the terminal quickly.

[0635] Step 10:

[0636] The device receives a suggestion sent from the server. The received suggestion includes the optimal plan based on the conditions entered by the user, device information, and adjustments based on sentiment data.

[0637] Step 11:

[0638] The device displays the suggested results to the user. Specifically, the screen shows detailed information about the best plan and device, along with explanations based on sentiment data.

[0639] Step 12:

[0640] The user reviews the displayed suggestions and, if necessary, asks the sales associate for further explanation. The sales associate then provides prompt and accurate supplementary explanations based on the suggestions.

[0641] This series of processing steps allows users to quickly find the optimal plan and device that matches their preferences, and to make informed choices with confidence as they are provided with appropriate information tailored to their emotional state. This enables sales staff to provide effective supplementary explanations based on the user's needs, significantly reducing customer service time.

[0642] (Example 2)

[0643] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0644] In current retail store systems, users often spend a lot of time selecting their desired communication plan and devices, increasing user stress and the burden on sales staff. Furthermore, suggestions are not made that take into account the user's emotional state, making it difficult for users to obtain appropriate information.

[0645] The identification processing by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes input means for inputting the communication plan desired by the user, the device under consideration, and the content to be used; calculation means for receiving user input and emotion data transmitted from the input means and generating a proposal for the optimal communication plan and device based on the user's wishes and emotional state; and display means for receiving the proposal transmitted from the calculation means and displaying it to the user. As a result, the user can quickly obtain the optimal proposal and make a choice with confidence through detailed explanations based on their emotional state. Furthermore, the burden on store sales staff is reduced, and efficient customer service is realized.

[0646] A "user" refers to a consumer who utilizes the system and provides information regarding the selection of communication plans, devices, and content.

[0647] A "communication plan" refers to the pricing structure and service details for data communication and calls that a user contracts for and uses.

[0648] "Device" is a general term for communication equipment and related devices used by users, including smartphones and tablets.

[0649] "Content" refers to applications and services that users access through their devices, including streaming services and games.

[0650] "Input means" refers to methods and devices for users to input their desired communication plans, devices, and content, including terminals installed in stores.

[0651] "Computational means" refers to processing devices and algorithms that analyze information and emotional data input by users and generate optimal suggestions.

[0652] "Display means" refers to a device or method that visually presents the proposed results generated by the calculation means to the user.

[0653] "Emotional data" refers to information about a user's emotional state, analyzed from their facial expressions, voice tone, and other factors.

[0654] "Recommendation" refers to the selection of the optimal communication plan and device, generated based on the user's preferences and emotional state.

[0655] This invention relates to a system that streamlines terminal sales and communication plan proposals in stores and provides more appropriate suggestions based on the user's emotional state. The system includes input means for inputting the communication plan, device, and content the user wants to use; calculation means for receiving and analyzing user input data and emotional data to generate optimal suggestions; and display means for displaying the suggestions to the user.

[0656] System Configuration

[0657] Hardware configuration

[0658] The input method will be a tablet or computer installed in the store. This will display a form screen where the user can input their desired communication plan, device, and the content they wish to use.

[0659] An emotion engine refers to a device that uses the device's camera and microphone to analyze the user's facial expressions and voice tone in real time.

[0660] High-performance servers are used as the computing means, responsible for complex data analysis and the execution of generative AI models.

[0661] Display methods include the user's terminal screen and digital signage within the store.

[0662] Software Configuration

[0663] The front-end section is constructed using HTML, CSS, and JavaScript, and provides the user interface.

[0664] The backend is built using Python, Node.js, etc., and handles receiving user input, performing data analysis, and calling the generated AI model.

[0665] The emotion engine utilizes machine learning models (e.g., TensorFlow or PyTorch) to analyze the user's emotional state in real time.

[0666] The generative AI model is used to generate detailed suggestions for plan and device selection.

[0667] Specific actions

[0668] The user operates a terminal in the store and inputs their desired communication plan (e.g., "unlimited data plan"), device (e.g., "latest smartphone"), and the content they want to use (e.g., "streaming, games"). Along with this input data, the terminal sends emotion data (e.g., "anxiety") analyzed from the user's facial expressions and voice to the server.

[0669] The server receives this data and first selects the optimal communication plan and device based on the user's preferences. Next, it uses a generative AI model to generate detailed explanations that take into account the user's emotional state. For example, it might generate suggestions such as, "With unlimited data, you can enjoy streaming and gaming comfortably. We also provide 24-hour support after you sign up."

[0670] The generated suggestions are sent back from the server to the terminal and displayed to the user. Based on this information, the user can confidently select a communication plan and device.

[0671] Explanation of specific examples

[0672] For example, if person B is considering a new smartphone and an unlimited data plan but is hesitant to purchase it, the following process will occur:

[0673] 1. Person B enters "unlimited data plan," "latest smartphone," and "streaming, games" into the store terminal screen.

[0674] 2. The emotion engine analyzes Person B's facial expressions and voice tone and detects the emotion data of "anxiety."

[0675] 3. The device sends input data and emotion data to the server.

[0676] 4. The server analyzes user input and selects the optimal communication plan and device.

[0677] 5. The server uses an AI model to generate suggestions with detailed explanations. For example, a suggestion might be: "An unlimited data plan and the latest smartphone are ideal. With unlimited data, you can comfortably enjoy streaming and gaming. We also provide 24-hour support after signing up so you can use it without any worries."

[0678] 6. The server sends this proposal result to the terminal.

[0679] 7. The device displays the proposed results to person B. Person B can make a selection with confidence through the detailed explanations.

[0680] Example of a prompt

[0681] The following is an example of a prompt to input into a generative AI model:

[0682] Based on the user's desired communication plan and device, the content they wish to use, and the results of the emotion engine's analysis, generate a suggestion for the optimal plan and device. If the user appears anxious, add a detailed explanation.

[0683] Input information:

[0684] Plan: Unlimited Data Plan

[0685] Device: Latest smartphone

[0686] Content: Streaming, Games

[0687] Emotion: Anxiety

[0688] This system allows users to receive quick and appropriate suggestions, and by providing detailed explanations based on their emotional state, users can make choices with confidence. This also enables stores to conduct sales activities more efficiently.

[0689] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0690] Step 1:

[0691] The user operates a terminal in the store and enters their desired communication plan, device, and content to be used. Specifically, they enter information such as "unlimited data plan," "latest smartphone," and "streaming, games" into a form displayed on the terminal screen and press the submit button. The entered data is saved to the terminal, and the terminal also uses its built-in camera and microphone to analyze the user's facial expressions and voice using an emotion engine to obtain emotional data such as anxiety and satisfaction.

[0692] Input: User-entered communication plan, device, content information, and user facial expressions and voice data.

[0693] Output: User preference data and sentiment data

[0694] Step 2:

[0695] The device transmits user input data and sentiment data to the server. Specifically, it uses a communication module within the device to transmit data via a secure communication protocol such as HTTPS. This data includes the desired communication plan, device, content information, and sentiment data analyzed by the sentiment engine.

[0696] Input: Communication plan, device, content information, and sentiment data obtained from the user.

[0697] Output: User input and sentiment data sent to the server

[0698] Step 3:

[0699] The server receives user input data and sentiment data transmitted from the terminal. First, the server processes the user's desired communication plan, device, and content information using an analysis algorithm, and selects the communication plan and device that best suit the user's needs.

[0700] Input: Communication plan, device, content information, and sentiment data sent from the device.

[0701] Output: Selection results for the optimal communication plan and devices.

[0702] Step 4:

[0703] The server analyzes the emotion engine data and generates suggestions using a generative AI model. You construct a prompt for the generative AI model, inputting it in the format of "Plan: Unlimited data plan, Device: Latest smartphone, Content: Streaming, Games, Emotion: Anxiety." The generative AI model then generates detailed suggestions and explanations.

[0704] Input: Selection results for optimal communication plan and device, sentiment data

[0705] Output: Detailed suggestions that take into account the user's emotional state.

[0706] Step 5:

[0707] The server generates proposal results, which are then compiled into data packets and securely transmitted to the terminal. This also uses communication protocols such as HTTPS.

[0708] Input: Generated proposal content

[0709] Output: Proposal results sent to the terminal

[0710] Step 6:

[0711] The device analyzes the suggestion result data packets received from the server and displays them appropriately on the user interface. Specifically, the suggestion content is formatted in an easy-to-read way on the screen, and detailed explanations such as "An unlimited data plan and the latest smartphone are ideal. With unlimited data, you can comfortably enjoy streaming and gaming. We also provide 24-hour support after the contract is signed so you can use it without worry" are displayed.

[0712] Input: Suggestion result data packet received from the server

[0713] Output: Optimal plan and device suggestions displayed to the user.

[0714] Step 7:

[0715] Users review the suggested options displayed on their devices and select the most suitable communication plan and device. Specifically, users review the displayed information and make their selections after they are satisfied with the results. This allows users to confidently choose a plan and device that meets their needs.

[0716] Input: Suggestions displayed on the device

[0717] Output: User's final selection

[0718] (Application Example 2)

[0719] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0720] Traditional in-store terminal sales and plan proposal systems had the problem of a complex user selection process, which often led to user anxiety and confusion. Furthermore, because proposals were generated solely based on user input, it was difficult to provide appropriate suggestions that took the user's emotional state into consideration. This could lead to decreased user satisfaction and reduced sales efficiency.

[0721] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes terminal means for the user to input their desired plan, terminal under consideration, and content they wish to use; server means for receiving user input transmitted from the terminal means and generating optimal plan and terminal suggestions based on the user input; display means for receiving suggestions transmitted from the server means and displaying them to the user; and emotion analysis means for analyzing the user's facial expressions and voice tone and recognizing their emotional state. This makes it possible to propose more appropriate plans and terminals based on the user's emotional state, reducing user anxiety and confusion, and improving user satisfaction and sales efficiency.

[0722] "A device for users to input their desired plan, devices under consideration, and content they wish to use" refers to a device for users to input their specific needs, such as a smartphone or tablet.

[0723] "Server means for receiving user input transmitted from the terminal means and generating optimal plan and terminal suggestions based on the user input" refers to a computer system that receives information entered by the user, analyzes that information, and automatically calculates and generates the most suitable suggestions.

[0724] "Display means for receiving and displaying suggestions transmitted from the server means to the user" refers to a device for displaying the suggestion results from the server to the user in a visually and easily understandable manner, and includes displays and monitors.

[0725] "An emotion analysis method that analyzes a user's facial expressions and voice tone to recognize their emotional state" is a technology that uses a camera and microphone to collect a user's facial expressions and voice tone, analyzes them, and identifies the emotional state the user is experiencing.

[0726] This invention relates to a system that streamlines the process of terminal sales and plan proposals in stores and provides more appropriate suggestions based on the user's emotional state. This system comprehensively covers each stage of user input, emotion analysis, suggestion generation, and display.

[0727] 1. Structure

[0728] This system includes the following main components:

[0729] Terminal device: This is the device used by the user to input their desired plan, device under consideration, and content they wish to use. Smartphones and tablets are commonly used as terminal devices.

[0730] Server: A computing system that receives user input transmitted from the terminal and generates optimal plan and terminal suggestions based on that information. The server executes AI algorithms that analyze user data and sentiment data.

[0731] Display means: A device that visually displays suggestions sent from the server means to the user. The display of the terminal means is used as the display means.

[0732] Emotion analysis method: This is a technology for recognizing an emotional state by analyzing the user's facial expressions and voice tone. Specifically, it uses a camera and microphone and the "DeepFace" library.

[0733] 2. Program Processing Flow

[0734] 1. User input:

[0735] Users input their desired plan, the device they are considering, and the content they want to use using their device. For example, they might enter information such as "unlimited data plan," "latest smartphone," and "streaming, games" into the input form.

[0736] 2. Emotion analysis:

[0737] As the user inputs data, the camera and microphone are used to collect the user's facial expressions and voice tone in real time. This data is then analyzed using the "DeepFace" library to recognize the user's emotional state (e.g., anxiety, joy).

[0738] 3. Data transmission:

[0739] The terminal device transmits user input data and sentiment data to the server device. This series of data is sent to the server via an API.

[0740] 4. Proposal generation:

[0741] The server analyzes the received user input data and sentiment data, and executes an algorithm to select the optimal plan and terminal combination. If the sentiment data indicates anxiety, adjustments such as adding detailed explanations are made.

[0742] 5. Suggestion display:

[0743] The suggestions generated by the server are sent back to the terminal and displayed to the user. The user can view detailed suggestions and explanations.

[0744] 3. Usage example

[0745] User prompt message:

[0746] "I have a dark green smartphone and I'm looking for a plan that allows unlimited data usage when exchanging contacts. I've also been enjoying a lot of movies and games lately."

[0747] Based on this prompt, the system will make appropriate suggestions.

[0748] 4. Hardware and Software

[0749] Hardware:

[0750] Smartphones and tablets (devices and display devices)

[0751] Camera and microphone (means of sentiment analysis)

[0752] software:

[0753] Requests library (data transmission)

[0754] DeepFace Library (emotion analysis)

[0755] Server-side AI algorithm (proposal generation)

[0756] In this way, the present invention can efficiently propose optimal plans and devices based on the user's emotional state, thereby improving user satisfaction and sales efficiency.

[0757] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0758] Step 1:

[0759] The user enters their desired plan, device under consideration, and content they wish to use using their device. The information entered by the user (e.g., "unlimited data plan," "latest smartphone," "streaming, games") is collected from the input form on the device. The entered data is then prepared for transmission, reflecting the user's specific preferences.

[0760] Step 2:

[0761] The device collects the user's facial expressions and voice tone using the camera and microphone as the user inputs data. Emotional data is acquired in real time and analyzed using the DeepFace library. As a result of the analysis, the user's emotional state (e.g., anxiety, joy) is recognized. This process provides data on the user's psychological state.

[0762] Step 3:

[0763] The device sends user input data and sentiment data to the server. The data sent via the API includes the user's specific preferences and sentiment analysis results. This allows the server to receive comprehensive user information.

[0764] Step 4:

[0765] The server analyzes the received user input data and selects the optimal plan and device that best suits the user's preferences. The analysis algorithm simultaneously evaluates the user's preferences and emotional state to generate the most suitable recommendations. If the emotional data indicates anxiety, adjustments are made to generate recommendations that include detailed explanations.

[0766] Step 5:

[0767] The server sends the generated proposal results to the terminal. The sent proposal results include details about the selected plan and terminal. Additional information and explanations that correspond to the user's emotional state are also added.

[0768] Step 6:

[0769] The terminal displays the suggested results received from the server to the user. The suggested results displayed on the screen are visually arranged for easy understanding by the user and presented with detailed explanations. This display allows the user to confidently make the choice that best suits their needs.

[0770] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0771] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0772] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0773] [Third Embodiment]

[0774] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0775] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0776] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0777] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0778] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0779] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0780] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0781] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0782] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0783] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0784] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0785] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0786] This invention relates to a system for streamlining the process of terminal sales and plan proposals in stores. The system includes terminal means for users to input their desired plan, terminal, and content, and server means for receiving the input information and generating optimal plan and terminal proposals. It also includes display means for receiving the proposals generated by the server means and displaying them to the user.

[0787] Program processing

[0788] User processing

[0789] Users access a form displayed on a terminal in the store and enter their desired plan, the device they are considering, and the content they want to use. For example, they might enter information such as "unlimited data plan," "latest smartphone," and "streaming, games." The terminal receives this information and sends the input data to the server.

[0790] Terminal processing

[0791] The terminal not only transmits user input to the server but also receives optimal plans and terminal suggestions from the server. Upon receiving suggestions from the server, the terminal displays the results to the user. This allows the user to obtain information quickly and accurately.

[0792] Server Processing

[0793] The server receives user input sent from the terminal device. This received data is analyzed, and an algorithm is executed to select the optimal plan and device according to the user's preferences. Specifically, if the user wants an "unlimited data plan," the algorithm selects a communication contract that provides an unlimited data plan; if the user is considering a "latest smartphone," it selects the optimal device to support that.

[0794] The server then sends back the optimal plan and terminal suggestion generated in this manner to the terminal device.

[0795] Explanation of specific examples

[0796] For example, if person A is considering a new smartphone and an unlimited data plan, the following process will occur:

[0797] 1. The user (Person A) enters "unlimited data plan," "latest smartphone," and "streaming, games" into the in-store terminal.

[0798] 2. The terminal sends this input data to the server.

[0799] 3. The server analyzes user input and selects the most suitable plan from the "unlimited data plans" and the most suitable device from the "latest smartphones."

[0800] 4. The server sends back the selected plan and terminal proposal results to the terminal.

[0801] 5. The terminal displays the proposal results sent from the server to person A.

[0802] In this way, users can quickly receive proposals for the optimal plan and device that meets their needs, so store staff only need to provide supplementary explanations based on the user's needs, which can significantly reduce the time spent with customers.

[0803] The above describes the configuration for implementing the system of the present invention. This system can improve customer satisfaction and increase sales efficiency by quickly and accurately proposing the optimal plan and terminal based on user input.

[0804] The following describes the processing flow.

[0805] Step 1:

[0806] Users access in-store terminals and enter their desired plan, device under consideration, and content they wish to use. Specifically, they enter information such as "unlimited data plan," "latest smartphone," and "streaming and games" into the form.

[0807] Step 2:

[0808] The terminal sends information entered by the user to the server. This includes formatting the input data and sending the data according to the transmission protocol.

[0809] Step 3:

[0810] The server receives user input data sent from the terminal. This allows the server to retrieve data regarding the user's preferences and requirements.

[0811] Step 4:

[0812] The server analyzes the user's input data received. Specifically, it analyzes the data to extract information about the desired plan, the device under consideration, and the content the user wants to use.

[0813] Step 5:

[0814] Based on the analysis results, the server selects the plan that best suits the user's desired conditions. For example, for a user who requests an "unlimited data plan," the server matches and selects the applicable plan.

[0815] Step 6:

[0816] Based on the analysis results, the server selects the most suitable device for the user's needs. For example, for a user considering the "latest smartphone," it selects the latest and best-performing device on the market.

[0817] Step 7:

[0818] The server generates a suggestion for the optimal plan and device. The generated suggestion includes specific information about the selected plan and device.

[0819] Step 8:

[0820] The server generates a proposal and sends it to the terminal. The proposal is formatted and sent to the terminal quickly.

[0821] Step 9:

[0822] The device receives a proposal sent from the server. The received proposal includes the optimal plan and device information based on the conditions entered by the user.

[0823] Step 10:

[0824] The device displays the suggested results it has received to the user. Specifically, the screen shows detailed information about the best plan and device.

[0825] Step 11:

[0826] The user reviews the displayed suggestions and, if necessary, asks the sales associate for further explanation. The sales associate then provides prompt and accurate supplementary explanations based on the suggestions.

[0827] This series of processing steps allows users to quickly find the optimal plan and device, and enables sales staff to provide efficient customer service.

[0828] (Example 1)

[0829] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0830] In traditional retail store sales and plan proposals, users often spent a significant amount of time trying to find the best plan and device for them, frequently receiving conflicting explanations from multiple sales representatives. This led to decreased user satisfaction, longer waiting times in stores, and reduced sales efficiency. Furthermore, understanding complex plan and device information required specialized knowledge, and without it, there was a risk of making the wrong choice.

[0831] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0832] In this invention, the server includes an information processing device for the user to input their desired contract, equipment under consideration, and functions they wish to use; a computing device for receiving user input transmitted from the information processing device and generating optimal contract and equipment suggestions based on the user input; and a display device for receiving suggestions transmitted from the computing device and displaying them to the user. This enables the user to receive prompt and accurate suggestions for the optimal plan and equipment.

[0833] A "user" refers to an individual or legal entity that uses this system to input their desired contract, equipment under consideration, and desired functions.

[0834] "Contract" refers to the agreement for the use of communication plans, data plans, and other services that the user desires.

[0835] "Equipment" refers to the electronic devices and hardware that the user is considering.

[0836] "Function" refers to the purpose of use of content, applications, etc., that a user wishes to use.

[0837] An "information processing device" refers to a terminal device used by users to input their desired contract, equipment under consideration, and desired functions.

[0838] A "computation device" refers to a server that receives user input transmitted from an information processing device and generates optimal contract and equipment proposals based on that data.

[0839] A "display device" refers to a device that receives suggestions transmitted from a computing device and displays them to the user.

[0840] "User input" refers to information entered by the user via an information processing device regarding contract preferences, equipment under consideration, and desired functions.

[0841] "Proposal" refers to the optimal combination of contracts and equipment for the user, as generated by the computing device.

[0842] "Transmission" refers to the act of transferring data to another device in the exchange of information.

[0843] "Receiving" refers to the act of receiving data transmitted from another device.

[0844] This invention relates to a system for streamlining the contract sales and plan proposal processes in retail stores. The system includes an information processing device for users to input their desired contracts, equipment, and functions, and a computing device to receive this input information and generate optimal contract and equipment proposals. It also includes a display device that receives the proposals generated by the computing device and displays them to the user.

[0845] User processing

[0846] Users access an information processing device installed in the store and enter their desired contract, equipment under consideration, and desired functions into the displayed form. For example, they might enter information such as "unlimited data plan," "latest smartphone," and "streaming and gaming." The input data is received by the information processing device and transmitted to the computer.

[0847] Terminal processing

[0848] The terminal (information processing device) not only transmits user input data to the computing device, but also receives optimal contract and equipment suggestions from the computing device. Upon receiving suggestions from the computing device, the terminal displays the results to the user. This allows the user to obtain information quickly and accurately.

[0849] Server (Computer) Processing

[0850] The server (computer) receives user input data sent from the terminal. Next, an algorithm is executed to analyze the received data and select the optimal contract and equipment according to the user's preferences. Specifically, if the user wants an "unlimited data plan," the server selects a communication contract that provides an unlimited data plan; if the user is considering a "latest smartphone," the server selects the optimal device to support it. The selected optimal contract and equipment proposal is then sent back from the server to the terminal.

[0851] Explanation of specific examples

[0852] For example, if user A is considering a new smartphone and an unlimited data plan, the following process will occur:

[0853] 1. User (Person A) enters "unlimited data plan," "latest smartphone," and "streaming, games" into the terminal in the store.

[0854] 2. The terminal sends this input data to the server.

[0855] 3. The server analyzes user input and selects the most suitable plan from the "unlimited data plans" and the most suitable device from the "latest smartphones."

[0856] 4. The server sends back the selected plan and terminal proposal results to the terminal.

[0857] 5. The terminal displays the proposal results sent from the server to person A.

[0858] Example of a prompt

[0859] When using a generative AI model to request a detailed explanation of this system, you can use prompt statements like the following:

[0860] Please describe in detail the system for streamlining the contract sales and plan proposal processes in stores, including the information entered by users, terminal processing, and server-based analysis and proposal processes. Furthermore, please explain the specific benefits this system offers and the hardware and software used.

[0861] The above describes the configuration for implementing the system of the present invention. This system can improve customer satisfaction and increase sales efficiency by quickly and accurately proposing the most suitable contracts and equipment based on user input.

[0862] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0863] Step 1: The user enters their desired information.

[0864] Users access an information processing device installed in the store and enter their desired contract, equipment under consideration, and desired functions into the displayed form. Specifically, they enter information such as "unlimited data plan," "latest smartphone," and "streaming and gaming" using touch controls or a keyboard. Once the entered data is confirmed, the submit button is pressed.

[0865] Input: User's preferences (contract, equipment, functions)

[0866] Output: Input data (contract, equipment, and function information)

[0867] Specific actions:

[0868] The user enters their desired information into the form and presses the submit button.

[0869] Step 2: The device sends data to the server.

[0870] The terminal temporarily stores the input data obtained from the user in memory and sends the data to the server using network communication. Specifically, the data is transferred to the server via an HTTP request.

[0871] Input: Input data (contract, equipment, and function information)

[0872] Output: Data sent to the server

[0873] Specific actions:

[0874] The terminal saves the input data to memory, generates an HTTP request, and sends it.

[0875] Step 3: The server receives and analyzes the data.

[0876] The server receives user input data sent from the terminal. The received data is first stored in the database, and data validation (checking for correctness) is performed as needed.

[0877] Input: User input data

[0878] Output: Analyzed data

[0879] Specific actions:

[0880] The server receives an HTTP request and parses and stores the data that has been sent.

[0881] Perform validation to confirm the validity of the data.

[0882] Step 4: The server selects the optimal plan and equipment.

[0883] The server executes an algorithm that selects the optimal contract and equipment according to the user's preferences based on the stored data. Specifically, it compares contract and equipment information in the database and selects the most suitable plan.

[0884] Input: Analyzed data

[0885] Output: Information on the selected optimal contracts and equipment.

[0886] Specific actions:

[0887] The server executes an algorithm and selects the optimal plan and equipment based on the information in the database.

[0888] Step 5: The server sends the proposal back to the terminal.

[0889] The server sends back a proposal for the most suitable contract and equipment selected by the terminal. The output data is converted by the server into HTML or JSON format and sent to the terminal as an HTTP response.

[0890] Input: Information on selected contracts and equipment

[0891] Output: Proposal data sent to the terminal

[0892] Specific actions:

[0893] The server converts the proposed data into a format and sends it to the terminal as an HTTP response.

[0894] Step 6: The device displays a suggestion.

[0895] The terminal analyzes the suggestion data received from the server and displays it to the user. This allows the user to view suggestions for the most suitable contract plan and equipment.

[0896] Input: Proposal data sent from the server

[0897] Output: Suggestion results displayed to the user

[0898] Specific actions:

[0899] The device analyzes the suggested data and displays the information on the screen. For example, it might show the user "unlimited data plan" and "latest smartphone."

[0900] The above outlines the specific processing steps of the system program. This process allows users to receive prompt, accurate, and optimal contract and equipment recommendations.

[0901] (Application Example 1)

[0902] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0903] In traditional retail store sales and plan proposal processes, users had to compare multiple options and gather a lot of information through conversations with sales staff in order to find the best plan and device that suited their needs. This cumbersome process led to decreased user satisfaction and reduced sales efficiency. Furthermore, the process for users to make immediate purchases or reservations was complicated, making quick decision-making difficult.

[0904] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0905] In this invention, the server includes input means for inputting the user's desired data plan, terminal under consideration, and content to be used; analysis means for receiving user input transmitted from the input means and generating optimal plan and terminal suggestions based on the user input; display means for receiving suggestions transmitted from the analysis means and displaying them to the user; and purchase support means for performing purchase procedures or reservations for the suggested plan and terminal if desired by the user. This enables the user to quickly and accurately receive optimal plan and terminal suggestions, and to smoothly perform purchase procedures or reservations on the spot.

[0906] A "user" is someone who uses the system to receive suggestions for their desired data plan, device, and content.

[0907] A "data plan" is a pricing plan for communication services and data usage that a user contracts for.

[0908] A "device" refers to a smartphone, tablet, or other device that the user is considering purchasing.

[0909] "Content" refers to digital services and applications such as streaming services and games that users want to use.

[0910] "Input means" refers to a device or interface in which the user inputs information about their desired data plan, device, and content.

[0911] "Analysis means" refers to a system or algorithm that receives user input transmitted from an input means, analyzes that information, and generates optimal plan and terminal suggestions.

[0912] "Display means" refers to a device or interface for displaying the suggested results transmitted from the analysis means to the user.

[0913] "Purchase support means" refers to a system or interface that allows users to purchase or reserve proposed plans and devices if they so desire.

[0914] This invention provides a system for streamlining terminal sales and plan proposals in physical stores. Based on user input, it makes optimal suggestions, displays them, and supports the purchase procedure as needed. This system mainly consists of input means, analysis means, display means, and purchase support means.

[0915] 1. System Configuration

[0916] Input means

[0917] Users use a smartphone app to input their desired data plan, the device they are considering, and the content they want to use. This input method is software that provides a user interface, designed to allow users to intuitively input information.

[0918] Analysis means

[0919] The smartphone app sends user input to a server. This server utilizes a cloud-based analysis system (e.g., AWS Lambda) to receive the transmitted data and use a generated AI model and an existing database to select the best plan and device for the user's needs. This analysis process uses software such as Python and TensorFlow.

[0920] Display means

[0921] The suggestions sent from the server are returned to the smartphone app and displayed to the user. The user reviews the displayed suggestions, and if they are satisfied with the content, they can proceed to the next step.

[0922] Purchase support methods

[0923] If a user wishes to purchase or reserve based on the suggestions, the smartphone app will support the purchase process. This method is linked to electronic payment and reservation systems, helping users complete the process smoothly.

[0924] 2. Explanation of Program Processing

[0925] Server Processing

[0926] When the server receives user input data, it analyzes the data using a generative AI model. This analysis employs an algorithm that derives the optimal combination of the user's desired data plan, devices under consideration, and content they wish to use. As a result, the server generates a suggestion of the plan and device that best matches the user's desired conditions.

[0927] Terminal processing

[0928] When the smartphone app receives a suggestion, it displays the details to the user. The user can review the suggested plan and device and make a selection based on the content they want to use. If necessary, they can proceed directly to purchase or reserve the suggested items within the app.

[0929] 3. Explanation of specific examples

[0930] For example, if a user wants an "unlimited data plan," a "latest smartphone," and "video streaming," enter the following prompt message.

[0931] Example of a prompt:

[0932] Please enter your desired data plan: Unlimited Data Plan

[0933] Please enter the device you are considering: Latest smartphone

[0934] Please enter the content you wish to use: Video viewing

[0935] When a user enters this prompt, the analysis system proposes and displays the most suitable plan and device based on that input. If the user is satisfied with the proposal, they can proceed with the purchase or reservation on the spot, enabling quick and efficient service delivery.

[0936] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0937] Step 1:

[0938] User input

[0939] The user opens the smartphone app and enters their desired data plan, the device they are considering, and the content they want to use. Specifically, the user enters information such as "unlimited data plan," "latest smartphone," and "video viewing" into the input form. This quantifies the user's needs and generates data that forms the basis for analysis in the next step.

[0940] Input: User's preferred data plan, device, and content information.

[0941] Output: User input data

[0942] Step 2:

[0943] Sending input data

[0944] The device sends the data entered by the user to a cloud server. Specifically, this involves the application's backend sending this input data to an analysis system in the cloud via an API.

[0945] Input: User input data

[0946] Output: Input data sent to the cloud server

[0947] Step 3:

[0948] Data analysis

[0949] The server analyzes the received user input data using a generating AI model and database. This allows for calculations to select the optimal data plan and device that meet the user's needs. Specifically, the previously trained AI model uses this dataset to generate a list of relevant data plans and devices.

[0950] Input: User input data sent to the cloud server

[0951] Output: Suggestions for the optimal data plan and device for the user.

[0952] Step 4:

[0953] Generation of proposal results

[0954] The server generates suggestions for the user based on the analysis results. These suggestions include the optimal data plan and device combination, and are provided in a way that best suits the user's needs. Here, software such as Python and TensorFlow are used to generate the suggestion results.

[0955] Input: Suggesting the optimal data plan and device for the user.

[0956] Output: Specific proposal details (list of optimal data plans and devices)

[0957] Step 5:

[0958] Submission of proposal results

[0959] The server sends the generated suggestion results to the terminal. Specifically, this involves a process where the suggestion data generated on the server side is returned to the user's smartphone via an API.

[0960] Input: Specific proposal details (list of optimal data plans and devices)

[0961] Output: Proposal results sent to the user terminal

[0962] Step 6:

[0963] Display of proposal results

[0964] The device receives the suggested results sent from the server and displays them to the user. Specifically, the suggested content is displayed in a rich format (e.g., list format or card format) through the user interface of the smartphone app.

[0965] Input: Suggestion results received from the server

[0966] Output: Suggestions displayed in the user interface

[0967] Step 7:

[0968] Support for the purchase process

[0969] If a user wishes to purchase or reserve an item based on a suggestion, the terminal provides an interface to assist with the purchase process. Specifically, it integrates with electronic payment and reservation systems, implementing a workflow that allows users to complete the process smoothly.

[0970] Input: User's intention to purchase or reserve

[0971] Output: Completed purchase or reservation information

[0972] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0973] This invention relates to a system that streamlines the process of terminal sales and plan proposals in stores and provides more appropriate suggestions based on the user's emotional state. The system includes terminal means for the user to input their desired plan, terminal, and content, and server means for receiving the input information and generating optimal plan and terminal suggestions. It also includes display means for receiving the suggestions generated by the server means and displaying them to the user, and further includes an emotion engine that recognizes the user's emotions.

[0974] Program processing

[0975] User processing

[0976] Users access a terminal in the store and enter their desired plan, the device they are considering, and the content they want to use. For example, they might enter information such as "unlimited data plan," "latest smartphone," and "streaming, games" into the form. The terminal receives this information and sends it to the server.

[0977] Terminal processing

[0978] The terminal transmits user input data to the server, along with data from the emotion engine. Upon receiving the optimal plan and terminal suggestions from the server, the results are displayed to the user. This allows the user to obtain information quickly and accurately.

[0979] Server Processing

[0980] The server receives user input data and emotion engine data transmitted from the terminal device. It analyzes the received data and executes an algorithm to select the optimal plan and terminal based on the user's preferences. Furthermore, it adjusts the suggested content and display method, taking into account the user's emotional state detected by the emotion engine. For example, if the user appears anxious, it will provide suggestions that include more detailed explanations.

[0981] Explanation of specific examples

[0982] For example, if person B is considering a new smartphone and an unlimited data plan but is feeling anxious, the following process will occur:

[0983] 1. User (Person B) enters "unlimited data plan," "latest smartphone," and "streaming, games" into the in-store terminal.

[0984] 2. The emotion engine analyzes Person B's facial expressions and voice tone to detect feelings of anxiety.

[0985] 3. The device sends input data and emotion data to the server.

[0986] 4. The server analyzes user input and selects the most suitable plan from the "unlimited data plans" and the most suitable device from the "latest smartphones."

[0987] 5. The server generates the selected plan and terminal suggestions, providing them with detailed explanations that take into account the user's concerns.

[0988] 6. The server sends the proposal to the terminal.

[0989] 7. The terminal displays the suggested results sent from the server to Person B. The displayed content includes detailed explanations and additional information to alleviate user anxiety.

[0990] This series of processing steps allows users to quickly receive optimal plan and device suggestions tailored to their preferences, as well as be provided with appropriate information based on their emotional state, enabling them to make choices with confidence. As a result, in-store sales staff only need to provide supplementary explanations based on the user's needs, significantly reducing the time spent with customers.

[0991] The following describes the processing flow.

[0992] Step 1:

[0993] Users access in-store terminals and enter their desired plan, device under consideration, and content they wish to use. Specifically, they enter information such as "unlimited data plan," "latest smartphone," and "streaming and games" into the form.

[0994] Step 2:

[0995] The device receives user input information and sends it to the server. Additionally, the device's emotion engine analyzes the user's facial expressions and voice tone to generate emotion data, which is also sent to the server.

[0996] Step 3:

[0997] The server receives user input data and emotion data sent from the terminal. This allows the server to acquire data regarding the user's preferences, conditions, and emotional state.

[0998] Step 4:

[0999] The server analyzes user data, extracting information about the desired plan, devices under consideration, and content the user wants to use from the input data. It also analyzes sentiment data simultaneously.

[1000] Step 5:

[1001] Based on the analysis results, the server selects the plan that best suits the user's desired conditions. For example, for a user who requests an "unlimited data plan," the server matches and selects the applicable plan.

[1002] Step 6:

[1003] Based on the analysis results, the server selects the most suitable device for the user's needs. For example, for a user considering the "latest smartphone," it selects the latest and best-performing device on the market.

[1004] Step 7:

[1005] The server takes emotional data into account and adjusts the suggestions accordingly. For example, if the user is feeling anxious, it will generate suggestions that include detailed explanations.

[1006] Step 8:

[1007] The server generates optimal plan and device suggestions. These suggestions include specific information about the selected plan and device, as well as adjustments based on sentiment data.

[1008] Step 9:

[1009] The server generates a proposal and sends it to the terminal. The proposal is formatted and sent to the terminal quickly.

[1010] Step 10:

[1011] The device receives a suggestion sent from the server. The received suggestion includes the optimal plan based on the conditions entered by the user, device information, and adjustments based on sentiment data.

[1012] Step 11:

[1013] The device displays the suggested results to the user. Specifically, the screen shows detailed information about the best plan and device, along with explanations based on sentiment data.

[1014] Step 12:

[1015] The user reviews the displayed suggestions and, if necessary, asks the sales associate for further explanation. The sales associate then provides prompt and accurate supplementary explanations based on the suggestions.

[1016] This series of processing steps allows users to quickly find the optimal plan and device that matches their preferences, and to make informed choices with confidence as they are provided with appropriate information tailored to their emotional state. This enables sales staff to provide effective supplementary explanations based on the user's needs, significantly reducing customer service time.

[1017] (Example 2)

[1018] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1019] In current retail store systems, users often spend a lot of time selecting their desired communication plan and devices, increasing user stress and the burden on sales staff. Furthermore, suggestions are not made that take into account the user's emotional state, making it difficult for users to obtain appropriate information.

[1020] The identification processing by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes input means for inputting the communication plan desired by the user, the device under consideration, and the content to be used; calculation means for receiving user input and emotion data transmitted from the input means and generating a proposal for the optimal communication plan and device based on the user's wishes and emotional state; and display means for receiving the proposal transmitted from the calculation means and displaying it to the user. As a result, the user can quickly obtain the optimal proposal and make a choice with confidence through detailed explanations based on their emotional state. Furthermore, the burden on store sales staff is reduced, and efficient customer service is realized.

[1021] A "user" refers to a consumer who utilizes the system and provides information regarding the selection of communication plans, devices, and content.

[1022] A "communication plan" refers to the pricing structure and service details for data communication and calls that a user contracts for and uses.

[1023] "Device" is a general term for communication equipment and related devices used by users, including smartphones and tablets.

[1024] "Content" refers to applications and services that users access through their devices, including streaming services and games.

[1025] "Input means" refers to methods and devices for users to input their desired communication plans, devices, and content, including terminals installed in stores.

[1026] "Computational means" refers to processing devices and algorithms that analyze information and emotional data input by users and generate optimal suggestions.

[1027] "Display means" refers to a device or method that visually presents the proposed results generated by the calculation means to the user.

[1028] "Emotional data" refers to information about a user's emotional state, analyzed from their facial expressions, voice tone, and other factors.

[1029] "Recommendation" refers to the selection of the optimal communication plan and device, generated based on the user's preferences and emotional state.

[1030] This invention relates to a system that streamlines terminal sales and communication plan proposals in stores and provides more appropriate suggestions based on the user's emotional state. The system includes input means for inputting the communication plan, device, and content the user wants to use; calculation means for receiving and analyzing user input data and emotional data to generate optimal suggestions; and display means for displaying the suggestions to the user.

[1031] System Configuration

[1032] Hardware configuration

[1033] The input method will be a tablet or computer installed in the store. This will display a form screen where the user can input their desired communication plan, device, and the content they wish to use.

[1034] An emotion engine refers to a device that uses the device's camera and microphone to analyze the user's facial expressions and voice tone in real time.

[1035] High-performance servers are used as the computing means, responsible for complex data analysis and the execution of generative AI models.

[1036] Display methods include the user's terminal screen and digital signage within the store.

[1037] Software Configuration

[1038] The front-end section is constructed using HTML, CSS, and JavaScript, and provides the user interface.

[1039] The backend is built using Python, Node.js, etc., and handles receiving user input, performing data analysis, and calling the generated AI model.

[1040] The emotion engine utilizes machine learning models (e.g., TensorFlow or PyTorch) to analyze the user's emotional state in real time.

[1041] The generative AI model is used to generate detailed suggestions for plan and device selection.

[1042] Specific actions

[1043] The user operates a terminal in the store and inputs their desired communication plan (e.g., "unlimited data plan"), device (e.g., "latest smartphone"), and the content they want to use (e.g., "streaming, games"). Along with this input data, the terminal sends emotion data (e.g., "anxiety") analyzed from the user's facial expressions and voice to the server.

[1044] The server receives this data and first selects the optimal communication plan and device based on the user's preferences. Next, it uses a generative AI model to generate detailed explanations that take into account the user's emotional state. For example, it might generate suggestions such as, "With unlimited data, you can enjoy streaming and gaming comfortably. We also provide 24-hour support after you sign up."

[1045] The generated suggestions are sent back from the server to the terminal and displayed to the user. Based on this information, the user can confidently select a communication plan and device.

[1046] Explanation of specific examples

[1047] For example, if person B is considering a new smartphone and an unlimited data plan but is hesitant to purchase it, the following process will occur:

[1048] 1. Person B enters "unlimited data plan," "latest smartphone," and "streaming, games" into the store terminal screen.

[1049] 2. The emotion engine analyzes Person B's facial expressions and voice tone and detects the emotion data of "anxiety."

[1050] 3. The device sends input data and emotion data to the server.

[1051] 4. The server analyzes user input and selects the optimal communication plan and device.

[1052] 5. The server uses an AI model to generate suggestions with detailed explanations. For example, a suggestion might be: "An unlimited data plan and the latest smartphone are ideal. With unlimited data, you can comfortably enjoy streaming and gaming. We also provide 24-hour support after signing up so you can use it without any worries."

[1053] 6. The server sends this proposal result to the terminal.

[1054] 7. The device displays the proposed results to person B. Person B can make a selection with confidence through the detailed explanations.

[1055] Example of a prompt

[1056] The following is an example of a prompt to input into a generative AI model:

[1057] Based on the user's desired communication plan and device, the content they wish to use, and the results of the emotion engine's analysis, generate a suggestion for the optimal plan and device. If the user appears anxious, add a detailed explanation.

[1058] Input information:

[1059] Plan: Unlimited Data Plan

[1060] Device: Latest smartphone

[1061] Content: Streaming, Games

[1062] Emotion: Anxiety

[1063] This system allows users to receive quick and appropriate suggestions, and by providing detailed explanations based on their emotional state, users can make choices with confidence. This also enables stores to conduct sales activities more efficiently.

[1064] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1065] Step 1:

[1066] The user operates a terminal in the store and enters their desired communication plan, device, and content to be used. Specifically, they enter information such as "unlimited data plan," "latest smartphone," and "streaming, games" into a form displayed on the terminal screen and press the submit button. The entered data is saved to the terminal, and the terminal also uses its built-in camera and microphone to analyze the user's facial expressions and voice using an emotion engine to obtain emotional data such as anxiety and satisfaction.

[1067] Input: User-entered communication plan, device, content information, and user facial expressions and voice data.

[1068] Output: User preference data and sentiment data

[1069] Step 2:

[1070] The device transmits user input data and sentiment data to the server. Specifically, it uses a communication module within the device to transmit data via a secure communication protocol such as HTTPS. This data includes the desired communication plan, device, content information, and sentiment data analyzed by the sentiment engine.

[1071] Input: Communication plan, device, content information, and sentiment data obtained from the user.

[1072] Output: User input and sentiment data sent to the server

[1073] Step 3:

[1074] The server receives user input data and sentiment data transmitted from the terminal. First, the server processes the user's desired communication plan, device, and content information using an analysis algorithm, and selects the communication plan and device that best suit the user's needs.

[1075] Input: Communication plan, device, content information, and sentiment data sent from the device.

[1076] Output: Selection results for the optimal communication plan and devices.

[1077] Step 4:

[1078] The server analyzes the emotion engine data and generates suggestions using a generative AI model. You construct a prompt for the generative AI model, inputting it in the format of "Plan: Unlimited data plan, Device: Latest smartphone, Content: Streaming, Games, Emotion: Anxiety." The generative AI model then generates detailed suggestions and explanations.

[1079] Input: Selection results for optimal communication plan and device, sentiment data

[1080] Output: Detailed suggestions that take into account the user's emotional state.

[1081] Step 5:

[1082] The server generates proposal results, which are then compiled into data packets and securely transmitted to the terminal. This also uses communication protocols such as HTTPS.

[1083] Input: Generated proposal content

[1084] Output: Proposal results sent to the terminal

[1085] Step 6:

[1086] The device analyzes the suggestion result data packets received from the server and displays them appropriately on the user interface. Specifically, the suggestion content is formatted in an easy-to-read way on the screen, and detailed explanations such as "An unlimited data plan and the latest smartphone are ideal. With unlimited data, you can comfortably enjoy streaming and gaming. We also provide 24-hour support after the contract is signed so you can use it without worry" are displayed.

[1087] Input: Suggestion result data packet received from the server

[1088] Output: Optimal plan and device suggestions displayed to the user.

[1089] Step 7:

[1090] Users review the suggested options displayed on their devices and select the most suitable communication plan and device. Specifically, users review the displayed information and make their selections after they are satisfied with the results. This allows users to confidently choose a plan and device that meets their needs.

[1091] Input: Suggestions displayed on the device

[1092] Output: User's final selection

[1093] (Application Example 2)

[1094] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1095] Traditional in-store terminal sales and plan proposal systems had the problem of a complex user selection process, which often led to user anxiety and confusion. Furthermore, because proposals were generated solely based on user input, it was difficult to provide appropriate suggestions that took the user's emotional state into consideration. This could lead to decreased user satisfaction and reduced sales efficiency.

[1096] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes terminal means for the user to input their desired plan, terminal under consideration, and content they wish to use; server means for receiving user input transmitted from the terminal means and generating optimal plan and terminal suggestions based on the user input; display means for receiving suggestions transmitted from the server means and displaying them to the user; and emotion analysis means for analyzing the user's facial expressions and voice tone and recognizing their emotional state. This makes it possible to propose more appropriate plans and terminals based on the user's emotional state, reducing user anxiety and confusion, and improving user satisfaction and sales efficiency.

[1097] "A device for users to input their desired plan, devices under consideration, and content they wish to use" refers to a device for users to input their specific needs, such as a smartphone or tablet.

[1098] "Server means for receiving user input transmitted from the terminal means and generating optimal plan and terminal suggestions based on the user input" refers to a computer system that receives information entered by the user, analyzes that information, and automatically calculates and generates the most suitable suggestions.

[1099] "Display means for receiving and displaying suggestions transmitted from the server means to the user" refers to a device for displaying the suggestion results from the server to the user in a visually and easily understandable manner, and includes displays and monitors.

[1100] "An emotion analysis method that analyzes a user's facial expressions and voice tone to recognize their emotional state" is a technology that uses a camera and microphone to collect a user's facial expressions and voice tone, analyzes them, and identifies the emotional state the user is experiencing.

[1101] This invention relates to a system that streamlines the process of terminal sales and plan proposals in stores and provides more appropriate suggestions based on the user's emotional state. This system comprehensively covers each stage of user input, emotion analysis, suggestion generation, and display.

[1102] 1. Structure

[1103] This system includes the following main components:

[1104] Terminal device: This is the device used by the user to input their desired plan, device under consideration, and content they wish to use. Smartphones and tablets are commonly used as terminal devices.

[1105] Server: A computing system that receives user input transmitted from the terminal and generates optimal plan and terminal suggestions based on that information. The server executes AI algorithms that analyze user data and sentiment data.

[1106] Display means: A device that visually displays suggestions sent from the server means to the user. The display of the terminal means is used as the display means.

[1107] Emotion analysis method: This is a technology for recognizing an emotional state by analyzing the user's facial expressions and voice tone. Specifically, it uses a camera and microphone and the "DeepFace" library.

[1108] 2. Program Processing Flow

[1109] 1. User input:

[1110] Users input their desired plan, the device they are considering, and the content they want to use using their device. For example, they might enter information such as "unlimited data plan," "latest smartphone," and "streaming, games" into the input form.

[1111] 2. Emotion analysis:

[1112] As the user inputs data, the camera and microphone are used to collect the user's facial expressions and voice tone in real time. This data is then analyzed using the "DeepFace" library to recognize the user's emotional state (e.g., anxiety, joy).

[1113] 3. Data transmission:

[1114] The terminal device transmits user input data and sentiment data to the server device. This series of data is sent to the server via an API.

[1115] 4. Proposal generation:

[1116] The server analyzes the received user input data and sentiment data, and executes an algorithm to select the optimal plan and terminal combination. If the sentiment data indicates anxiety, adjustments such as adding detailed explanations are made.

[1117] 5. Suggestion display:

[1118] The suggestions generated by the server are sent back to the terminal and displayed to the user. The user can view detailed suggestions and explanations.

[1119] 3. Usage example

[1120] User prompt message:

[1121] "I have a dark green smartphone and I'm looking for a plan that allows unlimited data usage when exchanging contacts. I've also been enjoying a lot of movies and games lately."

[1122] Based on this prompt, the system will make appropriate suggestions.

[1123] 4. Hardware and Software

[1124] Hardware:

[1125] Smartphones and tablets (devices and display devices)

[1126] Camera and microphone (means of sentiment analysis)

[1127] software:

[1128] Requests library (data transmission)

[1129] DeepFace Library (emotion analysis)

[1130] Server-side AI algorithm (proposal generation)

[1131] In this way, the present invention can efficiently propose optimal plans and devices based on the user's emotional state, thereby improving user satisfaction and sales efficiency.

[1132] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1133] Step 1:

[1134] The user enters their desired plan, device under consideration, and content they wish to use using their device. The information entered by the user (e.g., "unlimited data plan," "latest smartphone," "streaming, games") is collected from the input form on the device. The entered data is then prepared for transmission, reflecting the user's specific preferences.

[1135] Step 2:

[1136] The device collects the user's facial expressions and voice tone using the camera and microphone as the user inputs data. Emotional data is acquired in real time and analyzed using the DeepFace library. As a result of the analysis, the user's emotional state (e.g., anxiety, joy) is recognized. This process provides data on the user's psychological state.

[1137] Step 3:

[1138] The device sends user input data and sentiment data to the server. The data sent via the API includes the user's specific preferences and sentiment analysis results. This allows the server to receive comprehensive user information.

[1139] Step 4:

[1140] The server analyzes the received user input data and selects the optimal plan and device that best suits the user's preferences. The analysis algorithm simultaneously evaluates the user's preferences and emotional state to generate the most suitable recommendations. If the emotional data indicates anxiety, adjustments are made to generate recommendations that include detailed explanations.

[1141] Step 5:

[1142] The server sends the generated proposal results to the terminal. The sent proposal results include details about the selected plan and terminal. Additional information and explanations that correspond to the user's emotional state are also added.

[1143] Step 6:

[1144] The terminal displays the suggested results received from the server to the user. The suggested results displayed on the screen are visually arranged for easy understanding by the user and presented with detailed explanations. This display allows the user to confidently make the choice that best suits their needs.

[1145] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1146] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1147] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[1148] [Fourth Embodiment]

[1149] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[1150] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1151] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1152] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[1153] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1154] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1155] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1156] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[1157] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1158] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1159] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1160] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1161] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1162] This invention relates to a system for streamlining the process of terminal sales and plan proposals in stores. The system includes terminal means for users to input their desired plan, terminal, and content, and server means for receiving the input information and generating optimal plan and terminal proposals. It also includes display means for receiving the proposals generated by the server means and displaying them to the user.

[1163] Program processing

[1164] User processing

[1165] Users access a form displayed on a terminal in the store and enter their desired plan, the device they are considering, and the content they want to use. For example, they might enter information such as "unlimited data plan," "latest smartphone," and "streaming, games." The terminal receives this information and sends the input data to the server.

[1166] Terminal processing

[1167] The terminal not only transmits user input to the server but also receives optimal plans and terminal suggestions from the server. Upon receiving suggestions from the server, the terminal displays the results to the user. This allows the user to obtain information quickly and accurately.

[1168] Server Processing

[1169] The server receives user input sent from the terminal device. This received data is analyzed, and an algorithm is executed to select the optimal plan and device according to the user's preferences. Specifically, if the user wants an "unlimited data plan," the algorithm selects a communication contract that provides an unlimited data plan; if the user is considering a "latest smartphone," it selects the optimal device to support that.

[1170] The server then sends back the optimal plan and terminal suggestion generated in this manner to the terminal device.

[1171] Explanation of specific examples

[1172] For example, if person A is considering a new smartphone and an unlimited data plan, the following process will occur:

[1173] 1. The user (Person A) enters "unlimited data plan," "latest smartphone," and "streaming, games" into the in-store terminal.

[1174] 2. The terminal sends this input data to the server.

[1175] 3. The server analyzes user input and selects the most suitable plan from the "unlimited data plans" and the most suitable device from the "latest smartphones."

[1176] 4. The server sends back the selected plan and terminal proposal results to the terminal.

[1177] 5. The terminal displays the proposal results sent from the server to person A.

[1178] In this way, users can quickly receive proposals for the optimal plan and device that meets their needs, so store staff only need to provide supplementary explanations based on the user's needs, which can significantly reduce the time spent with customers.

[1179] The above describes the configuration for implementing the system of the present invention. This system can improve customer satisfaction and increase sales efficiency by quickly and accurately proposing the optimal plan and terminal based on user input.

[1180] The following describes the processing flow.

[1181] Step 1:

[1182] Users access in-store terminals and enter their desired plan, device under consideration, and content they wish to use. Specifically, they enter information such as "unlimited data plan," "latest smartphone," and "streaming and games" into the form.

[1183] Step 2:

[1184] The terminal sends information entered by the user to the server. This includes formatting the input data and sending the data according to the transmission protocol.

[1185] Step 3:

[1186] The server receives user input data sent from the terminal. This allows the server to retrieve data regarding the user's preferences and requirements.

[1187] Step 4:

[1188] The server analyzes the user's input data received. Specifically, it analyzes the data to extract information about the desired plan, the device under consideration, and the content the user wants to use.

[1189] Step 5:

[1190] Based on the analysis results, the server selects the plan that best suits the user's desired conditions. For example, for a user who requests an "unlimited data plan," the server matches and selects the applicable plan.

[1191] Step 6:

[1192] Based on the analysis results, the server selects the most suitable device for the user's needs. For example, for a user considering the "latest smartphone," it selects the latest and best-performing device on the market.

[1193] Step 7:

[1194] The server generates a suggestion for the optimal plan and device. The generated suggestion includes specific information about the selected plan and device.

[1195] Step 8:

[1196] The server generates a proposal and sends it to the terminal. The proposal is formatted and sent to the terminal quickly.

[1197] Step 9:

[1198] The device receives a proposal sent from the server. The received proposal includes the optimal plan and device information based on the conditions entered by the user.

[1199] Step 10:

[1200] The device displays the suggested results it has received to the user. Specifically, the screen shows detailed information about the best plan and device.

[1201] Step 11:

[1202] The user reviews the displayed suggestions and, if necessary, asks the sales associate for further explanation. The sales associate then provides prompt and accurate supplementary explanations based on the suggestions.

[1203] This series of processing steps allows users to quickly find the optimal plan and device, and enables sales staff to provide efficient customer service.

[1204] (Example 1)

[1205] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1206] In traditional retail store sales and plan proposals, users often spent a significant amount of time trying to find the best plan and device for them, frequently receiving conflicting explanations from multiple sales representatives. This led to decreased user satisfaction, longer waiting times in stores, and reduced sales efficiency. Furthermore, understanding complex plan and device information required specialized knowledge, and without it, there was a risk of making the wrong choice.

[1207] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1208] In this invention, the server includes an information processing device for the user to input their desired contract, equipment under consideration, and functions they wish to use; a computing device for receiving user input transmitted from the information processing device and generating optimal contract and equipment suggestions based on the user input; and a display device for receiving suggestions transmitted from the computing device and displaying them to the user. This enables the user to receive prompt and accurate suggestions for the optimal plan and equipment.

[1209] A "user" refers to an individual or legal entity that uses this system to input their desired contract, equipment under consideration, and desired functions.

[1210] "Contract" refers to the agreement for the use of communication plans, data plans, and other services that the user desires.

[1211] "Equipment" refers to the electronic devices and hardware that the user is considering.

[1212] "Function" refers to the purpose of use of content, applications, etc., that a user wishes to use.

[1213] An "information processing device" refers to a terminal device used by users to input their desired contract, equipment under consideration, and desired functions.

[1214] A "computation device" refers to a server that receives user input transmitted from an information processing device and generates optimal contract and equipment proposals based on that data.

[1215] A "display device" refers to a device that receives suggestions transmitted from a computing device and displays them to the user.

[1216] "User input" refers to information entered by the user via an information processing device regarding contract preferences, equipment under consideration, and desired functions.

[1217] "Proposal" refers to the optimal combination of contracts and equipment for the user, as generated by the computing device.

[1218] "Transmission" refers to the act of transferring data to another device in the exchange of information.

[1219] "Receiving" refers to the act of receiving data transmitted from another device.

[1220] This invention relates to a system for streamlining the contract sales and plan proposal processes in retail stores. The system includes an information processing device for users to input their desired contracts, equipment, and functions, and a computing device to receive this input information and generate optimal contract and equipment proposals. It also includes a display device that receives the proposals generated by the computing device and displays them to the user.

[1221] User processing

[1222] Users access an information processing device installed in the store and enter their desired contract, equipment under consideration, and desired functions into the displayed form. For example, they might enter information such as "unlimited data plan," "latest smartphone," and "streaming and gaming." The input data is received by the information processing device and transmitted to the computer.

[1223] Terminal processing

[1224] The terminal (information processing device) not only transmits user input data to the computing device, but also receives optimal contract and equipment suggestions from the computing device. Upon receiving suggestions from the computing device, the terminal displays the results to the user. This allows the user to obtain information quickly and accurately.

[1225] Server (Computer) Processing

[1226] The server (computer) receives user input data sent from the terminal. Next, an algorithm is executed to analyze the received data and select the optimal contract and equipment according to the user's preferences. Specifically, if the user wants an "unlimited data plan," the server selects a communication contract that provides an unlimited data plan; if the user is considering a "latest smartphone," the server selects the optimal device to support it. The selected optimal contract and equipment proposal is then sent back from the server to the terminal.

[1227] Explanation of specific examples

[1228] For example, if user A is considering a new smartphone and an unlimited data plan, the following process will occur:

[1229] 1. User (Person A) enters "unlimited data plan," "latest smartphone," and "streaming, games" into the terminal in the store.

[1230] 2. The terminal sends this input data to the server.

[1231] 3. The server analyzes user input and selects the most suitable plan from the "unlimited data plans" and the most suitable device from the "latest smartphones."

[1232] 4. The server sends back the selected plan and terminal proposal results to the terminal.

[1233] 5. The terminal displays the proposal results sent from the server to person A.

[1234] Example of a prompt

[1235] When using a generative AI model to request a detailed explanation of this system, you can use prompt statements like the following:

[1236] Please describe in detail the system for streamlining the contract sales and plan proposal processes in stores, including the information entered by users, terminal processing, and server-based analysis and proposal processes. Furthermore, please explain the specific benefits this system offers and the hardware and software used.

[1237] The above describes the configuration for implementing the system of the present invention. This system can improve customer satisfaction and increase sales efficiency by quickly and accurately proposing the most suitable contracts and equipment based on user input.

[1238] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1239] Step 1: The user enters their desired information.

[1240] Users access an information processing device installed in the store and enter their desired contract, equipment under consideration, and desired functions into the displayed form. Specifically, they enter information such as "unlimited data plan," "latest smartphone," and "streaming and gaming" using touch controls or a keyboard. Once the entered data is confirmed, the submit button is pressed.

[1241] Input: User's preferences (contract, equipment, functions)

[1242] Output: Input data (contract, equipment, and function information)

[1243] Specific actions:

[1244] The user enters their desired information into the form and presses the submit button.

[1245] Step 2: The device sends data to the server.

[1246] The terminal temporarily stores the input data obtained from the user in memory and sends the data to the server using network communication. Specifically, the data is transferred to the server via an HTTP request.

[1247] Input: Input data (contract, equipment, and function information)

[1248] Output: Data sent to the server

[1249] Specific actions:

[1250] The terminal saves the input data to memory, generates an HTTP request, and sends it.

[1251] Step 3: The server receives and analyzes the data.

[1252] The server receives user input data sent from the terminal. The received data is first stored in the database, and data validation (checking for correctness) is performed as needed.

[1253] Input: User input data

[1254] Output: Analyzed data

[1255] Specific actions:

[1256] The server receives an HTTP request and parses and stores the data that has been sent.

[1257] Perform validation to confirm the validity of the data.

[1258] Step 4: The server selects the optimal plan and equipment.

[1259] The server executes an algorithm that selects the optimal contract and equipment according to the user's preferences based on the stored data. Specifically, it compares contract and equipment information in the database and selects the most suitable plan.

[1260] Input: Analyzed data

[1261] Output: Information on the selected optimal contracts and equipment.

[1262] Specific actions:

[1263] The server executes an algorithm and selects the optimal plan and equipment based on the information in the database.

[1264] Step 5: The server sends the proposal back to the terminal.

[1265] The server sends back a proposal for the most suitable contract and equipment selected by the terminal. The output data is converted by the server into HTML or JSON format and sent to the terminal as an HTTP response.

[1266] Input: Information on selected contracts and equipment

[1267] Output: Proposal data sent to the terminal

[1268] Specific actions:

[1269] The server converts the proposed data into a format and sends it to the terminal as an HTTP response.

[1270] Step 6: The device displays a suggestion.

[1271] The terminal analyzes the suggestion data received from the server and displays it to the user. This allows the user to view suggestions for the most suitable contract plan and equipment.

[1272] Input: Proposal data sent from the server

[1273] Output: Suggestion results displayed to the user

[1274] Specific actions:

[1275] The device analyzes the suggested data and displays the information on the screen. For example, it might show the user "unlimited data plan" and "latest smartphone."

[1276] The above outlines the specific processing steps of the system program. This process allows users to receive prompt, accurate, and optimal contract and equipment recommendations.

[1277] (Application Example 1)

[1278] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1279] In traditional retail store sales and plan proposal processes, users had to compare multiple options and gather a lot of information through conversations with sales staff in order to find the best plan and device that suited their needs. This cumbersome process led to decreased user satisfaction and reduced sales efficiency. Furthermore, the process for users to make immediate purchases or reservations was complicated, making quick decision-making difficult.

[1280] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1281] In this invention, the server includes input means for inputting the user's desired data plan, terminal under consideration, and content to be used; analysis means for receiving user input transmitted from the input means and generating optimal plan and terminal suggestions based on the user input; display means for receiving suggestions transmitted from the analysis means and displaying them to the user; and purchase support means for performing purchase procedures or reservations for the suggested plan and terminal if desired by the user. This enables the user to quickly and accurately receive optimal plan and terminal suggestions, and to smoothly perform purchase procedures or reservations on the spot.

[1282] A "user" is someone who uses the system to receive suggestions for their desired data plan, device, and content.

[1283] A "data plan" is a pricing plan for communication services and data usage that a user contracts for.

[1284] A "device" refers to a smartphone, tablet, or other device that the user is considering purchasing.

[1285] "Content" refers to digital services and applications such as streaming services and games that users want to use.

[1286] "Input means" refers to a device or interface in which the user inputs information about their desired data plan, device, and content.

[1287] "Analysis means" refers to a system or algorithm that receives user input transmitted from an input means, analyzes that information, and generates optimal plan and terminal suggestions.

[1288] "Display means" refers to a device or interface for displaying the suggested results transmitted from the analysis means to the user.

[1289] "Purchase support means" refers to a system or interface that allows users to purchase or reserve proposed plans and devices if they so desire.

[1290] This invention provides a system for streamlining terminal sales and plan proposals in physical stores. Based on user input, it makes optimal suggestions, displays them, and supports the purchase procedure as needed. This system mainly consists of input means, analysis means, display means, and purchase support means.

[1291] 1. System Configuration

[1292] Input means

[1293] Users use a smartphone app to input their desired data plan, the device they are considering, and the content they want to use. This input method is software that provides a user interface, designed to allow users to intuitively input information.

[1294] Analysis means

[1295] The smartphone app sends user input to a server. This server utilizes a cloud-based analysis system (e.g., AWS Lambda) to receive the transmitted data and use a generated AI model and an existing database to select the best plan and device for the user's needs. This analysis process uses software such as Python and TensorFlow.

[1296] Display means

[1297] The suggestions sent from the server are returned to the smartphone app and displayed to the user. The user reviews the displayed suggestions, and if they are satisfied with the content, they can proceed to the next step.

[1298] Purchase support methods

[1299] If a user wishes to purchase or reserve based on the suggestions, the smartphone app will support the purchase process. This method is linked to electronic payment and reservation systems, helping users complete the process smoothly.

[1300] 2. Explanation of Program Processing

[1301] Server Processing

[1302] When the server receives user input data, it analyzes the data using a generative AI model. This analysis employs an algorithm that derives the optimal combination of the user's desired data plan, devices under consideration, and content they wish to use. As a result, the server generates a suggestion of the plan and device that best matches the user's desired conditions.

[1303] Terminal processing

[1304] When the smartphone app receives a suggestion, it displays the details to the user. The user can review the suggested plan and device and make a selection based on the content they want to use. If necessary, they can proceed directly to purchase or reserve the suggested items within the app.

[1305] 3. Explanation of specific examples

[1306] For example, if a user wants an "unlimited data plan," a "latest smartphone," and "video streaming," enter the following prompt message.

[1307] Example of a prompt:

[1308] Please enter your desired data plan: Unlimited Data Plan

[1309] Please enter the device you are considering: Latest smartphone

[1310] Please enter the content you wish to use: Video viewing

[1311] When a user enters this prompt, the analysis system proposes and displays the most suitable plan and device based on that input. If the user is satisfied with the proposal, they can proceed with the purchase or reservation on the spot, enabling quick and efficient service delivery.

[1312] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1313] Step 1:

[1314] User input

[1315] The user opens the smartphone app and enters their desired data plan, the device they are considering, and the content they want to use. Specifically, the user enters information such as "unlimited data plan," "latest smartphone," and "video viewing" into the input form. This quantifies the user's needs and generates data that forms the basis for analysis in the next step.

[1316] Input: User's preferred data plan, device, and content information.

[1317] Output: User input data

[1318] Step 2:

[1319] Sending input data

[1320] The device sends the data entered by the user to a cloud server. Specifically, this involves the application's backend sending this input data to an analysis system in the cloud via an API.

[1321] Input: User input data

[1322] Output: Input data sent to the cloud server

[1323] Step 3:

[1324] Data analysis

[1325] The server analyzes the received user input data using a generating AI model and database. This allows for calculations to select the optimal data plan and device that meet the user's needs. Specifically, the previously trained AI model uses this dataset to generate a list of relevant data plans and devices.

[1326] Input: User input data sent to the cloud server

[1327] Output: Suggestions for the optimal data plan and device for the user.

[1328] Step 4:

[1329] Generation of proposal results

[1330] The server generates suggestions for the user based on the analysis results. These suggestions include the optimal data plan and device combination, and are provided in a way that best suits the user's needs. Here, software such as Python and TensorFlow are used to generate the suggestion results.

[1331] Input: Suggesting the optimal data plan and device for the user.

[1332] Output: Specific proposal details (list of optimal data plans and devices)

[1333] Step 5:

[1334] Submission of proposal results

[1335] The server sends the generated suggestion results to the terminal. Specifically, this involves a process where the suggestion data generated on the server side is returned to the user's smartphone via an API.

[1336] Input: Specific proposal details (list of optimal data plans and devices)

[1337] Output: Proposal results sent to the user terminal

[1338] Step 6:

[1339] Display of proposal results

[1340] The device receives the suggested results sent from the server and displays them to the user. Specifically, the suggested content is displayed in a rich format (e.g., list format or card format) through the user interface of the smartphone app.

[1341] Input: Suggestion results received from the server

[1342] Output: Suggestions displayed in the user interface

[1343] Step 7:

[1344] Support for the purchase process

[1345] If a user wishes to purchase or reserve an item based on a suggestion, the terminal provides an interface to assist with the purchase process. Specifically, it integrates with electronic payment and reservation systems, implementing a workflow that allows users to complete the process smoothly.

[1346] Input: User's intention to purchase or reserve

[1347] Output: Completed purchase or reservation information

[1348] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1349] This invention relates to a system that streamlines the process of terminal sales and plan proposals in stores and provides more appropriate suggestions based on the user's emotional state. The system includes terminal means for the user to input their desired plan, terminal, and content, and server means for receiving the input information and generating optimal plan and terminal suggestions. It also includes display means for receiving the suggestions generated by the server means and displaying them to the user, and further includes an emotion engine that recognizes the user's emotions.

[1350] Program processing

[1351] User processing

[1352] Users access a terminal in the store and enter their desired plan, the device they are considering, and the content they want to use. For example, they might enter information such as "unlimited data plan," "latest smartphone," and "streaming, games" into the form. The terminal receives this information and sends it to the server.

[1353] Terminal processing

[1354] The terminal transmits user input data to the server, along with data from the emotion engine. Upon receiving the optimal plan and terminal suggestions from the server, the results are displayed to the user. This allows the user to obtain information quickly and accurately.

[1355] Server Processing

[1356] The server receives user input data and emotion engine data transmitted from the terminal device. It analyzes the received data and executes an algorithm to select the optimal plan and terminal based on the user's preferences. Furthermore, it adjusts the suggested content and display method, taking into account the user's emotional state detected by the emotion engine. For example, if the user appears anxious, it will provide suggestions that include more detailed explanations.

[1357] Explanation of specific examples

[1358] For example, if person B is considering a new smartphone and an unlimited data plan but is feeling anxious, the following process will occur:

[1359] 1. User (Person B) enters "unlimited data plan," "latest smartphone," and "streaming, games" into the in-store terminal.

[1360] 2. The emotion engine analyzes Person B's facial expressions and voice tone to detect feelings of anxiety.

[1361] 3. The device sends input data and emotion data to the server.

[1362] 4. The server analyzes user input and selects the most suitable plan from the "unlimited data plans" and the most suitable device from the "latest smartphones."

[1363] 5. The server generates the selected plan and terminal suggestions, providing them with detailed explanations that take into account the user's concerns.

[1364] 6. The server sends the proposal to the terminal.

[1365] 7. The terminal displays the suggested results sent from the server to Person B. The displayed content includes detailed explanations and additional information to alleviate user anxiety.

[1366] This series of processing steps allows users to quickly receive optimal plan and device suggestions tailored to their preferences, as well as be provided with appropriate information based on their emotional state, enabling them to make choices with confidence. As a result, in-store sales staff only need to provide supplementary explanations based on the user's needs, significantly reducing the time spent with customers.

[1367] The following describes the processing flow.

[1368] Step 1:

[1369] Users access in-store terminals and enter their desired plan, device under consideration, and content they wish to use. Specifically, they enter information such as "unlimited data plan," "latest smartphone," and "streaming and games" into the form.

[1370] Step 2:

[1371] The device receives user input information and sends it to the server. Additionally, the device's emotion engine analyzes the user's facial expressions and voice tone to generate emotion data, which is also sent to the server.

[1372] Step 3:

[1373] The server receives user input data and emotion data sent from the terminal. This allows the server to acquire data regarding the user's preferences, conditions, and emotional state.

[1374] Step 4:

[1375] The server analyzes user data, extracting information about the desired plan, devices under consideration, and content the user wants to use from the input data. It also analyzes sentiment data simultaneously.

[1376] Step 5:

[1377] Based on the analysis results, the server selects the plan that best suits the user's desired conditions. For example, for a user who requests an "unlimited data plan," the server matches and selects the applicable plan.

[1378] Step 6:

[1379] Based on the analysis results, the server selects the most suitable device for the user's needs. For example, for a user considering the "latest smartphone," it selects the latest and best-performing device on the market.

[1380] Step 7:

[1381] The server takes emotional data into account and adjusts the suggestions accordingly. For example, if the user is feeling anxious, it will generate suggestions that include detailed explanations.

[1382] Step 8:

[1383] The server generates optimal plan and device suggestions. These suggestions include specific information about the selected plan and device, as well as adjustments based on sentiment data.

[1384] Step 9:

[1385] The server generates a proposal and sends it to the terminal. The proposal is formatted and sent to the terminal quickly.

[1386] Step 10:

[1387] The device receives a suggestion sent from the server. The received suggestion includes the optimal plan based on the conditions entered by the user, device information, and adjustments based on sentiment data.

[1388] Step 11:

[1389] The device displays the suggested results to the user. Specifically, the screen shows detailed information about the best plan and device, along with explanations based on sentiment data.

[1390] Step 12:

[1391] The user reviews the displayed suggestions and, if necessary, asks the sales associate for further explanation. The sales associate then provides prompt and accurate supplementary explanations based on the suggestions.

[1392] This series of processing steps allows users to quickly find the optimal plan and device that matches their preferences, and to make informed choices with confidence as they are provided with appropriate information tailored to their emotional state. This enables sales staff to provide effective supplementary explanations based on the user's needs, significantly reducing customer service time.

[1393] (Example 2)

[1394] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1395] In current retail store systems, users often spend a lot of time selecting their desired communication plan and devices, increasing user stress and the burden on sales staff. Furthermore, suggestions are not made that take into account the user's emotional state, making it difficult for users to obtain appropriate information.

[1396] The identification processing by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes input means for inputting the communication plan desired by the user, the device under consideration, and the content to be used; calculation means for receiving user input and emotion data transmitted from the input means and generating a proposal for the optimal communication plan and device based on the user's wishes and emotional state; and display means for receiving the proposal transmitted from the calculation means and displaying it to the user. As a result, the user can quickly obtain the optimal proposal and make a choice with confidence through detailed explanations based on their emotional state. Furthermore, the burden on store sales staff is reduced, and efficient customer service is realized.

[1397] A "user" refers to a consumer who utilizes the system and provides information regarding the selection of communication plans, devices, and content.

[1398] A "communication plan" refers to the pricing structure and service details for data communication and calls that a user contracts for and uses.

[1399] "Device" is a general term for communication equipment and related devices used by users, including smartphones and tablets.

[1400] "Content" refers to applications and services that users access through their devices, including streaming services and games.

[1401] "Input means" refers to methods and devices for users to input their desired communication plans, devices, and content, including terminals installed in stores.

[1402] "Computational means" refers to processing devices and algorithms that analyze information and emotional data input by users and generate optimal suggestions.

[1403] "Display means" refers to a device or method that visually presents the proposed results generated by the calculation means to the user.

[1404] "Emotional data" refers to information about a user's emotional state, analyzed from their facial expressions, voice tone, and other factors.

[1405] "Recommendation" refers to the selection of the optimal communication plan and device, generated based on the user's preferences and emotional state.

[1406] This invention relates to a system that streamlines terminal sales and communication plan proposals in stores and provides more appropriate suggestions based on the user's emotional state. The system includes input means for inputting the communication plan, device, and content the user wants to use; calculation means for receiving and analyzing user input data and emotional data to generate optimal suggestions; and display means for displaying the suggestions to the user.

[1407] System Configuration

[1408] Hardware configuration

[1409] The input method will be a tablet or computer installed in the store. This will display a form screen where the user can input their desired communication plan, device, and the content they wish to use.

[1410] An emotion engine refers to a device that uses the device's camera and microphone to analyze the user's facial expressions and voice tone in real time.

[1411] High-performance servers are used as the computing means, responsible for complex data analysis and the execution of generative AI models.

[1412] Display methods include the user's terminal screen and digital signage within the store.

[1413] Software Configuration

[1414] The front-end section is constructed using HTML, CSS, and JavaScript, and provides the user interface.

[1415] The backend is built using Python, Node.js, etc., and handles receiving user input, performing data analysis, and calling the generated AI model.

[1416] The emotion engine utilizes machine learning models (e.g., TensorFlow or PyTorch) to analyze the user's emotional state in real time.

[1417] The generative AI model is used to generate detailed suggestions for plan and device selection.

[1418] Specific actions

[1419] The user operates a terminal in the store and inputs their desired communication plan (e.g., "unlimited data plan"), device (e.g., "latest smartphone"), and the content they want to use (e.g., "streaming, games"). Along with this input data, the terminal sends emotion data (e.g., "anxiety") analyzed from the user's facial expressions and voice to the server.

[1420] The server receives this data and first selects the optimal communication plan and device based on the user's preferences. Next, it uses a generative AI model to generate detailed explanations that take into account the user's emotional state. For example, it might generate suggestions such as, "With unlimited data, you can enjoy streaming and gaming comfortably. We also provide 24-hour support after you sign up."

[1421] The generated suggestions are sent back from the server to the terminal and displayed to the user. Based on this information, the user can confidently select a communication plan and device.

[1422] Explanation of specific examples

[1423] For example, if person B is considering a new smartphone and an unlimited data plan but is hesitant to purchase it, the following process will occur:

[1424] 1. Person B enters "unlimited data plan," "latest smartphone," and "streaming, games" into the store terminal screen.

[1425] 2. The emotion engine analyzes Person B's facial expressions and voice tone and detects the emotion data of "anxiety."

[1426] 3. The device sends input data and emotion data to the server.

[1427] 4. The server analyzes user input and selects the optimal communication plan and device.

[1428] 5. The server uses an AI model to generate suggestions with detailed explanations. For example, a suggestion might be: "An unlimited data plan and the latest smartphone are ideal. With unlimited data, you can comfortably enjoy streaming and gaming. We also provide 24-hour support after signing up so you can use it without any worries."

[1429] 6. The server sends this proposal result to the terminal.

[1430] 7. The device displays the proposed results to person B. Person B can make a selection with confidence through the detailed explanations.

[1431] Example of a prompt

[1432] The following is an example of a prompt to input into a generative AI model:

[1433] Based on the user's desired communication plan and device, the content they wish to use, and the results of the emotion engine's analysis, generate a suggestion for the optimal plan and device. If the user appears anxious, add a detailed explanation.

[1434] Input information:

[1435] Plan: Unlimited Data Plan

[1436] Device: Latest smartphone

[1437] Content: Streaming, Games

[1438] Emotion: Anxiety

[1439] This system allows users to receive quick and appropriate suggestions, and by providing detailed explanations based on their emotional state, users can make choices with confidence. This also enables stores to conduct sales activities more efficiently.

[1440] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1441] Step 1:

[1442] The user operates a terminal in the store and enters their desired communication plan, device, and content to be used. Specifically, they enter information such as "unlimited data plan," "latest smartphone," and "streaming, games" into a form displayed on the terminal screen and press the submit button. The entered data is saved to the terminal, and the terminal also uses its built-in camera and microphone to analyze the user's facial expressions and voice using an emotion engine to obtain emotional data such as anxiety and satisfaction.

[1443] Input: User-entered communication plan, device, content information, and user facial expressions and voice data.

[1444] Output: User preference data and sentiment data

[1445] Step 2:

[1446] The device transmits user input data and sentiment data to the server. Specifically, it uses a communication module within the device to transmit data via a secure communication protocol such as HTTPS. This data includes the desired communication plan, device, content information, and sentiment data analyzed by the sentiment engine.

[1447] Input: Communication plan, device, content information, and sentiment data obtained from the user.

[1448] Output: User input and sentiment data sent to the server

[1449] Step 3:

[1450] The server receives user input data and sentiment data transmitted from the terminal. First, the server processes the user's desired communication plan, device, and content information using an analysis algorithm, and selects the communication plan and device that best suit the user's needs.

[1451] Input: Communication plan, device, content information, and sentiment data sent from the device.

[1452] Output: Selection results for the optimal communication plan and devices.

[1453] Step 4:

[1454] The server analyzes the emotion engine data and generates suggestions using a generative AI model. You construct a prompt for the generative AI model, inputting it in the format of "Plan: Unlimited data plan, Device: Latest smartphone, Content: Streaming, Games, Emotion: Anxiety." The generative AI model then generates detailed suggestions and explanations.

[1455] Input: Selection results for optimal communication plan and device, sentiment data

[1456] Output: Detailed suggestions that take into account the user's emotional state.

[1457] Step 5:

[1458] The server generates proposal results, which are then compiled into data packets and securely transmitted to the terminal. This also uses communication protocols such as HTTPS.

[1459] Input: Generated proposal content

[1460] Output: Proposal results sent to the terminal

[1461] Step 6:

[1462] The device analyzes the suggestion result data packets received from the server and displays them appropriately on the user interface. Specifically, the suggestion content is formatted in an easy-to-read way on the screen, and detailed explanations such as "An unlimited data plan and the latest smartphone are ideal. With unlimited data, you can comfortably enjoy streaming and gaming. We also provide 24-hour support after the contract is signed so you can use it without worry" are displayed.

[1463] Input: Suggestion result data packet received from the server

[1464] Output: Optimal plan and device suggestions displayed to the user.

[1465] Step 7:

[1466] Users review the suggested options displayed on their devices and select the most suitable communication plan and device. Specifically, users review the displayed information and make their selections after they are satisfied with the results. This allows users to confidently choose a plan and device that meets their needs.

[1467] Input: Suggestions displayed on the device

[1468] Output: User's final selection

[1469] (Application Example 2)

[1470] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1471] Traditional in-store terminal sales and plan proposal systems had the problem of a complex user selection process, which often led to user anxiety and confusion. Furthermore, because proposals were generated solely based on user input, it was difficult to provide appropriate suggestions that took the user's emotional state into consideration. This could lead to decreased user satisfaction and reduced sales efficiency.

[1472] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes terminal means for the user to input their desired plan, terminal under consideration, and content they wish to use; server means for receiving user input transmitted from the terminal means and generating optimal plan and terminal suggestions based on the user input; display means for receiving suggestions transmitted from the server means and displaying them to the user; and emotion analysis means for analyzing the user's facial expressions and voice tone and recognizing their emotional state. This makes it possible to propose more appropriate plans and terminals based on the user's emotional state, reducing user anxiety and confusion, and improving user satisfaction and sales efficiency.

[1473] "A device for users to input their desired plan, devices under consideration, and content they wish to use" refers to a device for users to input their specific needs, such as a smartphone or tablet.

[1474] "Server means for receiving user input transmitted from the terminal means and generating optimal plan and terminal suggestions based on the user input" refers to a computer system that receives information entered by the user, analyzes that information, and automatically calculates and generates the most suitable suggestions.

[1475] "Display means for receiving and displaying suggestions transmitted from the server means to the user" refers to a device for displaying the suggestion results from the server to the user in a visually and easily understandable manner, and includes displays and monitors.

[1476] "An emotion analysis method that analyzes a user's facial expressions and voice tone to recognize their emotional state" is a technology that uses a camera and microphone to collect a user's facial expressions and voice tone, analyzes them, and identifies the emotional state the user is experiencing.

[1477] This invention relates to a system that streamlines the process of terminal sales and plan proposals in stores and provides more appropriate suggestions based on the user's emotional state. This system comprehensively covers each stage of user input, emotion analysis, suggestion generation, and display.

[1478] 1. Structure

[1479] This system includes the following main components:

[1480] Terminal device: This is the device used by the user to input their desired plan, device under consideration, and content they wish to use. Smartphones and tablets are commonly used as terminal devices.

[1481] Server: A computing system that receives user input transmitted from the terminal and generates optimal plan and terminal suggestions based on that information. The server executes AI algorithms that analyze user data and sentiment data.

[1482] Display means: A device that visually displays suggestions sent from the server means to the user. The display of the terminal means is used as the display means.

[1483] Emotion analysis method: This is a technology for recognizing an emotional state by analyzing the user's facial expressions and voice tone. Specifically, it uses a camera and microphone and the "DeepFace" library.

[1484] 2. Program Processing Flow

[1485] 1. User input:

[1486] Users input their desired plan, the device they are considering, and the content they want to use using their device. For example, they might enter information such as "unlimited data plan," "latest smartphone," and "streaming, games" into the input form.

[1487] 2. Emotion analysis:

[1488] As the user inputs data, the camera and microphone are used to collect the user's facial expressions and voice tone in real time. This data is then analyzed using the "DeepFace" library to recognize the user's emotional state (e.g., anxiety, joy).

[1489] 3. Data transmission:

[1490] The terminal device transmits user input data and sentiment data to the server device. This series of data is sent to the server via an API.

[1491] 4. Proposal generation:

[1492] The server analyzes the received user input data and sentiment data, and executes an algorithm to select the optimal plan and terminal combination. If the sentiment data indicates anxiety, adjustments such as adding detailed explanations are made.

[1493] 5. Suggestion display:

[1494] The suggestions generated by the server are sent back to the terminal and displayed to the user. The user can view detailed suggestions and explanations.

[1495] 3. Usage example

[1496] User prompt message:

[1497] "I have a dark green smartphone and I'm looking for a plan that allows unlimited data usage when exchanging contacts. I've also been enjoying a lot of movies and games lately."

[1498] Based on this prompt, the system will make appropriate suggestions.

[1499] 4. Hardware and Software

[1500] Hardware:

[1501] Smartphones and tablets (devices and display devices)

[1502] Camera and microphone (means of sentiment analysis)

[1503] software:

[1504] Requests library (data transmission)

[1505] DeepFace Library (emotion analysis)

[1506] Server-side AI algorithm (proposal generation)

[1507] In this way, the present invention can efficiently propose optimal plans and devices based on the user's emotional state, thereby improving user satisfaction and sales efficiency.

[1508] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1509] Step 1:

[1510] The user enters their desired plan, device under consideration, and content they wish to use using their device. The information entered by the user (e.g., "unlimited data plan," "latest smartphone," "streaming, games") is collected from the input form on the device. The entered data is then prepared for transmission, reflecting the user's specific preferences.

[1511] Step 2:

[1512] The device collects the user's facial expressions and voice tone using the camera and microphone as the user inputs data. Emotional data is acquired in real time and analyzed using the DeepFace library. As a result of the analysis, the user's emotional state (e.g., anxiety, joy) is recognized. This process provides data on the user's psychological state.

[1513] Step 3:

[1514] The device sends user input data and sentiment data to the server. The data sent via the API includes the user's specific preferences and sentiment analysis results. This allows the server to receive comprehensive user information.

[1515] Step 4:

[1516] The server analyzes the received user input data and selects the optimal plan and device that best suits the user's preferences. The analysis algorithm simultaneously evaluates the user's preferences and emotional state to generate the most suitable recommendations. If the emotional data indicates anxiety, adjustments are made to generate recommendations that include detailed explanations.

[1517] Step 5:

[1518] The server sends the generated proposal results to the terminal. The sent proposal results include details about the selected plan and terminal. Additional information and explanations that correspond to the user's emotional state are also added.

[1519] Step 6:

[1520] The terminal displays the suggested results received from the server to the user. The suggested results displayed on the screen are visually arranged for easy understanding by the user and presented with detailed explanations. This display allows the user to confidently make the choice that best suits their needs.

[1521] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1522] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1523] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[1524] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1525] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[1526] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[1527] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[1528] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[1529] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[1530] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[1531] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[1532] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[1533] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[1534] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1535] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[1536] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[1537] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[1538] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[1539] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[1540] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[1541] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[1542] The following is further disclosed regarding the embodiments described above.

[1543] (Claim 1)

[1544] A terminal device for users to input their desired plan, device under consideration, and content they wish to use,

[1545] A server means for receiving user input transmitted from the terminal means and generating an optimal plan and terminal suggestion based on the user input,

[1546] A display means for receiving a proposal transmitted from the server means and displaying it to the user,

[1547] A system that includes this.

[1548] (Claim 2)

[1549] The system according to claim 1, further comprising means for analyzing the user input and extracting necessary information as a server means.

[1550] (Claim 3)

[1551] The system according to claim 1, wherein the server means further includes means for selecting an optimal plan and means for selecting an optimal terminal based on the user input.

[1552] "Example 1"

[1553] (Claim 1)

[1554] An information processing device for users to input their desired contract, equipment under consideration, and functions they wish to use,

[1555] A computing device for receiving user input transmitted from the information processing device and generating optimal contract and equipment proposals based on the user input,

[1556] A display device for receiving a proposal transmitted from the aforementioned computing device and displaying it to the user,

[1557] A system that includes this.

[1558] (Claim 2)

[1559] The system according to claim 1, further comprising means for the computing device to analyze the user input and extract necessary information.

[1560] (Claim 3)

[1561] The system according to claim 1, further comprising means for selecting the optimal contract and means for selecting the optimal equipment based on the user input of the computing device.

[1562] "Application Example 1"

[1563] (Claim 1)

[1564] An input method for users to enter their desired data plan, devices under consideration, and content they wish to use,

[1565] An analysis means for receiving user input transmitted from the input means and generating an optimal plan and terminal suggestion based on the user input,

[1566] A display means for receiving a proposal transmitted from the analysis means and displaying it to the user,

[1567] Purchase support means for users to purchase or reserve proposed plans and devices if they so desire,

[1568] A system that includes this.

[1569] (Claim 2)

[1570] The system according to claim 1, wherein the analysis means further includes means for analyzing the user input and extracting necessary information.

[1571] (Claim 3)

[1572] The system according to claim 1, wherein the analysis means further includes means for selecting an optimal data plan and means for selecting an optimal terminal based on the user input.

[1573] "Example 2 of combining an emotion engine"

[1574] (Claim 1)

[1575] An input method for the user to input their desired communication plan, the device under consideration, and the content to be used,

[1576] A calculation means for receiving user input and emotion data transmitted from the input means and generating a proposal for an optimal communication plan and device based on the user's wishes and emotional state,

[1577] A display means for receiving a proposal transmitted from the calculation means and displaying it to the user,

[1578] A system that includes this.

[1579] (Claim 2)

[1580] The system according to claim 1, further comprising means for analyzing the user input and emotion data and extracting necessary information.

[1581] (Claim 3)

[1582] The system according to claim 1, wherein the calculation means further includes means for selecting an optimal communication plan and means for selecting an optimal device based on the user input and emotion data.

[1583] "Application example 2 when combining with an emotional engine"

[1584] (Claim 1)

[1585] A terminal device for users to input their desired plan, device under consideration, and content they wish to use,

[1586] A server means for receiving user input transmitted from the terminal means and generating an optimal plan and terminal suggestion based on the user input,

[1587] A display means for receiving a proposal transmitted from the server means and displaying it to the user,

[1588] An emotion analysis means that analyzes the user's facial expressions and voice tone to recognize their emotional state,

[1589] A system that includes this.

[1590] (Claim 2)

[1591] The system according to claim 1, further comprising means for analyzing the user input and extracting necessary information as a server means.

[1592] (Claim 3)

[1593] The system according to claim 1, wherein the server means further includes means for selecting an optimal plan and means for selecting an optimal terminal based on the user input and emotional state. [Explanation of Symbols]

[1594] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A terminal device for users to input their desired plan, device under consideration, and content they wish to use, A server means for receiving user input transmitted from the terminal means and generating an optimal plan and terminal suggestion based on the user input, A display means for receiving a proposal transmitted from the server means and displaying it to the user, A system that includes this.

2. The system according to claim 1, further comprising means for analyzing the user input and extracting necessary information as a server means.

3. The system according to claim 1, wherein the server means further includes means for selecting an optimal plan and means for selecting an optimal terminal based on the user input.

Images