System

Abstract

A system is provided.SOLUTION: The system includes an input means for inputting a desire or a condition of a user, a transmission means for transmitting inputted data to a server, a database retrieval means for acquiring appropriate data based on the desire or the condition of the user, a proposal generation means for generating a plurality of proposals based on the data acquired by the retrieval means, a presentation means for presenting the generated proposals to the user, a selection reception means for receiving a selection of the user, and a processing means for performing the next processing based on the received selection.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Conventional systems have difficulty providing multiple optimal proposals that match the user's desired conditions, and lack a flexible interface to present the proposals in an easy-to-understand manner and encourage the user to make an appropriate selection. As a result, it takes time for users to find the products and services they want, and the user experience is not improved. [Means for solving the problem]

[0005] In order to solve the above-mentioned problems, the present invention provides the following means: a system including input means for a user to input preferences and conditions, transmission means for transmitting the input data to a server, database search means for acquiring appropriate data based on the user's preferences and conditions, proposal generation means for generating a plurality of proposals based on the data acquired by the search means, presentation means for presenting the generated proposals to the user, selection receiving means for receiving the user's selection, and processing means for performing subsequent processing based on the received selection. This allows the user to easily select an optimal option from a plurality of proposals based on the user's desired conditions, thereby improving the user experience.

[0006] "Input means" refers to a device or software interface that allows a user to input their wishes and requirements.

[0007] "Transmission means" refers to a device or software function for transmitting input data to a server.

[0008] The "database search means" is a function that allows the server to search the database for appropriate data based on the user's wishes and conditions.

[0009] The "proposal generating means" is a device or software function for generating a plurality of proposals based on the data acquired by the search means.

[0010] The "presentation means" is a device or software function for displaying or notifying the generated proposal to the user.

[0011] A "selection receiving means" is a device or software function for receiving a user's selection.

[0012] A "processing means" is a device or software function for taking further action based on the received selection. [Brief explanation of the drawings]

[0013] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0014] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0015] First, the terms used in the following description will be explained.

[0016] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0017] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0018] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0019] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0020] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0021] [First embodiment]

[0022] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0023] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0024] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0025] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0026] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0027] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0028] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0029] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0030] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0031] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0032] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0033] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0034] The system of the present invention allows a user to input their wishes and requirements, searches a database based on those requirements, and presents the most suitable proposal. The flow of the system will be specifically explained below.

[0035] The user uses the device to input their preferences and requirements. For example, if a user is looking for a new smartphone, they can input requirements such as "high-resolution camera," "long battery life," and "budget within 50,000 yen."

[0036] This input information is sent to the server via the device. The server analyzes the received information and makes an appropriate query to the database. For example, it may search the database for smartphones that meet the following criteria: a resolution of 48MP or higher, a battery life of 24 hours or more, and a price of less than ¥50,000.

[0037] The server generates three proposals that best match the user's criteria based on information retrieved from the database. These proposals include detailed information about each product (e.g., smartphone specifications, price, benefits, etc.). Specifically, the proposals are generated in the form of "Smartphone A (48MP resolution, 24-hour battery life, price: 48,000 yen)," "Smartphone B (32MP resolution, 30-hour battery life, price: 46,000 yen)," and "Smartphone C (40MP resolution, 26-hour battery life, price: 49,000 yen)."

[0038] The generated proposals are sent from the server to the device and presented to the user through the user interface. The user compares the three proposals and selects the most suitable one. For example, suppose the user selects "Smartphone B."

[0039] This selection information is then sent back to the server via the terminal. Based on the received selection information, the server updates the relevant database, checks inventory, and prepares for the next sales step. Specifically, this may involve starting an inventory check or an order confirmation process.

[0040] This system allows users to easily select the best option from multiple options based on their preferences and conditions, making the purchasing process quick and smooth, thereby improving the user experience.

[0041] The above is a specific embodiment for carrying out the present invention.

[0042] The processing flow will be explained below.

[0043] Step 1:

[0044] The user inputs their wishes and requirements into the terminal.

[0045] Users use the device's input form to enter their preferences and requirements, such as "high-resolution camera," "long battery life," and "budget within 50,000 yen."

[0046] Step 2:

[0047] The terminal transmits the input information to the server.

[0048] The device compiles the user's input preferences and conditions into a data package and sends it to the server, usually in the form of an HTTP request.

[0049] Step 3:

[0050] The server receives and analyzes the user's request.

[0051] The server receives the data package sent from the device, analyzes the user's wishes and requirements, and creates an appropriate query for the database based on the analysis results.

[0052] Step 4:

[0053] The server queries the database to retrieve the relevant data.

[0054] The server uses the analysis results to send a query to the database and retrieve data that matches the user's preferences and conditions. For example, it retrieves information on smartphones that meet the following criteria: a resolution of 48MP or higher, a battery life of 24 hours or more, and a price of less than 50,000 yen.

[0055] Step 5:

[0056] The server generates multiple proposals based on the acquired data.

[0057] Based on the information retrieved from the database, the server generates three proposals that best match the user's criteria: "Smartphone A (48MP resolution, 24-hour battery life, price: 48,000 yen)," "Smartphone B (32MP resolution, 30-hour battery life, price: 46,000 yen)," and "Smartphone C (40MP resolution, 26-hour battery life, price: 49,000 yen)."

[0058] Step 6:

[0059] The server sends the generated proposal to the terminal.

[0060] The server assembles the three generated proposals into a data package and sends it to the terminal.

[0061] Step 7:

[0062] The terminal presents the suggestions in a user interface.

[0063] The device displays the proposals received from the server on a user interface (UI), allowing the user to review and compare the three proposals.

[0064] Step 8:

[0065] The user selects the best offer.

[0066] After reviewing the suggestions, the user selects the most suitable suggestion. For example, the user may select "Smartphone B."

[0067] Step 9:

[0068] The terminal transmits the user's selection to the server.

[0069] The terminal assembles the information selected by the user into a data package and transmits it to the server.

[0070] Step 10:

[0071] The server performs the following process based on the selection result.

[0072] The server receives the user's selection, updates the relevant database, checks stock availability, and prepares for the next sales step. For example, it checks stock availability for "Smartphone B" and proceeds to the next step of confirming the order.

[0073] The above is the specific processing flow of the system program.

[0074] Example 1

[0075] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0076] Conventional systems struggled to quickly and accurately recommend products and services that matched users' preferences and requirements. They also struggled to update the database based on user selections or quickly prepare the next sales step, which sometimes led to a poor user experience. Furthermore, complex query generation and data analysis were required, making their implementation cumbersome and reducing the efficiency of the overall system.

[0077] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0078] In this invention, the server includes a data analysis means for analyzing received data and generating an appropriate query, a database search means for searching a database based on the query and acquiring data that matches the conditions, and a proposal generation means for generating a plurality of proposals based on the acquired data. This enables proposals that quickly and accurately meet the user's wishes and conditions, and enables updating of the database based on the user's selection and rapid preparation for the next sales step.

[0079] "Input means" refers to a device or interface that allows a user to input their wishes and conditions.

[0080] "Transmission means" refers to a function or protocol for transmitting data input from a terminal to a server.

[0081] The "data analysis means" is a function for analyzing data received by the server and generating an appropriate query.

[0082] The "database search means" is a function for searching a database based on the generated query and retrieving data that matches the conditions.

[0083] The "proposal generation means" is a function for generating a plurality of proposals that best match the user's wishes and conditions based on the acquired data.

[0084] A "presentation mechanism" is a function for visually or otherwise displaying generated suggestions to a user.

[0085] The "selection receiving means" is a function for receiving a proposal selected by the user.

[0086] The "processing means" is a function for updating the relevant database and preparing the next sales step based on the received selection information.

[0087] The system of the present invention allows users to input their preferences and requirements, searches a database based on those requirements, and presents optimal proposals. This system is designed to enable users to efficiently select products and services. The following describes in detail the mode for carrying out the invention.

[0088] System Configuration

[0089] The system consists of a terminal used by the user and a server that performs data analysis and generates proposals. The following hardware and software are used:

[0090] Device: A device such as a smartphone, tablet, or personal computer on which users can input their preferences and conditions and view proposals. Applications used are mobile apps using "React Native" or "Flutter (registered trademark)," or web applications using "HTML / CSS" and "JavaScript (registered trademark)."

[0091] Server: A server that performs data analysis, proposal generation, and database management. Server-side programs use "Python" or "Node.js," and databases use "MySQL (registered trademark)" or "PostgreSQL."

[0092] Flow Details

[0093] User Input

[0094] Users input their preferences and requirements into an input form on their device. For example, if they are looking for a new smartphone, they would enter requirements such as "high-resolution camera," "long battery life," and "budget under 50,000 yen." This input information is sent to the server via the application.

[0095] Data analysis by server

[0096] The server analyzes the received user input and generates a search query based on the conditions. For example, it generates a query such as "resolution 48MP or higher," "battery life 24 hours or more," and "price under 50,000 yen." This query is executed against the database on the server.

[0097] Database search

[0098] The server searches the database based on the generated query and retrieves data that matches the conditions. For example, it retrieves data such as "Smartphone A (resolution 48MP, battery life 24 hours, price 48,000 yen)," "Smartphone B (resolution 32MP, battery life 30 hours, price 46,000 yen)," and "Smartphone C (resolution 40MP, battery life 26 hours, price 49,000 yen)" from the database.

[0099] Proposal generation

[0100] The server generates multiple proposals that best match the user's requirements based on the acquired data. These proposals include detailed information about each product. The generated proposal data is then sent from the server to the terminal.

[0101] Presenting the proposal

[0102] The device displays the sent proposal data to the user using a user interface. The user can compare the proposals and select the most suitable one. Specifically, the proposals are displayed in an easy-to-understand list view or card view.

[0103] User Selection and Server Processing

[0104] The user selects the most suitable option from the suggestions, and this selection information is sent back to the server via the terminal. The server updates the relevant database based on the received selection information and prepares for the next sales step, specifically the inventory check and order confirmation process.

[0105] Prompt Sentence Examples

[0106] "Please suggest a smartphone that meets the following criteria: high-resolution camera, long battery life, and a budget of less than ¥50,000."

[0107] One of the features of this system is that it uses a generative AI model to quickly provide proposals that meet the user's needs.In addition, the database is automatically updated and sales steps are prepared based on the user's selection, which is expected to improve the user experience.

[0108] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0109] Step 1:

[0110] The user inputs their preferences and requirements. Specifically, the user uses a smartphone or personal computer to input their desired requirements (e.g., "high-resolution camera," "long battery life," and "budget within 50,000 yen") into an input form in a dedicated application or web browser. The input is in text format, and when the user clicks the "Submit" button, the data is sent from the device to the server.

[0111] Input: User's wishes and conditions

[0112] Output: Data transmission request from the terminal to the server

[0113] Step 2:

[0114] The entered data is sent to the server. The device sends the user's input data to the server as an HTTP POST request. Specifically, the device application (developed with React Native or Flutter) or web browser serializes the data and sends a request to the server's API endpoint.

[0115] Input: Data including user's wishes and conditions

[0116] Output: Data received by the server

[0117] Step 3:

[0118] The server analyzes the received data and generates the appropriate query. Specifically, a server script written in Python or Node.js deserializes the data and generates a condition-based SQL query. This query contains search criteria based on the user's preferences (e.g., "resolution 48MP or higher," "battery life 24 hours or more," "price under ¥50,000").

[0119] Input: Data received from the user

[0120] Output: Generated SQL query

[0121] Step 4:

[0122] The server searches the database based on the generated query. Specifically, the server uses a database engine such as MySQL or PostgreSQL to execute the generated SQL query and retrieve data that matches the criteria. This data includes information such as the smartphone's specifications and price.

[0123] Input: Generated SQL query

[0124] Output: Data retrieved from the database

[0125] Step 5:

[0126] The server generates suggestions based on the acquired data. The server analyzes the data and builds three suggestions in JSON format that best match the user's input criteria. For example, "Smartphone A (48MP resolution, 24-hour battery life, price: ¥48,000)," "Smartphone B (32MP resolution, 30-hour battery life, price: ¥46,000)," and "Smartphone C (40MP resolution, 26-hour battery life, price: ¥49,000)."

[0127] Input: Data retrieved from the database

[0128] Output: JSON data of generated proposals

[0129] Step 6:

[0130] The generated proposal data is sent from the server to the device. Specifically, the server returns the proposal data to the device in an HTTP response.

[0131] Input: JSON data of generated proposals

[0132] Output: Proposal data sent to the device

[0133] Step 7:

[0134] The device displays the received suggestion data in a user interface (UI). Specifically, the device application parses the received JSON data and displays each suggestion in a card view or list view, allowing the user to visually review and compare these suggestions.

[0135] Input: Proposal data sent from the server

[0136] Output: Proposal displayed in the UI

[0137] Step 8:

[0138] The user selects the most suitable suggestion from the presented suggestions by tapping or clicking on the desired suggestion using a touchscreen or mouse, and data based on this selection is sent from the device to the server.

[0139] Input: Suggestion displayed in UI

[0140] Output: User-selected proposal data

[0141] Step 9:

[0142] The selected information is sent from the device to the server. The device sends data about the selected proposal to the server as an HTTP POST request.

[0143] Input: User-selected suggested data

[0144] Output: Selection data received by the server

[0145] Step 10:

[0146] Based on the received selection, the server updates the relevant databases and prepares for the next sales step, i.e., starting the inventory check and order confirmation process. The server updates the inventory database for the selected products and adds the new order to the order database.

[0147] Input: User selected data

[0148] Output: Updated database and ready for next processing step

[0149] (Application example 1)

[0150] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0151] In modern e-commerce, it is difficult for users to quickly find products that meet their needs and requirements. With multiple options available, users are overwhelmed with information and find it difficult to make optimal decisions. In such situations, there is a risk that user satisfaction will decrease and the purchasing process will not proceed smoothly. Furthermore, if the user interface or information presentation method is inappropriate, users will become lost in the search process and find it difficult to select a product efficiently. This significantly impacts the quality of the user experience.

[0152] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0153] In this invention, the server includes input means for the user to input their wishes and conditions, transmission means for transmitting the input data to the server, database search means for acquiring appropriate data based on the user's wishes and conditions, proposal generation means for generating a plurality of proposals based on the data acquired by the search means, presentation means for presenting the generated proposals to the user, selection receiving means for receiving the user's selection, processing means for performing the next process based on the received selection, means for displaying a list of information proposed by the presentation means, and means for sorting the proposed information based on the conditions. This makes it possible to quickly and accurately suggest optimal products based on the conditions entered by the user, and to smoothly progress the purchasing process.

[0154] The "input means" is a means for providing an interface for the user to input their wishes and conditions.

[0155] The "transmission means" is a communication means for transmitting data input by the input means to the server.

[0156] The "database search means" is a means for obtaining appropriate data from a database based on the user's wishes and conditions.

[0157] The "proposal generating means" is a means for generating a plurality of proposals based on the data acquired by the database searching means.

[0158] The "presentation means" is a means for presenting the generated proposal to the user.

[0159] The "selection receiving means" is a means for receiving a proposal selected by the user.

[0160] The "processing means" is a means for carrying out the next process based on the selection received by the selection receiving means.

[0161] The "means for displaying a list" is a means for displaying the proposed information in a list format.

[0162] A "sorting means" is a means for ordering the suggested information based on the user's criteria.

[0163] In this system, users input their preferences and requirements using a terminal. For example, requirements such as "high-resolution camera," "long battery life," and "budget within 50,000 yen." Once the user has completed the input, this data is sent to the server by the terminal. The server analyzes the received data and retrieves the most suitable data using a database search method.

[0164] The database stores various product information, and the search means filters this data to find products that match the user's requirements.The proposal generation means then generates multiple proposals based on the search results.The proposals include detailed product information, such as "48MP resolution," "24-hour battery life," and "price under 50,000 yen."

[0165] The generated suggestions are presented to the user through a presentation means, which visually displays the suggested information on a user interface using a list display means, and further uses a sorting means to order the suggested information based on the user's criteria.

[0166] When the user selects one of the presented suggestions, the selection receiving means receives the selection. The received selection information is sent back to the server, and the server performs the next process (e.g., stock check or order confirmation process) based on the selection information.

[0167] This process is executed in the following situation as a concrete example: When a user inputs the conditions of a smartphone with a resolution of 48MP or more, a battery life of 24 hours or more, and a price of less than 50,000 yen, the server filters multiple products that match the conditions from the database and suggests the three most suitable products. An example of the prompt sentence in this case is as follows.

[0168] If a user enters criteria for a smartphone with a resolution of 48MP or higher, a battery life of 24 hours or more, and a price of less than ¥50,000, suggest three products that meet the criteria. The suggested product details include resolution, battery life, and price. Sort the product information in ascending order by price and descending order by battery life.

[0169] This allows users to quickly find the product that best suits their needs and requirements, and experience a smooth purchasing process based on that selection.

[0170] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0171] Step 1:

[0172] The user uses the device to input their preferences and requirements. Specifically, they enter requirements such as "high-resolution camera," "long battery life," and "budget under 50,000 yen" into the device's input interface (for example, a text field or drop-down list). The input data is converted into JSON or XML format and prepared for transmission to the server in the next step.

[0173] Step 2:

[0174] The device sends the entered data to the server using an HTTP POST request. The input data (preferences and conditions) is sent to the server's API endpoint. The sent data includes all the requirements entered by the user and is used as is for the next process.

[0175] Step 3:

[0176] The server analyzes the received data and generates an appropriate query. Specifically, an application server (e.g., Flask or Django) analyzes the received data and generates a query such as "resolution 48MP or higher," "battery life 24 hours or more," and "price under 50,000 yen." This query is then passed to a database search mechanism.

[0177] Step 4:

[0178] The server retrieves the appropriate data from the database using a database lookup method. Here, an SQL or NoSQL query is used to search for products that match the user's criteria. For example, a query like "SELECT FROM products WHERE resolution >= 48 AND battery_life >= 24 AND price <= 50000" is generated to retrieve data from the database (e.g., MySQL or MongoDB).

[0179] Step 5:

[0180] The server generates a plurality of proposals based on the data retrieved by the search means. The proposal generator creates proposals for each product based on the search results and generates a list including proposal details (resolution, battery life, price, etc.). This proposal list is then prepared for later presentation to the user.

[0181] Step 6:

[0182] The server presents the generated suggestions to the user through a presentation tool. Specifically, the server converts the suggestions into HTML or JSON format and sends them to the device. The device receives the suggestions and displays them in a list on the user interface. The suggestions are sorted based on the user's criteria and are displayed in the optimal order.

[0183] Step 7:

[0184] The user selects one of the presented suggestions. The selected suggestion is sent back to the server by the terminal. The selection information includes the ID and details of the selected product.

[0185] Step 8:

[0186] The server performs the next process (e.g., stock check or order confirmation process) based on the selected proposal. The processing means receives the selection information and executes stock check and order processing. Specifically, it checks the stock status in cooperation with the stock management system, and if there are no problems, it confirms the order and proceeds to the next step, such as shipping procedures.

[0187] This series of processes allows users to quickly find the product that best suits their needs and requirements, and experience a smooth purchasing process.

[0188] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0189] The system of the present invention allows users to input their preferences and requirements, searches a database based on those requirements, and presents optimal suggestions. Furthermore, by recognizing the user's emotions and incorporating them into the proposal generation, the system provides a more personalized experience.

[0190] The user uses the device to input their preferences and requirements. For example, if a user is looking for a new smartphone, they might input requirements such as "high-resolution camera," "long battery life," and "budget under 50,000 yen." The device's built-in camera and microphone are then used to analyze the user's facial expressions and tone of voice, and the emotion engine recognizes the user's emotions.

[0191] This input information and emotion information are sent to a server via the device. The server analyzes the received information and makes an appropriate query to a database. For example, it searches the database for smartphones that meet the following criteria: a resolution of 48MP or higher, a battery life of 24 hours or more, and a price of less than ¥50,000.

[0192] Based on information retrieved from the database, the server generates three suggestions that best match the user's criteria and emotional information. These suggestions include detailed information about each product (e.g., smartphone specifications, price, benefits, etc.). Specifically, the suggestions are generated in the form of "Smartphone A (48MP resolution, 24-hour battery life, price: ¥48,000)," "Smartphone B (32MP resolution, 30-hour battery life, price: ¥46,000)," and "Smartphone C (40MP resolution, 26-hour battery life, price: ¥49,000)." The user's emotions, as recognized by the emotion engine, influence the content of the suggestions. For example, if the user is feeling stressed, it is possible to prioritize simple and easy-to-understand suggestions.

[0193] The generated proposals are sent from the server to the device and presented to the user through a user interface. Through this, the user can review and compare the three proposals. After reviewing the presented proposals, the user selects the most suitable one. For example, suppose the user selects "Smartphone B."

[0194] This selection information and the emotional state at that time are again sent to the server via the device. Based on the received selection information and emotional information, the server updates the relevant database, checks inventory, and prepares for the next sales step. Specifically, it checks the inventory of "Smartphone B" and proceeds to the next order confirmation step.

[0195] By taking the user's emotions into consideration, the system can provide more satisfying suggestions to the user and make the purchasing process go more smoothly, thereby improving the user experience.

[0196] The above is a specific embodiment of the present invention including an emotion engine.

[0197] The processing flow will be explained below.

[0198] Step 1:

[0199] The user inputs their wishes and requirements into the terminal.

[0200] Users use the device's input form to enter their preferences and requirements, such as "high-resolution camera," "long battery life," and "budget within 50,000 yen."

[0201] Step 2:

[0202] The device analyzes the user's facial expressions and tone of voice, and the emotion engine recognizes the user's emotions.

[0203] The device's built-in camera and microphone capture the user's facial expressions and tone of voice, and this information is analyzed by an emotion engine that recognizes emotions such as happiness, stress, and excitement.

[0204] Step 3:

[0205] The terminal transmits the input desires, conditions and emotion information to the server.

[0206] The device compiles the user's input preferences and conditions and the emotional information recognized by the emotion engine into a data package and sends it to the server, usually in the form of an HTTP request.

[0207] Step 4:

[0208] The server receives and analyzes the user's request.

[0209] The server receives the data package sent from the terminal and analyzes the user's wishes, conditions, and emotional information.

[0210] Step 5:

[0211] The server queries the database to retrieve the relevant data.

[0212] The server uses the analysis results to send a query to the database to retrieve data that matches the user's preferences and conditions. For example, it searches the database for smartphones that meet the following criteria: a resolution of 48MP or higher, a battery life of 24 hours or more, and a price of less than 50,000 yen.

[0213] Step 6:

[0214] The server generates multiple proposals based on the acquired data.

[0215] Based on the information retrieved from the database, the server generates three suggestions that best match the user's criteria. Specifically, the suggestions are generated in the form of "Smartphone A (48MP resolution, 24-hour battery life, price: 48,000 yen)," "Smartphone B (32MP resolution, 30-hour battery life, price: 46,000 yen)," and "Smartphone C (40MP resolution, 26-hour battery life, price: 49,000 yen)." The user's emotional information recognized by the emotion engine influences the content of the suggestions. For example, if the user is feeling stressed, simple and easy-to-understand suggestions will be displayed first.

[0216] Step 7:

[0217] The server sends the generated proposal to the terminal.

[0218] The server assembles the three generated proposals into a data package and sends it to the terminal.

[0219] Step 8:

[0220] The terminal presents the suggestions in a user interface.

[0221] The device displays the proposals received from the server on a user interface (UI), allowing the user to review and compare the three proposals.

[0222] Step 9:

[0223] The user selects the best offer.

[0224] After reviewing the suggestions, the user selects the most suitable suggestion. For example, the user may select "Smartphone B."

[0225] Step 10:

[0226] The terminal transmits the user's selection and current emotional state to the server.

[0227] The terminal compiles the information selected by the user and the emotion information at that time into a data package and transmits it to the server.

[0228] Step 11:

[0229] The server performs the following process based on the selection result.

[0230] The server receives the user's selection and emotion information, updates the relevant database, checks inventory, and prepares the next sales step, such as starting the inventory check or order confirmation process.

[0231] The above is the processing flow of a specific embodiment of the present invention that includes an emotion engine.

[0232] Example 2

[0233] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0234] Conventional suggestion systems generally make suggestions based on the user's wishes and conditions, but this has the problem of not being able to make detailed suggestions that take into account the user's emotions and situation. Also, when the user is feeling some kind of stress or anxiety, conventional systems cannot adequately respond, which results in a problem of not sufficiently improving the user experience.

[0235] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0236] In this invention, the server includes an analysis means, a database search means, and a proposal generation means, which makes it possible to analyze not only the user's wishes and conditions but also their emotional information, and generate optimal proposals.

[0237] "Input means" refers to a device or interface that allows a user to input their wishes and requirements into the system.

[0238] The "transmission means" is a function for transmitting the input desires, conditions, and emotional information of the user to the server.

[0239] "Analysis means" is a function for analyzing the data and emotional information received by the server.

[0240] The "database search means" is a function that allows the server to obtain appropriate data from the database based on the user's wishes and conditions.

[0241] The "proposal generation means" is a function that allows the server to generate multiple proposals using a generative AI model based on the analysis results.

[0242] A "presentation means" is a device or interface for presenting generated suggestions to a user.

[0243] The "selective receiving means" is a function for receiving information selected by the user from among the presented proposals.

[0244] The "processing means" is a function for carrying out the next process based on the received selection information and emotion information.

[0245] The system of the present invention allows users to input their preferences and requirements, searches a database based on those requirements, and presents optimal suggestions. Furthermore, by recognizing the user's emotions and incorporating them into the proposal generation, the system provides a more personalized experience.

[0246] The user uses the device to input their preferences and requirements. For example, if a user is looking for a new smartphone, they might input requirements such as "high-resolution camera," "long battery life," and "budget under 50,000 yen." Furthermore, the device's built-in camera and microphone are used to analyze the user's facial expressions and tone of voice, and the emotion engine recognizes the user's emotions. Specifically, a general-purpose AI service can be used as the emotion recognition engine.

[0247] This input and emotion information is sent to the server via the device. The server analyzes the received information and executes appropriate queries against the database. For example, the server might use an SQL query to search the database for smartphones that meet the following criteria: a resolution of 48MP or higher, a battery life of 24 hours or more, and a price of less than ¥50,000.

[0248] Based on information retrieved from the database, the server generates three proposals that best match the user's criteria and emotional information. These proposals include detailed information about each product (e.g., smartphone specifications, price, benefits, etc.). Specifically, using a generative AI model, the following proposals are generated: "Smartphone A (48MP resolution, 24-hour battery life, price: ¥48,000)," "Smartphone B (32MP resolution, 30-hour battery life, price: ¥46,000)," and "Smartphone C (40MP resolution, 26-hour battery life, price: ¥49,000)." The user's emotions, as recognized by the emotion engine, influence the content of the proposals. For example, if the user is feeling stressed, it is possible to prioritize simple and easy-to-understand proposals.

[0249] The generated proposals are sent from the server to the device and presented to the user through a user interface. Through this, the user can review and compare the three proposals. After reviewing the presented proposals, the user selects the most suitable one. For example, suppose the user selects "Smartphone B."

[0250] This selection information and the emotional state at that time are again sent to the server via the device. Based on the received selection information and emotional information, the server updates the relevant database, checks inventory, and prepares for the next sales step. Specifically, it checks the inventory of "Smartphone B" and proceeds to the next order confirmation step.

[0251] By taking the user's emotions into consideration, the system can provide more satisfying suggestions to the user and make the purchasing process go more smoothly, thereby improving the user experience.

[0252] Examples:

[0253] If a user inputs the criteria "high-resolution camera, long battery life, budget within 50,000 yen" and the facial expression recognition engine determines that the user is stressed, the server will generate simple suggestions such as "Smartphone A (resolution 48MP, battery life 24 hours, price 48,000 yen)," "Smartphone B (resolution 32MP, battery life 30 hours, price 46,000 yen)," and "Smartphone C (resolution 40MP, battery life 26 hours, price 49,000 yen)."

[0254] Example prompt sentence:

[0255] "Generate three optimal suggestions for a user looking for a smartphone with a high-resolution camera, long battery life, and a budget of less than $50,000. If the user is stressed, prioritize the simpler suggestions."

[0256] The above is a specific embodiment of the present invention using an emotion engine and a generative AI model.

[0257] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0258] Step 1:

[0259] The user uses the terminal to input their wishes and requirements.

[0260] Input: User's wishes and requirements (e.g., "high-resolution camera," "long battery life," "budget within 50,000 yen")

[0261] Specific operation: The user enters their wishes and conditions into the terminal's input interface and presses the send button.

[0262] Step 2:

[0263] The device recognizes the user's emotions.

[0264] Input: The user's facial expressions and tone of voice captured through the device's camera and microphone

[0265] How it works: The device's built-in camera captures the user's facial expressions, and the microphone records the tone of voice. The emotion recognition engine analyzes this data to determine the user's emotional state.

[0266] Step 3:

[0267] The device sends the input desires, conditions and emotion information to the server.

[0268] Input: Hopes, conditions, emotional information

[0269] Output: JSON data sent to the server

[0270] Specific operation: The device collects the wishes, conditions, and emotional information into a single JSON object and sends it to the server using the HTTP protocol.

[0271] Step 4:

[0272] The server analyzes the received information.

[0273] Input: JSON data received by the server

[0274] Output: Analysis results (user's wishes, conditions, emotional information)

[0275] Specific operation: The server parses the JSON data and extracts information such as preferences, conditions, and emotions. For example, data such as "high-resolution camera," "long battery life," "budget under ¥50,000," and "stress" are extracted.

[0276] Step 5:

[0277] The server searches the database.

[0278] Input: Data on your wishes and conditions

[0279] Output: A list of matching smartphones retrieved from the database

[0280] Specific operation: The server generates an SQL query and searches the database for smartphones that match the following criteria, for example, "resolution of 48MP or more," "battery life of 24 hours or more," and "price under 50,000 yen."

[0281] Step 6:

[0282] The server generates the best offer.

[0283] Input: List of smartphones obtained from the database, emotional information

[0284] Output: Suggestion list (e.g. "Smartphone A", "Smartphone B", "Smartphone C")

[0285] How it works: The server uses a generative AI model to generate optimal suggestions based on acquired smartphone data. It adjusts the priority and content of suggestions based on emotional information, and generates suggestions in a simple, easy-to-understand format.

[0286] Step 7:

[0287] The server sends the generated proposal to the terminal.

[0288] Input: Suggestion list

[0289] Output: JSON data sent to the terminal

[0290] Specific operation: The server converts the proposal list into JSON format and sends it to the terminal using the HTTP protocol.

[0291] Step 8:

[0292] The terminal presents the generated suggestions to the user.

[0293] Input: Proposal list received from the server

[0294] Output: Proposal displayed in the user interface

[0295] Specific behavior: The device receives the list of suggestions and displays it on the user interface, allowing the user to review and compare the suggestions.

[0296] Step 9:

[0297] The user selects the best offer.

[0298] Input: The suggestions displayed (e.g., "Smartphone A," "Smartphone B," "Smartphone C")

[0299] Output: Selected suggestion (e.g. "Smartphone B")

[0300] Specific operation: The user selects the best one from the presented suggestions and presses the select button.

[0301] Step 10:

[0302] The terminal transmits the selection information and emotion information to the server.

[0303] Input: Selection information, emotion information

[0304] Output: JSON data sent to the server

[0305] Specific operation: The device combines the selection information and emotion information into a single JSON object and sends it to the server using the HTTP protocol.

[0306] Step 11:

[0307] The server updates the database and performs the following steps:

[0308] Input: Selection information, emotion information

[0309] Output: Update the database and prepare for further processing

[0310] Specific operation: Based on the selection information and emotion information received by the server, the database is updated, the inventory of "Smartphone B" is checked, and the next order confirmation step is prepared.

[0311] (Application example 2)

[0312] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0313] Conventional online shopping site systems could suggest products based on the user's desired products and conditions, but they were unable to consider the user's emotions. As a result, users were often confused by the large number of suggested product options, or conversely, felt that the suggested products were inappropriate. To solve this problem and increase user satisfaction, it is necessary to recognize the user's emotions and reflect them in the product suggestions.

[0314] The specification processing by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes input means for the user to input their wishes and conditions, transmission means for transmitting the input data to the server, database search means for acquiring appropriate data based on the user's wishes and conditions, proposal generation means for generating a plurality of proposals based on the data acquired by the search means, presentation means for presenting the generated proposals to the user, emotion recognition means for recognizing the user's emotions, emotion reflection means for generating proposals taking into account the emotions recognized by the emotion recognition means, selection receiving means for receiving the user's selection, and processing means for performing the next process based on the received selection. This enables personalized product proposals that take into account the user's emotions.

[0315] The "input means" is an interface device that allows the user to input their wishes and conditions.

[0316] The "transmitting means" is a communication device for transmitting input data to a server.

[0317] The "database search means" is a device for retrieving appropriate data from a database based on the user's wishes and conditions.

[0318] The "proposal generating means" is a device for generating a plurality of proposals based on the data acquired by the search means.

[0319] The "presentation means" is a device for displaying the generated proposals on a user interface.

[0320] The "emotion recognition means" is a device for recognizing the user's emotions from facial expressions, tone of voice, and the like.

[0321] The "emotion reflection means" is a device for generating a suggestion by taking into consideration the emotion recognized by the emotion recognition means.

[0322] The "selection receiving means" is a device for receiving a user's selection.

[0323] A "processing means" is a device for taking further action based on the received selection.

[0324] The system based on the present invention allows a user to input their wishes and requirements and makes optimal product suggestions through emotion recognition. This system comprises an input means, a transmission means, a database search means, a suggestion generation means, a presentation means, an emotion recognition means, an emotion reflection means, a selection and reception means, and a processing means. These means will be described in detail below.

[0325] System Configuration

[0326] 1. Input method:

[0327] It is a means by which users input their preferences and requirements (e.g., high-resolution camera, long battery life, budget, etc.) using a smartphone or other interface device.

[0328] 2. Means of transmission:

[0329] The entered data is sent from the user's device to the server via Wi-Fi or mobile data communication.

[0330] 3. Database search methods:

[0331] The server searches for information in a database based on the received user's wishes and requirements. This database contains detailed information about various products.

[0332] 4. Proposal generation means:

[0333] Based on the searched data, the system generates multiple proposals that match the user's preferences and requirements, including detailed information such as smartphone specifications, prices, and benefits.

[0334] 5. Means of presentation:

[0335] A means for visually presenting the generated suggestions to the user, such as on a smartphone screen or other display device.

[0336] 6. Emotion recognition means:

[0337] The device's camera and microphone are used to analyze the user's facial expressions and tone of voice, using software such as OpenCV and DeepFace.

[0338] 7. Emotional reflection means:

[0339] Based on the recognized emotional information, more personalized suggestions are generated, such as prioritizing simpler suggestions if the user is feeling stressed.

[0340] 8. Selective Reception Method:

[0341] This is a means for receiving information selected by the user from among the suggestions presented.

[0342] 9. Processing Methods:

[0343] It is a means for taking the next step (for example, checking stock availability or placing an order) based on the received selection information.

[0344] Processing flow

[0345] After the user inputs their preferences and conditions, the server receives them and searches the database. Next, the server recognizes the user's emotions through analysis by the emotion recognition means, reflects this in the proposal generation means, and generates appropriate proposals. Finally, the server displays the proposals to the user through the presentation means, receives the user's selection information, and performs the next process.

[0346] Specific examples

[0347] For example, if a user enters the criteria "high-resolution camera," "long battery life," and "budget within 50,000 yen," the system will search the database for these criteria and generate suggestions such as "Smartphone A (resolution 48MP, battery life 24 hours, price 48,000 yen)," "Smartphone B (resolution 32MP, battery life 30 hours, price 46,000 yen)," and "Smartphone C (resolution 40MP, battery life 26 hours, price 49,000 yen)."

[0348] Furthermore, if the system recognizes that the user is feeling "stressed" based on their facial expression, it will preferentially suggest "Smartphone B," which is simple and easy to understand.

[0349] Example prompts to input to a generative AI model:

[0350] "Consider the user's conditions: high-resolution camera, long battery life, budget within 50,000 yen, and generate optimal product suggestions when the user is feeling stressed."

[0351] With the above configuration, the present invention can realize personalized product proposals that take into account the user's emotions, and can make the purchasing process go more smoothly.

[0352] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0353] Step 1:

[0354] The user inputs their preferences and requirements, such as "high-resolution camera," "long battery life," and "budget within 50,000 yen," using a terminal. The input data is collected via the terminal's input means.

[0355] Step 2:

[0356] The terminal transmits the input data to the server, and the input data is sent to the server via the Internet using the transmission means.

[0357] Step 3:

[0358] The server searches the database based on the received data. Specifically, it uses the database search means to retrieve information on products that match the criteria of "high-resolution camera," "long battery life," and "budget within 50,000 yen."

[0359] Step 4:

[0360] The server generates a plurality of proposals based on the acquired data, using a proposal generation means to generate a plurality of proposals including detailed product information (e.g., specifications, price, advantages, etc. of the smartphone) based on the search results.

[0361] Step 5:

[0362] To recognize the user's emotions, the device uses a camera and microphone to capture the user's facial expressions and tone of voice, and then uses emotion recognition means to analyze the captured data and recognize the user's emotions.

[0363] Step 6:

[0364] The server generates suggestions taking into account the recognized emotions. Using an emotion reflection mechanism, the server adjusts the content of the suggestions based on the recognized emotional state to generate suggestions that are more acceptable to the user. For example, if the user is feeling stressed, simpler suggestions are prioritized.

[0365] Step 7:

[0366] The server transmits the generated proposal to the terminal, and the proposal is sent to the terminal using the presentation means in a format to be displayed on a user interface, so as to be visually presented to the user.

[0367] Step 8:

[0368] The user selects one of the multiple proposals presented, and the terminal collects the selected proposal information using the selection receiving means.

[0369] Step 9:

[0370] The terminal transmits the selected proposal information to the server, and the selected information is again sent to the server using the transmission means.

[0371] Step 10:

[0372] The server then performs the following process based on the received selection information: using the processing means to process the next step, such as checking stock availability and placing an order, to facilitate the user's purchasing process.

[0373] The above are the specific processing steps of the system that realizes the application example.

[0374] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0375] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0376] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0377] [Second embodiment]

[0378] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0379] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0380] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0381] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0382] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0383] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0384] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0385] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0386] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0387] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0388] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0389] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0390] The system of the present invention allows a user to input their wishes and requirements, searches a database based on those requirements, and presents the most suitable proposal. The flow of the system will be specifically explained below.

[0391] The user uses the device to input their preferences and requirements. For example, if a user is looking for a new smartphone, they can input requirements such as "high-resolution camera," "long battery life," and "budget within 50,000 yen."

[0392] This input information is sent to the server via the device. The server analyzes the received information and makes an appropriate query to the database. For example, it may search the database for smartphones that meet the following criteria: a resolution of 48MP or higher, a battery life of 24 hours or more, and a price of less than ¥50,000.

[0393] The server generates three proposals that best match the user's criteria based on information retrieved from the database. These proposals include detailed information about each product (e.g., smartphone specifications, price, benefits, etc.). Specifically, the proposals are generated in the form of "Smartphone A (48MP resolution, 24-hour battery life, price: 48,000 yen)," "Smartphone B (32MP resolution, 30-hour battery life, price: 46,000 yen)," and "Smartphone C (40MP resolution, 26-hour battery life, price: 49,000 yen)."

[0394] The generated proposals are sent from the server to the device and presented to the user through the user interface. The user compares the three proposals and selects the most suitable one. For example, suppose the user selects "Smartphone B."

[0395] This selection information is then sent back to the server via the terminal. Based on the received selection information, the server updates the relevant database, checks inventory, and prepares for the next sales step. Specifically, this may involve starting an inventory check or an order confirmation process.

[0396] This system allows users to easily select the best option from multiple options based on their preferences and conditions, making the purchasing process quick and smooth, thereby improving the user experience.

[0397] The above is a specific embodiment for carrying out the present invention.

[0398] The processing flow will be explained below.

[0399] Step 1:

[0400] The user inputs their wishes and requirements into the terminal.

[0401] Users use the device's input form to enter their preferences and requirements, such as "high-resolution camera," "long battery life," and "budget within 50,000 yen."

[0402] Step 2:

[0403] The terminal transmits the input information to the server.

[0404] The device compiles the user's input preferences and conditions into a data package and sends it to the server, usually in the form of an HTTP request.

[0405] Step 3:

[0406] The server receives and analyzes the user's request.

[0407] The server receives the data package sent from the device, analyzes the user's wishes and requirements, and creates an appropriate query for the database based on the analysis results.

[0408] Step 4:

[0409] The server queries the database to retrieve the relevant data.

[0410] The server uses the analysis results to send a query to the database and retrieve data that matches the user's preferences and conditions. For example, it retrieves information on smartphones that meet the following criteria: a resolution of 48MP or higher, a battery life of 24 hours or more, and a price of less than 50,000 yen.

[0411] Step 5:

[0412] The server generates multiple proposals based on the acquired data.

[0413] Based on the information retrieved from the database, the server generates three proposals that best match the user's criteria: "Smartphone A (48MP resolution, 24-hour battery life, price: 48,000 yen)," "Smartphone B (32MP resolution, 30-hour battery life, price: 46,000 yen)," and "Smartphone C (40MP resolution, 26-hour battery life, price: 49,000 yen)."

[0414] Step 6:

[0415] The server sends the generated proposal to the terminal.

[0416] The server assembles the three generated proposals into a data package and sends it to the terminal.

[0417] Step 7:

[0418] The terminal presents the suggestions in a user interface.

[0419] The device displays the proposals received from the server on a user interface (UI), allowing the user to review and compare the three proposals.

[0420] Step 8:

[0421] The user selects the best offer.

[0422] After reviewing the suggestions, the user selects the most suitable suggestion. For example, the user may select "Smartphone B."

[0423] Step 9:

[0424] The terminal transmits the user's selection to the server.

[0425] The terminal assembles the information selected by the user into a data package and transmits it to the server.

[0426] Step 10:

[0427] The server performs the following process based on the selection result.

[0428] The server receives the user's selection, updates the relevant database, checks stock availability, and prepares for the next sales step. For example, it checks stock availability for "Smartphone B" and proceeds to the next step of confirming the order.

[0429] The above is the specific processing flow of the system program.

[0430] Example 1

[0431] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0432] Conventional systems struggled to quickly and accurately recommend products and services that matched users' preferences and requirements. They also struggled to update the database based on user selections or quickly prepare the next sales step, which sometimes led to a poor user experience. Furthermore, complex query generation and data analysis were required, making their implementation cumbersome and reducing the efficiency of the overall system.

[0433] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0434] In this invention, the server includes a data analysis means for analyzing received data and generating an appropriate query, a database search means for searching a database based on the query and acquiring data that matches the conditions, and a proposal generation means for generating a plurality of proposals based on the acquired data. This enables proposals that quickly and accurately meet the user's wishes and conditions, and enables updating of the database based on the user's selection and rapid preparation for the next sales step.

[0435] "Input means" refers to a device or interface that allows a user to input their wishes and conditions.

[0436] "Transmission means" refers to a function or protocol for transmitting data input from a terminal to a server.

[0437] The "data analysis means" is a function for analyzing data received by the server and generating an appropriate query.

[0438] The "database search means" is a function for searching a database based on the generated query and retrieving data that matches the conditions.

[0439] The "proposal generation means" is a function for generating a plurality of proposals that best match the user's wishes and conditions based on the acquired data.

[0440] A "presentation mechanism" is a function for visually or otherwise displaying generated suggestions to a user.

[0441] The "selection receiving means" is a function for receiving a proposal selected by the user.

[0442] The "processing means" is a function for updating the relevant database and preparing the next sales step based on the received selection information.

[0443] The system of the present invention allows users to input their preferences and requirements, searches a database based on those requirements, and presents optimal proposals. This system is designed to enable users to efficiently select products and services. The following describes in detail the mode for carrying out the invention.

[0444] System Configuration

[0445] The system consists of a terminal used by the user and a server that performs data analysis and generates proposals. The following hardware and software are used:

[0446] Device: A device such as a smartphone, tablet, or personal computer on which users can input their preferences and conditions and view proposals. Applications used are mobile apps using "React Native" or "Flutter," or web applications using "HTML / CSS" and "JavaScript."

[0447] Server: A server that performs data analysis, proposal generation, and database management. Server-side programs use "Python" or "Node.js," and databases use "MySQL" or "PostgreSQL."

[0448] Flow Details

[0449] User Input

[0450] Users input their preferences and requirements into an input form on their device. For example, if they are looking for a new smartphone, they would enter requirements such as "high-resolution camera," "long battery life," and "budget under 50,000 yen." This input information is sent to the server via the application.

[0451] Data analysis by server

[0452] The server analyzes the received user input and generates a search query based on the conditions. For example, it generates a query such as "resolution 48MP or higher," "battery life 24 hours or more," and "price under 50,000 yen." This query is executed against the database on the server.

[0453] Database search

[0454] The server searches the database based on the generated query and retrieves data that matches the conditions. For example, it retrieves data such as "Smartphone A (resolution 48MP, battery life 24 hours, price 48,000 yen)," "Smartphone B (resolution 32MP, battery life 30 hours, price 46,000 yen)," and "Smartphone C (resolution 40MP, battery life 26 hours, price 49,000 yen)" from the database.

[0455] Proposal generation

[0456] The server generates multiple proposals that best match the user's requirements based on the acquired data. These proposals include detailed information about each product. The generated proposal data is then sent from the server to the terminal.

[0457] Presenting the proposal

[0458] The device displays the sent proposal data to the user using a user interface. The user can compare the proposals and select the most suitable one. Specifically, the proposals are displayed in an easy-to-understand list view or card view.

[0459] User Selection and Server Processing

[0460] The user selects the most suitable option from the suggestions, and this selection information is sent back to the server via the terminal. The server updates the relevant database based on the received selection information and prepares for the next sales step, specifically the inventory check and order confirmation process.

[0461] Prompt Sentence Examples

[0462] "Please suggest a smartphone that meets the following criteria: high-resolution camera, long battery life, and a budget of less than ¥50,000."

[0463] One of the features of this system is that it uses a generative AI model to quickly provide proposals that meet the user's needs.In addition, the database is automatically updated and sales steps are prepared based on the user's selection, which is expected to improve the user experience.

[0464] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0465] Step 1:

[0466] The user inputs their preferences and requirements. Specifically, the user uses a smartphone or personal computer to input their desired requirements (e.g., "high-resolution camera," "long battery life," and "budget within 50,000 yen") into an input form in a dedicated application or web browser. The input is in text format, and when the user clicks the "Submit" button, the data is sent from the device to the server.

[0467] Input: User's wishes and conditions

[0468] Output: Data transmission request from the terminal to the server

[0469] Step 2:

[0470] The entered data is sent to the server. The device sends the user's input data to the server as an HTTP POST request. Specifically, the device application (developed with React Native or Flutter) or web browser serializes the data and sends a request to the server's API endpoint.

[0471] Input: Data including user's wishes and conditions

[0472] Output: Data received by the server

[0473] Step 3:

[0474] The server analyzes the received data and generates the appropriate query. Specifically, a server script written in Python or Node.js deserializes the data and generates a condition-based SQL query. This query contains search criteria based on the user's preferences (e.g., "resolution 48MP or higher," "battery life 24 hours or more," "price under ¥50,000").

[0475] Input: Data received from the user

[0476] Output: Generated SQL query

[0477] Step 4:

[0478] The server searches the database based on the generated query. Specifically, the server uses a database engine such as MySQL or PostgreSQL to execute the generated SQL query and retrieve data that matches the criteria. This data includes information such as the smartphone's specifications and price.

[0479] Input: Generated SQL query

[0480] Output: Data retrieved from the database

[0481] Step 5:

[0482] The server generates suggestions based on the acquired data. The server analyzes the data and builds three suggestions in JSON format that best match the user's input criteria. For example, "Smartphone A (48MP resolution, 24-hour battery life, price: ¥48,000)," "Smartphone B (32MP resolution, 30-hour battery life, price: ¥46,000)," and "Smartphone C (40MP resolution, 26-hour battery life, price: ¥49,000)."

[0483] Input: Data retrieved from the database

[0484] Output: JSON data of generated proposals

[0485] Step 6:

[0486] The generated proposal data is sent from the server to the device. Specifically, the server returns the proposal data to the device in an HTTP response.

[0487] Input: JSON data of generated proposals

[0488] Output: Proposal data sent to the device

[0489] Step 7:

[0490] The device displays the received suggestion data in a user interface (UI). Specifically, the device application parses the received JSON data and displays each suggestion in a card view or list view, allowing the user to visually review and compare these suggestions.

[0491] Input: Proposal data sent from the server

[0492] Output: Proposal displayed in the UI

[0493] Step 8:

[0494] The user selects the most suitable suggestion from the presented suggestions by tapping or clicking on the desired suggestion using a touchscreen or mouse, and data based on this selection is sent from the device to the server.

[0495] Input: Suggestion displayed in UI

[0496] Output: User-selected proposal data

[0497] Step 9:

[0498] The selected information is sent from the device to the server. The device sends data about the selected proposal to the server as an HTTP POST request.

[0499] Input: User-selected suggested data

[0500] Output: Selection data received by the server

[0501] Step 10:

[0502] Based on the received selection, the server updates the relevant databases and prepares for the next sales step, i.e., starting the inventory check and order confirmation process. The server updates the inventory database for the selected products and adds the new order to the order database.

[0503] Input: User selected data

[0504] Output: Updated database and ready for next processing step

[0505] (Application example 1)

[0506] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0507] In modern e-commerce, it is difficult for users to quickly find products that meet their needs and requirements. With multiple options available, users are overwhelmed with information and find it difficult to make optimal decisions. In such situations, there is a risk that user satisfaction will decrease and the purchasing process will not proceed smoothly. Furthermore, if the user interface or information presentation method is inappropriate, users will become lost in the search process and find it difficult to select a product efficiently. This significantly impacts the quality of the user experience.

[0508] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0509] In this invention, the server includes input means for the user to input their wishes and conditions, transmission means for transmitting the input data to the server, database search means for acquiring appropriate data based on the user's wishes and conditions, proposal generation means for generating a plurality of proposals based on the data acquired by the search means, presentation means for presenting the generated proposals to the user, selection receiving means for receiving the user's selection, processing means for performing the next process based on the received selection, means for displaying a list of information proposed by the presentation means, and means for sorting the proposed information based on the conditions. This makes it possible to quickly and accurately suggest optimal products based on the conditions entered by the user, and to smoothly progress the purchasing process.

[0510] The "input means" is a means for providing an interface for the user to input their wishes and conditions.

[0511] The "transmission means" is a communication means for transmitting data input by the input means to the server.

[0512] The "database search means" is a means for obtaining appropriate data from a database based on the user's wishes and conditions.

[0513] The "proposal generating means" is a means for generating a plurality of proposals based on the data acquired by the database searching means.

[0514] The "presentation means" is a means for presenting the generated proposal to the user.

[0515] The "selection receiving means" is a means for receiving a proposal selected by the user.

[0516] The "processing means" is a means for carrying out the next process based on the selection received by the selection receiving means.

[0517] The "means for displaying a list" is a means for displaying the proposed information in a list format.

[0518] A "sorting means" is a means for ordering the suggested information based on the user's criteria.

[0519] In this system, users input their preferences and requirements using a terminal. For example, requirements such as "high-resolution camera," "long battery life," and "budget within 50,000 yen." Once the user has completed the input, this data is sent to the server by the terminal. The server analyzes the received data and retrieves the most suitable data using a database search method.

[0520] The database stores various product information, and the search means filters this data to find products that match the user's requirements.The proposal generation means then generates multiple proposals based on the search results.The proposals include detailed product information, such as "48MP resolution," "24-hour battery life," and "price under 50,000 yen."

[0521] The generated suggestions are presented to the user through a presentation means, which visually displays the suggested information on a user interface using a list display means, and further uses a sorting means to order the suggested information based on the user's criteria.

[0522] When the user selects one of the presented suggestions, the selection receiving means receives the selection. The received selection information is sent back to the server, and the server performs the next process (e.g., stock check or order confirmation process) based on the selection information.

[0523] This process is executed in the following situation as a concrete example: When a user inputs the conditions of a smartphone with a resolution of 48MP or more, a battery life of 24 hours or more, and a price of less than 50,000 yen, the server filters multiple products that match the conditions from the database and suggests the three most suitable products. An example of the prompt sentence in this case is as follows.

[0524] If a user enters criteria for a smartphone with a resolution of 48MP or higher, a battery life of 24 hours or more, and a price of less than ¥50,000, suggest three products that meet the criteria. The suggested product details include resolution, battery life, and price. Sort the product information in ascending order by price and descending order by battery life.

[0525] This allows users to quickly find the product that best suits their needs and requirements, and experience a smooth purchasing process based on that selection.

[0526] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0527] Step 1:

[0528] The user uses the device to input their preferences and requirements. Specifically, they enter requirements such as "high-resolution camera," "long battery life," and "budget under 50,000 yen" into the device's input interface (for example, a text field or drop-down list). The input data is converted into JSON or XML format and prepared for transmission to the server in the next step.

[0529] Step 2:

[0530] The device sends the entered data to the server using an HTTP POST request. The input data (preferences and conditions) is sent to the server's API endpoint. The sent data includes all the requirements entered by the user and is used as is for the next process.

[0531] Step 3:

[0532] The server analyzes the received data and generates an appropriate query. Specifically, an application server (e.g., Flask or Django) analyzes the received data and generates a query such as "resolution 48MP or higher," "battery life 24 hours or more," and "price under 50,000 yen." This query is then passed to a database search mechanism.

[0533] Step 4:

[0534] The server retrieves the appropriate data from the database using a database lookup method. Here, an SQL or NoSQL query is used to search for products that match the user's criteria. For example, a query like "SELECT FROM products WHERE resolution >= 48 AND battery_life >= 24 AND price <= 50000" is generated to retrieve data from the database (e.g., MySQL or MongoDB).

[0535] Step 5:

[0536] The server generates a plurality of proposals based on the data retrieved by the search means. The proposal generator creates proposals for each product based on the search results and generates a list including proposal details (resolution, battery life, price, etc.). This proposal list is then prepared for later presentation to the user.

[0537] Step 6:

[0538] The server presents the generated suggestions to the user through a presentation tool. Specifically, the server converts the suggestions into HTML or JSON format and sends them to the device. The device receives the suggestions and displays them in a list on the user interface. The suggestions are sorted based on the user's criteria and are displayed in the optimal order.

[0539] Step 7:

[0540] The user selects one of the presented suggestions. The selected suggestion is sent back to the server by the terminal. The selection information includes the ID and details of the selected product.

[0541] Step 8:

[0542] The server performs the next process (e.g., stock check or order confirmation process) based on the selected proposal. The processing means receives the selection information and executes stock check and order processing. Specifically, it checks the stock status in cooperation with the stock management system, and if there are no problems, it confirms the order and proceeds to the next step, such as shipping procedures.

[0543] This series of processes allows users to quickly find the product that best suits their needs and requirements, and experience a smooth purchasing process.

[0544] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0545] The system of the present invention allows users to input their preferences and requirements, searches a database based on those requirements, and presents optimal suggestions. Furthermore, by recognizing the user's emotions and incorporating them into the proposal generation, the system provides a more personalized experience.

[0546] The user uses the device to input their preferences and requirements. For example, if a user is looking for a new smartphone, they might input requirements such as "high-resolution camera," "long battery life," and "budget under 50,000 yen." The device's built-in camera and microphone are then used to analyze the user's facial expressions and tone of voice, and the emotion engine recognizes the user's emotions.

[0547] This input information and emotion information are sent to a server via the device. The server analyzes the received information and makes an appropriate query to a database. For example, it searches the database for smartphones that meet the following criteria: a resolution of 48MP or higher, a battery life of 24 hours or more, and a price of less than ¥50,000.

[0548] Based on information retrieved from the database, the server generates three suggestions that best match the user's criteria and emotional information. These suggestions include detailed information about each product (e.g., smartphone specifications, price, benefits, etc.). Specifically, the suggestions are generated in the form of "Smartphone A (48MP resolution, 24-hour battery life, price: ¥48,000)," "Smartphone B (32MP resolution, 30-hour battery life, price: ¥46,000)," and "Smartphone C (40MP resolution, 26-hour battery life, price: ¥49,000)." The user's emotions, as recognized by the emotion engine, influence the content of the suggestions. For example, if the user is feeling stressed, it is possible to prioritize simple and easy-to-understand suggestions.

[0549] The generated proposals are sent from the server to the device and presented to the user through a user interface. Through this, the user can review and compare the three proposals. After reviewing the presented proposals, the user selects the most suitable one. For example, suppose the user selects "Smartphone B."

[0550] This selection information and the emotional state at that time are again sent to the server via the device. Based on the received selection information and emotional information, the server updates the relevant database, checks inventory, and prepares for the next sales step. Specifically, it checks the inventory of "Smartphone B" and proceeds to the next order confirmation step.

[0551] By taking the user's emotions into consideration, the system can provide more satisfying suggestions to the user and make the purchasing process go more smoothly, thereby improving the user experience.

[0552] The above is a specific embodiment of the present invention including an emotion engine.

[0553] The processing flow will be explained below.

[0554] Step 1:

[0555] The user inputs their wishes and requirements into the terminal.

[0556] Users use the device's input form to enter their preferences and requirements, such as "high-resolution camera," "long battery life," and "budget within 50,000 yen."

[0557] Step 2:

[0558] The device analyzes the user's facial expressions and tone of voice, and the emotion engine recognizes the user's emotions.

[0559] The device's built-in camera and microphone capture the user's facial expressions and tone of voice, and this information is analyzed by an emotion engine that recognizes emotions such as happiness, stress, and excitement.

[0560] Step 3:

[0561] The terminal transmits the input desires, conditions and emotion information to the server.

[0562] The device compiles the user's input preferences and conditions and the emotional information recognized by the emotion engine into a data package and sends it to the server, usually in the form of an HTTP request.

[0563] Step 4:

[0564] The server receives and analyzes the user's request.

[0565] The server receives the data package sent from the terminal and analyzes the user's wishes, conditions, and emotional information.

[0566] Step 5:

[0567] The server queries the database to retrieve the relevant data.

[0568] The server uses the analysis results to send a query to the database to retrieve data that matches the user's preferences and conditions. For example, it searches the database for smartphones that meet the following criteria: a resolution of 48MP or higher, a battery life of 24 hours or more, and a price of less than 50,000 yen.

[0569] Step 6:

[0570] The server generates multiple proposals based on the acquired data.

[0571] Based on the information retrieved from the database, the server generates three suggestions that best match the user's criteria. Specifically, the suggestions are generated in the form of "Smartphone A (48MP resolution, 24-hour battery life, price: 48,000 yen)," "Smartphone B (32MP resolution, 30-hour battery life, price: 46,000 yen)," and "Smartphone C (40MP resolution, 26-hour battery life, price: 49,000 yen)." The user's emotional information recognized by the emotion engine influences the content of the suggestions. For example, if the user is feeling stressed, simple and easy-to-understand suggestions will be displayed first.

[0572] Step 7:

[0573] The server sends the generated proposal to the terminal.

[0574] The server assembles the three generated proposals into a data package and sends it to the terminal.

[0575] Step 8:

[0576] The terminal presents the suggestions in a user interface.

[0577] The device displays the proposals received from the server on a user interface (UI), allowing the user to review and compare the three proposals.

[0578] Step 9:

[0579] The user selects the best offer.

[0580] After reviewing the suggestions, the user selects the most suitable suggestion. For example, the user may select "Smartphone B."

[0581] Step 10:

[0582] The terminal transmits the user's selection and current emotional state to the server.

[0583] The terminal compiles the information selected by the user and the emotion information at that time into a data package and transmits it to the server.

[0584] Step 11:

[0585] The server performs the following process based on the selection result.

[0586] The server receives the user's selection and emotion information, updates the relevant database, checks inventory, and prepares the next sales step, such as starting the inventory check or order confirmation process.

[0587] The above is the processing flow of a specific embodiment of the present invention that includes an emotion engine.

[0588] Example 2

[0589] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0590] Conventional suggestion systems generally make suggestions based on the user's wishes and conditions, but this has the problem of not being able to make detailed suggestions that take into account the user's emotions and situation. Also, when the user is feeling some kind of stress or anxiety, conventional systems cannot adequately respond, which results in a problem of not sufficiently improving the user experience.

[0591] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0592] In this invention, the server includes an analysis means, a database search means, and a proposal generation means, which makes it possible to analyze not only the user's wishes and conditions but also their emotional information, and generate optimal proposals.

[0593] "Input means" refers to a device or interface that allows a user to input their wishes and requirements into the system.

[0594] The "transmission means" is a function for transmitting the input desires, conditions, and emotional information of the user to the server.

[0595] "Analysis means" is a function for analyzing the data and emotional information received by the server.

[0596] The "database search means" is a function that allows the server to obtain appropriate data from the database based on the user's wishes and conditions.

[0597] The "proposal generation means" is a function that allows the server to generate multiple proposals using a generative AI model based on the analysis results.

[0598] A "presentation means" is a device or interface for presenting generated suggestions to a user.

[0599] The "selective receiving means" is a function for receiving information selected by the user from among the presented proposals.

[0600] The "processing means" is a function for carrying out the next process based on the received selection information and emotion information.

[0601] The system of the present invention allows users to input their preferences and requirements, searches a database based on those requirements, and presents optimal suggestions. Furthermore, by recognizing the user's emotions and incorporating them into the proposal generation, the system provides a more personalized experience.

[0602] The user uses the device to input their preferences and requirements. For example, if a user is looking for a new smartphone, they might input requirements such as "high-resolution camera," "long battery life," and "budget under 50,000 yen." Furthermore, the device's built-in camera and microphone are used to analyze the user's facial expressions and tone of voice, and the emotion engine recognizes the user's emotions. Specifically, a general-purpose AI service can be used as the emotion recognition engine.

[0603] This input and emotion information is sent to the server via the device. The server analyzes the received information and executes appropriate queries against the database. For example, the server might use an SQL query to search the database for smartphones that meet the following criteria: a resolution of 48MP or higher, a battery life of 24 hours or more, and a price of less than ¥50,000.

[0604] Based on information retrieved from the database, the server generates three proposals that best match the user's criteria and emotional information. These proposals include detailed information about each product (e.g., smartphone specifications, price, benefits, etc.). Specifically, using a generative AI model, the following proposals are generated: "Smartphone A (48MP resolution, 24-hour battery life, price: ¥48,000)," "Smartphone B (32MP resolution, 30-hour battery life, price: ¥46,000)," and "Smartphone C (40MP resolution, 26-hour battery life, price: ¥49,000)." The user's emotions, as recognized by the emotion engine, influence the content of the proposals. For example, if the user is feeling stressed, it is possible to prioritize simple and easy-to-understand proposals.

[0605] The generated proposals are sent from the server to the device and presented to the user through a user interface. Through this, the user can review and compare the three proposals. After reviewing the presented proposals, the user selects the most suitable one. For example, suppose the user selects "Smartphone B."

[0606] This selection information and the emotional state at that time are again sent to the server via the device. Based on the received selection information and emotional information, the server updates the relevant database, checks inventory, and prepares for the next sales step. Specifically, it checks the inventory of "Smartphone B" and proceeds to the next order confirmation step.

[0607] By taking the user's emotions into consideration, the system can provide more satisfying suggestions to the user and make the purchasing process go more smoothly, thereby improving the user experience.

[0608] Examples:

[0609] If a user inputs the criteria "high-resolution camera, long battery life, budget within 50,000 yen" and the facial expression recognition engine determines that the user is stressed, the server will generate simple suggestions such as "Smartphone A (resolution 48MP, battery life 24 hours, price 48,000 yen)," "Smartphone B (resolution 32MP, battery life 30 hours, price 46,000 yen)," and "Smartphone C (resolution 40MP, battery life 26 hours, price 49,000 yen)."

[0610] Example prompt sentence:

[0611] "Generate three optimal suggestions for a user looking for a smartphone with a high-resolution camera, long battery life, and a budget of less than $50,000. If the user is stressed, prioritize the simpler suggestions."

[0612] The above is a specific embodiment of the present invention using an emotion engine and a generative AI model.

[0613] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0614] Step 1:

[0615] The user uses the terminal to input their wishes and requirements.

[0616] Input: User's wishes and requirements (e.g., "high-resolution camera," "long battery life," "budget within 50,000 yen")

[0617] Specific operation: The user enters their wishes and conditions into the terminal's input interface and presses the send button.

[0618] Step 2:

[0619] The device recognizes the user's emotions.

[0620] Input: The user's facial expressions and tone of voice captured through the device's camera and microphone

[0621] How it works: The device's built-in camera captures the user's facial expressions, and the microphone records the tone of voice. The emotion recognition engine analyzes this data to determine the user's emotional state.

[0622] Step 3:

[0623] The device sends the input desires, conditions and emotion information to the server.

[0624] Input: Hopes, conditions, emotional information

[0625] Output: JSON data sent to the server

[0626] Specific operation: The device collects the wishes, conditions, and emotional information into a single JSON object and sends it to the server using the HTTP protocol.

[0627] Step 4:

[0628] The server analyzes the received information.

[0629] Input: JSON data received by the server

[0630] Output: Analysis results (user's wishes, conditions, emotional information)

[0631] Specific operation: The server parses the JSON data and extracts information such as preferences, conditions, and emotions. For example, data such as "high-resolution camera," "long battery life," "budget under ¥50,000," and "stress" are extracted.

[0632] Step 5:

[0633] The server searches the database.

[0634] Input: Data on your wishes and conditions

[0635] Output: A list of matching smartphones retrieved from the database

[0636] Specific operation: The server generates an SQL query and searches the database for smartphones that match the following criteria, for example, "resolution of 48MP or more," "battery life of 24 hours or more," and "price under 50,000 yen."

[0637] Step 6:

[0638] The server generates the best offer.

[0639] Input: List of smartphones obtained from the database, emotional information

[0640] Output: Suggestion list (e.g. "Smartphone A", "Smartphone B", "Smartphone C")

[0641] How it works: The server uses a generative AI model to generate optimal suggestions based on acquired smartphone data. It adjusts the priority and content of suggestions based on emotional information, and generates suggestions in a simple, easy-to-understand format.

[0642] Step 7:

[0643] The server sends the generated proposal to the terminal.

[0644] Input: Suggestion list

[0645] Output: JSON data sent to the terminal

[0646] Specific operation: The server converts the proposal list into JSON format and sends it to the terminal using the HTTP protocol.

[0647] Step 8:

[0648] The terminal presents the generated suggestions to the user.

[0649] Input: Proposal list received from the server

[0650] Output: Proposal displayed in the user interface

[0651] Specific behavior: The device receives the list of suggestions and displays it on the user interface, allowing the user to review and compare the suggestions.

[0652] Step 9:

[0653] The user selects the best offer.

[0654] Input: The suggestions displayed (e.g., "Smartphone A," "Smartphone B," "Smartphone C")

[0655] Output: Selected suggestion (e.g. "Smartphone B")

[0656] Specific operation: The user selects the best one from the presented suggestions and presses the select button.

[0657] Step 10:

[0658] The terminal transmits the selection information and emotion information to the server.

[0659] Input: Selection information, emotion information

[0660] Output: JSON data sent to the server

[0661] Specific operation: The device combines the selection information and emotion information into a single JSON object and sends it to the server using the HTTP protocol.

[0662] Step 11:

[0663] The server updates the database and performs the following steps:

[0664] Input: Selection information, emotion information

[0665] Output: Update the database and prepare for further processing

[0666] Specific operation: Based on the selection information and emotion information received by the server, the database is updated, the inventory of "Smartphone B" is checked, and the next order confirmation step is prepared.

[0667] (Application example 2)

[0668] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0669] Conventional online shopping site systems could suggest products based on the user's desired products and conditions, but they were unable to consider the user's emotions. As a result, users were often confused by the large number of suggested product options, or conversely, felt that the suggested products were inappropriate. To solve this problem and increase user satisfaction, it is necessary to recognize the user's emotions and reflect them in the product suggestions.

[0670] The specification processing by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes input means for the user to input their wishes and conditions, transmission means for transmitting the input data to the server, database search means for acquiring appropriate data based on the user's wishes and conditions, proposal generation means for generating a plurality of proposals based on the data acquired by the search means, presentation means for presenting the generated proposals to the user, emotion recognition means for recognizing the user's emotions, emotion reflection means for generating proposals taking into account the emotions recognized by the emotion recognition means, selection receiving means for receiving the user's selection, and processing means for performing the next process based on the received selection. This enables personalized product proposals that take into account the user's emotions.

[0671] The "input means" is an interface device that allows the user to input their wishes and conditions.

[0672] The "transmitting means" is a communication device for transmitting input data to a server.

[0673] The "database search means" is a device for retrieving appropriate data from a database based on the user's wishes and conditions.

[0674] The "proposal generating means" is a device for generating a plurality of proposals based on the data acquired by the search means.

[0675] The "presentation means" is a device for displaying the generated proposals on a user interface.

[0676] The "emotion recognition means" is a device for recognizing the user's emotions from facial expressions, tone of voice, and the like.

[0677] The "emotion reflection means" is a device for generating a suggestion by taking into consideration the emotion recognized by the emotion recognition means.

[0678] The "selection receiving means" is a device for receiving a user's selection.

[0679] A "processing means" is a device for taking further action based on the received selection.

[0680] The system based on the present invention allows a user to input their wishes and requirements and makes optimal product suggestions through emotion recognition. This system comprises an input means, a transmission means, a database search means, a suggestion generation means, a presentation means, an emotion recognition means, an emotion reflection means, a selection and reception means, and a processing means. These means will be described in detail below.

[0681] System Configuration

[0682] 1. Input method:

[0683] It is a means by which users input their preferences and requirements (e.g., high-resolution camera, long battery life, budget, etc.) using a smartphone or other interface device.

[0684] 2. Means of transmission:

[0685] The entered data is sent from the user's device to the server via Wi-Fi or mobile data communication.

[0686] 3. Database search methods:

[0687] The server searches for information in a database based on the received user's wishes and requirements. This database contains detailed information about various products.

[0688] 4. Proposal generation means:

[0689] Based on the searched data, the system generates multiple proposals that match the user's preferences and requirements, including detailed information such as smartphone specifications, prices, and benefits.

[0690] 5. Means of presentation:

[0691] A means for visually presenting the generated suggestions to the user, such as on a smartphone screen or other display device.

[0692] 6. Emotion recognition means:

[0693] The device's camera and microphone are used to analyze the user's facial expressions and tone of voice, using software such as OpenCV and DeepFace.

[0694] 7. Emotional reflection means:

[0695] Based on the recognized emotional information, more personalized suggestions are generated, such as prioritizing simpler suggestions if the user is feeling stressed.

[0696] 8. Selective Reception Method:

[0697] This is a means for receiving information selected by the user from among the suggestions presented.

[0698] 9. Processing Methods:

[0699] It is a means for taking the next step (for example, checking stock availability or placing an order) based on the received selection information.

[0700] Processing flow

[0701] After the user inputs their preferences and conditions, the server receives them and searches the database. Next, the server recognizes the user's emotions through analysis by the emotion recognition means, reflects this in the proposal generation means, and generates appropriate proposals. Finally, the server displays the proposals to the user through the presentation means, receives the user's selection information, and performs the next process.

[0702] Specific examples

[0703] For example, if a user enters the criteria "high-resolution camera," "long battery life," and "budget within 50,000 yen," the system will search the database for these criteria and generate suggestions such as "Smartphone A (resolution 48MP, battery life 24 hours, price 48,000 yen)," "Smartphone B (resolution 32MP, battery life 30 hours, price 46,000 yen)," and "Smartphone C (resolution 40MP, battery life 26 hours, price 49,000 yen)."

[0704] Furthermore, if the system recognizes that the user is feeling "stressed" based on their facial expression, it will preferentially suggest "Smartphone B," which is simple and easy to understand.

[0705] Example prompts to input to a generative AI model:

[0706] "Consider the user's conditions: high-resolution camera, long battery life, budget within 50,000 yen, and generate optimal product suggestions when the user is feeling stressed."

[0707] With the above configuration, the present invention can realize personalized product proposals that take into account the user's emotions, and can make the purchasing process go more smoothly.

[0708] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0709] Step 1:

[0710] The user inputs their preferences and requirements, such as "high-resolution camera," "long battery life," and "budget within 50,000 yen," using a terminal. The input data is collected via the terminal's input means.

[0711] Step 2:

[0712] The terminal transmits the input data to the server, and the input data is sent to the server via the Internet using the transmission means.

[0713] Step 3:

[0714] The server searches the database based on the received data. Specifically, it uses the database search means to retrieve information on products that match the criteria of "high-resolution camera," "long battery life," and "budget within 50,000 yen."

[0715] Step 4:

[0716] The server generates a plurality of proposals based on the acquired data, using a proposal generation means to generate a plurality of proposals including detailed product information (e.g., specifications, price, advantages, etc. of the smartphone) based on the search results.

[0717] Step 5:

[0718] To recognize the user's emotions, the device uses a camera and microphone to capture the user's facial expressions and tone of voice, and then uses emotion recognition means to analyze the captured data and recognize the user's emotions.

[0719] Step 6:

[0720] The server generates suggestions taking into account the recognized emotions. Using an emotion reflection mechanism, the server adjusts the content of the suggestions based on the recognized emotional state to generate suggestions that are more acceptable to the user. For example, if the user is feeling stressed, simpler suggestions are prioritized.

[0721] Step 7:

[0722] The server transmits the generated proposal to the terminal, and the proposal is sent to the terminal using the presentation means in a format to be displayed on a user interface, so as to be visually presented to the user.

[0723] Step 8:

[0724] The user selects one of the multiple proposals presented, and the terminal collects the selected proposal information using the selection receiving means.

[0725] Step 9:

[0726] The terminal transmits the selected proposal information to the server, and the selected information is again sent to the server using the transmission means.

[0727] Step 10:

[0728] The server then performs the following process based on the received selection information: using the processing means to process the next step, such as checking stock availability and placing an order, to facilitate the user's purchasing process.

[0729] The above are the specific processing steps of the system that realizes the application example.

[0730] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0731] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0732] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0733] [Third embodiment]

[0734] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0735] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0736] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0737] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0738] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0739] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0740] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0741] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0742] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0743] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0744] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0745] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0746] The system of the present invention allows a user to input their wishes and requirements, searches a database based on those requirements, and presents the most suitable proposal. The flow of the system will be specifically explained below.

[0747] The user uses the device to input their preferences and requirements. For example, if a user is looking for a new smartphone, they can input requirements such as "high-resolution camera," "long battery life," and "budget within 50,000 yen."

[0748] This input information is sent to the server via the device. The server analyzes the received information and makes an appropriate query to the database. For example, it may search the database for smartphones that meet the following criteria: a resolution of 48MP or higher, a battery life of 24 hours or more, and a price of less than ¥50,000.

[0749] The server generates three proposals that best match the user's criteria based on information retrieved from the database. These proposals include detailed information about each product (e.g., smartphone specifications, price, benefits, etc.). Specifically, the proposals are generated in the form of "Smartphone A (48MP resolution, 24-hour battery life, price: 48,000 yen)," "Smartphone B (32MP resolution, 30-hour battery life, price: 46,000 yen)," and "Smartphone C (40MP resolution, 26-hour battery life, price: 49,000 yen)."

[0750] The generated proposals are sent from the server to the device and presented to the user through the user interface. The user compares the three proposals and selects the most suitable one. For example, suppose the user selects "Smartphone B."

[0751] This selection information is then sent back to the server via the terminal. Based on the received selection information, the server updates the relevant database, checks inventory, and prepares for the next sales step. Specifically, this may involve starting an inventory check or an order confirmation process.

[0752] This system allows users to easily select the best option from multiple options based on their preferences and conditions, making the purchasing process quick and smooth, thereby improving the user experience.

[0753] The above is a specific embodiment for carrying out the present invention.

[0754] The processing flow will be explained below.

[0755] Step 1:

[0756] The user inputs their wishes and requirements into the terminal.

[0757] Users use the device's input form to enter their preferences and requirements, such as "high-resolution camera," "long battery life," and "budget within 50,000 yen."

[0758] Step 2:

[0759] The terminal transmits the input information to the server.

[0760] The device compiles the user's input preferences and conditions into a data package and sends it to the server, usually in the form of an HTTP request.

[0761] Step 3:

[0762] The server receives and analyzes the user's request.

[0763] The server receives the data package sent from the device, analyzes the user's wishes and requirements, and creates an appropriate query for the database based on the analysis results.

[0764] Step 4:

[0765] The server queries the database to retrieve the relevant data.

[0766] The server uses the analysis results to send a query to the database and retrieve data that matches the user's preferences and conditions. For example, it retrieves information on smartphones that meet the following criteria: a resolution of 48MP or higher, a battery life of 24 hours or more, and a price of less than 50,000 yen.

[0767] Step 5:

[0768] The server generates multiple proposals based on the acquired data.

[0769] Based on the information retrieved from the database, the server generates three proposals that best match the user's criteria: "Smartphone A (48MP resolution, 24-hour battery life, price: 48,000 yen)," "Smartphone B (32MP resolution, 30-hour battery life, price: 46,000 yen)," and "Smartphone C (40MP resolution, 26-hour battery life, price: 49,000 yen)."

[0770] Step 6:

[0771] The server sends the generated proposal to the terminal.

[0772] The server assembles the three generated proposals into a data package and sends it to the terminal.

[0773] Step 7:

[0774] The terminal presents the suggestions in a user interface.

[0775] The device displays the proposals received from the server on a user interface (UI), allowing the user to review and compare the three proposals.

[0776] Step 8:

[0777] The user selects the best offer.

[0778] After reviewing the suggestions, the user selects the most suitable suggestion. For example, the user may select "Smartphone B."

[0779] Step 9:

[0780] The terminal transmits the user's selection to the server.

[0781] The terminal assembles the information selected by the user into a data package and transmits it to the server.

[0782] Step 10:

[0783] The server performs the following process based on the selection result.

[0784] The server receives the user's selection, updates the relevant database, checks stock availability, and prepares for the next sales step. For example, it checks stock availability for "Smartphone B" and proceeds to the next step of confirming the order.

[0785] The above is the specific processing flow of the system program.

[0786] Example 1

[0787] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0788] Conventional systems struggled to quickly and accurately recommend products and services that matched users' preferences and requirements. They also struggled to update the database based on user selections or quickly prepare the next sales step, which sometimes led to a poor user experience. Furthermore, complex query generation and data analysis were required, making their implementation cumbersome and reducing the efficiency of the overall system.

[0789] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0790] In this invention, the server includes a data analysis means for analyzing received data and generating an appropriate query, a database search means for searching a database based on the query and acquiring data that matches the conditions, and a proposal generation means for generating a plurality of proposals based on the acquired data. This enables proposals that quickly and accurately meet the user's wishes and conditions, and enables updating of the database based on the user's selection and rapid preparation for the next sales step.

[0791] "Input means" refers to a device or interface that allows a user to input their wishes and conditions.

[0792] "Transmission means" refers to a function or protocol for transmitting data input from a terminal to a server.

[0793] The "data analysis means" is a function for analyzing data received by the server and generating an appropriate query.

[0794] The "database search means" is a function for searching a database based on the generated query and retrieving data that matches the conditions.

[0795] The "proposal generation means" is a function for generating a plurality of proposals that best match the user's wishes and conditions based on the acquired data.

[0796] A "presentation mechanism" is a function for visually or otherwise displaying generated suggestions to a user.

[0797] The "selection receiving means" is a function for receiving a proposal selected by the user.

[0798] The "processing means" is a function for updating the relevant database and preparing the next sales step based on the received selection information.

[0799] The system of the present invention allows users to input their preferences and requirements, searches a database based on those requirements, and presents optimal proposals. This system is designed to enable users to efficiently select products and services. The following describes in detail the mode for carrying out the invention.

[0800] System Configuration

[0801] The system consists of a terminal used by the user and a server that performs data analysis and generates proposals. The following hardware and software are used:

[0802] Device: A device such as a smartphone, tablet, or personal computer on which users can input their preferences and conditions and view proposals. Applications used are mobile apps using "React Native" or "Flutter," or web applications using "HTML / CSS" and "JavaScript."

[0803] Server: A server that performs data analysis, proposal generation, and database management. Server-side programs use "Python" or "Node.js," and databases use "MySQL" or "PostgreSQL."

[0804] Flow Details

[0805] User Input

[0806] Users input their preferences and requirements into an input form on their device. For example, if they are looking for a new smartphone, they would enter requirements such as "high-resolution camera," "long battery life," and "budget under 50,000 yen." This input information is sent to the server via the application.

[0807] Data analysis by server

[0808] The server analyzes the received user input and generates a search query based on the conditions. For example, it generates a query such as "resolution 48MP or higher," "battery life 24 hours or more," and "price under 50,000 yen." This query is executed against the database on the server.

[0809] Database search

[0810] The server searches the database based on the generated query and retrieves data that matches the conditions. For example, it retrieves data such as "Smartphone A (resolution 48MP, battery life 24 hours, price 48,000 yen)," "Smartphone B (resolution 32MP, battery life 30 hours, price 46,000 yen)," and "Smartphone C (resolution 40MP, battery life 26 hours, price 49,000 yen)" from the database.

[0811] Proposal generation

[0812] The server generates multiple proposals that best match the user's requirements based on the acquired data. These proposals include detailed information about each product. The generated proposal data is then sent from the server to the terminal.

[0813] Presenting the proposal

[0814] The device displays the sent proposal data to the user using a user interface. The user can compare the proposals and select the most suitable one. Specifically, the proposals are displayed in an easy-to-understand list view or card view.

[0815] User Selection and Server Processing

[0816] The user selects the most suitable option from the suggestions, and this selection information is sent back to the server via the terminal. The server updates the relevant database based on the received selection information and prepares for the next sales step, specifically the inventory check and order confirmation process.

[0817] Prompt Sentence Examples

[0818] "Please suggest a smartphone that meets the following criteria: high-resolution camera, long battery life, and a budget of less than ¥50,000."

[0819] One of the features of this system is that it uses a generative AI model to quickly provide proposals that meet the user's needs.In addition, the database is automatically updated and sales steps are prepared based on the user's selection, which is expected to improve the user experience.

[0820] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0821] Step 1:

[0822] The user inputs their preferences and requirements. Specifically, the user uses a smartphone or personal computer to input their desired requirements (e.g., "high-resolution camera," "long battery life," and "budget within 50,000 yen") into an input form in a dedicated application or web browser. The input is in text format, and when the user clicks the "Submit" button, the data is sent from the device to the server.

[0823] Input: User's wishes and conditions

[0824] Output: Data transmission request from the terminal to the server

[0825] Step 2:

[0826] The entered data is sent to the server. The device sends the user's input data to the server as an HTTP POST request. Specifically, the device application (developed with React Native or Flutter) or web browser serializes the data and sends a request to the server's API endpoint.

[0827] Input: Data including user's wishes and conditions

[0828] Output: Data received by the server

[0829] Step 3:

[0830] The server analyzes the received data and generates the appropriate query. Specifically, a server script written in Python or Node.js deserializes the data and generates a condition-based SQL query. This query contains search criteria based on the user's preferences (e.g., "resolution 48MP or higher," "battery life 24 hours or more," "price under ¥50,000").

[0831] Input: Data received from the user

[0832] Output: Generated SQL query

[0833] Step 4:

[0834] The server searches the database based on the generated query. Specifically, the server uses a database engine such as MySQL or PostgreSQL to execute the generated SQL query and retrieve data that matches the criteria. This data includes information such as the smartphone's specifications and price.

[0835] Input: Generated SQL query

[0836] Output: Data retrieved from the database

[0837] Step 5:

[0838] The server generates suggestions based on the acquired data. The server analyzes the data and builds three suggestions in JSON format that best match the user's input criteria. For example, "Smartphone A (48MP resolution, 24-hour battery life, price: ¥48,000)," "Smartphone B (32MP resolution, 30-hour battery life, price: ¥46,000)," and "Smartphone C (40MP resolution, 26-hour battery life, price: ¥49,000)."

[0839] Input: Data retrieved from the database

[0840] Output: JSON data of generated proposals

[0841] Step 6:

[0842] The generated proposal data is sent from the server to the device. Specifically, the server returns the proposal data to the device in an HTTP response.

[0843] Input: JSON data of generated proposals

[0844] Output: Proposal data sent to the device

[0845] Step 7:

[0846] The device displays the received suggestion data in a user interface (UI). Specifically, the device application parses the received JSON data and displays each suggestion in a card view or list view, allowing the user to visually review and compare these suggestions.

[0847] Input: Proposal data sent from the server

[0848] Output: Proposal displayed in the UI

[0849] Step 8:

[0850] The user selects the most suitable suggestion from the presented suggestions by tapping or clicking on the desired suggestion using a touchscreen or mouse, and data based on this selection is sent from the device to the server.

[0851] Input: Suggestion displayed in UI

[0852] Output: User-selected proposal data

[0853] Step 9:

[0854] The selected information is sent from the device to the server. The device sends data about the selected proposal to the server as an HTTP POST request.

[0855] Input: User-selected suggested data

[0856] Output: Selection data received by the server

[0857] Step 10:

[0858] Based on the received selection, the server updates the relevant databases and prepares for the next sales step, i.e., starting the inventory check and order confirmation process. The server updates the inventory database for the selected products and adds the new order to the order database.

[0859] Input: User selected data

[0860] Output: Updated database and ready for next processing step

[0861] (Application example 1)

[0862] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0863] In modern e-commerce, it is difficult for users to quickly find products that meet their needs and requirements. With multiple options available, users are overwhelmed with information and find it difficult to make optimal decisions. In such situations, there is a risk that user satisfaction will decrease and the purchasing process will not proceed smoothly. Furthermore, if the user interface or information presentation method is inappropriate, users will become lost in the search process and find it difficult to select a product efficiently. This significantly impacts the quality of the user experience.

[0864] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0865] In this invention, the server includes input means for the user to input their wishes and conditions, transmission means for transmitting the input data to the server, database search means for acquiring appropriate data based on the user's wishes and conditions, proposal generation means for generating a plurality of proposals based on the data acquired by the search means, presentation means for presenting the generated proposals to the user, selection receiving means for receiving the user's selection, processing means for performing the next process based on the received selection, means for displaying a list of information proposed by the presentation means, and means for sorting the proposed information based on the conditions. This makes it possible to quickly and accurately suggest optimal products based on the conditions entered by the user, and to smoothly progress the purchasing process.

[0866] The "input means" is a means for providing an interface for the user to input their wishes and conditions.

[0867] The "transmission means" is a communication means for transmitting data input by the input means to the server.

[0868] The "database search means" is a means for obtaining appropriate data from a database based on the user's wishes and conditions.

[0869] The "proposal generating means" is a means for generating a plurality of proposals based on the data acquired by the database searching means.

[0870] The "presentation means" is a means for presenting the generated proposal to the user.

[0871] The "selection receiving means" is a means for receiving a proposal selected by the user.

[0872] The "processing means" is a means for carrying out the next process based on the selection received by the selection receiving means.

[0873] The "means for displaying a list" is a means for displaying the proposed information in a list format.

[0874] A "sorting means" is a means for ordering the suggested information based on the user's criteria.

[0875] In this system, users input their preferences and requirements using a terminal. For example, requirements such as "high-resolution camera," "long battery life," and "budget within 50,000 yen." Once the user has completed the input, this data is sent to the server by the terminal. The server analyzes the received data and retrieves the most suitable data using a database search method.

[0876] The database stores various product information, and the search means filters this data to find products that match the user's requirements.The proposal generation means then generates multiple proposals based on the search results.The proposals include detailed product information, such as "48MP resolution," "24-hour battery life," and "price under 50,000 yen."

[0877] The generated suggestions are presented to the user through a presentation means, which visually displays the suggested information on a user interface using a list display means, and further uses a sorting means to order the suggested information based on the user's criteria.

[0878] When the user selects one of the presented suggestions, the selection receiving means receives the selection. The received selection information is sent back to the server, and the server performs the next process (e.g., stock check or order confirmation process) based on the selection information.

[0879] This process is executed in the following situation as a concrete example: When a user inputs the conditions of a smartphone with a resolution of 48MP or more, a battery life of 24 hours or more, and a price of less than 50,000 yen, the server filters multiple products that match the conditions from the database and suggests the three most suitable products. An example of the prompt sentence in this case is as follows.

[0880] If a user enters criteria for a smartphone with a resolution of 48MP or higher, a battery life of 24 hours or more, and a price of less than ¥50,000, suggest three products that meet the criteria. The suggested product details include resolution, battery life, and price. Sort the product information in ascending order by price and descending order by battery life.

[0881] This allows users to quickly find the product that best suits their needs and requirements, and experience a smooth purchasing process based on that selection.

[0882] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0883] Step 1:

[0884] The user uses the device to input their preferences and requirements. Specifically, they enter requirements such as "high-resolution camera," "long battery life," and "budget under 50,000 yen" into the device's input interface (for example, a text field or drop-down list). The input data is converted into JSON or XML format and prepared for transmission to the server in the next step.

[0885] Step 2:

[0886] The device sends the entered data to the server using an HTTP POST request. The input data (preferences and conditions) is sent to the server's API endpoint. The sent data includes all the requirements entered by the user and is used as is for the next process.

[0887] Step 3:

[0888] The server analyzes the received data and generates an appropriate query. Specifically, an application server (e.g., Flask or Django) analyzes the received data and generates a query such as "resolution 48MP or higher," "battery life 24 hours or more," and "price under 50,000 yen." This query is then passed to a database search mechanism.

[0889] Step 4:

[0890] The server retrieves the appropriate data from the database using a database lookup method. Here, an SQL or NoSQL query is used to search for products that match the user's criteria. For example, a query like "SELECT FROM products WHERE resolution >= 48 AND battery_life >= 24 AND price <= 50000" is generated to retrieve data from the database (e.g., MySQL or MongoDB).

[0891] Step 5:

[0892] The server generates a plurality of proposals based on the data retrieved by the search means. The proposal generator creates proposals for each product based on the search results and generates a list including proposal details (resolution, battery life, price, etc.). This proposal list is then prepared for later presentation to the user.

[0893] Step 6:

[0894] The server presents the generated suggestions to the user through a presentation tool. Specifically, the server converts the suggestions into HTML or JSON format and sends them to the device. The device receives the suggestions and displays them in a list on the user interface. The suggestions are sorted based on the user's criteria and are displayed in the optimal order.

[0895] Step 7:

[0896] The user selects one of the presented suggestions. The selected suggestion is sent back to the server by the terminal. The selection information includes the ID and details of the selected product.

[0897] Step 8:

[0898] The server performs the next process (e.g., stock check or order confirmation process) based on the selected proposal. The processing means receives the selection information and executes stock check and order processing. Specifically, it checks the stock status in cooperation with the stock management system, and if there are no problems, it confirms the order and proceeds to the next step, such as shipping procedures.

[0899] This series of processes allows users to quickly find the product that best suits their needs and requirements, and experience a smooth purchasing process.

[0900] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0901] The system of the present invention allows users to input their preferences and requirements, searches a database based on those requirements, and presents optimal suggestions. Furthermore, by recognizing the user's emotions and incorporating them into the proposal generation, the system provides a more personalized experience.

[0902] The user uses the device to input their preferences and requirements. For example, if a user is looking for a new smartphone, they might input requirements such as "high-resolution camera," "long battery life," and "budget under 50,000 yen." The device's built-in camera and microphone are then used to analyze the user's facial expressions and tone of voice, and the emotion engine recognizes the user's emotions.

[0903] This input information and emotion information are sent to a server via the device. The server analyzes the received information and makes an appropriate query to a database. For example, it searches the database for smartphones that meet the following criteria: a resolution of 48MP or higher, a battery life of 24 hours or more, and a price of less than ¥50,000.

[0904] Based on information retrieved from the database, the server generates three suggestions that best match the user's criteria and emotional information. These suggestions include detailed information about each product (e.g., smartphone specifications, price, benefits, etc.). Specifically, the suggestions are generated in the form of "Smartphone A (48MP resolution, 24-hour battery life, price: ¥48,000)," "Smartphone B (32MP resolution, 30-hour battery life, price: ¥46,000)," and "Smartphone C (40MP resolution, 26-hour battery life, price: ¥49,000)." The user's emotions, as recognized by the emotion engine, influence the content of the suggestions. For example, if the user is feeling stressed, it is possible to prioritize simple and easy-to-understand suggestions.

[0905] The generated proposals are sent from the server to the device and presented to the user through a user interface. Through this, the user can review and compare the three proposals. After reviewing the presented proposals, the user selects the most suitable one. For example, suppose the user selects "Smartphone B."

[0906] This selection information and the emotional state at that time are again sent to the server via the device. Based on the received selection information and emotional information, the server updates the relevant database, checks inventory, and prepares for the next sales step. Specifically, it checks the inventory of "Smartphone B" and proceeds to the next order confirmation step.

[0907] By taking the user's emotions into consideration, the system can provide more satisfying suggestions to the user and make the purchasing process go more smoothly, thereby improving the user experience.

[0908] The above is a specific embodiment of the present invention including an emotion engine.

[0909] The processing flow will be explained below.

[0910] Step 1:

[0911] The user inputs their wishes and requirements into the terminal.

[0912] Users use the device's input form to enter their preferences and requirements, such as "high-resolution camera," "long battery life," and "budget within 50,000 yen."

[0913] Step 2:

[0914] The device analyzes the user's facial expressions and tone of voice, and the emotion engine recognizes the user's emotions.

[0915] The device's built-in camera and microphone capture the user's facial expressions and tone of voice, and this information is analyzed by an emotion engine that recognizes emotions such as happiness, stress, and excitement.

[0916] Step 3:

[0917] The terminal transmits the input desires, conditions and emotion information to the server.

[0918] The device compiles the user's input preferences and conditions and the emotional information recognized by the emotion engine into a data package and sends it to the server, usually in the form of an HTTP request.

[0919] Step 4:

[0920] The server receives and analyzes the user's request.

[0921] The server receives the data package sent from the terminal and analyzes the user's wishes, conditions, and emotional information.

[0922] Step 5:

[0923] The server queries the database to retrieve the relevant data.

[0924] The server uses the analysis results to send a query to the database to retrieve data that matches the user's preferences and conditions. For example, it searches the database for smartphones that meet the following criteria: a resolution of 48MP or higher, a battery life of 24 hours or more, and a price of less than 50,000 yen.

[0925] Step 6:

[0926] The server generates multiple proposals based on the acquired data.

[0927] Based on the information retrieved from the database, the server generates three suggestions that best match the user's criteria. Specifically, the suggestions are generated in the form of "Smartphone A (48MP resolution, 24-hour battery life, price: 48,000 yen)," "Smartphone B (32MP resolution, 30-hour battery life, price: 46,000 yen)," and "Smartphone C (40MP resolution, 26-hour battery life, price: 49,000 yen)." The user's emotional information recognized by the emotion engine influences the content of the suggestions. For example, if the user is feeling stressed, simple and easy-to-understand suggestions will be displayed first.

[0928] Step 7:

[0929] The server sends the generated proposal to the terminal.

[0930] The server assembles the three generated proposals into a data package and sends it to the terminal.

[0931] Step 8:

[0932] The terminal presents the suggestions in a user interface.

[0933] The device displays the proposals received from the server on a user interface (UI), allowing the user to review and compare the three proposals.

[0934] Step 9:

[0935] The user selects the best offer.

[0936] After reviewing the suggestions, the user selects the most suitable suggestion. For example, the user may select "Smartphone B."

[0937] Step 10:

[0938] The terminal transmits the user's selection and current emotional state to the server.

[0939] The terminal compiles the information selected by the user and the emotion information at that time into a data package and transmits it to the server.

[0940] Step 11:

[0941] The server performs the following process based on the selection result.

[0942] The server receives the user's selection and emotion information, updates the relevant database, checks inventory, and prepares the next sales step, such as starting the inventory check or order confirmation process.

[0943] The above is the processing flow of a specific embodiment of the present invention that includes an emotion engine.

[0944] Example 2

[0945] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0946] Conventional suggestion systems generally make suggestions based on the user's wishes and conditions, but this has the problem of not being able to make detailed suggestions that take into account the user's emotions and situation. Also, when the user is feeling some kind of stress or anxiety, conventional systems cannot adequately respond, which results in a problem of not sufficiently improving the user experience.

[0947] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0948] In this invention, the server includes an analysis means, a database search means, and a proposal generation means, which makes it possible to analyze not only the user's wishes and conditions but also their emotional information, and generate optimal proposals.

[0949] "Input means" refers to a device or interface that allows a user to input their wishes and requirements into the system.

[0950] The "transmission means" is a function for transmitting the input desires, conditions, and emotional information of the user to the server.

[0951] "Analysis means" is a function for analyzing the data and emotional information received by the server.

[0952] The "database search means" is a function that allows the server to obtain appropriate data from the database based on the user's wishes and conditions.

[0953] The "proposal generation means" is a function that allows the server to generate multiple proposals using a generative AI model based on the analysis results.

[0954] A "presentation means" is a device or interface for presenting generated suggestions to a user.

[0955] The "selective receiving means" is a function for receiving information selected by the user from among the presented proposals.

[0956] The "processing means" is a function for carrying out the next process based on the received selection information and emotion information.

[0957] The system of the present invention allows users to input their preferences and requirements, searches a database based on those requirements, and presents optimal suggestions. Furthermore, by recognizing the user's emotions and incorporating them into the proposal generation, the system provides a more personalized experience.

[0958] The user uses the device to input their preferences and requirements. For example, if a user is looking for a new smartphone, they might input requirements such as "high-resolution camera," "long battery life," and "budget under 50,000 yen." Furthermore, the device's built-in camera and microphone are used to analyze the user's facial expressions and tone of voice, and the emotion engine recognizes the user's emotions. Specifically, a general-purpose AI service can be used as the emotion recognition engine.

[0959] This input and emotion information is sent to the server via the device. The server analyzes the received information and executes appropriate queries against the database. For example, the server might use an SQL query to search the database for smartphones that meet the following criteria: a resolution of 48MP or higher, a battery life of 24 hours or more, and a price of less than ¥50,000.

[0960] Based on information retrieved from the database, the server generates three proposals that best match the user's criteria and emotional information. These proposals include detailed information about each product (e.g., smartphone specifications, price, benefits, etc.). Specifically, using a generative AI model, the following proposals are generated: "Smartphone A (48MP resolution, 24-hour battery life, price: ¥48,000)," "Smartphone B (32MP resolution, 30-hour battery life, price: ¥46,000)," and "Smartphone C (40MP resolution, 26-hour battery life, price: ¥49,000)." The user's emotions, as recognized by the emotion engine, influence the content of the proposals. For example, if the user is feeling stressed, it is possible to prioritize simple and easy-to-understand proposals.

[0961] The generated proposals are sent from the server to the device and presented to the user through a user interface. Through this, the user can review and compare the three proposals. After reviewing the presented proposals, the user selects the most suitable one. For example, suppose the user selects "Smartphone B."

[0962] This selection information and the emotional state at that time are again sent to the server via the device. Based on the received selection information and emotional information, the server updates the relevant database, checks inventory, and prepares for the next sales step. Specifically, it checks the inventory of "Smartphone B" and proceeds to the next order confirmation step.

[0963] By taking the user's emotions into consideration, the system can provide more satisfying suggestions to the user and make the purchasing process go more smoothly, thereby improving the user experience.

[0964] Examples:

[0965] If a user inputs the criteria "high-resolution camera, long battery life, budget within 50,000 yen" and the facial expression recognition engine determines that the user is stressed, the server will generate simple suggestions such as "Smartphone A (resolution 48MP, battery life 24 hours, price 48,000 yen)," "Smartphone B (resolution 32MP, battery life 30 hours, price 46,000 yen)," and "Smartphone C (resolution 40MP, battery life 26 hours, price 49,000 yen)."

[0966] Example prompt sentence:

[0967] "Generate three optimal suggestions for a user looking for a smartphone with a high-resolution camera, long battery life, and a budget of less than $50,000. If the user is stressed, prioritize the simpler suggestions."

[0968] The above is a specific embodiment of the present invention using an emotion engine and a generative AI model.

[0969] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0970] Step 1:

[0971] The user uses the terminal to input their wishes and requirements.

[0972] Input: User's wishes and requirements (e.g., "high-resolution camera," "long battery life," "budget within 50,000 yen")

[0973] Specific operation: The user enters their wishes and conditions into the terminal's input interface and presses the send button.

[0974] Step 2:

[0975] The device recognizes the user's emotions.

[0976] Input: The user's facial expressions and tone of voice captured through the device's camera and microphone

[0977] How it works: The device's built-in camera captures the user's facial expressions, and the microphone records the tone of voice. The emotion recognition engine analyzes this data to determine the user's emotional state.

[0978] Step 3:

[0979] The device sends the input desires, conditions and emotion information to the server.

[0980] Input: Hopes, conditions, emotional information

[0981] Output: JSON data sent to the server

[0982] Specific operation: The device collects the wishes, conditions, and emotional information into a single JSON object and sends it to the server using the HTTP protocol.

[0983] Step 4:

[0984] The server analyzes the received information.

[0985] Input: JSON data received by the server

[0986] Output: Analysis results (user's wishes, conditions, emotional information)

[0987] Specific operation: The server parses the JSON data and extracts information such as preferences, conditions, and emotions. For example, data such as "high-resolution camera," "long battery life," "budget under ¥50,000," and "stress" are extracted.

[0988] Step 5:

[0989] The server searches the database.

[0990] Input: Data on your wishes and conditions

[0991] Output: A list of matching smartphones retrieved from the database

[0992] Specific operation: The server generates an SQL query and searches the database for smartphones that match the following criteria, for example, "resolution of 48MP or more," "battery life of 24 hours or more," and "price under 50,000 yen."

[0993] Step 6:

[0994] The server generates the best offer.

[0995] Input: List of smartphones obtained from the database, emotional information

[0996] Output: Suggestion list (e.g. "Smartphone A", "Smartphone B", "Smartphone C")

[0997] How it works: The server uses a generative AI model to generate optimal suggestions based on acquired smartphone data. It adjusts the priority and content of suggestions based on emotional information, and generates suggestions in a simple, easy-to-understand format.

[0998] Step 7:

[0999] The server sends the generated proposal to the terminal.

[1000] Input: Suggestion list

[1001] Output: JSON data sent to the terminal

[1002] Specific operation: The server converts the proposal list into JSON format and sends it to the terminal using the HTTP protocol.

[1003] Step 8:

[1004] The terminal presents the generated suggestions to the user.

[1005] Input: Proposal list received from the server

[1006] Output: Proposal displayed in the user interface

[1007] Specific behavior: The device receives the list of suggestions and displays it on the user interface, allowing the user to review and compare the suggestions.

[1008] Step 9:

[1009] The user selects the best offer.

[1010] Input: The suggestions displayed (e.g., "Smartphone A," "Smartphone B," "Smartphone C")

[1011] Output: Selected suggestion (e.g. "Smartphone B")

[1012] Specific operation: The user selects the best one from the presented suggestions and presses the select button.

[1013] Step 10:

[1014] The terminal transmits the selection information and emotion information to the server.

[1015] Input: Selection information, emotion information

[1016] Output: JSON data sent to the server

[1017] Specific operation: The device combines the selection information and emotion information into a single JSON object and sends it to the server using the HTTP protocol.

[1018] Step 11:

[1019] The server updates the database and performs the following steps:

[1020] Input: Selection information, emotion information

[1021] Output: Update the database and prepare for further processing

[1022] Specific operation: Based on the selection information and emotion information received by the server, the database is updated, the inventory of "Smartphone B" is checked, and the next order confirmation step is prepared.

[1023] (Application example 2)

[1024] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1025] Conventional online shopping site systems could suggest products based on the user's desired products and conditions, but they were unable to consider the user's emotions. As a result, users were often confused by the large number of suggested product options, or conversely, felt that the suggested products were inappropriate. To solve this problem and increase user satisfaction, it is necessary to recognize the user's emotions and reflect them in the product suggestions.

[1026] The specification processing by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes input means for the user to input their wishes and conditions, transmission means for transmitting the input data to the server, database search means for acquiring appropriate data based on the user's wishes and conditions, proposal generation means for generating a plurality of proposals based on the data acquired by the search means, presentation means for presenting the generated proposals to the user, emotion recognition means for recognizing the user's emotions, emotion reflection means for generating proposals taking into account the emotions recognized by the emotion recognition means, selection receiving means for receiving the user's selection, and processing means for performing the next process based on the received selection. This enables personalized product proposals that take into account the user's emotions.

[1027] The "input means" is an interface device that allows the user to input their wishes and conditions.

[1028] The "transmitting means" is a communication device for transmitting input data to a server.

[1029] The "database search means" is a device for retrieving appropriate data from a database based on the user's wishes and conditions.

[1030] The "proposal generating means" is a device for generating a plurality of proposals based on the data acquired by the search means.

[1031] The "presentation means" is a device for displaying the generated proposals on a user interface.

[1032] The "emotion recognition means" is a device for recognizing the user's emotions from facial expressions, tone of voice, and the like.

[1033] The "emotion reflection means" is a device for generating a suggestion by taking into consideration the emotion recognized by the emotion recognition means.

[1034] The "selection receiving means" is a device for receiving a user's selection.

[1035] A "processing means" is a device for taking further action based on the received selection.

[1036] The system based on the present invention allows a user to input their wishes and requirements and makes optimal product suggestions through emotion recognition. This system comprises an input means, a transmission means, a database search means, a suggestion generation means, a presentation means, an emotion recognition means, an emotion reflection means, a selection and reception means, and a processing means. These means will be described in detail below.

[1037] System Configuration

[1038] 1. Input method:

[1039] It is a means by which users input their preferences and requirements (e.g., high-resolution camera, long battery life, budget, etc.) using a smartphone or other interface device.

[1040] 2. Means of transmission:

[1041] The entered data is sent from the user's device to the server via Wi-Fi or mobile data communication.

[1042] 3. Database search methods:

[1043] The server searches for information in a database based on the received user's wishes and requirements. This database contains detailed information about various products.

[1044] 4. Proposal generation means:

[1045] Based on the searched data, the system generates multiple proposals that match the user's preferences and requirements, including detailed information such as smartphone specifications, prices, and benefits.

[1046] 5. Means of presentation:

[1047] A means for visually presenting the generated suggestions to the user, such as on a smartphone screen or other display device.

[1048] 6. Emotion recognition means:

[1049] The device's camera and microphone are used to analyze the user's facial expressions and tone of voice, using software such as OpenCV and DeepFace.

[1050] 7. Emotional reflection means:

[1051] Based on the recognized emotional information, more personalized suggestions are generated, such as prioritizing simpler suggestions if the user is feeling stressed.

[1052] 8. Selective Reception Method:

[1053] This is a means for receiving information selected by the user from among the suggestions presented.

[1054] 9. Processing Methods:

[1055] It is a means for taking the next step (for example, checking stock availability or placing an order) based on the received selection information.

[1056] Processing flow

[1057] After the user inputs their preferences and conditions, the server receives them and searches the database. Next, the server recognizes the user's emotions through analysis by the emotion recognition means, reflects this in the proposal generation means, and generates appropriate proposals. Finally, the server displays the proposals to the user through the presentation means, receives the user's selection information, and performs the next process.

[1058] Specific examples

[1059] For example, if a user enters the criteria "high-resolution camera," "long battery life," and "budget within 50,000 yen," the system will search the database for these criteria and generate suggestions such as "Smartphone A (resolution 48MP, battery life 24 hours, price 48,000 yen)," "Smartphone B (resolution 32MP, battery life 30 hours, price 46,000 yen)," and "Smartphone C (resolution 40MP, battery life 26 hours, price 49,000 yen)."

[1060] Furthermore, if the system recognizes that the user is feeling "stressed" based on their facial expression, it will preferentially suggest "Smartphone B," which is simple and easy to understand.

[1061] Example prompts to input to a generative AI model:

[1062] "Consider the user's conditions: high-resolution camera, long battery life, budget within 50,000 yen, and generate optimal product suggestions when the user is feeling stressed."

[1063] With the above configuration, the present invention can realize personalized product proposals that take into account the user's emotions, and can make the purchasing process go more smoothly.

[1064] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1065] Step 1:

[1066] The user inputs their preferences and requirements, such as "high-resolution camera," "long battery life," and "budget within 50,000 yen," using a terminal. The input data is collected via the terminal's input means.

[1067] Step 2:

[1068] The terminal transmits the input data to the server, and the input data is sent to the server via the Internet using the transmission means.

[1069] Step 3:

[1070] The server searches the database based on the received data. Specifically, it uses the database search means to retrieve information on products that match the criteria of "high-resolution camera," "long battery life," and "budget within 50,000 yen."

[1071] Step 4:

[1072] The server generates a plurality of proposals based on the acquired data, using a proposal generation means to generate a plurality of proposals including detailed product information (e.g., specifications, price, advantages, etc. of the smartphone) based on the search results.

[1073] Step 5:

[1074] To recognize the user's emotions, the device uses a camera and microphone to capture the user's facial expressions and tone of voice, and then uses emotion recognition means to analyze the captured data and recognize the user's emotions.

[1075] Step 6:

[1076] The server generates suggestions taking into account the recognized emotions. Using an emotion reflection mechanism, the server adjusts the content of the suggestions based on the recognized emotional state to generate suggestions that are more acceptable to the user. For example, if the user is feeling stressed, simpler suggestions are prioritized.

[1077] Step 7:

[1078] The server transmits the generated proposal to the terminal, and the proposal is sent to the terminal using the presentation means in a format to be displayed on a user interface, so as to be visually presented to the user.

[1079] Step 8:

[1080] The user selects one of the multiple proposals presented, and the terminal collects the selected proposal information using the selection receiving means.

[1081] Step 9:

[1082] The terminal transmits the selected proposal information to the server, and the selected information is again sent to the server using the transmission means.

[1083] Step 10:

[1084] The server then performs the following process based on the received selection information: using the processing means to process the next step, such as checking stock availability and placing an order, to facilitate the user's purchasing process.

[1085] The above are the specific processing steps of the system that realizes the application example.

[1086] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1087] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1088] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1089] [Fourth embodiment]

[1090] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1091] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1092] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1093] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1094] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1095] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1096] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1097] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1098] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1099] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1100] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1101] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1102] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1103] The system of the present invention allows a user to input their wishes and requirements, searches a database based on those requirements, and presents the most suitable proposal. The flow of the system will be specifically explained below.

[1104] The user uses the device to input their preferences and requirements. For example, if a user is looking for a new smartphone, they can input requirements such as "high-resolution camera," "long battery life," and "budget within 50,000 yen."

[1105] This input information is sent to the server via the device. The server analyzes the received information and makes an appropriate query to the database. For example, it may search the database for smartphones that meet the following criteria: a resolution of 48MP or higher, a battery life of 24 hours or more, and a price of less than ¥50,000.

[1106] The server generates three proposals that best match the user's criteria based on information retrieved from the database. These proposals include detailed information about each product (e.g., smartphone specifications, price, benefits, etc.). Specifically, the proposals are generated in the form of "Smartphone A (48MP resolution, 24-hour battery life, price: 48,000 yen)," "Smartphone B (32MP resolution, 30-hour battery life, price: 46,000 yen)," and "Smartphone C (40MP resolution, 26-hour battery life, price: 49,000 yen)."

[1107] The generated proposals are sent from the server to the device and presented to the user through the user interface. The user compares the three proposals and selects the most suitable one. For example, suppose the user selects "Smartphone B."

[1108] This selection information is then sent back to the server via the terminal. Based on the received selection information, the server updates the relevant database, checks inventory, and prepares for the next sales step. Specifically, this may involve starting an inventory check or an order confirmation process.

[1109] This system allows users to easily select the best option from multiple options based on their preferences and conditions, making the purchasing process quick and smooth, thereby improving the user experience.

[1110] The above is a specific embodiment for carrying out the present invention.

[1111] The processing flow will be explained below.

[1112] Step 1:

[1113] The user inputs their wishes and requirements into the terminal.

[1114] Users use the device's input form to enter their preferences and requirements, such as "high-resolution camera," "long battery life," and "budget within 50,000 yen."

[1115] Step 2:

[1116] The terminal transmits the input information to the server.

[1117] The device compiles the user's input preferences and conditions into a data package and sends it to the server, usually in the form of an HTTP request.

[1118] Step 3:

[1119] The server receives and analyzes the user's request.

[1120] The server receives the data package sent from the device, analyzes the user's wishes and requirements, and creates an appropriate query for the database based on the analysis results.

[1121] Step 4:

[1122] The server queries the database to retrieve the relevant data.

[1123] The server uses the analysis results to send a query to the database and retrieve data that matches the user's preferences and conditions. For example, it retrieves information on smartphones that meet the following criteria: a resolution of 48MP or higher, a battery life of 24 hours or more, and a price of less than 50,000 yen.

[1124] Step 5:

[1125] The server generates multiple proposals based on the acquired data.

[1126] Based on the information retrieved from the database, the server generates three proposals that best match the user's criteria: "Smartphone A (48MP resolution, 24-hour battery life, price: 48,000 yen)," "Smartphone B (32MP resolution, 30-hour battery life, price: 46,000 yen)," and "Smartphone C (40MP resolution, 26-hour battery life, price: 49,000 yen)."

[1127] Step 6:

[1128] The server sends the generated proposal to the terminal.

[1129] The server assembles the three generated proposals into a data package and sends it to the terminal.

[1130] Step 7:

[1131] The terminal presents the suggestions in a user interface.

[1132] The device displays the proposals received from the server on a user interface (UI), allowing the user to review and compare the three proposals.

[1133] Step 8:

[1134] The user selects the best offer.

[1135] After reviewing the suggestions, the user selects the most suitable suggestion. For example, the user may select "Smartphone B."

[1136] Step 9:

[1137] The terminal transmits the user's selection to the server.

[1138] The terminal assembles the information selected by the user into a data package and transmits it to the server.

[1139] Step 10:

[1140] The server performs the following process based on the selection result.

[1141] The server receives the user's selection, updates the relevant database, checks stock availability, and prepares for the next sales step. For example, it checks stock availability for "Smartphone B" and proceeds to the next step of confirming the order.

[1142] The above is the specific processing flow of the system program.

[1143] Example 1

[1144] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1145] Conventional systems struggled to quickly and accurately recommend products and services that matched users' preferences and requirements. They also struggled to update the database based on user selections or quickly prepare the next sales step, which sometimes led to a poor user experience. Furthermore, complex query generation and data analysis were required, making their implementation cumbersome and reducing the efficiency of the overall system.

[1146] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1147] In this invention, the server includes a data analysis means for analyzing received data and generating an appropriate query, a database search means for searching a database based on the query and acquiring data that matches the conditions, and a proposal generation means for generating a plurality of proposals based on the acquired data. This enables proposals that quickly and accurately meet the user's wishes and conditions, and enables updating of the database based on the user's selection and rapid preparation for the next sales step.

[1148] "Input means" refers to a device or interface that allows a user to input their wishes and conditions.

[1149] "Transmission means" refers to a function or protocol for transmitting data input from a terminal to a server.

[1150] The "data analysis means" is a function for analyzing data received by the server and generating an appropriate query.

[1151] The "database search means" is a function for searching a database based on the generated query and retrieving data that matches the conditions.

[1152] The "proposal generation means" is a function for generating a plurality of proposals that best match the user's wishes and conditions based on the acquired data.

[1153] A "presentation mechanism" is a function for visually or otherwise displaying generated suggestions to a user.

[1154] The "selection receiving means" is a function for receiving a proposal selected by the user.

[1155] The "processing means" is a function for updating the relevant database and preparing the next sales step based on the received selection information.

[1156] The system of the present invention allows users to input their preferences and requirements, searches a database based on those requirements, and presents optimal proposals. This system is designed to enable users to efficiently select products and services. The following describes in detail the mode for carrying out the invention.

[1157] System Configuration

[1158] The system consists of a terminal used by the user and a server that performs data analysis and generates proposals. The following hardware and software are used:

[1159] Device: A device such as a smartphone, tablet, or personal computer on which users can input their preferences and conditions and view proposals. Applications used are mobile apps using "React Native" or "Flutter," or web applications using "HTML / CSS" and "JavaScript."

[1160] Server: A server that performs data analysis, proposal generation, and database management. Server-side programs use "Python" or "Node.js," and databases use "MySQL" or "PostgreSQL."

[1161] Flow Details

[1162] User Input

[1163] Users input their preferences and requirements into an input form on their device. For example, if they are looking for a new smartphone, they would enter requirements such as "high-resolution camera," "long battery life," and "budget under 50,000 yen." This input information is sent to the server via the application.

[1164] Data analysis by server

[1165] The server analyzes the received user input and generates a search query based on the conditions. For example, it generates a query such as "resolution 48MP or higher," "battery life 24 hours or more," and "price under 50,000 yen." This query is executed against the database on the server.

[1166] Database search

[1167] The server searches the database based on the generated query and retrieves data that matches the conditions. For example, it retrieves data such as "Smartphone A (resolution 48MP, battery life 24 hours, price 48,000 yen)," "Smartphone B (resolution 32MP, battery life 30 hours, price 46,000 yen)," and "Smartphone C (resolution 40MP, battery life 26 hours, price 49,000 yen)" from the database.

[1168] Proposal generation

[1169] The server generates multiple proposals that best match the user's requirements based on the acquired data. These proposals include detailed information about each product. The generated proposal data is then sent from the server to the terminal.

[1170] Presenting the proposal

[1171] The device displays the sent proposal data to the user using a user interface. The user can compare the proposals and select the most suitable one. Specifically, the proposals are displayed in an easy-to-understand list view or card view.

[1172] User Selection and Server Processing

[1173] The user selects the most suitable option from the suggestions, and this selection information is sent back to the server via the terminal. The server updates the relevant database based on the received selection information and prepares for the next sales step, specifically the inventory check and order confirmation process.

[1174] Prompt Sentence Examples

[1175] "Please suggest a smartphone that meets the following criteria: high-resolution camera, long battery life, and a budget of less than ¥50,000."

[1176] One of the features of this system is that it uses a generative AI model to quickly provide proposals that meet the user's needs.In addition, the database is automatically updated and sales steps are prepared based on the user's selection, which is expected to improve the user experience.

[1177] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1178] Step 1:

[1179] The user inputs their preferences and requirements. Specifically, the user uses a smartphone or personal computer to input their desired requirements (e.g., "high-resolution camera," "long battery life," and "budget within 50,000 yen") into an input form in a dedicated application or web browser. The input is in text format, and when the user clicks the "Submit" button, the data is sent from the device to the server.

[1180] Input: User's wishes and conditions

[1181] Output: Data transmission request from the terminal to the server

[1182] Step 2:

[1183] The entered data is sent to the server. The device sends the user's input data to the server as an HTTP POST request. Specifically, the device application (developed with React Native or Flutter) or web browser serializes the data and sends a request to the server's API endpoint.

[1184] Input: Data including user's wishes and conditions

[1185] Output: Data received by the server

[1186] Step 3:

[1187] The server analyzes the received data and generates the appropriate query. Specifically, a server script written in Python or Node.js deserializes the data and generates a condition-based SQL query. This query contains search criteria based on the user's preferences (e.g., "resolution 48MP or higher," "battery life 24 hours or more," "price under ¥50,000").

[1188] Input: Data received from the user

[1189] Output: Generated SQL query

[1190] Step 4:

[1191] The server searches the database based on the generated query. Specifically, the server uses a database engine such as MySQL or PostgreSQL to execute the generated SQL query and retrieve data that matches the criteria. This data includes information such as the smartphone's specifications and price.

[1192] Input: Generated SQL query

[1193] Output: Data retrieved from the database

[1194] Step 5:

[1195] The server generates suggestions based on the acquired data. The server analyzes the data and builds three suggestions in JSON format that best match the user's input criteria. For example, "Smartphone A (48MP resolution, 24-hour battery life, price: ¥48,000)," "Smartphone B (32MP resolution, 30-hour battery life, price: ¥46,000)," and "Smartphone C (40MP resolution, 26-hour battery life, price: ¥49,000)."

[1196] Input: Data retrieved from the database

[1197] Output: JSON data of generated proposals

[1198] Step 6:

[1199] The generated proposal data is sent from the server to the device. Specifically, the server returns the proposal data to the device in an HTTP response.

[1200] Input: JSON data of generated proposals

[1201] Output: Proposal data sent to the device

[1202] Step 7:

[1203] The device displays the received suggestion data in a user interface (UI). Specifically, the device application parses the received JSON data and displays each suggestion in a card view or list view, allowing the user to visually review and compare these suggestions.

[1204] Input: Proposal data sent from the server

[1205] Output: Proposal displayed in the UI

[1206] Step 8:

[1207] The user selects the most suitable suggestion from the presented suggestions by tapping or clicking on the desired suggestion using a touchscreen or mouse, and data based on this selection is sent from the device to the server.

[1208] Input: Suggestion displayed in UI

[1209] Output: User-selected proposal data

[1210] Step 9:

[1211] The selected information is sent from the device to the server. The device sends data about the selected proposal to the server as an HTTP POST request.

[1212] Input: User-selected suggested data

[1213] Output: Selection data received by the server

[1214] Step 10:

[1215] Based on the received selection, the server updates the relevant databases and prepares for the next sales step, i.e., starting the inventory check and order confirmation process. The server updates the inventory database for the selected products and adds the new order to the order database.

[1216] Input: User selected data

[1217] Output: Updated database and ready for next processing step

[1218] (Application example 1)

[1219] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1220] In modern e-commerce, it is difficult for users to quickly find products that meet their needs and requirements. With multiple options available, users are overwhelmed with information and find it difficult to make optimal decisions. In such situations, there is a risk that user satisfaction will decrease and the purchasing process will not proceed smoothly. Furthermore, if the user interface or information presentation method is inappropriate, users will become lost in the search process and find it difficult to select a product efficiently. This significantly impacts the quality of the user experience.

[1221] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1222] In this invention, the server includes input means for the user to input their wishes and conditions, transmission means for transmitting the input data to the server, database search means for acquiring appropriate data based on the user's wishes and conditions, proposal generation means for generating a plurality of proposals based on the data acquired by the search means, presentation means for presenting the generated proposals to the user, selection receiving means for receiving the user's selection, processing means for performing the next process based on the received selection, means for displaying a list of information proposed by the presentation means, and means for sorting the proposed information based on the conditions. This makes it possible to quickly and accurately suggest optimal products based on the conditions entered by the user, and to smoothly progress the purchasing process.

[1223] The "input means" is a means for providing an interface for the user to input their wishes and conditions.

[1224] The "transmission means" is a communication means for transmitting data input by the input means to the server.

[1225] The "database search means" is a means for obtaining appropriate data from a database based on the user's wishes and conditions.

[1226] The "proposal generating means" is a means for generating a plurality of proposals based on the data acquired by the database searching means.

[1227] The "presentation means" is a means for presenting the generated proposal to the user.

[1228] The "selection receiving means" is a means for receiving a proposal selected by the user.

[1229] The "processing means" is a means for carrying out the next process based on the selection received by the selection receiving means.

[1230] The "means for displaying a list" is a means for displaying the proposed information in a list format.

[1231] A "sorting means" is a means for ordering the suggested information based on the user's criteria.

[1232] In this system, users input their preferences and requirements using a terminal. For example, requirements such as "high-resolution camera," "long battery life," and "budget within 50,000 yen." Once the user has completed the input, this data is sent to the server by the terminal. The server analyzes the received data and retrieves the most suitable data using a database search method.

[1233] The database stores various product information, and the search means filters this data to find products that match the user's requirements.The proposal generation means then generates multiple proposals based on the search results.The proposals include detailed product information, such as "48MP resolution," "24-hour battery life," and "price under 50,000 yen."

[1234] The generated suggestions are presented to the user through a presentation means, which visually displays the suggested information on a user interface using a list display means, and further uses a sorting means to order the suggested information based on the user's criteria.

[1235] When the user selects one of the presented suggestions, the selection receiving means receives the selection. The received selection information is sent back to the server, and the server performs the next process (e.g., stock check or order confirmation process) based on the selection information.

[1236] This process is executed in the following situation as a concrete example: When a user inputs the conditions of a smartphone with a resolution of 48MP or more, a battery life of 24 hours or more, and a price of less than 50,000 yen, the server filters multiple products that match the conditions from the database and suggests the three most suitable products. An example of the prompt sentence in this case is as follows.

[1237] If a user enters criteria for a smartphone with a resolution of 48MP or higher, a battery life of 24 hours or more, and a price of less than ¥50,000, suggest three products that meet the criteria. The suggested product details include resolution, battery life, and price. Sort the product information in ascending order by price and descending order by battery life.

[1238] This allows users to quickly find the product that best suits their needs and requirements, and experience a smooth purchasing process based on that selection.

[1239] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1240] Step 1:

[1241] The user uses the device to input their preferences and requirements. Specifically, they enter requirements such as "high-resolution camera," "long battery life," and "budget under 50,000 yen" into the device's input interface (for example, a text field or drop-down list). The input data is converted into JSON or XML format and prepared for transmission to the server in the next step.

[1242] Step 2:

[1243] The device sends the entered data to the server using an HTTP POST request. The input data (preferences and conditions) is sent to the server's API endpoint. The sent data includes all the requirements entered by the user and is used as is for the next process.

[1244] Step 3:

[1245] The server analyzes the received data and generates an appropriate query. Specifically, an application server (e.g., Flask or Django) analyzes the received data and generates a query such as "resolution 48MP or higher," "battery life 24 hours or more," and "price under 50,000 yen." This query is then passed to a database search mechanism.

[1246] Step 4:

[1247] The server retrieves the appropriate data from the database using a database lookup method. Here, an SQL or NoSQL query is used to search for products that match the user's criteria. For example, a query like "SELECT FROM products WHERE resolution >= 48 AND battery_life >= 24 AND price <= 50000" is generated to retrieve data from the database (e.g., MySQL or MongoDB).

[1248] Step 5:

[1249] The server generates a plurality of proposals based on the data retrieved by the search means. The proposal generator creates proposals for each product based on the search results and generates a list including proposal details (resolution, battery life, price, etc.). This proposal list is then prepared for later presentation to the user.

[1250] Step 6:

[1251] The server presents the generated suggestions to the user through a presentation tool. Specifically, the server converts the suggestions into HTML or JSON format and sends them to the device. The device receives the suggestions and displays them in a list on the user interface. The suggestions are sorted based on the user's criteria and are displayed in the optimal order.

[1252] Step 7:

[1253] The user selects one of the presented suggestions. The selected suggestion is sent back to the server by the terminal. The selection information includes the ID and details of the selected product.

[1254] Step 8:

[1255] The server performs the next process (e.g., stock check or order confirmation process) based on the selected proposal. The processing means receives the selection information and executes stock check and order processing. Specifically, it checks the stock status in cooperation with the stock management system, and if there are no problems, it confirms the order and proceeds to the next step, such as shipping procedures.

[1256] This series of processes allows users to quickly find the product that best suits their needs and requirements, and experience a smooth purchasing process.

[1257] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1258] The system of the present invention allows users to input their preferences and requirements, searches a database based on those requirements, and presents optimal suggestions. Furthermore, by recognizing the user's emotions and incorporating them into the proposal generation, the system provides a more personalized experience.

[1259] The user uses the device to input their preferences and requirements. For example, if a user is looking for a new smartphone, they might input requirements such as "high-resolution camera," "long battery life," and "budget under 50,000 yen." The device's built-in camera and microphone are then used to analyze the user's facial expressions and tone of voice, and the emotion engine recognizes the user's emotions.

[1260] This input information and emotion information are sent to a server via the device. The server analyzes the received information and makes an appropriate query to a database. For example, it searches the database for smartphones that meet the following criteria: a resolution of 48MP or higher, a battery life of 24 hours or more, and a price of less than ¥50,000.

[1261] Based on information retrieved from the database, the server generates three suggestions that best match the user's criteria and emotional information. These suggestions include detailed information about each product (e.g., smartphone specifications, price, benefits, etc.). Specifically, the suggestions are generated in the form of "Smartphone A (48MP resolution, 24-hour battery life, price: ¥48,000)," "Smartphone B (32MP resolution, 30-hour battery life, price: ¥46,000)," and "Smartphone C (40MP resolution, 26-hour battery life, price: ¥49,000)." The user's emotions, as recognized by the emotion engine, influence the content of the suggestions. For example, if the user is feeling stressed, it is possible to prioritize simple and easy-to-understand suggestions.

[1262] The generated proposals are sent from the server to the device and presented to the user through a user interface. Through this, the user can review and compare the three proposals. After reviewing the presented proposals, the user selects the most suitable one. For example, suppose the user selects "Smartphone B."

[1263] This selection information and the emotional state at that time are again sent to the server via the device. Based on the received selection information and emotional information, the server updates the relevant database, checks inventory, and prepares for the next sales step. Specifically, it checks the inventory of "Smartphone B" and proceeds to the next order confirmation step.

[1264] By taking the user's emotions into consideration, the system can provide more satisfying suggestions to the user and make the purchasing process go more smoothly, thereby improving the user experience.

[1265] The above is a specific embodiment of the present invention including an emotion engine.

[1266] The processing flow will be explained below.

[1267] Step 1:

[1268] The user inputs their wishes and requirements into the terminal.

[1269] Users use the device's input form to enter their preferences and requirements, such as "high-resolution camera," "long battery life," and "budget within 50,000 yen."

[1270] Step 2:

[1271] The device analyzes the user's facial expressions and tone of voice, and the emotion engine recognizes the user's emotions.

[1272] The device's built-in camera and microphone capture the user's facial expressions and tone of voice, and this information is analyzed by an emotion engine that recognizes emotions such as happiness, stress, and excitement.

[1273] Step 3:

[1274] The terminal transmits the input desires, conditions and emotion information to the server.

[1275] The device compiles the user's input preferences and conditions and the emotional information recognized by the emotion engine into a data package and sends it to the server, usually in the form of an HTTP request.

[1276] Step 4:

[1277] The server receives and analyzes the user's request.

[1278] The server receives the data package sent from the terminal and analyzes the user's wishes, conditions, and emotional information.

[1279] Step 5:

[1280] The server queries the database to retrieve the relevant data.

[1281] The server uses the analysis results to send a query to the database to retrieve data that matches the user's preferences and conditions. For example, it searches the database for smartphones that meet the following criteria: a resolution of 48MP or higher, a battery life of 24 hours or more, and a price of less than 50,000 yen.

[1282] Step 6:

[1283] The server generates multiple proposals based on the acquired data.

[1284] Based on the information retrieved from the database, the server generates three suggestions that best match the user's criteria. Specifically, the suggestions are generated in the form of "Smartphone A (48MP resolution, 24-hour battery life, price: 48,000 yen)," "Smartphone B (32MP resolution, 30-hour battery life, price: 46,000 yen)," and "Smartphone C (40MP resolution, 26-hour battery life, price: 49,000 yen)." The user's emotional information recognized by the emotion engine influences the content of the suggestions. For example, if the user is feeling stressed, simple and easy-to-understand suggestions will be displayed first.

[1285] Step 7:

[1286] The server sends the generated proposal to the terminal.

[1287] The server assembles the three generated proposals into a data package and sends it to the terminal.

[1288] Step 8:

[1289] The terminal presents the suggestions in a user interface.

[1290] The device displays the proposals received from the server on a user interface (UI), allowing the user to review and compare the three proposals.

[1291] Step 9:

[1292] The user selects the best offer.

[1293] After reviewing the suggestions, the user selects the most suitable suggestion. For example, the user may select "Smartphone B."

[1294] Step 10:

[1295] The terminal transmits the user's selection and current emotional state to the server.

[1296] The terminal compiles the information selected by the user and the emotion information at that time into a data package and transmits it to the server.

[1297] Step 11:

[1298] The server performs the following process based on the selection result.

[1299] The server receives the user's selection and emotion information, updates the relevant database, checks inventory, and prepares the next sales step, such as starting the inventory check or order confirmation process.

[1300] The above is the processing flow of a specific embodiment of the present invention that includes an emotion engine.

[1301] Example 2

[1302] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1303] Conventional suggestion systems generally make suggestions based on the user's wishes and conditions, but this has the problem of not being able to make detailed suggestions that take into account the user's emotions and situation. Also, when the user is feeling some kind of stress or anxiety, conventional systems cannot adequately respond, which results in a problem of not sufficiently improving the user experience.

[1304] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1305] In this invention, the server includes an analysis means, a database search means, and a proposal generation means, which makes it possible to analyze not only the user's wishes and conditions but also their emotional information, and generate optimal proposals.

[1306] "Input means" refers to a device or interface that allows a user to input their wishes and requirements into the system.

[1307] The "transmission means" is a function for transmitting the input desires, conditions, and emotional information of the user to the server.

[1308] "Analysis means" is a function for analyzing the data and emotional information received by the server.

[1309] The "database search means" is a function that allows the server to obtain appropriate data from the database based on the user's wishes and conditions.

[1310] The "proposal generation means" is a function that allows the server to generate multiple proposals using a generative AI model based on the analysis results.

[1311] A "presentation means" is a device or interface for presenting generated suggestions to a user.

[1312] The "selective receiving means" is a function for receiving information selected by the user from among the presented proposals.

[1313] The "processing means" is a function for carrying out the next process based on the received selection information and emotion information.

[1314] The system of the present invention allows users to input their preferences and requirements, searches a database based on those requirements, and presents optimal suggestions. Furthermore, by recognizing the user's emotions and incorporating them into the proposal generation, the system provides a more personalized experience.

[1315] The user uses the device to input their preferences and requirements. For example, if a user is looking for a new smartphone, they might input requirements such as "high-resolution camera," "long battery life," and "budget under 50,000 yen." Furthermore, the device's built-in camera and microphone are used to analyze the user's facial expressions and tone of voice, and the emotion engine recognizes the user's emotions. Specifically, a general-purpose AI service can be used as the emotion recognition engine.

[1316] This input and emotion information is sent to the server via the device. The server analyzes the received information and executes appropriate queries against the database. For example, the server might use an SQL query to search the database for smartphones that meet the following criteria: a resolution of 48MP or higher, a battery life of 24 hours or more, and a price of less than ¥50,000.

[1317] Based on information retrieved from the database, the server generates three proposals that best match the user's criteria and emotional information. These proposals include detailed information about each product (e.g., smartphone specifications, price, benefits, etc.). Specifically, using a generative AI model, the following proposals are generated: "Smartphone A (48MP resolution, 24-hour battery life, price: ¥48,000)," "Smartphone B (32MP resolution, 30-hour battery life, price: ¥46,000)," and "Smartphone C (40MP resolution, 26-hour battery life, price: ¥49,000)." The user's emotions, as recognized by the emotion engine, influence the content of the proposals. For example, if the user is feeling stressed, it is possible to prioritize simple and easy-to-understand proposals.

[1318] The generated proposals are sent from the server to the device and presented to the user through a user interface. Through this, the user can review and compare the three proposals. After reviewing the presented proposals, the user selects the most suitable one. For example, suppose the user selects "Smartphone B."

[1319] This selection information and the emotional state at that time are again sent to the server via the device. Based on the received selection information and emotional information, the server updates the relevant database, checks inventory, and prepares for the next sales step. Specifically, it checks the inventory of "Smartphone B" and proceeds to the next order confirmation step.

[1320] By taking the user's emotions into consideration, the system can provide more satisfying suggestions to the user and make the purchasing process go more smoothly, thereby improving the user experience.

[1321] Examples:

[1322] If a user inputs the criteria "high-resolution camera, long battery life, budget within 50,000 yen" and the facial expression recognition engine determines that the user is stressed, the server will generate simple suggestions such as "Smartphone A (resolution 48MP, battery life 24 hours, price 48,000 yen)," "Smartphone B (resolution 32MP, battery life 30 hours, price 46,000 yen)," and "Smartphone C (resolution 40MP, battery life 26 hours, price 49,000 yen)."

[1323] Example prompt sentence:

[1324] "Generate three optimal suggestions for a user looking for a smartphone with a high-resolution camera, long battery life, and a budget of less than $50,000. If the user is stressed, prioritize the simpler suggestions."

[1325] The above is a specific embodiment of the present invention using an emotion engine and a generative AI model.

[1326] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1327] Step 1:

[1328] The user uses the terminal to input their wishes and requirements.

[1329] Input: User's wishes and requirements (e.g., "high-resolution camera," "long battery life," "budget within 50,000 yen")

[1330] Specific operation: The user enters their wishes and conditions into the terminal's input interface and presses the send button.

[1331] Step 2:

[1332] The device recognizes the user's emotions.

[1333] Input: The user's facial expressions and tone of voice captured through the device's camera and microphone

[1334] How it works: The device's built-in camera captures the user's facial expressions, and the microphone records the tone of voice. The emotion recognition engine analyzes this data to determine the user's emotional state.

[1335] Step 3:

[1336] The device sends the input desires, conditions and emotion information to the server.

[1337] Input: Hopes, conditions, emotional information

[1338] Output: JSON data sent to the server

[1339] Specific operation: The device collects the wishes, conditions, and emotional information into a single JSON object and sends it to the server using the HTTP protocol.

[1340] Step 4:

[1341] The server analyzes the received information.

[1342] Input: JSON data received by the server

[1343] Output: Analysis results (user's wishes, conditions, emotional information)

[1344] Specific operation: The server parses the JSON data and extracts information such as preferences, conditions, and emotions. For example, data such as "high-resolution camera," "long battery life," "budget under ¥50,000," and "stress" are extracted.

[1345] Step 5:

[1346] The server searches the database.

[1347] Input: Data on your wishes and conditions

[1348] Output: A list of matching smartphones retrieved from the database

[1349] Specific operation: The server generates an SQL query and searches the database for smartphones that match the following criteria, for example, "resolution of 48MP or more," "battery life of 24 hours or more," and "price under 50,000 yen."

[1350] Step 6:

[1351] The server generates the best offer.

[1352] Input: List of smartphones obtained from the database, emotional information

[1353] Output: Suggestion list (e.g. "Smartphone A", "Smartphone B", "Smartphone C")

[1354] How it works: The server uses a generative AI model to generate optimal suggestions based on acquired smartphone data. It adjusts the priority and content of suggestions based on emotional information, and generates suggestions in a simple, easy-to-understand format.

[1355] Step 7:

[1356] The server sends the generated proposal to the terminal.

[1357] Input: Suggestion list

[1358] Output: JSON data sent to the terminal

[1359] Specific operation: The server converts the proposal list into JSON format and sends it to the terminal using the HTTP protocol.

[1360] Step 8:

[1361] The terminal presents the generated suggestions to the user.

[1362] Input: Proposal list received from the server

[1363] Output: Proposal displayed in the user interface

[1364] Specific behavior: The device receives the list of suggestions and displays it on the user interface, allowing the user to review and compare the suggestions.

[1365] Step 9:

[1366] The user selects the best offer.

[1367] Input: The suggestions displayed (e.g., "Smartphone A," "Smartphone B," "Smartphone C")

[1368] Output: Selected suggestion (e.g. "Smartphone B")

[1369] Specific operation: The user selects the best one from the presented suggestions and presses the select button.

[1370] Step 10:

[1371] The terminal transmits the selection information and emotion information to the server.

[1372] Input: Selection information, emotion information

[1373] Output: JSON data sent to the server

[1374] Specific operation: The device combines the selection information and emotion information into a single JSON object and sends it to the server using the HTTP protocol.

[1375] Step 11:

[1376] The server updates the database and performs the following steps:

[1377] Input: Selection information, emotion information

[1378] Output: Update the database and prepare for further processing

[1379] Specific operation: Based on the selection information and emotion information received by the server, the database is updated, the inventory of "Smartphone B" is checked, and the next order confirmation step is prepared.

[1380] (Application example 2)

[1381] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1382] Conventional online shopping site systems could suggest products based on the user's desired products and conditions, but they were unable to consider the user's emotions. As a result, users were often confused by the large number of suggested product options, or conversely, felt that the suggested products were inappropriate. To solve this problem and increase user satisfaction, it is necessary to recognize the user's emotions and reflect them in the product suggestions.

[1383] The specification processing by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes input means for the user to input their wishes and conditions, transmission means for transmitting the input data to the server, database search means for acquiring appropriate data based on the user's wishes and conditions, proposal generation means for generating a plurality of proposals based on the data acquired by the search means, presentation means for presenting the generated proposals to the user, emotion recognition means for recognizing the user's emotions, emotion reflection means for generating proposals taking into account the emotions recognized by the emotion recognition means, selection receiving means for receiving the user's selection, and processing means for performing the next process based on the received selection. This enables personalized product proposals that take into account the user's emotions.

[1384] The "input means" is an interface device that allows the user to input their wishes and conditions.

[1385] The "transmitting means" is a communication device for transmitting input data to a server.

[1386] The "database search means" is a device for retrieving appropriate data from a database based on the user's wishes and conditions.

[1387] The "proposal generating means" is a device for generating a plurality of proposals based on the data acquired by the search means.

[1388] The "presentation means" is a device for displaying the generated proposals on a user interface.

[1389] The "emotion recognition means" is a device for recognizing the user's emotions from facial expressions, tone of voice, and the like.

[1390] The "emotion reflection means" is a device for generating a suggestion by taking into consideration the emotion recognized by the emotion recognition means.

[1391] The "selection receiving means" is a device for receiving a user's selection.

[1392] A "processing means" is a device for taking further action based on the received selection.

[1393] The system based on the present invention allows a user to input their wishes and requirements and makes optimal product suggestions through emotion recognition. This system comprises an input means, a transmission means, a database search means, a suggestion generation means, a presentation means, an emotion recognition means, an emotion reflection means, a selection and reception means, and a processing means. These means will be described in detail below.

[1394] System Configuration

[1395] 1. Input method:

[1396] It is a means by which users input their preferences and requirements (e.g., high-resolution camera, long battery life, budget, etc.) using a smartphone or other interface device.

[1397] 2. Means of transmission:

[1398] The entered data is sent from the user's device to the server via Wi-Fi or mobile data communication.

[1399] 3. Database search methods:

[1400] The server searches for information in a database based on the received user's wishes and requirements. This database contains detailed information about various products.

[1401] 4. Proposal generation means:

[1402] Based on the searched data, the system generates multiple proposals that match the user's preferences and requirements, including detailed information such as smartphone specifications, prices, and benefits.

[1403] 5. Means of presentation:

[1404] A means for visually presenting the generated suggestions to the user, such as on a smartphone screen or other display device.

[1405] 6. Emotion recognition means:

[1406] The device's camera and microphone are used to analyze the user's facial expressions and tone of voice, using software such as OpenCV and DeepFace.

[1407] 7. Emotional reflection means:

[1408] Based on the recognized emotional information, more personalized suggestions are generated, such as prioritizing simpler suggestions if the user is feeling stressed.

[1409] 8. Selective Reception Method:

[1410] This is a means for receiving information selected by the user from among the suggestions presented.

[1411] 9. Processing Methods:

[1412] It is a means for taking the next step (for example, checking stock availability or placing an order) based on the received selection information.

[1413] Processing flow

[1414] After the user inputs their preferences and conditions, the server receives them and searches the database. Next, the server recognizes the user's emotions through analysis by the emotion recognition means, reflects this in the proposal generation means, and generates appropriate proposals. Finally, the server displays the proposals to the user through the presentation means, receives the user's selection information, and performs the next process.

[1415] Specific examples

[1416] For example, if a user enters the criteria "high-resolution camera," "long battery life," and "budget within 50,000 yen," the system will search the database for these criteria and generate suggestions such as "Smartphone A (resolution 48MP, battery life 24 hours, price 48,000 yen)," "Smartphone B (resolution 32MP, battery life 30 hours, price 46,000 yen)," and "Smartphone C (resolution 40MP, battery life 26 hours, price 49,000 yen)."

[1417] Furthermore, if the system recognizes that the user is feeling "stressed" based on their facial expression, it will preferentially suggest "Smartphone B," which is simple and easy to understand.

[1418] Example prompts to input to a generative AI model:

[1419] "Consider the user's conditions: high-resolution camera, long battery life, budget within 50,000 yen, and generate optimal product suggestions when the user is feeling stressed."

[1420] With the above configuration, the present invention can realize personalized product proposals that take into account the user's emotions, and can make the purchasing process go more smoothly.

[1421] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1422] Step 1:

[1423] The user inputs their preferences and requirements, such as "high-resolution camera," "long battery life," and "budget within 50,000 yen," using a terminal. The input data is collected via the terminal's input means.

[1424] Step 2:

[1425] The terminal transmits the input data to the server, and the input data is sent to the server via the Internet using the transmission means.

[1426] Step 3:

[1427] The server searches the database based on the received data. Specifically, it uses the database search means to retrieve information on products that match the criteria of "high-resolution camera," "long battery life," and "budget within 50,000 yen."

[1428] Step 4:

[1429] The server generates a plurality of proposals based on the acquired data, using a proposal generation means to generate a plurality of proposals including detailed product information (e.g., specifications, price, advantages, etc. of the smartphone) based on the search results.

[1430] Step 5:

[1431] To recognize the user's emotions, the device uses a camera and microphone to capture the user's facial expressions and tone of voice, and then uses emotion recognition means to analyze the captured data and recognize the user's emotions.

[1432] Step 6:

[1433] The server generates suggestions taking into account the recognized emotions. Using an emotion reflection mechanism, the server adjusts the content of the suggestions based on the recognized emotional state to generate suggestions that are more acceptable to the user. For example, if the user is feeling stressed, simpler suggestions are prioritized.

[1434] Step 7:

[1435] The server transmits the generated proposal to the terminal, and the proposal is sent to the terminal using the presentation means in a format to be displayed on a user interface, so as to be visually presented to the user.

[1436] Step 8:

[1437] The user selects one of the multiple proposals presented, and the terminal collects the selected proposal information using the selection receiving means.

[1438] Step 9:

[1439] The terminal transmits the selected proposal information to the server, and the selected information is again sent to the server using the transmission means.

[1440] Step 10:

[1441] The server then performs the following process based on the received selection information: using the processing means to process the next step, such as checking stock availability and placing an order, to facilitate the user's purchasing process.

[1442] The above are the specific processing steps of the system that realizes the application example.

[1443] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1444] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1445] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1446] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1447] FIG. 9 illustrates an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and behaviors arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1448] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1449] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1450] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1451] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1452] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1453] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1454] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1455] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1456] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1457] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1458] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1459] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1460] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1461] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1462] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1463] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1464] The following is further disclosed regarding the above embodiment.

[1465] (Claim 1)

[1466] an input means for a user to input their wishes and conditions;

[1467] a transmitting means for transmitting the input data to a server;

[1468] a database search means for acquiring appropriate data based on the user's wishes and conditions;

[1469] a proposal generating means for generating a plurality of proposals based on the data acquired by the searching means;

[1470] a presentation means for presenting the generated proposal to a user;

[1471] selection receiving means for receiving a user selection;

[1472] processing means for taking further action based on the received selection;

[1473] A system including:

[1474] (Claim 2)

[1475] 10. The system of claim 1, wherein the presenting means comprises means for displaying the generated suggestions in a user interface.

[1476] (Claim 3)

[1477] 2. The system according to claim 1, wherein the search means includes means for retrieving from a database a plurality of data items that match the user's wishes and conditions.

[1478] "Example 1"

[1479] (Claim 1)

[1480] an input means for a user to input their wishes and conditions;

[1481] a transmitting means for transmitting the input data to a server;

[1482] data analysis means for analyzing the received data and generating appropriate queries;

[1483] a database search means for searching a database based on a query and retrieving data that matches the query;

[1484] a proposal generation means for generating a plurality of proposals based on the acquired data;

[1485] a transmitting means for transmitting the generated proposal from the server to the terminal;

[1486] a presentation means for displaying the suggestions to the user;

[1487] selection receiving means for receiving a user selection;

[1488] processing means for updating a relevant database and preparing the next sales step based on the received selections;

[1489] A system including:

[1490] (Claim 2)

[1491] 10. The system of claim 1, wherein the presenting means comprises means for displaying the generated suggestions in a user interface.

[1492] (Claim 3)

[1493] 10. The system of claim 1, wherein the data parsing means comprises means for parsing the received data to generate an SQL query.

[1494] "Application Example 1"

[1495] (Claim 1)

[1496] an input means for a user to input their wishes and conditions;

[1497] a transmitting means for transmitting the input data to a server;

[1498] a database search means for acquiring appropriate data based on the user's wishes and conditions;

[1499] a proposal generating means for generating a plurality of proposals based on the data acquired by the searching means;

[1500] a presentation means for presenting the generated proposal to a user;

[1501] selection receiving means for receiving a user selection;

[1502] processing means for taking further action based on the received selection;

[1503] a means for displaying a list of information proposed by the presentation means;

[1504] means for sorting the suggested information based on criteria;

[1505] A system including:

[1506] (Claim 2)

[1507] 10. The system of claim 1, further comprising: means for displaying the generated suggestions in a user interface.

[1508] (Claim 3)

[1509] 2. The system according to claim 1, wherein the search means includes means for retrieving from a database a plurality of data items that match the user's wishes and conditions.

[1510] "Example 2: Combining Emotion Engines"

[1511] (Claim 1)

[1512] an input means for a user to input their wishes and conditions;

[1513] a transmitting means for transmitting the input data and the user's emotion information to a server;

[1514] an analysis means for analyzing the received data and emotional information;

[1515] a database search means for acquiring appropriate data based on the user's wishes and conditions;

[1516] a proposal generation means for generating a plurality of proposals using a generative AI model based on the analysis results;

[1517] a presentation means for presenting to the user a proposal generated in consideration of the user's emotional information;

[1518] selection receiving means for receiving a user selection;

[1519] processing means for performing a next process based on the received selection and emotion information;

[1520] A system including:

[1521] (Claim 2)

[1522] 10. The system of claim 1, further comprising a presentation means for displaying the generated suggestions in a user interface.

[1523] (Claim 3)

[1524] 2. The system according to claim 1, further comprising a search means for retrieving from a database a plurality of data items that match the user's wishes and conditions.

[1525] "Application example 2 when combining emotion engines"

[1526] (Claim 1)

[1527] an input means for a user to input their wishes and conditions;

[1528] a transmitting means for transmitting the input data to a server;

[1529] a database search means for acquiring appropriate data based on the user's wishes and conditions;

[1530] a proposal generating means for generating a plurality of proposals based on the data acquired by the searching means;

[1531] a presentation means for presenting the generated proposal to a user;

[1532] emotion recognition means for recognizing an emotion of a user;

[1533] an emotion reflection means for generating a suggestion in consideration of the emotion recognized by the emotion recognition means;

[1534] selection receiving means for receiving a user selection;

[1535] processing means for taking further action based on the received selection;

[1536] A system including:

[1537] (Claim 2)

[1538] 10. The system of claim 1, wherein the presenting means comprises means for displaying the generated suggestions in a user interface.

[1539] (Claim 3)

[1540] 2. The system according to claim 1, wherein the search means includes means for retrieving from a database a plurality of data items that match the user's wishes and conditions. [Explanation of symbols]

[1541] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. an input means for a user to input their wishes and conditions; a transmitting means for transmitting the input data to a server; a database search means for acquiring appropriate data based on the user's wishes and conditions; a proposal generating means for generating a plurality of proposals based on the data acquired by the searching means; a presentation means for presenting the generated proposal to a user; selection receiving means for receiving a user selection; processing means for taking further action based on the received selection; A system including:

2. The system of claim 1 , wherein the presenting means comprises means for displaying the generated suggestions in a user interface.

3. 2. The system according to claim 1, wherein the search means includes means for retrieving from a database a plurality of data items that match the user's wishes and conditions.

Images