system

Abstract

Provide a system. [Solution] User authentication means; How to obtain data on your favorite members, A means to display detailed information about the products used by the favorite members, A way to check product availability, A means of suggesting similar products; A system including:

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In modern fan activities, there is an increasing demand for fans to obtain products that their favorite members (idols, celebrities, etc.) use in their private lives. However, there are often no established methods for obtaining specific product information used by their favorite members and purchasing those products. Furthermore, when a product is sold out or out of stock, there are limited ways to easily find similar alternative products. To resolve these inconveniences, a system is needed that allows fans to easily identify and purchase products used by their favorite members. [Means for solving the problem]

[0005] In order to solve the above-mentioned problems, the present invention provides the following means. Specifically, it provides a system including a user authentication means, a means for acquiring data on a favorite member, a means for displaying detailed information about products used by the favorite member, a means for checking product inventory, and a means for suggesting similar products. This system allows users to identify products used by their favorite member, obtain detailed information about products that are available for purchase, and, if a product is sold out or out of stock, it is possible to use an AI engine to suggest similar products. This greatly improves convenience for fans.

[0006] "User authentication means" refers to a function that verifies the authentication information of a user when the user accesses the system, and ensures that only authorized users can access the system.

[0007] "Means for obtaining data on the favorite member" refers to the system's function of obtaining the favorite member's profile information and a list of related products from the database.

[0008] "Means for displaying detailed information about products used by the favorite member" refers to a function that allows users to check detailed information (images, prices, links to stores selling the products, etc.) about the products used by the favorite member.

[0009] "Means for checking product availability" refers to the function of the system to check the availability of the selected product through an external API or database and provide the user with inventory information.

[0010] "Means for suggesting similar products" refers to a function that uses an AI engine to search for similar products in a database and suggest them to the user when the selected product is sold out or out of stock. [Brief explanation of the drawings]

[0011] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2]1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0012] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0013] First, the terms used in the following description will be explained.

[0014] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0015] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0016] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0017] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0018] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0019] [First embodiment]

[0020] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0021] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0022] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0023] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0024] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0025] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0026] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0027] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0028] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0029] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0030] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0031] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0032] The present invention provides a system that allows users to identify and easily purchase products used by their favorite idols. The overall processing flow of the system and specific embodiments are described below.

[0033] Overall system configuration

[0034] This system consists of a user terminal, a server, a database, an external API, and an AI engine. The main steps are user authentication, obtaining information about the favorite member, displaying detailed product information, checking inventory, and suggesting similar products.

[0035] User Authentication

[0036] User: When you open the app, the login screen appears. Enter your email address and password and press the "Login" button.

[0037] Terminal: Sends the entered authentication information to the server.

[0038] Server: Compares the received authentication information with the user data in the database and returns the authentication result. If authentication is successful, redirects the user to the home screen.

[0039] Obtaining information about your favorite member

[0040] User: Click on the icon of your favorite member on the home screen.

[0041] Device: Sends a request to the server to retrieve the profile information of the selected Oshimen.

[0042] Server: Retrieves the profile information of the favorite member and a list of related products from the database and returns them to the device.

[0043] Device: Based on the information obtained, the profile page of your favorite member will be displayed.

[0044] Display detailed product information

[0045] User: On their profile page, they click on a product listed in the "Recently Purchased" section.

[0046] Terminal: Sends a request to the server to request detailed information about the product.

[0047] Server: Retrieves detailed information about the product (image, price, link to store, etc.) from the database and sends it back to the device.

[0048] Device: Display the product details page based on the obtained product details.

[0049] Check product availability

[0050] User: Clicks the "Purchase" button on the product details page.

[0051] Device: Sends a purchase request to the server.

[0052] Server: Calls an external API or database to check product availability.

[0053] In stock: A link to the purchase page is generated and sent to the user's device.

[0054] Out of Stock: Notify me that the product is out of stock and proceed to the next step.

[0055] Terminal: Based on the results of the inventory check, if the item is in stock, the purchase page will be displayed; if not, it will display "Out of stock" and start the similar product suggestion process.

[0056] Similar product suggestions

[0057] Server: If a product is out of stock, use the AI ​​engine to search for similar products from the database.

[0058] Server: Returns a list of similar products found to the device.

[0059] Terminal: Displays a list of similar products and allows the user to choose from the suggested products.

[0060] Specific examples

[0061] 1. The user opens the app and logs in by entering the email address "example@example.com" and the password "password123".

[0062] 2. The server receives this and checks it against the database, and if authentication is successful, displays the home screen.

[0063] 3. The user clicks on the icon of their favorite idol, "Idol A," on the home screen to view their profile information.

[0064] 4. The server retrieves "Idol A's" profile and a list of recently purchased items from the database and sends them back to the terminal.

[0065] 5. The user clicks on "Lipstick" to view more information.

[0066] 6. The server retrieves detailed information about the product from the database and returns it to the terminal.

[0067] 7. When the user presses the "Buy" button, the server checks stock availability.

[0068] 8. If the item is in stock, the purchase page will be displayed. If it is out of stock, the AI ​​engine will search for similar products and display them on the device.

[0069] In this way, this system is designed to help users identify products used by their favorite idols and make purchases smoothly. It can also increase user satisfaction by suggesting similar products even if the product is out of stock.

[0070] The processing flow will be explained below.

[0071] Step 1:

[0072] User: Opens the app, displays the login screen, enters email address and password, and presses the "Login" button.

[0073] Step 2:

[0074] Terminal: Sends the entered authentication information (email address and password) to the server in JSON format.

[0075] Step 3:

[0076] Server: Checks the received authentication information against the user information in the database.

[0077] If successful: Returns a successful authentication response and starts a login session.

[0078] On failure: Return an error message.

[0079] Step 4:

[0080] Terminal: Receives the authentication result from the server, and if login is successful, redirects to the home screen, otherwise displays an error message.

[0081] Step 5:

[0082] User: Click on your favorite member's icon on the home screen.

[0083] Step 6:

[0084] Device: Sends a request to the server to get data on the selected Oshimen.

[0085] Step 7:

[0086] Server: Retrieves the profile information of the favorite member and a list of related products from the database and returns them to the device.

[0087] Step 8:

[0088] Device: Displays your favorite member's profile information and a list of related products on the screen.

[0089] Step 9:

[0090] User: On their profile page, they click on a product listed under "Recently Purchased Items."

[0091] Step 10:

[0092] Terminal: Sends a request to the server to obtain detailed information about the product.

[0093] Step 11:

[0094] Server: Retrieves detailed information about the product (image, price, link to store, etc.) from the database and sends it back to the device.

[0095] Step 12:

[0096] Terminal: Display detailed product information on the screen.

[0097] Step 13:

[0098] User: Clicks the "Purchase" button on the product details page.

[0099] Step 14:

[0100] Device: Sends a purchase request to the server.

[0101] Step 15:

[0102] Server: Calls an external API or database to check product availability.

[0103] If in stock: Generate a link to the purchase page and send it to your device.

[0104] If out of stock: Notify the customer that the product is out of stock and proceed to the next step.

[0105] Step 16:

[0106] Terminal: Receives the stock check result and displays the purchase page if the item is in stock, or displays "Out of stock" if the item is out of stock and starts the similar product suggestion process.

[0107] Step 17:

[0108] Server: Uses an AI engine to search the database for similar products to the missing item.

[0109] Step 18:

[0110] Server: Returns a list of similar products found to the device.

[0111] Step 19:

[0112] Device: A list of similar products is displayed on the screen, allowing the user to select from the suggested products and proceed with the purchase.

[0113] Example 1

[0114] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0115] Previously, the process for users to identify and purchase products used by their favorite members (supported members) was complicated, and there were issues with checking stock availability and suggesting similar products not working smoothly. Also, when the stock status of a product was unknown, similar alternative products were not suggested appropriately, which led to a decrease in user satisfaction.

[0116] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0117] In this invention, the server includes a user authentication means, a means for acquiring data on the favorite target, a means for displaying detailed information on products used by the favorite target, a means for checking product inventory, a means for suggesting similar products, and a means for searching for similar products from a database using an AI engine. This allows users to easily identify products used by their favorite member (favorite target) and purchase them after checking inventory. Even if a product is out of stock, the AI ​​engine is used to quickly suggest suitable similar products, improving user satisfaction.

[0118] "User authentication means" is a mechanism for allowing a user to access a system by inputting appropriate authentication information.

[0119] "Means for obtaining data on supported objects" refers to the function that enables the system to extract and obtain information on specific supported objects (e.g., idols, characters, etc.) from the database.

[0120] "Means for displaying detailed information about products used by the target of support" is a function for providing users with specific information about the products used by the target of support (such as name, image, price, and link to the store where the product is sold).

[0121] "Means for checking product availability" refers to the mechanism by which the system checks, via an external API or database, whether a particular product is currently available.

[0122] The "means for suggesting similar products" is a function for presenting similar products that are alternative candidates to the user when a product is out of stock, for example.

[0123] "Means for searching for similar products from a database using an AI engine" refers to a mechanism that uses an artificial intelligence engine to analyze information in a database and automatically identify and extract products similar to a specified product.

[0124] This invention relates to a method for providing a system that identifies products used by a favorite member (supported person) and allows users to easily purchase them. This system smoothly performs user authentication, obtains information about the supported person, displays detailed product information, checks inventory, and even suggests similar products if the item is out of stock.

[0125] Overall system configuration

[0126] This system consists of a user terminal, a server, a database, an external API, and an AI engine. The main steps are user authentication, acquisition of support information, display of detailed product information, inventory confirmation, and suggestion of similar products.

[0127] User Authentication

[0128] When a user launches the app, a login screen appears. The user enters the email address "example@example.com" and the password "password123" and presses the "Login" button.

[0129] The device sends the entered authentication information to the server by using an HTTP POST request to send the data to the server's authentication endpoint.

[0130] The server checks the received authentication information against the user data in its database, searches for the email address and password pair using a database query, and verifies whether they match. The authentication is successful or not based on the result of the check.

[0131] If authentication is successful, the server generates a redirect URL for the home screen along with an authentication success message and returns it to the device. If authentication fails, it returns an error message.

[0132] Acquisition of support information

[0133] The user clicks on the icon of a specific object of support (e.g., idol A) on the home screen.

[0134] The device obtains the ID of the selected target and sends a request for profile information to the server, specifically using an HTTP GET request.

[0135] The server retrieves profile information and related product lists from the database and uses database queries to extract the required information.

[0136] The server returns the acquired profile information and product list to the terminal.

[0137] Based on the received data, the device displays the profile page of the person being supported, along with a list of products.

[0138] Display detailed product information

[0139] A user clicks on a specific product (e.g., "lipstick") in the "Recently Purchased Items" section of their profile page.

[0140] The device obtains the ID of the product the user clicked on and sends a request for more information to the server, specifically using an HTTP GET request.

[0141] The server retrieves detailed information about the product (image, price, store link, etc.) from the database and extracts the required information using a database query.

[0142] The server returns the obtained detailed information to the terminal.

[0143] The terminal displays the product details page based on the received product details information.

[0144] Check product availability

[0145] The user presses the "Purchase" button on the product details page.

[0146] The device sends a purchase request to the server, specifically using an HTTP POST request.

[0147] The server calls an external API or database to check the product availability. For example, it calls an external API to get real-time inventory information.

[0148] server:

[0149] If the item is in stock, a link to the purchase page is generated and sent to the user's terminal.

[0150] If the item is out of stock, the system will notify you and proceed to search for similar items using an AI engine.

[0151] Based on the results of the inventory check, the terminal displays the purchase page if the item is in stock, and if not, displays "Out of stock" and starts the process of suggesting similar products.

[0152] Similar product suggestions

[0153] If a product is out of stock, the server uses an AI engine (e.g., a generative AI model) to search for similar products in the database. As a concrete example, the following prompt is input to the AI ​​engine:

[0154] Prompt: "Search our database for similar products for the product name 'Lipstick'."

[0155] The server returns a list of similar products found to the terminal.

[0156] The terminal displays the received list of similar products and allows the user to select from the suggested products.

[0157] The system is designed to help users identify and purchase the products they support through a step-by-step process, and even if an item is out of stock, it utilizes an AI engine to quickly suggest suitable similar products, increasing user satisfaction.

[0158] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0159] Step 1:

[0160] The user launches the app, enters the email address "example@example.com" and password "password123" on the login screen, and presses the "Login" button.

[0161] Input: Email address, password

[0162] Output: Authentication request

[0163] The terminal sends the entered authentication information to the server using an HTTP POST request.

[0164] Input: Authentication Request

[0165] Output: HTTP POST request to the server

[0166] The server checks the received credentials against the user data in its database, which involves running a database query to verify that the email address and password match.

[0167] Input: Credentials

[0168] Output: Matching result (authentication success or failure)

[0169] If the authentication is successful, the server generates a redirect URL for the home screen along with an authentication success message and returns it to the device. If the authentication is unsuccessful, it returns an error message.

[0170] Input: Matching result

[0171] Output: Authentication result (success or error)

[0172] The device receives the returned authentication result, and if the authentication is successful, it transitions to the home screen, and if it is unsuccessful, it displays an error message.

[0173] Input: Authentication result

[0174] Output: Home screen or error message

[0175] Step 2:

[0176] The user clicks on the icon of the object of their support (e.g., idol A) on the home screen.

[0177] Input: Icon click event

[0178] Output: Supported ID

[0179] The terminal sends the ID of the selected target to the server using an HTTP GET request.

[0180] Input: ID of the target

[0181] Output: HTTP GET request to the server

[0182] The server retrieves the profile information and associated product listings of the supported subjects from the database, which involves executing a database query to extract the profile information and product listings.

[0183] Input: ID of the target

[0184] Output: Profile information and related product list

[0185] The server returns the acquired profile information and a list of related products to the terminal.

[0186] Input: Profile information and related product list

[0187] Output: Data returned to the terminal

[0188] The terminal displays the profile page of the target of support and a list of related products based on the received data.

[0189] Input:Return data

[0190] Output: Profile page and product list

[0191] Step 3:

[0192] A user clicks on a specific product (e.g., "lipstick") in the "Recently Purchased Items" section on their profile page.

[0193] Input: Product click event

[0194] Output: Product ID

[0195] The terminal sends the ID of the product clicked by the user to the server using an HTTP GET request.

[0196] Input: Product ID

[0197] Output: HTTP GET request to the server

[0198] The server retrieves detailed information about the product (images, prices, store links, etc.) from the database. This involves executing a database query to extract the required data.

[0199] Input: Product ID

[0200] Output: Detailed information (images, prices, retailer links)

[0201] The server returns the acquired detailed information to the terminal.

[0202] Input:Detailed information

[0203] Output: Data returned to the terminal

[0204] The terminal displays a product detail page based on the received product detail information.

[0205] Input:Return data

[0206] Output: Product detail page display

[0207] Step 4:

[0208] The user presses the "Purchase" button on the product details page.

[0209] Input: Buy button click event

[0210] Output: Purchase request

[0211] The terminal sends a purchase request to the server using an HTTP POST request.

[0212] Input: Purchase Request

[0213] Output: HTTP POST request to the server

[0214] The server calls an external API or database to check product availability, for example, by sending an API request to get real-time inventory information.

[0215] Input: Purchase Request

[0216] Output: Inventory status data

[0217] If the product is in stock, the server generates a link to the purchase page and sends it to the user's device. If the product is out of stock, the server notifies the user that the product is out of stock and proceeds to the process of searching for similar products using an AI engine.

[0218] Input: Inventory status data

[0219] Output: Purchase link or out-of-stock notification

[0220] Based on the results of the inventory check, the terminal displays a purchase page if the item is in stock, and if not, displays "Out of stock" and starts the similar product suggestion process.

[0221] Input: Inventory check result

[0222] Output: Display of purchase page or out-of-stock notification

[0223] Step 5:

[0224] If a product is out of stock, the server uses an AI engine (e.g., a generative AI model) to search for similar products in the database. As a concrete example, the following prompt sentence is input to the AI ​​engine:

[0225] "\nPlease search our database for similar products with the product name 'Lipstick'."

[0226] Input: prompt statement

[0227] Output: Similar products list

[0228] The server returns a list of similar products found to the terminal.

[0229] Input: Similar products list

[0230] Output: Data returned to the terminal

[0231] The terminal displays the received list of similar products and allows the user to select from the suggested products.

[0232] Input:Return data

[0233] Output: Display similar products list

[0234] (Application example 1)

[0235] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0236] Today's users have a need to easily identify and purchase products used by their favorite idols. However, it is difficult to easily find detailed product information and stock status of their favorite idols, and to instantly find similar products. There is a need for a system that can solve these problems and allow users to enjoy shopping more comfortably.

[0237] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0238] In this invention, the server includes a user authentication means, a means for acquiring data on the favorite member, a means for displaying detailed information on products used by the favorite member, a means for checking product inventory, a means for suggesting similar products, a means for suggesting similar products using a generative AI model, and a means for generating prompt text and inputting it into the generative AI model. This allows users to identify products used by their favorite member and smoothly check inventory and purchase them. Furthermore, users can receive suggestions for similar products even if the product is out of stock, which increases user satisfaction.

[0239] "User authentication means" refers to a means for verifying that a user is a valid user when accessing a system.

[0240] The "means for obtaining data on the favorite member" is a means for obtaining profile information and a list of related products related to the favorite member from the database.

[0241] The "means for displaying detailed information about products used by a favorite member" is a means for displaying to a user detailed information about products used by a favorite member selected by the user.

[0242] A "means for checking product availability" is a means for checking whether a particular product is in stock using an external API or database.

[0243] The "means for suggesting similar products" is a means for suggesting other similar products to the user when there is insufficient stock.

[0244] "Means for suggesting similar products using a generative AI model" refers to means for using an artificial intelligence model to search for similar products to a specific product and suggest them to users.

[0245] "Means for generating prompt sentences and inputting them to a generative AI model" refers to means for generating prompt sentences containing appropriate questions or commands for a generative AI model and inputting them.

[0246] The present invention is a system that identifies products used by a favorite member and suggests similar products based on them. This system includes a user authentication means, a means for acquiring data on the favorite member, a means for displaying detailed information about the products used by the favorite member, a means for checking product stock status, a means for suggesting similar products, a means for suggesting similar products using a generative AI model, and a means for generating prompt sentences and inputting them into the generative AI model.

[0247] Overall system configuration

[0248] This system consists of a user terminal, a server, a database, an external API, and a generative AI model. The main steps are user authentication, obtaining information about the favorite member, displaying detailed product information, checking inventory, and suggesting similar products.

[0249] Hardware and software used

[0250] Frontend: React Native is used as an application for smartphones (iOS / ANDROID (registered trademark)).

[0251] Backend: Uses Node.js and Express.js as the server.

[0252] Database: MySQL (registered trademark) is used for data storage.

[0253] External API: Use the product inventory confirmation API.

[0254] Generative AI model: Uses TENSORFLOW(R) to suggest similar products.

[0255] Details of each method and processing flow

[0256] 1. User authentication method:

[0257] The user opens the app and enters their email address and password on the login screen.

[0258] The information entered is sent to the server and checked against user data in a MySQL database.

[0259] If authentication is successful, you will be redirected to the home screen.

[0260] 2. How to get your favorite member's data:

[0261] When a user clicks on the icon of their favorite member on the home screen, the profile information of the favorite member and a list of related products are sent back to the device from the database via the server.

[0262] 3. How to view detailed information about products used by your favorite idol:

[0263] When a user selects a product on the profile page of their favorite member, detailed information about that product is requested from the server, retrieved from the database, and displayed.

[0264] 4. How to check product availability:

[0265] When the user presses the "Buy" button, stock availability is checked using an external API or database.

[0266] 5. Suggesting similar products:

[0267] If an item is out of stock, a generative AI model (TensorFlow) is used to suggest similar items.

[0268] The server generates prompt sentences based on information such as category, brand, and price range, and inputs them into the generative AI model.

[0269] Specific examples

[0270] For example, if a user selects a "lipstick" that "Favorite Member A" recently purchased and it's out of stock, the generative AI model will generate the following prompt:

[0271] Prompt: The lipstick that Oshime A recently purchased is out of stock. Please suggest five lipsticks from the same brand with similar features.

[0272] This prompt sentence is input into a generative AI model, and the results are sent back to the user's device to recommend similar products.

[0273] This system allows users to identify products used by their favorite idols, check stock availability, and purchase them smoothly. Furthermore, if an item is out of stock, users can receive suggestions for similar products, increasing user satisfaction.

[0274] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0275] Step 1:

[0276] The user opens the application and enters their email address and password on the login screen. This user input is sent to the server. The server verifies the user information in the MySQL database, and if authentication is successful, redirects them to the home screen. The input is the user's authentication information, and the output is the authentication result. Data processing and calculations involve verification of the user authentication information.

[0277] Step 2:

[0278] When a user clicks on an icon of their favorite member on the home screen, the selected information is sent as a request to the server. The server retrieves the member's profile information and a list of related products from the MySQL database and sends this back to the device. The input is the selected member's information, and the output is detailed data about the member. Data processing and calculation involves retrieving information from the database.

[0279] Step 3:

[0280] When a user clicks on a recently purchased item on the profile page of their favorite idol, a request is sent to the server for detailed information about that item. The server retrieves detailed information about the item (image, price, link to retail store, etc.) from the database and sends it back to the terminal. The input is the product selection information, and the output is detailed product information. Data processing and calculation involves retrieving detailed product information from the database.

[0281] Step 4:

[0282] When a user presses the "Purchase" button on a product detail page, the purchase request is sent to the server. The server calls an external API or database to check the product's stock status. The input is the purchase request and the output is the stock status. If the product is in stock, a link to the purchase page is generated and sent to the terminal. Data processing and calculations involve checking stock and generating the link.

[0283] Step 5:

[0284] If the item is out of stock, the server will use a generative AI model to begin the process of suggesting similar items. The server generates a prompt sentence and inputs this into the generative AI model. The input is the prompt sentence, and the output is a list of similar items. Data processing and calculations involve generating the prompt sentence and using the AI ​​model to search for similar items.

[0285] Step 6:

[0286] The server returns a list of similar products obtained from the generative AI model to the terminal. The terminal displays it, and the user can select from the suggested products. The input is a list of similar products, and the output is product information displayed to the user. Data processing and calculation involves displaying the output of the AI ​​model on the user's terminal.

[0287] As an example of a specific prompt sentence, we could generate the sentence, "The lipstick recently purchased by my favorite idol A is out of stock. Please suggest five lipsticks from the same brand with similar features." By inputting this into the generative AI model, it will search for and suggest similar products.

[0288] In this way, the specific actions and processing flow performed by the user, terminal, and server at each step are clearly defined. At each processing step, data processing and calculations are performed based on the input, and appropriate output is generated, realizing a system that allows users to easily identify and purchase products used by their favorite member.

[0289] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0290] The present invention combines an emotion engine with a system that identifies products used by favorite idols and allows users to easily purchase them, thereby providing specific product recommendations and promotions based on the user's emotions. The overall processing flow of the system and specific embodiments are described below.

[0291] Overall system configuration

[0292] This system consists of a user terminal, a server, a database, an external API, an AI engine, and an emotion engine. The main steps are user authentication, obtaining information about the favorite member, displaying detailed product information, checking inventory, suggesting similar products, and adjusting content based on user emotions.

[0293] User Authentication

[0294] User: When you open the app, the login screen appears. Enter your email address and password and press the "Login" button.

[0295] Terminal: Sends the entered authentication information to the server.

[0296] Server: Compares the received authentication information with the user data in the database and returns the authentication result. If authentication is successful, redirects the user to the home screen.

[0297] Obtaining information about your favorite member

[0298] User: Click on the icon of your favorite member on the home screen.

[0299] Device: Sends a request to the server to retrieve the profile information of the selected Oshimen.

[0300] Server: Retrieves the profile information of the favorite member and a list of related products from the database and returns them to the device.

[0301] Device: Based on the information obtained, the profile page of your favorite member will be displayed.

[0302] Display detailed product information

[0303] User: On their profile page, they click on a product listed in the "Recently Purchased" section.

[0304] Terminal: Sends a request to the server to obtain detailed information about the product.

[0305] Server: Retrieves detailed information about the product (image, price, link to store, etc.) from the database and sends it back to the device.

[0306] Device: Display the product details page based on the obtained product details.

[0307] Check product availability

[0308] User: Clicks the "Purchase" button on the product details page.

[0309] Device: Sends a purchase request to the server.

[0310] Server: Calls an external API or database to check product availability.

[0311] If in stock: Generate a link to the purchase page and send it to the user's device.

[0312] If out of stock: Notify the customer that the product is out of stock and proceed to the next step.

[0313] Device: Based on the results of the inventory check, if the item is in stock, the purchase page will be displayed; if it is out of stock, the message "Out of stock" will be displayed and the similar product suggestion process will be initiated.

[0314] Similar product suggestions

[0315] Server: If a product is out of stock, use the AI ​​engine to search for similar products from the database.

[0316] Server: Returns a list of similar products found to the device.

[0317] On your device: Displays a list of similar products, allowing the user to select from the suggested products and proceed with the purchase.

[0318] Content adjustment based on user sentiment

[0319] Terminal: Analyzes the user's facial expressions, voice, and text input, and recognizes the user's emotions using an emotion engine.

[0320] Server: Based on the recognized emotional information, adjust the display content of the means for acquiring data on the favorite member and the means for suggesting similar products.

[0321] For example, if the user is happy, the number of related product recommendations will be increased, and if the user is depressed, products and promotional content that will lift the user's spirits will be displayed.

[0322] Device: Display the adapted content to the user.

[0323] Specific examples

[0324] 1. The user opens the app and logs in by entering the email address "example@example.com" and the password "password123".

[0325] 2. The server receives this and checks it against the database, and if authentication is successful, displays the home screen.

[0326] 3. The user clicks on the icon of their favorite idol, "Idol A," on the home screen to view their profile information.

[0327] 4. The server retrieves "Idol A's" profile and a list of recently purchased items from the database and sends them back to the terminal.

[0328] 5. The user clicks on "Lipstick" to view more information.

[0329] 6. The server retrieves detailed information about the product from the database and returns it to the terminal.

[0330] 7. When the user presses the "Buy" button, the server checks stock availability.

[0331] 8. If the item is in stock, the purchase page will be displayed. If it is out of stock, the AI ​​engine will search for similar products and display them on the device.

[0332] 9. The device captures the user's facial expressions with a camera, and the emotion engine analyzes the user's emotions.

[0333] 10. Based on the analyzed emotions, the server selects appropriate products and promotions and displays them on the device.

[0334] For example, if the user is happy, the number of products related to "Idol A" will be increased, and if the user is depressed, promotional products that will lift the user's spirits will be displayed.

[0335] In this way, this system is designed to identify products used by users' favorite idols and facilitate smooth purchases. Furthermore, by utilizing an emotion engine, it can suggest individual content according to the user's emotional state, further increasing user satisfaction.

[0336] The processing flow will be explained below.

[0337] Step 1:

[0338] User: Opens the app, displays the login screen, enters email address and password, and presses the "Login" button.

[0339] Step 2:

[0340] Terminal: Sends the entered authentication information (email address and password) to the server in JSON format.

[0341] Step 3:

[0342] Server: Checks the received authentication information against the user information in the database. If successful, returns a response indicating successful authentication and starts a login session. If unsuccessful, returns an error message.

[0343] Step 4:

[0344] Terminal: Receives the authentication result from the server, and if login is successful, redirects to the home screen, otherwise displays an error message.

[0345] Step 5:

[0346] User: Click on your favorite member's icon on the home screen.

[0347] Step 6:

[0348] Device: Sends a request to the server to get data on the selected Oshimen.

[0349] Step 7:

[0350] Server: Retrieves the profile information of the favorite member and a list of related products from the database and returns them to the device.

[0351] Step 8:

[0352] Device: Displays your favorite member's profile information and a list of related products on the screen.

[0353] Step 9:

[0354] User: On their profile page, they click on a product listed under "Recently Purchased Items."

[0355] Step 10:

[0356] Terminal: Sends a request to the server to obtain detailed information about the product.

[0357] Step 11:

[0358] Server: Retrieves detailed information about the product (image, price, link to store, etc.) from the database and sends it back to the device.

[0359] Step 12:

[0360] Terminal: Display detailed product information on the screen.

[0361] Step 13:

[0362] User: Clicks the "Purchase" button on the product details page.

[0363] Step 14:

[0364] Device: Sends a purchase request to the server.

[0365] Step 15:

[0366] Server: Calls an external API or database to check product availability.

[0367] If the item is in stock, a link to the purchase page is generated and sent to the device.

[0368] If the item is out of stock, the system notifies the user that the item is out of stock and proceeds to the next step.

[0369] Step 16:

[0370] Terminal: Receives the stock check result and displays the purchase page if the item is in stock, or displays "Out of stock" if the item is out of stock and starts the similar product suggestion process.

[0371] Step 17:

[0372] Server: Uses an AI engine to search the database for similar products to the missing item.

[0373] Step 18:

[0374] Server: Returns a list of similar products found to the device.

[0375] Step 19:

[0376] On your device: Displays a list of similar products, allowing the user to select from the suggested products and proceed with the purchase.

[0377] Step 20:

[0378] User: Selects a product from the list of similar products and clicks the purchase button.

[0379] Step 21:

[0380] Terminal: Sends a similar product purchase request to the server.

[0381] Step 22:

[0382] Server: Checks the stock status and availability of similar products and returns the results to the terminal.

[0383] Step 23:

[0384] Device: Display a purchase completion screen to the user.

[0385] Step 24:

[0386] Terminal: Analyzes the user's facial expressions, voice, and text input, and recognizes the user's emotions using an emotion engine.

[0387] Step 25:

[0388] Server: Based on the recognized emotional information, adjust the display content of the means for acquiring data on the favorite member and the means for suggesting similar products.

[0389] For example, if the user is happy, the number of related product recommendations will be increased, and if the user is depressed, products and promotional content that will lift the user's spirits will be displayed.

[0390] Step 26:

[0391] Device: Display the adapted content to the user.

[0392] Specific examples

[0393] 1. The user opens the app and logs in by entering the email address "example@example.com" and the password "password123".

[0394] 2. The server receives this and checks it against the database, and if authentication is successful, displays the home screen.

[0395] 3. The user clicks on the icon of their favorite idol, "Idol A," on the home screen to view their profile information.

[0396] 4. The server retrieves "Idol A's" profile and a list of recently purchased items from the database and sends them back to the terminal.

[0397] 5. The user clicks on "Lipstick" to view more information.

[0398] 6. The server retrieves detailed information about the product from the database and returns it to the terminal.

[0399] 7. When the user presses the "Buy" button, the server checks stock availability.

[0400] 8. If the item is in stock, the purchase page will be displayed. If it is out of stock, the AI ​​engine will search for similar products and display them on the device.

[0401] 9. The device captures the user's facial expressions with a camera, and the emotion engine analyzes the user's emotions.

[0402] 10. Based on the analyzed emotions, the server selects appropriate products and promotions and displays them on the device.

[0403] For example, if the user is happy, the number of products related to "Idol A" will be increased, and if the user is depressed, promotional products that will lift the user's spirits will be displayed.

[0404] Example 2

[0405] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0406] In today's world, users want to easily identify and purchase products used by their favorite idols. However, conventional systems make the product identification and purchase process cumbersome and time-consuming for users. Furthermore, product recommendations and promotions are not tailored to the user's emotions, making it difficult to improve personalized satisfaction.

[0407] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a user authentication means, a means for acquiring data on the favorite member, a means for displaying detailed information on products used by the favorite member, a means for checking product inventory, a means for suggesting similar products, a means for acquiring and analyzing emotion data, and a means for adjusting content based on the user's emotion. This allows the user to smoothly identify and purchase products used by the favorite member, and also provides individual content according to the user's emotional state, thereby improving satisfaction.

[0408] "User authentication means" refers to a means for processing and authenticating authentication information such as an email address and password used when a user accesses the system.

[0409] "Means for obtaining data on a favorite member" refers to means for obtaining profile information and related product information of a target person (favorite member) from the database within the system.

[0410] The "means for displaying detailed information about the product used by the favorite member" is a means for displaying detailed information such as an image, price, and link to a store selling the product selected by the user.

[0411] "Means for checking product availability" refers to means for checking the availability of selected products using an external API or database.

[0412] "Means for suggesting similar products" refers to a means for using an AI engine to search for similar products from a database and suggest them to users when an item is out of stock.

[0413] The "means for acquiring and analyzing emotional data" refers to a means for recognizing the emotional state of a user by analyzing the user's facial expressions, voice, and text input.

[0414] The "means for adjusting content based on user emotion" refers to a means for individually adjusting displayed products and promotional content based on recognized user emotion information.

[0415] The present invention combines an emotion engine with a system that identifies products used by a specific idol and allows users to easily purchase them, thereby providing specific product recommendations and promotions based on the user's emotions. The overall processing flow of the system and specific embodiments are described below.

[0416] This system consists of a user terminal, a server, a database, an external API, an AI engine, and an emotion engine. The main steps are user authentication, obtaining information about the favorite member, displaying detailed product information, checking inventory, suggesting similar products, and adjusting content based on user emotions.

[0417] User Authentication

[0418] User: When the app is opened, the login screen appears, the user enters their email address and password, and presses the "Login" button.

[0419] Terminal: Sends the entered authentication information to the server using the HTTPS protocol.

[0420] Server: Compares the received authentication information with the user data in the database and returns the authentication result. If authentication is successful, redirects the user to the home screen.

[0421] Obtaining information about your favorite member

[0422] User: Click on the icon of your favorite member on the home screen.

[0423] Device: Sends a request to the server to retrieve the profile information of the selected Oshimen.

[0424] Server: Retrieves the profile information of the favorite member and a list of related products from the database and returns them to the device.

[0425] Device: Display your favorite member's profile page based on the information obtained.

[0426] Display detailed product information

[0427] User: On their profile page, they click on a product listed in the "Recently Purchased" section.

[0428] Terminal: Sends a request to the server to obtain detailed information about the product.

[0429] Server: Retrieves detailed information about the product (image, price, link to store, etc.) from the database and sends it back to the device.

[0430] Device: Display the product details page based on the obtained product details.

[0431] Check product availability

[0432] User: Clicks the "Purchase" button on the product details page.

[0433] Device: Sends a purchase request to the server.

[0434] Server: Calls an external API or database to check the product's availability. If the product is in stock, generates a link to the purchase page and sends it to the user's device. If the product is out of stock, notifies the user that the product is out of stock and proceeds to the next step.

[0435] Device: Based on the results of the inventory check, if the item is in stock, the purchase page will be displayed; if it is out of stock, the message "Out of stock" will be displayed and the similar product suggestion process will be initiated.

[0436] Similar product suggestions

[0437] Server: If a product is out of stock, use the AI ​​engine to search for similar products from the database.

[0438] Server: Returns a list of similar products found to the device.

[0439] On your device: Displays a list of similar products, allowing the user to select from the suggested products and proceed with the purchase.

[0440] Content adjustment based on user sentiment

[0441] Terminal: Analyzes the user's facial expressions, voice, and text input, and recognizes the user's emotions using an emotion engine.

[0442] Server: Based on the recognized emotion information, the server adjusts the display content of the means for acquiring data on the favorite member and the means for suggesting similar products. For example, if the user is happy, the server increases the number of related product recommendations, and if the user is depressed, the server displays products and promotional content that will lift the user's spirits.

[0443] Device: Display the adapted content to the user.

[0444] Specific examples

[0445] 1. The user opens the app and logs in by entering the email address "example@example.com" and the password "password123".

[0446] 2. The server receives this and checks it against the database, and if authentication is successful, displays the home screen.

[0447] 3. Users click on their favorite member's icon on the home screen to view their profile information and a list of recently purchased items.

[0448] 4. The server retrieves the profile of the favorite member and detailed information about related products from the database and sends them to the terminal.

[0449] 5. The user clicks on the displayed product to view more information.

[0450] 6. The server retrieves detailed information about the product from the database and returns it to the terminal.

[0451] 7. When the user presses the "Buy" button, the server checks stock availability.

[0452] 8. If the item is in stock, the purchase page will be displayed. If it is out of stock, the AI ​​engine will search for similar products and display them on the device.

[0453] 9. The device captures the user's facial expressions with a camera, and the emotion engine analyzes the user's emotions.

[0454] 10. The server selects appropriate products and promotions based on the analyzed emotions and displays them on the device. For example, if the user is happy, it will increase the number of related products, and if the user is depressed, it will display products that will lift their spirits.

[0455] In this way, this system is designed to identify products used by users' favorite idols and facilitate smooth purchases. Furthermore, by utilizing the emotion engine, it can suggest individual content according to the user's emotional state, further increasing user satisfaction.

[0456] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0457] Step 1: User authentication

[0458] Enter your email address and password

[0459] process:

[0460] User: When you open the app, the login screen will appear. Enter your email address and password and press the "Login" button.

[0461] Terminal: The entered authentication information is sent to the server via the HTTPS protocol.

[0462] Server: Checks the received credentials against the user data in the database using the hashed password.

[0463] Output: Authentication result (success or failure)

[0464] Specific operation:

[0465] If authentication is successful, the server generates a user ID and session information and returns it to the device, redirecting it to the home screen. If authentication fails, an error message is returned to the device, and the login screen is displayed again.

[0466] Step 2: Obtaining information about your favorite member

[0467] Input: Select your favorite member's icon

[0468] process:

[0469] User: Click on the icon of your favorite member on the home screen.

[0470] Device: Send a request to the server containing the ID of the selected member.

[0471] Server: Retrieves the profile information of the favorite member and the related product list from the database. Executes queries to extract relevant data.

[0472] Output: Profile information of your favorite member and related product list

[0473] Specific operation:

[0474] The server returns the acquired data in JSON format to the device, and the device displays the profile page of the favorite member.

[0475] Step 3: Display detailed product information

[0476] Input: Select product

[0477] process:

[0478] User: On their profile page, they click on a product listed in the "Recently Purchased" section.

[0479] Device: Sends a request to the server containing the ID of the selected item.

[0480] Server: Retrieves detailed product information (images, prices, store links, etc.) from the database and executes a database query.

[0481] Output: Product details

[0482] Specific operation:

[0483] The server returns the acquired data in JSON format to the terminal, and the terminal displays the product details page.

[0484] Step 4: Check product availability

[0485] Input: Purchase Request

[0486] process:

[0487] User: Clicks the "Purchase" button on the product details page.

[0488] Device: Sends a purchase request to the server, including the ID of the selected item.

[0489] Server: Calls an external API or database to check product availability and executes an inventory query.

[0490] Output: Stock check result (in stock / out of stock)

[0491] Specific operation:

[0492] If the item is in stock, the server generates a link to the purchase page and sends it to the user's device. If the item is out of stock, the server notifies the user that the item is out of stock.

[0493] Step 5: Suggest similar products

[0494] Input: Out-of-stock notification

[0495] process:

[0496] Server: If a product is out of stock, the AI ​​engine is used to search for similar products in the database. The AI ​​engine calculates the features of similar products and lists the most similar products.

[0497] Server: Returns a list of similar products found to the device.

[0498] Output: A list of similar products

[0499] Specific operation:

[0500] The server returns the acquired data in JSON format to the terminal, which then displays a list of similar products.

[0501] Step 6: Adjust content based on user sentiment

[0502] Input: Emotion data (facial expressions, voice, text input)

[0503] process:

[0504] Device: Uses a camera and microphone to capture the user's facial expressions, voice, and text.

[0505] On the device: Analyzes emotion data using an emotion engine (e.g., EmotionAPI) to recognize the user's emotional state.

[0506] Server: Based on the recognized emotion information, the server adjusts the display content of the means for acquiring data on the favorite member and the means for suggesting similar products. For example, if the user is happy, the server increases the number of related product recommendations, and if the user is depressed, the server displays products and promotional content that will lift the user's spirits.

[0507] Output: Adjusted content

[0508] Specific operation:

[0509] The adjusted content is sent back to the device in JSON format and displayed on the device. Specifically, if the user is happy, more products related to the favorite idol will be displayed, and if the user is depressed, cheering messages and items to lift their spirits will be displayed.

[0510] (Application example 2)

[0511] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0512] Current mail-order sales systems are insufficient in supporting users to identify and easily purchase products used by their favorite idols. They also lack mechanisms for product recommendations and promotions based on users' emotions. Therefore, the challenge is to efficiently provide appropriate products that correspond to users' interests and emotions and increase their purchasing motivation.

[0513] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0514] In this invention, the server includes a user authentication means, a means for acquiring data on the favorite member, a means for displaying detailed information on products used by the favorite member, a means for checking product stock status, a means for suggesting similar products, an emotion analysis means for analyzing the user's facial expressions and voice to recognize their emotions, and an emotion-responsive display means for adjusting the display content based on the recognized emotions. This not only allows users to easily identify and purchase products used by their favorite member, but also provides products and promotions that correspond to their emotions, enabling a more fulfilling shopping experience.

[0515] "User authentication means" is a function for verifying the identity of a user when accessing the system.

[0516] "Means for obtaining data on a favorite member" refers to a function for obtaining profile information and related product information of a specific person (favorite member) from a database.

[0517] "Means for displaying detailed information about products used by the favorite member" is a function for presenting detailed information (images, prices, retailer information, etc.) about products used by the favorite member to the user.

[0518] "Means for checking product inventory status" refers to a function for checking the inventory status of a specific product via an external API or database.

[0519] The "means for suggesting similar products" is a function for recommending other related products when there is a shortage of stock or based on the user's interests.

[0520] The "emotion analysis means for recognizing emotions by analyzing the user's facial expressions and voice" is an analysis function for detecting the user's emotional state based on the user's facial image and voice data.

[0521] The "emotion-responsive display means for adjusting display content based on recognized emotions" is a function for dynamically changing displayed products and promotional content in consideration of the results of emotion analysis.

[0522] The present invention combines an emotion engine with a system that allows users to identify and easily purchase products used by their favorite idols, providing specific product recommendations and promotions based on the user's emotions. This system includes a user authentication means, a means for acquiring data on the favorite idol, a means for displaying detailed information about products used by the favorite idol, a means for checking product inventory, a means for suggesting similar products, an emotion analysis means for analyzing the user's facial expressions and voice to recognize emotions, and an emotion-responsive display means for adjusting the display content based on the recognized emotions. Specific embodiments of this system are described below.

[0523] First, an application is installed on the user's device. This application has a login screen for user authentication, an interface for acquiring data on the favorite member, a page for displaying detailed product information, a function for checking stock availability, a function for suggesting similar products, and a camera and voice analysis function for analyzing the user's emotions.

[0524] The server has the following main functions. The user authentication means is a function that collates the authentication information entered by the user with the database and returns the authentication result. The means of obtaining data on the favorite member is a function that obtains the favorite member's profile information and related product list from the database. The means of displaying detailed product information is a function that obtains detailed information on the relevant product from the database and sends it to the user's device. The means of checking product stock status is a function that checks the product stock status using an external API or database. The means of suggesting similar products is a function that uses an AI engine to search for similar products from the database if they are out of stock and sends them to the user's device.

[0525] Furthermore, the emotion analysis means for analyzing the user's emotions uses the camera function and the voice analysis function to analyze the user's facial expressions and voice and recognize the emotions. The emotion-responsive display means for adjusting the display content based on the recognized emotions adjusts the display content of the favorite member data acquisition means and the similar product suggestion means based on the results of the emotion analysis.

[0526] In a specific example, the user's facial expression is analyzed using the camera on their smartphone. For example, if the user is happy, related products are increased, and if the user is depressed, promotional content that will lift their spirits is displayed. This analysis uses technologies such as OpenCV face detection and Keras emotion analysis models.

[0527] Examples of prompt sentences include the following:

[0528] Develop a mail-order application that captures the user's facial expressions with a camera, analyzes their emotions in real time, and displays products and promotional information based on their emotional state. The technologies used will be face detection using OpenCV and emotion analysis using Keras. Also, include a function to obtain images of the user's facial expressions using an API request.

[0529] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0530] Step 1:

[0531] A user opens the application, enters their email address and password on the login screen, and presses the "Login" button. The device sends the entered authentication information to the server. The server compares the received authentication information with the user data in the database and returns the authentication result. If the authentication is successful, the device redirects to the home screen. In this step, the input is the user's authentication information (email address and password), and the output is the display of the home screen or an authentication failure message.

[0532] Step 2:

[0533] The user clicks on the icon of their favorite member on the home screen. The device sends a request to the server to obtain the profile information of the selected favorite member. The server retrieves the favorite member's profile information and related product list from the database and returns them to the device. The device displays the favorite member's profile page based on the retrieved information. In this step, the input is the selection of the favorite member, and the output is the display of the favorite member's profile information and related product list.

[0534] Step 3:

[0535] The user clicks on a product displayed in the "Recently Purchased Products" section on the profile page. The device sends a request to the server to obtain detailed information about the product. The server retrieves detailed information about the product (image, price, link to retail store, etc.) from the database and sends it back to the device. The device displays the product detail page based on the retrieved detailed information. In this step, the input is the product selection, and the output is the display of detailed product information.

[0536] Step 4:

[0537] The user presses the "Purchase" button on the product details page. The terminal sends a purchase request to the server. The server calls an external API or database to check the product's stock status. If the product is in stock, the server generates a link to the purchase page and sends it to the terminal. If the product is out of stock, the server notifies the terminal that the product is out of stock and proceeds to the next step. Based on the stock check results, the terminal displays the purchase page if the product is in stock, or displays "Out of stock" if it is out of stock, and starts the similar product suggestion process. In this step, the input is the purchase request, and the output is the stock information check result and its display.

[0538] Step 5:

[0539] If the product is out of stock, the server uses an AI engine to search for similar products in the database. The server returns a list of similar products found to the terminal. The terminal displays the list of similar products. The user can select from the suggested products and proceed with the purchase. In this step, the input is an out-of-stock notification, and the output is a list of similar products and their display.

[0540] Step 6:

[0541] The device analyzes the user's facial expressions, voice, and text input, and recognizes the user's emotions using an emotion engine. The server adjusts the display content of the means for acquiring data on favorite members and the means for suggesting similar products based on the recognized emotion information. For example, if the user is happy, it increases the number of related product recommendations, and if the user is depressed, it displays products or promotional content that will lift their spirits. In this step, the input is the user's emotion data, and the output is the display of adjusted content.

[0542] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0543] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0544] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0545] [Second embodiment]

[0546] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0547] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0548] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0549] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0550] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0551] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0552] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0553] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0554] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0555] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0556] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0557] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0558] The present invention provides a system that allows users to identify and easily purchase products used by their favorite idols. The overall processing flow of the system and specific embodiments are described below.

[0559] Overall system configuration

[0560] This system consists of a user terminal, a server, a database, an external API, and an AI engine. The main steps are user authentication, obtaining information about the favorite member, displaying detailed product information, checking inventory, and suggesting similar products.

[0561] User Authentication

[0562] User: When you open the app, the login screen appears. Enter your email address and password and press the "Login" button.

[0563] Terminal: Sends the entered authentication information to the server.

[0564] Server: Compares the received authentication information with the user data in the database and returns the authentication result. If authentication is successful, redirects the user to the home screen.

[0565] Obtaining information about your favorite member

[0566] User: Click on the icon of your favorite member on the home screen.

[0567] Device: Sends a request to the server to retrieve the profile information of the selected Oshimen.

[0568] Server: Retrieves the profile information of the favorite member and a list of related products from the database and returns them to the device.

[0569] Device: Based on the information obtained, the profile page of your favorite member will be displayed.

[0570] Display detailed product information

[0571] User: On their profile page, they click on a product listed in the "Recently Purchased" section.

[0572] Terminal: Sends a request to the server to request detailed information about the product.

[0573] Server: Retrieves detailed information about the product (image, price, link to store, etc.) from the database and sends it back to the device.

[0574] Device: Display the product details page based on the obtained product details.

[0575] Check product availability

[0576] User: Clicks the "Purchase" button on the product details page.

[0577] Device: Sends a purchase request to the server.

[0578] Server: Calls an external API or database to check product availability.

[0579] In stock: A link to the purchase page is generated and sent to the user's device.

[0580] Out of Stock: Notify me that the product is out of stock and proceed to the next step.

[0581] Terminal: Based on the results of the inventory check, if the item is in stock, the purchase page will be displayed; if not, it will display "Out of stock" and start the similar product suggestion process.

[0582] Similar product suggestions

[0583] Server: If a product is out of stock, use the AI ​​engine to search for similar products from the database.

[0584] Server: Returns a list of similar products found to the device.

[0585] Terminal: Displays a list of similar products and allows the user to choose from the suggested products.

[0586] Specific examples

[0587] 1. The user opens the app and logs in by entering the email address "example@example.com" and the password "password123".

[0588] 2. The server receives this and checks it against the database, and if authentication is successful, displays the home screen.

[0589] 3. The user clicks on the icon of their favorite idol, "Idol A," on the home screen to view their profile information.

[0590] 4. The server retrieves "Idol A's" profile and a list of recently purchased items from the database and sends them back to the terminal.

[0591] 5. The user clicks on "Lipstick" to view more information.

[0592] 6. The server retrieves detailed information about the product from the database and returns it to the terminal.

[0593] 7. When the user presses the "Buy" button, the server checks stock availability.

[0594] 8. If the item is in stock, the purchase page will be displayed. If it is out of stock, the AI ​​engine will search for similar products and display them on the device.

[0595] In this way, this system is designed to help users identify products used by their favorite idols and make purchases smoothly. It can also increase user satisfaction by suggesting similar products even if the product is out of stock.

[0596] The processing flow will be explained below.

[0597] Step 1:

[0598] User: Opens the app, displays the login screen, enters email address and password, and presses the "Login" button.

[0599] Step 2:

[0600] Terminal: Sends the entered authentication information (email address and password) to the server in JSON format.

[0601] Step 3:

[0602] Server: Checks the received authentication information against the user information in the database.

[0603] If successful: Returns a successful authentication response and starts a login session.

[0604] On failure: Return an error message.

[0605] Step 4:

[0606] Terminal: Receives the authentication result from the server, and if login is successful, redirects to the home screen, otherwise displays an error message.

[0607] Step 5:

[0608] User: Click on your favorite member's icon on the home screen.

[0609] Step 6:

[0610] Device: Sends a request to the server to get data on the selected Oshimen.

[0611] Step 7:

[0612] Server: Retrieves the profile information of the favorite member and a list of related products from the database and returns them to the device.

[0613] Step 8:

[0614] Device: Displays your favorite member's profile information and a list of related products on the screen.

[0615] Step 9:

[0616] User: On their profile page, they click on a product listed under "Recently Purchased Items."

[0617] Step 10:

[0618] Terminal: Sends a request to the server to obtain detailed information about the product.

[0619] Step 11:

[0620] Server: Retrieves detailed information about the product (image, price, link to store, etc.) from the database and sends it back to the device.

[0621] Step 12:

[0622] Terminal: Display detailed product information on the screen.

[0623] Step 13:

[0624] User: Clicks the "Purchase" button on the product details page.

[0625] Step 14:

[0626] Device: Sends a purchase request to the server.

[0627] Step 15:

[0628] Server: Calls an external API or database to check product availability.

[0629] If in stock: Generate a link to the purchase page and send it to your device.

[0630] If out of stock: Notify the customer that the product is out of stock and proceed to the next step.

[0631] Step 16:

[0632] Terminal: Receives the stock check result and displays the purchase page if the item is in stock, or displays "Out of stock" if the item is out of stock and starts the similar product suggestion process.

[0633] Step 17:

[0634] Server: Uses an AI engine to search the database for similar products to the missing item.

[0635] Step 18:

[0636] Server: Returns a list of similar products found to the device.

[0637] Step 19:

[0638] Device: A list of similar products is displayed on the screen, allowing the user to select from the suggested products and proceed with the purchase.

[0639] Example 1

[0640] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0641] Previously, the process for users to identify and purchase products used by their favorite members (supported members) was complicated, and there were issues with checking stock availability and suggesting similar products not working smoothly. Also, when the stock status of a product was unknown, similar alternative products were not suggested appropriately, which led to a decrease in user satisfaction.

[0642] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0643] In this invention, the server includes a user authentication means, a means for acquiring data on the favorite target, a means for displaying detailed information on products used by the favorite target, a means for checking product inventory, a means for suggesting similar products, and a means for searching for similar products from a database using an AI engine. This allows users to easily identify products used by their favorite member (favorite target) and purchase them after checking inventory. Even if a product is out of stock, the AI ​​engine is used to quickly suggest suitable similar products, improving user satisfaction.

[0644] "User authentication means" is a mechanism for allowing a user to access a system by inputting appropriate authentication information.

[0645] "Means for obtaining data on supported objects" refers to the function that enables the system to extract and obtain information on specific supported objects (e.g., idols, characters, etc.) from the database.

[0646] "Means for displaying detailed information about products used by the target of support" is a function for providing users with specific information about the products used by the target of support (such as name, image, price, and link to the store where the product is sold).

[0647] "Means for checking product availability" refers to the mechanism by which the system checks, via an external API or database, whether a particular product is currently available.

[0648] The "means for suggesting similar products" is a function for presenting similar products that are alternative candidates to the user when a product is out of stock, for example.

[0649] "Means for searching for similar products from a database using an AI engine" refers to a mechanism that uses an artificial intelligence engine to analyze information in a database and automatically identify and extract products similar to a specified product.

[0650] This invention relates to a method for providing a system that identifies products used by a favorite member (supported person) and allows users to easily purchase them. This system smoothly performs user authentication, obtains information about the supported person, displays detailed product information, checks inventory, and even suggests similar products if the item is out of stock.

[0651] Overall system configuration

[0652] This system consists of a user terminal, a server, a database, an external API, and an AI engine. The main steps are user authentication, acquisition of support information, display of detailed product information, inventory confirmation, and suggestion of similar products.

[0653] User Authentication

[0654] When a user launches the app, a login screen appears. The user enters the email address "example@example.com" and the password "password123" and presses the "Login" button.

[0655] The device sends the entered authentication information to the server by using an HTTP POST request to send the data to the server's authentication endpoint.

[0656] The server checks the received authentication information against the user data in its database, searches for the email address and password pair using a database query, and verifies whether they match. The authentication is successful or not based on the result of the check.

[0657] If authentication is successful, the server generates a redirect URL for the home screen along with an authentication success message and returns it to the device. If authentication fails, it returns an error message.

[0658] Acquisition of support information

[0659] The user clicks on the icon of a specific object of support (e.g., idol A) on the home screen.

[0660] The device obtains the ID of the selected target and sends a request for profile information to the server, specifically using an HTTP GET request.

[0661] The server retrieves profile information and related product lists from the database and uses database queries to extract the required information.

[0662] The server returns the acquired profile information and product list to the terminal.

[0663] Based on the received data, the device displays the profile page of the person being supported, along with a list of products.

[0664] Display detailed product information

[0665] A user clicks on a specific product (e.g., "lipstick") in the "Recently Purchased Items" section of their profile page.

[0666] The device obtains the ID of the product the user clicked on and sends a request for more information to the server, specifically using an HTTP GET request.

[0667] The server retrieves detailed information about the product (image, price, store link, etc.) from the database and extracts the required information using a database query.

[0668] The server returns the obtained detailed information to the terminal.

[0669] The terminal displays the product details page based on the received product details information.

[0670] Check product availability

[0671] The user presses the "Purchase" button on the product details page.

[0672] The device sends a purchase request to the server, specifically using an HTTP POST request.

[0673] The server calls an external API or database to check the product availability. For example, it calls an external API to get real-time inventory information.

[0674] server:

[0675] If the item is in stock, a link to the purchase page is generated and sent to the user's terminal.

[0676] If the item is out of stock, the system will notify you and proceed to search for similar items using an AI engine.

[0677] Based on the results of the inventory check, the terminal displays the purchase page if the item is in stock, and if not, displays "Out of stock" and starts the process of suggesting similar products.

[0678] Similar product suggestions

[0679] If a product is out of stock, the server uses an AI engine (e.g., a generative AI model) to search for similar products in the database. As a concrete example, the following prompt is input to the AI ​​engine:

[0680] Prompt: "Search our database for similar products for the product name 'Lipstick'."

[0681] The server returns a list of similar products found to the terminal.

[0682] The terminal displays the received list of similar products and allows the user to select from the suggested products.

[0683] The system is designed to help users identify and purchase the products they support through a step-by-step process, and even if an item is out of stock, it utilizes an AI engine to quickly suggest suitable similar products, increasing user satisfaction.

[0684] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0685] Step 1:

[0686] The user launches the app, enters the email address "example@example.com" and password "password123" on the login screen, and presses the "Login" button.

[0687] Input: Email address, password

[0688] Output: Authentication request

[0689] The terminal sends the entered authentication information to the server using an HTTP POST request.

[0690] Input: Authentication Request

[0691] Output: HTTP POST request to the server

[0692] The server checks the received credentials against the user data in its database, which involves running a database query to verify that the email address and password match.

[0693] Input: Credentials

[0694] Output: Matching result (authentication success or failure)

[0695] If the authentication is successful, the server generates a redirect URL for the home screen along with an authentication success message and returns it to the device. If the authentication is unsuccessful, it returns an error message.

[0696] Input: Matching result

[0697] Output: Authentication result (success or error)

[0698] The device receives the returned authentication result, and if the authentication is successful, it transitions to the home screen, and if it is unsuccessful, it displays an error message.

[0699] Input: Authentication result

[0700] Output: Home screen or error message

[0701] Step 2:

[0702] The user clicks on the icon of the object of their support (e.g., idol A) on the home screen.

[0703] Input: Icon click event

[0704] Output: Supported ID

[0705] The terminal sends the ID of the selected target to the server using an HTTP GET request.

[0706] Input: ID of the target

[0707] Output: HTTP GET request to the server

[0708] The server retrieves the profile information and associated product listings of the supported subjects from the database, which involves executing a database query to extract the profile information and product listings.

[0709] Input: ID of the target

[0710] Output: Profile information and related product list

[0711] The server returns the acquired profile information and a list of related products to the terminal.

[0712] Input: Profile information and related product list

[0713] Output: Data returned to the terminal

[0714] The terminal displays the profile page of the target of support and a list of related products based on the received data.

[0715] Input:Return data

[0716] Output: Profile page and product list

[0717] Step 3:

[0718] A user clicks on a specific product (e.g., "lipstick") in the "Recently Purchased Items" section on their profile page.

[0719] Input: Product click event

[0720] Output: Product ID

[0721] The terminal sends the ID of the product clicked by the user to the server using an HTTP GET request.

[0722] Input: Product ID

[0723] Output: HTTP GET request to the server

[0724] The server retrieves detailed information about the product (images, prices, store links, etc.) from the database. This involves executing a database query to extract the required data.

[0725] Input: Product ID

[0726] Output: Detailed information (images, prices, retailer links)

[0727] The server returns the acquired detailed information to the terminal.

[0728] Input:Detailed information

[0729] Output: Data returned to the terminal

[0730] The terminal displays a product detail page based on the received product detail information.

[0731] Input:Return data

[0732] Output: Product detail page display

[0733] Step 4:

[0734] The user presses the "Purchase" button on the product details page.

[0735] Input: Buy button click event

[0736] Output: Purchase request

[0737] The terminal sends a purchase request to the server using an HTTP POST request.

[0738] Input: Purchase Request

[0739] Output: HTTP POST request to the server

[0740] The server calls an external API or database to check product availability, for example, by sending an API request to get real-time inventory information.

[0741] Input: Purchase Request

[0742] Output: Inventory status data

[0743] If the product is in stock, the server generates a link to the purchase page and sends it to the user's device. If the product is out of stock, the server notifies the user that the product is out of stock and proceeds to the process of searching for similar products using an AI engine.

[0744] Input: Inventory status data

[0745] Output: Purchase link or out-of-stock notification

[0746] Based on the results of the inventory check, the terminal displays a purchase page if the item is in stock, and if not, displays "Out of stock" and starts the similar product suggestion process.

[0747] Input: Inventory check result

[0748] Output: Display of purchase page or out-of-stock notification

[0749] Step 5:

[0750] If a product is out of stock, the server uses an AI engine (e.g., a generative AI model) to search for similar products in the database. As a concrete example, the following prompt sentence is input to the AI ​​engine:

[0751] "\nPlease search our database for similar products with the product name 'Lipstick'."

[0752] Input: prompt statement

[0753] Output: Similar products list

[0754] The server returns a list of similar products found to the terminal.

[0755] Input: Similar products list

[0756] Output: Data returned to the terminal

[0757] The terminal displays the received list of similar products and allows the user to select from the suggested products.

[0758] Input:Return data

[0759] Output: Display similar products list

[0760] (Application example 1)

[0761] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0762] Today's users have a need to easily identify and purchase products used by their favorite idols. However, it is difficult to easily find detailed product information and stock status of their favorite idols, and to instantly find similar products. There is a need for a system that can solve these problems and allow users to enjoy shopping more comfortably.

[0763] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0764] In this invention, the server includes a user authentication means, a means for acquiring data on the favorite member, a means for displaying detailed information on products used by the favorite member, a means for checking product inventory, a means for suggesting similar products, a means for suggesting similar products using a generative AI model, and a means for generating prompt text and inputting it into the generative AI model. This allows users to identify products used by their favorite member and smoothly check inventory and purchase them. Furthermore, users can receive suggestions for similar products even if the product is out of stock, which increases user satisfaction.

[0765] "User authentication means" refers to a means for verifying that a user is a valid user when accessing a system.

[0766] The "means for obtaining data on the favorite member" is a means for obtaining profile information and a list of related products related to the favorite member from the database.

[0767] The "means for displaying detailed information about products used by a favorite member" is a means for displaying to a user detailed information about products used by a favorite member selected by the user.

[0768] A "means for checking product availability" is a means for checking whether a particular product is in stock using an external API or database.

[0769] The "means for suggesting similar products" is a means for suggesting other similar products to the user when there is insufficient stock.

[0770] "Means for suggesting similar products using a generative AI model" refers to means for using an artificial intelligence model to search for similar products to a specific product and suggest them to users.

[0771] "Means for generating prompt sentences and inputting them to a generative AI model" refers to means for generating prompt sentences containing appropriate questions or commands for a generative AI model and inputting them.

[0772] The present invention is a system that identifies products used by a favorite member and suggests similar products based on them. This system includes a user authentication means, a means for acquiring data on the favorite member, a means for displaying detailed information about the products used by the favorite member, a means for checking product stock status, a means for suggesting similar products, a means for suggesting similar products using a generative AI model, and a means for generating prompt sentences and inputting them into the generative AI model.

[0773] Overall system configuration

[0774] This system consists of a user terminal, a server, a database, an external API, and a generative AI model. The main steps are user authentication, obtaining information about the favorite member, displaying detailed product information, checking inventory, and suggesting similar products.

[0775] Hardware and software used

[0776] Frontend: Use React Native to create an application compatible with smartphones (iOS / Android).

[0777] Backend: Uses Node.js and Express.js as the server.

[0778] Database: Uses MySQL for data storage.

[0779] External API: Use the product inventory confirmation API.

[0780] Generative AI model: Uses TensorFlow to suggest similar products.

[0781] Details of each method and processing flow

[0782] 1. User authentication method:

[0783] The user opens the app and enters their email address and password on the login screen.

[0784] The information entered is sent to the server and checked against user data in a MySQL database.

[0785] If authentication is successful, you will be redirected to the home screen.

[0786] 2. How to get your favorite member's data:

[0787] When a user clicks on the icon of their favorite member on the home screen, the profile information of the favorite member and a list of related products are sent back to the device from the database via the server.

[0788] 3. How to view detailed information about products used by your favorite idol:

[0789] When a user selects a product on the profile page of their favorite member, detailed information about that product is requested from the server, retrieved from the database, and displayed.

[0790] 4. How to check product availability:

[0791] When the user presses the "Buy" button, stock availability is checked using an external API or database.

[0792] 5. Suggesting similar products:

[0793] If an item is out of stock, a generative AI model (TensorFlow) is used to suggest similar items.

[0794] The server generates prompt sentences based on information such as category, brand, and price range, and inputs them into the generative AI model.

[0795] Specific examples

[0796] For example, if a user selects a "lipstick" that "Favorite Member A" recently purchased and it's out of stock, the generative AI model will generate the following prompt:

[0797] Prompt: The lipstick that Oshime A recently purchased is out of stock. Please suggest five lipsticks from the same brand with similar features.

[0798] This prompt sentence is input into a generative AI model, and the results are sent back to the user's device to recommend similar products.

[0799] This system allows users to identify products used by their favorite idols, check stock availability, and purchase them smoothly. Furthermore, if an item is out of stock, users can receive suggestions for similar products, increasing user satisfaction.

[0800] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0801] Step 1:

[0802] The user opens the application and enters their email address and password on the login screen. This user input is sent to the server. The server verifies the user information in the MySQL database, and if authentication is successful, redirects them to the home screen. The input is the user's authentication information, and the output is the authentication result. Data processing and calculations involve verification of the user authentication information.

[0803] Step 2:

[0804] When a user clicks on an icon of their favorite member on the home screen, the selected information is sent as a request to the server. The server retrieves the member's profile information and a list of related products from the MySQL database and sends this back to the device. The input is the selected member's information, and the output is detailed data about the member. Data processing and calculation involves retrieving information from the database.

[0805] Step 3:

[0806] When a user clicks on a recently purchased item on the profile page of their favorite idol, a request is sent to the server for detailed information about that item. The server retrieves detailed information about the item (image, price, link to retail store, etc.) from the database and sends it back to the terminal. The input is the product selection information, and the output is detailed product information. Data processing and calculation involves retrieving detailed product information from the database.

[0807] Step 4:

[0808] When a user presses the "Purchase" button on a product detail page, the purchase request is sent to the server. The server calls an external API or database to check the product's stock status. The input is the purchase request and the output is the stock status. If the product is in stock, a link to the purchase page is generated and sent to the terminal. Data processing and calculations involve checking stock and generating the link.

[0809] Step 5:

[0810] If the item is out of stock, the server will use a generative AI model to begin the process of suggesting similar items. The server generates a prompt sentence and inputs this into the generative AI model. The input is the prompt sentence, and the output is a list of similar items. Data processing and calculations involve generating the prompt sentence and using the AI ​​model to search for similar items.

[0811] Step 6:

[0812] The server returns a list of similar products obtained from the generative AI model to the terminal. The terminal displays it, and the user can select from the suggested products. The input is a list of similar products, and the output is product information displayed to the user. Data processing and calculation involves displaying the output of the AI ​​model on the user's terminal.

[0813] As an example of a specific prompt sentence, we could generate the sentence, "The lipstick recently purchased by my favorite idol A is out of stock. Please suggest five lipsticks from the same brand with similar features." By inputting this into the generative AI model, it will search for and suggest similar products.

[0814] In this way, the specific actions and processing flow performed by the user, terminal, and server at each step are clearly defined. At each processing step, data processing and calculations are performed based on the input, and appropriate output is generated, realizing a system that allows users to easily identify and purchase products used by their favorite member.

[0815] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0816] The present invention combines an emotion engine with a system that identifies products used by favorite idols and allows users to easily purchase them, thereby providing specific product recommendations and promotions based on the user's emotions. The overall processing flow of the system and specific embodiments are described below.

[0817] Overall system configuration

[0818] This system consists of a user terminal, a server, a database, an external API, an AI engine, and an emotion engine. The main steps are user authentication, obtaining information about the favorite member, displaying detailed product information, checking inventory, suggesting similar products, and adjusting content based on user emotions.

[0819] User Authentication

[0820] User: When you open the app, the login screen appears. Enter your email address and password and press the "Login" button.

[0821] Terminal: Sends the entered authentication information to the server.

[0822] Server: Compares the received authentication information with the user data in the database and returns the authentication result. If authentication is successful, redirects the user to the home screen.

[0823] Obtaining information about your favorite member

[0824] User: Click on the icon of your favorite member on the home screen.

[0825] Device: Sends a request to the server to retrieve the profile information of the selected Oshimen.

[0826] Server: Retrieves the profile information of the favorite member and a list of related products from the database and returns them to the device.

[0827] Device: Based on the information obtained, the profile page of your favorite member will be displayed.

[0828] Display detailed product information

[0829] User: On their profile page, they click on a product listed in the "Recently Purchased" section.

[0830] Terminal: Sends a request to the server to obtain detailed information about the product.

[0831] Server: Retrieves detailed information about the product (image, price, link to store, etc.) from the database and sends it back to the device.

[0832] Device: Display the product details page based on the obtained product details.

[0833] Check product availability

[0834] User: Clicks the "Purchase" button on the product details page.

[0835] Device: Sends a purchase request to the server.

[0836] Server: Calls an external API or database to check product availability.

[0837] If in stock: Generate a link to the purchase page and send it to the user's device.

[0838] If out of stock: Notify the customer that the product is out of stock and proceed to the next step.

[0839] Device: Based on the results of the inventory check, if the item is in stock, the purchase page will be displayed; if it is out of stock, the message "Out of stock" will be displayed and the similar product suggestion process will be initiated.

[0840] Similar product suggestions

[0841] Server: If a product is out of stock, use the AI ​​engine to search for similar products from the database.

[0842] Server: Returns a list of similar products found to the device.

[0843] On your device: Displays a list of similar products, allowing the user to select from the suggested products and proceed with the purchase.

[0844] Content adjustment based on user sentiment

[0845] Terminal: Analyzes the user's facial expressions, voice, and text input, and recognizes the user's emotions using an emotion engine.

[0846] Server: Based on the recognized emotional information, adjust the display content of the means for acquiring data on the favorite member and the means for suggesting similar products.

[0847] For example, if the user is happy, the number of related product recommendations will be increased, and if the user is depressed, products and promotional content that will lift the user's spirits will be displayed.

[0848] Device: Display the adapted content to the user.

[0849] Specific examples

[0850] 1. The user opens the app and logs in by entering the email address "example@example.com" and the password "password123".

[0851] 2. The server receives this and checks it against the database, and if authentication is successful, displays the home screen.

[0852] 3. The user clicks on the icon of their favorite idol, "Idol A," on the home screen to view their profile information.

[0853] 4. The server retrieves "Idol A's" profile and a list of recently purchased items from the database and sends them back to the terminal.

[0854] 5. The user clicks on "Lipstick" to view more information.

[0855] 6. The server retrieves detailed information about the product from the database and returns it to the terminal.

[0856] 7. When the user presses the "Buy" button, the server checks stock availability.

[0857] 8. If the item is in stock, the purchase page will be displayed. If it is out of stock, the AI ​​engine will search for similar products and display them on the device.

[0858] 9. The device captures the user's facial expressions with a camera, and the emotion engine analyzes the user's emotions.

[0859] 10. Based on the analyzed emotions, the server selects appropriate products and promotions and displays them on the device.

[0860] For example, if the user is happy, the number of products related to "Idol A" will be increased, and if the user is depressed, promotional products that will lift the user's spirits will be displayed.

[0861] In this way, this system is designed to identify products used by users' favorite idols and facilitate smooth purchases. Furthermore, by utilizing an emotion engine, it can suggest individual content according to the user's emotional state, further increasing user satisfaction.

[0862] The processing flow will be explained below.

[0863] Step 1:

[0864] User: Opens the app, displays the login screen, enters email address and password, and presses the "Login" button.

[0865] Step 2:

[0866] Terminal: Sends the entered authentication information (email address and password) to the server in JSON format.

[0867] Step 3:

[0868] Server: Checks the received authentication information against the user information in the database. If successful, returns a response indicating successful authentication and starts a login session. If unsuccessful, returns an error message.

[0869] Step 4:

[0870] Terminal: Receives the authentication result from the server, and if login is successful, redirects to the home screen, otherwise displays an error message.

[0871] Step 5:

[0872] User: Click on your favorite member's icon on the home screen.

[0873] Step 6:

[0874] Device: Sends a request to the server to get data on the selected Oshimen.

[0875] Step 7:

[0876] Server: Retrieves the profile information of the favorite member and a list of related products from the database and returns them to the device.

[0877] Step 8:

[0878] Device: Displays your favorite member's profile information and a list of related products on the screen.

[0879] Step 9:

[0880] User: On their profile page, they click on a product listed under "Recently Purchased Items."

[0881] Step 10:

[0882] Terminal: Sends a request to the server to obtain detailed information about the product.

[0883] Step 11:

[0884] Server: Retrieves detailed information about the product (image, price, link to store, etc.) from the database and sends it back to the device.

[0885] Step 12:

[0886] Terminal: Display detailed product information on the screen.

[0887] Step 13:

[0888] User: Clicks the "Purchase" button on the product details page.

[0889] Step 14:

[0890] Device: Sends a purchase request to the server.

[0891] Step 15:

[0892] Server: Calls an external API or database to check product availability.

[0893] If the item is in stock, a link to the purchase page is generated and sent to the device.

[0894] If the item is out of stock, the system notifies the user that the item is out of stock and proceeds to the next step.

[0895] Step 16:

[0896] Terminal: Receives the stock check result and displays the purchase page if the item is in stock, or displays "Out of stock" if the item is out of stock and starts the similar product suggestion process.

[0897] Step 17:

[0898] Server: Uses an AI engine to search the database for similar products to the missing item.

[0899] Step 18:

[0900] Server: Returns a list of similar products found to the device.

[0901] Step 19:

[0902] On your device: Displays a list of similar products, allowing the user to select from the suggested products and proceed with the purchase.

[0903] Step 20:

[0904] User: Selects a product from the list of similar products and clicks the purchase button.

[0905] Step 21:

[0906] Terminal: Sends a similar product purchase request to the server.

[0907] Step 22:

[0908] Server: Checks the stock status and availability of similar products and returns the results to the terminal.

[0909] Step 23:

[0910] Device: Display a purchase completion screen to the user.

[0911] Step 24:

[0912] Terminal: Analyzes the user's facial expressions, voice, and text input, and recognizes the user's emotions using an emotion engine.

[0913] Step 25:

[0914] Server: Based on the recognized emotional information, adjust the display content of the means for acquiring data on the favorite member and the means for suggesting similar products.

[0915] For example, if the user is happy, the number of related product recommendations will be increased, and if the user is depressed, products and promotional content that will lift the user's spirits will be displayed.

[0916] Step 26:

[0917] Device: Display the adapted content to the user.

[0918] Specific examples

[0919] 1. The user opens the app and logs in by entering the email address "example@example.com" and the password "password123".

[0920] 2. The server receives this and checks it against the database, and if authentication is successful, displays the home screen.

[0921] 3. The user clicks on the icon of their favorite idol, "Idol A," on the home screen to view their profile information.

[0922] 4. The server retrieves "Idol A's" profile and a list of recently purchased items from the database and sends them back to the terminal.

[0923] 5. The user clicks on "Lipstick" to view more information.

[0924] 6. The server retrieves detailed information about the product from the database and returns it to the terminal.

[0925] 7. When the user presses the "Buy" button, the server checks stock availability.

[0926] 8. If the item is in stock, the purchase page will be displayed. If it is out of stock, the AI ​​engine will search for similar products and display them on the device.

[0927] 9. The device captures the user's facial expressions with a camera, and the emotion engine analyzes the user's emotions.

[0928] 10. Based on the analyzed emotions, the server selects appropriate products and promotions and displays them on the device.

[0929] For example, if the user is happy, the number of products related to "Idol A" will be increased, and if the user is depressed, promotional products that will lift the user's spirits will be displayed.

[0930] Example 2

[0931] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0932] In today's world, users want to easily identify and purchase products used by their favorite idols. However, conventional systems make the product identification and purchase process cumbersome and time-consuming for users. Furthermore, product recommendations and promotions are not tailored to the user's emotions, making it difficult to improve personalized satisfaction.

[0933] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a user authentication means, a means for acquiring data on the favorite member, a means for displaying detailed information on products used by the favorite member, a means for checking product inventory, a means for suggesting similar products, a means for acquiring and analyzing emotion data, and a means for adjusting content based on the user's emotion. This allows the user to smoothly identify and purchase products used by the favorite member, and also provides individual content according to the user's emotional state, thereby improving satisfaction.

[0934] "User authentication means" refers to a means for processing and authenticating authentication information such as an email address and password used when a user accesses the system.

[0935] "Means for obtaining data on a favorite member" refers to means for obtaining profile information and related product information of a target person (favorite member) from the database within the system.

[0936] The "means for displaying detailed information about the product used by the favorite member" is a means for displaying detailed information such as an image, price, and link to a store selling the product selected by the user.

[0937] "Means for checking product availability" refers to means for checking the availability of selected products using an external API or database.

[0938] "Means for suggesting similar products" refers to a means for using an AI engine to search for similar products from a database and suggest them to users when an item is out of stock.

[0939] The "means for acquiring and analyzing emotional data" refers to a means for recognizing the emotional state of a user by analyzing the user's facial expressions, voice, and text input.

[0940] The "means for adjusting content based on user emotion" refers to a means for individually adjusting displayed products and promotional content based on recognized user emotion information.

[0941] The present invention combines an emotion engine with a system that identifies products used by a specific idol and allows users to easily purchase them, thereby providing specific product recommendations and promotions based on the user's emotions. The overall processing flow of the system and specific embodiments are described below.

[0942] This system consists of a user terminal, a server, a database, an external API, an AI engine, and an emotion engine. The main steps are user authentication, obtaining information about the favorite member, displaying detailed product information, checking inventory, suggesting similar products, and adjusting content based on user emotions.

[0943] User Authentication

[0944] User: When the app is opened, the login screen appears, the user enters their email address and password, and presses the "Login" button.

[0945] Terminal: Sends the entered authentication information to the server using the HTTPS protocol.

[0946] Server: Compares the received authentication information with the user data in the database and returns the authentication result. If authentication is successful, redirects the user to the home screen.

[0947] Obtaining information about your favorite member

[0948] User: Click on the icon of your favorite member on the home screen.

[0949] Device: Sends a request to the server to retrieve the profile information of the selected Oshimen.

[0950] Server: Retrieves the profile information of the favorite member and a list of related products from the database and returns them to the device.

[0951] Device: Display your favorite member's profile page based on the information obtained.

[0952] Display detailed product information

[0953] User: On their profile page, they click on a product listed in the "Recently Purchased" section.

[0954] Terminal: Sends a request to the server to obtain detailed information about the product.

[0955] Server: Retrieves detailed information about the product (image, price, link to store, etc.) from the database and sends it back to the device.

[0956] Device: Display the product details page based on the obtained product details.

[0957] Check product availability

[0958] User: Clicks the "Purchase" button on the product details page.

[0959] Device: Sends a purchase request to the server.

[0960] Server: Calls an external API or database to check the product's availability. If the product is in stock, generates a link to the purchase page and sends it to the user's device. If the product is out of stock, notifies the user that the product is out of stock and proceeds to the next step.

[0961] Device: Based on the results of the inventory check, if the item is in stock, the purchase page will be displayed; if it is out of stock, the message "Out of stock" will be displayed and the similar product suggestion process will be initiated.

[0962] Similar product suggestions

[0963] Server: If a product is out of stock, use the AI ​​engine to search for similar products from the database.

[0964] Server: Returns a list of similar products found to the device.

[0965] On your device: Displays a list of similar products, allowing the user to select from the suggested products and proceed with the purchase.

[0966] Content adjustment based on user sentiment

[0967] Terminal: Analyzes the user's facial expressions, voice, and text input, and recognizes the user's emotions using an emotion engine.

[0968] Server: Based on the recognized emotion information, the server adjusts the display content of the means for acquiring data on the favorite member and the means for suggesting similar products. For example, if the user is happy, the server increases the number of related product recommendations, and if the user is depressed, the server displays products and promotional content that will lift the user's spirits.

[0969] Device: Display the adapted content to the user.

[0970] Specific examples

[0971] 1. The user opens the app and logs in by entering the email address "example@example.com" and the password "password123".

[0972] 2. The server receives this and checks it against the database, and if authentication is successful, displays the home screen.

[0973] 3. Users click on their favorite member's icon on the home screen to view their profile information and a list of recently purchased items.

[0974] 4. The server retrieves the profile of the favorite member and detailed information about related products from the database and sends them to the terminal.

[0975] 5. The user clicks on the displayed product to view more information.

[0976] 6. The server retrieves detailed information about the product from the database and returns it to the terminal.

[0977] 7. When the user presses the "Buy" button, the server checks stock availability.

[0978] 8. If the item is in stock, the purchase page will be displayed. If it is out of stock, the AI ​​engine will search for similar products and display them on the device.

[0979] 9. The device captures the user's facial expressions with a camera, and the emotion engine analyzes the user's emotions.

[0980] 10. The server selects appropriate products and promotions based on the analyzed emotions and displays them on the device. For example, if the user is happy, it will increase the number of related products, and if the user is depressed, it will display products that will lift their spirits.

[0981] In this way, this system is designed to identify products used by users' favorite idols and facilitate smooth purchases. Furthermore, by utilizing the emotion engine, it can suggest individual content according to the user's emotional state, further increasing user satisfaction.

[0982] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0983] Step 1: User authentication

[0984] Enter your email address and password

[0985] process:

[0986] User: When you open the app, the login screen will appear. Enter your email address and password and press the "Login" button.

[0987] Terminal: The entered authentication information is sent to the server via the HTTPS protocol.

[0988] Server: Checks the received credentials against the user data in the database using the hashed password.

[0989] Output: Authentication result (success or failure)

[0990] Specific operation:

[0991] If authentication is successful, the server generates a user ID and session information and returns it to the device, redirecting it to the home screen. If authentication fails, an error message is returned to the device, and the login screen is displayed again.

[0992] Step 2: Obtaining information about your favorite member

[0993] Input: Select your favorite member's icon

[0994] process:

[0995] User: Click on the icon of your favorite member on the home screen.

[0996] Device: Send a request to the server containing the ID of the selected member.

[0997] Server: Retrieves the profile information of the favorite member and the related product list from the database. Executes queries to extract relevant data.

[0998] Output: Profile information of your favorite member and related product list

[0999] Specific operation:

[1000] The server returns the acquired data in JSON format to the device, and the device displays the profile page of the favorite member.

[1001] Step 3: Display detailed product information

[1002] Input: Select product

[1003] process:

[1004] User: On their profile page, they click on a product listed in the "Recently Purchased" section.

[1005] Device: Sends a request to the server containing the ID of the selected item.

[1006] Server: Retrieves detailed product information (images, prices, store links, etc.) from the database and executes a database query.

[1007] Output: Product details

[1008] Specific operation:

[1009] The server returns the acquired data in JSON format to the terminal, and the terminal displays the product details page.

[1010] Step 4: Check product availability

[1011] Input: Purchase Request

[1012] process:

[1013] User: Clicks the "Purchase" button on the product details page.

[1014] Device: Sends a purchase request to the server, including the ID of the selected item.

[1015] Server: Calls an external API or database to check product availability and executes an inventory query.

[1016] Output: Stock check result (in stock / out of stock)

[1017] Specific operation:

[1018] If the item is in stock, the server generates a link to the purchase page and sends it to the user's device. If the item is out of stock, the server notifies the user that the item is out of stock.

[1019] Step 5: Suggest similar products

[1020] Input: Out-of-stock notification

[1021] process:

[1022] Server: If a product is out of stock, the AI ​​engine is used to search for similar products in the database. The AI ​​engine calculates the features of similar products and lists the most similar products.

[1023] Server: Returns a list of similar products found to the device.

[1024] Output: A list of similar products

[1025] Specific operation:

[1026] The server returns the acquired data in JSON format to the terminal, which then displays a list of similar products.

[1027] Step 6: Adjust content based on user sentiment

[1028] Input: Emotion data (facial expressions, voice, text input)

[1029] process:

[1030] Device: Uses a camera and microphone to capture the user's facial expressions, voice, and text.

[1031] On the device: Analyzes emotion data using an emotion engine (e.g., EmotionAPI) to recognize the user's emotional state.

[1032] Server: Based on the recognized emotion information, the server adjusts the display content of the means for acquiring data on the favorite member and the means for suggesting similar products. For example, if the user is happy, the server increases the number of related product recommendations, and if the user is depressed, the server displays products and promotional content that will lift the user's spirits.

[1033] Output: Adjusted content

[1034] Specific operation:

[1035] The adjusted content is sent back to the device in JSON format and displayed on the device. Specifically, if the user is happy, more products related to the favorite idol will be displayed, and if the user is depressed, cheering messages and items to lift their spirits will be displayed.

[1036] (Application example 2)

[1037] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1038] Current mail-order sales systems are insufficient in supporting users to identify and easily purchase products used by their favorite idols. They also lack mechanisms for product recommendations and promotions based on users' emotions. Therefore, the challenge is to efficiently provide appropriate products that correspond to users' interests and emotions and increase their purchasing motivation.

[1039] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1040] In this invention, the server includes a user authentication means, a means for acquiring data on the favorite member, a means for displaying detailed information on products used by the favorite member, a means for checking product stock status, a means for suggesting similar products, an emotion analysis means for analyzing the user's facial expressions and voice to recognize their emotions, and an emotion-responsive display means for adjusting the display content based on the recognized emotions. This not only allows users to easily identify and purchase products used by their favorite member, but also provides products and promotions that correspond to their emotions, enabling a more fulfilling shopping experience.

[1041] "User authentication means" is a function for verifying the identity of a user when accessing the system.

[1042] "Means for obtaining data on a favorite member" refers to a function for obtaining profile information and related product information of a specific person (favorite member) from a database.

[1043] "Means for displaying detailed information about products used by the favorite member" is a function for presenting detailed information (images, prices, retailer information, etc.) about products used by the favorite member to the user.

[1044] "Means for checking product inventory status" refers to a function for checking the inventory status of a specific product via an external API or database.

[1045] The "means for suggesting similar products" is a function for recommending other related products when there is a shortage of stock or based on the user's interests.

[1046] The "emotion analysis means for recognizing emotions by analyzing the user's facial expressions and voice" is an analysis function for detecting the user's emotional state based on the user's facial image and voice data.

[1047] The "emotion-responsive display means for adjusting display content based on recognized emotions" is a function for dynamically changing displayed products and promotional content in consideration of the results of emotion analysis.

[1048] The present invention combines an emotion engine with a system that allows users to identify and easily purchase products used by their favorite idols, providing specific product recommendations and promotions based on the user's emotions. This system includes a user authentication means, a means for acquiring data on the favorite idol, a means for displaying detailed information about products used by the favorite idol, a means for checking product inventory, a means for suggesting similar products, an emotion analysis means for analyzing the user's facial expressions and voice to recognize emotions, and an emotion-responsive display means for adjusting the display content based on the recognized emotions. Specific embodiments of this system are described below.

[1049] First, an application is installed on the user's device. This application has a login screen for user authentication, an interface for acquiring data on the favorite member, a page for displaying detailed product information, a function for checking stock availability, a function for suggesting similar products, and a camera and voice analysis function for analyzing the user's emotions.

[1050] The server has the following main functions. The user authentication means is a function that collates the authentication information entered by the user with the database and returns the authentication result. The means of obtaining data on the favorite member is a function that obtains the favorite member's profile information and related product list from the database. The means of displaying detailed product information is a function that obtains detailed information on the relevant product from the database and sends it to the user's device. The means of checking product stock status is a function that checks the product stock status using an external API or database. The means of suggesting similar products is a function that uses an AI engine to search for similar products from the database if they are out of stock and sends them to the user's device.

[1051] Furthermore, the emotion analysis means for analyzing the user's emotions uses the camera function and the voice analysis function to analyze the user's facial expressions and voice and recognize the emotions. The emotion-responsive display means for adjusting the display content based on the recognized emotions adjusts the display content of the favorite member data acquisition means and the similar product suggestion means based on the results of the emotion analysis.

[1052] In a specific example, the user's facial expression is analyzed using the camera on their smartphone. For example, if the user is happy, related products are increased, and if the user is depressed, promotional content that will lift their spirits is displayed. This analysis uses technologies such as OpenCV face detection and Keras emotion analysis models.

[1053] Examples of prompt sentences include the following:

[1054] Develop a mail-order application that captures the user's facial expressions with a camera, analyzes their emotions in real time, and displays products and promotional information based on their emotional state. The technologies used will be face detection using OpenCV and emotion analysis using Keras. Also, include a function to obtain images of the user's facial expressions using an API request.

[1055] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1056] Step 1:

[1057] A user opens the application, enters their email address and password on the login screen, and presses the "Login" button. The device sends the entered authentication information to the server. The server compares the received authentication information with the user data in the database and returns the authentication result. If the authentication is successful, the device redirects to the home screen. In this step, the input is the user's authentication information (email address and password), and the output is the display of the home screen or an authentication failure message.

[1058] Step 2:

[1059] The user clicks on the icon of their favorite member on the home screen. The device sends a request to the server to obtain the profile information of the selected favorite member. The server retrieves the favorite member's profile information and related product list from the database and returns them to the device. The device displays the favorite member's profile page based on the retrieved information. In this step, the input is the selection of the favorite member, and the output is the display of the favorite member's profile information and related product list.

[1060] Step 3:

[1061] The user clicks on a product displayed in the "Recently Purchased Products" section on the profile page. The device sends a request to the server to obtain detailed information about the product. The server retrieves detailed information about the product (image, price, link to retail store, etc.) from the database and sends it back to the device. The device displays the product detail page based on the retrieved detailed information. In this step, the input is the product selection, and the output is the display of detailed product information.

[1062] Step 4:

[1063] The user presses the "Purchase" button on the product details page. The terminal sends a purchase request to the server. The server calls an external API or database to check the product's stock status. If the product is in stock, the server generates a link to the purchase page and sends it to the terminal. If the product is out of stock, the server notifies the terminal that the product is out of stock and proceeds to the next step. Based on the stock check results, the terminal displays the purchase page if the product is in stock, or displays "Out of stock" if it is out of stock, and starts the similar product suggestion process. In this step, the input is the purchase request, and the output is the stock information check result and its display.

[1064] Step 5:

[1065] If the product is out of stock, the server uses an AI engine to search for similar products in the database. The server returns a list of similar products found to the terminal. The terminal displays the list of similar products. The user can select from the suggested products and proceed with the purchase. In this step, the input is an out-of-stock notification, and the output is a list of similar products and their display.

[1066] Step 6:

[1067] The device analyzes the user's facial expressions, voice, and text input, and recognizes the user's emotions using an emotion engine. The server adjusts the display content of the means for acquiring data on favorite members and the means for suggesting similar products based on the recognized emotion information. For example, if the user is happy, it increases the number of related product recommendations, and if the user is depressed, it displays products or promotional content that will lift their spirits. In this step, the input is the user's emotion data, and the output is the display of adjusted content.

[1068] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1069] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1070] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1071] [Third embodiment]

[1072] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1073] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1074] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1075] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1076] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1077] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1078] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1079] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1080] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1081] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1082] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1083] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1084] The present invention provides a system that allows users to identify and easily purchase products used by their favorite idols. The overall processing flow of the system and specific embodiments are described below.

[1085] Overall system configuration

[1086] This system consists of a user terminal, a server, a database, an external API, and an AI engine. The main steps are user authentication, obtaining information about the favorite member, displaying detailed product information, checking inventory, and suggesting similar products.

[1087] User Authentication

[1088] User: When you open the app, the login screen appears. Enter your email address and password and press the "Login" button.

[1089] Terminal: Sends the entered authentication information to the server.

[1090] Server: Compares the received authentication information with the user data in the database and returns the authentication result. If authentication is successful, redirects the user to the home screen.

[1091] Obtaining information about your favorite member

[1092] User: Click on the icon of your favorite member on the home screen.

[1093] Device: Sends a request to the server to retrieve the profile information of the selected Oshimen.

[1094] Server: Retrieves the profile information of the favorite member and a list of related products from the database and returns them to the device.

[1095] Device: Based on the information obtained, the profile page of your favorite member will be displayed.

[1096] Display detailed product information

[1097] User: On their profile page, they click on a product listed in the "Recently Purchased" section.

[1098] Terminal: Sends a request to the server to request detailed information about the product.

[1099] Server: Retrieves detailed information about the product (image, price, link to store, etc.) from the database and sends it back to the device.

[1100] Device: Display the product details page based on the obtained product details.

[1101] Check product availability

[1102] User: Clicks the "Purchase" button on the product details page.

[1103] Device: Sends a purchase request to the server.

[1104] Server: Calls an external API or database to check product availability.

[1105] In stock: A link to the purchase page is generated and sent to the user's device.

[1106] Out of Stock: Notify me that the product is out of stock and proceed to the next step.

[1107] Terminal: Based on the results of the inventory check, if the item is in stock, the purchase page will be displayed; if not, it will display "Out of stock" and start the similar product suggestion process.

[1108] Similar product suggestions

[1109] Server: If a product is out of stock, use the AI ​​engine to search for similar products from the database.

[1110] Server: Returns a list of similar products found to the device.

[1111] Terminal: Displays a list of similar products and allows the user to choose from the suggested products.

[1112] Specific examples

[1113] 1. The user opens the app and logs in by entering the email address "example@example.com" and the password "password123".

[1114] 2. The server receives this and checks it against the database, and if authentication is successful, displays the home screen.

[1115] 3. The user clicks on the icon of their favorite idol, "Idol A," on the home screen to view their profile information.

[1116] 4. The server retrieves "Idol A's" profile and a list of recently purchased items from the database and sends them back to the terminal.

[1117] 5. The user clicks on "Lipstick" to view more information.

[1118] 6. The server retrieves detailed information about the product from the database and returns it to the terminal.

[1119] 7. When the user presses the "Buy" button, the server checks stock availability.

[1120] 8. If the item is in stock, the purchase page will be displayed. If it is out of stock, the AI ​​engine will search for similar products and display them on the device.

[1121] In this way, this system is designed to help users identify products used by their favorite idols and make purchases smoothly. It can also increase user satisfaction by suggesting similar products even if the product is out of stock.

[1122] The processing flow will be explained below.

[1123] Step 1:

[1124] User: Opens the app, displays the login screen, enters email address and password, and presses the "Login" button.

[1125] Step 2:

[1126] Terminal: Sends the entered authentication information (email address and password) to the server in JSON format.

[1127] Step 3:

[1128] Server: Checks the received authentication information against the user information in the database.

[1129] If successful: Returns a successful authentication response and starts a login session.

[1130] On failure: Return an error message.

[1131] Step 4:

[1132] Terminal: Receives the authentication result from the server, and if login is successful, redirects to the home screen, otherwise displays an error message.

[1133] Step 5:

[1134] User: Click on your favorite member's icon on the home screen.

[1135] Step 6:

[1136] Device: Sends a request to the server to get data on the selected Oshimen.

[1137] Step 7:

[1138] Server: Retrieves the profile information of the favorite member and a list of related products from the database and returns them to the device.

[1139] Step 8:

[1140] Device: Displays your favorite member's profile information and a list of related products on the screen.

[1141] Step 9:

[1142] User: On their profile page, they click on a product listed under "Recently Purchased Items."

[1143] Step 10:

[1144] Terminal: Sends a request to the server to obtain detailed information about the product.

[1145] Step 11:

[1146] Server: Retrieves detailed information about the product (image, price, link to store, etc.) from the database and sends it back to the device.

[1147] Step 12:

[1148] Terminal: Display detailed product information on the screen.

[1149] Step 13:

[1150] User: Clicks the "Purchase" button on the product details page.

[1151] Step 14:

[1152] Device: Sends a purchase request to the server.

[1153] Step 15:

[1154] Server: Calls an external API or database to check product availability.

[1155] If in stock: Generate a link to the purchase page and send it to your device.

[1156] If out of stock: Notify the customer that the product is out of stock and proceed to the next step.

[1157] Step 16:

[1158] Terminal: Receives the stock check result and displays the purchase page if the item is in stock, or displays "Out of stock" if the item is out of stock and starts the similar product suggestion process.

[1159] Step 17:

[1160] Server: Uses an AI engine to search the database for similar products to the missing item.

[1161] Step 18:

[1162] Server: Returns a list of similar products found to the device.

[1163] Step 19:

[1164] Device: A list of similar products is displayed on the screen, allowing the user to select from the suggested products and proceed with the purchase.

[1165] Example 1

[1166] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1167] Previously, the process for users to identify and purchase products used by their favorite members (supported members) was complicated, and there were issues with checking stock availability and suggesting similar products not working smoothly. Also, when the stock status of a product was unknown, similar alternative products were not suggested appropriately, which led to a decrease in user satisfaction.

[1168] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1169] In this invention, the server includes a user authentication means, a means for acquiring data on the favorite target, a means for displaying detailed information on products used by the favorite target, a means for checking product inventory, a means for suggesting similar products, and a means for searching for similar products from a database using an AI engine. This allows users to easily identify products used by their favorite member (favorite target) and purchase them after checking inventory. Even if a product is out of stock, the AI ​​engine is used to quickly suggest suitable similar products, improving user satisfaction.

[1170] "User authentication means" is a mechanism for allowing a user to access a system by inputting appropriate authentication information.

[1171] "Means for obtaining data on supported objects" refers to the function that enables the system to extract and obtain information on specific supported objects (e.g., idols, characters, etc.) from the database.

[1172] "Means for displaying detailed information about products used by the target of support" is a function for providing users with specific information about the products used by the target of support (such as name, image, price, and link to the store where the product is sold).

[1173] "Means for checking product availability" refers to the mechanism by which the system checks, via an external API or database, whether a particular product is currently available.

[1174] The "means for suggesting similar products" is a function for presenting similar products that are alternative candidates to the user when a product is out of stock, for example.

[1175] "Means for searching for similar products from a database using an AI engine" refers to a mechanism that uses an artificial intelligence engine to analyze information in a database and automatically identify and extract products similar to a specified product.

[1176] This invention relates to a method for providing a system that identifies products used by a favorite member (supported person) and allows users to easily purchase them. This system smoothly performs user authentication, obtains information about the supported person, displays detailed product information, checks inventory, and even suggests similar products if the item is out of stock.

[1177] Overall system configuration

[1178] This system consists of a user terminal, a server, a database, an external API, and an AI engine. The main steps are user authentication, acquisition of support information, display of detailed product information, inventory confirmation, and suggestion of similar products.

[1179] User Authentication

[1180] When a user launches the app, a login screen appears. The user enters the email address "example@example.com" and the password "password123" and presses the "Login" button.

[1181] The device sends the entered authentication information to the server by using an HTTP POST request to send the data to the server's authentication endpoint.

[1182] The server checks the received authentication information against the user data in its database, searches for the email address and password pair using a database query, and verifies whether they match. The authentication is successful or not based on the result of the check.

[1183] If authentication is successful, the server generates a redirect URL for the home screen along with an authentication success message and returns it to the device. If authentication fails, it returns an error message.

[1184] Acquisition of support information

[1185] The user clicks on the icon of a specific object of support (e.g., idol A) on the home screen.

[1186] The device obtains the ID of the selected target and sends a request for profile information to the server, specifically using an HTTP GET request.

[1187] The server retrieves profile information and related product lists from the database and uses database queries to extract the required information.

[1188] The server returns the acquired profile information and product list to the terminal.

[1189] Based on the received data, the device displays the profile page of the person being supported, along with a list of products.

[1190] Display detailed product information

[1191] A user clicks on a specific product (e.g., "lipstick") in the "Recently Purchased Items" section of their profile page.

[1192] The device obtains the ID of the product the user clicked on and sends a request for more information to the server, specifically using an HTTP GET request.

[1193] The server retrieves detailed information about the product (image, price, store link, etc.) from the database and extracts the required information using a database query.

[1194] The server returns the obtained detailed information to the terminal.

[1195] The terminal displays the product details page based on the received product details information.

[1196] Check product availability

[1197] The user presses the "Purchase" button on the product details page.

[1198] The device sends a purchase request to the server, specifically using an HTTP POST request.

[1199] The server calls an external API or database to check the product availability. For example, it calls an external API to get real-time inventory information.

[1200] server:

[1201] If the item is in stock, a link to the purchase page is generated and sent to the user's terminal.

[1202] If the item is out of stock, the system will notify you and proceed to search for similar items using an AI engine.

[1203] Based on the results of the inventory check, the terminal displays the purchase page if the item is in stock, and if not, displays "Out of stock" and starts the process of suggesting similar products.

[1204] Similar product suggestions

[1205] If a product is out of stock, the server uses an AI engine (e.g., a generative AI model) to search for similar products in the database. As a concrete example, the following prompt is input to the AI ​​engine:

[1206] Prompt: "Search our database for similar products for the product name 'Lipstick'."

[1207] The server returns a list of similar products found to the terminal.

[1208] The terminal displays the received list of similar products and allows the user to select from the suggested products.

[1209] The system is designed to help users identify and purchase the products they support through a step-by-step process, and even if an item is out of stock, it utilizes an AI engine to quickly suggest suitable similar products, increasing user satisfaction.

[1210] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1211] Step 1:

[1212] The user launches the app, enters the email address "example@example.com" and password "password123" on the login screen, and presses the "Login" button.

[1213] Input: Email address, password

[1214] Output: Authentication request

[1215] The terminal sends the entered authentication information to the server using an HTTP POST request.

[1216] Input: Authentication Request

[1217] Output: HTTP POST request to the server

[1218] The server checks the received credentials against the user data in its database, which involves running a database query to verify that the email address and password match.

[1219] Input: Credentials

[1220] Output: Matching result (authentication success or failure)

[1221] If the authentication is successful, the server generates a redirect URL for the home screen along with an authentication success message and returns it to the device. If the authentication is unsuccessful, it returns an error message.

[1222] Input: Matching result

[1223] Output: Authentication result (success or error)

[1224] The device receives the returned authentication result, and if the authentication is successful, it transitions to the home screen, and if it is unsuccessful, it displays an error message.

[1225] Input: Authentication result

[1226] Output: Home screen or error message

[1227] Step 2:

[1228] The user clicks on the icon of the object of their support (e.g., idol A) on the home screen.

[1229] Input: Icon click event

[1230] Output: Supported ID

[1231] The terminal sends the ID of the selected target to the server using an HTTP GET request.

[1232] Input: ID of the target

[1233] Output: HTTP GET request to the server

[1234] The server retrieves the profile information and associated product listings of the supported subjects from the database, which involves executing a database query to extract the profile information and product listings.

[1235] Input: ID of the target

[1236] Output: Profile information and related product list

[1237] The server returns the acquired profile information and a list of related products to the terminal.

[1238] Input: Profile information and related product list

[1239] Output: Data returned to the terminal

[1240] The terminal displays the profile page of the target of support and a list of related products based on the received data.

[1241] Input:Return data

[1242] Output: Profile page and product list

[1243] Step 3:

[1244] A user clicks on a specific product (e.g., "lipstick") in the "Recently Purchased Items" section on their profile page.

[1245] Input: Product click event

[1246] Output: Product ID

[1247] The terminal sends the ID of the product clicked by the user to the server using an HTTP GET request.

[1248] Input: Product ID

[1249] Output: HTTP GET request to the server

[1250] The server retrieves detailed information about the product (images, prices, store links, etc.) from the database. This involves executing a database query to extract the required data.

[1251] Input: Product ID

[1252] Output: Detailed information (images, prices, retailer links)

[1253] The server returns the acquired detailed information to the terminal.

[1254] Input:Detailed information

[1255] Output: Data returned to the terminal

[1256] The terminal displays a product detail page based on the received product detail information.

[1257] Input:Return data

[1258] Output: Product detail page display

[1259] Step 4:

[1260] The user presses the "Purchase" button on the product details page.

[1261] Input: Buy button click event

[1262] Output: Purchase request

[1263] The terminal sends a purchase request to the server using an HTTP POST request.

[1264] Input: Purchase Request

[1265] Output: HTTP POST request to the server

[1266] The server calls an external API or database to check product availability, for example, by sending an API request to get real-time inventory information.

[1267] Input: Purchase Request

[1268] Output: Inventory status data

[1269] If the product is in stock, the server generates a link to the purchase page and sends it to the user's device. If the product is out of stock, the server notifies the user that the product is out of stock and proceeds to the process of searching for similar products using an AI engine.

[1270] Input: Inventory status data

[1271] Output: Purchase link or out-of-stock notification

[1272] Based on the results of the inventory check, the terminal displays a purchase page if the item is in stock, and if not, displays "Out of stock" and starts the similar product suggestion process.

[1273] Input: Inventory check result

[1274] Output: Display of purchase page or out-of-stock notification

[1275] Step 5:

[1276] If a product is out of stock, the server uses an AI engine (e.g., a generative AI model) to search for similar products in the database. As a concrete example, the following prompt sentence is input to the AI ​​engine:

[1277] "\nPlease search our database for similar products with the product name 'Lipstick'."

[1278] Input: prompt statement

[1279] Output: Similar products list

[1280] The server returns a list of similar products found to the terminal.

[1281] Input: Similar products list

[1282] Output: Data returned to the terminal

[1283] The terminal displays the received list of similar products and allows the user to select from the suggested products.

[1284] Input:Return data

[1285] Output: Display similar products list

[1286] (Application example 1)

[1287] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1288] Today's users have a need to easily identify and purchase products used by their favorite idols. However, it is difficult to easily find detailed product information and stock status of their favorite idols, and to instantly find similar products. There is a need for a system that can solve these problems and allow users to enjoy shopping more comfortably.

[1289] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1290] In this invention, the server includes a user authentication means, a means for acquiring data on the favorite member, a means for displaying detailed information on products used by the favorite member, a means for checking product inventory, a means for suggesting similar products, a means for suggesting similar products using a generative AI model, and a means for generating prompt text and inputting it into the generative AI model. This allows users to identify products used by their favorite member and smoothly check inventory and purchase them. Furthermore, users can receive suggestions for similar products even if the product is out of stock, which increases user satisfaction.

[1291] "User authentication means" refers to a means for verifying that a user is a valid user when accessing a system.

[1292] The "means for obtaining data on the favorite member" is a means for obtaining profile information and a list of related products related to the favorite member from the database.

[1293] The "means for displaying detailed information about products used by a favorite member" is a means for displaying to a user detailed information about products used by a favorite member selected by the user.

[1294] A "means for checking product availability" is a means for checking whether a particular product is in stock using an external API or database.

[1295] The "means for suggesting similar products" is a means for suggesting other similar products to the user when there is insufficient stock.

[1296] "Means for suggesting similar products using a generative AI model" refers to means for using an artificial intelligence model to search for similar products to a specific product and suggest them to users.

[1297] "Means for generating prompt sentences and inputting them to a generative AI model" refers to means for generating prompt sentences containing appropriate questions or commands for a generative AI model and inputting them.

[1298] The present invention is a system that identifies products used by a favorite member and suggests similar products based on them. This system includes a user authentication means, a means for acquiring data on the favorite member, a means for displaying detailed information about the products used by the favorite member, a means for checking product stock status, a means for suggesting similar products, a means for suggesting similar products using a generative AI model, and a means for generating prompt sentences and inputting them into the generative AI model.

[1299] Overall system configuration

[1300] This system consists of a user terminal, a server, a database, an external API, and a generative AI model. The main steps are user authentication, obtaining information about the favorite member, displaying detailed product information, checking inventory, and suggesting similar products.

[1301] Hardware and software used

[1302] Frontend: Use React Native to create an application compatible with smartphones (iOS / Android).

[1303] Backend: Uses Node.js and Express.js as the server.

[1304] Database: Uses MySQL for data storage.

[1305] External API: Use the product inventory confirmation API.

[1306] Generative AI model: Uses TensorFlow to suggest similar products.

[1307] Details of each method and processing flow

[1308] 1. User authentication method:

[1309] The user opens the app and enters their email address and password on the login screen.

[1310] The information entered is sent to the server and checked against user data in a MySQL database.

[1311] If authentication is successful, you will be redirected to the home screen.

[1312] 2. How to get your favorite member's data:

[1313] When a user clicks on the icon of their favorite member on the home screen, the profile information of the favorite member and a list of related products are sent back to the device from the database via the server.

[1314] 3. How to view detailed information about products used by your favorite idol:

[1315] When a user selects a product on the profile page of their favorite member, detailed information about that product is requested from the server, retrieved from the database, and displayed.

[1316] 4. How to check product availability:

[1317] When the user presses the "Buy" button, stock availability is checked using an external API or database.

[1318] 5. Suggesting similar products:

[1319] If an item is out of stock, a generative AI model (TensorFlow) is used to suggest similar items.

[1320] The server generates prompt sentences based on information such as category, brand, and price range, and inputs them into the generative AI model.

[1321] Specific examples

[1322] For example, if a user selects a "lipstick" that "Favorite Member A" recently purchased and it's out of stock, the generative AI model will generate the following prompt:

[1323] Prompt: The lipstick that Oshime A recently purchased is out of stock. Please suggest five lipsticks from the same brand with similar features.

[1324] This prompt sentence is input into a generative AI model, and the results are sent back to the user's device to recommend similar products.

[1325] This system allows users to identify products used by their favorite idols, check stock availability, and purchase them smoothly. Furthermore, if an item is out of stock, users can receive suggestions for similar products, increasing user satisfaction.

[1326] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1327] Step 1:

[1328] The user opens the application and enters their email address and password on the login screen. This user input is sent to the server. The server verifies the user information in the MySQL database, and if authentication is successful, redirects them to the home screen. The input is the user's authentication information, and the output is the authentication result. Data processing and calculations involve verification of the user authentication information.

[1329] Step 2:

[1330] When a user clicks on an icon of their favorite member on the home screen, the selected information is sent as a request to the server. The server retrieves the member's profile information and a list of related products from the MySQL database and sends this back to the device. The input is the selected member's information, and the output is detailed data about the member. Data processing and calculation involves retrieving information from the database.

[1331] Step 3:

[1332] When a user clicks on a recently purchased item on the profile page of their favorite idol, a request is sent to the server for detailed information about that item. The server retrieves detailed information about the item (image, price, link to retail store, etc.) from the database and sends it back to the terminal. The input is the product selection information, and the output is detailed product information. Data processing and calculation involves retrieving detailed product information from the database.

[1333] Step 4:

[1334] When a user presses the "Purchase" button on a product detail page, the purchase request is sent to the server. The server calls an external API or database to check the product's stock status. The input is the purchase request and the output is the stock status. If the product is in stock, a link to the purchase page is generated and sent to the terminal. Data processing and calculations involve checking stock and generating the link.

[1335] Step 5:

[1336] If the item is out of stock, the server will use a generative AI model to begin the process of suggesting similar items. The server generates a prompt sentence and inputs this into the generative AI model. The input is the prompt sentence, and the output is a list of similar items. Data processing and calculations involve generating the prompt sentence and using the AI ​​model to search for similar items.

[1337] Step 6:

[1338] The server returns a list of similar products obtained from the generative AI model to the terminal. The terminal displays it, and the user can select from the suggested products. The input is a list of similar products, and the output is product information displayed to the user. Data processing and calculation involves displaying the output of the AI ​​model on the user's terminal.

[1339] As an example of a specific prompt sentence, we could generate the sentence, "The lipstick recently purchased by my favorite idol A is out of stock. Please suggest five lipsticks from the same brand with similar features." By inputting this into the generative AI model, it will search for and suggest similar products.

[1340] In this way, the specific actions and processing flow performed by the user, terminal, and server at each step are clearly defined. At each processing step, data processing and calculations are performed based on the input, and appropriate output is generated, realizing a system that allows users to easily identify and purchase products used by their favorite member.

[1341] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1342] The present invention combines an emotion engine with a system that identifies products used by favorite idols and allows users to easily purchase them, thereby providing specific product recommendations and promotions based on the user's emotions. The overall processing flow of the system and specific embodiments are described below.

[1343] Overall system configuration

[1344] This system consists of a user terminal, a server, a database, an external API, an AI engine, and an emotion engine. The main steps are user authentication, obtaining information about the favorite member, displaying detailed product information, checking inventory, suggesting similar products, and adjusting content based on user emotions.

[1345] User Authentication

[1346] User: When you open the app, the login screen appears. Enter your email address and password and press the "Login" button.

[1347] Terminal: Sends the entered authentication information to the server.

[1348] Server: Compares the received authentication information with the user data in the database and returns the authentication result. If authentication is successful, redirects the user to the home screen.

[1349] Obtaining information about your favorite member

[1350] User: Click on the icon of your favorite member on the home screen.

[1351] Device: Sends a request to the server to retrieve the profile information of the selected Oshimen.

[1352] Server: Retrieves the profile information of the favorite member and a list of related products from the database and returns them to the device.

[1353] Device: Based on the information obtained, the profile page of your favorite member will be displayed.

[1354] Display detailed product information

[1355] User: On their profile page, they click on a product listed in the "Recently Purchased" section.

[1356] Terminal: Sends a request to the server to obtain detailed information about the product.

[1357] Server: Retrieves detailed information about the product (image, price, link to store, etc.) from the database and sends it back to the device.

[1358] Device: Display the product details page based on the obtained product details.

[1359] Check product availability

[1360] User: Clicks the "Purchase" button on the product details page.

[1361] Device: Sends a purchase request to the server.

[1362] Server: Calls an external API or database to check product availability.

[1363] If in stock: Generate a link to the purchase page and send it to the user's device.

[1364] If out of stock: Notify the customer that the product is out of stock and proceed to the next step.

[1365] Device: Based on the results of the inventory check, if the item is in stock, the purchase page will be displayed; if it is out of stock, the message "Out of stock" will be displayed and the similar product suggestion process will be initiated.

[1366] Similar product suggestions

[1367] Server: If a product is out of stock, use the AI ​​engine to search for similar products from the database.

[1368] Server: Returns a list of similar products found to the device.

[1369] On your device: Displays a list of similar products, allowing the user to select from the suggested products and proceed with the purchase.

[1370] Content adjustment based on user sentiment

[1371] Terminal: Analyzes the user's facial expressions, voice, and text input, and recognizes the user's emotions using an emotion engine.

[1372] Server: Based on the recognized emotional information, adjust the display content of the means for acquiring data on the favorite member and the means for suggesting similar products.

[1373] For example, if the user is happy, the number of related product recommendations will be increased, and if the user is depressed, products and promotional content that will lift the user's spirits will be displayed.

[1374] Device: Display the adapted content to the user.

[1375] Specific examples

[1376] 1. The user opens the app and logs in by entering the email address "example@example.com" and the password "password123".

[1377] 2. The server receives this and checks it against the database, and if authentication is successful, displays the home screen.

[1378] 3. The user clicks on the icon of their favorite idol, "Idol A," on the home screen to view their profile information.

[1379] 4. The server retrieves "Idol A's" profile and a list of recently purchased items from the database and sends them back to the terminal.

[1380] 5. The user clicks on "Lipstick" to view more information.

[1381] 6. The server retrieves detailed information about the product from the database and returns it to the terminal.

[1382] 7. When the user presses the "Buy" button, the server checks stock availability.

[1383] 8. If the item is in stock, the purchase page will be displayed. If it is out of stock, the AI ​​engine will search for similar products and display them on the device.

[1384] 9. The device captures the user's facial expressions with a camera, and the emotion engine analyzes the user's emotions.

[1385] 10. Based on the analyzed emotions, the server selects appropriate products and promotions and displays them on the device.

[1386] For example, if the user is happy, the number of products related to "Idol A" will be increased, and if the user is depressed, promotional products that will lift the user's spirits will be displayed.

[1387] In this way, this system is designed to identify products used by users' favorite idols and facilitate smooth purchases. Furthermore, by utilizing an emotion engine, it can suggest individual content according to the user's emotional state, further increasing user satisfaction.

[1388] The processing flow will be explained below.

[1389] Step 1:

[1390] User: Opens the app, displays the login screen, enters email address and password, and presses the "Login" button.

[1391] Step 2:

[1392] Terminal: Sends the entered authentication information (email address and password) to the server in JSON format.

[1393] Step 3:

[1394] Server: Checks the received authentication information against the user information in the database. If successful, returns a response indicating successful authentication and starts a login session. If unsuccessful, returns an error message.

[1395] Step 4:

[1396] Terminal: Receives the authentication result from the server, and if login is successful, redirects to the home screen, otherwise displays an error message.

[1397] Step 5:

[1398] User: Click on your favorite member's icon on the home screen.

[1399] Step 6:

[1400] Device: Sends a request to the server to get data on the selected Oshimen.

[1401] Step 7:

[1402] Server: Retrieves the profile information of the favorite member and a list of related products from the database and returns them to the device.

[1403] Step 8:

[1404] Device: Displays your favorite member's profile information and a list of related products on the screen.

[1405] Step 9:

[1406] User: On their profile page, they click on a product listed under "Recently Purchased Items."

[1407] Step 10:

[1408] Terminal: Sends a request to the server to obtain detailed information about the product.

[1409] Step 11:

[1410] Server: Retrieves detailed information about the product (image, price, link to store, etc.) from the database and sends it back to the device.

[1411] Step 12:

[1412] Terminal: Display detailed product information on the screen.

[1413] Step 13:

[1414] User: Clicks the "Purchase" button on the product details page.

[1415] Step 14:

[1416] Device: Sends a purchase request to the server.

[1417] Step 15:

[1418] Server: Calls an external API or database to check product availability.

[1419] If the item is in stock, a link to the purchase page is generated and sent to the device.

[1420] If the item is out of stock, the system notifies the user that the item is out of stock and proceeds to the next step.

[1421] Step 16:

[1422] Terminal: Receives the stock check result and displays the purchase page if the item is in stock, or displays "Out of stock" if the item is out of stock and starts the similar product suggestion process.

[1423] Step 17:

[1424] Server: Uses an AI engine to search the database for similar products to the missing item.

[1425] Step 18:

[1426] Server: Returns a list of similar products found to the device.

[1427] Step 19:

[1428] On your device: Displays a list of similar products, allowing the user to select from the suggested products and proceed with the purchase.

[1429] Step 20:

[1430] User: Selects a product from the list of similar products and clicks the purchase button.

[1431] Step 21:

[1432] Terminal: Sends a similar product purchase request to the server.

[1433] Step 22:

[1434] Server: Checks the stock status and availability of similar products and returns the results to the terminal.

[1435] Step 23:

[1436] Device: Display a purchase completion screen to the user.

[1437] Step 24:

[1438] Terminal: Analyzes the user's facial expressions, voice, and text input, and recognizes the user's emotions using an emotion engine.

[1439] Step 25:

[1440] Server: Based on the recognized emotional information, adjust the display content of the means for acquiring data on the favorite member and the means for suggesting similar products.

[1441] For example, if the user is happy, the number of related product recommendations will be increased, and if the user is depressed, products and promotional content that will lift the user's spirits will be displayed.

[1442] Step 26:

[1443] Device: Display the adapted content to the user.

[1444] Specific examples

[1445] 1. The user opens the app and logs in by entering the email address "example@example.com" and the password "password123".

[1446] 2. The server receives this and checks it against the database, and if authentication is successful, displays the home screen.

[1447] 3. The user clicks on the icon of their favorite idol, "Idol A," on the home screen to view their profile information.

[1448] 4. The server retrieves "Idol A's" profile and a list of recently purchased items from the database and sends them back to the terminal.

[1449] 5. The user clicks on "Lipstick" to view more information.

[1450] 6. The server retrieves detailed information about the product from the database and returns it to the terminal.

[1451] 7. When the user presses the "Buy" button, the server checks stock availability.

[1452] 8. If the item is in stock, the purchase page will be displayed. If it is out of stock, the AI ​​engine will search for similar products and display them on the device.

[1453] 9. The device captures the user's facial expressions with a camera, and the emotion engine analyzes the user's emotions.

[1454] 10. Based on the analyzed emotions, the server selects appropriate products and promotions and displays them on the device.

[1455] For example, if the user is happy, the number of products related to "Idol A" will be increased, and if the user is depressed, promotional products that will lift the user's spirits will be displayed.

[1456] Example 2

[1457] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1458] In today's world, users want to easily identify and purchase products used by their favorite idols. However, conventional systems make the product identification and purchase process cumbersome and time-consuming for users. Furthermore, product recommendations and promotions are not tailored to the user's emotions, making it difficult to improve personalized satisfaction.

[1459] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a user authentication means, a means for acquiring data on the favorite member, a means for displaying detailed information on products used by the favorite member, a means for checking product inventory, a means for suggesting similar products, a means for acquiring and analyzing emotion data, and a means for adjusting content based on the user's emotion. This allows the user to smoothly identify and purchase products used by the favorite member, and also provides individual content according to the user's emotional state, thereby improving satisfaction.

[1460] "User authentication means" refers to a means for processing and authenticating authentication information such as an email address and password used when a user accesses the system.

[1461] "Means for obtaining data on a favorite member" refers to means for obtaining profile information and related product information of a target person (favorite member) from the database within the system.

[1462] The "means for displaying detailed information about the product used by the favorite member" is a means for displaying detailed information such as an image, price, and link to a store selling the product selected by the user.

[1463] "Means for checking product availability" refers to means for checking the availability of selected products using an external API or database.

[1464] "Means for suggesting similar products" refers to a means for using an AI engine to search for similar products from a database and suggest them to users when an item is out of stock.

[1465] The "means for acquiring and analyzing emotional data" refers to a means for recognizing the emotional state of a user by analyzing the user's facial expressions, voice, and text input.

[1466] The "means for adjusting content based on user emotion" refers to a means for individually adjusting displayed products and promotional content based on recognized user emotion information.

[1467] The present invention combines an emotion engine with a system that identifies products used by a specific idol and allows users to easily purchase them, thereby providing specific product recommendations and promotions based on the user's emotions. The overall processing flow of the system and specific embodiments are described below.

[1468] This system consists of a user terminal, a server, a database, an external API, an AI engine, and an emotion engine. The main steps are user authentication, obtaining information about the favorite member, displaying detailed product information, checking inventory, suggesting similar products, and adjusting content based on user emotions.

[1469] User Authentication

[1470] User: When the app is opened, the login screen appears, the user enters their email address and password, and presses the "Login" button.

[1471] Terminal: Sends the entered authentication information to the server using the HTTPS protocol.

[1472] Server: Compares the received authentication information with the user data in the database and returns the authentication result. If authentication is successful, redirects the user to the home screen.

[1473] Obtaining information about your favorite member

[1474] User: Click on the icon of your favorite member on the home screen.

[1475] Device: Sends a request to the server to retrieve the profile information of the selected Oshimen.

[1476] Server: Retrieves the profile information of the favorite member and a list of related products from the database and returns them to the device.

[1477] Device: Display your favorite member's profile page based on the information obtained.

[1478] Display detailed product information

[1479] User: On their profile page, they click on a product listed in the "Recently Purchased" section.

[1480] Terminal: Sends a request to the server to obtain detailed information about the product.

[1481] Server: Retrieves detailed information about the product (image, price, link to store, etc.) from the database and sends it back to the device.

[1482] Device: Display the product details page based on the obtained product details.

[1483] Check product availability

[1484] User: Clicks the "Purchase" button on the product details page.

[1485] Device: Sends a purchase request to the server.

[1486] Server: Calls an external API or database to check the product's availability. If the product is in stock, generates a link to the purchase page and sends it to the user's device. If the product is out of stock, notifies the user that the product is out of stock and proceeds to the next step.

[1487] Device: Based on the results of the inventory check, if the item is in stock, the purchase page will be displayed; if it is out of stock, the message "Out of stock" will be displayed and the similar product suggestion process will be initiated.

[1488] Similar product suggestions

[1489] Server: If a product is out of stock, use the AI ​​engine to search for similar products from the database.

[1490] Server: Returns a list of similar products found to the device.

[1491] On your device: Displays a list of similar products, allowing the user to select from the suggested products and proceed with the purchase.

[1492] Content adjustment based on user sentiment

[1493] Terminal: Analyzes the user's facial expressions, voice, and text input, and recognizes the user's emotions using an emotion engine.

[1494] Server: Based on the recognized emotion information, the server adjusts the display content of the means for acquiring data on the favorite member and the means for suggesting similar products. For example, if the user is happy, the server increases the number of related product recommendations, and if the user is depressed, the server displays products and promotional content that will lift the user's spirits.

[1495] Device: Display the adapted content to the user.

[1496] Specific examples

[1497] 1. The user opens the app and logs in by entering the email address "example@example.com" and the password "password123".

[1498] 2. The server receives this and checks it against the database, and if authentication is successful, displays the home screen.

[1499] 3. Users click on their favorite member's icon on the home screen to view their profile information and a list of recently purchased items.

[1500] 4. The server retrieves the profile of the favorite member and detailed information about related products from the database and sends them to the terminal.

[1501] 5. The user clicks on the displayed product to view more information.

[1502] 6. The server retrieves detailed information about the product from the database and returns it to the terminal.

[1503] 7. When the user presses the "Buy" button, the server checks stock availability.

[1504] 8. If the item is in stock, the purchase page will be displayed. If it is out of stock, the AI ​​engine will search for similar products and display them on the device.

[1505] 9. The device captures the user's facial expressions with a camera, and the emotion engine analyzes the user's emotions.

[1506] 10. The server selects appropriate products and promotions based on the analyzed emotions and displays them on the device. For example, if the user is happy, it will increase the number of related products, and if the user is depressed, it will display products that will lift their spirits.

[1507] In this way, this system is designed to identify products used by users' favorite idols and facilitate smooth purchases. Furthermore, by utilizing the emotion engine, it can suggest individual content according to the user's emotional state, further increasing user satisfaction.

[1508] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1509] Step 1: User authentication

[1510] Enter your email address and password

[1511] process:

[1512] User: When you open the app, the login screen will appear. Enter your email address and password and press the "Login" button.

[1513] Terminal: The entered authentication information is sent to the server via the HTTPS protocol.

[1514] Server: Checks the received credentials against the user data in the database using the hashed password.

[1515] Output: Authentication result (success or failure)

[1516] Specific operation:

[1517] If authentication is successful, the server generates a user ID and session information and returns it to the device, redirecting it to the home screen. If authentication fails, an error message is returned to the device, and the login screen is displayed again.

[1518] Step 2: Obtaining information about your favorite member

[1519] Input: Select your favorite member's icon

[1520] process:

[1521] User: Click on the icon of your favorite member on the home screen.

[1522] Device: Send a request to the server containing the ID of the selected member.

[1523] Server: Retrieves the profile information of the favorite member and the related product list from the database. Executes queries to extract relevant data.

[1524] Output: Profile information of your favorite member and related product list

[1525] Specific operation:

[1526] The server returns the acquired data in JSON format to the device, and the device displays the profile page of the favorite member.

[1527] Step 3: Display detailed product information

[1528] Input: Select product

[1529] process:

[1530] User: On their profile page, they click on a product listed in the "Recently Purchased" section.

[1531] Device: Sends a request to the server containing the ID of the selected item.

[1532] Server: Retrieves detailed product information (images, prices, store links, etc.) from the database and executes a database query.

[1533] Output: Product details

[1534] Specific operation:

[1535] The server returns the acquired data in JSON format to the terminal, and the terminal displays the product details page.

[1536] Step 4: Check product availability

[1537] Input: Purchase Request

[1538] process:

[1539] User: Clicks the "Purchase" button on the product details page.

[1540] Device: Sends a purchase request to the server, including the ID of the selected item.

[1541] Server: Calls an external API or database to check product availability and executes an inventory query.

[1542] Output: Stock check result (in stock / out of stock)

[1543] Specific operation:

[1544] If the item is in stock, the server generates a link to the purchase page and sends it to the user's device. If the item is out of stock, the server notifies the user that the item is out of stock.

[1545] Step 5: Suggest similar products

[1546] Input: Out-of-stock notification

[1547] process:

[1548] Server: If a product is out of stock, the AI ​​engine is used to search for similar products in the database. The AI ​​engine calculates the features of similar products and lists the most similar products.

[1549] Server: Returns a list of similar products found to the device.

[1550] Output: A list of similar products

[1551] Specific operation:

[1552] The server returns the acquired data in JSON format to the terminal, which then displays a list of similar products.

[1553] Step 6: Adjust content based on user sentiment

[1554] Input: Emotion data (facial expressions, voice, text input)

[1555] process:

[1556] Device: Uses a camera and microphone to capture the user's facial expressions, voice, and text.

[1557] On the device: Analyzes emotion data using an emotion engine (e.g., EmotionAPI) to recognize the user's emotional state.

[1558] Server: Based on the recognized emotion information, the server adjusts the display content of the means for acquiring data on the favorite member and the means for suggesting similar products. For example, if the user is happy, the server increases the number of related product recommendations, and if the user is depressed, the server displays products and promotional content that will lift the user's spirits.

[1559] Output: Adjusted content

[1560] Specific operation:

[1561] The adjusted content is sent back to the device in JSON format and displayed on the device. Specifically, if the user is happy, more products related to the favorite idol will be displayed, and if the user is depressed, cheering messages and items to lift their spirits will be displayed.

[1562] (Application example 2)

[1563] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1564] Current mail-order sales systems are insufficient in supporting users to identify and easily purchase products used by their favorite idols. They also lack mechanisms for product recommendations and promotions based on users' emotions. Therefore, the challenge is to efficiently provide appropriate products that correspond to users' interests and emotions and increase their purchasing motivation.

[1565] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1566] In this invention, the server includes a user authentication means, a means for acquiring data on the favorite member, a means for displaying detailed information on products used by the favorite member, a means for checking product stock status, a means for suggesting similar products, an emotion analysis means for analyzing the user's facial expressions and voice to recognize their emotions, and an emotion-responsive display means for adjusting the display content based on the recognized emotions. This not only allows users to easily identify and purchase products used by their favorite member, but also provides products and promotions that correspond to their emotions, enabling a more fulfilling shopping experience.

[1567] "User authentication means" is a function for verifying the identity of a user when accessing the system.

[1568] "Means for obtaining data on a favorite member" refers to a function for obtaining profile information and related product information of a specific person (favorite member) from a database.

[1569] "Means for displaying detailed information about products used by the favorite member" is a function for presenting detailed information (images, prices, retailer information, etc.) about products used by the favorite member to the user.

[1570] "Means for checking product inventory status" refers to a function for checking the inventory status of a specific product via an external API or database.

[1571] The "means for suggesting similar products" is a function for recommending other related products when there is a shortage of stock or based on the user's interests.

[1572] The "emotion analysis means for recognizing emotions by analyzing the user's facial expressions and voice" is an analysis function for detecting the user's emotional state based on the user's facial image and voice data.

[1573] The "emotion-responsive display means for adjusting display content based on recognized emotions" is a function for dynamically changing displayed products and promotional content in consideration of the results of emotion analysis.

[1574] The present invention combines an emotion engine with a system that allows users to identify and easily purchase products used by their favorite idols, providing specific product recommendations and promotions based on the user's emotions. This system includes a user authentication means, a means for acquiring data on the favorite idol, a means for displaying detailed information about products used by the favorite idol, a means for checking product inventory, a means for suggesting similar products, an emotion analysis means for analyzing the user's facial expressions and voice to recognize emotions, and an emotion-responsive display means for adjusting the display content based on the recognized emotions. Specific embodiments of this system are described below.

[1575] First, an application is installed on the user's device. This application has a login screen for user authentication, an interface for acquiring data on the favorite member, a page for displaying detailed product information, a function for checking stock availability, a function for suggesting similar products, and a camera and voice analysis function for analyzing the user's emotions.

[1576] The server has the following main functions. The user authentication means is a function that collates the authentication information entered by the user with the database and returns the authentication result. The means of obtaining data on the favorite member is a function that obtains the favorite member's profile information and related product list from the database. The means of displaying detailed product information is a function that obtains detailed information on the relevant product from the database and sends it to the user's device. The means of checking product stock status is a function that checks the product stock status using an external API or database. The means of suggesting similar products is a function that uses an AI engine to search for similar products from the database if they are out of stock and sends them to the user's device.

[1577] Furthermore, the emotion analysis means for analyzing the user's emotions uses the camera function and the voice analysis function to analyze the user's facial expressions and voice and recognize the emotions. The emotion-responsive display means for adjusting the display content based on the recognized emotions adjusts the display content of the favorite member data acquisition means and the similar product suggestion means based on the results of the emotion analysis.

[1578] In a specific example, the user's facial expression is analyzed using the camera on their smartphone. For example, if the user is happy, related products are increased, and if the user is depressed, promotional content that will lift their spirits is displayed. This analysis uses technologies such as OpenCV face detection and Keras emotion analysis models.

[1579] Examples of prompt sentences include the following:

[1580] Develop a mail-order application that captures the user's facial expressions with a camera, analyzes their emotions in real time, and displays products and promotional information based on their emotional state. The technologies used will be face detection using OpenCV and emotion analysis using Keras. Also, include a function to obtain images of the user's facial expressions using an API request.

[1581] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1582] Step 1:

[1583] A user opens the application, enters their email address and password on the login screen, and presses the "Login" button. The device sends the entered authentication information to the server. The server compares the received authentication information with the user data in the database and returns the authentication result. If the authentication is successful, the device redirects to the home screen. In this step, the input is the user's authentication information (email address and password), and the output is the display of the home screen or an authentication failure message.

[1584] Step 2:

[1585] The user clicks on the icon of their favorite member on the home screen. The device sends a request to the server to obtain the profile information of the selected favorite member. The server retrieves the favorite member's profile information and related product list from the database and returns them to the device. The device displays the favorite member's profile page based on the retrieved information. In this step, the input is the selection of the favorite member, and the output is the display of the favorite member's profile information and related product list.

[1586] Step 3:

[1587] The user clicks on a product displayed in the "Recently Purchased Products" section on the profile page. The device sends a request to the server to obtain detailed information about the product. The server retrieves detailed information about the product (image, price, link to retail store, etc.) from the database and sends it back to the device. The device displays the product detail page based on the retrieved detailed information. In this step, the input is the product selection, and the output is the display of detailed product information.

[1588] Step 4:

[1589] The user presses the "Purchase" button on the product details page. The terminal sends a purchase request to the server. The server calls an external API or database to check the product's stock status. If the product is in stock, the server generates a link to the purchase page and sends it to the terminal. If the product is out of stock, the server notifies the terminal that the product is out of stock and proceeds to the next step. Based on the stock check results, the terminal displays the purchase page if the product is in stock, or displays "Out of stock" if it is out of stock, and starts the similar product suggestion process. In this step, the input is the purchase request, and the output is the stock information check result and its display.

[1590] Step 5:

[1591] If the product is out of stock, the server uses an AI engine to search for similar products in the database. The server returns a list of similar products found to the terminal. The terminal displays the list of similar products. The user can select from the suggested products and proceed with the purchase. In this step, the input is an out-of-stock notification, and the output is a list of similar products and their display.

[1592] Step 6:

[1593] The device analyzes the user's facial expressions, voice, and text input, and recognizes the user's emotions using an emotion engine. The server adjusts the display content of the means for acquiring data on favorite members and the means for suggesting similar products based on the recognized emotion information. For example, if the user is happy, it increases the number of related product recommendations, and if the user is depressed, it displays products or promotional content that will lift their spirits. In this step, the input is the user's emotion data, and the output is the display of adjusted content.

[1594] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1595] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1596] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1597] [Fourth embodiment]

[1598] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1599] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1600] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1601] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1602] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1603] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1604] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1605] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1606] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1607] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1608] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1609] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1610] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1611] The present invention provides a system that allows users to identify and easily purchase products used by their favorite idols. The overall processing flow of the system and specific embodiments are described below.

[1612] Overall system configuration

[1613] This system consists of a user terminal, a server, a database, an external API, and an AI engine. The main steps are user authentication, obtaining information about the favorite member, displaying detailed product information, checking inventory, and suggesting similar products.

[1614] User Authentication

[1615] User: When you open the app, the login screen appears. Enter your email address and password and press the "Login" button.

[1616] Terminal: Sends the entered authentication information to the server.

[1617] Server: Compares the received authentication information with the user data in the database and returns the authentication result. If authentication is successful, redirects the user to the home screen.

[1618] Obtaining information about your favorite member

[1619] User: Click on the icon of your favorite member on the home screen.

[1620] Device: Sends a request to the server to retrieve the profile information of the selected Oshimen.

[1621] Server: Retrieves the profile information of the favorite member and a list of related products from the database and returns them to the device.

[1622] Device: Based on the information obtained, the profile page of your favorite member will be displayed.

[1623] Display detailed product information

[1624] User: On their profile page, they click on a product listed in the "Recently Purchased" section.

[1625] Terminal: Sends a request to the server to request detailed information about the product.

[1626] Server: Retrieves detailed information about the product (image, price, link to store, etc.) from the database and sends it back to the device.

[1627] Device: Display the product details page based on the obtained product details.

[1628] Check product availability

[1629] User: Clicks the "Purchase" button on the product details page.

[1630] Device: Sends a purchase request to the server.

[1631] Server: Calls an external API or database to check product availability.

[1632] In stock: A link to the purchase page is generated and sent to the user's device.

[1633] Out of Stock: Notify me that the product is out of stock and proceed to the next step.

[1634] Terminal: Based on the results of the inventory check, if the item is in stock, the purchase page will be displayed; if not, it will display "Out of stock" and start the similar product suggestion process.

[1635] Similar product suggestions

[1636] Server: If a product is out of stock, use the AI ​​engine to search for similar products from the database.

[1637] Server: Returns a list of similar products found to the device.

[1638] Terminal: Displays a list of similar products and allows the user to choose from the suggested products.

[1639] Specific examples

[1640] 1. The user opens the app and logs in by entering the email address "example@example.com" and the password "password123".

[1641] 2. The server receives this and checks it against the database, and if authentication is successful, displays the home screen.

[1642] 3. The user clicks on the icon of their favorite idol, "Idol A," on the home screen to view their profile information.

[1643] 4. The server retrieves "Idol A's" profile and a list of recently purchased items from the database and sends them back to the terminal.

[1644] 5. The user clicks on "Lipstick" to view more information.

[1645] 6. The server retrieves detailed information about the product from the database and returns it to the terminal.

[1646] 7. When the user presses the "Buy" button, the server checks stock availability.

[1647] 8. If the item is in stock, the purchase page will be displayed. If it is out of stock, the AI ​​engine will search for similar products and display them on the device.

[1648] In this way, this system is designed to help users identify products used by their favorite idols and make purchases smoothly. It can also increase user satisfaction by suggesting similar products even if the product is out of stock.

[1649] The processing flow will be explained below.

[1650] Step 1:

[1651] User: Opens the app, displays the login screen, enters email address and password, and presses the "Login" button.

[1652] Step 2:

[1653] Terminal: Sends the entered authentication information (email address and password) to the server in JSON format.

[1654] Step 3:

[1655] Server: Checks the received authentication information against the user information in the database.

[1656] If successful: Returns a successful authentication response and starts a login session.

[1657] On failure: Return an error message.

[1658] Step 4:

[1659] Terminal: Receives the authentication result from the server, and if login is successful, redirects to the home screen, otherwise displays an error message.

[1660] Step 5:

[1661] User: Click on your favorite member's icon on the home screen.

[1662] Step 6:

[1663] Device: Sends a request to the server to get data on the selected Oshimen.

[1664] Step 7:

[1665] Server: Retrieves the profile information of the favorite member and a list of related products from the database and returns them to the device.

[1666] Step 8:

[1667] Device: Displays your favorite member's profile information and a list of related products on the screen.

[1668] Step 9:

[1669] User: On their profile page, they click on a product listed under "Recently Purchased Items."

[1670] Step 10:

[1671] Terminal: Sends a request to the server to obtain detailed information about the product.

[1672] Step 11:

[1673] Server: Retrieves detailed information about the product (image, price, link to store, etc.) from the database and sends it back to the device.

[1674] Step 12:

[1675] Terminal: Display detailed product information on the screen.

[1676] Step 13:

[1677] User: Clicks the "Purchase" button on the product details page.

[1678] Step 14:

[1679] Device: Sends a purchase request to the server.

[1680] Step 15:

[1681] Server: Calls an external API or database to check product availability.

[1682] If in stock: Generate a link to the purchase page and send it to your device.

[1683] If out of stock: Notify the customer that the product is out of stock and proceed to the next step.

[1684] Step 16:

[1685] Terminal: Receives the stock check result and displays the purchase page if the item is in stock, or displays "Out of stock" if the item is out of stock and starts the similar product suggestion process.

[1686] Step 17:

[1687] Server: Uses an AI engine to search the database for similar products to the missing item.

[1688] Step 18:

[1689] Server: Returns a list of similar products found to the device.

[1690] Step 19:

[1691] Device: A list of similar products is displayed on the screen, allowing the user to select from the suggested products and proceed with the purchase.

[1692] Example 1

[1693] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1694] Previously, the process for users to identify and purchase products used by their favorite members (supported members) was complicated, and there were issues with checking stock availability and suggesting similar products not working smoothly. Also, when the stock status of a product was unknown, similar alternative products were not suggested appropriately, which led to a decrease in user satisfaction.

[1695] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1696] In this invention, the server includes a user authentication means, a means for acquiring data on the favorite target, a means for displaying detailed information on products used by the favorite target, a means for checking product inventory, a means for suggesting similar products, and a means for searching for similar products from a database using an AI engine. This allows users to easily identify products used by their favorite member (favorite target) and purchase them after checking inventory. Even if a product is out of stock, the AI ​​engine is used to quickly suggest suitable similar products, improving user satisfaction.

[1697] "User authentication means" is a mechanism for allowing a user to access a system by inputting appropriate authentication information.

[1698] "Means for obtaining data on supported objects" refers to the function that enables the system to extract and obtain information on specific supported objects (e.g., idols, characters, etc.) from the database.

[1699] "Means for displaying detailed information about products used by the target of support" is a function for providing users with specific information about the products used by the target of support (such as name, image, price, and link to the store where the product is sold).

[1700] "Means for checking product availability" refers to the mechanism by which the system checks, via an external API or database, whether a particular product is currently available.

[1701] The "means for suggesting similar products" is a function for presenting similar products that are alternative candidates to the user when a product is out of stock, for example.

[1702] "Means for searching for similar products from a database using an AI engine" refers to a mechanism that uses an artificial intelligence engine to analyze information in a database and automatically identify and extract products similar to a specified product.

[1703] This invention relates to a method for providing a system that identifies products used by a favorite member (supported person) and allows users to easily purchase them. This system smoothly performs user authentication, obtains information about the supported person, displays detailed product information, checks inventory, and even suggests similar products if the item is out of stock.

[1704] Overall system configuration

[1705] This system consists of a user terminal, a server, a database, an external API, and an AI engine. The main steps are user authentication, acquisition of support information, display of detailed product information, inventory confirmation, and suggestion of similar products.

[1706] User Authentication

[1707] When a user launches the app, a login screen appears. The user enters the email address "example@example.com" and the password "password123" and presses the "Login" button.

[1708] The device sends the entered authentication information to the server by using an HTTP POST request to send the data to the server's authentication endpoint.

[1709] The server checks the received authentication information against the user data in its database, searches for the email address and password pair using a database query, and verifies whether they match. The authentication is successful or not based on the result of the check.

[1710] If authentication is successful, the server generates a redirect URL for the home screen along with an authentication success message and returns it to the device. If authentication fails, it returns an error message.

[1711] Acquisition of support information

[1712] The user clicks on the icon of a specific object of support (e.g., idol A) on the home screen.

[1713] The device obtains the ID of the selected target and sends a request for profile information to the server, specifically using an HTTP GET request.

[1714] The server retrieves profile information and related product lists from the database and uses database queries to extract the required information.

[1715] The server returns the acquired profile information and product list to the terminal.

[1716] Based on the received data, the device displays the profile page of the person being supported, along with a list of products.

[1717] Display detailed product information

[1718] A user clicks on a specific product (e.g., "lipstick") in the "Recently Purchased Items" section of their profile page.

[1719] The device obtains the ID of the product the user clicked on and sends a request for more information to the server, specifically using an HTTP GET request.

[1720] The server retrieves detailed information about the product (image, price, store link, etc.) from the database and extracts the required information using a database query.

[1721] The server returns the obtained detailed information to the terminal.

[1722] The terminal displays the product details page based on the received product details information.

[1723] Check product availability

[1724] The user presses the "Purchase" button on the product details page.

[1725] The device sends a purchase request to the server, specifically using an HTTP POST request.

[1726] The server calls an external API or database to check the product availability. For example, it calls an external API to get real-time inventory information.

[1727] server:

[1728] If the item is in stock, a link to the purchase page is generated and sent to the user's terminal.

[1729] If the item is out of stock, the system will notify you and proceed to search for similar items using an AI engine.

[1730] Based on the results of the inventory check, the terminal displays the purchase page if the item is in stock, and if not, displays "Out of stock" and starts the process of suggesting similar products.

[1731] Similar product suggestions

[1732] If a product is out of stock, the server uses an AI engine (e.g., a generative AI model) to search for similar products in the database. As a concrete example, the following prompt is input to the AI ​​engine:

[1733] Prompt: "Search our database for similar products for the product name 'Lipstick'."

[1734] The server returns a list of similar products found to the terminal.

[1735] The terminal displays the received list of similar products and allows the user to select from the suggested products.

[1736] The system is designed to help users identify and purchase the products they support through a step-by-step process, and even if an item is out of stock, it utilizes an AI engine to quickly suggest suitable similar products, increasing user satisfaction.

[1737] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1738] Step 1:

[1739] The user launches the app, enters the email address "example@example.com" and password "password123" on the login screen, and presses the "Login" button.

[1740] Input: Email address, password

[1741] Output: Authentication request

[1742] The terminal sends the entered authentication information to the server using an HTTP POST request.

[1743] Input: Authentication Request

[1744] Output: HTTP POST request to the server

[1745] The server checks the received credentials against the user data in its database, which involves running a database query to verify that the email address and password match.

[1746] Input: Credentials

[1747] Output: Matching result (authentication success or failure)

[1748] If the authentication is successful, the server generates a redirect URL for the home screen along with an authentication success message and returns it to the device. If the authentication is unsuccessful, it returns an error message.

[1749] Input: Matching result

[1750] Output: Authentication result (success or error)

[1751] The device receives the returned authentication result, and if the authentication is successful, it transitions to the home screen, and if it is unsuccessful, it displays an error message.

[1752] Input: Authentication result

[1753] Output: Home screen or error message

[1754] Step 2:

[1755] The user clicks on the icon of the object of their support (e.g., idol A) on the home screen.

[1756] Input: Icon click event

[1757] Output: Supported ID

[1758] The terminal sends the ID of the selected target to the server using an HTTP GET request.

[1759] Input: ID of the target

[1760] Output: HTTP GET request to the server

[1761] The server retrieves the profile information and associated product listings of the supported subjects from the database, which involves executing a database query to extract the profile information and product listings.

[1762] Input: ID of the target

[1763] Output: Profile information and related product list

[1764] The server returns the acquired profile information and a list of related products to the terminal.

[1765] Input: Profile information and related product list

[1766] Output: Data returned to the terminal

[1767] The terminal displays the profile page of the target of support and a list of related products based on the received data.

[1768] Input:Return data

[1769] Output: Profile page and product list

[1770] Step 3:

[1771] A user clicks on a specific product (e.g., "lipstick") in the "Recently Purchased Items" section on their profile page.

[1772] Input: Product click event

[1773] Output: Product ID

[1774] The terminal sends the ID of the product clicked by the user to the server using an HTTP GET request.

[1775] Input: Product ID

[1776] Output: HTTP GET request to the server

[1777] The server retrieves detailed information about the product (images, prices, store links, etc.) from the database. This involves executing a database query to extract the required data.

[1778] Input: Product ID

[1779] Output: Detailed information (images, prices, retailer links)

[1780] The server returns the acquired detailed information to the terminal.

[1781] Input:Detailed information

[1782] Output: Data returned to the terminal

[1783] The terminal displays a product detail page based on the received product detail information.

[1784] Input:Return data

[1785] Output: Product detail page display

[1786] Step 4:

[1787] The user presses the "Purchase" button on the product details page.

[1788] Input: Buy button click event

[1789] Output: Purchase request

[1790] The terminal sends a purchase request to the server using an HTTP POST request.

[1791] Input: Purchase Request

[1792] Output: HTTP POST request to the server

[1793] The server calls an external API or database to check product availability, for example, by sending an API request to get real-time inventory information.

[1794] Input: Purchase Request

[1795] Output: Inventory status data

[1796] If the product is in stock, the server generates a link to the purchase page and sends it to the user's device. If the product is out of stock, the server notifies the user that the product is out of stock and proceeds to the process of searching for similar products using an AI engine.

[1797] Input: Inventory status data

[1798] Output: Purchase link or out-of-stock notification

[1799] Based on the results of the inventory check, the terminal displays a purchase page if the item is in stock, and if not, displays "Out of stock" and starts the similar product suggestion process.

[1800] Input: Inventory check result

[1801] Output: Display of purchase page or out-of-stock notification

[1802] Step 5:

[1803] If a product is out of stock, the server uses an AI engine (e.g., a generative AI model) to search for similar products in the database. As a concrete example, the following prompt sentence is input to the AI ​​engine:

[1804] "\nPlease search our database for similar products with the product name 'Lipstick'."

[1805] Input: prompt statement

[1806] Output: Similar products list

[1807] The server returns a list of similar products found to the terminal.

[1808] Input: Similar products list

[1809] Output: Data returned to the terminal

[1810] The terminal displays the received list of similar products and allows the user to select from the suggested products.

[1811] Input:Return data

[1812] Output: Display similar products list

[1813] (Application example 1)

[1814] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1815] Today's users have a need to easily identify and purchase products used by their favorite idols. However, it is difficult to easily find detailed product information and stock status of their favorite idols, and to instantly find similar products. There is a need for a system that can solve these problems and allow users to enjoy shopping more comfortably.

[1816] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1817] In this invention, the server includes a user authentication means, a means for acquiring data on the favorite member, a means for displaying detailed information on products used by the favorite member, a means for checking product inventory, a means for suggesting similar products, a means for suggesting similar products using a generative AI model, and a means for generating prompt text and inputting it into the generative AI model. This allows users to identify products used by their favorite member and smoothly check inventory and purchase them. Furthermore, users can receive suggestions for similar products even if the product is out of stock, which increases user satisfaction.

[1818] "User authentication means" refers to a means for verifying that a user is a valid user when accessing a system.

[1819] The "means for obtaining data on the favorite member" is a means for obtaining profile information and a list of related products related to the favorite member from the database.

[1820] The "means for displaying detailed information about products used by a favorite member" is a means for displaying to a user detailed information about products used by a favorite member selected by the user.

[1821] A "means for checking product availability" is a means for checking whether a particular product is in stock using an external API or database.

[1822] The "means for suggesting similar products" is a means for suggesting other similar products to the user when there is insufficient stock.

[1823] "Means for suggesting similar products using a generative AI model" refers to means for using an artificial intelligence model to search for similar products to a specific product and suggest them to users.

[1824] "Means for generating prompt sentences and inputting them to a generative AI model" refers to means for generating prompt sentences containing appropriate questions or commands for a generative AI model and inputting them.

[1825] The present invention is a system that identifies products used by a favorite member and suggests similar products based on them. This system includes a user authentication means, a means for acquiring data on the favorite member, a means for displaying detailed information about the products used by the favorite member, a means for checking product stock status, a means for suggesting similar products, a means for suggesting similar products using a generative AI model, and a means for generating prompt sentences and inputting them into the generative AI model.

[1826] Overall system configuration

[1827] This system consists of a user terminal, a server, a database, an external API, and a generative AI model. The main steps are user authentication, obtaining information about the favorite member, displaying detailed product information, checking inventory, and suggesting similar products.

[1828] Hardware and software used

[1829] Frontend: Use React Native to create an application compatible with smartphones (iOS / Android).

[1830] Backend: Uses Node.js and Express.js as the server.

[1831] Database: Uses MySQL for data storage.

[1832] External API: Use the product inventory confirmation API.

[1833] Generative AI model: Uses TensorFlow to suggest similar products.

[1834] Details of each method and processing flow

[1835] 1. User authentication method:

[1836] The user opens the app and enters their email address and password on the login screen.

[1837] The information entered is sent to the server and checked against user data in a MySQL database.

[1838] If authentication is successful, you will be redirected to the home screen.

[1839] 2. How to get your favorite member's data:

[1840] When a user clicks on the icon of their favorite member on the home screen, the profile information of the favorite member and a list of related products are sent back to the device from the database via the server.

[1841] 3. How to view detailed information about products used by your favorite idol:

[1842] When a user selects a product on the profile page of their favorite member, detailed information about that product is requested from the server, retrieved from the database, and displayed.

[1843] 4. How to check product availability:

[1844] When the user presses the "Buy" button, stock availability is checked using an external API or database.

[1845] 5. Suggesting similar products:

[1846] If an item is out of stock, a generative AI model (TensorFlow) is used to suggest similar items.

[1847] The server generates prompt sentences based on information such as category, brand, and price range, and inputs them into the generative AI model.

[1848] Specific examples

[1849] For example, if a user selects a "lipstick" that "Favorite Member A" recently purchased and it's out of stock, the generative AI model will generate the following prompt:

[1850] Prompt: The lipstick that Oshime A recently purchased is out of stock. Please suggest five lipsticks from the same brand with similar features.

[1851] This prompt sentence is input into a generative AI model, and the results are sent back to the user's device to recommend similar products.

[1852] This system allows users to identify products used by their favorite idols, check stock availability, and purchase them smoothly. Furthermore, if an item is out of stock, users can receive suggestions for similar products, increasing user satisfaction.

[1853] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1854] Step 1:

[1855] The user opens the application and enters their email address and password on the login screen. This user input is sent to the server. The server verifies the user information in the MySQL database, and if authentication is successful, redirects them to the home screen. The input is the user's authentication information, and the output is the authentication result. Data processing and calculations involve verification of the user authentication information.

[1856] Step 2:

[1857] When a user clicks on an icon of their favorite member on the home screen, the selected information is sent as a request to the server. The server retrieves the member's profile information and a list of related products from the MySQL database and sends this back to the device. The input is the selected member's information, and the output is detailed data about the member. Data processing and calculation involves retrieving information from the database.

[1858] Step 3:

[1859] When a user clicks on a recently purchased item on the profile page of their favorite idol, a request is sent to the server for detailed information about that item. The server retrieves detailed information about the item (image, price, link to retail store, etc.) from the database and sends it back to the terminal. The input is the product selection information, and the output is detailed product information. Data processing and calculation involves retrieving detailed product information from the database.

[1860] Step 4:

[1861] When a user presses the "Purchase" button on a product detail page, the purchase request is sent to the server. The server calls an external API or database to check the product's stock status. The input is the purchase request and the output is the stock status. If the product is in stock, a link to the purchase page is generated and sent to the terminal. Data processing and calculations involve checking stock and generating the link.

[1862] Step 5:

[1863] If the item is out of stock, the server will use a generative AI model to begin the process of suggesting similar items. The server generates a prompt sentence and inputs this into the generative AI model. The input is the prompt sentence, and the output is a list of similar items. Data processing and calculations involve generating the prompt sentence and using the AI ​​model to search for similar items.

[1864] Step 6:

[1865] The server returns a list of similar products obtained from the generative AI model to the terminal. The terminal displays it, and the user can select from the suggested products. The input is a list of similar products, and the output is product information displayed to the user. Data processing and calculation involves displaying the output of the AI ​​model on the user's terminal.

[1866] As an example of a specific prompt sentence, we could generate the sentence, "The lipstick recently purchased by my favorite idol A is out of stock. Please suggest five lipsticks from the same brand with similar features." By inputting this into the generative AI model, it will search for and suggest similar products.

[1867] In this way, the specific actions and processing flow performed by the user, terminal, and server at each step are clearly defined. At each processing step, data processing and calculations are performed based on the input, and appropriate output is generated, realizing a system that allows users to easily identify and purchase products used by their favorite member.

[1868] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1869] The present invention combines an emotion engine with a system that identifies products used by favorite idols and allows users to easily purchase them, thereby providing specific product recommendations and promotions based on the user's emotions. The overall processing flow of the system and specific embodiments are described below.

[1870] Overall system configuration

[1871] This system consists of a user terminal, a server, a database, an external API, an AI engine, and an emotion engine. The main steps are user authentication, obtaining information about the favorite member, displaying detailed product information, checking inventory, suggesting similar products, and adjusting content based on user emotions.

[1872] User Authentication

[1873] User: When you open the app, the login screen appears. Enter your email address and password and press the "Login" button.

[1874] Terminal: Sends the entered authentication information to the server.

[1875] Server: Compares the received authentication information with the user data in the database and returns the authentication result. If authentication is successful, redirects the user to the home screen.

[1876] Obtaining information about your favorite member

[1877] User: Click on the icon of your favorite member on the home screen.

[1878] Device: Sends a request to the server to retrieve the profile information of the selected Oshimen.

[1879] Server: Retrieves the profile information of the favorite member and a list of related products from the database and returns them to the device.

[1880] Device: Based on the information obtained, the profile page of your favorite member will be displayed.

[1881] Display detailed product information

[1882] User: On their profile page, they click on a product listed in the "Recently Purchased" section.

[1883] Terminal: Sends a request to the server to obtain detailed information about the product.

[1884] Server: Retrieves detailed information about the product (image, price, link to store, etc.) from the database and sends it back to the device.

[1885] Device: Display the product details page based on the obtained product details.

[1886] Check product availability

[1887] User: Clicks the "Purchase" button on the product details page.

[1888] Device: Sends a purchase request to the server.

[1889] Server: Calls an external API or database to check product availability.

[1890] If in stock: Generate a link to the purchase page and send it to the user's device.

[1891] If out of stock: Notify the customer that the product is out of stock and proceed to the next step.

[1892] Device: Based on the results of the inventory check, if the item is in stock, the purchase page will be displayed; if it is out of stock, the message "Out of stock" will be displayed and the similar product suggestion process will be initiated.

[1893] Similar product suggestions

[1894] Server: If a product is out of stock, use the AI ​​engine to search for similar products from the database.

[1895] Server: Returns a list of similar products found to the device.

[1896] On your device: Displays a list of similar products, allowing the user to select from the suggested products and proceed with the purchase.

[1897] Content adjustment based on user sentiment

[1898] Terminal: Analyzes the user's facial expressions, voice, and text input, and recognizes the user's emotions using an emotion engine.

[1899] Server: Based on the recognized emotional information, adjust the display content of the means for acquiring data on the favorite member and the means for suggesting similar products.

[1900] For example, if the user is happy, the number of related product recommendations will be increased, and if the user is depressed, products and promotional content that will lift the user's spirits will be displayed.

[1901] Device: Display the adapted content to the user.

[1902] Specific examples

[1903] 1. The user opens the app and logs in by entering the email address "example@example.com" and the password "password123".

[1904] 2. The server receives this and checks it against the database, and if authentication is successful, displays the home screen.

[1905] 3. The user clicks on the icon of their favorite idol, "Idol A," on the home screen to view their profile information.

[1906] 4. The server retrieves "Idol A's" profile and a list of recently purchased items from the database and sends them back to the terminal.

[1907] 5. The user clicks on "Lipstick" to view more information.

[1908] 6. The server retrieves detailed information about the product from the database and returns it to the terminal.

[1909] 7. When the user presses the "Buy" button, the server checks stock availability.

[1910] 8. If the item is in stock, the purchase page will be displayed. If it is out of stock, the AI ​​engine will search for similar products and display them on the device.

[1911] 9. The device captures the user's facial expressions with a camera, and the emotion engine analyzes the user's emotions.

[1912] 10. Based on the analyzed emotions, the server selects appropriate products and promotions and displays them on the device.

[1913] For example, if the user is happy, the number of products related to "Idol A" will be increased, and if the user is depressed, promotional products that will lift the user's spirits will be displayed.

[1914] In this way, this system is designed to identify products used by users' favorite idols and facilitate smooth purchases. Furthermore, by utilizing an emotion engine, it can suggest individual content according to the user's emotional state, further increasing user satisfaction.

[1915] The processing flow will be explained below.

[1916] Step 1:

[1917] User: Opens the app, displays the login screen, enters email address and password, and presses the "Login" button.

[1918] Step 2:

[1919] Terminal: Sends the entered authentication information (email address and password) to the server in JSON format.

[1920] Step 3:

[1921] Server: Checks the received authentication information against the user information in the database. If successful, returns a response indicating successful authentication and starts a login session. If unsuccessful, returns an error message.

[1922] Step 4:

[1923] Terminal: Receives the authentication result from the server, and if login is successful, redirects to the home screen, otherwise displays an error message.

[1924] Step 5:

[1925] User: Click on your favorite member's icon on the home screen.

[1926] Step 6:

[1927] Device: Sends a request to the server to get data on the selected Oshimen.

[1928] Step 7:

[1929] Server: Retrieves the profile information of the favorite member and a list of related products from the database and returns them to the device.

[1930] Step 8:

[1931] Device: Displays your favorite member's profile information and a list of related products on the screen.

[1932] Step 9:

[1933] User: On their profile page, they click on a product listed under "Recently Purchased Items."

[1934] Step 10:

[1935] Terminal: Sends a request to the server to obtain detailed information about the product.

[1936] Step 11:

[1937] Server: Retrieves detailed information about the product (image, price, link to store, etc.) from the database and sends it back to the device.

[1938] Step 12:

[1939] Terminal: Display detailed product information on the screen.

[1940] Step 13:

[1941] User: Clicks the "Purchase" button on the product details page.

[1942] Step 14:

[1943] Device: Sends a purchase request to the server.

[1944] Step 15:

[1945] Server: Calls an external API or database to check product availability.

[1946] If the item is in stock, a link to the purchase page is generated and sent to the device.

[1947] If the item is out of stock, the system notifies the user that the item is out of stock and proceeds to the next step.

[1948] Step 16:

[1949] Terminal: Receives the stock check result and displays the purchase page if the item is in stock, or displays "Out of stock" if the item is out of stock and starts the similar product suggestion process.

[1950] Step 17:

[1951] Server: Uses an AI engine to search the database for similar products to the missing item.

[1952] Step 18:

[1953] Server: Returns a list of similar products found to the device.

[1954] Step 19:

[1955] On your device: Displays a list of similar products, allowing the user to select from the suggested products and proceed with the purchase.

[1956] Step 20:

[1957] User: Selects a product from the list of similar products and clicks the purchase button.

[1958] Step 21:

[1959] Terminal: Sends a similar product purchase request to the server.

[1960] Step 22:

[1961] Server: Checks the stock status and availability of similar products and returns the results to the terminal.

[1962] Step 23:

[1963] Device: Display a purchase completion screen to the user.

[1964] Step 24:

[1965] Terminal: Analyzes the user's facial expressions, voice, and text input, and recognizes the user's emotions using an emotion engine.

[1966] Step 25:

[1967] Server: Based on the recognized emotional information, adjust the display content of the means for acquiring data on the favorite member and the means for suggesting similar products.

[1968] For example, if the user is happy, the number of related product recommendations will be increased, and if the user is depressed, products and promotional content that will lift the user's spirits will be displayed.

[1969] Step 26:

[1970] Device: Display the adapted content to the user.

[1971] Specific examples

[1972] 1. The user opens the app and logs in by entering the email address "example@example.com" and the password "password123".

[1973] 2. The server receives this and checks it against the database, and if authentication is successful, displays the home screen.

[1974] 3. The user clicks on the icon of their favorite idol, "Idol A," on the home screen to view their profile information.

[1975] 4. The server retrieves "Idol A's" profile and a list of recently purchased items from the database and sends them back to the terminal.

[1976] 5. The user clicks on "Lipstick" to view more information.

[1977] 6. The server retrieves detailed information about the product from the database and returns it to the terminal.

[1978] 7. When the user presses the "Buy" button, the server checks stock availability.

[1979] 8. If the item is in stock, the purchase page will be displayed. If it is out of stock, the AI ​​engine will search for similar products and display them on the device.

[1980] 9. The device captures the user's facial expressions with a camera, and the emotion engine analyzes the user's emotions.

[1981] 10. Based on the analyzed emotions, the server selects appropriate products and promotions and displays them on the device.

[1982] For example, if the user is happy, the number of products related to "Idol A" will be increased, and if the user is depressed, promotional products that will lift the user's spirits will be displayed.

[1983] Example 2

[1984] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1985] In today's world, users want to easily identify and purchase products used by their favorite idols. However, conventional systems make the product identification and purchase process cumbersome and time-consuming for users. Furthermore, product recommendations and promotions are not tailored to the user's emotions, making it difficult to improve personalized satisfaction.

[1986] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a user authentication means, a means for acquiring data on the favorite member, a means for displaying detailed information on products used by the favorite member, a means for checking product inventory, a means for suggesting similar products, a means for acquiring and analyzing emotion data, and a means for adjusting content based on the user's emotion. This allows the user to smoothly identify and purchase products used by the favorite member, and also provides individual content according to the user's emotional state, thereby improving satisfaction.

[1987] "User authentication means" refers to a means for processing and authenticating authentication information such as an email address and password used when a user accesses the system.

[1988] "Means for obtaining data on a favorite member" refers to means for obtaining profile information and related product information of a target person (favorite member) from the database within the system.

[1989] The "means for displaying detailed information about the product used by the favorite member" is a means for displaying detailed information such as an image, price, and link to a store selling the product selected by the user.

[1990] "Means for checking product availability" refers to means for checking the availability of selected products using an external API or database.

[1991] "Means for suggesting similar products" refers to a means for using an AI engine to search for similar products from a database and suggest them to users when an item is out of stock.

[1992] The "means for acquiring and analyzing emotional data" refers to a means for recognizing the emotional state of a user by analyzing the user's facial expressions, voice, and text input.

[1993] The "means for adjusting content based on user emotion" refers to a means for individually adjusting displayed products and promotional content based on recognized user emotion information.

[1994] The present invention combines an emotion engine with a system that identifies products used by a specific idol and allows users to easily purchase them, thereby providing specific product recommendations and promotions based on the user's emotions. The overall processing flow of the system and specific embodiments are described below.

[1995] This system consists of a user terminal, a server, a database, an external API, an AI engine, and an emotion engine. The main steps are user authentication, obtaining information about the favorite member, displaying detailed product information, checking inventory, suggesting similar products, and adjusting content based on user emotions.

[1996] User Authentication

[1997] User: When the app is opened, the login screen appears, the user enters their email address and password, and presses the "Login" button.

[1998] Terminal: Sends the entered authentication information to the server using the HTTPS protocol.

[1999] Server: Compares the received authentication information with the user data in the database and returns the authentication result. If authentication is successful, redirects the user to the home screen.

[2000] Obtaining information about your favorite member

[2001] User: Click on the icon of your favorite member on the home screen.

[2002] Device: Sends a request to the server to retrieve the profile information of the selected Oshimen.

[2003] Server: Retrieves the profile information of the favorite member and a list of related products from the database and returns them to the device.

[2004] Device: Display your favorite member's profile page based on the information obtained.

[2005] Display detailed product information

[2006] User: On their profile page, they click on a product listed in the "Recently Purchased" section.

[2007] Terminal: Sends a request to the server to obtain detailed information about the product.

[2008] Server: Retrieves detailed information about the product (image, price, link to store, etc.) from the database and sends it back to the device.

[2009] Device: Display the product details page based on the obtained product details.

[2010] Check product availability

[2011] User: Clicks the "Purchase" button on the product details page.

[2012] Device: Sends a purchase request to the server.

[2013] Server: Calls an external API or database to check the product's availability. If the product is in stock, generates a link to the purchase page and sends it to the user's device. If the product is out of stock, notifies the user that the product is out of stock and proceeds to the next step.

[2014] Device: Based on the results of the inventory check, if the item is in stock, the purchase page will be displayed; if it is out of stock, the message "Out of stock" will be displayed and the similar product suggestion process will be initiated.

[2015] Similar product suggestions

[2016] Server: If a product is out of stock, use the AI ​​engine to search for similar products from the database.

[2017] Server: Returns a list of similar products found to the device.

[2018] On your device: Displays a list of similar products, allowing the user to select from the suggested products and proceed with the purchase.

[2019] Content adjustment based on user sentiment

[2020] Terminal: Analyzes the user's facial expressions, voice, and text input, and recognizes the user's emotions using an emotion engine.

[2021] Server: Based on the recognized emotion information, the server adjusts the display content of the means for acquiring data on the favorite member and the means for suggesting similar products. For example, if the user is happy, the server increases the number of related product recommendations, and if the user is depressed, the server displays products and promotional content that will lift the user's spirits.

[2022] Device: Display the adapted content to the user.

[2023] Specific examples

[2024] 1. The user opens the app and logs in by entering the email address "example@example.com" and the password "password123".

[2025] 2. The server receives this and checks it against the database, and if authentication is successful, displays the home screen.

[2026] 3. Users click on their favorite member's icon on the home screen to view their profile information and a list of recently purchased items.

[2027] 4. The server retrieves the profile of the favorite member and detailed information about related products from the database and sends them to the terminal.

[2028] 5. The user clicks on the displayed product to view more information.

[2029] 6. The server retrieves detailed information about the product from the database and returns it to the terminal.

[2030] 7. When the user presses the "Buy" button, the server checks stock availability.

[2031] 8. If the item is in stock, the purchase page will be displayed. If it is out of stock, the AI ​​engine will search for similar products and display them on the device.

[2032] 9. The device captures the user's facial expressions with a camera, and the emotion engine analyzes the user's emotions.

[2033] 10. The server selects appropriate products and promotions based on the analyzed emotions and displays them on the device. For example, if the user is happy, it will increase the number of related products, and if the user is depressed, it will display products that will lift their spirits.

[2034] In this way, this system is designed to identify products used by users' favorite idols and facilitate smooth purchases. Furthermore, by utilizing the emotion engine, it can suggest individual content according to the user's emotional state, further increasing user satisfaction.

[2035] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2036] Step 1: User authentication

[2037] Enter your email address and password

[2038] process:

[2039] User: When you open the app, the login screen will appear. Enter your email address and password and press the "Login" button.

[2040] Terminal: The entered authentication information is sent to the server via the HTTPS protocol.

[2041] Server: Checks the received credentials against the user data in the database using the hashed password.

[2042] Output: Authentication result (success or failure)

[2043] Specific operation:

[2044] If authentication is successful, the server generates a user ID and session information and returns it to the device, redirecting it to the home screen. If authentication fails, an error message is returned to the device, and the login screen is displayed again.

[2045] Step 2: Obtaining information about your favorite member

[2046] Input: Select your favorite member's icon

[2047] process:

[2048] User: Click on the icon of your favorite member on the home screen.

[2049] Device: Send a request to the server containing the ID of the selected member.

[2050] Server: Retrieves the profile information of the favorite member and the related product list from the database. Executes queries to extract relevant data.

[2051] Output: Profile information of your favorite member and related product list

[2052] Specific operation:

[2053] The server returns the acquired data in JSON format to the device, and the device displays the profile page of the favorite member.

[2054] Step 3: Display detailed product information

[2055] Input: Select product

[2056] process:

[2057] User: On their profile page, they click on a product listed in the "Recently Purchased" section.

[2058] Device: Sends a request to the server containing the ID of the selected item.

[2059] Server: Retrieves detailed product information (images, prices, store links, etc.) from the database and executes a database query.

[2060] Output: Product details

[2061] Specific operation:

[2062] The server returns the acquired data in JSON format to the terminal, and the terminal displays the product details page.

[2063] Step 4: Check product availability

[2064] Input: Purchase Request

[2065] process:

[2066] User: Clicks the "Purchase" button on the product details page.

[2067] Device: Sends a purchase request to the server, including the ID of the selected item.

[2068] Server: Calls an external API or database to check product availability and executes an inventory query.

[2069] Output: Stock check result (in stock / out of stock)

[2070] Specific operation:

[2071] If the item is in stock, the server generates a link to the purchase page and sends it to the user's device. If the item is out of stock, the server notifies the user that the item is out of stock.

[2072] Step 5: Suggest similar products

[2073] Input: Out-of-stock notification

[2074] process:

[2075] Server: If a product is out of stock, the AI ​​engine is used to search for similar products in the database. The AI ​​engine calculates the features of similar products and lists the most similar products.

[2076] Server: Returns a list of similar products found to the device.

[2077] Output: A list of similar products

[2078] Specific operation:

[2079] The server returns the acquired data in JSON format to the terminal, which then displays a list of similar products.

[2080] Step 6: Adjust content based on user sentiment

[2081] Input: Emotion data (facial expressions, voice, text input)

[2082] process:

[2083] Device: Uses a camera and microphone to capture the user's facial expressions, voice, and text.

[2084] On the device: Analyzes emotion data using an emotion engine (e.g., EmotionAPI) to recognize the user's emotional state.

[2085] Server: Based on the recognized emotion information, the server adjusts the display content of the means for acquiring data on the favorite member and the means for suggesting similar products. For example, if the user is happy, the server increases the number of related product recommendations, and if the user is depressed, the server displays products and promotional content that will lift the user's spirits.

[2086] Output: Adjusted content

[2087] Specific operation:

[2088] The adjusted content is sent back to the device in JSON format and displayed on the device. Specifically, if the user is happy, more products related to the favorite idol will be displayed, and if the user is depressed, cheering messages and items to lift their spirits will be displayed.

[2089] (Application example 2)

[2090] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2091] Current mail-order sales systems are insufficient in supporting users to identify and easily purchase products used by their favorite idols. They also lack mechanisms for product recommendations and promotions based on users' emotions. Therefore, the challenge is to efficiently provide appropriate products that correspond to users' interests and emotions and increase their purchasing motivation.

[2092] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[2093] In this invention, the server includes a user authentication means, a means for acquiring data on the favorite member, a means for displaying detailed information on products used by the favorite member, a means for checking product stock status, a means for suggesting similar products, an emotion analysis means for analyzing the user's facial expressions and voice to recognize their emotions, and an emotion-responsive display means for adjusting the display content based on the recognized emotions. This not only allows users to easily identify and purchase products used by their favorite member, but also provides products and promotions that correspond to their emotions, enabling a more fulfilling shopping experience.

[2094] "User authentication means" is a function for verifying the identity of a user when accessing the system.

[2095] "Means for obtaining data on a favorite member" refers to a function for obtaining profile information and related product information of a specific person (favorite member) from a database.

[2096] "Means for displaying detailed information about products used by the favorite member" is a function for presenting detailed information (images, prices, retailer information, etc.) about products used by the favorite member to the user.

[2097] "Means for checking product inventory status" refers to a function for checking the inventory status of a specific product via an external API or database.

[2098] The "means for suggesting similar products" is a function for recommending other related products when there is a shortage of stock or based on the user's interests.

[2099] The "emotion analysis means for recognizing emotions by analyzing the user's facial expressions and voice" is an analysis function for detecting the user's emotional state based on the user's facial image and voice data.

[2100] The "emotion-responsive display means for adjusting display content based on recognized emotions" is a function for dynamically changing displayed products and promotional content in consideration of the results of emotion analysis.

[2101] The present invention combines an emotion engine with a system that allows users to identify and easily purchase products used by their favorite idols, providing specific product recommendations and promotions based on the user's emotions. This system includes a user authentication means, a means for acquiring data on the favorite idol, a means for displaying detailed information about products used by the favorite idol, a means for checking product inventory, a means for suggesting similar products, an emotion analysis means for analyzing the user's facial expressions and voice to recognize emotions, and an emotion-responsive display means for adjusting the display content based on the recognized emotions. Specific embodiments of this system are described below.

[2102] First, an application is installed on the user's device. This application has a login screen for user authentication, an interface for acquiring data on the favorite member, a page for displaying detailed product information, a function for checking stock availability, a function for suggesting similar products, and a camera and voice analysis function for analyzing the user's emotions.

[2103] The server has the following main functions. The user authentication means is a function that collates the authentication information entered by the user with the database and returns the authentication result. The means of obtaining data on the favorite member is a function that obtains the favorite member's profile information and related product list from the database. The means of displaying detailed product information is a function that obtains detailed information on the relevant product from the database and sends it to the user's device. The means of checking product stock status is a function that checks the product stock status using an external API or database. The means of suggesting similar products is a function that uses an AI engine to search for similar products from the database if they are out of stock and sends them to the user's device.

[2104] Furthermore, the emotion analysis means for analyzing the user's emotions uses the camera function and the voice analysis function to analyze the user's facial expressions and voice and recognize the emotions. The emotion-responsive display means for adjusting the display content based on the recognized emotions adjusts the display content of the favorite member data acquisition means and the similar product suggestion means based on the results of the emotion analysis.

[2105] In a specific example, the user's facial expression is analyzed using the camera on their smartphone. For example, if the user is happy, related products are increased, and if the user is depressed, promotional content that will lift their spirits is displayed. This analysis uses technologies such as OpenCV face detection and Keras emotion analysis models.

[2106] Examples of prompt sentences include the following:

[2107] Develop a mail-order application that captures the user's facial expressions with a camera, analyzes their emotions in real time, and displays products and promotional information based on their emotional state. The technologies used will be face detection using OpenCV and emotion analysis using Keras. Also, include a function to obtain images of the user's facial expressions using an API request.

[2108] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2109] Step 1:

[2110] A user opens the application, enters their email address and password on the login screen, and presses the "Login" button. The device sends the entered authentication information to the server. The server compares the received authentication information with the user data in the database and returns the authentication result. If the authentication is successful, the device redirects to the home screen. In this step, the input is the user's authentication information (email address and password), and the output is the display of the home screen or an authentication failure message.

[2111] Step 2:

[2112] The user clicks on the icon of their favorite member on the home screen. The device sends a request to the server to obtain the profile information of the selected favorite member. The server retrieves the favorite member's profile information and related product list from the database and returns them to the device. The device displays the favorite member's profile page based on the retrieved information. In this step, the input is the selection of the favorite member, and the output is the display of the favorite member's profile information and related product list.

[2113] Step 3:

[2114] The user clicks on a product displayed in the "Recently Purchased Products" section on the profile page. The device sends a request to the server to obtain detailed information about the product. The server retrieves detailed information about the product (image, price, link to retail store, etc.) from the database and sends it back to the device. The device displays the product detail page based on the retrieved detailed information. In this step, the input is the product selection, and the output is the display of detailed product information.

[2115] Step 4:

[2116] The user presses the "Purchase" button on the product details page. The terminal sends a purchase request to the server. The server calls an external API or database to check the product's stock status. If the product is in stock, the server generates a link to the purchase page and sends it to the terminal. If the product is out of stock, the server notifies the terminal that the product is out of stock and proceeds to the next step. Based on the stock check results, the terminal displays the purchase page if the product is in stock, or displays "Out of stock" if it is out of stock, and starts the similar product suggestion process. In this st...

Claims

1. User authentication means; How to obtain data on your favorite members, A means to display detailed information about the products used by the favorite members, A way to check product availability, A means of suggesting similar products; A system including:

2. 2. The system according to claim 1, wherein the means for acquiring the data on the favorite member acquires the profile information of the favorite member and a list of related products from a database.

3. The system according to claim 1 , wherein the means for checking inventory status checks the inventory status of the product using an external API or database.

4. The system according to claim 1, wherein the means for suggesting similar products uses an AI engine to search for similar products from a database.

Images