System

Abstract

A system is provided.SOLUTION: The system includes a means for inputting commodity information desired to be purchased by a user, a means for collecting store price information and storing it in a database, a means for collecting net shopping price information, a means for integrating the store price information and the net shopping price information and specifying the lowest price, a means for displaying the lowest price information to a user, and a means for displaying the position of a store on a map based on the store information.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] As society evolves, consumers want to purchase the products they need cheaply and efficiently to meet their increasingly diverse needs. However, it is a time-consuming task for consumers to compare prices at each store one by one to find the lowest priced product. This becomes even more complicated when prices on online shopping sites are also included in the comparison. A system that can solve this price comparison problem is needed. [Means for solving the problem]

[0005] The present invention provides a system that allows consumers to efficiently obtain information on the cheapest products. This system includes a means for users to input information on products they wish to purchase. It also includes a means for collecting store price information and saving it in a database, and a means for collecting online shopping price information. This provides a means for integrating store price information and online shopping price information to identify the cheapest price. It also includes a means for displaying the cheapest price information to the user, and a means for displaying the location of stores on a map based on the store information. In this way, users can find the cheapest products without any hassle.

[0006] "User" refers to a consumer who uses the system to search for purchasing information.

[0007] "Product information" refers to detailed information about the product that the user wishes to purchase, such as the product name and category.

[0008] "Means" refers to a device or method for performing a particular function or role.

[0009] "Store" refers to a physical sales location where products are actually sold.

[0010] "Price Information" refers to data regarding the selling price for a particular product.

[0011] "Database" refers to a structured collection of data that allows for efficient storage and management of price and product information within a system.

[0012] "Online shopping" refers to websites and platforms that sell products online.

[0013] "API" stands for Application Program Interface, a set of definitions and protocols that allow different systems and software to communicate with each other.

[0014] "Integration" refers to bringing together information obtained from different data sources and processing it comprehensively.

[0015] "Displaying on a map" refers to visually showing a specific location or location information on a digital map.

[0016] "Price comparison" refers to the act of comparing prices across different sales outlets and platforms to find the cheapest deal. [Brief explanation of the drawings]

[0017] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0018] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0019] First, the terms used in the following description will be explained.

[0020] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0021] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0022] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0023] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0025] [First embodiment]

[0026] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0027] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0028] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0029] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0030] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0032] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0033] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0034] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0035] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0036] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0037] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0038] A system for carrying out the present invention provides information that enables a user to purchase a desired product efficiently and at the lowest possible price. An embodiment of the system will be described in detail below.

[0039] Data collection

[0040] server

[0041] The server periodically collects price information and flyer data provided by each store and stores it in a database. At this time, the server sends an API request to each store's endpoint, formats the acquired data, and stores it in the database. For example, the server sends a request to the API endpoint of "Store A," acquires price information for "Milk," "Condiments," and "Rice," and stores it in the database.

[0042] Receiving a user request

[0043] User

[0044] Users input the items they wish to purchase through a dedicated smartphone app or web interface. For example, a user might input "milk, seasonings, and rice." This information is then sent to the server via the device.

[0045] Terminal

[0046] After receiving the user's input, the terminal sends the information to the server, which then searches for product price information based on the received information.

[0047] Database search

[0048] server

[0049] The server searches the database for price information based on the user request it receives, finds the cheapest product, and aggregates that information. For example, the server extracts the price information for "milk" from the database and identifies the store that sells it at the cheapest price.

[0050] Price comparison with online shopping

[0051] server

[0052] The server also collects price information from online shopping sites to compare with the store's price information, using the API of each online shopping site, and combines the obtained online price information with the store's price information to determine the most cost-effective option for the user.

[0053] Integration and display of results

[0054] server

[0055] The server integrates store and online shopping data to identify the cheapest price for the user. It then sends the results to the user's device. For example, the cheapest "milk" is "Store X," which costs 100 yen.

[0056] Terminal

[0057] The terminal displays the results received from the server to the user. Specifically, it displays the product price information, the name of the store where the product can be purchased, and a link to the online shopping site. For example, it displays information such as "Milk: 100 yen at store X, 105 yen at online shopping site Y."

[0058] Display on the map

[0059] Terminal

[0060] The device displays a marker on a map based on the store's location information, allowing the user to easily access the nearest store. For example, when a user selects "Store X," the location of "Store X" is displayed on a map and a navigation function is provided.

[0061] Specific examples

[0062] For example, if a user searches for "milk, seasonings, rice," the system will provide information in the following order:

[0063] 1. The user enters "milk, seasonings, rice" into the app and submits a request.

[0064] 2. The server searches the database for the cheapest "milk, seasonings, and rice" and aggregates the results.

[0065] 3. The server uses the API of an online shopping site to collect price information about similar products.

[0066] 4. The server aggregates in-store and online pricing information to identify the cheapest option.

[0067] 5. The server sends the results to the user's device.

[0068] 6. The device displays the results to the user and shows the store's location on a map.

[0069] In this way, users can quickly and efficiently find the cheapest products. This system significantly reduces the effort required by consumers and provides a convenient and cost-effective shopping experience.

[0070] The processing flow will be explained below.

[0071] Step 1:

[0072] The server periodically sends requests to each store's API endpoint to obtain the latest price information and flyer data. The obtained data is formatted and stored in a database. For example, price information for "milk," "seasonings," and "rice" is obtained from "Store A" and stored in the database.

[0073] Step 2:

[0074] The user enters the product information they wish to purchase through a dedicated smartphone app or web interface. For example, the user might enter "milk, seasonings, and rice."

[0075] Step 3:

[0076] The device receives the user's input and sends the information to the server. For example, it sends a request for "milk, seasonings, and rice" in JSON format to the server.

[0077] Step 4:

[0078] The server receives the user's request and searches for the corresponding product information in the database, for example, searching for the price information for "milk" and identifying the store with the cheapest price.

[0079] Step 5:

[0080] The server uses the API of an online shopping site to collect price information for the same products. For example, it sends a request to the API endpoint of Amazon or Rakuten to obtain price information for "milk," "seasoning," and "rice."

[0081] Step 6:

[0082] The server compares and integrates price information obtained from stores with price information obtained from online shopping. For example, it compares "Milk at Store A for 100 yen" with "Milk at Amazon for 105 yen" and selects the store where the price is 100 yen.

[0083] Step 7:

[0084] The server sends the integrated results to the user's device. For example, it sends information such as "Milk: 100 yen at store A, seasoning: 200 yen at store B, rice: 300 yen at store C."

[0085] Step 8:

[0086] The terminal displays the results received from the server to the user. Specifically, it displays product price information, the name of the store where the product can be purchased, a link to the online shopping site, etc. For example, it displays "Milk: 100 yen at store A - Address: XX" or "Condiment: 200 yen at store B - Address: XX".

[0087] Step 9:

[0088] The device displays the nearest store on a map based on the store's location information. The user can refer to the map to confirm the store's location. The device also uses the navigation function to display the route to the store. For example, a marker for "Store A" is displayed on the map, and route guidance is provided.

[0089] This allows users to quickly and efficiently find the cheapest products and also check the store's location on a map.

[0090] Example 1

[0091] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0092] In the past, in order to efficiently purchase the product they wanted at the lowest price, users had to check multiple stores and online sales sites individually, which required a lot of time and effort.It was also difficult to compare prices in real time, making it difficult to find the best option.

[0093] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0094] In this invention, the server includes means for a user to input information about a product they wish to purchase, means for collecting price information from retail stores and saving it in a database, means for collecting price information from online sales sites, means for integrating the price information from retail stores and the price information from online sales sites to identify the cheapest price, means for displaying the cheapest price information to the user, and means for displaying the locations of retail stores on a map based on the retail store information, thereby enabling users to efficiently find the cheapest products.

[0095] "User" refers to a consumer who uses this system to input information about a product they wish to purchase.

[0096] "Means for inputting product information for purchase" refers to an interface that allows users to input the products they wish to purchase via a smartphone app or web interface.

[0097] "Sales store" refers to a physical store that actually sells products.

[0098] "Means of collecting price information and storing it in a database" refers to a system for obtaining price information from retail stores using an API or other means and storing it in a database.

[0099] "Online Sales Site" means a website that sells products over the Internet.

[0100] "Means of collecting price information" refers to a system for obtaining price information from online sales sites using APIs, etc.

[0101] "Means for integrating price information and identifying the lowest price" refers to an algorithm or process for integrating price information obtained from retail stores and online retail sites to identify the product with the lowest price for the user.

[0102] The "means for displaying the lowest price information" refers to an interface for visually displaying to the user the product information with the lowest price from the integrated price information.

[0103] "Means for displaying the location of a retail store on a map based on retail store information" refers to a function for displaying the location of a retail store on a map based on its location information and providing it visually to the user.

[0104] The present invention is a system that provides information to help users purchase desired products efficiently and at the lowest possible price. This system consists of three main components: the user, the terminal, and the server.

[0105] Data collection

[0106] server

[0107] The server periodically collects price information and flyer data provided by retail stores and online retail sites and stores it in a database. Specifically, the server uses an API to send requests to each store's endpoint, formats the retrieved data, and stores it in the database. For example, the server sends a request to the API endpoint of "Store A" to retrieve price information for "Milk," "Condiments," and "Rice," and stores the information in the database.

[0108] Receiving a user request

[0109] User

[0110] Users input the items they wish to purchase through a dedicated smartphone app or web interface. For example, a user might input "milk, seasonings, and rice." This information is then sent to the server via the device.

[0111] Terminal

[0112] After receiving the user's input, the terminal transmits the information to the server. Specifically, the terminal transmits a request including the input data to the server using the HTTPS protocol.

[0113] Database search

[0114] server

[0115] The server searches the database for price information based on the received user request, finds the cheapest product, and aggregates that information. For example, the server extracts the price information for "milk" from the database and identifies the store that sells it at the cheapest price.

[0116] Price comparison with online shopping

[0117] server

[0118] The server also collects price information from online retailers to compare with the retailer's price information, using the API of each online retailer. The server then combines the obtained online price information with the retailer's price information to determine the most cost-effective option for the user.

[0119] Integration and display of results

[0120] server

[0121] The server aggregates data from retail stores and online retail sites to identify the cheapest price for the user. It then sends the results to the user's device. For example, the cheapest "milk" is "Store X," which costs 100 yen.

[0122] Terminal

[0123] The device displays the results received from the server to the user. Specifically, it displays the product price information, the name of the store where the product can be purchased, and a link to the online shopping site. For example, it displays information such as "Milk: 100 yen at store X, 105 yen at online shopping site Y."

[0124] Display on the map

[0125] Terminal

[0126] The device displays a marker on a map based on the store's location information, allowing users to easily access the nearest store. For example, when a user selects "Store X," the device displays the location of "Store X" on a map and provides navigation functionality.

[0127] Specific examples

[0128] For example, if a user searches for "milk, seasonings, rice," the system will provide information in the following order:

[0129] 1. The user enters "milk, seasonings, rice" into the app and submits a request.

[0130] 2. The server searches the database for the cheapest "milk, seasonings, and rice" and aggregates the results.

[0131] 3. The server uses the API of an online retailer to collect price information about similar products.

[0132] 4. The server aggregates in-store and online pricing information to identify the cheapest option.

[0133] 5. The server sends the results to the user's device.

[0134] 6. The device displays the results to the user and shows the store's location on a map.

[0135] In this way, users can quickly and efficiently find the cheapest products. This system significantly reduces the effort required by consumers and provides a convenient and cost-effective shopping experience.

[0136] Example prompts for generative AI models

[0137] Below are some example prompts to input to the generative AI model:

[0138] "Get information on retail stores and online shops that offer the lowest prices on a particular product"

[0139] "Explain how you would collect price information for milk, condiments, and rice, and then perform a comparative analysis to present the cheapest options."

[0140] This allows the generative AI model to explain the entire process, from how data is collected to how the results are displayed.

[0141] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0142] Step 1: Send a request to collect data and get a response

[0143] server

[0144] The server sends a request to an API endpoint to collect price information from retail stores and online retail sites. For example, a request is sent to the endpoint of "Store A" requesting price information for "Milk," "Condiments," and "Rice." The data returned as a response is received in JSON format. This data includes information such as the product name, price, store name, and update date and time.

[0145] Input: API endpoint and request parameters (product name)

[0146] Output: Price information in JSON format

[0147] Specific behavior:

[0148] 1. The server generates an HTTP request and sends it to the API endpoint.

[0149] 2. Receive a response in JSON format from the API endpoint.

[0150] 3. Parse the received JSON data and extract the necessary information.

[0151] Step 2: Saving to the database

[0152] server

[0153] The server formats the acquired price information and saves it in the database. Information such as product name, price, store name, and update date and time is inserted or updated in the corresponding table according to the database structure.

[0154] Input: Price information in JSON format

[0155] Output: Price information stored in a database

[0156] Specific behavior:

[0157] 1. Extract product name, price, store name, and update date and time from JSON data.

[0158] 2. Connect to the database and generate and execute SQL queries to insert or update data into the appropriate tables.

[0159] Step 3: Enter the product you want to purchase

[0160] User

[0161] Using a dedicated smartphone app or web interface, users input information about the products they wish to purchase. For example, they might enter "milk, seasonings, and rice" and press the search button. This information is then sent to the server via the user's device.

[0162] Input: Product information you wish to purchase (user input)

[0163] Output: User request data

[0164] Specific behavior:

[0165] 1. The user enters the product information they wish to purchase into the app's search bar.

[0166] 2. The input data is sent to the server via the terminal.

[0167] Step 4: Sending the user request to the server

[0168] Terminal

[0169] The terminal transmits the user's input data to the server. Specifically, the terminal transmits the user's request data to the server using the HTTPS protocol.

[0170] Input: User request data

[0171] Output: Request sent to server

[0172] Specific behavior:

[0173] 1. Generate an HTTP request containing the user's request data.

[0174] 2. Send the generated request to the server using the HTTPS protocol.

[0175] Step 5: Retrieve price information from the database

[0176] server

[0177] The server searches the database for price information based on the user's request. Specifically, it searches for price information for product names such as "milk," "seasoning," and "rice" to find the cheapest product.

[0178] Input: User request data

[0179] Output: The product with the lowest price

[0180] Specific behavior:

[0181] 1. Generate an SQL query based on the user request.

[0182] 2. Query the database and retrieve the results.

[0183] 3. Extract and list the product information with the lowest price.

[0184] Step 6: Collect price information from online shopping sites

[0185] server

[0186] The server collects price information from the API of an online sales site. For example, it sends a request to the API of "Online Shop B" to obtain price information for "milk, seasonings, and rice." The obtained data is formatted and stored in a temporary data store.

[0187] Input: Online API endpoint and request parameters

[0188] Output: Online price information in JSON format

[0189] Specific behavior:

[0190] 1. The server sends a request to the online retailer's API.

[0191] 2. Receive the acquired online price information in JSON format.

[0192] 3. Parse the JSON data and save it to a temporary data store.

[0193] Step 7: Consolidate and compare pricing information

[0194] server

[0195] The server combines the price information from retail stores and online retailers to identify the lowest prices, comparing both sets of data and calculating the lowest price for each product.

[0196] Input: Retail store and online pricing information

[0197] Output: Identify and list the cheapest options

[0198] Specific behavior:

[0199] 1. Convert pricing information from retail stores and online retail sites into a unified format.

[0200] 2. Compare the prices of each item and identify the cheapest option.

[0201] 3. List the cheapest results.

[0202] Step 8: Generate and submit results

[0203] server

[0204] The server identifies the cheapest product price and its source, then sends the results to the user's device, formatting the results in JSON format and sending them as a response.

[0205] Input: List of cheapest options

[0206] Output: JSON formatted results

[0207] Specific behavior:

[0208] 1. Convert the list of cheapest options into JSON format.

[0209] 2. Send it as an HTTP response to the user's device.

[0210] Step 9: View the results

[0211] Terminal

[0212] The terminal displays the results received from the server to the user, including price information, the names of stores where the product can be purchased, and links to online shops.

[0213] Input: Response data from the server

[0214] Output: Information displayed on the user interface

[0215] Specific behavior:

[0216] 1. Analyze the response data from the server.

[0217] 2. Display the analyzed data in the user interface.

[0218] Step 10: Map location and navigation

[0219] Terminal

[0220] The device displays markers on a map based on the location information of retail stores, allowing users to easily access the nearest store, and also provides a navigation function.

[0221] Input: Store location information

[0222] Output: Map markers and navigation route

[0223] Specific behavior:

[0224] 1. Obtain the store's location information and send it to the map API.

[0225] 2. Display store markers on the map.

[0226] 3. Display navigation route to the selected store.

[0227] (Application example 1)

[0228] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0229] In recent years, consumers have increasingly sought the cheapest way to purchase the same product from multiple stores and online shopping sites. However, comparing and searching each store and online shopping site individually is time-consuming and laborious. Even if you find the cheapest store, you may not know the store's specific location, making it difficult to purchase the product efficiently. Furthermore, limited access to product reviews and ratings often leaves consumers unsure of their purchasing decisions. The present invention aims to solve these problems.

[0230] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0231] In this invention, the server includes means for a user to input information about a product they wish to purchase, means for collecting store price information and saving it in a database, means for collecting online shopping price information, means for integrating store price information and online shopping price information to identify the cheapest price, means for displaying the cheapest price information to the user, means for displaying store locations on a map based on the store information, means for displaying product reviews and ratings, and means for managing purchase history. This enables consumers to efficiently and quickly find the cheapest products, check location information, and make optimal purchasing decisions by referring to reviews and ratings.

[0232] "Means for users to input product information they wish to purchase" refers to the function whereby a user uses a device such as a smartphone or computer to input the name of the product they wish to purchase and send a request to the system.

[0233] "Means of collecting store price information and storing it in a database" refers to a server or API integration mechanism that periodically obtains product price information provided by physical stores and records and stores this information in a database.

[0234] "Means for collecting online shopping price information" refers to the function of obtaining product price information from various online shopping sites via APIs, etc., and storing this information in a database.

[0235] "Means of integrating in-store price information and online shopping price information to identify the cheapest price" refers to algorithms and software that centrally manage and compare collected price information from physical and online stores, and extract the most economical option for the user.

[0236] "Means for displaying the lowest price information to the user" refers to the function of selecting the lowest price from the integrated price information and visually presenting it on the user's device.

[0237] "Means for displaying the location of a store on a map based on the store information" refers to a function that displays the geographical location information of a store offering the lowest priced product on a map, allowing users to easily find the store.

[0238] "Means for displaying product reviews and ratings" refers to a function that collects opinions and ratings from users of products that the user is considering purchasing from the Internet and displays them to the user.

[0239] "Means for managing purchase history" refers to a function that stores records of products purchased by users in a database and allows them to refer to these records later.

[0240] The system for implementing this invention provides information that allows users to purchase desired products efficiently and at the lowest possible cost. The system is mainly composed of three elements: a server, a terminal, and a user interface.

[0241] The server periodically collects price information, reviews, and ratings from each physical store and online shopping site, and stores them in a database. The server uses an API to obtain this information and integrates and manages it in the database. For price information from physical stores, it obtains and stores the prices of specific products (e.g., milk, seasonings, rice, etc.). It also collects price information from online shopping sites for similar products, and stores this in the database.

[0242] Users input the items they wish to purchase through an application on their smartphone or computer. The information they input is sent to a server via their device. The server then searches a database of price information based on the user's request to identify the cheapest option, which includes information from physical stores and online shopping.

[0243] The terminal displays the results received from the server to the user. Specifically, it displays the cheapest price information for the product entered by the user, the name of the store where the product can be purchased, and a link to the online shopping site. In addition, it displays the location of the store on a map, providing a navigation function that allows the user to easily access the nearest store. This allows the user to efficiently purchase the cheapest product.

[0244] The system can also display product reviews and ratings, allowing users to make purchasing decisions based on not only price information but also the product's quality and the ratings of other users. It also has a purchasing history management function, allowing users to plan future purchases while referring to their past purchase history.

[0245] As a concrete example, if a user searches for "milk, seasonings, rice," the system provides information in the following way. When a user enters "milk, seasonings, rice" into the app and sends a request, the server searches the database for the cheapest "milk, seasonings, rice" and aggregates the results. The server then uses the API of an online shopping site to collect price information for similar products and integrates the two. The identified cheapest option is sent to the user's device, and the user can view price information, the name of the store where the product is available, and a link to the online shopping site on the app. The nearest store is also displayed on a map, and users can also view reviews, ratings, and past purchase history. This allows users to quickly and efficiently find the cheapest, highest-quality products.

[0246] Example prompt sentence:

[0247] Please compare prices for "Milk, Seasonings, and Rice" and let me know the cheapest options. Also, please show me the location of the nearest store.

[0248] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0249] Step 1:

[0250] User enters product information

[0251] A user uses an application on a smartphone or PC to input product information (e.g., "milk, seasoning, rice") and send a request. This input information is then sent to the server via the terminal.

[0252] Input: Product information entered by the user

[0253] Output: Request data sent to the server via the terminal

[0254] Step 2:

[0255] Collect store prices

[0256] The server sends requests to each physical store's API endpoint to retrieve pricing information for specific products. This collected data is then formatted and stored in a database.

[0257] Input: API request from the server

[0258] Data processing: Format the collected price information and convert it into a storage format.

[0259] Output: Price information stored in the database

[0260] Step 3:

[0261] Collecting online shopping price information

[0262] The server then sends requests to each online shop's API endpoint to retrieve pricing information for specific products, which is then formatted and stored in the database.

[0263] Input: API request from the server

[0264] Data processing: Format the collected price information and convert it into a storage format.

[0265] Output: Online pricing information stored in a database

[0266] Step 4:

[0267] Consolidating pricing information and identifying the best prices

[0268] The server retrieves price information from a database based on the request received from the user, integrates price information from physical stores and online stores, and identifies the lowest price from the integrated information.

[0269] Input: Price information extracted from databases (both physical and online stores)

[0270] Data Calculation: Compare prices and find the best deals

[0271] Output: The cheapest price and the store (or online shop) that offers it

[0272] Step 5:

[0273] Displaying results to the user

[0274] The terminal displays the lowest price information received from the server, the name of the store offering the price, and a link to the online shop to the user.

[0275] Input: The lowest price information sent from the server

[0276] Output: Price information and links displayed on the user's device

[0277] Step 6:

[0278] Displaying store locations on a map

[0279] The device displays a store marker on a map based on the location information of the store offering the cheapest products, providing navigation functionality.

[0280] Input: Store location information

[0281] Output: Store markers and navigation routes displayed on the map

[0282] Step 7:

[0283] Displaying product reviews and ratings

[0284] The server collects reviews and ratings of specific products from the Internet and displays them to the user.

[0285] Input: Collected reviews and ratings

[0286] Output: Reviews and ratings displayed on the user's device

[0287] Step 8:

[0288] Purchase history management

[0289] The terminal records the user's purchase history and manages it for later reference.

[0290] Input: Information about the product purchased by the user

[0291] Output: Purchase history information stored in a database

[0292] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0293] The present invention combines an emotion engine with a system that provides information on products that users want to purchase efficiently and at the lowest possible cost. An embodiment of the present invention will be described in detail below.

[0294] Data collection

[0295] server

[0296] The server periodically collects price information and flyer data provided by each store and stores it in a database. To do this, the server sends an API request to each store's endpoint, formats the acquired data, and stores it in the database. For example, the server obtains price information for "milk," "seasonings," and "rice" from "Store A" and stores it in the database.

[0297] Receiving a user request

[0298] User

[0299] Users input the items they wish to purchase through a dedicated smartphone app or web interface. For example, a user might input "milk, seasonings, and rice." This information is then sent to the server via the device.

[0300] Terminal

[0301] After receiving the user's input, the device sends the information to the server. For example, it sends a request for "milk, seasonings, and rice" in JSON format to the server.

[0302] Database search

[0303] server

[0304] The server searches for the corresponding product information in the database based on the received user request, finds the cheapest product, and aggregates that information. For example, the server extracts the price information for "milk" from the database and identifies the store with the cheapest price.

[0305] Price comparison with online shopping

[0306] server

[0307] The server also collects price information from online shopping sites to compare with the store's price information, using the API of each online shopping site, and combines the obtained online price information with the store's price information to determine the most cost-effective option for the user.

[0308] Integration and display of results

[0309] server

[0310] The server integrates store and online shopping data to identify the cheapest price for the user. It then sends the results to the user's device. For example, the cheapest "milk" is "Store X," which costs 100 yen.

[0311] Terminal

[0312] The terminal displays the results received from the server to the user. Specifically, it displays the product price information, the name of the store where the product can be purchased, and a link to the online shopping site. For example, it displays information such as "Milk: 100 yen at store X, 105 yen at online shopping site Y."

[0313] Display on the map

[0314] Terminal

[0315] The device displays a marker on a map based on the store's location information, allowing the user to easily access the nearest store. For example, when a user selects "Store X," the location of "Store X" is displayed on a map and a navigation function is provided.

[0316] Emotion engine integration

[0317] server

[0318] The server has an emotion engine that recognizes emotions from the user's facial expressions and voice. This engine analyzes data obtained from the camera and microphone in real time while the user is using the app or web interface. For example, if a user looks dissatisfied after viewing price information, the engine recognizes the emotion.

[0319] Emotion-Based Adjustment

[0320] Terminal

[0321] The device dynamically adjusts the display method according to the user's emotions based on the analysis results of the emotion engine sent from the server. For example, if the user looks dissatisfied, the system will suggest alternative products or display detailed descriptions of specific products. If the user looks satisfied, the current display will be maintained.

[0322] Specific examples

[0323] For example, if a user searches for "milk, seasonings, rice," the system will provide information in the following order:

[0324] 1. The user enters "milk, seasonings, rice" into the app and submits a request.

[0325] 2. The server searches the database for the cheapest "milk, seasonings, and rice" and aggregates the results.

[0326] 3. The server uses the API of an online shopping site to collect price information about similar products.

[0327] 4. The server aggregates in-store and online pricing information to identify the cheapest option.

[0328] 5. The server sends the results to the user's device.

[0329] 6. The device displays the results to the user and shows the store's location on a map.

[0330] 7. The device uses an emotion engine to analyze the user's facial expressions and voice, and dynamically adjusts the display content based on the user's emotions.

[0331] This system allows users to find the cheapest products quickly and efficiently, and with the support of an emotion engine, they can enjoy a more comfortable purchasing experience.

[0332] The processing flow will be explained below.

[0333] Step 1:

[0334] The server sends a request to each store's API endpoint to obtain the latest price information and flyer data. The obtained data is formatted and stored in a database. For example, price information for "milk," "seasonings," and "rice" is obtained from "Store A" and stored in the database.

[0335] Step 2:

[0336] The user enters the product information they wish to purchase through a dedicated smartphone app or web interface. For example, the user might enter "milk, seasonings, and rice."

[0337] Step 3:

[0338] The device receives the user's input and sends the information to the server. For example, it sends a request for "milk, seasonings, and rice" in JSON format to the server.

[0339] Step 4:

[0340] The server receives the user's request and searches for the corresponding product information in the database. For example, the server searches for price information for "milk," "seasonings," and "rice" and identifies the store with the lowest price.

[0341] Step 5:

[0342] The server uses the API of an online shopping site to collect price information for the same products. For example, it sends a request to the API endpoint of Amazon or Rakuten to obtain price information for "milk," "seasoning," and "rice."

[0343] Step 6:

[0344] The server compares and integrates price information obtained from stores with price information obtained from online shopping. For example, it compares "Milk from Store A for 100 yen" with "Milk from Amazon for 105 yen" and selects the store that sells it for 100 yen.

[0345] Step 7:

[0346] The server sends the integrated results to the user's device. For example, it might send information such as "Milk: 100 yen at store A, seasoning: 200 yen at store B, rice: 300 yen at store C."

[0347] Step 8:

[0348] The terminal displays the results received from the server to the user. Specifically, it displays product price information, the names of stores where the product can be purchased, and links to online shopping sites. For example, it might display "Milk: 100 yen at store A, seasoning: 200 yen at store B, rice: 300 yen at store C."

[0349] Step 9:

[0350] The device displays the nearest store on a map based on the store's location information. The user can refer to the map to confirm the store's location. The device also uses the navigation function to display the route to the store. For example, a marker for "Store A" is displayed on the map, and route guidance is provided.

[0351] Step 10:

[0352] The device sends data acquired from the user's camera and microphone to the emotion engine, which analyzes the user's emotions. For example, if the user looks dissatisfied after viewing price information, that emotion will be analyzed.

[0353] Step 11:

[0354] The server receives the analysis results from the emotion engine and dynamically adjusts the display method based on the user's emotions. For example, if the user looks dissatisfied, the system will suggest alternative products or display detailed information about specific products. If the user looks satisfied, the current display will be maintained.

[0355] This processing step allows the user to not only purchase products efficiently and at the lowest possible cost, but also to enjoy a pleasant purchasing experience using the emotion engine.

[0356] Example 2

[0357] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0358] Until now, users have lacked a means to easily and efficiently obtain product information and purchase it at the lowest price. In particular, it has been difficult to integrate price information from stores and online shopping sites, identify the lowest price in real time, and provide it to users. In addition, the display has not been adjusted based on user emotions, making it difficult to improve the quality of the user experience.

[0359] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0360] In this invention, the server includes means for a user to input information about a product they wish to purchase, means for collecting store price information and saving it in a database, means for collecting online shopping price information, means for integrating store price information and online shopping price information to identify the cheapest price, means for displaying the cheapest price information to the user, means for displaying store locations on a map based on the store information, means for using an emotion engine that recognizes emotions from the user's facial expressions and voice, and means for dynamically adjusting display content based on the recognized emotion. This enables the user to efficiently obtain information about the cheapest products and enjoy a pleasant shopping experience through display adjustments using the emotion engine.

[0361] A "user" is an individual or organization that uses the system to input product information and obtain the cheapest price information.

[0362] "Information about the product desired to be purchased" is information about the name and type of the product that the user wishes to purchase.

[0363] "Store price information" refers to price information for products sold in physical stores.

[0364] "Online shopping price information" refers to price information for products sold online.

[0365] A "database" is a digital storage device that organizes and stores collected store price information and online shopping price information.

[0366] "API" stands for Application Programming Interface, a mechanism for exchanging data and functions between different software programs.

[0367] An "emotion engine" is an algorithm or software that analyzes a user's facial expressions and voice and recognizes their emotional state.

[0368] "Dynamic adjustment of display content" means that the system changes the information displayed and interface layout in real time according to the user's emotional state.

[0369] "Displaying store locations on a map" is a function in which the system visually displays the user's current location or the location of a selected store on a map.

[0370] The present invention is a system that provides users with information that allows them to efficiently obtain product information they wish to purchase at the lowest possible cost, and further improves the user experience by combining it with an emotion engine. Specific embodiments of the system are described below.

[0371] In this system, the server, terminal, and user components work together to collect, analyze, and display data using various hardware and software.

[0372] Hardware and software used

[0373] 1. Server

[0374] Price information is collected from each store and online shopping site using an API.

[0375] Organize and store price information in a database.

[0376] An emotion engine is implemented to recognize emotions from the user's facial expressions and voice.

[0377] 2. Terminal

[0378] Sends the user's input to the server.

[0379] The response from the server is displayed to the user, and the store location is displayed on a map so that the user can access the nearest store.

[0380] The user's facial expressions and voice are captured and sent to the server.

[0381] 3. Users

[0382] Enter the product information you wish to purchase via a smartphone app or web interface.

[0383] Data processing and calculation flow

[0384] 1. The server periodically sends requests to each store's endpoint to collect price information and flyer data. This is done using each store's API. For example, the server obtains price information for "milk," "seasonings," and "rice" from "Store A" and stores it in the database.

[0385] 2. The user enters the product information they wish to purchase into a dedicated smartphone app or web interface and submits a request. For example, the user enters "milk, seasonings, and rice." This information is sent to the server via the device.

[0386] 3. The device converts the user's input into JSON format, generates an HTTP request to send to the server, and sends it.

[0387] 4. The server searches the corresponding product information in the database, finds the cheapest product, and aggregates it. For example, it extracts the price information for "milk" from the database and identifies the store that offers the cheapest price.

[0388] 5. The server uses the API of the online shopping site to collect price information about similar products and integrates it with the store's price information.

[0389] 6. The server sends the lowest price information to the user's device, which displays it to the user. For example, "Milk: 100 yen at store X, 105 yen at online store Y."

[0390] 7. The device will display a marker on the map based on the store's location information, allowing the user to access the nearest store. For example, when the user selects "Store X," its location will be displayed on the map.

[0391] 8. The server analyzes data obtained from the camera and microphone in real time while the user is using the app or web interface to recognize the user's emotions. For example, if the user looks dissatisfied after viewing price information, the server recognizes that emotion.

[0392] 9. The device receives the emotion engine's analysis results from the server and dynamically adjusts the display method. For example, if the user looks dissatisfied, it will suggest an alternative product or display a detailed product description. If the user looks satisfied, it will maintain the current display.

[0393] Specific examples

[0394] For example, if a user searches for "milk, seasonings, rice," the system will provide information in the following order:

[0395] 1. The user enters "milk, seasonings, rice" into the app and submits a request.

[0396] 2. The server searches the database for the cheapest "milk, seasonings, and rice" and aggregates the results.

[0397] 3. The server uses the API of an online shopping site to collect price information about similar products.

[0398] 4. The server aggregates in-store and online pricing information to identify the cheapest option.

[0399] 5. The server sends the results to the user's device.

[0400] 6. The device displays the results to the user and shows the store's location on a map.

[0401] 7. The device uses an emotion engine to analyze the user's facial expressions and voice and dynamically adjust the display content.

[0402] An example of a prompt is as follows:

[0403] "Please explain a system that provides users with information on products they want to purchase efficiently and at the lowest possible price. This system incorporates an emotion engine."

[0404] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0405] Step 1:

[0406] Data collection

[0407] The server collects price information from each store and stores it in a database.

[0408] Input: Endpoint information for each store.

[0409] Output: Formatted pricing information stored in a database.

[0410] Specific operation: The server sends a request to each store's API, obtains price information for "milk," "seasonings," and "rice" from store A, formats the information, and saves it in the database.

[0411] Step 2:

[0412] Receiving a user request

[0413] Users enter information about the product they wish to purchase using a dedicated app or web interface and submit a request.

[0414] Input: Desired product information entered by the user, such as "milk, seasonings, rice."

[0415] Output: The user's request information is sent to the terminal.

[0416] Specific behavior: The user enters "milk, seasoning, rice" into the app, which is converted into JSON format and sent to the server.

[0417] Step 3:

[0418] Server reception of user requests

[0419] The terminal transmits the user's request to the server.

[0420] Input: A JSON request containing product information entered by the user.

[0421] Output: Triggers the server's price information lookup process.

[0422] Specific operation: The device generates an HTTP request to send JSON data containing the request for "milk, seasonings, and rice" to the server, and sends it to the server.

[0423] Step 4:

[0424] Database search

[0425] The server searches the product information in the database based on the request and identifies the lowest price.

[0426] Input: Product name based on user request.

[0427] Output: Data on the cheapest product.

[0428] Specific operation: The server executes a database query to extract the store information with the cheapest price for "milk," "seasoning," and "rice."

[0429] Step 5:

[0430] Price comparison with online shopping

[0431] The server collects price information from online shopping sites and compares it with the price information of the store.

[0432] Input: Product name based on user request, and API endpoint information of online shopping site.

[0433] Output: Consolidated best price information.

[0434] Specific operation: The server sends a request to the API endpoint of the online shopping site, obtains online price information for "milk," "seasonings," and "rice," and integrates it with the store.

[0435] Step 6:

[0436] Integration and display of results

[0437] The server aggregates the cheapest price information and sends it to the user's terminal.

[0438] Input: In-store and online shopping price information.

[0439] Output: Consolidated pricing information.

[0440] Specific operation: The server generates a result such as "Milk: 100 yen at store X, 105 yen at online shop Y" and sends it to the terminal.

[0441] Step 7:

[0442] Displaying results and providing location information

[0443] The terminal displays the results to the user and shows the store's location on a map.

[0444] Input: Lowest price information and location information provided by the server.

[0445] Output: Display in the user interface and a marker on the map.

[0446] Specific operation: The device analyzes the data received and displays it in the format "Milk: 100 yen at store X, 105 yen at online shop Y," and shows the store location on a map.

[0447] Step 8:

[0448] Emotion Engine Data Acquisition

[0449] The server acquires the user's facial expressions and voice and recognizes their emotions.

[0450] Input: Live data from the user's camera and microphone.

[0451] Output: Parsed emotional state.

[0452] Specific operation: The server collects data from the user's camera and microphone in real time and analyzes it using the emotion engine.

[0453] Step 9:

[0454] Emotion-based display adjustment

[0455] The device dynamically adjusts the display content based on the analysis results of the emotion engine.

[0456] Input: Parsed emotional state.

[0457] Output: Dynamic display of the user interface.

[0458] Specific operation: If the user looks dissatisfied, the device will suggest alternative products and display detailed explanations; if the user looks satisfied, the current display will be maintained.

[0459] (Application example 2)

[0460] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0461] Current shopping systems require users to spend a lot of time and effort to find the cheapest products. Furthermore, the user experience is uniform, and there is a problem in that the system is unable to flexibly display and suggest products that respond to individual emotions and preferences. In particular, comparing online and offline prices is often cumbersome, making it difficult for users to use. It is necessary to solve these issues and provide a new shopping experience that is user-friendly and responds to emotions.

[0462] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for a user to input information about a product they wish to purchase, means for collecting store price information and saving it in a database, means for collecting online shopping price information, means for integrating store price information and online shopping price information to identify the cheapest price, means for displaying the cheapest price information to the user, means for displaying store locations on a map based on the store information, emotion analysis means for recognizing emotions from the user's facial expressions and voice, and means for dynamically adjusting display content according to the user's emotions. This allows the user to quickly and efficiently find the cheapest product, and with the support of the emotion engine, a more comfortable and satisfying purchasing experience is possible.

[0463] The "means by which a user inputs information about a product they wish to purchase" refers to an interface that allows a user to input information about a product they wish to purchase using a smartphone app or web interface.

[0464] "Means of collecting store price information and saving it in a database" refers to a method of obtaining price information through each store's API endpoint, formatting it, and saving it in a database.

[0465] "Methods for collecting online shopping price information" refers to a method for obtaining and integrating price information using the API of an online shopping site.

[0466] "Means for integrating in-store price information and online shopping price information to identify the lowest price" refers to an algorithm that compares collected in-store and online price information and identifies the product with the lowest price.

[0467] The "means for displaying the cheapest price information to the user" is a method for displaying the identified cheapest price information to the user through a smartphone app or web interface.

[0468] The "means for displaying the location of the store on a map based on the store information" is a method for displaying the location of the store on a map using a map API (e.g., Google (registered trademark) Maps API).

[0469] "Emotion analysis means for recognizing emotions from a user's facial expressions and voice" is a technology for analyzing a user's facial expressions and voice data collected using a camera or microphone to recognize the user's emotional state.

[0470] The "means for dynamically adjusting the displayed content according to the user's emotions" is an algorithm that changes the displayed information and suggested content based on the recognized user's emotions.

[0471] This invention is a system that collects price information from stores and online shopping sites and helps users purchase products at the lowest price. Furthermore, by combining it with emotion analysis technology, it realizes flexible information display and suggestions according to the user's emotions. Specific embodiments will be described.

[0472] Hardware and software used

[0473] The following hardware and software are used in this system:

[0474] Server: Private cloud, AWS (registered trademark), or Google Cloud

[0475] Database: MySQL (registered trademark) or PostgreSQL

[0476] API: Public API for each store and online shopping site

[0477] Smartphone: iOS or ANDROID (registered trademark) device

[0478] Camera and microphone: Built-in to device

[0479] Emotion engine: OpenAI (registered trademark) API, Kairos (emotion analysis API)

[0480] Map API: Google Maps API

[0481] System configuration

[0482] 1. Data Collection

[0483] The server periodically sends requests to each store's API endpoint to retrieve pricing information and flyer data, which is then formatted and stored in a database.

[0484] 2. Receipt of User Request

[0485] Users use a smartphone app to input information about the product they wish to purchase, which is then sent to the server in JSON format.

[0486] 3. Database Search

[0487] The server searches the price information in the database based on the received user request and identifies the cheapest product.

[0488] 4. Collecting Online Pricing Information

[0489] The server uses the API of each online shopping site to obtain price information and integrates it with the store's price information.

[0490] 5. Integration and display of results

[0491] The server sends the consolidated results to the user's device, where a smartphone app displays them.

[0492] 6. Displaying stores on a map

[0493] The smartphone app uses the Google Maps API to display the location of the store with the lowest price on a map.

[0494] 7. Sentiment Analysis and Dynamic Adjustment

[0495] The server analyzes the user's facial expressions and voice recorded through the camera and microphone, and recognizes the user's emotions using an emotion engine (OpenAI's API, Kairos).The server dynamically adjusts the content displayed and suggestions provided based on the user's emotions.

[0496] Specific examples

[0497] For example, if a user searches for "milk, seasonings, rice," the system will perform the following functions:

[0498] 1. The user enters "milk, seasonings, rice" into the app and submits a request.

[0499] 2. The server searches the database for the cheapest "milk, seasonings, and rice" and aggregates the results.

[0500] 3. The server uses the API of an online shopping site to collect price information about similar products.

[0501] 4. The server aggregates in-store and online pricing information to identify the cheapest option.

[0502] 5. The server sends the results to the user's device.

[0503] 6. The device displays the results to the user and shows the store's location on a map.

[0504] 7. The device uses an emotion engine to analyze the user's facial expressions and voice, and dynamically adjusts the display content based on the user's emotions.

[0505] Prompt Sentence Examples

[0506] Product list: Milk, seasonings, rice

[0507] View: Map, Dashboard

[0508] Expression: Unhappy

[0509] With the above configuration, users can quickly and efficiently find the cheapest products, and with the support of the emotion engine, they can enjoy a more comfortable and satisfying purchasing experience.

[0510] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0511] Step 1:

[0512] A user opens a smartphone app and inputs the items they wish to purchase, such as "milk, seasonings, and rice." Once the input is complete, the device sends this information to the server in JSON format (e.g., "{"products": ["milk", "seasonings", "rice"]}").

[0513] Step 2:

[0514] The server analyzes the received JSON-formatted user request and searches for the corresponding product information in the database. Specifically, it executes an SQL query based on the product name to obtain information on the store with the cheapest price. The input is the user request information, and the output is the cheapest price information.

[0515] Step 3:

[0516] The server uses the API of online shopping sites to collect price information for products that users wish to purchase. It generates API requests for each online shopping site and accesses them to obtain price data. The input is the API request, and the output is the price information obtained from the online shopping site.

[0517] Step 4:

[0518] The server integrates the price information of the store and the price information of the online shopping site to identify the cheapest price. At this stage, the collected price information is compared and the product information with the cheapest price is selected. The input is all the collected price information, and the output is the result of identifying the cheapest price.

[0519] Step 5:

[0520] The server sends the consolidated price information to the user's device in JSON format, for example, "{"Milk": {"Store": "A", "Price": 100 yen}, "Seasoning": {"Store": "B", "Price": 200 yen}, "Rice": {"Online Shopping": "Site C", "Price": 300 yen}}".

[0521] Step 6:

[0522] The terminal displays the price information received from the server on the user interface, allowing the user to visually check the information on the cheapest product. It also uses the Google Maps API to display the location of the store offering the cheapest price on a map and provide a navigation function. The input is the price information from the server, and the output is the display on the user interface and the map display.

[0523] Step 7:

[0524] The device's camera and microphone are used to collect the user's facial expressions and voice in real time. The data acquired from the camera and microphone is sent to a server and analyzed by an emotion analysis engine (e.g., OpenAI API, Kairos). The input is the user's facial expressions and voice data, and the output is the analyzed emotional state.

[0525] Step 8:

[0526] The server dynamically adjusts the display content based on the user's emotions based on the results of emotion analysis. For example, if the user looks dissatisfied, it will suggest alternative products or display detailed explanations. The input is the emotion analysis results, and the output is the adjusted display content.

[0527] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0528] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0529] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0530] [Second embodiment]

[0531] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0532] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0533] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0534] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0535] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0536] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0537] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0538] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0539] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0540] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0541] In the smart glasses 214, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0542] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0543] A system for carrying out the present invention provides information that enables a user to purchase a desired product efficiently and at the lowest possible price. An embodiment of the system will be described in detail below.

[0544] Data collection

[0545] server

[0546] The server periodically collects price information and flyer data provided by each store and stores it in a database. At this time, the server sends an API request to each store's endpoint, formats the acquired data, and stores it in the database. For example, the server sends a request to the API endpoint of "Store A," acquires price information for "Milk," "Condiments," and "Rice," and stores it in the database.

[0547] Receiving a user request

[0548] User

[0549] Users input the items they wish to purchase through a dedicated smartphone app or web interface. For example, a user might input "milk, seasonings, and rice." This information is then sent to the server via the device.

[0550] Terminal

[0551] After receiving the user's input, the terminal sends the information to the server, which then searches for product price information based on the received information.

[0552] Database search

[0553] server

[0554] The server searches the database for price information based on the user request it receives, finds the cheapest product, and aggregates that information. For example, the server extracts the price information for "milk" from the database and identifies the store that sells it at the cheapest price.

[0555] Price comparison with online shopping

[0556] server

[0557] The server also collects price information from online shopping sites to compare with the store's price information, using the API of each online shopping site, and combines the obtained online price information with the store's price information to determine the most cost-effective option for the user.

[0558] Integration and display of results

[0559] server

[0560] The server integrates store and online shopping data to identify the cheapest price for the user. It then sends the results to the user's device. For example, the cheapest "milk" is "Store X," which costs 100 yen.

[0561] Terminal

[0562] The terminal displays the results received from the server to the user. Specifically, it displays the product price information, the name of the store where the product can be purchased, and a link to the online shopping site. For example, it displays information such as "Milk: 100 yen at store X, 105 yen at online shopping site Y."

[0563] Display on the map

[0564] Terminal

[0565] The device displays a marker on a map based on the store's location information, allowing the user to easily access the nearest store. For example, when a user selects "Store X," the location of "Store X" is displayed on a map and a navigation function is provided.

[0566] Specific examples

[0567] For example, if a user searches for "milk, seasonings, rice," the system will provide information in the following order:

[0568] 1. The user enters "milk, seasonings, rice" into the app and submits a request.

[0569] 2. The server searches the database for the cheapest "milk, seasonings, and rice" and aggregates the results.

[0570] 3. The server uses the API of an online shopping site to collect price information about similar products.

[0571] 4. The server aggregates in-store and online pricing information to identify the cheapest option.

[0572] 5. The server sends the results to the user's device.

[0573] 6. The device displays the results to the user and shows the store's location on a map.

[0574] In this way, users can quickly and efficiently find the cheapest products. This system significantly reduces the effort required by consumers and provides a convenient and cost-effective shopping experience.

[0575] The processing flow will be explained below.

[0576] Step 1:

[0577] The server periodically sends requests to each store's API endpoint to obtain the latest price information and flyer data. The obtained data is formatted and stored in a database. For example, price information for "milk," "seasonings," and "rice" is obtained from "Store A" and stored in the database.

[0578] Step 2:

[0579] The user enters the product information they wish to purchase through a dedicated smartphone app or web interface. For example, the user might enter "milk, seasonings, and rice."

[0580] Step 3:

[0581] The device receives the user's input and sends the information to the server. For example, it sends a request for "milk, seasonings, and rice" in JSON format to the server.

[0582] Step 4:

[0583] The server receives the user's request and searches for the corresponding product information in the database, for example, searching for the price information for "milk" and identifying the store with the cheapest price.

[0584] Step 5:

[0585] The server uses the API of an online shopping site to collect price information for the same products. For example, it sends a request to the API endpoint of Amazon or Rakuten to obtain price information for "milk," "seasoning," and "rice."

[0586] Step 6:

[0587] The server compares and integrates price information obtained from stores with price information obtained from online shopping. For example, it compares "Milk at Store A for 100 yen" with "Milk at Amazon for 105 yen" and selects the store where the price is 100 yen.

[0588] Step 7:

[0589] The server sends the integrated results to the user's device. For example, it sends information such as "Milk: 100 yen at store A, seasoning: 200 yen at store B, rice: 300 yen at store C."

[0590] Step 8:

[0591] The terminal displays the results received from the server to the user. Specifically, it displays product price information, the name of the store where the product can be purchased, a link to the online shopping site, etc. For example, it displays "Milk: 100 yen at store A - Address: XX" or "Condiment: 200 yen at store B - Address: XX".

[0592] Step 9:

[0593] The device displays the nearest store on a map based on the store's location information. The user can refer to the map to confirm the store's location. The device also uses the navigation function to display the route to the store. For example, a marker for "Store A" is displayed on the map, and route guidance is provided.

[0594] This allows users to quickly and efficiently find the cheapest products and also check the store's location on a map.

[0595] Example 1

[0596] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0597] In the past, in order to efficiently purchase the product they wanted at the lowest price, users had to check multiple stores and online sales sites individually, which required a lot of time and effort.It was also difficult to compare prices in real time, making it difficult to find the best option.

[0598] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0599] In this invention, the server includes means for a user to input information about a product they wish to purchase, means for collecting price information from retail stores and saving it in a database, means for collecting price information from online sales sites, means for integrating the price information from retail stores and the price information from online sales sites to identify the cheapest price, means for displaying the cheapest price information to the user, and means for displaying the locations of retail stores on a map based on the retail store information, thereby enabling users to efficiently find the cheapest products.

[0600] "User" refers to a consumer who uses this system to input information about a product they wish to purchase.

[0601] "Means for inputting product information for purchase" refers to an interface that allows users to input the products they wish to purchase via a smartphone app or web interface.

[0602] "Sales store" refers to a physical store that actually sells products.

[0603] "Means of collecting price information and storing it in a database" refers to a system for obtaining price information from retail stores using an API or other means and storing it in a database.

[0604] "Online Sales Site" means a website that sells products over the Internet.

[0605] "Means of collecting price information" refers to a system for obtaining price information from online sales sites using APIs, etc.

[0606] "Means for integrating price information and identifying the lowest price" refers to an algorithm or process for integrating price information obtained from retail stores and online retail sites to identify the product with the lowest price for the user.

[0607] The "means for displaying the lowest price information" refers to an interface for visually displaying to the user the product information with the lowest price from the integrated price information.

[0608] "Means for displaying the location of a retail store on a map based on retail store information" refers to a function for displaying the location of a retail store on a map based on its location information and providing it visually to the user.

[0609] The present invention is a system that provides information to help users purchase desired products efficiently and at the lowest possible price. This system consists of three main components: the user, the terminal, and the server.

[0610] Data collection

[0611] server

[0612] The server periodically collects price information and flyer data provided by retail stores and online retail sites and stores it in a database. Specifically, the server uses an API to send requests to each store's endpoint, formats the retrieved data, and stores it in the database. For example, the server sends a request to the API endpoint of "Store A" to retrieve price information for "Milk," "Condiments," and "Rice," and stores the information in the database.

[0613] Receiving a user request

[0614] User

[0615] Users input the items they wish to purchase through a dedicated smartphone app or web interface. For example, a user might input "milk, seasonings, and rice." This information is then sent to the server via the device.

[0616] Terminal

[0617] After receiving the user's input, the terminal transmits the information to the server. Specifically, the terminal transmits a request including the input data to the server using the HTTPS protocol.

[0618] Database search

[0619] server

[0620] The server searches the database for price information based on the received user request, finds the cheapest product, and aggregates that information. For example, the server extracts the price information for "milk" from the database and identifies the store that sells it at the cheapest price.

[0621] Price comparison with online shopping

[0622] server

[0623] The server also collects price information from online retailers to compare with the retailer's price information, using the API of each online retailer. The server then combines the obtained online price information with the retailer's price information to determine the most cost-effective option for the user.

[0624] Integration and display of results

[0625] server

[0626] The server aggregates data from retail stores and online retail sites to identify the cheapest price for the user. It then sends the results to the user's device. For example, the cheapest "milk" is "Store X," which costs 100 yen.

[0627] Terminal

[0628] The device displays the results received from the server to the user. Specifically, it displays the product price information, the name of the store where the product can be purchased, and a link to the online shopping site. For example, it displays information such as "Milk: 100 yen at store X, 105 yen at online shopping site Y."

[0629] Display on the map

[0630] Terminal

[0631] The device displays a marker on a map based on the store's location information, allowing users to easily access the nearest store. For example, when a user selects "Store X," the device displays the location of "Store X" on a map and provides navigation functionality.

[0632] Specific examples

[0633] For example, if a user searches for "milk, seasonings, rice," the system will provide information in the following order:

[0634] 1. The user enters "milk, seasonings, rice" into the app and submits a request.

[0635] 2. The server searches the database for the cheapest "milk, seasonings, and rice" and aggregates the results.

[0636] 3. The server uses the API of an online retailer to collect price information about similar products.

[0637] 4. The server aggregates in-store and online pricing information to identify the cheapest option.

[0638] 5. The server sends the results to the user's device.

[0639] 6. The device displays the results to the user and shows the store's location on a map.

[0640] In this way, users can quickly and efficiently find the cheapest products. This system significantly reduces the effort required by consumers and provides a convenient and cost-effective shopping experience.

[0641] Example prompts for generative AI models

[0642] Below are some example prompts to input to the generative AI model:

[0643] "Get information on retail stores and online shops that offer the lowest prices on a particular product"

[0644] "Explain how you would collect price information for milk, condiments, and rice, and then perform a comparative analysis to present the cheapest options."

[0645] This allows the generative AI model to explain the entire process, from how data is collected to how the results are displayed.

[0646] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0647] Step 1: Send a request to collect data and get a response

[0648] server

[0649] The server sends a request to an API endpoint to collect price information from retail stores and online retail sites. For example, a request is sent to the endpoint of "Store A" requesting price information for "Milk," "Condiments," and "Rice." The data returned as a response is received in JSON format. This data includes information such as the product name, price, store name, and update date and time.

[0650] Input: API endpoint and request parameters (product name)

[0651] Output: Price information in JSON format

[0652] Specific behavior:

[0653] 1. The server generates an HTTP request and sends it to the API endpoint.

[0654] 2. Receive a response in JSON format from the API endpoint.

[0655] 3. Parse the received JSON data and extract the necessary information.

[0656] Step 2: Saving to the database

[0657] server

[0658] The server formats the acquired price information and saves it in the database. Information such as product name, price, store name, and update date and time is inserted or updated in the corresponding table according to the database structure.

[0659] Input: Price information in JSON format

[0660] Output: Price information stored in a database

[0661] Specific behavior:

[0662] 1. Extract product name, price, store name, and update date and time from JSON data.

[0663] 2. Connect to the database and generate and execute SQL queries to insert or update data into the appropriate tables.

[0664] Step 3: Enter the product you want to purchase

[0665] User

[0666] Using a dedicated smartphone app or web interface, users input information about the products they wish to purchase. For example, they might enter "milk, seasonings, and rice" and press the search button. This information is then sent to the server via the user's device.

[0667] Input: Product information you wish to purchase (user input)

[0668] Output: User request data

[0669] Specific behavior:

[0670] 1. The user enters the product information they wish to purchase into the app's search bar.

[0671] 2. The input data is sent to the server via the terminal.

[0672] Step 4: Sending the user request to the server

[0673] Terminal

[0674] The terminal transmits the user's input data to the server. Specifically, the terminal transmits the user's request data to the server using the HTTPS protocol.

[0675] Input: User request data

[0676] Output: Request sent to server

[0677] Specific behavior:

[0678] 1. Generate an HTTP request containing the user's request data.

[0679] 2. Send the generated request to the server using the HTTPS protocol.

[0680] Step 5: Retrieve price information from the database

[0681] server

[0682] The server searches the database for price information based on the user's request. Specifically, it searches for price information for product names such as "milk," "seasoning," and "rice" to find the cheapest product.

[0683] Input: User request data

[0684] Output: The product with the lowest price

[0685] Specific behavior:

[0686] 1. Generate an SQL query based on the user request.

[0687] 2. Query the database and retrieve the results.

[0688] 3. Extract and list the product information with the lowest price.

[0689] Step 6: Collect price information from online shopping sites

[0690] server

[0691] The server collects price information from the API of an online sales site. For example, it sends a request to the API of "Online Shop B" to obtain price information for "milk, seasonings, and rice." The obtained data is formatted and stored in a temporary data store.

[0692] Input: Online API endpoint and request parameters

[0693] Output: Online price information in JSON format

[0694] Specific behavior:

[0695] 1. The server sends a request to the online retailer's API.

[0696] 2. Receive the acquired online price information in JSON format.

[0697] 3. Parse the JSON data and save it to a temporary data store.

[0698] Step 7: Consolidate and compare pricing information

[0699] server

[0700] The server combines the price information from retail stores and online retailers to identify the lowest prices, comparing both sets of data and calculating the lowest price for each product.

[0701] Input: Retail store and online pricing information

[0702] Output: Identify and list the cheapest options

[0703] Specific behavior:

[0704] 1. Convert pricing information from retail stores and online retail sites into a unified format.

[0705] 2. Compare the prices of each item and identify the cheapest option.

[0706] 3. List the cheapest results.

[0707] Step 8: Generate and submit results

[0708] server

[0709] The server identifies the cheapest product price and its source, then sends the results to the user's device, formatting the results in JSON format and sending them as a response.

[0710] Input: List of cheapest options

[0711] Output: JSON formatted results

[0712] Specific behavior:

[0713] 1. Convert the list of cheapest options into JSON format.

[0714] 2. Send it as an HTTP response to the user's device.

[0715] Step 9: View the results

[0716] Terminal

[0717] The terminal displays the results received from the server to the user, including price information, the names of stores where the product can be purchased, and links to online shops.

[0718] Input: Response data from the server

[0719] Output: Information displayed on the user interface

[0720] Specific behavior:

[0721] 1. Analyze the response data from the server.

[0722] 2. Display the analyzed data in the user interface.

[0723] Step 10: Map location and navigation

[0724] Terminal

[0725] The device displays markers on a map based on the location information of retail stores, allowing users to easily access the nearest store, and also provides a navigation function.

[0726] Input: Store location information

[0727] Output: Map markers and navigation route

[0728] Specific behavior:

[0729] 1. Obtain the store's location information and send it to the map API.

[0730] 2. Display store markers on the map.

[0731] 3. Display navigation route to the selected store.

[0732] (Application example 1)

[0733] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0734] In recent years, consumers have increasingly sought the cheapest way to purchase the same product from multiple stores and online shopping sites. However, comparing and searching each store and online shopping site individually is time-consuming and laborious. Even if you find the cheapest store, you may not know the store's specific location, making it difficult to purchase the product efficiently. Furthermore, limited access to product reviews and ratings often leaves consumers unsure of their purchasing decisions. The present invention aims to solve these problems.

[0735] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0736] In this invention, the server includes means for a user to input information about a product they wish to purchase, means for collecting store price information and saving it in a database, means for collecting online shopping price information, means for integrating store price information and online shopping price information to identify the cheapest price, means for displaying the cheapest price information to the user, means for displaying store locations on a map based on the store information, means for displaying product reviews and ratings, and means for managing purchase history. This enables consumers to efficiently and quickly find the cheapest products, check location information, and make optimal purchasing decisions by referring to reviews and ratings.

[0737] "Means for users to input product information they wish to purchase" refers to the function whereby a user uses a device such as a smartphone or computer to input the name of the product they wish to purchase and send a request to the system.

[0738] "Means of collecting store price information and storing it in a database" refers to a server or API integration mechanism that periodically obtains product price information provided by physical stores and records and stores this information in a database.

[0739] "Means for collecting online shopping price information" refers to the function of obtaining product price information from various online shopping sites via APIs, etc., and storing this information in a database.

[0740] "Means of integrating in-store price information and online shopping price information to identify the cheapest price" refers to algorithms and software that centrally manage and compare collected price information from physical and online stores, and extract the most economical option for the user.

[0741] "Means for displaying the lowest price information to the user" refers to the function of selecting the lowest price from the integrated price information and visually presenting it on the user's device.

[0742] "Means for displaying the location of a store on a map based on the store information" refers to a function that displays the geographical location information of a store offering the lowest priced product on a map, allowing users to easily find the store.

[0743] "Means for displaying product reviews and ratings" refers to a function that collects opinions and ratings from users of products that the user is considering purchasing from the Internet and displays them to the user.

[0744] "Means for managing purchase history" refers to a function that stores records of products purchased by users in a database and allows them to refer to these records later.

[0745] The system for implementing this invention provides information that allows users to purchase desired products efficiently and at the lowest possible cost. The system is mainly composed of three elements: a server, a terminal, and a user interface.

[0746] The server periodically collects price information, reviews, and ratings from each physical store and online shopping site, and stores them in a database. The server uses an API to obtain this information and integrates and manages it in the database. For price information from physical stores, it obtains and stores the prices of specific products (e.g., milk, seasonings, rice, etc.). It also collects price information from online shopping sites for similar products, and stores this in the database.

[0747] Users input the items they wish to purchase through an application on their smartphone or computer. The information they input is sent to a server via their device. The server then searches a database of price information based on the user's request to identify the cheapest option, which includes information from physical stores and online shopping.

[0748] The terminal displays the results received from the server to the user. Specifically, it displays the cheapest price information for the product entered by the user, the name of the store where the product can be purchased, and a link to the online shopping site. In addition, it displays the location of the store on a map, providing a navigation function that allows the user to easily access the nearest store. This allows the user to efficiently purchase the cheapest product.

[0749] The system can also display product reviews and ratings, allowing users to make purchasing decisions based on not only price information but also the product's quality and the ratings of other users. It also has a purchasing history management function, allowing users to plan future purchases while referring to their past purchase history.

[0750] As a concrete example, if a user searches for "milk, seasonings, rice," the system provides information in the following way. When a user enters "milk, seasonings, rice" into the app and sends a request, the server searches the database for the cheapest "milk, seasonings, rice" and aggregates the results. The server then uses the API of an online shopping site to collect price information for similar products and integrates the two. The identified cheapest option is sent to the user's device, and the user can view price information, the name of the store where the product is available, and a link to the online shopping site on the app. The nearest store is also displayed on a map, and users can also view reviews, ratings, and past purchase history. This allows users to quickly and efficiently find the cheapest, highest-quality products.

[0751] Example prompt sentence:

[0752] Please compare prices for "Milk, Seasonings, and Rice" and let me know the cheapest options. Also, please show me the location of the nearest store.

[0753] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0754] Step 1:

[0755] User enters product information

[0756] A user uses an application on a smartphone or PC to input product information (e.g., "milk, seasoning, rice") and send a request. This input information is then sent to the server via the terminal.

[0757] Input: Product information entered by the user

[0758] Output: Request data sent to the server via the terminal

[0759] Step 2:

[0760] Collect store prices

[0761] The server sends requests to each physical store's API endpoint to retrieve pricing information for specific products. This collected data is then formatted and stored in a database.

[0762] Input: API request from the server

[0763] Data processing: Format the collected price information and convert it into a storage format.

[0764] Output: Price information stored in the database

[0765] Step 3:

[0766] Collecting online shopping price information

[0767] The server then sends requests to each online shop's API endpoint to retrieve pricing information for specific products, which is then formatted and stored in the database.

[0768] Input: API request from the server

[0769] Data processing: Format the collected price information and convert it into a storage format.

[0770] Output: Online pricing information stored in a database

[0771] Step 4:

[0772] Consolidating pricing information and identifying the best prices

[0773] The server retrieves price information from a database based on the request received from the user, integrates price information from physical stores and online stores, and identifies the lowest price from the integrated information.

[0774] Input: Price information extracted from databases (both physical and online stores)

[0775] Data Calculation: Compare prices and find the best deals

[0776] Output: The cheapest price and the store (or online shop) that offers it

[0777] Step 5:

[0778] Displaying results to the user

[0779] The terminal displays the lowest price information received from the server, the name of the store offering the price, and a link to the online shop to the user.

[0780] Input: The lowest price information sent from the server

[0781] Output: Price information and links displayed on the user's device

[0782] Step 6:

[0783] Displaying store locations on a map

[0784] The device displays a store marker on a map based on the location information of the store offering the cheapest products, providing navigation functionality.

[0785] Input: Store location information

[0786] Output: Store markers and navigation routes displayed on the map

[0787] Step 7:

[0788] Displaying product reviews and ratings

[0789] The server collects reviews and ratings of specific products from the Internet and displays them to the user.

[0790] Input: Collected reviews and ratings

[0791] Output: Reviews and ratings displayed on the user's device

[0792] Step 8:

[0793] Purchase history management

[0794] The terminal records the user's purchase history and manages it for later reference.

[0795] Input: Information about the product purchased by the user

[0796] Output: Purchase history information stored in a database

[0797] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0798] The present invention combines an emotion engine with a system that provides information on products that users want to purchase efficiently and at the lowest possible cost. An embodiment of the present invention will be described in detail below.

[0799] Data collection

[0800] server

[0801] The server periodically collects price information and flyer data provided by each store and stores it in a database. To do this, the server sends an API request to each store's endpoint, formats the acquired data, and stores it in the database. For example, the server obtains price information for "milk," "seasonings," and "rice" from "Store A" and stores it in the database.

[0802] Receiving a user request

[0803] User

[0804] Users input the items they wish to purchase through a dedicated smartphone app or web interface. For example, a user might input "milk, seasonings, and rice." This information is then sent to the server via the device.

[0805] Terminal

[0806] After receiving the user's input, the device sends the information to the server. For example, it sends a request for "milk, seasonings, and rice" in JSON format to the server.

[0807] Database search

[0808] server

[0809] The server searches for the corresponding product information in the database based on the received user request, finds the cheapest product, and aggregates that information. For example, the server extracts the price information for "milk" from the database and identifies the store with the cheapest price.

[0810] Price comparison with online shopping

[0811] server

[0812] The server also collects price information from online shopping sites to compare with the store's price information, using the API of each online shopping site, and combines the obtained online price information with the store's price information to determine the most cost-effective option for the user.

[0813] Integration and display of results

[0814] server

[0815] The server integrates store and online shopping data to identify the cheapest price for the user. It then sends the results to the user's device. For example, the cheapest "milk" is "Store X," which costs 100 yen.

[0816] Terminal

[0817] The terminal displays the results received from the server to the user. Specifically, it displays the product price information, the name of the store where the product can be purchased, and a link to the online shopping site. For example, it displays information such as "Milk: 100 yen at store X, 105 yen at online shopping site Y."

[0818] Display on the map

[0819] Terminal

[0820] The device displays a marker on a map based on the store's location information, allowing the user to easily access the nearest store. For example, when a user selects "Store X," the location of "Store X" is displayed on a map and a navigation function is provided.

[0821] Emotion engine integration

[0822] server

[0823] The server has an emotion engine that recognizes emotions from the user's facial expressions and voice. This engine analyzes data obtained from the camera and microphone in real time while the user is using the app or web interface. For example, if a user looks dissatisfied after viewing price information, the engine recognizes the emotion.

[0824] Emotion-Based Adjustment

[0825] Terminal

[0826] The device dynamically adjusts the display method according to the user's emotions based on the analysis results of the emotion engine sent from the server. For example, if the user looks dissatisfied, the system will suggest alternative products or display detailed descriptions of specific products. If the user looks satisfied, the current display will be maintained.

[0827] Specific examples

[0828] For example, if a user searches for "milk, seasonings, rice," the system will provide information in the following order:

[0829] 1. The user enters "milk, seasonings, rice" into the app and submits a request.

[0830] 2. The server searches the database for the cheapest "milk, seasonings, and rice" and aggregates the results.

[0831] 3. The server uses the API of an online shopping site to collect price information about similar products.

[0832] 4. The server aggregates in-store and online pricing information to identify the cheapest option.

[0833] 5. The server sends the results to the user's device.

[0834] 6. The device displays the results to the user and shows the store's location on a map.

[0835] 7. The device uses an emotion engine to analyze the user's facial expressions and voice, and dynamically adjusts the display content based on the user's emotions.

[0836] This system allows users to find the cheapest products quickly and efficiently, and with the support of an emotion engine, they can enjoy a more comfortable purchasing experience.

[0837] The processing flow will be explained below.

[0838] Step 1:

[0839] The server sends a request to each store's API endpoint to obtain the latest price information and flyer data. The obtained data is formatted and stored in a database. For example, price information for "milk," "seasonings," and "rice" is obtained from "Store A" and stored in the database.

[0840] Step 2:

[0841] The user enters the product information they wish to purchase through a dedicated smartphone app or web interface. For example, the user might enter "milk, seasonings, and rice."

[0842] Step 3:

[0843] The device receives the user's input and sends the information to the server. For example, it sends a request for "milk, seasonings, and rice" in JSON format to the server.

[0844] Step 4:

[0845] The server receives the user's request and searches for the corresponding product information in the database. For example, the server searches for price information for "milk," "seasonings," and "rice" and identifies the store with the lowest price.

[0846] Step 5:

[0847] The server uses the API of an online shopping site to collect price information for the same products. For example, it sends a request to the API endpoint of Amazon or Rakuten to obtain price information for "milk," "seasoning," and "rice."

[0848] Step 6:

[0849] The server compares and integrates price information obtained from stores with price information obtained from online shopping. For example, it compares "Milk from Store A for 100 yen" with "Milk from Amazon for 105 yen" and selects the store that sells it for 100 yen.

[0850] Step 7:

[0851] The server sends the integrated results to the user's device. For example, it might send information such as "Milk: 100 yen at store A, seasoning: 200 yen at store B, rice: 300 yen at store C."

[0852] Step 8:

[0853] The terminal displays the results received from the server to the user. Specifically, it displays product price information, the names of stores where the product can be purchased, and links to online shopping sites. For example, it might display "Milk: 100 yen at store A, seasoning: 200 yen at store B, rice: 300 yen at store C."

[0854] Step 9:

[0855] The device displays the nearest store on a map based on the store's location information. The user can refer to the map to confirm the store's location. The device also uses the navigation function to display the route to the store. For example, a marker for "Store A" is displayed on the map, and route guidance is provided.

[0856] Step 10:

[0857] The device sends data acquired from the user's camera and microphone to the emotion engine, which analyzes the user's emotions. For example, if the user looks dissatisfied after viewing price information, that emotion will be analyzed.

[0858] Step 11:

[0859] The server receives the analysis results from the emotion engine and dynamically adjusts the display method based on the user's emotions. For example, if the user looks dissatisfied, the system will suggest alternative products or display detailed information about specific products. If the user looks satisfied, the current display will be maintained.

[0860] This processing step allows the user to not only purchase products efficiently and at the lowest possible cost, but also to enjoy a pleasant purchasing experience using the emotion engine.

[0861] Example 2

[0862] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0863] Until now, users have lacked a means to easily and efficiently obtain product information and purchase it at the lowest price. In particular, it has been difficult to integrate price information from stores and online shopping sites, identify the lowest price in real time, and provide it to users. In addition, the display has not been adjusted based on user emotions, making it difficult to improve the quality of the user experience.

[0864] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0865] In this invention, the server includes means for a user to input information about a product they wish to purchase, means for collecting store price information and saving it in a database, means for collecting online shopping price information, means for integrating store price information and online shopping price information to identify the cheapest price, means for displaying the cheapest price information to the user, means for displaying store locations on a map based on the store information, means for using an emotion engine that recognizes emotions from the user's facial expressions and voice, and means for dynamically adjusting display content based on the recognized emotion. This enables the user to efficiently obtain information about the cheapest products and enjoy a pleasant shopping experience through display adjustments using the emotion engine.

[0866] A "user" is an individual or organization that uses the system to input product information and obtain the cheapest price information.

[0867] "Information about the product desired to be purchased" is information about the name and type of the product that the user wishes to purchase.

[0868] "Store price information" refers to price information for products sold in physical stores.

[0869] "Online shopping price information" refers to price information for products sold online.

[0870] A "database" is a digital storage device that organizes and stores collected store price information and online shopping price information.

[0871] "API" stands for Application Programming Interface, a mechanism for exchanging data and functions between different software programs.

[0872] An "emotion engine" is an algorithm or software that analyzes a user's facial expressions and voice and recognizes their emotional state.

[0873] "Dynamic adjustment of display content" means that the system changes the information displayed and interface layout in real time according to the user's emotional state.

[0874] "Displaying store locations on a map" is a function in which the system visually displays the user's current location or the location of a selected store on a map.

[0875] The present invention is a system that provides users with information that allows them to efficiently obtain product information they wish to purchase at the lowest possible cost, and further improves the user experience by combining it with an emotion engine. Specific embodiments of the system are described below.

[0876] In this system, the server, terminal, and user components work together to collect, analyze, and display data using various hardware and software.

[0877] Hardware and software used

[0878] 1. Server

[0879] Price information is collected from each store and online shopping site using an API.

[0880] Organize and store price information in a database.

[0881] An emotion engine is implemented to recognize emotions from the user's facial expressions and voice.

[0882] 2. Terminal

[0883] Sends the user's input to the server.

[0884] The response from the server is displayed to the user, and the store location is displayed on a map so that the user can access the nearest store.

[0885] The user's facial expressions and voice are captured and sent to the server.

[0886] 3. Users

[0887] Enter the product information you wish to purchase via a smartphone app or web interface.

[0888] Data processing and calculation flow

[0889] 1. The server periodically sends requests to each store's endpoint to collect price information and flyer data. This is done using each store's API. For example, the server obtains price information for "milk," "seasonings," and "rice" from "Store A" and stores it in the database.

[0890] 2. The user enters the product information they wish to purchase into a dedicated smartphone app or web interface and submits a request. For example, the user enters "milk, seasonings, and rice." This information is sent to the server via the device.

[0891] 3. The device converts the user's input into JSON format, generates an HTTP request to send to the server, and sends it.

[0892] 4. The server searches the corresponding product information in the database, finds the cheapest product, and aggregates it. For example, it extracts the price information for "milk" from the database and identifies the store that offers the cheapest price.

[0893] 5. The server uses the API of the online shopping site to collect price information about similar products and integrates it with the store's price information.

[0894] 6. The server sends the lowest price information to the user's device, which displays it to the user. For example, "Milk: 100 yen at store X, 105 yen at online store Y."

[0895] 7. The device will display a marker on the map based on the store's location information, allowing the user to access the nearest store. For example, when the user selects "Store X," its location will be displayed on the map.

[0896] 8. The server analyzes data obtained from the camera and microphone in real time while the user is using the app or web interface to recognize the user's emotions. For example, if the user looks dissatisfied after viewing price information, the server recognizes that emotion.

[0897] 9. The device receives the emotion engine's analysis results from the server and dynamically adjusts the display method. For example, if the user looks dissatisfied, it will suggest an alternative product or display a detailed product description. If the user looks satisfied, it will maintain the current display.

[0898] Specific examples

[0899] For example, if a user searches for "milk, seasonings, rice," the system will provide information in the following order:

[0900] 1. The user enters "milk, seasonings, rice" into the app and submits a request.

[0901] 2. The server searches the database for the cheapest "milk, seasonings, and rice" and aggregates the results.

[0902] 3. The server uses the API of an online shopping site to collect price information about similar products.

[0903] 4. The server aggregates in-store and online pricing information to identify the cheapest option.

[0904] 5. The server sends the results to the user's device.

[0905] 6. The device displays the results to the user and shows the store's location on a map.

[0906] 7. The device uses an emotion engine to analyze the user's facial expressions and voice and dynamically adjust the display content.

[0907] An example of a prompt is as follows:

[0908] "Please explain a system that provides users with information on products they want to purchase efficiently and at the lowest possible price. This system incorporates an emotion engine."

[0909] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0910] Step 1:

[0911] Data collection

[0912] The server collects price information from each store and stores it in a database.

[0913] Input: Endpoint information for each store.

[0914] Output: Formatted pricing information stored in a database.

[0915] Specific operation: The server sends a request to each store's API, obtains price information for "milk," "seasonings," and "rice" from store A, formats the information, and saves it in the database.

[0916] Step 2:

[0917] Receiving a user request

[0918] Users enter information about the product they wish to purchase using a dedicated app or web interface and submit a request.

[0919] Input: Desired product information entered by the user, such as "milk, seasonings, rice."

[0920] Output: The user's request information is sent to the terminal.

[0921] Specific behavior: The user enters "milk, seasoning, rice" into the app, which is converted into JSON format and sent to the server.

[0922] Step 3:

[0923] Server reception of user requests

[0924] The terminal transmits the user's request to the server.

[0925] Input: A JSON request containing product information entered by the user.

[0926] Output: Triggers the server's price information lookup process.

[0927] Specific operation: The device generates an HTTP request to send JSON data containing the request for "milk, seasonings, and rice" to the server, and sends it to the server.

[0928] Step 4:

[0929] Database search

[0930] The server searches the product information in the database based on the request and identifies the lowest price.

[0931] Input: Product name based on user request.

[0932] Output: Data on the cheapest product.

[0933] Specific operation: The server executes a database query to extract the store information with the cheapest price for "milk," "seasoning," and "rice."

[0934] Step 5:

[0935] Price comparison with online shopping

[0936] The server collects price information from online shopping sites and compares it with the price information of the store.

[0937] Input: Product name based on user request, and API endpoint information of online shopping site.

[0938] Output: Consolidated best price information.

[0939] Specific operation: The server sends a request to the API endpoint of the online shopping site, obtains online price information for "milk," "seasonings," and "rice," and integrates it with the store.

[0940] Step 6:

[0941] Integration and display of results

[0942] The server aggregates the cheapest price information and sends it to the user's terminal.

[0943] Input: In-store and online shopping price information.

[0944] Output: Consolidated pricing information.

[0945] Specific operation: The server generates a result such as "Milk: 100 yen at store X, 105 yen at online shop Y" and sends it to the terminal.

[0946] Step 7:

[0947] Displaying results and providing location information

[0948] The terminal displays the results to the user and shows the store's location on a map.

[0949] Input: Lowest price information and location information provided by the server.

[0950] Output: Display in the user interface and a marker on the map.

[0951] Specific operation: The device analyzes the data received and displays it in the format "Milk: 100 yen at store X, 105 yen at online shop Y," and shows the store location on a map.

[0952] Step 8:

[0953] Emotion Engine Data Acquisition

[0954] The server acquires the user's facial expressions and voice and recognizes their emotions.

[0955] Input: Live data from the user's camera and microphone.

[0956] Output: Parsed emotional state.

[0957] Specific operation: The server collects data from the user's camera and microphone in real time and analyzes it using the emotion engine.

[0958] Step 9:

[0959] Emotion-based display adjustment

[0960] The device dynamically adjusts the display content based on the analysis results of the emotion engine.

[0961] Input: Parsed emotional state.

[0962] Output: Dynamic display of the user interface.

[0963] Specific operation: If the user looks dissatisfied, the device will suggest alternative products and display detailed explanations; if the user looks satisfied, the current display will be maintained.

[0964] (Application example 2)

[0965] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0966] Current shopping systems require users to spend a lot of time and effort to find the cheapest products. Furthermore, the user experience is uniform, and there is a problem in that the system is unable to flexibly display and suggest products that respond to individual emotions and preferences. In particular, comparing online and offline prices is often cumbersome, making it difficult for users to use. It is necessary to solve these issues and provide a new shopping experience that is user-friendly and responds to emotions.

[0967] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for a user to input information about a product they wish to purchase, means for collecting store price information and saving it in a database, means for collecting online shopping price information, means for integrating store price information and online shopping price information to identify the cheapest price, means for displaying the cheapest price information to the user, means for displaying store locations on a map based on the store information, emotion analysis means for recognizing emotions from the user's facial expressions and voice, and means for dynamically adjusting display content according to the user's emotions. This allows the user to quickly and efficiently find the cheapest product, and with the support of the emotion engine, a more comfortable and satisfying purchasing experience is possible.

[0968] The "means by which a user inputs information about a product they wish to purchase" refers to an interface that allows a user to input information about a product they wish to purchase using a smartphone app or web interface.

[0969] "Means of collecting store price information and saving it in a database" refers to a method of obtaining price information through each store's API endpoint, formatting it, and saving it in a database.

[0970] "Methods for collecting online shopping price information" refers to a method for obtaining and integrating price information using the API of an online shopping site.

[0971] "Means for integrating in-store price information and online shopping price information to identify the lowest price" refers to an algorithm that compares collected in-store and online price information and identifies the product with the lowest price.

[0972] The "means for displaying the cheapest price information to the user" is a method for displaying the identified cheapest price information to the user through a smartphone app or web interface.

[0973] The "means for displaying the location of the store on a map based on the store information" is a method for displaying the location of the store on a map using a map API (e.g., Google Maps API).

[0974] "Emotion analysis means for recognizing emotions from a user's facial expressions and voice" is a technology for analyzing a user's facial expressions and voice data collected using a camera or microphone to recognize the user's emotional state.

[0975] The "means for dynamically adjusting the displayed content according to the user's emotions" is an algorithm that changes the displayed information and suggested content based on the recognized user's emotions.

[0976] This invention is a system that collects price information from stores and online shopping sites and helps users purchase products at the lowest price. Furthermore, by combining it with emotion analysis technology, it realizes flexible information display and suggestions according to the user's emotions. Specific embodiments will be described.

[0977] Hardware and software used

[0978] The following hardware and software are used in this system:

[0979] Server: Private cloud, AWS, or Google Cloud

[0980] Database: MySQL or PostgreSQL

[0981] API: Public API for each store and online shopping site

[0982] Smartphone: iOS or Android device

[0983] Camera and microphone: Built-in to device

[0984] Emotion engine: OpenAI API, Kairos (emotion analysis API)

[0985] Map API: Google Maps API

[0986] System configuration

[0987] 1. Data Collection

[0988] The server periodically sends requests to each store's API endpoint to retrieve pricing information and flyer data, which is then formatted and stored in a database.

[0989] 2. Receipt of User Request

[0990] Users use a smartphone app to input information about the product they wish to purchase, which is then sent to the server in JSON format.

[0991] 3. Database Search

[0992] The server searches the price information in the database based on the received user request and identifies the cheapest product.

[0993] 4. Collecting Online Pricing Information

[0994] The server uses the API of each online shopping site to obtain price information and integrates it with the store's price information.

[0995] 5. Integration and display of results

[0996] The server sends the consolidated results to the user's device, where a smartphone app displays them.

[0997] 6. Displaying stores on a map

[0998] The smartphone app uses the Google Maps API to display the location of the store with the lowest price on a map.

[0999] 7. Sentiment Analysis and Dynamic Adjustment

[1000] The server analyzes the user's facial expressions and voice recorded through the camera and microphone, and recognizes the user's emotions using an emotion engine (OpenAI's API, Kairos).The server dynamically adjusts the content displayed and suggestions provided based on the user's emotions.

[1001] Specific examples

[1002] For example, if a user searches for "milk, seasonings, rice," the system will perform the following functions:

[1003] 1. The user enters "milk, seasonings, rice" into the app and submits a request.

[1004] 2. The server searches the database for the cheapest "milk, seasonings, and rice" and aggregates the results.

[1005] 3. The server uses the API of an online shopping site to collect price information about similar products.

[1006] 4. The server aggregates in-store and online pricing information to identify the cheapest option.

[1007] 5. The server sends the results to the user's device.

[1008] 6. The device displays the results to the user and shows the store's location on a map.

[1009] 7. The device uses an emotion engine to analyze the user's facial expressions and voice, and dynamically adjusts the display content based on the user's emotions.

[1010] Prompt Sentence Examples

[1011] Product list: Milk, seasonings, rice

[1012] View: Map, Dashboard

[1013] Expression: Unhappy

[1014] With the above configuration, users can quickly and efficiently find the cheapest products, and with the support of the emotion engine, they can enjoy a more comfortable and satisfying purchasing experience.

[1015] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1016] Step 1:

[1017] A user opens a smartphone app and inputs the items they wish to purchase, such as "milk, seasonings, and rice." Once the input is complete, the device sends this information to the server in JSON format (e.g., "{"products": ["milk", "seasonings", "rice"]}").

[1018] Step 2:

[1019] The server analyzes the received JSON-formatted user request and searches for the corresponding product information in the database. Specifically, it executes an SQL query based on the product name to obtain information on the store with the cheapest price. The input is the user request information, and the output is the cheapest price information.

[1020] Step 3:

[1021] The server uses the API of online shopping sites to collect price information for products that users wish to purchase. It generates API requests for each online shopping site and accesses them to obtain price data. The input is the API request, and the output is the price information obtained from the online shopping site.

[1022] Step 4:

[1023] The server integrates the price information of the store and the price information of the online shopping site to identify the cheapest price. At this stage, the collected price information is compared and the product information with the cheapest price is selected. The input is all the collected price information, and the output is the result of identifying the cheapest price.

[1024] Step 5:

[1025] The server sends the consolidated price information to the user's device in JSON format, for example, "{"Milk": {"Store": "A", "Price": 100 yen}, "Seasoning": {"Store": "B", "Price": 200 yen}, "Rice": {"Online Shopping": "Site C", "Price": 300 yen}}".

[1026] Step 6:

[1027] The terminal displays the price information received from the server on the user interface, allowing the user to visually check the information on the cheapest product. It also uses the Google Maps API to display the location of the store offering the cheapest price on a map and provide a navigation function. The input is the price information from the server, and the output is the display on the user interface and the map display.

[1028] Step 7:

[1029] The device's camera and microphone are used to collect the user's facial expressions and voice in real time. The data acquired from the camera and microphone is sent to a server and analyzed by an emotion analysis engine (e.g., OpenAI API, Kairos). The input is the user's facial expressions and voice data, and the output is the analyzed emotional state.

[1030] Step 8:

[1031] The server dynamically adjusts the display content based on the user's emotions based on the results of emotion analysis. For example, if the user looks dissatisfied, it will suggest alternative products or display detailed explanations. The input is the emotion analysis results, and the output is the adjusted display content.

[1032] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1033] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1034] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1035] [Third embodiment]

[1036] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1037] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1038] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1039] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1040] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1041] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1042] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1043] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1044] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1045] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1046] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1047] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1048] A system for carrying out the present invention provides information that enables a user to purchase a desired product efficiently and at the lowest possible price. An embodiment of the system will be described in detail below.

[1049] Data collection

[1050] server

[1051] The server periodically collects price information and flyer data provided by each store and stores it in a database. At this time, the server sends an API request to each store's endpoint, formats the acquired data, and stores it in the database. For example, the server sends a request to the API endpoint of "Store A," acquires price information for "Milk," "Condiments," and "Rice," and stores it in the database.

[1052] Receiving a user request

[1053] User

[1054] Users input the items they wish to purchase through a dedicated smartphone app or web interface. For example, a user might input "milk, seasonings, and rice." This information is then sent to the server via the device.

[1055] Terminal

[1056] After receiving the user's input, the terminal sends the information to the server, which then searches for product price information based on the received information.

[1057] Database search

[1058] server

[1059] The server searches the database for price information based on the user request it receives, finds the cheapest product, and aggregates that information. For example, the server extracts the price information for "milk" from the database and identifies the store that sells it at the cheapest price.

[1060] Price comparison with online shopping

[1061] server

[1062] The server also collects price information from online shopping sites to compare with the store's price information, using the API of each online shopping site, and combines the obtained online price information with the store's price information to determine the most cost-effective option for the user.

[1063] Integration and display of results

[1064] server

[1065] The server integrates store and online shopping data to identify the cheapest price for the user. It then sends the results to the user's device. For example, the cheapest "milk" is "Store X," which costs 100 yen.

[1066] Terminal

[1067] The terminal displays the results received from the server to the user. Specifically, it displays the product price information, the name of the store where the product can be purchased, and a link to the online shopping site. For example, it displays information such as "Milk: 100 yen at store X, 105 yen at online shopping site Y."

[1068] Display on the map

[1069] Terminal

[1070] The device displays a marker on a map based on the store's location information, allowing the user to easily access the nearest store. For example, when a user selects "Store X," the location of "Store X" is displayed on a map and a navigation function is provided.

[1071] Specific examples

[1072] For example, if a user searches for "milk, seasonings, rice," the system will provide information in the following order:

[1073] 1. The user enters "milk, seasonings, rice" into the app and submits a request.

[1074] 2. The server searches the database for the cheapest "milk, seasonings, and rice" and aggregates the results.

[1075] 3. The server uses the API of an online shopping site to collect price information about similar products.

[1076] 4. The server aggregates in-store and online pricing information to identify the cheapest option.

[1077] 5. The server sends the results to the user's device.

[1078] 6. The device displays the results to the user and shows the store's location on a map.

[1079] In this way, users can quickly and efficiently find the cheapest products. This system significantly reduces the effort required by consumers and provides a convenient and cost-effective shopping experience.

[1080] The processing flow will be explained below.

[1081] Step 1:

[1082] The server periodically sends requests to each store's API endpoint to obtain the latest price information and flyer data. The obtained data is formatted and stored in a database. For example, price information for "milk," "seasonings," and "rice" is obtained from "Store A" and stored in the database.

[1083] Step 2:

[1084] The user enters the product information they wish to purchase through a dedicated smartphone app or web interface. For example, the user might enter "milk, seasonings, and rice."

[1085] Step 3:

[1086] The device receives the user's input and sends the information to the server. For example, it sends a request for "milk, seasonings, and rice" in JSON format to the server.

[1087] Step 4:

[1088] The server receives the user's request and searches for the corresponding product information in the database, for example, searching for the price information for "milk" and identifying the store with the cheapest price.

[1089] Step 5:

[1090] The server uses the API of an online shopping site to collect price information for the same products. For example, it sends a request to the API endpoint of Amazon or Rakuten to obtain price information for "milk," "seasoning," and "rice."

[1091] Step 6:

[1092] The server compares and integrates price information obtained from stores with price information obtained from online shopping. For example, it compares "Milk at Store A for 100 yen" with "Milk at Amazon for 105 yen" and selects the store where the price is 100 yen.

[1093] Step 7:

[1094] The server sends the integrated results to the user's device. For example, it sends information such as "Milk: 100 yen at store A, seasoning: 200 yen at store B, rice: 300 yen at store C."

[1095] Step 8:

[1096] The terminal displays the results received from the server to the user. Specifically, it displays product price information, the name of the store where the product can be purchased, a link to the online shopping site, etc. For example, it displays "Milk: 100 yen at store A - Address: XX" or "Condiment: 200 yen at store B - Address: XX".

[1097] Step 9:

[1098] The device displays the nearest store on a map based on the store's location information. The user can refer to the map to confirm the store's location. The device also uses the navigation function to display the route to the store. For example, a marker for "Store A" is displayed on the map, and route guidance is provided.

[1099] This allows users to quickly and efficiently find the cheapest products and also check the store's location on a map.

[1100] Example 1

[1101] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1102] In the past, in order to efficiently purchase the product they wanted at the lowest price, users had to check multiple stores and online sales sites individually, which required a lot of time and effort.It was also difficult to compare prices in real time, making it difficult to find the best option.

[1103] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1104] In this invention, the server includes means for a user to input information about a product they wish to purchase, means for collecting price information from retail stores and saving it in a database, means for collecting price information from online sales sites, means for integrating the price information from retail stores and the price information from online sales sites to identify the cheapest price, means for displaying the cheapest price information to the user, and means for displaying the locations of retail stores on a map based on the retail store information, thereby enabling users to efficiently find the cheapest products.

[1105] "User" refers to a consumer who uses this system to input information about a product they wish to purchase.

[1106] "Means for inputting product information for purchase" refers to an interface that allows users to input the products they wish to purchase via a smartphone app or web interface.

[1107] "Sales store" refers to a physical store that actually sells products.

[1108] "Means of collecting price information and storing it in a database" refers to a system for obtaining price information from retail stores using an API or other means and storing it in a database.

[1109] "Online Sales Site" means a website that sells products over the Internet.

[1110] "Means of collecting price information" refers to a system for obtaining price information from online sales sites using APIs, etc.

[1111] "Means for integrating price information and identifying the lowest price" refers to an algorithm or process for integrating price information obtained from retail stores and online retail sites to identify the product with the lowest price for the user.

[1112] The "means for displaying the lowest price information" refers to an interface for visually displaying to the user the product information with the lowest price from the integrated price information.

[1113] "Means for displaying the location of a retail store on a map based on retail store information" refers to a function for displaying the location of a retail store on a map based on its location information and providing it visually to the user.

[1114] The present invention is a system that provides information to help users purchase desired products efficiently and at the lowest possible price. This system consists of three main components: the user, the terminal, and the server.

[1115] Data collection

[1116] server

[1117] The server periodically collects price information and flyer data provided by retail stores and online retail sites and stores it in a database. Specifically, the server uses an API to send requests to each store's endpoint, formats the retrieved data, and stores it in the database. For example, the server sends a request to the API endpoint of "Store A" to retrieve price information for "Milk," "Condiments," and "Rice," and stores the information in the database.

[1118] Receiving a user request

[1119] User

[1120] Users input the items they wish to purchase through a dedicated smartphone app or web interface. For example, a user might input "milk, seasonings, and rice." This information is then sent to the server via the device.

[1121] Terminal

[1122] After receiving the user's input, the terminal transmits the information to the server. Specifically, the terminal transmits a request including the input data to the server using the HTTPS protocol.

[1123] Database search

[1124] server

[1125] The server searches the database for price information based on the received user request, finds the cheapest product, and aggregates that information. For example, the server extracts the price information for "milk" from the database and identifies the store that sells it at the cheapest price.

[1126] Price comparison with online shopping

[1127] server

[1128] The server also collects price information from online retailers to compare with the retailer's price information, using the API of each online retailer. The server then combines the obtained online price information with the retailer's price information to determine the most cost-effective option for the user.

[1129] Integration and display of results

[1130] server

[1131] The server aggregates data from retail stores and online retail sites to identify the cheapest price for the user. It then sends the results to the user's device. For example, the cheapest "milk" is "Store X," which costs 100 yen.

[1132] Terminal

[1133] The device displays the results received from the server to the user. Specifically, it displays the product price information, the name of the store where the product can be purchased, and a link to the online shopping site. For example, it displays information such as "Milk: 100 yen at store X, 105 yen at online shopping site Y."

[1134] Display on the map

[1135] Terminal

[1136] The device displays a marker on a map based on the store's location information, allowing users to easily access the nearest store. For example, when a user selects "Store X," the device displays the location of "Store X" on a map and provides navigation functionality.

[1137] Specific examples

[1138] For example, if a user searches for "milk, seasonings, rice," the system will provide information in the following order:

[1139] 1. The user enters "milk, seasonings, rice" into the app and submits a request.

[1140] 2. The server searches the database for the cheapest "milk, seasonings, and rice" and aggregates the results.

[1141] 3. The server uses the API of an online retailer to collect price information about similar products.

[1142] 4. The server aggregates in-store and online pricing information to identify the cheapest option.

[1143] 5. The server sends the results to the user's device.

[1144] 6. The device displays the results to the user and shows the store's location on a map.

[1145] In this way, users can quickly and efficiently find the cheapest products. This system significantly reduces the effort required by consumers and provides a convenient and cost-effective shopping experience.

[1146] Example prompts for generative AI models

[1147] Below are some example prompts to input to the generative AI model:

[1148] "Get information on retail stores and online shops that offer the lowest prices on a particular product"

[1149] "Explain how you would collect price information for milk, condiments, and rice, and then perform a comparative analysis to present the cheapest options."

[1150] This allows the generative AI model to explain the entire process, from how data is collected to how the results are displayed.

[1151] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1152] Step 1: Send a request to collect data and get a response

[1153] server

[1154] The server sends a request to an API endpoint to collect price information from retail stores and online retail sites. For example, a request is sent to the endpoint of "Store A" requesting price information for "Milk," "Condiments," and "Rice." The data returned as a response is received in JSON format. This data includes information such as the product name, price, store name, and update date and time.

[1155] Input: API endpoint and request parameters (product name)

[1156] Output: Price information in JSON format

[1157] Specific behavior:

[1158] 1. The server generates an HTTP request and sends it to the API endpoint.

[1159] 2. Receive a response in JSON format from the API endpoint.

[1160] 3. Parse the received JSON data and extract the necessary information.

[1161] Step 2: Saving to the database

[1162] server

[1163] The server formats the acquired price information and saves it in the database. Information such as product name, price, store name, and update date and time is inserted or updated in the corresponding table according to the database structure.

[1164] Input: Price information in JSON format

[1165] Output: Price information stored in a database

[1166] Specific behavior:

[1167] 1. Extract product name, price, store name, and update date and time from JSON data.

[1168] 2. Connect to the database and generate and execute SQL queries to insert or update data into the appropriate tables.

[1169] Step 3: Enter the product you want to purchase

[1170] User

[1171] Using a dedicated smartphone app or web interface, users input information about the products they wish to purchase. For example, they might enter "milk, seasonings, and rice" and press the search button. This information is then sent to the server via the user's device.

[1172] Input: Product information you wish to purchase (user input)

[1173] Output: User request data

[1174] Specific behavior:

[1175] 1. The user enters the product information they wish to purchase into the app's search bar.

[1176] 2. The input data is sent to the server via the terminal.

[1177] Step 4: Sending the user request to the server

[1178] Terminal

[1179] The terminal transmits the user's input data to the server. Specifically, the terminal transmits the user's request data to the server using the HTTPS protocol.

[1180] Input: User request data

[1181] Output: Request sent to server

[1182] Specific behavior:

[1183] 1. Generate an HTTP request containing the user's request data.

[1184] 2. Send the generated request to the server using the HTTPS protocol.

[1185] Step 5: Retrieve price information from the database

[1186] server

[1187] The server searches the database for price information based on the user's request. Specifically, it searches for price information for product names such as "milk," "seasoning," and "rice" to find the cheapest product.

[1188] Input: User request data

[1189] Output: The product with the lowest price

[1190] Specific behavior:

[1191] 1. Generate an SQL query based on the user request.

[1192] 2. Query the database and retrieve the results.

[1193] 3. Extract and list the product information with the lowest price.

[1194] Step 6: Collect price information from online shopping sites

[1195] server

[1196] The server collects price information from the API of an online sales site. For example, it sends a request to the API of "Online Shop B" to obtain price information for "milk, seasonings, and rice." The obtained data is formatted and stored in a temporary data store.

[1197] Input: Online API endpoint and request parameters

[1198] Output: Online price information in JSON format

[1199] Specific behavior:

[1200] 1. The server sends a request to the online retailer's API.

[1201] 2. Receive the acquired online price information in JSON format.

[1202] 3. Parse the JSON data and save it to a temporary data store.

[1203] Step 7: Consolidate and compare pricing information

[1204] server

[1205] The server combines the price information from retail stores and online retailers to identify the lowest prices, comparing both sets of data and calculating the lowest price for each product.

[1206] Input: Retail store and online pricing information

[1207] Output: Identify and list the cheapest options

[1208] Specific behavior:

[1209] 1. Convert pricing information from retail stores and online retail sites into a unified format.

[1210] 2. Compare the prices of each item and identify the cheapest option.

[1211] 3. List the cheapest results.

[1212] Step 8: Generate and submit results

[1213] server

[1214] The server identifies the cheapest product price and its source, then sends the results to the user's device, formatting the results in JSON format and sending them as a response.

[1215] Input: List of cheapest options

[1216] Output: JSON formatted results

[1217] Specific behavior:

[1218] 1. Convert the list of cheapest options into JSON format.

[1219] 2. Send it as an HTTP response to the user's device.

[1220] Step 9: View the results

[1221] Terminal

[1222] The terminal displays the results received from the server to the user, including price information, the names of stores where the product can be purchased, and links to online shops.

[1223] Input: Response data from the server

[1224] Output: Information displayed on the user interface

[1225] Specific behavior:

[1226] 1. Analyze the response data from the server.

[1227] 2. Display the analyzed data in the user interface.

[1228] Step 10: Map location and navigation

[1229] Terminal

[1230] The device displays markers on a map based on the location information of retail stores, allowing users to easily access the nearest store, and also provides a navigation function.

[1231] Input: Store location information

[1232] Output: Map markers and navigation route

[1233] Specific behavior:

[1234] 1. Obtain the store's location information and send it to the map API.

[1235] 2. Display store markers on the map.

[1236] 3. Display navigation route to the selected store.

[1237] (Application example 1)

[1238] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1239] In recent years, consumers have increasingly sought the cheapest way to purchase the same product from multiple stores and online shopping sites. However, comparing and searching each store and online shopping site individually is time-consuming and laborious. Even if you find the cheapest store, you may not know the store's specific location, making it difficult to purchase the product efficiently. Furthermore, limited access to product reviews and ratings often leaves consumers unsure of their purchasing decisions. The present invention aims to solve these problems.

[1240] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1241] In this invention, the server includes means for a user to input information about a product they wish to purchase, means for collecting store price information and saving it in a database, means for collecting online shopping price information, means for integrating store price information and online shopping price information to identify the cheapest price, means for displaying the cheapest price information to the user, means for displaying store locations on a map based on the store information, means for displaying product reviews and ratings, and means for managing purchase history. This enables consumers to efficiently and quickly find the cheapest products, check location information, and make optimal purchasing decisions by referring to reviews and ratings.

[1242] "Means for users to input product information they wish to purchase" refers to the function whereby a user uses a device such as a smartphone or computer to input the name of the product they wish to purchase and send a request to the system.

[1243] "Means of collecting store price information and storing it in a database" refers to a server or API integration mechanism that periodically obtains product price information provided by physical stores and records and stores this information in a database.

[1244] "Means for collecting online shopping price information" refers to the function of obtaining product price information from various online shopping sites via APIs, etc., and storing this information in a database.

[1245] "Means of integrating in-store price information and online shopping price information to identify the cheapest price" refers to algorithms and software that centrally manage and compare collected price information from physical and online stores, and extract the most economical option for the user.

[1246] "Means for displaying the lowest price information to the user" refers to the function of selecting the lowest price from the integrated price information and visually presenting it on the user's device.

[1247] "Means for displaying the location of a store on a map based on the store information" refers to a function that displays the geographical location information of a store offering the lowest priced product on a map, allowing users to easily find the store.

[1248] "Means for displaying product reviews and ratings" refers to a function that collects opinions and ratings from users of products that the user is considering purchasing from the Internet and displays them to the user.

[1249] "Means for managing purchase history" refers to a function that stores records of products purchased by users in a database and allows them to refer to these records later.

[1250] The system for implementing this invention provides information that allows users to purchase desired products efficiently and at the lowest possible cost. The system is mainly composed of three elements: a server, a terminal, and a user interface.

[1251] The server periodically collects price information, reviews, and ratings from each physical store and online shopping site, and stores them in a database. The server uses an API to obtain this information and integrates and manages it in the database. For price information from physical stores, it obtains and stores the prices of specific products (e.g., milk, seasonings, rice, etc.). It also collects price information from online shopping sites for similar products, and stores this in the database.

[1252] Users input the items they wish to purchase through an application on their smartphone or computer. The information they input is sent to a server via their device. The server then searches a database of price information based on the user's request to identify the cheapest option, which includes information from physical stores and online shopping.

[1253] The terminal displays the results received from the server to the user. Specifically, it displays the cheapest price information for the product entered by the user, the name of the store where the product can be purchased, and a link to the online shopping site. In addition, it displays the location of the store on a map, providing a navigation function that allows the user to easily access the nearest store. This allows the user to efficiently purchase the cheapest product.

[1254] The system can also display product reviews and ratings, allowing users to make purchasing decisions based on not only price information but also the product's quality and the ratings of other users. It also has a purchasing history management function, allowing users to plan future purchases while referring to their past purchase history.

[1255] As a concrete example, if a user searches for "milk, seasonings, rice," the system provides information in the following way. When a user enters "milk, seasonings, rice" into the app and sends a request, the server searches the database for the cheapest "milk, seasonings, rice" and aggregates the results. The server then uses the API of an online shopping site to collect price information for similar products and integrates the two. The identified cheapest option is sent to the user's device, and the user can view price information, the name of the store where the product is available, and a link to the online shopping site on the app. The nearest store is also displayed on a map, and users can also view reviews, ratings, and past purchase history. This allows users to quickly and efficiently find the cheapest, highest-quality products.

[1256] Example prompt sentence:

[1257] Please compare prices for "Milk, Seasonings, and Rice" and let me know the cheapest options. Also, please show me the location of the nearest store.

[1258] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1259] Step 1:

[1260] User enters product information

[1261] A user uses an application on a smartphone or PC to input product information (e.g., "milk, seasoning, rice") and send a request. This input information is then sent to the server via the terminal.

[1262] Input: Product information entered by the user

[1263] Output: Request data sent to the server via the terminal

[1264] Step 2:

[1265] Collect store prices

[1266] The server sends requests to each physical store's API endpoint to retrieve pricing information for specific products. This collected data is then formatted and stored in a database.

[1267] Input: API request from the server

[1268] Data processing: Format the collected price information and convert it into a storage format.

[1269] Output: Price information stored in the database

[1270] Step 3:

[1271] Collecting online shopping price information

[1272] The server then sends requests to each online shop's API endpoint to retrieve pricing information for specific products, which is then formatted and stored in the database.

[1273] Input: API request from the server

[1274] Data processing: Format the collected price information and convert it into a storage format.

[1275] Output: Online pricing information stored in a database

[1276] Step 4:

[1277] Consolidating pricing information and identifying the best prices

[1278] The server retrieves price information from a database based on the request received from the user, integrates price information from physical stores and online stores, and identifies the lowest price from the integrated information.

[1279] Input: Price information extracted from databases (both physical and online stores)

[1280] Data Calculation: Compare prices and find the best deals

[1281] Output: The cheapest price and the store (or online shop) that offers it

[1282] Step 5:

[1283] Displaying results to the user

[1284] The terminal displays the lowest price information received from the server, the name of the store offering the price, and a link to the online shop to the user.

[1285] Input: The lowest price information sent from the server

[1286] Output: Price information and links displayed on the user's device

[1287] Step 6:

[1288] Displaying store locations on a map

[1289] The device displays a store marker on a map based on the location information of the store offering the cheapest products, providing navigation functionality.

[1290] Input: Store location information

[1291] Output: Store markers and navigation routes displayed on the map

[1292] Step 7:

[1293] Displaying product reviews and ratings

[1294] The server collects reviews and ratings of specific products from the Internet and displays them to the user.

[1295] Input: Collected reviews and ratings

[1296] Output: Reviews and ratings displayed on the user's device

[1297] Step 8:

[1298] Purchase history management

[1299] The terminal records the user's purchase history and manages it for later reference.

[1300] Input: Information about the product purchased by the user

[1301] Output: Purchase history information stored in a database

[1302] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1303] The present invention combines an emotion engine with a system that provides information on products that users want to purchase efficiently and at the lowest possible cost. An embodiment of the present invention will be described in detail below.

[1304] Data collection

[1305] server

[1306] The server periodically collects price information and flyer data provided by each store and stores it in a database. To do this, the server sends an API request to each store's endpoint, formats the acquired data, and stores it in the database. For example, the server obtains price information for "milk," "seasonings," and "rice" from "Store A" and stores it in the database.

[1307] Receiving a user request

[1308] User

[1309] Users input the items they wish to purchase through a dedicated smartphone app or web interface. For example, a user might input "milk, seasonings, and rice." This information is then sent to the server via the device.

[1310] Terminal

[1311] After receiving the user's input, the device sends the information to the server. For example, it sends a request for "milk, seasonings, and rice" in JSON format to the server.

[1312] Database search

[1313] server

[1314] The server searches for the corresponding product information in the database based on the received user request, finds the cheapest product, and aggregates that information. For example, the server extracts the price information for "milk" from the database and identifies the store with the cheapest price.

[1315] Price comparison with online shopping

[1316] server

[1317] The server also collects price information from online shopping sites to compare with the store's price information, using the API of each online shopping site, and combines the obtained online price information with the store's price information to determine the most cost-effective option for the user.

[1318] Integration and display of results

[1319] server

[1320] The server integrates store and online shopping data to identify the cheapest price for the user. It then sends the results to the user's device. For example, the cheapest "milk" is "Store X," which costs 100 yen.

[1321] Terminal

[1322] The terminal displays the results received from the server to the user. Specifically, it displays the product price information, the name of the store where the product can be purchased, and a link to the online shopping site. For example, it displays information such as "Milk: 100 yen at store X, 105 yen at online shopping site Y."

[1323] Display on the map

[1324] Terminal

[1325] The device displays a marker on a map based on the store's location information, allowing the user to easily access the nearest store. For example, when a user selects "Store X," the location of "Store X" is displayed on a map and a navigation function is provided.

[1326] Emotion engine integration

[1327] server

[1328] The server has an emotion engine that recognizes emotions from the user's facial expressions and voice. This engine analyzes data obtained from the camera and microphone in real time while the user is using the app or web interface. For example, if a user looks dissatisfied after viewing price information, the engine recognizes the emotion.

[1329] Emotion-Based Adjustment

[1330] Terminal

[1331] The device dynamically adjusts the display method according to the user's emotions based on the analysis results of the emotion engine sent from the server. For example, if the user looks dissatisfied, the system will suggest alternative products or display detailed descriptions of specific products. If the user looks satisfied, the current display will be maintained.

[1332] Specific examples

[1333] For example, if a user searches for "milk, seasonings, rice," the system will provide information in the following order:

[1334] 1. The user enters "milk, seasonings, rice" into the app and submits a request.

[1335] 2. The server searches the database for the cheapest "milk, seasonings, and rice" and aggregates the results.

[1336] 3. The server uses the API of an online shopping site to collect price information about similar products.

[1337] 4. The server aggregates in-store and online pricing information to identify the cheapest option.

[1338] 5. The server sends the results to the user's device.

[1339] 6. The device displays the results to the user and shows the store's location on a map.

[1340] 7. The device uses an emotion engine to analyze the user's facial expressions and voice, and dynamically adjusts the display content based on the user's emotions.

[1341] This system allows users to find the cheapest products quickly and efficiently, and with the support of an emotion engine, they can enjoy a more comfortable purchasing experience.

[1342] The processing flow will be explained below.

[1343] Step 1:

[1344] The server sends a request to each store's API endpoint to obtain the latest price information and flyer data. The obtained data is formatted and stored in a database. For example, price information for "milk," "seasonings," and "rice" is obtained from "Store A" and stored in the database.

[1345] Step 2:

[1346] The user enters the product information they wish to purchase through a dedicated smartphone app or web interface. For example, the user might enter "milk, seasonings, and rice."

[1347] Step 3:

[1348] The device receives the user's input and sends the information to the server. For example, it sends a request for "milk, seasonings, and rice" in JSON format to the server.

[1349] Step 4:

[1350] The server receives the user's request and searches for the corresponding product information in the database. For example, the server searches for price information for "milk," "seasonings," and "rice" and identifies the store with the lowest price.

[1351] Step 5:

[1352] The server uses the API of an online shopping site to collect price information for the same products. For example, it sends a request to the API endpoint of Amazon or Rakuten to obtain price information for "milk," "seasoning," and "rice."

[1353] Step 6:

[1354] The server compares and integrates price information obtained from stores with price information obtained from online shopping. For example, it compares "Milk from Store A for 100 yen" with "Milk from Amazon for 105 yen" and selects the store that sells it for 100 yen.

[1355] Step 7:

[1356] The server sends the integrated results to the user's device. For example, it might send information such as "Milk: 100 yen at store A, seasoning: 200 yen at store B, rice: 300 yen at store C."

[1357] Step 8:

[1358] The terminal displays the results received from the server to the user. Specifically, it displays product price information, the names of stores where the product can be purchased, and links to online shopping sites. For example, it might display "Milk: 100 yen at store A, seasoning: 200 yen at store B, rice: 300 yen at store C."

[1359] Step 9:

[1360] The device displays the nearest store on a map based on the store's location information. The user can refer to the map to confirm the store's location. The device also uses the navigation function to display the route to the store. For example, a marker for "Store A" is displayed on the map, and route guidance is provided.

[1361] Step 10:

[1362] The device sends data acquired from the user's camera and microphone to the emotion engine, which analyzes the user's emotions. For example, if the user looks dissatisfied after viewing price information, that emotion will be analyzed.

[1363] Step 11:

[1364] The server receives the analysis results from the emotion engine and dynamically adjusts the display method based on the user's emotions. For example, if the user looks dissatisfied, the system will suggest alternative products or display detailed information about specific products. If the user looks satisfied, the current display will be maintained.

[1365] This processing step allows the user to not only purchase products efficiently and at the lowest possible cost, but also to enjoy a pleasant purchasing experience using the emotion engine.

[1366] Example 2

[1367] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1368] Until now, users have lacked a means to easily and efficiently obtain product information and purchase it at the lowest price. In particular, it has been difficult to integrate price information from stores and online shopping sites, identify the lowest price in real time, and provide it to users. In addition, the display has not been adjusted based on user emotions, making it difficult to improve the quality of the user experience.

[1369] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1370] In this invention, the server includes means for a user to input information about a product they wish to purchase, means for collecting store price information and saving it in a database, means for collecting online shopping price information, means for integrating store price information and online shopping price information to identify the cheapest price, means for displaying the cheapest price information to the user, means for displaying store locations on a map based on the store information, means for using an emotion engine that recognizes emotions from the user's facial expressions and voice, and means for dynamically adjusting display content based on the recognized emotion. This enables the user to efficiently obtain information about the cheapest products and enjoy a pleasant shopping experience through display adjustments using the emotion engine.

[1371] A "user" is an individual or organization that uses the system to input product information and obtain the cheapest price information.

[1372] "Information about the product desired to be purchased" is information about the name and type of the product that the user wishes to purchase.

[1373] "Store price information" refers to price information for products sold in physical stores.

[1374] "Online shopping price information" refers to price information for products sold online.

[1375] A "database" is a digital storage device that organizes and stores collected store price information and online shopping price information.

[1376] "API" stands for Application Programming Interface, a mechanism for exchanging data and functions between different software programs.

[1377] An "emotion engine" is an algorithm or software that analyzes a user's facial expressions and voice and recognizes their emotional state.

[1378] "Dynamic adjustment of display content" means that the system changes the information displayed and interface layout in real time according to the user's emotional state.

[1379] "Displaying store locations on a map" is a function in which the system visually displays the user's current location or the location of a selected store on a map.

[1380] The present invention is a system that provides users with information that allows them to efficiently obtain product information they wish to purchase at the lowest possible cost, and further improves the user experience by combining it with an emotion engine. Specific embodiments of the system are described below.

[1381] In this system, the server, terminal, and user components work together to collect, analyze, and display data using various hardware and software.

[1382] Hardware and software used

[1383] 1. Server

[1384] Price information is collected from each store and online shopping site using an API.

[1385] Organize and store price information in a database.

[1386] An emotion engine is implemented to recognize emotions from the user's facial expressions and voice.

[1387] 2. Terminal

[1388] Sends the user's input to the server.

[1389] The response from the server is displayed to the user, and the store location is displayed on a map so that the user can access the nearest store.

[1390] The user's facial expressions and voice are captured and sent to the server.

[1391] 3. Users

[1392] Enter the product information you wish to purchase via a smartphone app or web interface.

[1393] Data processing and calculation flow

[1394] 1. The server periodically sends requests to each store's endpoint to collect price information and flyer data. This is done using each store's API. For example, the server obtains price information for "milk," "seasonings," and "rice" from "Store A" and stores it in the database.

[1395] 2. The user enters the product information they wish to purchase into a dedicated smartphone app or web interface and submits a request. For example, the user enters "milk, seasonings, and rice." This information is sent to the server via the device.

[1396] 3. The device converts the user's input into JSON format, generates an HTTP request to send to the server, and sends it.

[1397] 4. The server searches the corresponding product information in the database, finds the cheapest product, and aggregates it. For example, it extracts the price information for "milk" from the database and identifies the store that offers the cheapest price.

[1398] 5. The server uses the API of the online shopping site to collect price information about similar products and integrates it with the store's price information.

[1399] 6. The server sends the lowest price information to the user's device, which displays it to the user. For example, "Milk: 100 yen at store X, 105 yen at online store Y."

[1400] 7. The device will display a marker on the map based on the store's location information, allowing the user to access the nearest store. For example, when the user selects "Store X," its location will be displayed on the map.

[1401] 8. The server analyzes data obtained from the camera and microphone in real time while the user is using the app or web interface to recognize the user's emotions. For example, if the user looks dissatisfied after viewing price information, the server recognizes that emotion.

[1402] 9. The device receives the emotion engine's analysis results from the server and dynamically adjusts the display method. For example, if the user looks dissatisfied, it will suggest an alternative product or display a detailed product description. If the user looks satisfied, it will maintain the current display.

[1403] Specific examples

[1404] For example, if a user searches for "milk, seasonings, rice," the system will provide information in the following order:

[1405] 1. The user enters "milk, seasonings, rice" into the app and submits a request.

[1406] 2. The server searches the database for the cheapest "milk, seasonings, and rice" and aggregates the results.

[1407] 3. The server uses the API of an online shopping site to collect price information about similar products.

[1408] 4. The server aggregates in-store and online pricing information to identify the cheapest option.

[1409] 5. The server sends the results to the user's device.

[1410] 6. The device displays the results to the user and shows the store's location on a map.

[1411] 7. The device uses an emotion engine to analyze the user's facial expressions and voice and dynamically adjust the display content.

[1412] An example of a prompt is as follows:

[1413] "Please explain a system that provides users with information on products they want to purchase efficiently and at the lowest possible price. This system incorporates an emotion engine."

[1414] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1415] Step 1:

[1416] Data collection

[1417] The server collects price information from each store and stores it in a database.

[1418] Input: Endpoint information for each store.

[1419] Output: Formatted pricing information stored in a database.

[1420] Specific operation: The server sends a request to each store's API, obtains price information for "milk," "seasonings," and "rice" from store A, formats the information, and saves it in the database.

[1421] Step 2:

[1422] Receiving a user request

[1423] Users enter information about the product they wish to purchase using a dedicated app or web interface and submit a request.

[1424] Input: Desired product information entered by the user, such as "milk, seasonings, rice."

[1425] Output: The user's request information is sent to the terminal.

[1426] Specific behavior: The user enters "milk, seasoning, rice" into the app, which is converted into JSON format and sent to the server.

[1427] Step 3:

[1428] Server reception of user requests

[1429] The terminal transmits the user's request to the server.

[1430] Input: A JSON request containing product information entered by the user.

[1431] Output: Triggers the server's price information lookup process.

[1432] Specific operation: The device generates an HTTP request to send JSON data containing the request for "milk, seasonings, and rice" to the server, and sends it to the server.

[1433] Step 4:

[1434] Database search

[1435] The server searches the product information in the database based on the request and identifies the lowest price.

[1436] Input: Product name based on user request.

[1437] Output: Data on the cheapest product.

[1438] Specific operation: The server executes a database query to extract the store information with the cheapest price for "milk," "seasoning," and "rice."

[1439] Step 5:

[1440] Price comparison with online shopping

[1441] The server collects price information from online shopping sites and compares it with the price information of the store.

[1442] Input: Product name based on user request, and API endpoint information of online shopping site.

[1443] Output: Consolidated best price information.

[1444] Specific operation: The server sends a request to the API endpoint of the online shopping site, obtains online price information for "milk," "seasonings," and "rice," and integrates it with the store.

[1445] Step 6:

[1446] Integration and display of results

[1447] The server aggregates the cheapest price information and sends it to the user's terminal.

[1448] Input: In-store and online shopping price information.

[1449] Output: Consolidated pricing information.

[1450] Specific operation: The server generates a result such as "Milk: 100 yen at store X, 105 yen at online shop Y" and sends it to the terminal.

[1451] Step 7:

[1452] Displaying results and providing location information

[1453] The terminal displays the results to the user and shows the store's location on a map.

[1454] Input: Lowest price information and location information provided by the server.

[1455] Output: Display in the user interface and a marker on the map.

[1456] Specific operation: The device analyzes the data received and displays it in the format "Milk: 100 yen at store X, 105 yen at online shop Y," and shows the store location on a map.

[1457] Step 8:

[1458] Emotion Engine Data Acquisition

[1459] The server acquires the user's facial expressions and voice and recognizes their emotions.

[1460] Input: Live data from the user's camera and microphone.

[1461] Output: Parsed emotional state.

[1462] Specific operation: The server collects data from the user's camera and microphone in real time and analyzes it using the emotion engine.

[1463] Step 9:

[1464] Emotion-based display adjustment

[1465] The device dynamically adjusts the display content based on the analysis results of the emotion engine.

[1466] Input: Parsed emotional state.

[1467] Output: Dynamic display of the user interface.

[1468] Specific operation: If the user looks dissatisfied, the device will suggest alternative products and display detailed explanations; if the user looks satisfied, the current display will be maintained.

[1469] (Application example 2)

[1470] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1471] Current shopping systems require users to spend a lot of time and effort to find the cheapest products. Furthermore, the user experience is uniform, and there is a problem in that the system is unable to flexibly display and suggest products that respond to individual emotions and preferences. In particular, comparing online and offline prices is often cumbersome, making it difficult for users to use. It is necessary to solve these issues and provide a new shopping experience that is user-friendly and responds to emotions.

[1472] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for a user to input information about a product they wish to purchase, means for collecting store price information and saving it in a database, means for collecting online shopping price information, means for integrating store price information and online shopping price information to identify the cheapest price, means for displaying the cheapest price information to the user, means for displaying store locations on a map based on the store information, emotion analysis means for recognizing emotions from the user's facial expressions and voice, and means for dynamically adjusting display content according to the user's emotions. This allows the user to quickly and efficiently find the cheapest product, and with the support of the emotion engine, a more comfortable and satisfying purchasing experience is possible.

[1473] The "means by which a user inputs information about a product they wish to purchase" refers to an interface that allows a user to input information about a product they wish to purchase using a smartphone app or web interface.

[1474] "Means of collecting store price information and saving it in a database" refers to a method of obtaining price information through each store's API endpoint, formatting it, and saving it in a database.

[1475] "Methods for collecting online shopping price information" refers to a method for obtaining and integrating price information using the API of an online shopping site.

[1476] "Means for integrating in-store price information and online shopping price information to identify the lowest price" refers to an algorithm that compares collected in-store and online price information and identifies the product with the lowest price.

[1477] The "means for displaying the cheapest price information to the user" is a method for displaying the identified cheapest price information to the user through a smartphone app or web interface.

[1478] The "means for displaying the location of the store on a map based on the store information" is a method for displaying the location of the store on a map using a map API (e.g., Google Maps API).

[1479] "Emotion analysis means for recognizing emotions from a user's facial expressions and voice" is a technology for analyzing a user's facial expressions and voice data collected using a camera or microphone to recognize the user's emotional state.

[1480] The "means for dynamically adjusting the displayed content according to the user's emotions" is an algorithm that changes the displayed information and suggested content based on the recognized user's emotions.

[1481] This invention is a system that collects price information from stores and online shopping sites and helps users purchase products at the lowest price. Furthermore, by combining it with emotion analysis technology, it realizes flexible information display and suggestions according to the user's emotions. Specific embodiments will be described.

[1482] Hardware and software used

[1483] The following hardware and software are used in this system:

[1484] Server: Private cloud, AWS, or Google Cloud

[1485] Database: MySQL or PostgreSQL

[1486] API: Public API for each store and online shopping site

[1487] Smartphone: iOS or Android device

[1488] Camera and microphone: Built-in to device

[1489] Emotion engine: OpenAI API, Kairos (emotion analysis API)

[1490] Map API: Google Maps API

[1491] System configuration

[1492] 1. Data Collection

[1493] The server periodically sends requests to each store's API endpoint to retrieve pricing information and flyer data, which is then formatted and stored in a database.

[1494] 2. Receipt of User Request

[1495] Users use a smartphone app to input information about the product they wish to purchase, which is then sent to the server in JSON format.

[1496] 3. Database Search

[1497] The server searches the price information in the database based on the received user request and identifies the cheapest product.

[1498] 4. Collecting Online Pricing Information

[1499] The server uses the API of each online shopping site to obtain price information and integrates it with the store's price information.

[1500] 5. Integration and display of results

[1501] The server sends the consolidated results to the user's device, where a smartphone app displays them.

[1502] 6. Displaying stores on a map

[1503] The smartphone app uses the Google Maps API to display the location of the store with the lowest price on a map.

[1504] 7. Sentiment Analysis and Dynamic Adjustment

[1505] The server analyzes the user's facial expressions and voice recorded through the camera and microphone, and recognizes the user's emotions using an emotion engine (OpenAI's API, Kairos).The server dynamically adjusts the content displayed and suggestions provided based on the user's emotions.

[1506] Specific examples

[1507] For example, if a user searches for "milk, seasonings, rice," the system will perform the following functions:

[1508] 1. The user enters "milk, seasonings, rice" into the app and submits a request.

[1509] 2. The server searches the database for the cheapest "milk, seasonings, and rice" and aggregates the results.

[1510] 3. The server uses the API of an online shopping site to collect price information about similar products.

[1511] 4. The server aggregates in-store and online pricing information to identify the cheapest option.

[1512] 5. The server sends the results to the user's device.

[1513] 6. The device displays the results to the user and shows the store's location on a map.

[1514] 7. The device uses an emotion engine to analyze the user's facial expressions and voice, and dynamically adjusts the display content based on the user's emotions.

[1515] Prompt Sentence Examples

[1516] Product list: Milk, seasonings, rice

[1517] View: Map, Dashboard

[1518] Expression: Unhappy

[1519] With the above configuration, users can quickly and efficiently find the cheapest products, and with the support of the emotion engine, they can enjoy a more comfortable and satisfying purchasing experience.

[1520] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1521] Step 1:

[1522] A user opens a smartphone app and inputs the items they wish to purchase, such as "milk, seasonings, and rice." Once the input is complete, the device sends this information to the server in JSON format (e.g., "{"products": ["milk", "seasonings", "rice"]}").

[1523] Step 2:

[1524] The server analyzes the received JSON-formatted user request and searches for the corresponding product information in the database. Specifically, it executes an SQL query based on the product name to obtain information on the store with the cheapest price. The input is the user request information, and the output is the cheapest price information.

[1525] Step 3:

[1526] The server uses the API of online shopping sites to collect price information for products that users wish to purchase. It generates API requests for each online shopping site and accesses them to obtain price data. The input is the API request, and the output is the price information obtained from the online shopping site.

[1527] Step 4:

[1528] The server integrates the price information of the store and the price information of the online shopping site to identify the cheapest price. At this stage, the collected price information is compared and the product information with the cheapest price is selected. The input is all the collected price information, and the output is the result of identifying the cheapest price.

[1529] Step 5:

[1530] The server sends the consolidated price information to the user's device in JSON format, for example, "{"Milk": {"Store": "A", "Price": 100 yen}, "Seasoning": {"Store": "B", "Price": 200 yen}, "Rice": {"Online Shopping": "Site C", "Price": 300 yen}}".

[1531] Step 6:

[1532] The terminal displays the price information received from the server on the user interface, allowing the user to visually check the information on the cheapest product. It also uses the Google Maps API to display the location of the store offering the cheapest price on a map and provide a navigation function. The input is the price information from the server, and the output is the display on the user interface and the map display.

[1533] Step 7:

[1534] The device's camera and microphone are used to collect the user's facial expressions and voice in real time. The data acquired from the camera and microphone is sent to a server and analyzed by an emotion analysis engine (e.g., OpenAI API, Kairos). The input is the user's facial expressions and voice data, and the output is the analyzed emotional state.

[1535] Step 8:

[1536] The server dynamically adjusts the display content based on the user's emotions based on the results of emotion analysis. For example, if the user looks dissatisfied, it will suggest alternative products or display detailed explanations. The input is the emotion analysis results, and the output is the adjusted display content.

[1537] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1538] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1539] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1540] [Fourth embodiment]

[1541] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1542] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1543] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1544] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1545] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1546] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1547] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1548] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1549] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1550] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1551] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1552] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1553] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1554] A system for carrying out the present invention provides information that enables a user to purchase a desired product efficiently and at the lowest possible price. An embodiment of the system will be described in detail below.

[1555] Data collection

[1556] server

[1557] The server periodically collects price information and flyer data provided by each store and stores it in a database. At this time, the server sends an API request to each store's endpoint, formats the acquired data, and stores it in the database. For example, the server sends a request to the API endpoint of "Store A," acquires price information for "Milk," "Condiments," and "Rice," and stores it in the database.

[1558] Receiving a user request

[1559] User

[1560] Users input the items they wish to purchase through a dedicated smartphone app or web interface. For example, a user might input "milk, seasonings, and rice." This information is then sent to the server via the device.

[1561] Terminal

[1562] After receiving the user's input, the terminal sends the information to the server, which then searches for product price information based on the received information.

[1563] Database search

[1564] server

[1565] The server searches the database for price information based on the user request it receives, finds the cheapest product, and aggregates that information. For example, the server extracts the price information for "milk" from the database and identifies the store that sells it at the cheapest price.

[1566] Price comparison with online shopping

[1567] server

[1568] The server also collects price information from online shopping sites to compare with the store's price information, using the API of each online shopping site, and combines the obtained online price information with the store's price information to determine the most cost-effective option for the user.

[1569] Integration and display of results

[1570] server

[1571] The server integrates store and online shopping data to identify the cheapest price for the user. It then sends the results to the user's device. For example, the cheapest "milk" is "Store X," which costs 100 yen.

[1572] Terminal

[1573] The terminal displays the results received from the server to the user. Specifically, it displays the product price information, the name of the store where the product can be purchased, and a link to the online shopping site. For example, it displays information such as "Milk: 100 yen at store X, 105 yen at online shopping site Y."

[1574] Display on the map

[1575] Terminal

[1576] The device displays a marker on a map based on the store's location information, allowing the user to easily access the nearest store. For example, when a user selects "Store X," the location of "Store X" is displayed on a map and a navigation function is provided.

[1577] Specific examples

[1578] For example, if a user searches for "milk, seasonings, rice," the system will provide information in the following order:

[1579] 1. The user enters "milk, seasonings, rice" into the app and submits a request.

[1580] 2. The server searches the database for the cheapest "milk, seasonings, and rice" and aggregates the results.

[1581] 3. The server uses the API of an online shopping site to collect price information about similar products.

[1582] 4. The server aggregates in-store and online pricing information to identify the cheapest option.

[1583] 5. The server sends the results to the user's device.

[1584] 6. The device displays the results to the user and shows the store's location on a map.

[1585] In this way, users can quickly and efficiently find the cheapest products. This system significantly reduces the effort required by consumers and provides a convenient and cost-effective shopping experience.

[1586] The processing flow will be explained below.

[1587] Step 1:

[1588] The server periodically sends requests to each store's API endpoint to obtain the latest price information and flyer data. The obtained data is formatted and stored in a database. For example, price information for "milk," "seasonings," and "rice" is obtained from "Store A" and stored in the database.

[1589] Step 2:

[1590] The user enters the product information they wish to purchase through a dedicated smartphone app or web interface. For example, the user might enter "milk, seasonings, and rice."

[1591] Step 3:

[1592] The device receives the user's input and sends the information to the server. For example, it sends a request for "milk, seasonings, and rice" in JSON format to the server.

[1593] Step 4:

[1594] The server receives the user's request and searches for the corresponding product information in the database, for example, searching for the price information for "milk" and identifying the store with the cheapest price.

[1595] Step 5:

[1596] The server uses the API of an online shopping site to collect price information for the same products. For example, it sends a request to the API endpoint of Amazon or Rakuten to obtain price information for "milk," "seasoning," and "rice."

[1597] Step 6:

[1598] The server compares and integrates price information obtained from stores with price information obtained from online shopping. For example, it compares "Milk at Store A for 100 yen" with "Milk at Amazon for 105 yen" and selects the store where the price is 100 yen.

[1599] Step 7:

[1600] The server sends the integrated results to the user's device. For example, it sends information such as "Milk: 100 yen at store A, seasoning: 200 yen at store B, rice: 300 yen at store C."

[1601] Step 8:

[1602] The terminal displays the results received from the server to the user. Specifically, it displays product price information, the name of the store where the product can be purchased, a link to the online shopping site, etc. For example, it displays "Milk: 100 yen at store A - Address: XX" or "Condiment: 200 yen at store B - Address: XX".

[1603] Step 9:

[1604] The device displays the nearest store on a map based on the store's location information. The user can refer to the map to confirm the store's location. The device also uses the navigation function to display the route to the store. For example, a marker for "Store A" is displayed on the map, and route guidance is provided.

[1605] This allows users to quickly and efficiently find the cheapest products and also check the store's location on a map.

[1606] Example 1

[1607] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1608] In the past, in order to efficiently purchase the product they wanted at the lowest price, users had to check multiple stores and online sales sites individually, which required a lot of time and effort.It was also difficult to compare prices in real time, making it difficult to find the best option.

[1609] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1610] In this invention, the server includes means for a user to input information about a product they wish to purchase, means for collecting price information from retail stores and saving it in a database, means for collecting price information from online sales sites, means for integrating the price information from retail stores and the price information from online sales sites to identify the cheapest price, means for displaying the cheapest price information to the user, and means for displaying the locations of retail stores on a map based on the retail store information, thereby enabling users to efficiently find the cheapest products.

[1611] "User" refers to a consumer who uses this system to input information about a product they wish to purchase.

[1612] "Means for inputting product information for purchase" refers to an interface that allows users to input the products they wish to purchase via a smartphone app or web interface.

[1613] "Sales store" refers to a physical store that actually sells products.

[1614] "Means of collecting price information and storing it in a database" refers to a system for obtaining price information from retail stores using an API or other means and storing it in a database.

[1615] "Online Sales Site" means a website that sells products over the Internet.

[1616] "Means of collecting price information" refers to a system for obtaining price information from online sales sites using APIs, etc.

[1617] "Means for integrating price information and identifying the lowest price" refers to an algorithm or process for integrating price information obtained from retail stores and online retail sites to identify the product with the lowest price for the user.

[1618] The "means for displaying the lowest price information" refers to an interface for visually displaying to the user the product information with the lowest price from the integrated price information.

[1619] "Means for displaying the location of a retail store on a map based on retail store information" refers to a function for displaying the location of a retail store on a map based on its location information and providing it visually to the user.

[1620] The present invention is a system that provides information to help users purchase desired products efficiently and at the lowest possible price. This system consists of three main components: the user, the terminal, and the server.

[1621] Data collection

[1622] server

[1623] The server periodically collects price information and flyer data provided by retail stores and online retail sites and stores it in a database. Specifically, the server uses an API to send requests to each store's endpoint, formats the retrieved data, and stores it in the database. For example, the server sends a request to the API endpoint of "Store A" to retrieve price information for "Milk," "Condiments," and "Rice," and stores the information in the database.

[1624] Receiving a user request

[1625] User

[1626] Users input the items they wish to purchase through a dedicated smartphone app or web interface. For example, a user might input "milk, seasonings, and rice." This information is then sent to the server via the device.

[1627] Terminal

[1628] After receiving the user's input, the terminal transmits the information to the server. Specifically, the terminal transmits a request including the input data to the server using the HTTPS protocol.

[1629] Database search

[1630] server

[1631] The server searches the database for price information based on the received user request, finds the cheapest product, and aggregates that information. For example, the server extracts the price information for "milk" from the database and identifies the store that sells it at the cheapest price.

[1632] Price comparison with online shopping

[1633] server

[1634] The server also collects price information from online retailers to compare with the retailer's price information, using the API of each online retailer. The server then combines the obtained online price information with the retailer's price information to determine the most cost-effective option for the user.

[1635] Integration and display of results

[1636] server

[1637] The server aggregates data from retail stores and online retail sites to identify the cheapest price for the user. It then sends the results to the user's device. For example, the cheapest "milk" is "Store X," which costs 100 yen.

[1638] Terminal

[1639] The device displays the results received from the server to the user. Specifically, it displays the product price information, the name of the store where the product can be purchased, and a link to the online shopping site. For example, it displays information such as "Milk: 100 yen at store X, 105 yen at online shopping site Y."

[1640] Display on the map

[1641] Terminal

[1642] The device displays a marker on a map based on the store's location information, allowing users to easily access the nearest store. For example, when a user selects "Store X," the device displays the location of "Store X" on a map and provides navigation functionality.

[1643] Specific examples

[1644] For example, if a user searches for "milk, seasonings, rice," the system will provide information in the following order:

[1645] 1. The user enters "milk, seasonings, rice" into the app and submits a request.

[1646] 2. The server searches the database for the cheapest "milk, seasonings, and rice" and aggregates the results.

[1647] 3. The server uses the API of an online retailer to collect price information about similar products.

[1648] 4. The server aggregates in-store and online pricing information to identify the cheapest option.

[1649] 5. The server sends the results to the user's device.

[1650] 6. The device displays the results to the user and shows the store's location on a map.

[1651] In this way, users can quickly and efficiently find the cheapest products. This system significantly reduces the effort required by consumers and provides a convenient and cost-effective shopping experience.

[1652] Example prompts for generative AI models

[1653] Below are some example prompts to input to the generative AI model:

[1654] "Get information on retail stores and online shops that offer the lowest prices on a particular product"

[1655] "Explain how you would collect price information for milk, condiments, and rice, and then perform a comparative analysis to present the cheapest options."

[1656] This allows the generative AI model to explain the entire process, from how data is collected to how the results are displayed.

[1657] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1658] Step 1: Send a request to collect data and get a response

[1659] server

[1660] The server sends a request to an API endpoint to collect price information from retail stores and online retail sites. For example, a request is sent to the endpoint of "Store A" requesting price information for "Milk," "Condiments," and "Rice." The data returned as a response is received in JSON format. This data includes information such as the product name, price, store name, and update date and time.

[1661] Input: API endpoint and request parameters (product name)

[1662] Output: Price information in JSON format

[1663] Specific behavior:

[1664] 1. The server generates an HTTP request and sends it to the API endpoint.

[1665] 2. Receive a response in JSON format from the API endpoint.

[1666] 3. Parse the received JSON data and extract the necessary information.

[1667] Step 2: Saving to the database

[1668] server

[1669] The server formats the acquired price information and saves it in the database. Information such as product name, price, store name, and update date and time is inserted or updated in the corresponding table according to the database structure.

[1670] Input: Price information in JSON format

[1671] Output: Price information stored in a database

[1672] Specific behavior:

[1673] 1. Extract product name, price, store name, and update date and time from JSON data.

[1674] 2. Connect to the database and generate and execute SQL queries to insert or update data into the appropriate tables.

[1675] Step 3: Enter the product you want to purchase

[1676] User

[1677] Using a dedicated smartphone app or web interface, users input information about the products they wish to purchase. For example, they might enter "milk, seasonings, and rice" and press the search button. This information is then sent to the server via the user's device.

[1678] Input: Product information you wish to purchase (user input)

[1679] Output: User request data

[1680] Specific behavior:

[1681] 1. The user enters the product information they wish to purchase into the app's search bar.

[1682] 2. The input data is sent to the server via the terminal.

[1683] Step 4: Sending the user request to the server

[1684] Terminal

[1685] The terminal transmits the user's input data to the server. Specifically, the terminal transmits the user's request data to the server using the HTTPS protocol.

[1686] Input: User request data

[1687] Output: Request sent to server

[1688] Specific behavior:

[1689] 1. Generate an HTTP request containing the user's request data.

[1690] 2. Send the generated request to the server using the HTTPS protocol.

[1691] Step 5: Retrieve price information from the database

[1692] server

[1693] The server searches the database for price information based on the user's request. Specifically, it searches for price information for product names such as "milk," "seasoning," and "rice" to find the cheapest product.

[1694] Input: User request data

[1695] Output: The product with the lowest price

[1696] Specific behavior:

[1697] 1. Generate an SQL query based on the user request.

[1698] 2. Query the database and retrieve the results.

[1699] 3. Extract and list the product information with the lowest price.

[1700] Step 6: Collect price information from online shopping sites

[1701] server

[1702] The server collects price information from the API of an online sales site. For example, it sends a request to the API of "Online Shop B" to obtain price information for "milk, seasonings, and rice." The obtained data is formatted and stored in a temporary data store.

[1703] Input: Online API endpoint and request parameters

[1704] Output: Online price information in JSON format

[1705] Specific behavior:

[1706] 1. The server sends a request to the online retailer's API.

[1707] 2. Receive the acquired online price information in JSON format.

[1708] 3. Parse the JSON data and save it to a temporary data store.

[1709] Step 7: Consolidate and compare pricing information

[1710] server

[1711] The server combines the price information from retail stores and online retailers to identify the lowest prices, comparing both sets of data and calculating the lowest price for each product.

[1712] Input: Retail store and online pricing information

[1713] Output: Identify and list the cheapest options

[1714] Specific behavior:

[1715] 1. Convert pricing information from retail stores and online retail sites into a unified format.

[1716] 2. Compare the prices of each item and identify the cheapest option.

[1717] 3. List the cheapest results.

[1718] Step 8: Generate and submit results

[1719] server

[1720] The server identifies the cheapest product price and its source, then sends the results to the user's device, formatting the results in JSON format and sending them as a response.

[1721] Input: List of cheapest options

[1722] Output: JSON formatted results

[1723] Specific behavior:

[1724] 1. Convert the list of cheapest options into JSON format.

[1725] 2. Send it as an HTTP response to the user's device.

[1726] Step 9: View the results

[1727] Terminal

[1728] The terminal displays the results received from the server to the user, including price information, the names of stores where the product can be purchased, and links to online shops.

[1729] Input: Response data from the server

[1730] Output: Information displayed on the user interface

[1731] Specific behavior:

[1732] 1. Analyze the response data from the server.

[1733] 2. Display the analyzed data in the user interface.

[1734] Step 10: Map location and navigation

[1735] Terminal

[1736] The device displays markers on a map based on the location information of retail stores, allowing users to easily access the nearest store, and also provides a navigation function.

[1737] Input: Store location information

[1738] Output: Map markers and navigation route

[1739] Specific behavior:

[1740] 1. Obtain the store's location information and send it to the map API.

[1741] 2. Display store markers on the map.

[1742] 3. Display navigation route to the selected store.

[1743] (Application example 1)

[1744] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1745] In recent years, consumers have increasingly sought the cheapest way to purchase the same product from multiple stores and online shopping sites. However, comparing and searching each store and online shopping site individually is time-consuming and laborious. Even if you find the cheapest store, you may not know the store's specific location, making it difficult to purchase the product efficiently. Furthermore, limited access to product reviews and ratings often leaves consumers unsure of their purchasing decisions. The present invention aims to solve these problems.

[1746] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1747] In this invention, the server includes means for a user to input information about a product they wish to purchase, means for collecting store price information and saving it in a database, means for collecting online shopping price information, means for integrating store price information and online shopping price information to identify the cheapest price, means for displaying the cheapest price information to the user, means for displaying store locations on a map based on the store information, means for displaying product reviews and ratings, and means for managing purchase history. This enables consumers to efficiently and quickly find the cheapest products, check location information, and make optimal purchasing decisions by referring to reviews and ratings.

[1748] "Means for users to input product information they wish to purchase" refers to the function whereby a user uses a device such as a smartphone or computer to input the name of the product they wish to purchase and send a request to the system.

[1749] "Means of collecting store price information and storing it in a database" refers to a server or API integration mechanism that periodically obtains product price information provided by physical stores and records and stores this information in a database.

[1750] "Means for collecting online shopping price information" refers to the function of obtaining product price information from various online shopping sites via APIs, etc., and storing this information in a database.

[1751] "Means of integrating in-store price information and online shopping price information to identify the cheapest price" refers to algorithms and software that centrally manage and compare collected price information from physical and online stores, and extract the most economical option for the user.

[1752] "Means for displaying the lowest price information to the user" refers to the function of selecting the lowest price from the integrated price information and visually presenting it on the user's device.

[1753] "Means for displaying the location of a store on a map based on the store information" refers to a function that displays the geographical location information of a store offering the lowest priced product on a map, allowing users to easily find the store.

[1754] "Means for displaying product reviews and ratings" refers to a function that collects opinions and ratings from users of products that the user is considering purchasing from the Internet and displays them to the user.

[1755] "Means for managing purchase history" refers to a function that stores records of products purchased by users in a database and allows them to refer to these records later.

[1756] The system for implementing this invention provides information that allows users to purchase desired products efficiently and at the lowest possible cost. The system is mainly composed of three elements: a server, a terminal, and a user interface.

[1757] The server periodically collects price information, reviews, and ratings from each physical store and online shopping site, and stores them in a database. The server uses an API to obtain this information and integrates and manages it in the database. For price information from physical stores, it obtains and stores the prices of specific products (e.g., milk, seasonings, rice, etc.). It also collects price information from online shopping sites for similar products, and stores this in the database.

[1758] Users input the items they wish to purchase through an application on their smartphone or computer. The information they input is sent to a server via their device. The server then searches a database of price information based on the user's request to identify the cheapest option, which includes information from physical stores and online shopping.

[1759] The terminal displays the results received from the server to the user. Specifically, it displays the cheapest price information for the product entered by the user, the name of the store where the product can be purchased, and a link to the online shopping site. In addition, it displays the location of the store on a map, providing a navigation function that allows the user to easily access the nearest store. This allows the user to efficiently purchase the cheapest product.

[1760] The system can also display product reviews and ratings, allowing users to make purchasing decisions based on not only price information but also the product's quality and the ratings of other users. It also has a purchasing history management function, allowing users to plan future purchases while referring to their past purchase history.

[1761] As a concrete example, if a user searches for "milk, seasonings, rice," the system provides information in the following way. When a user enters "milk, seasonings, rice" into the app and sends a request, the server searches the database for the cheapest "milk, seasonings, rice" and aggregates the results. The server then uses the API of an online shopping site to collect price information for similar products and integrates the two. The identified cheapest option is sent to the user's device, and the user can view price information, the name of the store where the product is available, and a link to the online shopping site on the app. The nearest store is also displayed on a map, and users can also view reviews, ratings, and past purchase history. This allows users to quickly and efficiently find the cheapest, highest-quality products.

[1762] Example prompt sentence:

[1763] Please compare prices for "Milk, Seasonings, and Rice" and let me know the cheapest options. Also, please show me the location of the nearest store.

[1764] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1765] Step 1:

[1766] User enters product information

[1767] A user uses an application on a smartphone or PC to input product information (e.g., "milk, seasoning, rice") and send a request. This input information is then sent to the server via the terminal.

[1768] Input: Product information entered by the user

[1769] Output: Request data sent to the server via the terminal

[1770] Step 2:

[1771] Collect store prices

[1772] The server sends requests to each physical store's API endpoint to retrieve pricing information for specific products. This collected data is then formatted and stored in a database.

[1773] Input: API request from the server

[1774] Data processing: Format the collected price information and convert it into a storage format.

[1775] Output: Price information stored in the database

[1776] Step 3:

[1777] Collecting online shopping price information

[1778] The server then sends requests to each online shop's API endpoint to retrieve pricing information for specific products, which is then formatted and stored in the database.

[1779] Input: API request from the server

[1780] Data processing: Format the collected price information and convert it into a storage format.

[1781] Output: Online pricing information stored in a database

[1782] Step 4:

[1783] Consolidating pricing information and identifying the best prices

[1784] The server retrieves price information from a database based on the request received from the user, integrates price information from physical stores and online stores, and identifies the lowest price from the integrated information.

[1785] Input: Price information extracted from databases (both physical and online stores)

[1786] Data Calculation: Compare prices and find the best deals

[1787] Output: The cheapest price and the store (or online shop) that offers it

[1788] Step 5:

[1789] Displaying results to the user

[1790] The terminal displays the lowest price information received from the server, the name of the store offering the price, and a link to the online shop to the user.

[1791] Input: The lowest price information sent from the server

[1792] Output: Price information and links displayed on the user's device

[1793] Step 6:

[1794] Displaying store locations on a map

[1795] The device displays a store marker on a map based on the location information of the store offering the cheapest products, providing navigation functionality.

[1796] Input: Store location information

[1797] Output: Store markers and navigation routes displayed on the map

[1798] Step 7:

[1799] Displaying product reviews and ratings

[1800] The server collects reviews and ratings of specific products from the Internet and displays them to the user.

[1801] Input: Collected reviews and ratings

[1802] Output: Reviews and ratings displayed on the user's device

[1803] Step 8:

[1804] Purchase history management

[1805] The terminal records the user's purchase history and manages it for later reference.

[1806] Input: Information about the product purchased by the user

[1807] Output: Purchase history information stored in a database

[1808] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1809] The present invention combines an emotion engine with a system that provides information on products that users want to purchase efficiently and at the lowest possible cost. An embodiment of the present invention will be described in detail below.

[1810] Data collection

[1811] server

[1812] The server periodically collects price information and flyer data provided by each store and stores it in a database. To do this, the server sends an API request to each store's endpoint, formats the acquired data, and stores it in the database. For example, the server obtains price information for "milk," "seasonings," and "rice" from "Store A" and stores it in the database.

[1813] Receiving a user request

[1814] User

[1815] Users input the items they wish to purchase through a dedicated smartphone app or web interface. For example, a user might input "milk, seasonings, and rice." This information is then sent to the server via the device.

[1816] Terminal

[1817] After receiving the user's input, the device sends the information to the server. For example, it sends a request for "milk, seasonings, and rice" in JSON format to the server.

[1818] Database search

[1819] server

[1820] The server searches for the corresponding product information in the database based on the received user request, finds the cheapest product, and aggregates that information. For example, the server extracts the price information for "milk" from the database and identifies the store with the cheapest price.

[1821] Price comparison with online shopping

[1822] server

[1823] The server also collects price information from online shopping sites to compare with the store's price information, using the API of each online shopping site, and combines the obtained online price information with the store's price information to determine the most cost-effective option for the user.

[1824] Integration and display of results

[1825] server

[1826] The server integrates store and online shopping data to identify the cheapest price for the user. It then sends the results to the user's device. For example, the cheapest "milk" is "Store X," which costs 100 yen.

[1827] Terminal

[1828] The terminal displays the results received from the server to the user. Specifically, it displays the product price information, the name of the store where the product can be purchased, and a link to the online shopping site. For example, it displays information such as "Milk: 100 yen at store X, 105 yen at online shopping site Y."

[1829] Display on the map

[1830] Terminal

[1831] The device displays a marker on a map based on the store's location information, allowing the user to easily access the nearest store. For example, when a user selects "Store X," the location of "Store X" is displayed on a map and a navigation function is provided.

[1832] Emotion engine integration

[1833] server

[1834] The server has an emotion engine that recognizes emotions from the user's facial expressions and voice. This engine analyzes data obtained from the camera and microphone in real time while the user is using the app or web interface. For example, if a user looks dissatisfied after viewing price information, the engine recognizes the emotion.

[1835] Emotion-Based Adjustment

[1836] Terminal

[1837] The device dynamically adjusts the display method according to the user's emotions based on the analysis results of the emotion engine sent from the server. For example, if the user looks dissatisfied, the system will suggest alternative products or display detailed descriptions of specific products. If the user looks satisfied, the current display will be maintained.

[1838] Specific examples

[1839] For example, if a user searches for "milk, seasonings, rice," the system will provide information in the following order:

[1840] 1. The user enters "milk, seasonings, rice" into the app and submits a request.

[1841] 2. The server searches the database for the cheapest "milk, seasonings, and rice" and aggregates the results.

[1842] 3. The server uses the API of an online shopping site to collect price information about similar products.

[1843] 4. The server aggregates in-store and online pricing information to identify the cheapest option.

[1844] 5. The server sends the results to the user's device.

[1845] 6. The device displays the results to the user and shows the store's location on a map.

[1846] 7. The device uses an emotion engine to analyze the user's facial expressions and voice, and dynamically adjusts the display content based on the user's emotions.

[1847] This system allows users to find the cheapest products quickly and efficiently, and with the support of an emotion engine, they can enjoy a more comfortable purchasing experience.

[1848] The processing flow will be explained below.

[1849] Step 1:

[1850] The server sends a request to each store's API endpoint to obtain the latest price information and flyer data. The obtained data is formatted and stored in a database. For example, price information for "milk," "seasonings," and "rice" is obtained from "Store A" and stored in the database.

[1851] Step 2:

[1852] The user enters the product information they wish to purchase through a dedicated smartphone app or web interface. For example, the user might enter "milk, seasonings, and rice."

[1853] Step 3:

[1854] The device receives the user's input and sends the information to the server. For example, it sends a request for "milk, seasonings, and rice" in JSON format to the server.

[1855] Step 4:

[1856] The server receives the user's request and searches for the corresponding product information in the database. For example, the server searches for price information for "milk," "seasonings," and "rice" and identifies the store with the lowest price.

[1857] Step 5:

[1858] The server uses the API of an online shopping site to collect price information for the same products. For example, it sends a request to the API endpoint of Amazon or Rakuten to obtain price information for "milk," "seasoning," and "rice."

[1859] Step 6:

[1860] The server compares and integrates price information obtained from stores with price information obtained from online shopping. For example, it compares "Milk from Store A for 100 yen" with "Milk from Amazon for 105 yen" and selects the store that sells it for 100 yen.

[1861] Step 7:

[1862] The server sends the integrated results to the user's device. For example, it might send information such as "Milk: 100 yen at store A, seasoning: 200 yen at store B, rice: 300 yen at store C."

[1863] Step 8:

[1864] The terminal displays the results received from the server to the user. Specifically, it displays product price information, the names of stores where the product can be purchased, and links to online shopping sites. For example, it might display "Milk: 100 yen at store A, seasoning: 200 yen at store B, rice: 300 yen at store C."

[1865] Step 9:

[1866] The device displays the nearest store on a map based on the store's location information. The user can refer to the map to confirm the store's location. The device also uses the navigation function to display the route to the store. For example, a marker for "Store A" is displayed on the map, and route guidance is provided.

[1867] Step 10:

[1868] The device sends data acquired from the user's camera and microphone to the emotion engine, which analyzes the user's emotions. For example, if the user looks dissatisfied after viewing price information, that emotion will be analyzed.

[1869] Step 11:

[1870] The server receives the analysis results from the emotion engine and dynamically adjusts the display method based on the user's emotions. For example, if the user looks dissatisfied, the system will suggest alternative products or display detailed information about specific products. If the user looks satisfied, the current display will be maintained.

[1871] This processing step allows the user to not only purchase products efficiently and at the lowest possible cost, but also to enjoy a pleasant purchasing experience using the emotion engine.

[1872] Example 2

[1873] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1874] Until now, users have lacked a means to easily and efficiently obtain product information and purchase it at the lowest price. In particular, it has been difficult to integrate price information from stores and online shopping sites, identify the lowest price in real time, and provide it to users. In addition, the display has not been adjusted based on user emotions, making it difficult to improve the quality of the user experience.

[1875] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1876] In this invention, the server includes means for a user to input information about a product they wish to purchase, means for collecting store price information and saving it in a database, means for collecting online shopping price information, means for integrating store price information and online shopping price information to identify the cheapest price, means for displaying the cheapest price information to the user, means for displaying store locations on a map based on the store information, means for using an emotion engine that recognizes emotions from the user's facial expressions and voice, and means for dynamically adjusting display content based on the recognized emotion. This enables the user to efficiently obtain information about the cheapest products and enjoy a pleasant shopping experience through display adjustments using the emotion engine.

[1877] A "user" is an individual or organization that uses the system to input product information and obtain the cheapest price information.

[1878] "Information about the product desired to be purchased" is information about the name and type of the product that the user wishes to purchase.

[1879] "Store price information" refers to price information for products sold in physical stores.

[1880] "Online shopping price information" refers to price information for products sold online.

[1881] A "database" is a digital storage device that organizes and stores collected store price information and online shopping price information.

[1882] "API" stands for Application Programming Interface, a mechanism for exchanging data and functions between different software programs.

[1883] An "emotion engine" is an algorithm or software that analyzes a user's facial expressions and voice and recognizes their emotional state.

[1884] "Dynamic adjustment of display content" means that the system changes the information displayed and interface layout in real time according to the user's emotional state.

[1885] "Displaying store locations on a map" is a function in which the system visually displays the user's current location or the location of a selected store on a map.

[1886] The present invention is a system that provides users with information that allows them to efficiently obtain product information they wish to purchase at the lowest possible cost, and further improves the user experience by combining it with an emotion engine. Specific embodiments of the system are described below.

[1887] In this system, the server, terminal, and user components work together to collect, analyze, and display data using various hardware and software.

[1888] Hardware and software used

[1889] 1. Server

[1890] Price information is collected from each store and online shopping site using an API.

[1891] Organize and store price information in a database.

[1892] An emotion engine is implemented to recognize emotions from the user's facial expressions and voice.

[1893] 2. Terminal

[1894] Sends the user's input to the server.

[1895] The response from the server is displayed to the user, and the store location is displayed on a map so that the user can access the nearest store.

[1896] The user's facial expressions and voice are captured and sent to the server.

[1897] 3. Users

[1898] Enter the product information you wish to purchase via a smartphone app or web interface.

[1899] Data processing and calculation flow

[1900] 1. The server periodically sends requests to each store's endpoint to collect price information and flyer data. This is done using each store's API. For example, the server obtains price information for "milk," "seasonings," and "rice" from "Store A" and stores it in the database.

[1901] 2. The user enters the product information they wish to purchase into a dedicated smartphone app or web interface and submits a request. For example, the user enters "milk, seasonings, and rice." This information is sent to the server via the device.

[1902] 3. The device converts the user's input into JSON format, generates an HTTP request to send to the server, and sends it.

[1903] 4. The server searches the corresponding product information in the database, finds the cheapest product, and aggregates it. For example, it extracts the price information for "milk" from the database and identifies the store that offers the cheapest price.

[1904] 5. The server uses the API of the online shopping site to collect price information about similar products and integrates it with the store's price information.

[1905] 6. The server sends the lowest price information to the user's device, which displays it to the user. For example, "Milk: 100 yen at store X, 105 yen at online store Y."

[1906] 7. The device will display a marker on the map based on the store's location information, allowing the user to access the nearest store. For example, when the user selects "Store X," its location will be displayed on the map.

[1907] 8. The server analyzes data obtained from the camera and microphone in real time while the user is using the app or web interface to recognize the user's emotions. For example, if the user looks dissatisfied after viewing price information, the server recognizes that emotion.

[1908] 9. The device receives the emotion engine's analysis results from the server and dynamically adjusts the display method. For example, if the user looks dissatisfied, it will suggest an alternative product or display a detailed product description. If the user looks satisfied, it will maintain the current display.

[1909] Specific examples

[1910] For example, if a user searches for "milk, seasonings, rice," the system will provide information in the following order:

[1911] 1. The user enters "milk, seasonings, rice" into the app and submits a request.

[1912] 2. The server searches the database for the cheapest "milk, seasonings, and rice" and aggregates the results.

[1913] 3. The server uses the API of an online shopping site to collect price information about similar products.

[1914] 4. The server aggregates in-store and online pricing information to identify the cheapest option.

[1915] 5. The server sends the results to the user's device.

[1916] 6. The device displays the results to the user and shows the store's location on a map.

[1917] 7. The device uses an emotion engine to analyze the user's facial expressions and voice and dynamically adjust the display content.

[1918] An example of a prompt is as follows:

[1919] "Please explain a system that provides users with information on products they want to purchase efficiently and at the lowest possible price. This system incorporates an emotion engine."

[1920] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1921] Step 1:

[1922] Data collection

[1923] The server collects price information from each store and stores it in a database.

[1924] Input: Endpoint information for each store.

[1925] Output: Formatted pricing information stored in a database.

[1926] Specific operation: The server sends a request to each store's API, obtains price information for "milk," "seasonings," and "rice" from store A, formats the information, and saves it in the database.

[1927] Step 2:

[1928] Receiving a user request

[1929] Users enter information about the product they wish to purchase using a dedicated app or web interface and submit a request.

[1930] Input: Desired product information entered by the user, such as "milk, seasonings, rice."

[1931] Output: The user's request information is sent to the terminal.

[1932] Specific behavior: The user enters "milk, seasoning, rice" into the app, which is converted into JSON format and sent to the server.

[1933] Step 3:

[1934] Server reception of user requests

[1935] The terminal transmits the user's request to the server.

[1936] Input: A JSON request containing product information entered by the user.

[1937] Output: Triggers the server's price information lookup process.

[1938] Specific operation: The device generates an HTTP request to send JSON data containing the request for "milk, seasonings, and rice" to the server, and sends it to the server.

[1939] Step 4:

[1940] Database search

[1941] The server searches the product information in the database based on the request and identifies the lowest price.

[1942] Input: Product name based on user request.

[1943] Output: Data on the cheapest product.

[1944] Specific operation: The server executes a database query to extract the store information with the cheapest price for "milk," "seasoning," and "rice."

[1945] Step 5:

[1946] Price comparison with online shopping

[1947] The server collects price information from online shopping sites and compares it with the price information of the store.

[1948] Input: Product name based on user request, and API endpoint information of online shopping site.

[1949] Output: Consolidated best price information.

[1950] Specific operation: The server sends a request to the API endpoint of the online shopping site, obtains online price information for "milk," "seasonings," and "rice," and integrates it with the store.

[1951] Step 6:

[1952] Integration and display of results

[1953] The server aggregates the cheapest price information and sends it to the user's terminal.

[1954] Input: In-store and online shopping price information.

[1955] Output: Consolidated pricing information.

[1956] Specific operation: The server generates a result such as "Milk: 100 yen at store X, 105 yen at online shop Y" and sends it to the terminal.

[1957] Step 7:

[1958] Displaying results and providing location information

[1959] The terminal displays the results to the user and shows the store's location on a map.

[1960] Input: Lowest price information and location information provided by the server.

[1961] Output: Display in the user interface and a marker on the map.

[1962] Specific operation: The device analyzes the data received and displays it in the format "Milk: 100 yen at store X, 105 yen at online shop Y," and shows the store location on a map.

[1963] Step 8:

[1964] Emotion Engine Data Acquisition

[1965] The server acquires the user's facial expressions and voice and recognizes their emotions.

[1966] Input: Live data from the user's camera and microphone.

[1967] Output: Parsed emotional state.

[1968] Specific operation: The server collects data from the user's camera and microphone in real time and analyzes it using the emotion engine.

[1969] Step 9:

[1970] Emotion-based display adjustment

[1971] The device dynamically adjusts the display content based on the analysis results of the emotion engine.

[1972] Input: Parsed emotional state.

[1973] Output: Dynamic display of the user interface.

[1974] Specific operation: If the user looks dissatisfied, the device will suggest alternative products and display detailed explanations; if the user looks satisfied, the current display will be maintained.

[1975] (Application example 2)

[1976] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1977] Current shopping systems require users to spend a lot of time and effort to find the cheapest products. Furthermore, the user experience is uniform, and there is a problem in that the system is unable to flexibly display and suggest products that respond to individual emotions and preferences. In particular, comparing online and offline prices is often cumbersome, making it difficult for users to use. It is necessary to solve these issues and provide a new shopping experience that is user-friendly and responds to emotions.

[1978] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for a user to input information about a product they wish to purchase, means for collecting store price information and saving it in a database, means for collecting online shopping price information, means for integrating store price information and online shopping price information to identify the cheapest price, means for displaying the cheapest price information to the user, means for displaying store locations on a map based on the store information, emotion analysis means for recognizing emotions from the user's facial expressions and voice, and means for dynamically adjusting display content according to the user's emotions. This allows the user to quickly and efficiently find the cheapest product, and with the support of the emotion engine, a more comfortable and satisfying purchasing experience is possible.

[1979] The "means by which a user inputs information about a product they wish to purchase" refers to an interface that allows a user to input information about a product they wish to purchase using a smartphone app or web interface.

[1980] "Means of collecting store price information and saving it in a database" refers to a method of obtaining price information through each store's API endpoint, formatting it, and saving it in a database.

[1981] "Methods for collecting online shopping price information" refers to a method for obtaining and integrating price information using the API of an online shopping site.

[1982] "Means for integrating in-store price information and online shopping price information to identify the lowest price" refers to an algorithm that compares collected in-store and online price information and identifies the product with the lowest price.

[1983] The "means for displaying the cheapest price information to the user" is a method for displaying the identified cheapest price information to the user through a smartphone app or web interface.

[1984] The "means for displaying the location of the store on a map based on the store information" is a method for displaying the location of the store on a map using a map API (e.g., Google Maps API).

[1985] "Emotion analysis means for recognizing emotions from a user's facial expressions and voice" is a technology for analyzing a user's facial expressions and voice data collected using a camera or microphone to recognize the user's emotional state.

[1986] The "means for dynamically adjusting the displayed content according to the user's emotions" is an algorithm that changes the displayed information and suggested content based on the recognized user's emotions.

[1987] This invention is a system that collects price information from stores and online shopping sites and helps users purchase products at the lowest price. Furthermore, by combining it with emotion analysis technology, it realizes flexible information display and suggestions according to the user's emotions. Specific embodiments will be described.

[1988] Hardware and software used

[1989] The following hardware and software are used in this system:

[1990] Server: Private cloud, AWS, or Google Cloud

[1991] Database: MySQL or PostgreSQL

[1992] API: Public API for each store and online shopping site

[1993] Smartphone: iOS or Android device

[1994] Camera and microphone: Built-in to device

[1995] Emotion engine: OpenAI API, Kairos (emotion analysis API)

[1996] Map API: Google Maps API

[1997] System configuration

[1998] 1. Data Collection

[1999] The server periodically sends requests to each store's API endpoint to retrieve pricing information and flyer data, which is then formatted and stored in a database.

[2000] 2. Receipt of User Request

[2001] Users use a smartphone app to input information about the product they wish to purchase, which is then sent to the server in JSON format.

[2002] 3. Database Search

[2003] The server searches the price information in the database based on the received user request and identifies the cheapest product.

[2004] 4. Collecting Online Pricing Information

[2005] The server uses the API of each online shopping site to obtain price information and integrates it with the store's price information.

[2006] 5. Integration and display of results

[2007] The server sends the consolidated results to the user's device, where a smartphone app displays them.

[2008] 6. Displaying stores on a map

[2009] The smartphone app uses the Google Maps API to display the location of the store with the lowest price on a map.

[2010] 7. Sentiment Analysis and Dynamic Adjustment

[2011] The server analyzes the user's facial expressions and voice recorded through the camera and microphone, and recognizes the user's emotions using an emotion engine (OpenAI's API, Kairos).The server dynamically adjusts the content displayed and suggestions provided based on the user's emotions.

[2012] Specific examples

[2013] For example, if a user searches for "milk, seasonings, rice," the system will perform the following functions:

[2014] 1. The user enters "milk, seasonings, rice" into the app and submits a request.

[2015] 2. The server searches the database for the cheapest "milk, seasonings, and rice" and aggregates the results.

[2016] 3. The server uses the API of an online shopping site to collect price information about similar products.

[2017] 4. The server aggregates in-store and online pricing information to identify the cheapest option.

[2018] 5. The server sends the results to the user's device.

[2019] 6. The device displays the results to the user and shows the store's location on a map.

[2020] 7. The device uses an emotion engine to analyze the user's facial expressions and voice, and dynamically adjusts the display content based on the user's emotions.

[2021] Prompt Sentence Examples

[2022] Product list: Milk, seasonings, rice

[2023] View: Map, Dashboard

[2024] Expression: Unhappy

[2025] With the above configuration, users can quickly and efficiently find the cheapest products, and with the support of the emotion engine, they can enjoy a more comfortable and satisfying purchasing experience.

[2026] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2027] Step 1:

[2028] A user opens a smartphone app and inputs the items they wish to purchase, such as "milk, seasonings, and rice." Once the input is complete, the device sends this information to the server in JSON format (e.g., "{"products": ["milk", "seasonings", "rice"]}").

[2029] Step 2:

[2030] The server analyzes the received JSON-formatted user request and searches for the corresponding product information in the database. Specifically, it executes an SQL query based on the product name to obtain information on the store with the cheapest price. The input is the user request information, and the output is the cheapest price information.

[2031] Step 3:

[2032] The server uses the API of online shopping sites to collect price information for products that users wish to purchase. It generates API requests for each online shopping site and accesses them to obtain price data. The input is the API request, and the output is the price information obtained from the online shopping site.

[2033] Step 4:

[2034] The server integrates the price information of the store and the price information of the online shopping site to identify the cheapest price. At this stage, the collected price information is compared and the product information with the cheapest price is selected. The input is all the collected price information, and the output is the result of identifying the cheapest price.

[2035] Step 5:

[2036] The server sends the consolidated price information to the user's device in JSON format, for example, "{"Milk": {"Store": "A", "Price": 100 yen}, "Seasoning": {"Store": "B", "Price": 200 yen}, "Rice": {"Online Shopping": "Site C", "Price": 300 yen}}".

[2037] Step 6:

[2038] The terminal displays the price information received from the server on the user interface, allowing the user to visually check the information on the cheapest product. It also uses the Google Maps API to display the location of the store offering the cheapest price on a map and provide a navigation function. The input is the price information from the server, and the output is the display on the user interface and the map display.

[2039] Step 7:

[2040] The device's camera and microphone are used to collect the user's facial expressions and voice in real time. The data acquired from the camera and microphone is sent to a server and analyzed by an emotion analysis engine (e.g., OpenAI API, Kairos). The input is the user's facial expressions and voice data, and the output is the analyzed emotional state.

[2041] Step 8:

[2042] The server dynamically adjusts the display content based on the user's emotions based on the results of emotion analysis. For example, if the user looks dissatisfied, it will suggest alternative products or display detailed explanations. The input is the emotion analysis results, and the output is the adjusted display content.

[2043] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[2044] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2045] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[2046] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2047] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[2048] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[2049] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[2050] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[2051] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[2052] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[2053] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[2054] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[2055] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[2056] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[2057] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[2058] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[2059] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[2060] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[2061] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[2062] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[2063] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[2064] The following is further disclosed regarding the above embodiment.

[2065] (Claim 1)

[2066] A means for a user to input information about a product they wish to purchase;

[2067] a means for collecting store price information and storing it in a database;

[2068] A means of collecting online shopping price information,

[2069] A means of integrating store price information with online shopping price information to identify the lowest price;

[2070] a means for displaying the lowest price information to the user;

[2071] means for displaying the location of the store on a map based on the store information;

[2072] A system including:

[2073] (Claim 2)

[2074] The system of claim 1, which uses an API to obtain online shopping price information.

[2075] (Claim 3)

[2076] 2. The system according to claim 1, which searches for price information in real time based on product information entered by a user and provides the results to the user.

[2077] "Example 1"

[2078] (Claim 1)

[2079] A means for a user to input information about a product they wish to purchase;

[2080] A means for collecting and storing price information from retail outlets in a database;

[2081] A means of collecting price information from online retailers;

[2082] A means of integrating price information from retail stores and online retail sites to identify the lowest price;

[2083] a means for displaying the lowest price information to the user;

[2084] means for displaying the location of the store on a map based on the store information;

[2085] A system including:

[2086] (Claim 2)

[2087] 10. The system of claim 1, wherein the system uses an API to obtain price information from an online sales site.

[2088] (Claim 3)

[2089] 2. The system according to claim 1, which searches for price information in real time based on product information entered by a user and provides the results to the user.

[2090] "Application Example 1"

[2091] (Claim 1)

[2092] A means for a user to input information about a product they wish to purchase;

[2093] a means for collecting store price information and storing it in a database;

[2094] A means of collecting online shopping price information,

[2095] A means of integrating store price information with online shopping price information to identify the lowest price;

[2096] a means for displaying the lowest price information to the user;

[2097] means for displaying the location of the store on a map based on the store information;

[2098] A means to display product reviews and ratings,

[2099] A means for managing purchase history;

[2100] A system including:

[2101] (Claim 2)

[2102] The system of claim 1, which uses an API to obtain online shopping price information.

[2103] (Claim 3)

[2104] 2. The system according to claim 1, which searches for price information in real time based on product information entered by a user and provides the results to the user.

[2105] "Example 2: Combining Emotion Engines"

[2106] (Claim 1)

[2107] A means for a user...

Claims

1. A means for a user to input information about a product they wish to purchase; a means for collecting store price information and storing it in a database; A means of collecting online shopping price information, A means of integrating store price information with online shopping price information to identify the lowest price; a means for displaying the lowest price information to the user; means for displaying the location of the store on a map based on the store information; A system including:

2. The system according to claim 1, wherein an API is used to obtain online shopping price information.

3. 2. The system according to claim 1, wherein price information is searched in real time based on product information input by a user, and the results are provided to the user.

Images