system

Abstract

We provide the system. [Solution] A means of communication for receiving information from users, A computing means equipped with artificial intelligence for searching for and recommending products based on information received from the user, Information display means that provides detailed product information in multiple languages, A display means for showing the inventory status of exhibited products and sales information of sales locations in real time, A purchasing processing means for users to execute transaction processing for purchasing goods, A logistics processing method for sending the product selected by the user to the point of purchase or delivery address, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a persona chatbot control method performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] It is to solve the difficulties that occur when foreign visitors to Japan efficiently select and purchase Japanese souvenirs within a limited time. Specifically, there are problems of supporting the selection of products according to the individual preferences and budgets of users while accommodating various cultures and languages, and further providing the information necessary for purchase in real time. Also, the problems of checking inventory status and the complexity of delivery procedures should be solved.

Means for Solving the Problems

[0005] This invention provides a system that first receives information from the user using an input means, and then uses an artificial intelligence processing means to search for and suggest the most suitable products based on that information. It also includes an information provision means that provides product information in multiple languages, enabling users to understand product details, including cultural background. Furthermore, it has a display means that improves the convenience of purchase by displaying inventory status and store operating information in real time. The purchase means allows users to smoothly purchase selected products and reduces hassle by providing delivery options. Such a system can improve the shopping experience for foreign visitors to Japan and contribute to the revitalization of local economies.

[0006] "Input means" refers to the interface and its functions for users to input their needs and conditions, and is the means by which the system receives information that meets the user's wishes.

[0007] "Processing means" refers to the function and components that enable the system to analyze information provided by the user, search for and suggest the most suitable product using artificial intelligence technology, and implement this function.

[0008] "Artificial intelligence" refers to algorithms and models that present optimal choices based on information from users and past data, and is a core technology of the system.

[0009] "Information provision means" refers to the interface and the underlying data management system used to provide users with detailed product-related information in multiple languages.

[0010] "Display means" refers to displays and related technologies used to show users real-time information such as product and store inventory status and business information, and is a function that provides users with timely information.

[0011] "Purchase method" refers to system functions and their components that facilitate the transaction process when a user purchases a product they have selected.

[0012] "Delivery method" refers to a part of the system that handles logistics and procedures for delivering purchased goods to a specified address. [Brief explanation of the drawing]

[0013] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] This is a sequence diagram showing the processing flow of the data processing system in Example 2, which incorporates an emotion engine. [Figure 14]It is a sequence diagram showing the processing flow of a data processing system in Application Example 2 when a sentiment engine is combined.

Embodiments for Carrying Out the Invention

[0014] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0015] First, the terms used in the following description will be explained.

[0016] In the following embodiments, a numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0017] In the following embodiments, a numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0018] In the following embodiments, a numbered storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, etc.

[0019] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0020] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0021] [First Embodiment]

[0022] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0023] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0024] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0025] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0026] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0027] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0028] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0029] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0030] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0031] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0032] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0033] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0034] This invention is a system that assists foreign visitors to Japan in efficiently selecting and purchasing souvenirs. The system mainly consists of a terminal operated by the user and a server that performs processing. A specific embodiment of the system is shown below.

[0035] The user first uses a terminal to enter information such as the recipient's gender, age, preferences, budget, and the purpose of the gift. The terminal sends the entered information to the server in real time. This information is temporarily stored on the server and used for processing in the next step.

[0036] The server analyzes the received information and applies an AI algorithm to select the product best suited to the user's needs. This AI searches and filters products from an existing database to generate a list of relevant items. Selection criteria include price range, category, and other entered conditions.

[0037] The product list generated by the server is sent to the terminal and displayed to the user as a suggestion. At this time, a function is activated that explains the cultural background and characteristics of each product in multiple languages ​​using an information provision system. The user can then use this information to choose the most suitable souvenir.

[0038] For selected products, the server connects with the store's inventory information system to retrieve real-time inventory status and store operating information. This allows users to check available products and make quick decisions.

[0039] Users who decide to purchase proceed with the purchase through their terminal. The server executes a secure payment process and confirms the purchase. At this time, users can select delivery options to their home or hotel. Based on the selected delivery address, the server initiates the logistics process.

[0040] Finally, users can submit feedback on the products they receive, and the server collects this feedback to help the AI ​​learn further. This allows the system to continuously improve in order to increase user satisfaction.

[0041] This system allows foreign visitors to Japan to efficiently and satisfactorily purchase souvenirs through their travel experience, and also contributes to the revitalization of local economies.

[0042] The following describes the processing flow.

[0043] Step 1:

[0044] The user accesses the souvenir selection app using their device and enters the necessary information (such as the recipient's gender, age, preferences, budget, and purpose of the souvenir). The device then prepares to send this information to the server.

[0045] Step 2:

[0046] The terminal organizes the entered user information and sends it to the server. Based on the received information, the server prepares the necessary dataset for the recommendation engine and starts the AI ​​analysis.

[0047] Step 3:

[0048] The AI ​​implemented within the server analyzes the received data and filters products that match the user's preferences. This process involves accessing a database and selecting products that meet the specified criteria.

[0049] Step 4:

[0050] The server generates a list of products selected by the AI ​​and creates detailed descriptions for each product in multiple languages. The generated product list is then sent to the terminal for display.

[0051] Step 5:

[0052] The terminal displays a list of products selected by the user. The user selects their desired product while viewing detailed information in multiple languages.

[0053] Step 6:

[0054] When a user selects an item, the terminal sends the selection to the server, which then accesses the store's inventory management system to check the item's availability and the store's operating information.

[0055] Step 7:

[0056] The server transmits the acquired inventory information to the terminal in real time, prompting the user to check the available products for purchase.

[0057] Step 8:

[0058] Once the user decides to purchase, the terminal communicates the purchase intention to the server, which then initiates the payment process. The server completes the transaction via a secure payment system.

[0059] Step 9:

[0060] The server executes logistics procedures to deliver the goods to the specified delivery destination, based on the delivery option selected by the user.

[0061] Step 10:

[0062] After purchase, users can submit feedback about the product through their device. The server collects this feedback and uses it to train the AI ​​and improve the system.

[0063] (Example 1)

[0064] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0065] Foreign visitors to Japan face numerous challenges when efficiently and satisfactorily selecting and purchasing souvenirs. Language barriers and a lack of understanding of different cultures make it difficult to choose appropriate souvenirs, and real-time information on product availability and prices may not be available. Furthermore, a lack of smooth delivery services for purchased items can detract from the user's travel experience. Solving these problems is essential.

[0066] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0067] In this invention, the server includes means for a user interface to receive detailed information from users, means for artificial intelligence to analyze the information and provide prompt sentences to a generating AI model to extract products, and management means for dynamically acquiring the inventory status of the relevant products and the operating status of sales locations. This enables foreign visitors to Japan to efficiently select and purchase appropriate souvenirs, overcoming language and cultural barriers. Furthermore, it allows users to select their desired delivery options and have products delivered smoothly to a designated pick-up location, improving the user's travel experience.

[0068] The term "user" refers to a person who operates the system and provides information.

[0069] A "user interface" refers to a visual or physical interface provided for users to input and manipulate information.

[0070] A "generative AI model" refers to an artificial intelligence algorithm used to select the most suitable product based on the input information.

[0071] A "prompt statement" refers to specific input data used to instruct a generating AI model on how to perform analysis.

[0072] "Artificial intelligence" refers to a computer program that performs analysis and judgment based on data and generates suggestions for users.

[0073] "Management means" refers to a system configuration for dynamically acquiring inventory and sales information and providing users with information optimized for their needs.

[0074] "Delivery management means" refers to the function of controlling the means of logistics to efficiently deliver purchased goods to a designated location.

[0075] This invention is a support system for foreign visitors to Japan to efficiently select and purchase souvenirs, and mainly consists of a terminal operated by the user and a server responsible for data analysis.

[0076] The user first uses the user interface on their device to input information such as the recipient's gender, age, preferences, budget, and the purpose of the gift. The device then securely encrypts this information and sends it to the server.

[0077] The server uses a generative AI model to analyze the information it receives. This AI constructs prompts based on user input and extracts the most suitable products from an existing database. For example, a prompt might include specific conditions such as "a gift for a friend in their 30s, under 3000 yen, and Japanese style."

[0078] The AI ​​selects the product that best matches the user's criteria from a filtered list of products. For the selected products, detailed information is prepared on the server side in multiple languages, detailing the cultural background and product characteristics.

[0079] Next, the server retrieves real-time inventory information and sales information from sales locations and sends it to the user's terminal. This allows the user to immediately see which products are available for purchase.

[0080] The purchase process is conducted on the terminal, and the server provides a secure payment process. Furthermore, the user can select their preferred delivery option, and the server initiates the logistics process to deliver the goods to the specified delivery location.

[0081] As described above, foreign visitors to Japan can purchase souvenirs smoothly and with high satisfaction, enjoying efficient shopping while experiencing Japanese culture.

[0082] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0083] Step 1:

[0084] The user launches the user interface on their device and enters information about the recipient of the gift into the input fields. Specifically, they select gender, age, preferences, budget, purpose of the gift, etc., on the device's operation screen and enter them into text boxes. The entered information is then temporarily saved to the device's local storage.

[0085] Step 2:

[0086] The terminal encrypts the information entered by the user and sends it to the server. Security is ensured by using an encryption protocol (e.g., HTTPS) for transmission. The entered data includes category information such as gender and age, as well as text-based information about preferences and budget, and this data is transmitted.

[0087] Step 3:

[0088] The server uses a generative AI model to create a prompt message in order to analyze the received information. The prompt message is generated in the format "female in her 30s, budget of 3000 yen, Japanese culture". This prompt message is given to the AI, which filters suitable products from the existing database. The process involves checking the product data structure in the database and selecting products that match the conditions.

[0089] Step 4:

[0090] The server translates the generated product list into multiple languages ​​and then sends it to the terminal. Natural language processing technology is used for the translation process to generate multicultural descriptions. Product information, including images, text, and prices, is sent in a format that can be displayed on the user's terminal.

[0091] Step 5:

[0092] The user selects items of interest from a list displayed on their device. The user's selection is made on the device, and the results are sent back to the server. Based on this information, the server performs the next step: checking inventory.

[0093] Step 6:

[0094] The server integrates with the store's inventory management system to check the stock status of the selected product. Information is retrieved via a real-time API and sent to the terminal. This allows the user to instantly check whether the product is available for purchase.

[0095] Step 7:

[0096] The user confirms the purchase and completes the payment process from their terminal. The server performs a secure payment processing and verifies the purchase details. The input information includes payment information and shipping address, and as a result, a purchase confirmation message is displayed to the user.

[0097] Step 8:

[0098] Based on the purchase information, the server instructs the logistics system to begin the shipping process. Once the shipping arrangements are complete, a link to track the shipping status is sent to the user's device, allowing the user to check the shipping progress in real time.

[0099] (Application Example 1)

[0100] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0101] The challenge is to enable foreign visitors to Japan to efficiently select and purchase unique Japanese souvenirs in a short amount of time. Foreign tourists often struggle to choose souvenirs due to language barriers and a lack of cultural knowledge, and if store inventory and purchasing options are limited, they are unable to have a satisfying shopping experience.

[0102] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0103] In this invention, the server includes communication means for receiving information from users, computing means equipped with artificial intelligence for searching for and recommending products based on the information received from users, and information display means for providing detailed information about products in multiple languages. This makes it possible for foreign visitors to Japan to efficiently select and learn about the most suitable products without being dependent on language.

[0104] "Communication means" refers to a device or mechanism used to receive information from a user.

[0105] "Computational means" refers to an algorithm or hardware equipped with artificial intelligence for searching for and recommending products based on information received from the user.

[0106] "Information display means" refers to a screen or interface for providing users with detailed information about a product in multiple languages.

[0107] "Display means" refers to a device or mechanism for displaying the inventory status of exhibited products and sales information of the sales location in real time.

[0108] A "purchase processing means" is a system or device used to perform transaction processing for a user to purchase goods.

[0109] "Logistics processing means" refers to a device or system for executing procedures to send the goods selected by the user to the point of purchase or delivery destination.

[0110] "Learning processing means" refers to algorithms or systems used to collect user evaluations or opinions and improve the recommendation accuracy of artificial intelligence.

[0111] This invention is an embodiment of a system that assists foreign visitors to Japan in effectively and efficiently purchasing souvenirs within Japan. The system consists of a communication terminal and a control server.

[0112] The server collects user input information and uses it to recommend products. Specifically, the server receives data from users via communication channels. This includes information such as gender, age, preferences, and budget. Next, the server uses artificial intelligence (AI) to search for products based on the received information and recommend the most suitable products. The AI ​​is built using the Python programming language and machine learning libraries such as TENSORFLOW®.

[0113] Recommended products are provided to the user's device in multiple languages ​​along with detailed information via an information display system. This information is displayed on the screen of a smartphone or tablet, allowing users to easily select products by reviewing the displayed list.

[0114] After the user has made their selection, the server uses a purchasing process to execute the transaction. This process integrates secure payment methods, allowing users to confirm their purchase quickly and efficiently. Furthermore, the goods are shipped to the point of purchase or designated delivery destination via a logistics processing system.

[0115] These features allow users to easily select and purchase appropriate products that reflect Japanese culture. The following is a specific example of its use: For instance, if a user has the need to "find a recommended souvenir for a woman in her 30s, featuring traditional Japanese pottery, within a budget of 5,000 yen," the system can present optimal product options. Based on this prompt, a product list is displayed on the user's device, making selection easier.

[0116] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0117] Step 1:

[0118] The user enters information about the souvenir through their device. This information includes the recipient's gender, age, preferences, and budget. The device then sends this information to the server. At this stage, the user's input data is provided to the server, and this data forms the basis for product recommendations.

[0119] Step 2:

[0120] The server analyzes the received information and uses an AI algorithm to search for the product that best matches the user's needs. Specifically, it uses Python and TensorFlow to filter products from the database that meet the user's needs. In this process, product candidates are listed based on the user information received as input data.

[0121] Step 3:

[0122] The server sends a list of selected products to the user's terminal via an information display device. The information includes multilingual support, allowing the user to understand the cultural background and details of each product. The output at this stage is a product list optimized for the user.

[0123] Step 4:

[0124] The user views a list of products displayed on their device screen and selects the items they wish to purchase. This selection is based on the user's judgment, and they choose the products they deem most suitable.

[0125] Step 5:

[0126] The server initiates the purchase process for the selected product. Using a purchasing mechanism, it provides a secure payment method and processes the user's purchase request. After the purchase is complete, the system displays the result to the user as confirmation.

[0127] Step 6:

[0128] After the purchase process is complete, the server uses logistics processing to arrange for the shipment of the goods to the user's purchase location or designated delivery address. In this step, the server generates specific shipping instructions using delivery options and delivery address information.

[0129] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0130] This invention is a system designed to enhance the experience of foreign visitors to Japan in selecting and purchasing the perfect souvenirs during their trip, and in particular, it has the function of recognizing the user's emotions and making emotion-based product suggestions. The system utilizes emotion data via an emotion engine to realize personalized suggestions that match the user's preferences and purposes.

[0131] The user first uses a terminal to enter the necessary information. This information includes basic information about the recipient, the purpose of the gift, budget, and preferences. The terminal sends this information to the server, which then prepares to analyze it.

[0132] The server is equipped with an AI-powered product recommendation engine that generates a list of candidate products based on user input. This engine also utilizes an emotion engine, taking into account emotional data from past interactions. For example, emotional data from when a user previously selected products in a specific category can be used to help select future candidate products.

[0133] The generated product list is sent from the server to the terminal and displayed to the user. The terminal provides the user with detailed information in multiple languages. At this point, the sentiment data output by the sentiment engine is used to dynamically adjust the product descriptions and recommendation messages to make them more relatable to the user.

[0134] The user reviews the displayed product list and selects the desired product. The terminal sends this selection to the server, which then integrates with the inventory information system to check the inventory of the selected product and the store's operating hours in real time.

[0135] When a user decides to make a purchase, they notify the server via their device. The server then initiates the payment process to facilitate the purchase. This process includes delivery options, allowing the user to specify the delivery address.

[0136] After purchase, users can provide feedback, which is sent to the server via the emotion engine. The server uses this information to update the AI's learning database. This update allows for future service improvements.

[0137] In this way, by providing a product recommendation function that utilizes an emotion engine, this system can enrich and personalize the purchasing experience of foreign visitors to Japan, and contribute to the revitalization of local economies.

[0138] The following describes the processing flow.

[0139] Step 1:

[0140] The user accesses the souvenir selection application through their device and enters information such as the recipient's details, budget, preferences, purpose of the souvenir, and selection trends based on past profiles. The device then aggregates this information and prepares to send it to the server.

[0141] Step 2:

[0142] The terminal sends the entered information to the server. The server receives this information and stores it in the user database. This allows access to past preference data.

[0143] Step 3:

[0144] The server generates suitable product candidates from the product database. Here, the emotion engine is utilized to analyze the user's past emotional data, identify the characteristics of products that have shown positive emotions, and adjust the current suggestions based on that.

[0145] Step 4:

[0146] The server generates a list of products selected by an AI algorithm, incorporates adjustments made by an emotion engine, and then sends the list to the terminal. As a result, recommendation messages based on emotion data are attached to the products that are selected as candidates.

[0147] Step 5:

[0148] The device displays a product list to the user. Detailed information about each product is provided in multiple languages, and the user is informed that recommendation messages are tailored based on emotional factors. The user can then use this information to select their preferred products.

[0149] Step 6:

[0150] When a user selects a product, the terminal sends the selected product information to the server. The server uses this information to check actual inventory levels and obtains real-time updated inventory status and store operating information.

[0151] Step 7:

[0152] The server sends the confirmed inventory information to the terminal, displaying the latest available purchase information to the user and enabling them to proceed with the purchase.

[0153] Step 8:

[0154] After the user decides to purchase, the device transmits the purchase intention to the server. The server initiates the payment process for the purchase and handles it to ensure a secure transaction. If a shipping option is selected, the shipping process also proceeds simultaneously.

[0155] Step 9:

[0156] After purchase, users provide feedback from their device. This feedback includes emotions as input to the emotion engine and is sent to the server. The server receives this feedback and updates the feedback database to improve the recommendation accuracy of the AI ​​system.

[0157] Through these steps, the system supports personalized souvenir selection that takes user emotions into account, improving the purchasing experience.

[0158] (Example 2)

[0159] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0160] There is a growing need to personalize and enhance the shopping experience for foreign visitors to Japan. However, existing systems do not adequately provide personalized product recommendations based on users' emotions and past behavior. This makes it difficult to appropriately suggest products that users truly want, resulting in a challenge in providing the optimal purchasing experience.

[0161] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0162] In this invention, the server includes an input means for receiving attribute information and emotional state from the user, an artificial intelligence processing means equipped with emotion analysis for generating and suggesting products based on the information received from the user and past emotional data, and an information providing means for providing detailed product information and dynamic recommendation messages based on emotions in multiple languages. This enables product suggestions that take the user's emotions into consideration, providing a more personalized purchasing experience.

[0163] "Attribute information" refers to basic data about users, such as age, gender, and purchase history, and is used as basic information for product recommendations.

[0164] "Emotional state" refers to the psychological and emotional responses that users exhibit under specific circumstances, and is data that is considered when proposing products.

[0165] "Artificial intelligence processing means" refers to algorithms and technologies that analyze data obtained from users and recommend products.

[0166] "Emotional analysis" refers to the process of understanding and analyzing the emotional state of users, and is a technology that enables personalized product recommendations.

[0167] A "dynamic recommendation message" refers to a product recommendation that changes in content according to the user's attribute information and emotional state.

[0168] "Logistics means" refers to the function of delivering selected goods to the designated receiving location specified by the user, and functions as part of the system.

[0169] This invention is a system for personalizing the shopping experience of foreign visitors to Japan and providing emotion-based product recommendations. Specifically, a terminal and a server communicate, and artificial intelligence is used to suggest products based on the user's input information.

[0170] Users input their attribute information and emotional state using devices such as smartphones and tablets. This input data is securely transmitted to the server. The device is configured to allow users to input information in multiple languages, and the output is displayed in the language selected by the user.

[0171] The server processes the received data using a generative AI model equipped with sentiment analysis. The server incorporates a product recommendation engine that selects the most suitable products based on accumulated user sentiment data and attribute information. In this process, the user's past emotional states and purchase history are considered to generate a suitable product list. This list is sent to the device and displayed as a dynamic recommendation message.

[0172] For example, suppose a user is looking for a "traditional souvenir for a friend" that can be purchased in Kyoto. By inputting information about their purpose and budget through their device, the server uses a generative AI model to suggest traditional Kyoto products and items with unique designs.

[0173] An example of a prompt is: "Please describe a system that suggests the best souvenirs for foreign visitors to Japan based on their emotions." This invention aims to provide foreign visitors with a more fulfilling and personalized experience when purchasing goods, and to contribute to the revitalization of local economies.

[0174] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0175] Step 1:

[0176] The user accesses an input screen using their device and enters their attribute information (e.g., age, gender, nationality) and emotional state (e.g., interests, level of interest). This allows initial data based on the user's preferences and goals to be stored on the device. The device then prepares this input information to send to the server as structured data and verifies the data format.

[0177] Step 2:

[0178] The terminal sends the collected user data to the server. The data sent includes the user's entered attribute information and emotional state, which forms the basis for processing on the server. The server verifies the received data and cleans or transforms it as needed.

[0179] Step 3:

[0180] The server processes user data using a generative AI model that performs sentiment analysis. Based on the input data, it analyzes the emotional state by comparing it with past interactions and sentiment history. Using this analyzed data, the server generates a list of product candidates that match the user's emotions. The output is a list of required product attributes and categories.

[0181] Step 4:

[0182] The server adds detailed product information based on the generated list of potential products. This process is carried out in conjunction with the product database to create dynamic recommendation messages that align with the user's emotions. The server then prepares to send this detailed information and recommendation message to the terminal.

[0183] Step 5:

[0184] The terminal displays the received product list and recommendation messages in multiple languages. The user reviews the suggested product options and selects the desired products. Once the user has made their selection, the terminal sends that information back to the server.

[0185] Step 6:

[0186] The server connects with the inventory check system based on the user's selected product information. It checks the inventory status of the selected product and the store's operating hours in real time. The output of this process is the product's purchase availability status.

[0187] Step 7:

[0188] Once the user decides to purchase, they notify the server of their purchase confirmation via their device. The server then initiates the payment process and performs the necessary transaction procedures. After payment is complete, it proceeds with shipping arrangements. The output of this process is purchase and shipping confirmation information.

[0189] Step 8:

[0190] The user enters feedback about their purchase experience into their device. The device sends this information to a server, which updates the training database of the generated AI model based on the feedback. The output of this feedback process is the data update to the training database.

[0191] (Application Example 2)

[0192] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0193] When foreign visitors to Japan choose the perfect souvenirs during their trip, they often face the challenge of receiving suggestions based on their individual feelings and preferences. Furthermore, language barriers and unclear inventory information can limit their purchasing experience.

[0194] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0195] In this invention, the server includes an input means for receiving information from the user, a processing means equipped with artificial intelligence for searching for and suggesting products based on the information received from the user, and an emotion analysis means for dynamically adjusting product suggestions based on the user's emotion data. This makes it possible for foreign visitors to Japan to receive personalized product suggestions based on their emotions and overcome limitations in the purchasing experience due to language and inventory information.

[0196] "Input means" refers to a device or method for receiving information from a user.

[0197] "Processing means" refers to a device or method for searching for and suggesting products based on information received using artificial intelligence.

[0198] "Emotional analysis means" refers to a device or method for dynamically adjusting product recommendations based on user emotional data.

[0199] "Information provision means" refers to a device or method for providing detailed information about a product in multiple languages.

[0200] "Display means" refers to a device or method for displaying the inventory status of a proposed product and store operating information in real time.

[0201] "Means of purchase" refers to a device or method that allows a user to carry out transaction procedures for purchasing goods.

[0202] "Delivery method" refers to the equipment or method used to deliver goods to the user's place of residence or selected destination.

[0203] A "digital assistant function" is a feature that works in conjunction with smart devices to support the user's purchasing experience.

[0204] To implement this invention, a system will be built that uses user emotional data to suggest products. This system will consist of the user's smart device (e.g., a smartphone) and a server. The server will be equipped with an AI recommendation engine developed using Python and TensorFlow, and will retrieve information from a database managed by MongoDB.

[0205] Users input necessary information into a specific application using their smartphones. This application, developed using React Native, is responsible for sending the input data to a server. The data that reaches the server is analyzed by an AI engine, which, along with the user's emotional data, provides product recommendations.

[0206] The suggested product list is displayed on the smartphone, and detailed information can be viewed in multiple languages. Once the user selects an item and decides to purchase it, the payment process begins. This includes delivery options, and arrangements are made for the product to be delivered to the specified address.

[0207] For example, suppose a foreign visitor staying in Kyoto accesses an application using their smartphone. This user inputs that they are interested in traditional Japanese crafts as souvenirs, and the application requests suggestions from the server based on the user's sentiment data. The server generates a product list accordingly, and the user selects their preferred items and makes a purchase.

[0208] An example of a prompt message might be: "Tourists scan the QR code (registered trademark) with their smartphones, provide feedback to rate related products, and the AI ​​learns from the ratings to improve the accuracy of product recommendations."

[0209] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0210] Step 1:

[0211] The user launches an application on their smartphone and enters basic information about the recipient, the purpose of the gift, budget, and preferences. This input data is sent from the device to the server. Based on the input data, the server updates the user's profile and retrieves sentiment data from the previous interaction.

[0212] Step 2:

[0213] The server uses a generative AI model to process the received user information and sentiment data. Sentiment analysis measures analyze the user's emotional tendencies and, based on this, generate a product list for product recommendations. The input here is user information and sentiment data, and the output is a customized product list.

[0214] Step 3:

[0215] The generated product list is sent to the terminal and displayed to the user. The terminal supports multiple languages ​​and displays detailed information about the products. The user reviews the displayed product list and selects the products they like. The input here is the product list sent from the server, and the output is the user's selection information.

[0216] Step 4:

[0217] After the user selects their desired product, the selection information is sent back from the terminal to the server. The server interacts with the inventory information system to check the inventory status of the selected product and the store's operating hours in real time. Once the inventory check is complete, the user receives a purchase confirmation message.

[0218] Step 5:

[0219] The server initiates the payment process once the user decides to purchase. During this process, it provides delivery options to the user's specified address or destination, utilizing the available shipping methods. Once payment is complete, the purchase details are displayed on the terminal. The input here is the user's payment information, and the output is a purchase confirmation message.

[0220] Step 6:

[0221] After purchase, users can provide product feedback through the application. This feedback is sent from the device to the server, which updates the training database of the generated AI model. The input here is the user's feedback information, and the output is the updated database information.

[0222] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0223] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0224] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0225] [Second Embodiment]

[0226] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0227] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0228] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0229] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0230] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0231] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0232] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0233] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0234] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0235] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0236] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0237] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0238] This invention is a system that assists foreign visitors to Japan in efficiently selecting and purchasing souvenirs. The system mainly consists of a terminal operated by the user and a server that performs processing. A specific embodiment of the system is shown below.

[0239] The user first uses a terminal to enter information such as the recipient's gender, age, preferences, budget, and the purpose of the gift. The terminal sends the entered information to the server in real time. This information is temporarily stored on the server and used for processing in the next step.

[0240] The server analyzes the received information and applies an AI algorithm to select the product best suited to the user's needs. This AI searches and filters products from an existing database to generate a list of relevant items. Selection criteria include price range, category, and other entered conditions.

[0241] The product list generated by the server is sent to the terminal and displayed to the user as a suggestion. At this time, a function is activated that explains the cultural background and characteristics of each product in multiple languages ​​using an information provision system. The user can then use this information to choose the most suitable souvenir.

[0242] For selected products, the server connects with the store's inventory information system to retrieve real-time inventory status and store operating information. This allows users to check available products and make quick decisions.

[0243] Users who decide to purchase proceed with the purchase through their terminal. The server executes a secure payment process and confirms the purchase. At this time, users can select delivery options to their home or hotel. Based on the selected delivery address, the server initiates the logistics process.

[0244] Finally, users can submit feedback on the products they receive, and the server collects this feedback to help the AI ​​learn further. This allows the system to continuously improve in order to increase user satisfaction.

[0245] This system allows foreign visitors to Japan to efficiently and satisfactorily purchase souvenirs through their travel experience, and also contributes to the revitalization of local economies.

[0246] The following describes the processing flow.

[0247] Step 1:

[0248] The user accesses the souvenir selection app using their device and enters the necessary information (such as the recipient's gender, age, preferences, budget, and purpose of the souvenir). The device then prepares to send this information to the server.

[0249] Step 2:

[0250] The terminal organizes the entered user information and sends it to the server. Based on the received information, the server prepares the necessary dataset for the recommendation engine and starts the AI ​​analysis.

[0251] Step 3:

[0252] The AI ​​implemented within the server analyzes the received data and filters products that match the user's preferences. This process involves accessing a database and selecting products that meet the specified criteria.

[0253] Step 4:

[0254] The server generates a list of products selected by the AI ​​and creates detailed descriptions for each product in multiple languages. The generated product list is then sent to the terminal for display.

[0255] Step 5:

[0256] The terminal displays a list of products selected by the user. The user selects their desired product while viewing detailed information in multiple languages.

[0257] Step 6:

[0258] When a user selects an item, the terminal sends the selection to the server, which then accesses the store's inventory management system to check the item's availability and the store's operating information.

[0259] Step 7:

[0260] The server transmits the acquired inventory information to the terminal in real time, prompting the user to check the available products for purchase.

[0261] Step 8:

[0262] Once the user decides to purchase, the terminal communicates the purchase intention to the server, which then initiates the payment process. The server completes the transaction via a secure payment system.

[0263] Step 9:

[0264] The server executes logistics procedures to deliver the goods to the specified delivery destination, based on the delivery option selected by the user.

[0265] Step 10:

[0266] After purchase, users can submit feedback about the product through their device. The server collects this feedback and uses it to train the AI ​​and improve the system.

[0267] (Example 1)

[0268] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0269] Foreign visitors to Japan face numerous challenges when efficiently and satisfactorily selecting and purchasing souvenirs. Language barriers and a lack of understanding of different cultures make it difficult to choose appropriate souvenirs, and real-time information on product availability and prices may not be available. Furthermore, a lack of smooth delivery services for purchased items can detract from the user's travel experience. Solving these problems is essential.

[0270] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0271] In this invention, the server includes means for a user interface to receive detailed information from users, means for artificial intelligence to analyze the information and provide prompt sentences to a generating AI model to extract products, and management means for dynamically acquiring the inventory status of the relevant products and the operating status of sales locations. This enables foreign visitors to Japan to efficiently select and purchase appropriate souvenirs, overcoming language and cultural barriers. Furthermore, it allows users to select their desired delivery options and have products delivered smoothly to a designated pick-up location, improving the user's travel experience.

[0272] The term "user" refers to a person who operates the system and provides information.

[0273] A "user interface" refers to a visual or physical interface provided for users to input and manipulate information.

[0274] A "generative AI model" refers to an artificial intelligence algorithm used to select the most suitable product based on the input information.

[0275] A "prompt statement" refers to specific input data used to instruct a generating AI model on how to perform analysis.

[0276] "Artificial intelligence" refers to a computer program that performs analysis and judgment based on data and generates suggestions for users.

[0277] "Management means" refers to a system configuration for dynamically acquiring inventory and sales information and providing users with information optimized for their needs.

[0278] "Delivery management means" refers to the function of controlling the means of logistics to efficiently deliver purchased goods to a designated location.

[0279] This invention is a support system for foreign visitors to Japan to efficiently select and purchase souvenirs, mainly composed of a terminal operated by the user and a server responsible for data analysis.

[0280] First, the user uses the user interface on the terminal to input information such as the gender, age, preferences, budget, and purpose of the souvenir of the recipient of the gift. The terminal encrypts this information securely and then sends it to the server.

[0281] The server uses a generative AI model to analyze the received information. This AI constructs a prompt sentence based on the input from the user and extracts the optimal products from the existing database. For example, specific conditions such as "a gift for a friend in their 30s, with a budget of within 3000 yen, and something Japanese-style" are given as the prompt sentence.

[0282] The AI selects the candidate that best matches the user's conditions from the filtered product group. For the selected products, detailed information corresponding to multiple languages is prepared on the server side, and the cultural background and product features are described in detail.

[0283] Next, the server obtains the inventory information of the products and the business information of the sales outlets in real time and sends them to the user terminal. As a result, the user can immediately check the products that can be purchased.

[0284] The purchase procedure is carried out on the terminal, and the server provides a secure payment process. Furthermore, the user can select the desired delivery option, and the server starts the logistics procedure for delivering the product to the designated receiving location.

[0285] In the above manner, foreign visitors to Japan can smoothly and satisfactorily purchase souvenirs, and can enjoy efficient shopping while experiencing Japanese culture.

[0286] The flow of the specific process in Example 1 will be described using FIG. 11.

[0287] Step 1:

[0288] The user launches the user interface on their device and enters information about the recipient of the gift into the input fields. Specifically, they select gender, age, preferences, budget, purpose of the gift, etc., on the device's operation screen and enter them into text boxes. The entered information is then temporarily saved to the device's local storage.

[0289] Step 2:

[0290] The terminal encrypts the information entered by the user and sends it to the server. Security is ensured by using an encryption protocol (e.g., HTTPS) for transmission. The entered data includes category information such as gender and age, as well as text-based information about preferences and budget, and this data is transmitted.

[0291] Step 3:

[0292] The server uses a generative AI model to create a prompt message in order to analyze the received information. The prompt message is generated in the format "female in her 30s, budget of 3000 yen, Japanese culture". This prompt message is given to the AI, which filters suitable products from the existing database. The process involves checking the product data structure in the database and selecting products that match the conditions.

[0293] Step 4:

[0294] The server translates the generated product list into multiple languages ​​and then sends it to the terminal. Natural language processing technology is used for the translation process to generate multicultural descriptions. Product information, including images, text, and prices, is sent in a format that can be displayed on the user's terminal.

[0295] Step 5:

[0296] The user selects items of interest from a list displayed on their device. The user's selection is made on the device, and the results are sent back to the server. Based on this information, the server performs the next step: checking inventory.

[0297] Step 6:

[0298] The server integrates with the store's inventory management system to check the stock status of the selected product. Information is retrieved via a real-time API and sent to the terminal. This allows the user to instantly check whether the product is available for purchase.

[0299] Step 7:

[0300] The user confirms the purchase and completes the payment process from their terminal. The server performs a secure payment processing and verifies the purchase details. The input information includes payment information and shipping address, and as a result, a purchase confirmation message is displayed to the user.

[0301] Step 8:

[0302] Based on the purchase information, the server instructs the logistics system to begin the shipping process. Once the shipping arrangements are complete, a link to track the shipping status is sent to the user's device, allowing the user to check the shipping progress in real time.

[0303] (Application Example 1)

[0304] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0305] The challenge is to enable foreign visitors to Japan to efficiently select and purchase unique Japanese souvenirs in a short amount of time. Foreign tourists often struggle to choose souvenirs due to language barriers and a lack of cultural knowledge, and if store inventory and purchasing options are limited, they are unable to have a satisfying shopping experience.

[0306] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means respectively.

[0307] In this invention, the server includes a communication means for receiving information from the user, an arithmetic means with artificial intelligence for searching and recommending products based on the information received from the user, and an information display means for providing detailed information about the products in multiple languages. Thereby, foreign visitors to Japan can efficiently select and acquire optimal products without depending on languages.

[0308] The "communication means" is a device or mechanism used to receive information from the user.

[0309] The "arithmetic means" is an algorithm or hardware with artificial intelligence for searching and recommending products based on the information received from the user.

[0310] The "information display means" is a screen or interface for providing the user with detailed information about the products in multiple languages.

[0311] The "display means" is a device or mechanism for displaying in real time the inventory status of the exhibited products and the business information of the sales locations.

[0312] The "purchase processing means" is a system or device used to execute the transaction processing for the user to purchase products.

[0313] The "logistics processing means" is a device or system used to execute the procedures for delivering the products selected by the user to the purchase location or the delivery destination.

[0314] The "learning processing means" is an algorithm or system used to collect the evaluations or opinions of the user and improve the recommendation accuracy of the artificial intelligence.

[0315] This invention is an embodiment of a system that assists foreign visitors to Japan in effectively and efficiently purchasing souvenirs within Japan. The system consists of a communication terminal and a control server.

[0316] The server collects user input information and uses it to recommend products. Specifically, the server receives data from users via communication channels. This includes information such as gender, age, preferences, and budget. Next, the server uses artificial intelligence (AI) to search for products based on the received information and recommend the most suitable products. The AI ​​is built using the Python programming language and machine learning libraries such as TensorFlow.

[0317] Recommended products are provided to the user's device in multiple languages ​​along with detailed information via an information display system. This information is displayed on the screen of a smartphone or tablet, allowing users to easily select products by reviewing the displayed list.

[0318] After the user has made their selection, the server uses a purchasing process to execute the transaction. This process integrates secure payment methods, allowing users to confirm their purchase quickly and efficiently. Furthermore, the goods are shipped to the point of purchase or designated delivery destination via a logistics processing system.

[0319] These features allow users to easily select and purchase appropriate products that reflect Japanese culture. The following is a specific example of its use: For instance, if a user has the need to "find a recommended souvenir for a woman in her 30s, featuring traditional Japanese pottery, within a budget of 5,000 yen," the system can present optimal product options. Based on this prompt, a product list is displayed on the user's device, making selection easier.

[0320] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0321] Step 1:

[0322] The user enters information about the souvenir through their device. This information includes the recipient's gender, age, preferences, and budget. The device then sends this information to the server. At this stage, the user's input data is provided to the server, and this data forms the basis for product recommendations.

[0323] Step 2:

[0324] The server analyzes the received information and uses an AI algorithm to search for the product that best matches the user's needs. Specifically, it uses Python and TensorFlow to filter products from the database that meet the user's needs. In this process, product candidates are listed based on the user information received as input data.

[0325] Step 3:

[0326] The server sends a list of selected products to the user's terminal via an information display device. The information includes multilingual support, allowing the user to understand the cultural background and details of each product. The output at this stage is a product list optimized for the user.

[0327] Step 4:

[0328] The user views a list of products displayed on their device screen and selects the items they wish to purchase. This selection is based on the user's judgment, and they choose the products they deem most suitable.

[0329] Step 5:

[0330] The server initiates the purchase process for the selected product. Using a purchasing mechanism, it provides a secure payment method and processes the user's purchase request. After the purchase is complete, the system displays the result to the user as confirmation.

[0331] Step 6:

[0332] After the purchase process is complete, the server uses logistics processing to arrange for the shipment of the goods to the user's purchase location or designated delivery address. In this step, the server generates specific shipping instructions using delivery options and delivery address information.

[0333] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0334] This invention is a system designed to enhance the experience of foreign visitors to Japan in selecting and purchasing the perfect souvenirs during their trip, and in particular, it has the function of recognizing the user's emotions and making emotion-based product suggestions. The system utilizes emotion data via an emotion engine to realize personalized suggestions that match the user's preferences and purposes.

[0335] The user first uses a terminal to enter the necessary information. This information includes basic information about the recipient, the purpose of the gift, budget, and preferences. The terminal sends this information to the server, which then prepares to analyze it.

[0336] The server is equipped with an AI-powered product recommendation engine that generates a list of candidate products based on user input. This engine also utilizes an emotion engine, taking into account emotional data from past interactions. For example, emotional data from when a user previously selected products in a specific category can be used to help select future candidate products.

[0337] The generated product list is sent from the server to the terminal and displayed to the user. The terminal provides the user with detailed information in multiple languages. At this point, the sentiment data output by the sentiment engine is used to dynamically adjust the product descriptions and recommendation messages to make them more relatable to the user.

[0338] The user reviews the displayed product list and selects the desired product. The terminal sends this selection to the server, which then integrates with the inventory information system to check the inventory of the selected product and the store's operating hours in real time.

[0339] When a user decides to make a purchase, they notify the server via their device. The server then initiates the payment process to facilitate the purchase. This process includes delivery options, allowing the user to specify the delivery address.

[0340] After purchase, users can provide feedback, which is sent to the server via the emotion engine. The server uses this information to update the AI's learning database. This update allows for future service improvements.

[0341] In this way, by providing a product recommendation function that utilizes an emotion engine, this system can enrich and personalize the purchasing experience of foreign visitors to Japan, and contribute to the revitalization of local economies.

[0342] The following describes the processing flow.

[0343] Step 1:

[0344] The user accesses the souvenir selection application through their device and enters information such as the recipient's details, budget, preferences, purpose of the souvenir, and selection trends based on past profiles. The device then aggregates this information and prepares to send it to the server.

[0345] Step 2:

[0346] The terminal sends the entered information to the server. The server receives this information and stores it in the user database. This allows access to past preference data.

[0347] Step 3:

[0348] The server generates suitable product candidates from the product database. Here, the emotion engine is utilized to analyze the user's past emotional data, identify the characteristics of products that have shown positive emotions, and adjust the current suggestions based on that.

[0349] Step 4:

[0350] The server generates a list of products selected by an AI algorithm, incorporates adjustments made by an emotion engine, and then sends the list to the terminal. As a result, recommendation messages based on emotion data are attached to the products that are selected as candidates.

[0351] Step 5:

[0352] The device displays a product list to the user. Detailed information about each product is provided in multiple languages, and the user is informed that recommendation messages are tailored based on emotional factors. The user can then use this information to select their preferred products.

[0353] Step 6:

[0354] When a user selects a product, the terminal sends the selected product information to the server. The server uses this information to check actual inventory levels and obtains real-time updated inventory status and store operating information.

[0355] Step 7:

[0356] The server sends the confirmed inventory information to the terminal, displaying the latest available purchase information to the user and enabling them to proceed with the purchase.

[0357] Step 8:

[0358] After the user decides to purchase, the device transmits the purchase intention to the server. The server initiates the payment process for the purchase and handles it to ensure a secure transaction. If a shipping option is selected, the shipping process also proceeds simultaneously.

[0359] Step 9:

[0360] After purchase, users provide feedback from their device. This feedback includes emotions as input to the emotion engine and is sent to the server. The server receives this feedback and updates the feedback database to improve the recommendation accuracy of the AI ​​system.

[0361] Through these steps, the system supports personalized souvenir selection that takes user emotions into account, improving the purchasing experience.

[0362] (Example 2)

[0363] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0364] There is a growing need to personalize and enhance the shopping experience for foreign visitors to Japan. However, existing systems do not adequately provide personalized product recommendations based on users' emotions and past behavior. This makes it difficult to appropriately suggest products that users truly want, resulting in a challenge in providing the optimal purchasing experience.

[0365] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0366] In this invention, the server includes an input means for receiving attribute information and emotional state from the user, an artificial intelligence processing means equipped with emotion analysis for generating and suggesting products based on the information received from the user and past emotional data, and an information providing means for providing detailed product information and dynamic recommendation messages based on emotions in multiple languages. This enables product suggestions that take the user's emotions into consideration, providing a more personalized purchasing experience.

[0367] "Attribute information" refers to basic data about users, such as age, gender, and purchase history, and is used as basic information for product recommendations.

[0368] "Emotional state" refers to the psychological and emotional responses that users exhibit under specific circumstances, and is data that is considered when proposing products.

[0369] "Artificial intelligence processing means" refers to algorithms and technologies that analyze data obtained from users and recommend products.

[0370] "Emotional analysis" refers to the process of understanding and analyzing the emotional state of users, and is a technology that enables personalized product recommendations.

[0371] A "dynamic recommendation message" refers to a product recommendation that changes in content according to the user's attribute information and emotional state.

[0372] "Logistics means" refers to the function of delivering selected goods to the designated receiving location specified by the user, and functions as part of the system.

[0373] This invention is a system for personalizing the shopping experience of foreign visitors to Japan and providing emotion-based product recommendations. Specifically, a terminal and a server communicate, and artificial intelligence is used to suggest products based on the user's input information.

[0374] Users input their attribute information and emotional state using devices such as smartphones and tablets. This input data is securely transmitted to the server. The device is configured to allow users to input information in multiple languages, and the output is displayed in the language selected by the user.

[0375] The server processes the received data using a generative AI model equipped with sentiment analysis. The server incorporates a product recommendation engine that selects the most suitable products based on accumulated user sentiment data and attribute information. In this process, the user's past emotional states and purchase history are considered to generate a suitable product list. This list is sent to the device and displayed as a dynamic recommendation message.

[0376] For example, suppose a user is looking for a "traditional souvenir for a friend" that can be purchased in Kyoto. By inputting information about their purpose and budget through their device, the server uses a generative AI model to suggest traditional Kyoto products and items with unique designs.

[0377] An example of a prompt is: "Please describe a system that suggests the best souvenirs for foreign visitors to Japan based on their emotions." This invention aims to provide foreign visitors with a more fulfilling and personalized experience when purchasing goods, and to contribute to the revitalization of local economies.

[0378] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0379] Step 1:

[0380] The user accesses an input screen using their device and enters their attribute information (e.g., age, gender, nationality) and emotional state (e.g., interests, level of interest). This allows initial data based on the user's preferences and goals to be stored on the device. The device then prepares this input information to send to the server as structured data and verifies the data format.

[0381] Step 2:

[0382] The terminal sends the collected user data to the server. The data sent includes the user's entered attribute information and emotional state, which forms the basis for processing on the server. The server verifies the received data and cleans or transforms it as needed.

[0383] Step 3:

[0384] The server processes user data using a generative AI model that performs sentiment analysis. Based on the input data, it analyzes the emotional state by comparing it with past interactions and sentiment history. Using this analyzed data, the server generates a list of product candidates that match the user's emotions. The output is a list of required product attributes and categories.

[0385] Step 4:

[0386] The server adds detailed product information based on the generated list of potential products. This process is carried out in conjunction with the product database to create dynamic recommendation messages that align with the user's emotions. The server then prepares to send this detailed information and recommendation message to the terminal.

[0387] Step 5:

[0388] The terminal displays the received product list and recommendation messages in multiple languages. The user reviews the suggested product options and selects the desired products. Once the user has made their selection, the terminal sends that information back to the server.

[0389] Step 6:

[0390] The server connects with the inventory check system based on the user's selected product information. It checks the inventory status of the selected product and the store's operating hours in real time. The output of this process is the product's purchase availability status.

[0391] Step 7:

[0392] Once the user decides to purchase, they notify the server of their purchase confirmation via their device. The server then initiates the payment process and performs the necessary transaction procedures. After payment is complete, it proceeds with shipping arrangements. The output of this process is purchase and shipping confirmation information.

[0393] Step 8:

[0394] The user enters feedback about their purchase experience into their device. The device sends this information to a server, which updates the training database of the generated AI model based on the feedback. The output of this feedback process is the data update to the training database.

[0395] (Application Example 2)

[0396] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0397] When foreign visitors to Japan choose the perfect souvenirs during their trip, they often face the challenge of receiving suggestions based on their individual feelings and preferences. Furthermore, language barriers and unclear inventory information can limit their purchasing experience.

[0398] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0399] In this invention, the server includes an input means for receiving information from the user, a processing means equipped with artificial intelligence for searching for and suggesting products based on the information received from the user, and an emotion analysis means for dynamically adjusting product suggestions based on the user's emotion data. This makes it possible for foreign visitors to Japan to receive personalized product suggestions based on their emotions and overcome limitations in the purchasing experience due to language and inventory information.

[0400] "Input means" refers to a device or method for receiving information from a user.

[0401] "Processing means" refers to a device or method for searching for and suggesting products based on information received using artificial intelligence.

[0402] "Emotional analysis means" refers to a device or method for dynamically adjusting product recommendations based on user emotional data.

[0403] "Information provision means" refers to a device or method for providing detailed information about a product in multiple languages.

[0404] "Display means" refers to a device or method for displaying the inventory status of a proposed product and store operating information in real time.

[0405] "Means of purchase" refers to a device or method that allows a user to carry out transaction procedures for purchasing goods.

[0406] "Delivery method" refers to the equipment or method used to deliver goods to the user's place of residence or selected destination.

[0407] A "digital assistant function" is a feature that works in conjunction with smart devices to support the user's purchasing experience.

[0408] To implement this invention, a system will be built that uses user emotional data to suggest products. This system will consist of the user's smart device (e.g., a smartphone) and a server. The server will be equipped with an AI recommendation engine developed using Python and TensorFlow, and will retrieve information from a database managed by MongoDB.

[0409] Users input necessary information into a specific application using their smartphones. This application, developed using React Native, is responsible for sending the input data to a server. The data that reaches the server is analyzed by an AI engine, which, along with the user's emotional data, provides product recommendations.

[0410] The suggested product list is displayed on the smartphone, and detailed information can be viewed in multiple languages. Once the user selects an item and decides to purchase it, the payment process begins. This includes delivery options, and arrangements are made for the product to be delivered to the specified address.

[0411] For example, suppose a foreign visitor staying in Kyoto accesses an application using their smartphone. This user inputs that they are interested in traditional Japanese crafts as souvenirs, and the application requests suggestions from the server based on the user's sentiment data. The server generates a product list accordingly, and the user selects their preferred items and makes a purchase.

[0412] An example of a prompt message might be: "Tourists scan a QR code with their smartphones, provide feedback to rate related products, and the AI ​​learns from the ratings to improve the accuracy of product recommendations."

[0413] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0414] Step 1:

[0415] The user launches an application on their smartphone and enters basic information about the recipient, the purpose of the gift, budget, and preferences. This input data is sent from the device to the server. Based on the input data, the server updates the user's profile and retrieves sentiment data from the previous interaction.

[0416] Step 2:

[0417] The server uses a generative AI model to process the received user information and sentiment data. Sentiment analysis measures analyze the user's emotional tendencies and, based on this, generate a product list for product recommendations. The input here is user information and sentiment data, and the output is a customized product list.

[0418] Step 3:

[0419] The generated product list is sent to the terminal and displayed to the user. The terminal supports multiple languages ​​and displays detailed information about the products. The user reviews the displayed product list and selects the products they like. The input here is the product list sent from the server, and the output is the user's selection information.

[0420] Step 4:

[0421] After the user selects their desired product, the selection information is sent back from the terminal to the server. The server interacts with the inventory information system to check the inventory status of the selected product and the store's operating hours in real time. Once the inventory check is complete, the user receives a purchase confirmation message.

[0422] Step 5:

[0423] The server initiates the payment process once the user decides to purchase. During this process, it provides delivery options to the user's specified address or destination, utilizing the available shipping methods. Once payment is complete, the purchase details are displayed on the terminal. The input here is the user's payment information, and the output is a purchase confirmation message.

[0424] Step 6:

[0425] After purchase, users can provide product feedback through the application. This feedback is sent from the device to the server, which updates the training database of the generated AI model. The input here is the user's feedback information, and the output is the updated database information.

[0426] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0427] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0428] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0429] [Third Embodiment]

[0430] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0431] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0432] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0433] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0434] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0435] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0436] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0437] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0438] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0439] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0440] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0441] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0442] This invention is a system that assists foreign visitors to Japan in efficiently selecting and purchasing souvenirs. The system mainly consists of a terminal operated by the user and a server that performs processing. A specific embodiment of the system is shown below.

[0443] The user first uses a terminal to enter information such as the recipient's gender, age, preferences, budget, and the purpose of the gift. The terminal sends the entered information to the server in real time. This information is temporarily stored on the server and used for processing in the next step.

[0444] The server analyzes the received information and applies an AI algorithm to select the product best suited to the user's needs. This AI searches and filters products from an existing database to generate a list of relevant items. Selection criteria include price range, category, and other entered conditions.

[0445] The product list generated by the server is sent to the terminal and displayed to the user as a suggestion. At this time, a function is activated that explains the cultural background and characteristics of each product in multiple languages ​​using an information provision system. The user can then use this information to choose the most suitable souvenir.

[0446] For selected products, the server connects with the store's inventory information system to retrieve real-time inventory status and store operating information. This allows users to check available products and make quick decisions.

[0447] Users who decide to purchase proceed with the purchase through their terminal. The server executes a secure payment process and confirms the purchase. At this time, users can select delivery options to their home or hotel. Based on the selected delivery address, the server initiates the logistics process.

[0448] Finally, users can submit feedback on the products they receive, and the server collects this feedback to help the AI ​​learn further. This allows the system to continuously improve in order to increase user satisfaction.

[0449] This system allows foreign visitors to Japan to efficiently and satisfactorily purchase souvenirs through their travel experience, and also contributes to the revitalization of local economies.

[0450] The following describes the processing flow.

[0451] Step 1:

[0452] The user accesses the souvenir selection app using their device and enters the necessary information (such as the recipient's gender, age, preferences, budget, and purpose of the souvenir). The device then prepares to send this information to the server.

[0453] Step 2:

[0454] The terminal organizes the entered user information and sends it to the server. Based on the received information, the server prepares the necessary dataset for the recommendation engine and starts the AI ​​analysis.

[0455] Step 3:

[0456] The AI ​​implemented within the server analyzes the received data and filters products that match the user's preferences. This process involves accessing a database and selecting products that meet the specified criteria.

[0457] Step 4:

[0458] The server generates a list of products selected by the AI ​​and creates detailed descriptions for each product in multiple languages. The generated product list is then sent to the terminal for display.

[0459] Step 5:

[0460] The terminal displays a list of products selected by the user. The user selects their desired product while viewing detailed information in multiple languages.

[0461] Step 6:

[0462] When a user selects an item, the terminal sends the selection to the server, which then accesses the store's inventory management system to check the item's availability and the store's operating information.

[0463] Step 7:

[0464] The server transmits the acquired inventory information to the terminal in real time, prompting the user to check the available products for purchase.

[0465] Step 8:

[0466] Once the user decides to purchase, the terminal communicates the purchase intention to the server, which then initiates the payment process. The server completes the transaction via a secure payment system.

[0467] Step 9:

[0468] The server executes logistics procedures to deliver the goods to the specified delivery destination, based on the delivery option selected by the user.

[0469] Step 10:

[0470] After purchase, users can submit feedback about the product through their device. The server collects this feedback and uses it to train the AI ​​and improve the system.

[0471] (Example 1)

[0472] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0473] Foreign visitors to Japan face numerous challenges when efficiently and satisfactorily selecting and purchasing souvenirs. Language barriers and a lack of understanding of different cultures make it difficult to choose appropriate souvenirs, and real-time information on product availability and prices may not be available. Furthermore, a lack of smooth delivery services for purchased items can detract from the user's travel experience. Solving these problems is essential.

[0474] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0475] In this invention, the server includes means for a user interface to receive detailed information from users, means for artificial intelligence to analyze the information and provide prompt sentences to a generating AI model to extract products, and management means for dynamically acquiring the inventory status of the relevant products and the operating status of sales locations. This enables foreign visitors to Japan to efficiently select and purchase appropriate souvenirs, overcoming language and cultural barriers. Furthermore, it allows users to select their desired delivery options and have products delivered smoothly to a designated pick-up location, improving the user's travel experience.

[0476] The term "user" refers to a person who operates the system and provides information.

[0477] A "user interface" refers to a visual or physical interface provided for users to input and manipulate information.

[0478] A "generative AI model" refers to an artificial intelligence algorithm used to select the most suitable product based on the input information.

[0479] A "prompt statement" refers to specific input data used to instruct a generating AI model on how to perform analysis.

[0480] "Artificial intelligence" refers to a computer program that performs analysis and judgment based on data and generates suggestions for users.

[0481] "Management means" refers to a system configuration for dynamically acquiring inventory and sales information and providing users with information optimized for their needs.

[0482] "Delivery management means" refers to the function of controlling the means of logistics to efficiently deliver purchased goods to a designated location.

[0483] This invention is a support system for foreign visitors to Japan to efficiently select and purchase souvenirs, and mainly consists of a terminal operated by the user and a server responsible for data analysis.

[0484] The user first uses the user interface on their device to input information such as the recipient's gender, age, preferences, budget, and the purpose of the gift. The device then securely encrypts this information and sends it to the server.

[0485] The server uses a generative AI model to analyze the information it receives. This AI constructs prompts based on user input and extracts the most suitable products from an existing database. For example, a prompt might include specific conditions such as "a gift for a friend in their 30s, under 3000 yen, and Japanese style."

[0486] The AI ​​selects the product that best matches the user's criteria from a filtered list of products. For the selected products, detailed information is prepared on the server side in multiple languages, detailing the cultural background and product characteristics.

[0487] Next, the server retrieves real-time inventory information and sales information from sales locations and sends it to the user's terminal. This allows the user to immediately see which products are available for purchase.

[0488] The purchase process is conducted on the terminal, and the server provides a secure payment process. Furthermore, the user can select their preferred delivery option, and the server initiates the logistics process to deliver the goods to the specified delivery location.

[0489] As described above, foreign visitors to Japan can purchase souvenirs smoothly and with high satisfaction, enjoying efficient shopping while experiencing Japanese culture.

[0490] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0491] Step 1:

[0492] The user launches the user interface on their device and enters information about the recipient of the gift into the input fields. Specifically, they select gender, age, preferences, budget, purpose of the gift, etc., on the device's operation screen and enter them into text boxes. The entered information is then temporarily saved to the device's local storage.

[0493] Step 2:

[0494] The terminal encrypts the information entered by the user and sends it to the server. Security is ensured by using an encryption protocol (e.g., HTTPS) for transmission. The entered data includes category information such as gender and age, as well as text-based information about preferences and budget, and this data is transmitted.

[0495] Step 3:

[0496] The server uses a generative AI model to create a prompt message in order to analyze the received information. The prompt message is generated in the format "female in her 30s, budget of 3000 yen, Japanese culture". This prompt message is given to the AI, which filters suitable products from the existing database. The process involves checking the product data structure in the database and selecting products that match the conditions.

[0497] Step 4:

[0498] The server translates the generated product list into multiple languages ​​and then sends it to the terminal. Natural language processing technology is used for the translation process to generate multicultural descriptions. Product information, including images, text, and prices, is sent in a format that can be displayed on the user's terminal.

[0499] Step 5:

[0500] The user selects items of interest from a list displayed on their device. The user's selection is made on the device, and the results are sent back to the server. Based on this information, the server performs the next step: checking inventory.

[0501] Step 6:

[0502] The server integrates with the store's inventory management system to check the stock status of the selected product. Information is retrieved via a real-time API and sent to the terminal. This allows the user to instantly check whether the product is available for purchase.

[0503] Step 7:

[0504] The user confirms the purchase and completes the payment process from their terminal. The server performs a secure payment processing and verifies the purchase details. The input information includes payment information and shipping address, and as a result, a purchase confirmation message is displayed to the user.

[0505] Step 8:

[0506] Based on the purchase information, the server instructs the logistics system to begin the shipping process. Once the shipping arrangements are complete, a link to track the shipping status is sent to the user's device, allowing the user to check the shipping progress in real time.

[0507] (Application Example 1)

[0508] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0509] The challenge is to enable foreign visitors to Japan to efficiently select and purchase unique Japanese souvenirs in a short amount of time. Foreign tourists often struggle to choose souvenirs due to language barriers and a lack of cultural knowledge, and if store inventory and purchasing options are limited, they are unable to have a satisfying shopping experience.

[0510] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0511] In this invention, the server includes communication means for receiving information from users, computing means equipped with artificial intelligence for searching for and recommending products based on the information received from users, and information display means for providing detailed information about products in multiple languages. This makes it possible for foreign visitors to Japan to efficiently select and learn about the most suitable products without being dependent on language.

[0512] "Communication means" refers to a device or mechanism used to receive information from a user.

[0513] "Computational means" refers to an algorithm or hardware equipped with artificial intelligence for searching for and recommending products based on information received from the user.

[0514] "Information display means" refers to a screen or interface for providing users with detailed information about a product in multiple languages.

[0515] "Display means" refers to a device or mechanism for displaying the inventory status of exhibited products and sales information of the sales location in real time.

[0516] A "purchase processing means" is a system or device used to perform transaction processing for a user to purchase goods.

[0517] "Logistics processing means" refers to a device or system for executing procedures to send the goods selected by the user to the point of purchase or delivery destination.

[0518] "Learning processing means" refers to algorithms or systems used to collect user evaluations or opinions and improve the recommendation accuracy of artificial intelligence.

[0519] This invention is an embodiment of a system that assists foreign visitors to Japan in effectively and efficiently purchasing souvenirs within Japan. The system consists of a communication terminal and a control server.

[0520] The server collects user input information and uses it to recommend products. Specifically, the server receives data from users via communication channels. This includes information such as gender, age, preferences, and budget. Next, the server uses artificial intelligence (AI) to search for products based on the received information and recommend the most suitable products. The AI ​​is built using the Python programming language and machine learning libraries such as TensorFlow.

[0521] Recommended products are provided to the user's device in multiple languages ​​along with detailed information via an information display system. This information is displayed on the screen of a smartphone or tablet, allowing users to easily select products by reviewing the displayed list.

[0522] After the user has made their selection, the server uses a purchasing process to execute the transaction. This process integrates secure payment methods, allowing users to confirm their purchase quickly and efficiently. Furthermore, the goods are shipped to the point of purchase or designated delivery destination via a logistics processing system.

[0523] These features allow users to easily select and purchase appropriate products that reflect Japanese culture. The following is a specific example of its use: For instance, if a user has the need to "find a recommended souvenir for a woman in her 30s, featuring traditional Japanese pottery, within a budget of 5,000 yen," the system can present optimal product options. Based on this prompt, a product list is displayed on the user's device, making selection easier.

[0524] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0525] Step 1:

[0526] The user enters information about the souvenir through their device. This information includes the recipient's gender, age, preferences, and budget. The device then sends this information to the server. At this stage, the user's input data is provided to the server, and this data forms the basis for product recommendations.

[0527] Step 2:

[0528] The server analyzes the received information and uses an AI algorithm to search for the product that best matches the user's needs. Specifically, it uses Python and TensorFlow to filter products from the database that meet the user's needs. In this process, product candidates are listed based on the user information received as input data.

[0529] Step 3:

[0530] The server sends a list of selected products to the user's terminal via an information display device. The information includes multilingual support, allowing the user to understand the cultural background and details of each product. The output at this stage is a product list optimized for the user.

[0531] Step 4:

[0532] The user views a list of products displayed on their device screen and selects the items they wish to purchase. This selection is based on the user's judgment, and they choose the products they deem most suitable.

[0533] Step 5:

[0534] The server initiates the purchase process for the selected product. Using a purchasing mechanism, it provides a secure payment method and processes the user's purchase request. After the purchase is complete, the system displays the result to the user as confirmation.

[0535] Step 6:

[0536] After the purchase process is complete, the server uses logistics processing to arrange for the shipment of the goods to the user's purchase location or designated delivery address. In this step, the server generates specific shipping instructions using delivery options and delivery address information.

[0537] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0538] This invention is a system designed to enhance the experience of foreign visitors to Japan in selecting and purchasing the perfect souvenirs during their trip, and in particular, it has the function of recognizing the user's emotions and making emotion-based product suggestions. The system utilizes emotion data via an emotion engine to realize personalized suggestions that match the user's preferences and purposes.

[0539] The user first uses a terminal to enter the necessary information. This information includes basic information about the recipient, the purpose of the gift, budget, and preferences. The terminal sends this information to the server, which then prepares to analyze it.

[0540] The server is equipped with an AI-powered product recommendation engine that generates a list of candidate products based on user input. This engine also utilizes an emotion engine, taking into account emotional data from past interactions. For example, emotional data from when a user previously selected products in a specific category can be used to help select future candidate products.

[0541] The generated product list is sent from the server to the terminal and displayed to the user. The terminal provides the user with detailed information in multiple languages. At this point, the sentiment data output by the sentiment engine is used to dynamically adjust the product descriptions and recommendation messages to make them more relatable to the user.

[0542] The user reviews the displayed product list and selects the desired product. The terminal sends this selection to the server, which then integrates with the inventory information system to check the inventory of the selected product and the store's operating hours in real time.

[0543] When a user decides to make a purchase, they notify the server via their device. The server then initiates the payment process to facilitate the purchase. This process includes delivery options, allowing the user to specify the delivery address.

[0544] After purchase, users can provide feedback, which is sent to the server via the emotion engine. The server uses this information to update the AI's learning database. This update allows for future service improvements.

[0545] In this way, by providing a product recommendation function that utilizes an emotion engine, this system can enrich and personalize the purchasing experience of foreign visitors to Japan, and contribute to the revitalization of local economies.

[0546] The following describes the processing flow.

[0547] Step 1:

[0548] The user accesses the souvenir selection application through their device and enters information such as the recipient's details, budget, preferences, purpose of the souvenir, and selection trends based on past profiles. The device then aggregates this information and prepares to send it to the server.

[0549] Step 2:

[0550] The terminal sends the entered information to the server. The server receives this information and stores it in the user database. This allows access to past preference data.

[0551] Step 3:

[0552] The server generates suitable product candidates from the product database. Here, the emotion engine is utilized to analyze the user's past emotional data, identify the characteristics of products that have shown positive emotions, and adjust the current suggestions based on that.

[0553] Step 4:

[0554] The server generates a list of products selected by an AI algorithm, incorporates adjustments made by an emotion engine, and then sends the list to the terminal. As a result, recommendation messages based on emotion data are attached to the products that are selected as candidates.

[0555] Step 5:

[0556] The device displays a product list to the user. Detailed information about each product is provided in multiple languages, and the user is informed that recommendation messages are tailored based on emotional factors. The user can then use this information to select their preferred products.

[0557] Step 6:

[0558] When a user selects a product, the terminal sends the selected product information to the server. The server uses this information to check actual inventory levels and obtains real-time updated inventory status and store operating information.

[0559] Step 7:

[0560] The server sends the confirmed inventory information to the terminal, displaying the latest available purchase information to the user and enabling them to proceed with the purchase.

[0561] Step 8:

[0562] After the user decides to purchase, the device transmits the purchase intention to the server. The server initiates the payment process for the purchase and handles it to ensure a secure transaction. If a shipping option is selected, the shipping process also proceeds simultaneously.

[0563] Step 9:

[0564] After purchase, users provide feedback from their device. This feedback includes emotions as input to the emotion engine and is sent to the server. The server receives this feedback and updates the feedback database to improve the recommendation accuracy of the AI ​​system.

[0565] Through these steps, the system supports personalized souvenir selection that takes user emotions into account, improving the purchasing experience.

[0566] (Example 2)

[0567] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0568] There is a growing need to personalize and enhance the shopping experience for foreign visitors to Japan. However, existing systems do not adequately provide personalized product recommendations based on users' emotions and past behavior. This makes it difficult to appropriately suggest products that users truly want, resulting in a challenge in providing the optimal purchasing experience.

[0569] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0570] In this invention, the server includes an input means for receiving attribute information and emotional state from the user, an artificial intelligence processing means equipped with emotion analysis for generating and suggesting products based on the information received from the user and past emotional data, and an information providing means for providing detailed product information and dynamic recommendation messages based on emotions in multiple languages. This enables product suggestions that take the user's emotions into consideration, providing a more personalized purchasing experience.

[0571] "Attribute information" refers to basic data about users, such as age, gender, and purchase history, and is used as basic information for product recommendations.

[0572] "Emotional state" refers to the psychological and emotional responses that users exhibit under specific circumstances, and is data that is considered when proposing products.

[0573] "Artificial intelligence processing means" refers to algorithms and technologies that analyze data obtained from users and recommend products.

[0574] "Emotional analysis" refers to the process of understanding and analyzing the emotional state of users, and is a technology that enables personalized product recommendations.

[0575] A "dynamic recommendation message" refers to a product recommendation that changes in content according to the user's attribute information and emotional state.

[0576] "Logistics means" refers to the function of delivering selected goods to the designated receiving location specified by the user, and functions as part of the system.

[0577] This invention is a system for personalizing the shopping experience of foreign visitors to Japan and providing emotion-based product recommendations. Specifically, a terminal and a server communicate, and artificial intelligence is used to suggest products based on the user's input information.

[0578] Users input their attribute information and emotional state using devices such as smartphones and tablets. This input data is securely transmitted to the server. The device is configured to allow users to input information in multiple languages, and the output is displayed in the language selected by the user.

[0579] The server processes the received data using a generative AI model equipped with sentiment analysis. The server incorporates a product recommendation engine that selects the most suitable products based on accumulated user sentiment data and attribute information. In this process, the user's past emotional states and purchase history are considered to generate a suitable product list. This list is sent to the device and displayed as a dynamic recommendation message.

[0580] For example, suppose a user is looking for a "traditional souvenir for a friend" that can be purchased in Kyoto. By inputting information about their purpose and budget through their device, the server uses a generative AI model to suggest traditional Kyoto products and items with unique designs.

[0581] An example of a prompt is: "Please describe a system that suggests the best souvenirs for foreign visitors to Japan based on their emotions." This invention aims to provide foreign visitors with a more fulfilling and personalized experience when purchasing goods, and to contribute to the revitalization of local economies.

[0582] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0583] Step 1:

[0584] The user accesses an input screen using their device and enters their attribute information (e.g., age, gender, nationality) and emotional state (e.g., interests, level of interest). This allows initial data based on the user's preferences and goals to be stored on the device. The device then prepares this input information to send to the server as structured data and verifies the data format.

[0585] Step 2:

[0586] The terminal sends the collected user data to the server. The data sent includes the user's entered attribute information and emotional state, which forms the basis for processing on the server. The server verifies the received data and cleans or transforms it as needed.

[0587] Step 3:

[0588] The server processes user data using a generative AI model that performs sentiment analysis. Based on the input data, it analyzes the emotional state by comparing it with past interactions and sentiment history. Using this analyzed data, the server generates a list of product candidates that match the user's emotions. The output is a list of required product attributes and categories.

[0589] Step 4:

[0590] The server adds detailed product information based on the generated list of potential products. This process is carried out in conjunction with the product database to create dynamic recommendation messages that align with the user's emotions. The server then prepares to send this detailed information and recommendation message to the terminal.

[0591] Step 5:

[0592] The terminal displays the received product list and recommendation messages in multiple languages. The user reviews the suggested product options and selects the desired products. Once the user has made their selection, the terminal sends that information back to the server.

[0593] Step 6:

[0594] The server connects with the inventory check system based on the user's selected product information. It checks the inventory status of the selected product and the store's operating hours in real time. The output of this process is the product's purchase availability status.

[0595] Step 7:

[0596] Once the user decides to purchase, they notify the server of their purchase confirmation via their device. The server then initiates the payment process and performs the necessary transaction procedures. After payment is complete, it proceeds with shipping arrangements. The output of this process is purchase and shipping confirmation information.

[0597] Step 8:

[0598] The user enters feedback about their purchase experience into their device. The device sends this information to a server, which updates the training database of the generated AI model based on the feedback. The output of this feedback process is the data update to the training database.

[0599] (Application Example 2)

[0600] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0601] When foreign visitors to Japan choose the perfect souvenirs during their trip, they often face the challenge of receiving suggestions based on their individual feelings and preferences. Furthermore, language barriers and unclear inventory information can limit their purchasing experience.

[0602] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0603] In this invention, the server includes an input means for receiving information from the user, a processing means equipped with artificial intelligence for searching for and suggesting products based on the information received from the user, and an emotion analysis means for dynamically adjusting product suggestions based on the user's emotion data. This makes it possible for foreign visitors to Japan to receive personalized product suggestions based on their emotions and overcome limitations in the purchasing experience due to language and inventory information.

[0604] "Input means" refers to a device or method for receiving information from a user.

[0605] "Processing means" refers to a device or method for searching for and suggesting products based on information received using artificial intelligence.

[0606] "Emotional analysis means" refers to a device or method for dynamically adjusting product recommendations based on user emotional data.

[0607] "Information provision means" refers to a device or method for providing detailed information about a product in multiple languages.

[0608] "Display means" refers to a device or method for displaying the inventory status of a proposed product and store operating information in real time.

[0609] "Means of purchase" refers to a device or method that allows a user to carry out transaction procedures for purchasing goods.

[0610] "Delivery method" refers to the equipment or method used to deliver goods to the user's place of residence or selected destination.

[0611] A "digital assistant function" is a feature that works in conjunction with smart devices to support the user's purchasing experience.

[0612] To implement this invention, a system will be built that uses user emotional data to suggest products. This system will consist of the user's smart device (e.g., a smartphone) and a server. The server will be equipped with an AI recommendation engine developed using Python and TensorFlow, and will retrieve information from a database managed by MongoDB.

[0613] Users input necessary information into a specific application using their smartphones. This application, developed using React Native, is responsible for sending the input data to a server. The data that reaches the server is analyzed by an AI engine, which, along with the user's emotional data, provides product recommendations.

[0614] The suggested product list is displayed on the smartphone, and detailed information can be viewed in multiple languages. Once the user selects an item and decides to purchase it, the payment process begins. This includes delivery options, and arrangements are made for the product to be delivered to the specified address.

[0615] For example, suppose a foreign visitor staying in Kyoto accesses an application using their smartphone. This user inputs that they are interested in traditional Japanese crafts as souvenirs, and the application requests suggestions from the server based on the user's sentiment data. The server generates a product list accordingly, and the user selects their preferred items and makes a purchase.

[0616] An example of a prompt message might be: "Tourists scan a QR code with their smartphones, provide feedback to rate related products, and the AI ​​learns from the ratings to improve the accuracy of product recommendations."

[0617] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0618] Step 1:

[0619] The user launches an application on their smartphone and enters basic information about the recipient, the purpose of the gift, budget, and preferences. This input data is sent from the device to the server. Based on the input data, the server updates the user's profile and retrieves sentiment data from the previous interaction.

[0620] Step 2:

[0621] The server uses a generative AI model to process the received user information and sentiment data. Sentiment analysis measures analyze the user's emotional tendencies and, based on this, generate a product list for product recommendations. The input here is user information and sentiment data, and the output is a customized product list.

[0622] Step 3:

[0623] The generated product list is sent to the terminal and displayed to the user. The terminal supports multiple languages ​​and displays detailed information about the products. The user reviews the displayed product list and selects the products they like. The input here is the product list sent from the server, and the output is the user's selection information.

[0624] Step 4:

[0625] After the user selects their desired product, the selection information is sent back from the terminal to the server. The server interacts with the inventory information system to check the inventory status of the selected product and the store's operating hours in real time. Once the inventory check is complete, the user receives a purchase confirmation message.

[0626] Step 5:

[0627] The server initiates the payment process once the user decides to purchase. During this process, it provides delivery options to the user's specified address or destination, utilizing the available shipping methods. Once payment is complete, the purchase details are displayed on the terminal. The input here is the user's payment information, and the output is a purchase confirmation message.

[0628] Step 6:

[0629] After purchase, users can provide product feedback through the application. This feedback is sent from the device to the server, which updates the training database of the generated AI model. The input here is the user's feedback information, and the output is the updated database information.

[0630] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0631] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0632] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0633] [Fourth Embodiment]

[0634] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0635] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0636] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0637] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0638] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0639] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0640] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0641] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0642] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0643] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0644] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0645] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0646] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0647] This invention is a system that assists foreign visitors to Japan in efficiently selecting and purchasing souvenirs. The system mainly consists of a terminal operated by the user and a server that performs processing. A specific embodiment of the system is shown below.

[0648] The user first uses a terminal to enter information such as the recipient's gender, age, preferences, budget, and the purpose of the gift. The terminal sends the entered information to the server in real time. This information is temporarily stored on the server and used for processing in the next step.

[0649] The server analyzes the received information and applies an AI algorithm to select the product best suited to the user's needs. This AI searches and filters products from an existing database to generate a list of relevant items. Selection criteria include price range, category, and other entered conditions.

[0650] The product list generated by the server is sent to the terminal and displayed to the user as a suggestion. At this time, a function is activated that explains the cultural background and characteristics of each product in multiple languages ​​using an information provision system. The user can then use this information to choose the most suitable souvenir.

[0651] For selected products, the server connects with the store's inventory information system to retrieve real-time inventory status and store operating information. This allows users to check available products and make quick decisions.

[0652] Users who decide to purchase proceed with the purchase through their terminal. The server executes a secure payment process and confirms the purchase. At this time, users can select delivery options to their home or hotel. Based on the selected delivery address, the server initiates the logistics process.

[0653] Finally, users can submit feedback on the products they receive, and the server collects this feedback to help the AI ​​learn further. This allows the system to continuously improve in order to increase user satisfaction.

[0654] This system allows foreign visitors to Japan to efficiently and satisfactorily purchase souvenirs through their travel experience, and also contributes to the revitalization of local economies.

[0655] The following describes the processing flow.

[0656] Step 1:

[0657] The user accesses the souvenir selection app using their device and enters the necessary information (such as the recipient's gender, age, preferences, budget, and purpose of the souvenir). The device then prepares to send this information to the server.

[0658] Step 2:

[0659] The terminal organizes the entered user information and sends it to the server. Based on the received information, the server prepares the necessary dataset for the recommendation engine and starts the AI ​​analysis.

[0660] Step 3:

[0661] The AI ​​implemented within the server analyzes the received data and filters products that match the user's preferences. This process involves accessing a database and selecting products that meet the specified criteria.

[0662] Step 4:

[0663] The server generates a list of products selected by the AI ​​and creates detailed descriptions for each product in multiple languages. The generated product list is then sent to the terminal for display.

[0664] Step 5:

[0665] The terminal displays a list of products selected by the user. The user selects their desired product while viewing detailed information in multiple languages.

[0666] Step 6:

[0667] When a user selects an item, the terminal sends the selection to the server, which then accesses the store's inventory management system to check the item's availability and the store's operating information.

[0668] Step 7:

[0669] The server transmits the acquired inventory information to the terminal in real time, prompting the user to check the available products for purchase.

[0670] Step 8:

[0671] Once the user decides to purchase, the terminal communicates the purchase intention to the server, which then initiates the payment process. The server completes the transaction via a secure payment system.

[0672] Step 9:

[0673] The server executes logistics procedures to deliver the goods to the specified delivery destination, based on the delivery option selected by the user.

[0674] Step 10:

[0675] After purchase, users can submit feedback about the product through their device. The server collects this feedback and uses it to train the AI ​​and improve the system.

[0676] (Example 1)

[0677] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0678] Foreign visitors to Japan face numerous challenges when efficiently and satisfactorily selecting and purchasing souvenirs. Language barriers and a lack of understanding of different cultures make it difficult to choose appropriate souvenirs, and real-time information on product availability and prices may not be available. Furthermore, a lack of smooth delivery services for purchased items can detract from the user's travel experience. Solving these problems is essential.

[0679] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0680] In this invention, the server includes means for a user interface to receive detailed information from users, means for artificial intelligence to analyze the information and provide prompt sentences to a generating AI model to extract products, and management means for dynamically acquiring the inventory status of the relevant products and the operating status of sales locations. This enables foreign visitors to Japan to efficiently select and purchase appropriate souvenirs, overcoming language and cultural barriers. Furthermore, it allows users to select their desired delivery options and have products delivered smoothly to a designated pick-up location, improving the user's travel experience.

[0681] The term "user" refers to a person who operates the system and provides information.

[0682] A "user interface" refers to a visual or physical interface provided for users to input and manipulate information.

[0683] A "generative AI model" refers to an artificial intelligence algorithm used to select the most suitable product based on the input information.

[0684] A "prompt statement" refers to specific input data used to instruct a generating AI model on how to perform analysis.

[0685] "Artificial intelligence" refers to a computer program that performs analysis and judgment based on data and generates suggestions for users.

[0686] "Management means" refers to a system configuration for dynamically acquiring inventory and sales information and providing users with information optimized for their needs.

[0687] "Delivery management means" refers to the function of controlling the means of logistics to efficiently deliver purchased goods to a designated location.

[0688] This invention is a support system for foreign visitors to Japan to efficiently select and purchase souvenirs, and mainly consists of a terminal operated by the user and a server responsible for data analysis.

[0689] The user first uses the user interface on their device to input information such as the recipient's gender, age, preferences, budget, and the purpose of the gift. The device then securely encrypts this information and sends it to the server.

[0690] The server uses a generative AI model to analyze the information it receives. This AI constructs prompts based on user input and extracts the most suitable products from an existing database. For example, a prompt might include specific conditions such as "a gift for a friend in their 30s, under 3000 yen, and Japanese style."

[0691] The AI ​​selects the product that best matches the user's criteria from a filtered list of products. For the selected products, detailed information is prepared on the server side in multiple languages, detailing the cultural background and product characteristics.

[0692] Next, the server retrieves real-time inventory information and sales information from sales locations and sends it to the user's terminal. This allows the user to immediately see which products are available for purchase.

[0693] The purchase process is conducted on the terminal, and the server provides a secure payment process. Furthermore, the user can select their preferred delivery option, and the server initiates the logistics process to deliver the goods to the specified delivery location.

[0694] As described above, foreign visitors to Japan can purchase souvenirs smoothly and with high satisfaction, enjoying efficient shopping while experiencing Japanese culture.

[0695] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0696] Step 1:

[0697] The user launches the user interface on their device and enters information about the recipient of the gift into the input fields. Specifically, they select gender, age, preferences, budget, purpose of the gift, etc., on the device's operation screen and enter them into text boxes. The entered information is then temporarily saved to the device's local storage.

[0698] Step 2:

[0699] The terminal encrypts the information entered by the user and sends it to the server. Security is ensured by using an encryption protocol (e.g., HTTPS) for transmission. The entered data includes category information such as gender and age, as well as text-based information about preferences and budget, and this data is transmitted.

[0700] Step 3:

[0701] The server uses a generative AI model to create a prompt message in order to analyze the received information. The prompt message is generated in the format "female in her 30s, budget of 3000 yen, Japanese culture". This prompt message is given to the AI, which filters suitable products from the existing database. The process involves checking the product data structure in the database and selecting products that match the conditions.

[0702] Step 4:

[0703] The server translates the generated product list into multiple languages ​​and then sends it to the terminal. Natural language processing technology is used for the translation process to generate multicultural descriptions. Product information, including images, text, and prices, is sent in a format that can be displayed on the user's terminal.

[0704] Step 5:

[0705] The user selects items of interest from a list displayed on their device. The user's selection is made on the device, and the results are sent back to the server. Based on this information, the server performs the next step: checking inventory.

[0706] Step 6:

[0707] The server integrates with the store's inventory management system to check the stock status of the selected product. Information is retrieved via a real-time API and sent to the terminal. This allows the user to instantly check whether the product is available for purchase.

[0708] Step 7:

[0709] The user confirms the purchase and completes the payment process from their terminal. The server performs a secure payment processing and verifies the purchase details. The input information includes payment information and shipping address, and as a result, a purchase confirmation message is displayed to the user.

[0710] Step 8:

[0711] Based on the purchase information, the server instructs the logistics system to begin the shipping process. Once the shipping arrangements are complete, a link to track the shipping status is sent to the user's device, allowing the user to check the shipping progress in real time.

[0712] (Application Example 1)

[0713] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0714] The challenge is to enable foreign visitors to Japan to efficiently select and purchase unique Japanese souvenirs in a short amount of time. Foreign tourists often struggle to choose souvenirs due to language barriers and a lack of cultural knowledge, and if store inventory and purchasing options are limited, they are unable to have a satisfying shopping experience.

[0715] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0716] In this invention, the server includes communication means for receiving information from users, computing means equipped with artificial intelligence for searching for and recommending products based on the information received from users, and information display means for providing detailed information about products in multiple languages. This makes it possible for foreign visitors to Japan to efficiently select and learn about the most suitable products without being dependent on language.

[0717] "Communication means" refers to a device or mechanism used to receive information from a user.

[0718] "Computational means" refers to an algorithm or hardware equipped with artificial intelligence for searching for and recommending products based on information received from the user.

[0719] "Information display means" refers to a screen or interface for providing users with detailed information about a product in multiple languages.

[0720] "Display means" refers to a device or mechanism for displaying the inventory status of exhibited products and sales information of the sales location in real time.

[0721] A "purchase processing means" is a system or device used to perform transaction processing for a user to purchase goods.

[0722] "Logistics processing means" refers to a device or system for executing procedures to send the goods selected by the user to the point of purchase or delivery destination.

[0723] "Learning processing means" refers to algorithms or systems used to collect user evaluations or opinions and improve the recommendation accuracy of artificial intelligence.

[0724] This invention is an embodiment of a system that assists foreign visitors to Japan in effectively and efficiently purchasing souvenirs within Japan. The system consists of a communication terminal and a control server.

[0725] The server collects user input information and uses it to recommend products. Specifically, the server receives data from users via communication channels. This includes information such as gender, age, preferences, and budget. Next, the server uses artificial intelligence (AI) to search for products based on the received information and recommend the most suitable products. The AI ​​is built using the Python programming language and machine learning libraries such as TensorFlow.

[0726] Recommended products are provided to the user's device in multiple languages ​​along with detailed information via an information display system. This information is displayed on the screen of a smartphone or tablet, allowing users to easily select products by reviewing the displayed list.

[0727] After the user has made their selection, the server uses a purchasing process to execute the transaction. This process integrates secure payment methods, allowing users to confirm their purchase quickly and efficiently. Furthermore, the goods are shipped to the point of purchase or designated delivery destination via a logistics processing system.

[0728] These features allow users to easily select and purchase appropriate products that reflect Japanese culture. The following is a specific example of its use: For instance, if a user has the need to "find a recommended souvenir for a woman in her 30s, featuring traditional Japanese pottery, within a budget of 5,000 yen," the system can present optimal product options. Based on this prompt, a product list is displayed on the user's device, making selection easier.

[0729] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0730] Step 1:

[0731] The user enters information about the souvenir through their device. This information includes the recipient's gender, age, preferences, and budget. The device then sends this information to the server. At this stage, the user's input data is provided to the server, and this data forms the basis for product recommendations.

[0732] Step 2:

[0733] The server analyzes the received information and uses an AI algorithm to search for the product that best matches the user's needs. Specifically, it uses Python and TensorFlow to filter products from the database that meet the user's needs. In this process, product candidates are listed based on the user information received as input data.

[0734] Step 3:

[0735] The server sends a list of selected products to the user's terminal via an information display device. The information includes multilingual support, allowing the user to understand the cultural background and details of each product. The output at this stage is a product list optimized for the user.

[0736] Step 4:

[0737] The user views a list of products displayed on their device screen and selects the items they wish to purchase. This selection is based on the user's judgment, and they choose the products they deem most suitable.

[0738] Step 5:

[0739] The server initiates the purchase process for the selected product. Using a purchasing mechanism, it provides a secure payment method and processes the user's purchase request. After the purchase is complete, the system displays the result to the user as confirmation.

[0740] Step 6:

[0741] After the purchase process is complete, the server uses logistics processing to arrange for the shipment of the goods to the user's purchase location or designated delivery address. In this step, the server generates specific shipping instructions using delivery options and delivery address information.

[0742] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0743] This invention is a system designed to enhance the experience of foreign visitors to Japan in selecting and purchasing the perfect souvenirs during their trip, and in particular, it has the function of recognizing the user's emotions and making emotion-based product suggestions. The system utilizes emotion data via an emotion engine to realize personalized suggestions that match the user's preferences and purposes.

[0744] The user first uses a terminal to enter the necessary information. This information includes basic information about the recipient, the purpose of the gift, budget, and preferences. The terminal sends this information to the server, which then prepares to analyze it.

[0745] The server is equipped with an AI-powered product recommendation engine that generates a list of candidate products based on user input. This engine also utilizes an emotion engine, taking into account emotional data from past interactions. For example, emotional data from when a user previously selected products in a specific category can be used to help select future candidate products.

[0746] The generated product list is sent from the server to the terminal and displayed to the user. The terminal provides the user with detailed information in multiple languages. At this point, the sentiment data output by the sentiment engine is used to dynamically adjust the product descriptions and recommendation messages to make them more relatable to the user.

[0747] The user reviews the displayed product list and selects the desired product. The terminal sends this selection to the server, which then integrates with the inventory information system to check the inventory of the selected product and the store's operating hours in real time.

[0748] When a user decides to make a purchase, they notify the server via their device. The server then initiates the payment process to facilitate the purchase. This process includes delivery options, allowing the user to specify the delivery address.

[0749] After purchase, users can provide feedback, which is sent to the server via the emotion engine. The server uses this information to update the AI's learning database. This update allows for future service improvements.

[0750] In this way, by providing a product recommendation function that utilizes an emotion engine, this system can enrich and personalize the purchasing experience of foreign visitors to Japan, and contribute to the revitalization of local economies.

[0751] The following describes the processing flow.

[0752] Step 1:

[0753] The user accesses the souvenir selection application through their device and enters information such as the recipient's details, budget, preferences, purpose of the souvenir, and selection trends based on past profiles. The device then aggregates this information and prepares to send it to the server.

[0754] Step 2:

[0755] The terminal sends the entered information to the server. The server receives this information and stores it in the user database. This allows access to past preference data.

[0756] Step 3:

[0757] The server generates suitable product candidates from the product database. Here, the emotion engine is utilized to analyze the user's past emotional data, identify the characteristics of products that have shown positive emotions, and adjust the current suggestions based on that.

[0758] Step 4:

[0759] The server generates a list of products selected by an AI algorithm, incorporates adjustments made by an emotion engine, and then sends the list to the terminal. As a result, recommendation messages based on emotion data are attached to the products that are selected as candidates.

[0760] Step 5:

[0761] The device displays a product list to the user. Detailed information about each product is provided in multiple languages, and the user is informed that recommendation messages are tailored based on emotional factors. The user can then use this information to select their preferred products.

[0762] Step 6:

[0763] When a user selects a product, the terminal sends the selected product information to the server. The server uses this information to check actual inventory levels and obtains real-time updated inventory status and store operating information.

[0764] Step 7:

[0765] The server sends the confirmed inventory information to the terminal, displaying the latest available purchase information to the user and enabling them to proceed with the purchase.

[0766] Step 8:

[0767] After the user decides to purchase, the device transmits the purchase intention to the server. The server initiates the payment process for the purchase and handles it to ensure a secure transaction. If a shipping option is selected, the shipping process also proceeds simultaneously.

[0768] Step 9:

[0769] After purchase, users provide feedback from their device. This feedback includes emotions as input to the emotion engine and is sent to the server. The server receives this feedback and updates the feedback database to improve the recommendation accuracy of the AI ​​system.

[0770] Through these steps, the system supports personalized souvenir selection that takes user emotions into account, improving the purchasing experience.

[0771] (Example 2)

[0772] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0773] There is a growing need to personalize and enhance the shopping experience for foreign visitors to Japan. However, existing systems do not adequately provide personalized product recommendations based on users' emotions and past behavior. This makes it difficult to appropriately suggest products that users truly want, resulting in a challenge in providing the optimal purchasing experience.

[0774] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0775] In this invention, the server includes an input means for receiving attribute information and emotional state from the user, an artificial intelligence processing means equipped with emotion analysis for generating and suggesting products based on the information received from the user and past emotional data, and an information providing means for providing detailed product information and dynamic recommendation messages based on emotions in multiple languages. This enables product suggestions that take the user's emotions into consideration, providing a more personalized purchasing experience.

[0776] "Attribute information" refers to basic data about users, such as age, gender, and purchase history, and is used as basic information for product recommendations.

[0777] "Emotional state" refers to the psychological and emotional responses that users exhibit under specific circumstances, and is data that is considered when proposing products.

[0778] "Artificial intelligence processing means" refers to algorithms and technologies that analyze data obtained from users and recommend products.

[0779] "Emotional analysis" refers to the process of understanding and analyzing the emotional state of users, and is a technology that enables personalized product recommendations.

[0780] A "dynamic recommendation message" refers to a product recommendation that changes in content according to the user's attribute information and emotional state.

[0781] "Logistics means" refers to the function of delivering selected goods to the designated receiving location specified by the user, and functions as part of the system.

[0782] This invention is a system for personalizing the shopping experience of foreign visitors to Japan and providing emotion-based product recommendations. Specifically, a terminal and a server communicate, and artificial intelligence is used to suggest products based on the user's input information.

[0783] Users input their attribute information and emotional state using devices such as smartphones and tablets. This input data is securely transmitted to the server. The device is configured to allow users to input information in multiple languages, and the output is displayed in the language selected by the user.

[0784] The server processes the received data using a generative AI model equipped with sentiment analysis. The server incorporates a product recommendation engine that selects the most suitable products based on accumulated user sentiment data and attribute information. In this process, the user's past emotional states and purchase history are considered to generate a suitable product list. This list is sent to the device and displayed as a dynamic recommendation message.

[0785] For example, suppose a user is looking for a "traditional souvenir for a friend" that can be purchased in Kyoto. By inputting information about their purpose and budget through their device, the server uses a generative AI model to suggest traditional Kyoto products and items with unique designs.

[0786] An example of a prompt is: "Please describe a system that suggests the best souvenirs for foreign visitors to Japan based on their emotions." This invention aims to provide foreign visitors with a more fulfilling and personalized experience when purchasing goods, and to contribute to the revitalization of local economies.

[0787] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0788] Step 1:

[0789] The user accesses an input screen using their device and enters their attribute information (e.g., age, gender, nationality) and emotional state (e.g., interests, level of interest). This allows initial data based on the user's preferences and goals to be stored on the device. The device then prepares this input information to send to the server as structured data and verifies the data format.

[0790] Step 2:

[0791] The terminal sends the collected user data to the server. The data sent includes the user's entered attribute information and emotional state, which forms the basis for processing on the server. The server verifies the received data and cleans or transforms it as needed.

[0792] Step 3:

[0793] The server processes user data using a generative AI model that performs sentiment analysis. Based on the input data, it analyzes the emotional state by comparing it with past interactions and sentiment history. Using this analyzed data, the server generates a list of product candidates that match the user's emotions. The output is a list of required product attributes and categories.

[0794] Step 4:

[0795] The server adds detailed product information based on the generated list of potential products. This process is carried out in conjunction with the product database to create dynamic recommendation messages that align with the user's emotions. The server then prepares to send this detailed information and recommendation message to the terminal.

[0796] Step 5:

[0797] The terminal displays the received product list and recommendation messages in multiple languages. The user reviews the suggested product options and selects the desired products. Once the user has made their selection, the terminal sends that information back to the server.

[0798] Step 6:

[0799] The server connects with the inventory check system based on the user's selected product information. It checks the inventory status of the selected product and the store's operating hours in real time. The output of this process is the product's purchase availability status.

[0800] Step 7:

[0801] Once the user decides to purchase, they notify the server of their purchase confirmation via their device. The server then initiates the payment process and performs the necessary transaction procedures. After payment is complete, it proceeds with shipping arrangements. The output of this process is purchase and shipping confirmation information.

[0802] Step 8:

[0803] The user enters feedback about their purchase experience into their device. The device sends this information to a server, which updates the training database of the generated AI model based on the feedback. The output of this feedback process is the data update to the training database.

[0804] (Application Example 2)

[0805] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0806] When foreign visitors to Japan choose the perfect souvenirs during their trip, they often face the challenge of receiving suggestions based on their individual feelings and preferences. Furthermore, language barriers and unclear inventory information can limit their purchasing experience.

[0807] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0808] In this invention, the server includes an input means for receiving information from the user, a processing means equipped with artificial intelligence for searching for and suggesting products based on the information received from the user, and an emotion analysis means for dynamically adjusting product suggestions based on the user's emotion data. This makes it possible for foreign visitors to Japan to receive personalized product suggestions based on their emotions and overcome limitations in the purchasing experience due to language and inventory information.

[0809] "Input means" refers to a device or method for receiving information from a user.

[0810] "Processing means" refers to a device or method for searching for and suggesting products based on information received using artificial intelligence.

[0811] "Emotional analysis means" refers to a device or method for dynamically adjusting product recommendations based on user emotional data.

[0812] "Information provision means" refers to a device or method for providing detailed information about a product in multiple languages.

[0813] "Display means" refers to a device or method for displaying the inventory status of a proposed product and store operating information in real time.

[0814] "Means of purchase" refers to a device or method that allows a user to carry out transaction procedures for purchasing goods.

[0815] "Delivery method" refers to the equipment or method used to deliver goods to the user's place of residence or selected destination.

[0816] A "digital assistant function" is a feature that works in conjunction with smart devices to support the user's purchasing experience.

[0817] To implement this invention, a system will be built that uses user emotional data to suggest products. This system will consist of the user's smart device (e.g., a smartphone) and a server. The server will be equipped with an AI recommendation engine developed using Python and TensorFlow, and will retrieve information from a database managed by MongoDB.

[0818] Users input necessary information into a specific application using their smartphones. This application, developed using React Native, is responsible for sending the input data to a server. The data that reaches the server is analyzed by an AI engine, which, along with the user's emotional data, provides product recommendations.

[0819] The suggested product list is displayed on the smartphone, and detailed information can be viewed in multiple languages. Once the user selects an item and decides to purchase it, the payment process begins. This includes delivery options, and arrangements are made for the product to be delivered to the specified address.

[0820] For example, suppose a foreign visitor staying in Kyoto accesses an application using their smartphone. This user inputs that they are interested in traditional Japanese crafts as souvenirs, and the application requests suggestions from the server based on the user's sentiment data. The server generates a product list accordingly, and the user selects their preferred items and makes a purchase.

[0821] An example of a prompt message might be: "Tourists scan a QR code with their smartphones, provide feedback to rate related products, and the AI ​​learns from the ratings to improve the accuracy of product recommendations."

[0822] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0823] Step 1:

[0824] The user launches an application on their smartphone and enters basic information about the recipient, the purpose of the gift, budget, and preferences. This input data is sent from the device to the server. Based on the input data, the server updates the user's profile and retrieves sentiment data from the previous interaction.

[0825] Step 2:

[0826] The server uses a generative AI model to process the received user information and sentiment data. Sentiment analysis measures analyze the user's emotional tendencies and, based on this, generate a product list for product recommendations. The input here is user information and sentiment data, and the output is a customized product list.

[0827] Step 3:

[0828] The generated product list is sent to the terminal and displayed to the user. The terminal supports multiple languages ​​and displays detailed information about the products. The user reviews the displayed product list and selects the products they like. The input here is the product list sent from the server, and the output is the user's selection information.

[0829] Step 4:

[0830] After the user selects their desired product, the selection information is sent back from the terminal to the server. The server interacts with the inventory information system to check the inventory status of the selected product and the store's operating hours in real time. Once the inventory check is complete, the user receives a purchase confirmation message.

[0831] Step 5:

[0832] The server initiates the payment process once the user decides to purchase. During this process, it provides delivery options to the user's specified address or destination, utilizing the available shipping methods. Once payment is complete, the purchase details are displayed on the terminal. The input here is the user's payment information, and the output is a purchase confirmation message.

[0833] Step 6:

[0834] After purchase, users can provide product feedback through the application. This feedback is sent from the device to the server, which updates the training database of the generated AI model. The input here is the user's feedback information, and the output is the updated database information.

[0835] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0836] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0837] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0838] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0839] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0840] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0841] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0842] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0843] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0844] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0845] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0846] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0847] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0848] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0849] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0850] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0851] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0852] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0853] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0854] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0855] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[0856] The following is further disclosed regarding the embodiments described above.

[0857] (Claim 1)

[0858] An input method for receiving information from users,

[0859] A processing means equipped with artificial intelligence for searching for and suggesting products based on the information received from the user,

[0860] Information provision methods that provide detailed information about products in multiple languages,

[0861] A display means that shows the inventory status of the proposed products and the store's operating information in real time,

[0862] A means of purchase in which a user carries out a transaction procedure to purchase a product,

[0863] A system that includes this.

[0864] (Claim 2)

[0865] The system according to claim 1, wherein the purchasing means includes a delivery means for providing delivery options and delivering the goods to the user's place of residence or a selected destination.

[0866] (Claim 3)

[0867] The system according to claim 1, characterized in that the processing means includes means for collecting user evaluations or feedback and using them to improve the recommendation accuracy of the artificial intelligence.

[0868] "Example 1"

[0869] (Claim 1)

[0870] An input means equipped with a user interface for receiving detailed information from the user,

[0871] A communication means for encrypting and transmitting detailed information received from the user,

[0872] A processing means having artificial intelligence that analyzes the aforementioned information and provides prompt sentences to a generating AI model to extract products,

[0873] A means of providing information that explains the processed product list in detail in multiple languages,

[0874] A management system that dynamically acquires the inventory status of the relevant product and the operating status of sales locations,

[0875] A purchasing method that includes the transaction and delivery procedures for the user to confirm the purchase of goods and specify the delivery address,

[0876] A system that includes this.

[0877] (Claim 2)

[0878] The system according to claim 1, characterized in that the purchasing means includes a delivery management means for providing multiple delivery options and delivering the goods to a delivery location specified by the user.

[0879] (Claim 3)

[0880] The system according to claim 1, characterized in that the processing means includes an update means used to collect evaluation or feedback information received from the user after purchase and to improve the accuracy of the generated AI model.

[0881] "Application Example 1"

[0882] (Claim 1)

[0883] A means of communication for receiving information from users,

[0884] A computing means equipped with artificial intelligence for searching for and recommending products based on information received from the user,

[0885] Information display means that provides detailed product information in multiple languages,

[0886] A display means for showing the inventory status of exhibited products and sales information of sales locations in real time,

[0887] A purchasing processing means for users to execute transaction processing for purchasing goods,

[0888] A logistics processing method for sending the product selected by the user to the point of purchase or delivery address,

[0889] A system that includes this.

[0890] (Claim 2)

[0891] The system according to claim 1, characterized in that the logistics processing means provides delivery options and ships goods to a location or selected delivery destination desired by the user.

[0892] (Claim 3)

[0893] The system according to claim 1, characterized in that the calculation means includes a learning processing means for collecting user evaluations or opinions and using them to improve the recommendation accuracy of the artificial intelligence.

[0894] "Example 2 of combining an emotion engine"

[0895] (Claim 1)

[0896] An input means for receiving attribute information and emotional state from the user,

[0897] An artificial intelligence processing means equipped with sentiment analysis for generating and proposing products based on information received from the user and past sentiment data,

[0898] An information delivery method that provides detailed product information and emotion-based dynamic recommendation messages in multiple languages,

[0899] A display means that shows the inventory status and sales information of the proposed products in real time,

[0900] A means of purchase in which a user carries out a transaction procedure to purchase a product,

[0901] A means for collecting user feedback after the purchase and updating the artificial intelligence's learning database,

[0902] A system that includes this.

[0903] (Claim 2)

[0904] The system according to claim 1, characterized in that the purchasing means includes logistics means for providing delivery options and delivering the goods to a receiving location specified by the user.

[0905] (Claim 3)

[0906] The system according to claim 1, characterized in that the artificial intelligence processing means includes a learning means for analyzing the user's product selection history based on emotions and improving recommendation accuracy.

[0907] "Application example 2 when combining with an emotional engine"

[0908] (Claim 1)

[0909] An input method for receiving information from users,

[0910] A processing means equipped with artificial intelligence for searching for and suggesting products based on the information received from the user,

[0911] A sentiment analysis method that dynamically adjusts product recommendations based on user sentiment data,

[0912] Information provision methods that provide detailed information about products in multiple languages,

[0913] A display means that shows the inventory status of the proposed products and the store's operating information in real time,

[0914] A means of purchase in which a user carries out a transaction procedure to purchase a product,

[0915] A system that includes this.

[0916] (Claim 2)

[0917] The system according to claim 1, wherein the purchasing means includes a delivery means for providing delivery options and delivering the goods to the user's place of residence or a selected destination.

[0918] (Claim 3)

[0919] The system according to claim 1, wherein the processing means includes means for collecting user evaluations or feedback and using them to improve the recommendation accuracy of the artificial intelligence, and provides a digital assistant function in cooperation with a smart device. [Explanation of symbols]

[0920] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A means of communication for receiving information from users, A computing means equipped with artificial intelligence for searching for and recommending products based on information received from the user, Information display means that provides detailed product information in multiple languages, A display means for showing the inventory status of exhibited products and sales information of sales locations in real time, A purchasing processing means for users to execute transaction processing for purchasing goods, A logistics processing method for sending the product selected by the user to the point of purchase or delivery address, A system that includes this.

2. The system according to claim 1, characterized in that the logistics processing means provides delivery options and ships goods to a location or selected delivery destination desired by the user.

3. The system according to claim 1, characterized in that the calculation means includes a learning processing means for collecting user evaluations or opinions and using them to improve the recommendation accuracy of the artificial intelligence.

Images