system

Abstract

We provide the system. [Solution] A device for inputting user requirements, A device that transmits the above conditions to a network device, The network device is a device that searches for a suitable information device from a storage device based on the above conditions, A device for displaying the search results on a user device, The device is characterized in that the aforementioned user can use it on a multi-purpose commercial platform, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, and includes steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a character of the chatbot, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] When consumers newly purchase or replace an information device, due to the diversity of options provided and the complexity of technical information, there is a problem that it is difficult to select an appropriate information device. Also, it may be difficult for existing information devices to determine whether they can be used with a desired mobile communication carrier. Such a situation is a factor that wastes time and effort for consumers, that is, it hinders making an optimal choice.

Means for Solving the Problems

[0005] This invention provides a system that streamlines the process of selecting information devices, allowing consumers to easily choose devices that meet their needs. Specifically, the system includes means for users to input their desired device specifications, means for transmitting these specifications to a server, and means for the server to perform a database search based on the input to identify information devices that meet the specifications. The acquired information can then be presented to the user, showing options in an easily usable format. This enables users to efficiently and effectively select the most suitable information device, reducing the burden of the selection process.

[0006] "Means of receiving user input" refers to interfaces or devices that allow users to provide the system with their requirements and preferences.

[0007] "Means of sending input to a server" refers to functions or devices for transferring information provided by a user to a remote server via a network.

[0008] "Means by which the server searches the database for the most suitable information device based on input" refers to a function in which the server searches a database containing information related to information devices based on data sent by the user, and identifies an information device that matches the specified criteria.

[0009] "Means of displaying search results to the user" refers to functions or devices that present information from appropriate information devices identified by the server in a format that is easy for the user to understand, either visually or audibly.

[0010] "Ranking based on priority" refers to the process of evaluating the suitability of multiple candidates, ranking them according to certain criteria, and presenting them in the most appropriate order.

[0011] "Information including the characteristics of the information device" refers to data that provides details related to the specifications, performance, price, and other attributes of the information device.

[0012] "Displaying on the user interface" refers to the function of providing information to the user and creating an operable state through the screen, display, or audio output on the device. [Brief explanation of the drawing]

[0013] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] This is a sequence diagram showing the processing flow of the data processing system in Example 2, which incorporates an emotion engine. [Figure 14]It is a sequence diagram showing the processing flow of a data processing system in Application Example 2 when a sentiment engine is combined.

Embodiments for Carrying Out the Invention

[0014] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0015] First, the terms used in the following description will be explained.

[0016] In the following embodiments, a numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), etc.

[0017] In the following embodiments, a numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0018] In the following embodiments, a numbered storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, etc.

[0019] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0020] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0021] [First Embodiment]

[0022] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0023] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0024] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0025] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0026] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0027] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0028] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0029] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0030] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0031] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0032] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0033] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0034] This invention relates to a system that assists users in the process of selecting information devices, and its main objective is to propose information devices that efficiently and appropriately meet the user's needs. This system consists of user terminals, a network, a server, and a database.

[0035] The user first answers a series of questions about the information device using a terminal. These questions include budget, intended use, screen size, battery life, operating system, storage capacity, expected usage period, presence or absence of authentication functions, and contracted telecommunications carrier. Once the user enters their answers, the terminal sends that information to the server.

[0036] The server searches the database based on the information it receives. The database contains detailed data on multiple information devices. The server uses queries to identify the information device that best suits the user's requirements.

[0037] The server then ranks these information devices based on their suitability and sends the information to the terminal for presentation to the user. The terminal displays the data sent from the server. For example, if the user prioritizes the camera function, information devices with good camera performance will be listed preferentially.

[0038] For example, if a user enters a budget of 50,000 yen or less, a screen size of 6 inches or larger, and prioritizes camera performance, the server will narrow down the information devices that meet these conditions and display the best candidates based on price range, screen size, camera resolution, etc. As a result, the user can easily compare, consider, and select an information device that meets their needs.

[0039] The key feature of this system is that it not only searches for information devices that meet the specified criteria, but also proposes solutions that best suit the user's needs, simplifying and speeding up the often complex selection process. Based on the information presented, users can proceed with checking products in stores or making online purchases.

[0040] The following describes the processing flow.

[0041] Step 1:

[0042] The user uses a terminal to input their desired specifications for the information device through the interface. The questions present specific options such as budget, screen size, and intended use.

[0043] Step 2:

[0044] The terminal collects information entered by the user, compiles it into a single dataset, and formats it into an appropriate format such as JSON. This data is then ready to be sent to the server.

[0045] Step 3:

[0046] The terminal sends formatted data to the server over the network. This communication is securely conducted using protocols such as SSL / TLS.

[0047] Step 4:

[0048] The server analyzes the received data. Specifically, it extracts conditional items and prepares them to be used as parameters for the search query.

[0049] Step 5:

[0050] The server executes a query on its internal database based on the received conditions. This query searches the database for information devices that meet the conditions specified by the user.

[0051] Step 6:

[0052] The server analyzes the results obtained from the database, calculates the degree of suitability of each information device, and ranks them in order of priority.

[0053] Step 7:

[0054] The server returns ranked information to the terminal. This data includes the name, characteristics, and suitability of each information device.

[0055] Step 8:

[0056] The terminal displays data received from the server in a format that is easy for the user to understand. The user can review the presented information and select the information device that best suits their needs.

[0057] (Example 1)

[0058] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0059] Selecting information processing equipment is challenging, requiring significant time and effort to efficiently and quickly meet the diverse needs of users. Furthermore, it is not easy for users to find the option best suited to their requirements. Therefore, a system is needed to retrieve appropriate information from data storage devices and present the user with the optimal choice.

[0060] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0061] In this invention, the server includes terminal means for a user to input multiple conditions, means for transmitting the conditions to the server via communication means, means for the server to identify an information processing device from a data storage device based on the conditions, means for sorting the information processing devices by priority based on their suitability to the conditions, and means for transmitting and visualizing the sorted information to the terminal. This allows the user to quickly find an information processing device that suits their needs.

[0062] A "user" is the entity that inputs multiple criteria in order to select an information processing device.

[0063] "Terminal means" refers to a device or system used by a user to input conditions and display information.

[0064] "Communication methods" refer to network technologies and protocols used to send data from a terminal to a server.

[0065] A "server" is a central processing unit that searches data storage devices based on the conditions received from the user and processes the results.

[0066] A "data storage device" is a location where detailed data related to an information processing device is stored.

[0067] An "information processing device" is a device that is selected based on the user's requirements.

[0068] "Condition suitability" is a measure used to evaluate how well an information processing device matches the conditions specified by the user.

[0069] "Means of sorting by priority" refers to a method or process for arranging information processing devices in the optimal order based on their suitability for the given conditions.

[0070] "Means of visualization" refers to methods or techniques for displaying information in a way that allows users to intuitively understand the results.

[0071] This invention relates to a system that allows users to efficiently select information processing equipment. This system consists of a user terminal, a server, a network, and a data storage device.

[0072] The user first uses a terminal to input the necessary criteria for selecting an information processing device. The terminal provides an input screen where the user can specify elements such as budget, screen size, battery life, and operating system. For example, the user might input conditions such as "budget under 50,000 yen, screen size 6 inches or larger, and emphasis on camera performance."

[0073] The entered conditions are sent to the server via a communication method. The server receives this information and searches for information processing devices based on the conditions in a database that has been pre-built as a data storage device. The database contains detailed information such as the specifications, performance, price, and reviews of the information devices.

[0074] The server calculates the degree of suitability based on the search results and sorts the information processing devices with the best conditions into those most suitable for the user. In this process, a generative AI model is used to efficiently evaluate and score numerous conditions. The server then sends the scored results to the terminal.

[0075] The terminal visualizes the information received from the server so that the user can easily understand it. For example, by using a list format or a graphical interface, users can easily compare different information processing devices.

[0076] For example, if a user enters a prompt such as, "Please recommend a smartphone with high camera performance and long battery life, within a budget of 50,000 yen," the system can then suggest the most suitable smartphone based on these conditions. In this way, users can select an information device that meets their individual needs.

[0077] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0078] Step 1:

[0079] The user inputs selection criteria for an information processing device via a terminal. These criteria include budget, screen size, battery life, operating system, storage capacity, and camera performance. The entered data is structured using a form and temporarily stored on the terminal. Specifically, the terminal checks the entered information in real time to ensure there are no errors or inaccuracies.

[0080] Step 2:

[0081] The terminal sends the checked user input to the server. This communication is performed using a secure protocol, encrypting the data. The input data is converted to a common data format such as JSON and transferred to the server. Specifically, after the transmission is complete, the terminal displays a message to the user informing them of the status, such as "Sending data...".

[0082] Step 3:

[0083] The server analyzes the received input data and searches for relevant information in the database. The server generates queries and retrieves data from the data storage device corresponding to the information processing device. Specifically, the server lists the information that matches the conditions and calculates a provisional score.

[0084] Step 4:

[0085] The server ranks the acquired information based on its relevance to the given conditions. Using a generative AI model, it calculates a score for each information processing device and sorts them in order of priority. In this process, the AI ​​model integrates multiple conditions to make sophisticated decisions. Specifically, if the focus is on camera performance, scoring will be performed with emphasis on camera pixel count and lens features.

[0086] Step 5:

[0087] The server sends the ranked information to the terminal. The output data is again sent via a secure protocol and formatted in a way that is easily understandable to the user. Specifically, the server labels the data and assigns tags such as "the option with the best camera performance."

[0088] Step 6:

[0089] The terminal displays received data in a user interface. Details of each information processing device are provided in a list format or graphical interface to facilitate comparison. Specifically, users can tap on each piece of information on the screen to view individual detailed data.

[0090] (Application Example 1)

[0091] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0092] In today's multi-purpose e-commerce platforms, it is a challenging task for users to quickly and accurately select the information devices that best suit their needs. Identifying the appropriate product from a diverse range of options and a vast amount of information is time-consuming and laborious, placing a significant burden on users. Therefore, there is a need for a system that can easily suggest optimal information devices based on user input, thereby improving the user's purchasing experience.

[0093] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0094] In this invention, the server includes a device for inputting conditions from the user, a device for transmitting the conditions to a network device, a device for the network device to search for suitable information equipment from a storage device based on the conditions, a device for displaying the search results on the user device, and a device that is available to the user on a multipurpose commercial transaction platform. This enables the user to efficiently select information equipment suitable for their needs and make purchasing decisions quickly.

[0095] A "user" is an individual or group that inputs conditions into an information device.

[0096] "Conditions" refer to information that users input as specific wishes or requirements when selecting information equipment. Examples include budget and functional performance.

[0097] A "network device" is a communication device that receives conditions entered by a user and transmits them to a server.

[0098] A "storage device" refers to a device that stores data related to information equipment and provides appropriate data based on requests from network devices.

[0099] "Information equipment" refers to electronic devices that are subject to determination as to whether or not they meet the user's requirements.

[0100] "Searching" is the process of finding information devices that match the user's criteria from data stored in a storage device.

[0101] "Display" refers to the procedure of visually communicating the results obtained through a search to the user.

[0102] A "multipurpose commercial trading platform" is an online marketplace that handles a wide variety of goods and services.

[0103] The system for realizing this invention mainly consists of a smartphone or other user terminal, a cloud-based server, and a database. Users use an application on their smartphone to input conditions. This application is implemented using mobile application development frameworks such as React Native and Flutter®. The conditions entered by the user are sent to the cloud server via the internet.

[0104] The cloud server is based on cloud services such as AWS® and Google® Cloud, and provides the functionality to analyze user conditions and search for the most suitable information devices from a database. This database uses Firebase or AWS DynamoDB and stores detailed data on information devices. The server finds products that match the conditions, ranks them, and sends them to the user's terminal.

[0105] The search results are presented to the user in an interactive format within the smartphone's user interface. This allows users to easily select the information device that best matches their criteria. For example, if a user enters "budget of 30,000 yen, battery life of 24 hours or more, camera performance of mid-range or higher" into the app, the server searches for information devices that meet these conditions and recommends them to the user with a ranking.

[0106] An example of a prompt message is, "Please suggest a smartphone information device with a budget of 30,000 yen, a battery life of 24 hours or more, and camera performance of a mid-range or higher class." Based on this prompt message, the generating AI model provides the optimal experience and improves the user's purchasing experience.

[0107] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0108] Step 1:

[0109] The user launches an application on their device and enters the selection criteria for information equipment. These criteria include budget, functionality, and battery life. The device formats the entered criteria as digital data and prepares to send it to the server over the network.

[0110] Step 2:

[0111] The terminal sends the entered conditions to the cloud server. In this process, the terminal uses the Internet Protocol to send the condition data to the cloud network device in an appropriate format. Once the server receives this data, it proceeds to the next step.

[0112] Step 3:

[0113] The server analyzes the condition data received from the terminal. Based on the analyzed conditions, the server generates a data query and searches the database for information device data. The goal is to identify the information device that best suits the user's conditions.

[0114] Step 4:

[0115] The server ranks information device data extracted from the database based on its degree of relevance to the conditions. This ranking process uses a predefined algorithm and leverages a generative AI model to calculate the degree of match between the conditions and the products.

[0116] Step 5:

[0117] The server sends a ranked list of information devices to the terminal. The transmitted data includes detailed information and a ranking score for each information device. The terminal then prepares the information to be displayed to the user.

[0118] Step 6:

[0119] The terminal displays a list of information devices received from the server on its user interface. Based on this display, users can examine and compare products in detail, thereby supporting their purchasing decisions.

[0120] Step 7:

[0121] Users can select the information equipment they deem most suitable and proceed with the purchase process on a multi-purpose e-commerce platform as needed. This improves the user's purchasing experience.

[0122] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0123] This invention relates to a system that enables users to make more appropriate and user-friendly selections of information devices by taking into account emotional factors in addition to ordinary technical conditions when selecting an information device. This system consists of a user terminal, a network, a server, a database, and an emotion engine.

[0124] First, the user accesses the system using a terminal and enters their desired specifications for the information device. These specifications include specific items such as budget, purpose of use, and screen size. This information is sent from the terminal to the server. In addition, to understand the user's emotions, an emotion engine analyzes the user's voice and facial expressions through a microphone and camera installed on the terminal.

[0125] The server searches the database by combining the received preferences with data from the emotion engine. The database contains specifications and characteristics of a wide variety of information devices, and through a process of selecting information devices that also match the user's emotional state based on this data, it identifies devices that contribute to the user's interest and satisfaction.

[0126] The selected information devices are ranked based on the user's preferences and emotional state, and listed in order of priority. This list is sent to the terminal, which displays it to the user in a visually easy-to-understand format. Based on this information, the user can consider and select the most suitable information device.

[0127] For example, if a user operates the system with the conditions "budget under 50,000 yen, screen size 6 inches or larger, and excited state," the server can take into account the excited state detected by the emotion engine and prioritize suggesting information devices with superior graphics performance and game performance.

[0128] This invention makes it possible to offer suggestions that are not merely technically specific but also resonate with the user's emotions, making the selection process more user-centric. As a result, users can more easily make choices that take their own feelings into consideration, improving the overall experience value.

[0129] The following describes the processing flow.

[0130] Step 1:

[0131] The user uses the terminal to input basic requirements for the information device, including budget, intended use, and screen size. Furthermore, the terminal uses its built-in camera and microphone to collect emotional information from the user's facial expressions and voice.

[0132] Step 2:

[0133] The device combines user input conditions and sentiment data, and sends this information to the server. The data is transmitted securely in real time and reaches the server.

[0134] Step 3:

[0135] The server analyzes the received user conditions and sentiment data. Based on the analyzed data, it prepares queries to determine which information device is best suited to the user's sentiment and conditions.

[0136] Step 4:

[0137] The server uses the generated query to access the database and search for information devices that match the conditions and sentiment. The database stores information such as the technical specifications and user reviews of each device.

[0138] Step 5:

[0139] The server calculates the suitability of each device based on the searched list of devices and ranks them based on the user's emotions. For example, if the user is excited, devices with high gaming performance will be ranked higher.

[0140] Step 6:

[0141] The server sends a list of ranked information devices to the terminal. This presents the option that best suits the user's preferences and emotional state.

[0142] Step 7:

[0143] The terminal receives information transmitted from the server and displays it in a visually easy-to-understand format on the user interface. Based on this information, the user can compare, consider, and select the most suitable information device.

[0144] (Example 2)

[0145] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0146] Conventional information equipment selection systems propose the most suitable equipment based on the user's technical requirements, but they fail to consider the user's emotions and psychological factors. Therefore, they may not adequately improve the user experience, potentially leading to decreased user satisfaction with the selected equipment.

[0147] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0148] In this invention, the server includes means for receiving user preferences, means for analyzing user emotional data, and means for searching a database to select information equipment based on the user's preferences and emotional state. This makes it possible to select information equipment that is more suitable based on the user's preferences and emotional state.

[0149] "User requirements" refer to specific requirements such as budget, purpose of use, and screen size that users desire when selecting information equipment.

[0150] "Emotional data" refers to information that represents the user's current emotional state, obtained by analyzing the user's voice and facial expressions.

[0151] A "server" refers to a computer system that receives information sent by a user, searches a database, selects the appropriate information device, and provides the results to the user's terminal.

[0152] A "database" refers to a collection of information that stores the specifications and characteristics of various information devices, which a server uses to search for and select information devices.

[0153] "Information equipment" refers to all electronic devices that possess the technical functions and performance to meet user needs.

[0154] "Ranking" refers to the process of prioritizing and ranking selected information devices based on the user's desired conditions and emotional state.

[0155] "User interface" refers to the screen layout of digital displays and applications that present information to users in a way that is easy for them to understand visually.

[0156] This invention provides a system that allows users to make more appropriate selections of information devices by taking into account not only technical requirements but also emotional factors. This system consists of a user terminal, a network, a server, a database, and an emotion analysis engine.

[0157] The user uses a device to input specific requirements such as budget, purpose of use, and screen size into the system. The device has the function to send this data to a server, and also uses the microphone and camera attached to the device to collect emotional data such as the user's voice and facial expressions. This emotional data is evaluated by an emotion analysis engine, which quantifies the user's emotional state.

[0158] The server receives these preference conditions and emotional data and searches its database. This database contains the characteristics of a wide variety of information devices, and the server selects the device that best matches the user's conditions and emotional state. This selection process involves database searches using SQL queries and employs an algorithm to prioritize the selection results.

[0159] The selected information devices are ranked and the information is transmitted from the server to the terminal. Based on this information, the terminal displays it to the user in an easy-to-understand visual format through the user interface. This allows the user to compare and consider the presented information devices and select the one that best matches their emotional state.

[0160] As a concrete example, consider a case where a user inputs the following conditions: "budget under 50,000 yen, screen size 6 inches or larger, and excited state." Based on this input, the server can identify and suggest information devices with high graphics and gaming performance. An example of a prompt in this system operation is as follows: "The user is looking for a smartphone with a screen size of 6 inches or larger and a budget of under 50,000 yen. The user is excited and prioritizes graphics and gaming performance. Please suggest a list of smartphones that best meet these conditions."

[0161] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0162] Step 1:

[0163] The user enters their desired specifications using a terminal. These specifications include specific requirements such as the budget, intended use, and screen size of the information equipment. The entered data is registered directly to the terminal via the user interface. Once this input is complete, the specifications are converted into an internal data format and prepared for the next step.

[0164] Step 2:

[0165] The device sends the user's desired conditions to the server. Simultaneously, it uses its built-in microphone and camera to collect the user's voice and facial expressions. This collected data is sent to an emotion analysis engine. Using the voice and video data as input, the emotion analysis engine numerically evaluates the user's emotional state and generates a result. This results in outputting data that reflects the user's psychological state.

[0166] Step 3:

[0167] The server receives preference and sentiment data sent from the terminal. Based on the received data, a process is triggered to search the database. The server queries the database using SQL queries to select information devices that may match the user's requirements and sentiment state. In this process, the data is processed using filtering and scoring algorithms to generate a list of optimal devices.

[0168] Step 4:

[0169] The server performs a process of ranking the identified information devices based on the database search results. Ranking is performed considering the degree to which the devices match the user's desired criteria and their suitability to their emotional state. This results in a prioritized list of devices. The list is then sorted from the most suitable devices downwards and prepared as output data.

[0170] Step 5:

[0171] A list of ranked information devices from the server is sent to the terminal. The terminal displays this list to the user through a user interface. Specifically, it displays images and specifications of the information devices in a list format on the screen, providing information arranged to allow for easy visual comparison. This enables the user to make the best choice based on the information presented.

[0172] (Application Example 2)

[0173] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0174] Existing information equipment selection systems tend to consider only the user's technical requirements, making it difficult to provide suggestions based on the user's emotions and preferences. As a result, users are not always able to make satisfactory choices, and the selection process can become stressful. To solve this problem, a system is needed that can balance the user's emotional factors with those of technical requirements.

[0175] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0176] In this invention, the server includes means for analyzing user input and the user's emotional state, means for searching a database based on the analysis results and identifying the optimal information device, and means for displaying the search results to the user via a user interface. This enables personalized suggestions based on the user's technical preferences and emotional state.

[0177] "Means of receiving user input" refers to a device or interface for users to input selection criteria or preferences.

[0178] "Means of analysis" refers to components that perform the necessary processes to analyze user input data and emotional states and identify appropriate information devices.

[0179] A "server" refers to a central processing unit that searches for information devices based on user input data and analyzed emotional state data, and selects the optimal information device using a database.

[0180] A "database" refers to a data system used to organize and store the specifications, features, and available options of information devices.

[0181] "User interface" refers to a screen display that visually presents the optimal information device to the user, allowing the user to easily understand and operate the proposed device.

[0182] "Emotional state" refers to the user's psychological state and emotional responses, and is derived from data obtained through analysis of facial expressions and voice.

[0183] "Personalized suggestions" refer to recommendations for information devices that are optimized according to the technical needs and emotional state of individual users.

[0184] To implement this invention, the user's terminal receives input regarding the information device they desire. The terminal acquires the user's voice and facial expressions through a camera and microphone, and analyzes their emotional state. For the analysis, OpenCV is used to process the camera image, speech recognition software is used to process the audio data, and a generative AI model such as TENSORFLOW® is utilized to integrate this data and infer emotions.

[0185] The server processes data on technical requirements and emotional states received from the user and searches a database to identify the most suitable information device for the user. The database stores the technical specifications and characteristics of each information device. As a result, a list of products that are emotionally suitable for the user and meet their technical requirements is generated and sent to the terminal via the user interface.

[0186] As a concrete example, consider a situation where a user is searching for "products perfect for relaxing time" via their smartphone. In this case, the device determines that the user is in a relaxed state, and the server prioritizes suggesting relaxation goods such as aromatherapy candles and cushions. An example of a prompt to the generating AI model would be input in the format, "What products would you recommend when the user is in a relaxed state?"

[0187] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0188] Step 1:

[0189] The user enters their desired specifications into the terminal. These specifications include technical requirements such as budget and intended use. This data is collected via the terminal's input interface and prepared for transmission to the server.

[0190] Step 2:

[0191] The device captures the user's voice and facial expressions through its camera and microphone. The acquired data is prepared to be sent to the server as primary data for emotion analysis. At this stage, the data is still raw.

[0192] Step 3:

[0193] The server receives the audio data, converts it into text using speech recognition software (e.g., Google Cloud Speech-to-Text), and inputs this text data into a generative AI model for sentiment analysis. Here, the data is processed to extract speech features and obtain information about emotions.

[0194] Step 4:

[0195] The server processes the facial expression data it receives using tools like OpenCV to analyze its characteristics. This analysis helps to estimate the user's current emotional state, and this data is then integrated into a generative AI model for emotion analysis.

[0196] Step 5:

[0197] The server searches the database based on the user's technical skills and emotional state. The search selects the most suitable information devices from those stored in the database, prioritizing them and creating a list. The output here is a list of information devices recommended to the user.

[0198] Step 6:

[0199] The server sends a list of generated information devices to the terminal, which then displays it to the user through a user interface. The list is personalized based on emotions and presented in a format that makes it easy for the user to select.

[0200] Step 7:

[0201] The user selects an information device based on the displayed information. The selected data is then sent back from the terminal to the server, where the final purchase process is managed.

[0202] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0203] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include those described above. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions shown by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0204] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0205] [Second Embodiment]

[0206] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0207] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0208] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0209] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0210] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0211] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0212] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0213] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0214] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0215] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0216] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0217] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0218] This invention relates to a system that assists users in the process of selecting information devices, and its main objective is to propose information devices that efficiently and appropriately meet the user's needs. This system consists of user terminals, a network, a server, and a database.

[0219] The user first answers a series of questions about the information device using a terminal. These questions include budget, intended use, screen size, battery life, operating system, storage capacity, expected usage period, presence or absence of authentication functions, and contracted telecommunications carrier. Once the user enters their answers, the terminal sends that information to the server.

[0220] The server searches the database based on the information it receives. The database contains detailed data on multiple information devices. The server uses queries to identify the information device that best suits the user's requirements.

[0221] The server then ranks these information devices based on their suitability and sends the information to the terminal for presentation to the user. The terminal displays the data sent from the server. For example, if the user prioritizes the camera function, information devices with good camera performance will be listed preferentially.

[0222] For example, if a user enters a budget of 50,000 yen or less, a screen size of 6 inches or larger, and prioritizes camera performance, the server will narrow down the information devices that meet these conditions and display the best candidates based on price range, screen size, camera resolution, etc. As a result, the user can easily compare, consider, and select an information device that meets their needs.

[0223] The key feature of this system is that it not only searches for information devices that meet the specified criteria, but also proposes solutions that best suit the user's needs, simplifying and speeding up the often complex selection process. Based on the information presented, users can proceed with checking products in stores or making online purchases.

[0224] The following describes the processing flow.

[0225] Step 1:

[0226] The user uses a terminal to input their desired specifications for the information device through the interface. The questions present specific options such as budget, screen size, and intended use.

[0227] Step 2:

[0228] The terminal collects information entered by the user, compiles it into a single dataset, and formats it into an appropriate format such as JSON. This data is then ready to be sent to the server.

[0229] Step 3:

[0230] The terminal sends formatted data to the server over the network. This communication is securely conducted using protocols such as SSL / TLS.

[0231] Step 4:

[0232] The server analyzes the received data. Specifically, it extracts conditional items and prepares them to be used as parameters for the search query.

[0233] Step 5:

[0234] The server executes a query on its internal database based on the received conditions. This query searches the database for information devices that meet the conditions specified by the user.

[0235] Step 6:

[0236] The server analyzes the results obtained from the database, calculates the degree of suitability of each information device, and ranks them in order of priority.

[0237] Step 7:

[0238] The server returns ranked information to the terminal. This data includes the name, characteristics, and suitability of each information device.

[0239] Step 8:

[0240] The terminal displays data received from the server in a format that is easy for the user to understand. The user can review the presented information and select the information device that best suits their needs.

[0241] (Example 1)

[0242] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0243] Selecting information processing equipment is challenging, requiring significant time and effort to efficiently and quickly meet the diverse needs of users. Furthermore, it is not easy for users to find the option best suited to their requirements. Therefore, a system is needed to retrieve appropriate information from data storage devices and present the user with the optimal choice.

[0244] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0245] In this invention, the server includes terminal means for a user to input multiple conditions, means for transmitting the conditions to the server via communication means, means for the server to identify an information processing device from a data storage device based on the conditions, means for sorting the information processing devices by priority based on their suitability to the conditions, and means for transmitting and visualizing the sorted information to the terminal. This allows the user to quickly find an information processing device that suits their needs.

[0246] A "user" is the entity that inputs multiple criteria in order to select an information processing device.

[0247] "Terminal means" refers to a device or system used by a user to input conditions and display information.

[0248] "Communication methods" refer to network technologies and protocols used to send data from a terminal to a server.

[0249] A "server" is a central processing unit that searches data storage devices based on the conditions received from the user and processes the results.

[0250] A "data storage device" is a location where detailed data related to an information processing device is stored.

[0251] An "information processing device" is a device that is selected based on the user's requirements.

[0252] "Condition suitability" is a measure used to evaluate how well an information processing device matches the conditions specified by the user.

[0253] "Means of sorting by priority" refers to a method or process for arranging information processing devices in the optimal order based on their suitability for the given conditions.

[0254] "Means of visualization" refers to methods or techniques for displaying information in a way that allows users to intuitively understand the results.

[0255] This invention relates to a system that allows users to efficiently select information processing equipment. This system consists of a user terminal, a server, a network, and a data storage device.

[0256] The user first uses a terminal to input the necessary criteria for selecting an information processing device. The terminal provides an input screen where the user can specify elements such as budget, screen size, battery life, and operating system. For example, the user might input conditions such as "budget under 50,000 yen, screen size 6 inches or larger, and emphasis on camera performance."

[0257] The entered conditions are sent to the server via a communication method. The server receives this information and searches for information processing devices based on the conditions in a database that has been pre-built as a data storage device. The database contains detailed information such as the specifications, performance, price, and reviews of the information devices.

[0258] The server calculates the degree of suitability based on the search results and sorts the information processing devices with the best conditions into those most suitable for the user. In this process, a generative AI model is used to efficiently evaluate and score numerous conditions. The server then sends the scored results to the terminal.

[0259] The terminal visualizes the information received from the server so that the user can easily understand it. For example, by using a list format or a graphical interface, users can easily compare different information processing devices.

[0260] For example, if a user enters a prompt such as, "Please recommend a smartphone with high camera performance and long battery life, within a budget of 50,000 yen," the system can then suggest the most suitable smartphone based on these conditions. In this way, users can select an information device that meets their individual needs.

[0261] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0262] Step 1:

[0263] The user inputs selection criteria for an information processing device via a terminal. These criteria include budget, screen size, battery life, operating system, storage capacity, and camera performance. The entered data is structured using a form and temporarily stored on the terminal. Specifically, the terminal checks the entered information in real time to ensure there are no errors or inaccuracies.

[0264] Step 2:

[0265] The terminal sends the checked user input to the server. This communication is performed using a secure protocol, encrypting the data. The input data is converted to a common data format such as JSON and transferred to the server. Specifically, after the transmission is complete, the terminal displays a message to the user informing them of the status, such as "Sending data...".

[0266] Step 3:

[0267] The server analyzes the received input data and searches for relevant information in the database. The server generates queries and retrieves data from the data storage device corresponding to the information processing device. Specifically, the server lists the information that matches the conditions and calculates a provisional score.

[0268] Step 4:

[0269] The server ranks the acquired information based on its relevance to the given conditions. Using a generative AI model, it calculates a score for each information processing device and sorts them in order of priority. In this process, the AI ​​model integrates multiple conditions to make sophisticated decisions. Specifically, if the focus is on camera performance, scoring will be performed with emphasis on camera pixel count and lens features.

[0270] Step 5:

[0271] The server sends the ranked information to the terminal. The output data is again sent via a secure protocol and formatted in a way that is easily understandable to the user. Specifically, the server labels the data and assigns tags such as "the option with the best camera performance."

[0272] Step 6:

[0273] The terminal displays received data in a user interface. Details of each information processing device are provided in a list format or graphical interface to facilitate comparison. Specifically, users can tap on each piece of information on the screen to view individual detailed data.

[0274] (Application Example 1)

[0275] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0276] In today's multi-purpose e-commerce platforms, it is a challenging task for users to quickly and accurately select the information devices that best suit their needs. Identifying the appropriate product from a diverse range of options and a vast amount of information is time-consuming and laborious, placing a significant burden on users. Therefore, there is a need for a system that can easily suggest optimal information devices based on user input, thereby improving the user's purchasing experience.

[0277] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0278] In this invention, the server includes a device for inputting conditions from the user, a device for transmitting the conditions to a network device, a device for the network device to search for suitable information equipment from a storage device based on the conditions, a device for displaying the search results on the user device, and a device that is available to the user on a multipurpose commercial transaction platform. This enables the user to efficiently select information equipment suitable for their needs and make purchasing decisions quickly.

[0279] A "user" is an individual or group that inputs conditions into an information device.

[0280] "Conditions" refer to the information that users input as specific hopes and requirements when selecting information devices. For example, budget, functional performance, etc. are included.

[0281] "Network device" refers to a communication device that receives the conditions input by the user and sends them to the server.

[0282] "Storage device" refers to a device that stores data related to information devices and provides appropriate data based on requests from network devices.

[0283] "Information device" refers to an electronic device that is the target for determining whether it meets the user's conditions.

[0284] "Search" refers to a process for finding information devices that match the user's conditions from the data stored in the storage device.

[0285] "Display" refers to a procedure for visually conveying the results obtained by the search to the user.

[0286] "Multi-purpose trading platform" refers to an online marketplace that deals with various types of goods and services.

[0287] The system for realizing this invention mainly consists of smartphones and other user terminals, cloud-based servers, and databases. Users use an application for inputting conditions on their smartphones. This application is implemented using mobile application development frameworks such as React Native and Flutter. The conditions input by the user are sent to the cloud server via the Internet.

[0288] The cloud server, based on cloud services such as AWS and Google Cloud, analyzes user requirements and provides the functionality to search for the most suitable information devices from a database. This database uses Firebase or AWS DynamoDB and stores detailed data on information devices. The server finds products that match the requirements, ranks them, and sends them to the user's terminal.

[0289] The search results are presented to the user in an interactive format within the smartphone's user interface. This allows users to easily select the information device that best matches their criteria. For example, if a user enters "budget of 30,000 yen, battery life of 24 hours or more, camera performance of mid-range or higher" into the app, the server searches for information devices that meet these conditions and recommends them to the user with a ranking.

[0290] An example of a prompt message is, "Please suggest a smartphone information device with a budget of 30,000 yen, a battery life of 24 hours or more, and camera performance of a mid-range or higher class." Based on this prompt message, the generating AI model provides the optimal experience and improves the user's purchasing experience.

[0291] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0292] Step 1:

[0293] The user launches an application on their device and enters the selection criteria for information equipment. These criteria include budget, functionality, and battery life. The device formats the entered criteria as digital data and prepares to send it to the server over the network.

[0294] Step 2:

[0295] The terminal sends the entered conditions to the cloud server. In this process, the terminal uses the Internet Protocol to send the condition data to the cloud network device in an appropriate format. Once the server receives this data, it proceeds to the next step.

[0296] Step 3:

[0297] The server analyzes the condition data received from the terminal. Based on the analyzed conditions, the server generates a data query and searches the database for information device data. The goal is to identify the information device that best suits the user's conditions.

[0298] Step 4:

[0299] The server ranks information device data extracted from the database based on its degree of relevance to the conditions. This ranking process uses a predefined algorithm and leverages a generative AI model to calculate the degree of match between the conditions and the products.

[0300] Step 5:

[0301] The server sends a ranked list of information devices to the terminal. The transmitted data includes detailed information and a ranking score for each information device. The terminal then prepares the information to be displayed to the user.

[0302] Step 6:

[0303] The terminal displays a list of information devices received from the server on its user interface. Based on this display, users can examine and compare products in detail, thereby supporting their purchasing decisions.

[0304] Step 7:

[0305] Users can select the information equipment they deem most suitable and proceed with the purchase process on a multi-purpose e-commerce platform as needed. This improves the user's purchasing experience.

[0306] Furthermore, an emotion engine for estimating the user's emotion may be combined. That is, the specific processing unit 290 may estimate the user's emotion using the emotion specific model 59 and perform specific processing using the user's emotion.

[0307] The present invention relates to a system that makes a more appropriate and user-friendly selection by taking into account emotional factors in addition to normal technical conditions when a user selects an information device. This system is composed of a user terminal, a network, a server, a database, and an emotion engine.

[0308] First, the user accesses the system using the terminal and inputs desired conditions regarding the information device. The desired conditions include specific items such as budget, purpose of use, and screen size. These pieces of information are transmitted from the terminal to the server. Also, in order to grasp the user's emotion, the emotion engine analyzes the user's voice and facial expressions through a microphone and a camera installed in the terminal.

[0309] The server combines the received desired conditions and the data from the emotion engine to search the database. The database contains specifications and features of various information devices, and through the process of selecting an information device that also matches the user's emotional state based on this data, a device that contributes to the user's interest and satisfaction is identified.

[0310] The selected information device is ranked based on the user's desired conditions and emotional state and listed in order of priority. This list is transmitted to the terminal, and the terminal displays it in a visually understandable form for the user. The user can consider and select the optimal information device based on this information.

[0311] For example, if a user operates the system with the conditions "budget under 50,000 yen, screen size 6 inches or larger, and excited state," the server can take into account the excited state detected by the emotion engine and prioritize suggesting information devices with superior graphics performance and game performance.

[0312] This invention makes it possible to offer suggestions that are not merely technically specific but also resonate with the user's emotions, making the selection process more user-centric. As a result, users can more easily make choices that take their own feelings into consideration, improving the overall experience value.

[0313] The following describes the processing flow.

[0314] Step 1:

[0315] The user uses the terminal to input basic requirements for the information device, including budget, intended use, and screen size. Furthermore, the terminal uses its built-in camera and microphone to collect emotional information from the user's facial expressions and voice.

[0316] Step 2:

[0317] The device combines user input conditions and sentiment data, and sends this information to the server. The data is transmitted securely in real time and reaches the server.

[0318] Step 3:

[0319] The server analyzes the received user conditions and sentiment data. Based on the analyzed data, it prepares queries to determine which information device is best suited to the user's sentiment and conditions.

[0320] Step 4:

[0321] The server uses the generated query to access the database and search for information devices that match the conditions and sentiment. The database stores information such as the technical specifications and user reviews of each device.

[0322] Step 5:

[0323] The server calculates the suitability of each device based on the searched list of devices and ranks them based on the user's emotions. For example, if the user is excited, devices with high gaming performance will be ranked higher.

[0324] Step 6:

[0325] The server sends a list of ranked information devices to the terminal. This presents the option that best suits the user's preferences and emotional state.

[0326] Step 7:

[0327] The terminal receives information transmitted from the server and displays it in a visually easy-to-understand format on the user interface. Based on this information, the user can compare, consider, and select the most suitable information device.

[0328] (Example 2)

[0329] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0330] Conventional information equipment selection systems propose the most suitable equipment based on the user's technical requirements, but they fail to consider the user's emotions and psychological factors. Therefore, they may not adequately improve the user experience, potentially leading to decreased user satisfaction with the selected equipment.

[0331] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0332] In this invention, the server includes means for receiving user preferences, means for analyzing user emotional data, and means for searching a database to select information equipment based on the user's preferences and emotional state. This makes it possible to select information equipment that is more suitable based on the user's preferences and emotional state.

[0333] "User requirements" refer to specific requirements such as budget, purpose of use, and screen size that users desire when selecting information equipment.

[0334] "Emotional data" refers to information that represents the user's current emotional state, obtained by analyzing the user's voice and facial expressions.

[0335] A "server" refers to a computer system that receives information sent by a user, searches a database, selects the appropriate information device, and provides the results to the user's terminal.

[0336] A "database" refers to a collection of information that stores the specifications and characteristics of various information devices, which a server uses to search for and select information devices.

[0337] "Information equipment" refers to all electronic devices that possess the technical functions and performance to meet user needs.

[0338] "Ranking" refers to the process of prioritizing and ranking selected information devices based on the user's desired conditions and emotional state.

[0339] "User interface" refers to the screen layout of digital displays and applications that present information to users in a way that is easy for them to understand visually.

[0340] This invention provides a system that allows users to make more appropriate selections of information devices by taking into account not only technical requirements but also emotional factors. This system consists of a user terminal, a network, a server, a database, and an emotion analysis engine.

[0341] The user uses a device to input specific requirements such as budget, purpose of use, and screen size into the system. The device has the function to send this data to a server, and also uses the microphone and camera attached to the device to collect emotional data such as the user's voice and facial expressions. This emotional data is evaluated by an emotion analysis engine, which quantifies the user's emotional state.

[0342] The server receives these preference conditions and emotional data and searches its database. This database contains the characteristics of a wide variety of information devices, and the server selects the device that best matches the user's conditions and emotional state. This selection process involves database searches using SQL queries and employs an algorithm to prioritize the selection results.

[0343] The selected information devices are ranked and the information is transmitted from the server to the terminal. Based on this information, the terminal displays it to the user in an easy-to-understand visual format through the user interface. This allows the user to compare and consider the presented information devices and select the one that best matches their emotional state.

[0344] As a concrete example, consider a case where a user inputs the following conditions: "budget under 50,000 yen, screen size 6 inches or larger, and excited state." Based on this input, the server can identify and suggest information devices with high graphics and gaming performance. An example of a prompt in this system operation is as follows: "The user is looking for a smartphone with a screen size of 6 inches or larger and a budget of under 50,000 yen. The user is excited and prioritizes graphics and gaming performance. Please suggest a list of smartphones that best meet these conditions."

[0345] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0346] Step 1:

[0347] The user enters their desired specifications using a terminal. These specifications include specific requirements such as the budget, intended use, and screen size of the information equipment. The entered data is registered directly to the terminal via the user interface. Once this input is complete, the specifications are converted into an internal data format and prepared for the next step.

[0348] Step 2:

[0349] The device sends the user's desired conditions to the server. Simultaneously, it uses its built-in microphone and camera to collect the user's voice and facial expressions. This collected data is sent to an emotion analysis engine. Using the voice and video data as input, the emotion analysis engine numerically evaluates the user's emotional state and generates a result. This results in outputting data that reflects the user's psychological state.

[0350] Step 3:

[0351] The server receives preference and sentiment data sent from the terminal. Based on the received data, a process is triggered to search the database. The server queries the database using SQL queries to select information devices that may match the user's requirements and sentiment state. In this process, the data is processed using filtering and scoring algorithms to generate a list of optimal devices.

[0352] Step 4:

[0353] The server performs a process of ranking the identified information devices based on the database search results. Ranking is performed considering the degree to which the devices match the user's desired criteria and their suitability to their emotional state. This results in a prioritized list of devices. The list is then sorted from the most suitable devices downwards and prepared as output data.

[0354] Step 5:

[0355] A list of ranked information devices from the server is sent to the terminal. The terminal displays this list to the user through a user interface. Specifically, it displays images and specifications of the information devices in a list format on the screen, providing information arranged to allow for easy visual comparison. This enables the user to make the best choice based on the information presented.

[0356] (Application Example 2)

[0357] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0358] Existing information equipment selection systems tend to consider only the user's technical requirements, making it difficult to provide suggestions based on the user's emotions and preferences. As a result, users are not always able to make satisfactory choices, and the selection process can become stressful. To solve this problem, a system is needed that can balance the user's emotional factors with those of technical requirements.

[0359] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0360] In this invention, the server includes means for analyzing user input and the user's emotional state, means for searching a database based on the analysis results and identifying the optimal information device, and means for displaying the search results to the user via a user interface. This enables personalized suggestions based on the user's technical preferences and emotional state.

[0361] "Means of receiving user input" refers to a device or interface for users to input selection criteria or preferences.

[0362] "Means of analysis" refers to components that perform the necessary processes to analyze user input data and emotional states and identify appropriate information devices.

[0363] A "server" refers to a central processing unit that searches for information devices based on user input data and analyzed emotional state data, and selects the optimal information device using a database.

[0364] A "database" refers to a data system used to organize and store the specifications, features, and available options of information devices.

[0365] "User interface" refers to a screen display that visually presents the optimal information device to the user, allowing the user to easily understand and operate the proposed device.

[0366] "Emotional state" refers to the user's psychological state and emotional responses, and is derived from data obtained through analysis of facial expressions and voice.

[0367] "Personalized suggestions" refer to recommendations for information devices that are optimized according to the technical needs and emotional state of individual users.

[0368] To implement this invention, the user's terminal receives input regarding the information device they desire. The terminal acquires the user's voice and facial expressions through a camera and microphone, and analyzes their emotional state. For the analysis, OpenCV is used to process the camera image, speech recognition software is used to process the audio data, and a generative AI model such as TensorFlow is used to integrate this data and infer emotions.

[0369] The server processes data on technical requirements and emotional states received from the user and searches a database to identify the most suitable information device for the user. The database stores the technical specifications and characteristics of each information device. As a result, a list of products that are emotionally suitable for the user and meet their technical requirements is generated and sent to the terminal via the user interface.

[0370] As a concrete example, consider a situation where a user is searching for "products perfect for relaxing time" via their smartphone. In this case, the device determines that the user is in a relaxed state, and the server prioritizes suggesting relaxation goods such as aromatherapy candles and cushions. An example of a prompt to the generating AI model would be input in the format, "What products would you recommend when the user is in a relaxed state?"

[0371] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0372] Step 1:

[0373] The user enters their desired specifications into the terminal. These specifications include technical requirements such as budget and intended use. This data is collected via the terminal's input interface and prepared for transmission to the server.

[0374] Step 2:

[0375] The device captures the user's voice and facial expressions through its camera and microphone. The acquired data is prepared to be sent to the server as primary data for emotion analysis. At this stage, the data is still raw.

[0376] Step 3:

[0377] The server receives the audio data, converts it into text using speech recognition software (e.g., Google Cloud Speech-to-Text), and inputs this text data into a generative AI model for sentiment analysis. Here, the data is processed to extract speech features and obtain information about emotions.

[0378] Step 4:

[0379] The server processes the facial expression data it receives using tools like OpenCV to analyze its characteristics. This analysis helps to estimate the user's current emotional state, and this data is then integrated into a generative AI model for emotion analysis.

[0380] Step 5:

[0381] The server searches the database based on the user's technical skills and emotional state. The search selects the most suitable information devices from those stored in the database, prioritizing them and creating a list. The output here is a list of information devices recommended to the user.

[0382] Step 6:

[0383] The server sends a list of generated information devices to the terminal, which then displays it to the user through a user interface. The list is personalized based on emotions and presented in a format that makes it easy for the user to select.

[0384] Step 7:

[0385] The user selects an information device based on the displayed information. The selected data is then sent back from the terminal to the server, where the final purchase process is managed.

[0386] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0387] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include those described above. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions shown by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0388] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0389] [Third Embodiment]

[0390] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0391] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0392] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0393] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0394] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0395] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0396] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0397] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0398] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0399] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0400] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0401] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0402] This invention relates to a system that assists users in the process of selecting information devices, and its main objective is to propose information devices that efficiently and appropriately meet the user's needs. This system consists of user terminals, a network, a server, and a database.

[0403] The user first answers a series of questions about the information device using a terminal. These questions include budget, intended use, screen size, battery life, operating system, storage capacity, expected usage period, presence or absence of authentication functions, and contracted telecommunications carrier. Once the user enters their answers, the terminal sends that information to the server.

[0404] The server searches the database based on the information it receives. The database contains detailed data on multiple information devices. The server uses queries to identify the information device that best suits the user's requirements.

[0405] The server then ranks these information devices based on their suitability and sends the information to the terminal for presentation to the user. The terminal displays the data sent from the server. For example, if the user prioritizes the camera function, information devices with good camera performance will be listed preferentially.

[0406] For example, if a user enters a budget of 50,000 yen or less, a screen size of 6 inches or larger, and prioritizes camera performance, the server will narrow down the information devices that meet these conditions and display the best candidates based on price range, screen size, camera resolution, etc. As a result, the user can easily compare, consider, and select an information device that meets their needs.

[0407] The key feature of this system is that it not only searches for information devices that meet the specified criteria, but also proposes solutions that best suit the user's needs, simplifying and speeding up the often complex selection process. Based on the information presented, users can proceed with checking products in stores or making online purchases.

[0408] The following describes the processing flow.

[0409] Step 1:

[0410] The user uses a terminal to input their desired specifications for the information device through the interface. The questions present specific options such as budget, screen size, and intended use.

[0411] Step 2:

[0412] The terminal collects information entered by the user, compiles it into a single dataset, and formats it into an appropriate format such as JSON. This data is then ready to be sent to the server.

[0413] Step 3:

[0414] The terminal sends formatted data to the server over the network. This communication is securely conducted using protocols such as SSL / TLS.

[0415] Step 4:

[0416] The server analyzes the received data. Specifically, it extracts conditional items and prepares them to be used as parameters for the search query.

[0417] Step 5:

[0418] The server executes a query on its internal database based on the received conditions. This query searches the database for information devices that meet the conditions specified by the user.

[0419] Step 6:

[0420] The server analyzes the results obtained from the database, calculates the degree of suitability of each information device, and ranks them in order of priority.

[0421] Step 7:

[0422] The server returns ranked information to the terminal. This data includes the name, characteristics, and suitability of each information device.

[0423] Step 8:

[0424] The terminal displays data received from the server in a format that is easy for the user to understand. The user can review the presented information and select the information device that best suits their needs.

[0425] (Example 1)

[0426] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0427] Selecting information processing equipment is challenging, requiring significant time and effort to efficiently and quickly meet the diverse needs of users. Furthermore, it is not easy for users to find the option best suited to their requirements. Therefore, a system is needed to retrieve appropriate information from data storage devices and present the user with the optimal choice.

[0428] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0429] In this invention, the server includes terminal means for a user to input multiple conditions, means for transmitting the conditions to the server via communication means, means for the server to identify an information processing device from a data storage device based on the conditions, means for sorting the information processing devices by priority based on their suitability to the conditions, and means for transmitting and visualizing the sorted information to the terminal. This allows the user to quickly find an information processing device that suits their needs.

[0430] A "user" is the entity that inputs multiple criteria in order to select an information processing device.

[0431] "Terminal means" refers to a device or system used by a user to input conditions and display information.

[0432] "Communication methods" refer to network technologies and protocols used to send data from a terminal to a server.

[0433] A "server" is a central processing unit that searches data storage devices based on the conditions received from the user and processes the results.

[0434] A "data storage device" is a location where detailed data related to an information processing device is stored.

[0435] An "information processing device" is a device that is selected based on the user's requirements.

[0436] "Condition suitability" is a measure used to evaluate how well an information processing device matches the conditions specified by the user.

[0437] "Means of sorting by priority" refers to a method or process for arranging information processing devices in the optimal order based on their suitability for the given conditions.

[0438] "Means of visualization" refers to methods or techniques for displaying information in a way that allows users to intuitively understand the results.

[0439] This invention relates to a system that allows users to efficiently select information processing equipment. This system consists of a user terminal, a server, a network, and a data storage device.

[0440] The user first uses a terminal to input the necessary criteria for selecting an information processing device. The terminal provides an input screen where the user can specify elements such as budget, screen size, battery life, and operating system. For example, the user might input conditions such as "budget under 50,000 yen, screen size 6 inches or larger, and emphasis on camera performance."

[0441] The entered conditions are sent to the server via a communication method. The server receives this information and searches for information processing devices based on the conditions in a database that has been pre-built as a data storage device. The database contains detailed information such as the specifications, performance, price, and reviews of the information devices.

[0442] The server calculates the degree of suitability based on the search results and sorts the information processing devices with the best conditions into those most suitable for the user. In this process, a generative AI model is used to efficiently evaluate and score numerous conditions. The server then sends the scored results to the terminal.

[0443] The terminal visualizes the information received from the server so that the user can easily understand it. For example, by using a list format or a graphical interface, users can easily compare different information processing devices.

[0444] For example, if a user enters a prompt such as, "Please recommend a smartphone with high camera performance and long battery life, within a budget of 50,000 yen," the system can then suggest the most suitable smartphone based on these conditions. In this way, users can select an information device that meets their individual needs.

[0445] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0446] Step 1:

[0447] The user inputs selection criteria for an information processing device via a terminal. These criteria include budget, screen size, battery life, operating system, storage capacity, and camera performance. The entered data is structured using a form and temporarily stored on the terminal. Specifically, the terminal checks the entered information in real time to ensure there are no errors or inaccuracies.

[0448] Step 2:

[0449] The terminal sends the checked user input to the server. This communication is performed using a secure protocol, encrypting the data. The input data is converted to a common data format such as JSON and transferred to the server. Specifically, after the transmission is complete, the terminal displays a message to the user informing them of the status, such as "Sending data...".

[0450] Step 3:

[0451] The server analyzes the received input data and searches for relevant information in the database. The server generates queries and retrieves data from the data storage device corresponding to the information processing device. Specifically, the server lists the information that matches the conditions and calculates a provisional score.

[0452] Step 4:

[0453] The server ranks the acquired information based on its relevance to the given conditions. Using a generative AI model, it calculates a score for each information processing device and sorts them in order of priority. In this process, the AI ​​model integrates multiple conditions to make sophisticated decisions. Specifically, if the focus is on camera performance, scoring will be performed with emphasis on camera pixel count and lens features.

[0454] Step 5:

[0455] The server sends the ranked information to the terminal. The output data is again sent via a secure protocol and formatted in a way that is easily understandable to the user. Specifically, the server labels the data and assigns tags such as "the option with the best camera performance."

[0456] Step 6:

[0457] The terminal displays received data in a user interface. Details of each information processing device are provided in a list format or graphical interface to facilitate comparison. Specifically, users can tap on each piece of information on the screen to view individual detailed data.

[0458] (Application Example 1)

[0459] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0460] In today's multi-purpose e-commerce platforms, it is a challenging task for users to quickly and accurately select the information devices that best suit their needs. Identifying the appropriate product from a diverse range of options and a vast amount of information is time-consuming and laborious, placing a significant burden on users. Therefore, there is a need for a system that can easily suggest optimal information devices based on user input, thereby improving the user's purchasing experience.

[0461] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0462] In this invention, the server includes a device for inputting conditions from the user, a device for transmitting the conditions to a network device, a device for the network device to search for suitable information equipment from a storage device based on the conditions, a device for displaying the search results on the user device, and a device that is available to the user on a multipurpose commercial transaction platform. This enables the user to efficiently select information equipment suitable for their needs and make purchasing decisions quickly.

[0463] A "user" is an individual or group that inputs conditions into an information device.

[0464] "Conditions" refer to information that users input as specific wishes or requirements when selecting information equipment. Examples include budget and functional performance.

[0465] A "network device" is a communication device that receives conditions entered by a user and transmits them to a server.

[0466] A "storage device" refers to a device that stores data related to information equipment and provides appropriate data based on requests from network devices.

[0467] "Information equipment" refers to electronic devices that are subject to determination as to whether or not they meet the user's requirements.

[0468] "Searching" is the process of finding information devices that match the user's criteria from data stored in a storage device.

[0469] "Display" refers to the procedure of visually communicating the results obtained through a search to the user.

[0470] A "multipurpose commercial trading platform" is an online marketplace that handles a wide variety of goods and services.

[0471] The system for realizing this invention mainly consists of smartphones and other user terminals, a cloud-based server, and a database. Users use an application on their smartphone to input conditions. This application is implemented using mobile application development frameworks such as React Native and Flutter. The conditions entered by the user are sent to the cloud server via the internet.

[0472] The cloud server, based on cloud services such as AWS and Google Cloud, analyzes user requirements and provides the functionality to search for the most suitable information devices from a database. This database uses Firebase or AWS DynamoDB and stores detailed data on information devices. The server finds products that match the requirements, ranks them, and sends them to the user's terminal.

[0473] The search results are presented to the user in an interactive format within the smartphone's user interface. This allows users to easily select the information device that best matches their criteria. For example, if a user enters "budget of 30,000 yen, battery life of 24 hours or more, camera performance of mid-range or higher" into the app, the server searches for information devices that meet these conditions and recommends them to the user with a ranking.

[0474] An example of a prompt message is, "Please suggest a smartphone information device with a budget of 30,000 yen, a battery life of 24 hours or more, and camera performance of a mid-range or higher class." Based on this prompt message, the generating AI model provides the optimal experience and improves the user's purchasing experience.

[0475] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0476] Step 1:

[0477] The user launches an application on their device and enters the selection criteria for information equipment. These criteria include budget, functionality, and battery life. The device formats the entered criteria as digital data and prepares to send it to the server over the network.

[0478] Step 2:

[0479] The terminal sends the entered conditions to the cloud server. In this process, the terminal uses the Internet Protocol to send the condition data to the cloud network device in an appropriate format. Once the server receives this data, it proceeds to the next step.

[0480] Step 3:

[0481] The server analyzes the condition data received from the terminal. Based on the analyzed conditions, the server generates a data query and searches the database for information device data. The goal is to identify the information device that best suits the user's conditions.

[0482] Step 4:

[0483] The server ranks information device data extracted from the database based on its degree of relevance to the conditions. This ranking process uses a predefined algorithm and leverages a generative AI model to calculate the degree of match between the conditions and the products.

[0484] Step 5:

[0485] The server sends a ranked list of information devices to the terminal. The transmitted data includes detailed information and a ranking score for each information device. The terminal then prepares the information to be displayed to the user.

[0486] Step 6:

[0487] The terminal displays a list of information devices received from the server on its user interface. Based on this display, users can examine and compare products in detail, thereby supporting their purchasing decisions.

[0488] Step 7:

[0489] Users can select the information equipment they deem most suitable and proceed with the purchase process on a multi-purpose e-commerce platform as needed. This improves the user's purchasing experience.

[0490] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0491] This invention relates to a system that enables users to make more appropriate and user-friendly selections of information devices by taking into account emotional factors in addition to ordinary technical conditions when selecting an information device. This system consists of a user terminal, a network, a server, a database, and an emotion engine.

[0492] First, the user accesses the system using a terminal and enters their desired specifications for the information device. These specifications include specific items such as budget, purpose of use, and screen size. This information is sent from the terminal to the server. In addition, to understand the user's emotions, an emotion engine analyzes the user's voice and facial expressions through a microphone and camera installed on the terminal.

[0493] The server searches the database by combining the received preferences with data from the emotion engine. The database contains specifications and characteristics of a wide variety of information devices, and through a process of selecting information devices that also match the user's emotional state based on this data, it identifies devices that contribute to the user's interest and satisfaction.

[0494] The selected information devices are ranked based on the user's preferences and emotional state, and listed in order of priority. This list is sent to the terminal, which displays it to the user in a visually easy-to-understand format. Based on this information, the user can consider and select the most suitable information device.

[0495] For example, if a user operates the system with the conditions "budget under 50,000 yen, screen size 6 inches or larger, and excited state," the server can take into account the excited state detected by the emotion engine and prioritize suggesting information devices with superior graphics performance and game performance.

[0496] This invention makes it possible to offer suggestions that are not merely technically specific but also resonate with the user's emotions, making the selection process more user-centric. As a result, users can more easily make choices that take their own feelings into consideration, improving the overall experience value.

[0497] The following describes the processing flow.

[0498] Step 1:

[0499] The user uses the terminal to input basic requirements for the information device, including budget, intended use, and screen size. Furthermore, the terminal uses its built-in camera and microphone to collect emotional information from the user's facial expressions and voice.

[0500] Step 2:

[0501] The device combines user input conditions and sentiment data, and sends this information to the server. The data is transmitted securely in real time and reaches the server.

[0502] Step 3:

[0503] The server analyzes the received user conditions and sentiment data. Based on the analyzed data, it prepares queries to determine which information device is best suited to the user's sentiment and conditions.

[0504] Step 4:

[0505] The server uses the generated query to access the database and search for information devices that match the conditions and sentiment. The database stores information such as the technical specifications and user reviews of each device.

[0506] Step 5:

[0507] The server calculates the suitability of each device based on the searched list of devices and ranks them based on the user's emotions. For example, if the user is excited, devices with high gaming performance will be ranked higher.

[0508] Step 6:

[0509] The server sends a list of ranked information devices to the terminal. This presents the option that best suits the user's preferences and emotional state.

[0510] Step 7:

[0511] The terminal receives information transmitted from the server and displays it in a visually easy-to-understand format on the user interface. Based on this information, the user can compare, consider, and select the most suitable information device.

[0512] (Example 2)

[0513] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0514] Conventional information equipment selection systems propose the most suitable equipment based on the user's technical requirements, but they fail to consider the user's emotions and psychological factors. Therefore, they may not adequately improve the user experience, potentially leading to decreased user satisfaction with the selected equipment.

[0515] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0516] In this invention, the server includes means for receiving user preferences, means for analyzing user emotional data, and means for searching a database to select information equipment based on the user's preferences and emotional state. This makes it possible to select information equipment that is more suitable based on the user's preferences and emotional state.

[0517] "User requirements" refer to specific requirements such as budget, purpose of use, and screen size that users desire when selecting information equipment.

[0518] "Emotional data" refers to information that represents the user's current emotional state, obtained by analyzing the user's voice and facial expressions.

[0519] A "server" refers to a computer system that receives information sent by a user, searches a database, selects the appropriate information device, and provides the results to the user's terminal.

[0520] A "database" refers to a collection of information that stores the specifications and characteristics of various information devices, which a server uses to search for and select information devices.

[0521] "Information equipment" refers to all electronic devices that possess the technical functions and performance to meet user needs.

[0522] "Ranking" refers to the process of prioritizing and ranking selected information devices based on the user's desired conditions and emotional state.

[0523] "User interface" refers to the screen layout of digital displays and applications that present information to users in a way that is easy for them to understand visually.

[0524] This invention provides a system that allows users to make more appropriate selections of information devices by taking into account not only technical requirements but also emotional factors. This system consists of a user terminal, a network, a server, a database, and an emotion analysis engine.

[0525] The user uses a device to input specific requirements such as budget, purpose of use, and screen size into the system. The device has the function to send this data to a server, and also uses the microphone and camera attached to the device to collect emotional data such as the user's voice and facial expressions. This emotional data is evaluated by an emotion analysis engine, which quantifies the user's emotional state.

[0526] The server receives these preference conditions and emotional data and searches its database. This database contains the characteristics of a wide variety of information devices, and the server selects the device that best matches the user's conditions and emotional state. This selection process involves database searches using SQL queries and employs an algorithm to prioritize the selection results.

[0527] The selected information devices are ranked and the information is transmitted from the server to the terminal. Based on this information, the terminal displays it to the user in an easy-to-understand visual format through the user interface. This allows the user to compare and consider the presented information devices and select the one that best matches their emotional state.

[0528] As a concrete example, consider a case where a user inputs the following conditions: "budget under 50,000 yen, screen size 6 inches or larger, and excited state." Based on this input, the server can identify and suggest information devices with high graphics and gaming performance. An example of a prompt in this system operation is as follows: "The user is looking for a smartphone with a screen size of 6 inches or larger and a budget of under 50,000 yen. The user is excited and prioritizes graphics and gaming performance. Please suggest a list of smartphones that best meet these conditions."

[0529] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0530] Step 1:

[0531] The user enters their desired specifications using a terminal. These specifications include specific requirements such as the budget, intended use, and screen size of the information equipment. The entered data is registered directly to the terminal via the user interface. Once this input is complete, the specifications are converted into an internal data format and prepared for the next step.

[0532] Step 2:

[0533] The device sends the user's desired conditions to the server. Simultaneously, it uses its built-in microphone and camera to collect the user's voice and facial expressions. This collected data is sent to an emotion analysis engine. Using the voice and video data as input, the emotion analysis engine numerically evaluates the user's emotional state and generates a result. This results in outputting data that reflects the user's psychological state.

[0534] Step 3:

[0535] The server receives preference and sentiment data sent from the terminal. Based on the received data, a process is triggered to search the database. The server queries the database using SQL queries to select information devices that may match the user's requirements and sentiment state. In this process, the data is processed using filtering and scoring algorithms to generate a list of optimal devices.

[0536] Step 4:

[0537] The server performs a process of ranking the identified information devices based on the database search results. Ranking is performed considering the degree to which the devices match the user's desired criteria and their suitability to their emotional state. This results in a prioritized list of devices. The list is then sorted from the most suitable devices downwards and prepared as output data.

[0538] Step 5:

[0539] A list of ranked information devices from the server is sent to the terminal. The terminal displays this list to the user through a user interface. Specifically, it displays images and specifications of the information devices in a list format on the screen, providing information arranged to allow for easy visual comparison. This enables the user to make the best choice based on the information presented.

[0540] (Application Example 2)

[0541] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0542] Existing information equipment selection systems tend to consider only the user's technical requirements, making it difficult to provide suggestions based on the user's emotions and preferences. As a result, users are not always able to make satisfactory choices, and the selection process can become stressful. To solve this problem, a system is needed that can balance the user's emotional factors with those of technical requirements.

[0543] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0544] In this invention, the server includes means for analyzing user input and the user's emotional state, means for searching a database based on the analysis results and identifying the optimal information device, and means for displaying the search results to the user via a user interface. This enables personalized suggestions based on the user's technical preferences and emotional state.

[0545] "Means of receiving user input" refers to a device or interface for users to input selection criteria or preferences.

[0546] "Means of analysis" refers to components that perform the necessary processes to analyze user input data and emotional states and identify appropriate information devices.

[0547] A "server" refers to a central processing unit that searches for information devices based on user input data and analyzed emotional state data, and selects the optimal information device using a database.

[0548] A "database" refers to a data system used to organize and store the specifications, features, and available options of information devices.

[0549] "User interface" refers to a screen display that visually presents the optimal information device to the user, allowing the user to easily understand and operate the proposed device.

[0550] "Emotional state" refers to the user's psychological state and emotional responses, and is derived from data obtained through analysis of facial expressions and voice.

[0551] "Personalized suggestions" refer to recommendations for information devices that are optimized according to the technical needs and emotional state of individual users.

[0552] To implement this invention, the user's terminal receives input regarding the information device they desire. The terminal acquires the user's voice and facial expressions through a camera and microphone, and analyzes their emotional state. For the analysis, OpenCV is used to process the camera image, speech recognition software is used to process the audio data, and a generative AI model such as TensorFlow is used to integrate this data and infer emotions.

[0553] The server processes data on technical requirements and emotional states received from the user and searches a database to identify the most suitable information device for the user. The database stores the technical specifications and characteristics of each information device. As a result, a list of products that are emotionally suitable for the user and meet their technical requirements is generated and sent to the terminal via the user interface.

[0554] As a concrete example, consider a situation where a user is searching for "products perfect for relaxing time" via their smartphone. In this case, the device determines that the user is in a relaxed state, and the server prioritizes suggesting relaxation goods such as aromatherapy candles and cushions. An example of a prompt to the generating AI model would be input in the format, "What products would you recommend when the user is in a relaxed state?"

[0555] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0556] Step 1:

[0557] The user enters their desired specifications into the terminal. These specifications include technical requirements such as budget and intended use. This data is collected via the terminal's input interface and prepared for transmission to the server.

[0558] Step 2:

[0559] The device captures the user's voice and facial expressions through its camera and microphone. The acquired data is prepared to be sent to the server as primary data for emotion analysis. At this stage, the data is still raw.

[0560] Step 3:

[0561] The server receives the audio data, converts it into text using speech recognition software (e.g., Google Cloud Speech-to-Text), and inputs this text data into a generative AI model for sentiment analysis. Here, the data is processed to extract speech features and obtain information about emotions.

[0562] Step 4:

[0563] The server processes the facial expression data it receives using tools like OpenCV to analyze its characteristics. This analysis helps to estimate the user's current emotional state, and this data is then integrated into a generative AI model for emotion analysis.

[0564] Step 5:

[0565] The server searches the database based on the user's technical skills and emotional state. The search selects the most suitable information devices from those stored in the database, prioritizing them and creating a list. The output here is a list of information devices recommended to the user.

[0566] Step 6:

[0567] The server sends a list of generated information devices to the terminal, which then displays it to the user through a user interface. The list is personalized based on emotions and presented in a format that makes it easy for the user to select.

[0568] Step 7:

[0569] The user selects an information device based on the displayed information. The selected data is then sent back from the terminal to the server, where the final purchase process is managed.

[0570] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0571] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include those described above. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions shown by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0572] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0573] [Fourth Embodiment]

[0574] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0575] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0576] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0577] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0578] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0579] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0580] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0581] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0582] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0583] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0584] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0585] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0586] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0587] This invention relates to a system that assists users in the process of selecting information devices, and its main objective is to propose information devices that efficiently and appropriately meet the user's needs. This system consists of user terminals, a network, a server, and a database.

[0588] The user first answers a series of questions about the information device using a terminal. These questions include budget, intended use, screen size, battery life, operating system, storage capacity, expected usage period, presence or absence of authentication functions, and contracted telecommunications carrier. Once the user enters their answers, the terminal sends that information to the server.

[0589] The server searches the database based on the information it receives. The database contains detailed data on multiple information devices. The server uses queries to identify the information device that best suits the user's requirements.

[0590] The server then ranks these information devices based on their suitability and sends the information to the terminal for presentation to the user. The terminal displays the data sent from the server. For example, if the user prioritizes the camera function, information devices with good camera performance will be listed preferentially.

[0591] For example, if a user enters a budget of 50,000 yen or less, a screen size of 6 inches or larger, and prioritizes camera performance, the server will narrow down the information devices that meet these conditions and display the best candidates based on price range, screen size, camera resolution, etc. As a result, the user can easily compare, consider, and select an information device that meets their needs.

[0592] The key feature of this system is that it not only searches for information devices that meet the specified criteria, but also proposes solutions that best suit the user's needs, simplifying and speeding up the often complex selection process. Based on the information presented, users can proceed with checking products in stores or making online purchases.

[0593] The following describes the processing flow.

[0594] Step 1:

[0595] The user uses a terminal to input their desired specifications for the information device through the interface. The questions present specific options such as budget, screen size, and intended use.

[0596] Step 2:

[0597] The terminal collects information entered by the user, compiles it into a single dataset, and formats it into an appropriate format such as JSON. This data is then ready to be sent to the server.

[0598] Step 3:

[0599] The terminal sends formatted data to the server over the network. This communication is securely conducted using protocols such as SSL / TLS.

[0600] Step 4:

[0601] The server analyzes the received data. Specifically, it extracts conditional items and prepares them to be used as parameters for the search query.

[0602] Step 5:

[0603] The server executes a query on its internal database based on the received conditions. This query searches the database for information devices that meet the conditions specified by the user.

[0604] Step 6:

[0605] The server analyzes the results obtained from the database, calculates the degree of suitability of each information device, and ranks them in order of priority.

[0606] Step 7:

[0607] The server returns ranked information to the terminal. This data includes the name, characteristics, and suitability of each information device.

[0608] Step 8:

[0609] The terminal displays data received from the server in a format that is easy for the user to understand. The user can review the presented information and select the information device that best suits their needs.

[0610] (Example 1)

[0611] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0612] Selecting information processing equipment is challenging, requiring significant time and effort to efficiently and quickly meet the diverse needs of users. Furthermore, it is not easy for users to find the option best suited to their requirements. Therefore, a system is needed to retrieve appropriate information from data storage devices and present the user with the optimal choice.

[0613] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0614] In this invention, the server includes terminal means for a user to input multiple conditions, means for transmitting the conditions to the server via communication means, means for the server to identify an information processing device from a data storage device based on the conditions, means for sorting the information processing devices by priority based on their suitability to the conditions, and means for transmitting and visualizing the sorted information to the terminal. This allows the user to quickly find an information processing device that suits their needs.

[0615] A "user" is the entity that inputs multiple criteria in order to select an information processing device.

[0616] "Terminal means" refers to a device or system used by a user to input conditions and display information.

[0617] "Communication methods" refer to network technologies and protocols used to send data from a terminal to a server.

[0618] A "server" is a central processing unit that searches data storage devices based on the conditions received from the user and processes the results.

[0619] A "data storage device" is a location where detailed data related to an information processing device is stored.

[0620] An "information processing device" is a device that is selected based on the user's requirements.

[0621] "Condition suitability" is a measure used to evaluate how well an information processing device matches the conditions specified by the user.

[0622] "Means of sorting by priority" refers to a method or process for arranging information processing devices in the optimal order based on their suitability for the given conditions.

[0623] "Means of visualization" refers to methods or techniques for displaying information in a way that allows users to intuitively understand the results.

[0624] This invention relates to a system that allows users to efficiently select information processing equipment. This system consists of a user terminal, a server, a network, and a data storage device.

[0625] The user first uses a terminal to input the necessary criteria for selecting an information processing device. The terminal provides an input screen where the user can specify elements such as budget, screen size, battery life, and operating system. For example, the user might input conditions such as "budget under 50,000 yen, screen size 6 inches or larger, and emphasis on camera performance."

[0626] The entered conditions are sent to the server via a communication method. The server receives this information and searches for information processing devices based on the conditions in a database that has been pre-built as a data storage device. The database contains detailed information such as the specifications, performance, price, and reviews of the information devices.

[0627] The server calculates the degree of suitability based on the search results and sorts the information processing devices with the best conditions into those most suitable for the user. In this process, a generative AI model is used to efficiently evaluate and score numerous conditions. The server then sends the scored results to the terminal.

[0628] The terminal visualizes the information received from the server so that the user can easily understand it. For example, by using a list format or a graphical interface, users can easily compare different information processing devices.

[0629] For example, if a user enters a prompt such as, "Please recommend a smartphone with high camera performance and long battery life, within a budget of 50,000 yen," the system can then suggest the most suitable smartphone based on these conditions. In this way, users can select an information device that meets their individual needs.

[0630] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0631] Step 1:

[0632] The user inputs selection criteria for an information processing device via a terminal. These criteria include budget, screen size, battery life, operating system, storage capacity, and camera performance. The entered data is structured using a form and temporarily stored on the terminal. Specifically, the terminal checks the entered information in real time to ensure there are no errors or inaccuracies.

[0633] Step 2:

[0634] The terminal sends the checked user input to the server. This communication is performed using a secure protocol, encrypting the data. The input data is converted to a common data format such as JSON and transferred to the server. Specifically, after the transmission is complete, the terminal displays a message to the user informing them of the status, such as "Sending data...".

[0635] Step 3:

[0636] The server analyzes the received input data and searches for relevant information in the database. The server generates queries and retrieves data from the data storage device corresponding to the information processing device. Specifically, the server lists the information that matches the conditions and calculates a provisional score.

[0637] Step 4:

[0638] The server ranks the acquired information based on its relevance to the given conditions. Using a generative AI model, it calculates a score for each information processing device and sorts them in order of priority. In this process, the AI ​​model integrates multiple conditions to make sophisticated decisions. Specifically, if the focus is on camera performance, scoring will be performed with emphasis on camera pixel count and lens features.

[0639] Step 5:

[0640] The server sends the ranked information to the terminal. The output data is again sent via a secure protocol and formatted in a way that is easily understandable to the user. Specifically, the server labels the data and assigns tags such as "the option with the best camera performance."

[0641] Step 6:

[0642] The terminal displays received data in a user interface. Details of each information processing device are provided in a list format or graphical interface to facilitate comparison. Specifically, users can tap on each piece of information on the screen to view individual detailed data.

[0643] (Application Example 1)

[0644] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0645] In today's multi-purpose e-commerce platforms, it is a challenging task for users to quickly and accurately select the information devices that best suit their needs. Identifying the appropriate product from a diverse range of options and a vast amount of information is time-consuming and laborious, placing a significant burden on users. Therefore, there is a need for a system that can easily suggest optimal information devices based on user input, thereby improving the user's purchasing experience.

[0646] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0647] In this invention, the server includes a device for inputting conditions from the user, a device for transmitting the conditions to a network device, a device for the network device to search for suitable information equipment from a storage device based on the conditions, a device for displaying the search results on the user device, and a device that is available to the user on a multipurpose commercial transaction platform. This enables the user to efficiently select information equipment suitable for their needs and make purchasing decisions quickly.

[0648] A "user" is an individual or group that inputs conditions into an information device.

[0649] "Conditions" refer to information that users input as specific wishes or requirements when selecting information equipment. Examples include budget and functional performance.

[0650] A "network device" is a communication device that receives conditions entered by a user and transmits them to a server.

[0651] A "storage device" refers to a device that stores data related to information equipment and provides appropriate data based on requests from network devices.

[0652] "Information equipment" refers to electronic devices that are subject to determination as to whether or not they meet the user's requirements.

[0653] "Searching" is the process of finding information devices that match the user's criteria from data stored in a storage device.

[0654] "Display" refers to the procedure of visually communicating the results obtained through a search to the user.

[0655] A "multipurpose commercial trading platform" is an online marketplace that handles a wide variety of goods and services.

[0656] The system for realizing this invention mainly consists of smartphones and other user terminals, a cloud-based server, and a database. Users use an application on their smartphone to input conditions. This application is implemented using mobile application development frameworks such as React Native and Flutter. The conditions entered by the user are sent to the cloud server via the internet.

[0657] The cloud server, based on cloud services such as AWS and Google Cloud, analyzes user requirements and provides the functionality to search for the most suitable information devices from a database. This database uses Firebase or AWS DynamoDB and stores detailed data on information devices. The server finds products that match the requirements, ranks them, and sends them to the user's terminal.

[0658] The search results are presented to the user in an interactive format within the smartphone's user interface. This allows users to easily select the information device that best matches their criteria. For example, if a user enters "budget of 30,000 yen, battery life of 24 hours or more, camera performance of mid-range or higher" into the app, the server searches for information devices that meet these conditions and recommends them to the user with a ranking.

[0659] An example of a prompt message is, "Please suggest a smartphone information device with a budget of 30,000 yen, a battery life of 24 hours or more, and camera performance of a mid-range or higher class." Based on this prompt message, the generating AI model provides the optimal experience and improves the user's purchasing experience.

[0660] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0661] Step 1:

[0662] The user launches an application on their device and enters the selection criteria for information equipment. These criteria include budget, functionality, and battery life. The device formats the entered criteria as digital data and prepares to send it to the server over the network.

[0663] Step 2:

[0664] The terminal sends the entered conditions to the cloud server. In this process, the terminal uses the Internet Protocol to send the condition data to the cloud network device in an appropriate format. Once the server receives this data, it proceeds to the next step.

[0665] Step 3:

[0666] The server analyzes the condition data received from the terminal. Based on the analyzed conditions, the server generates a data query and searches the database for information device data. The goal is to identify the information device that best suits the user's conditions.

[0667] Step 4:

[0668] The server ranks information device data extracted from the database based on its degree of relevance to the conditions. This ranking process uses a predefined algorithm and leverages a generative AI model to calculate the degree of match between the conditions and the products.

[0669] Step 5:

[0670] The server sends a ranked list of information devices to the terminal. The transmitted data includes detailed information and a ranking score for each information device. The terminal then prepares the information to be displayed to the user.

[0671] Step 6:

[0672] The terminal displays a list of information devices received from the server on its user interface. Based on this display, users can examine and compare products in detail, thereby supporting their purchasing decisions.

[0673] Step 7:

[0674] Users can select the information equipment they deem most suitable and proceed with the purchase process on a multi-purpose e-commerce platform as needed. This improves the user's purchasing experience.

[0675] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0676] This invention relates to a system that enables users to make more appropriate and user-friendly selections of information devices by taking into account emotional factors in addition to ordinary technical conditions when selecting an information device. This system consists of a user terminal, a network, a server, a database, and an emotion engine.

[0677] First, the user accesses the system using a terminal and enters their desired specifications for the information device. These specifications include specific items such as budget, purpose of use, and screen size. This information is sent from the terminal to the server. In addition, to understand the user's emotions, an emotion engine analyzes the user's voice and facial expressions through a microphone and camera installed on the terminal.

[0678] The server searches the database by combining the received preferences with data from the emotion engine. The database contains specifications and characteristics of a wide variety of information devices, and through a process of selecting information devices that also match the user's emotional state based on this data, it identifies devices that contribute to the user's interest and satisfaction.

[0679] The selected information devices are ranked based on the user's preferences and emotional state, and listed in order of priority. This list is sent to the terminal, which displays it to the user in a visually easy-to-understand format. Based on this information, the user can consider and select the most suitable information device.

[0680] For example, if a user operates the system with the conditions "budget under 50,000 yen, screen size 6 inches or larger, and excited state," the server can take into account the excited state detected by the emotion engine and prioritize suggesting information devices with superior graphics performance and game performance.

[0681] This invention makes it possible to offer suggestions that are not merely technically specific but also resonate with the user's emotions, making the selection process more user-centric. As a result, users can more easily make choices that take their own feelings into consideration, improving the overall experience value.

[0682] The following describes the processing flow.

[0683] Step 1:

[0684] The user uses the terminal to input basic requirements for the information device, including budget, intended use, and screen size. Furthermore, the terminal uses its built-in camera and microphone to collect emotional information from the user's facial expressions and voice.

[0685] Step 2:

[0686] The device combines user input conditions and sentiment data, and sends this information to the server. The data is transmitted securely in real time and reaches the server.

[0687] Step 3:

[0688] The server analyzes the received user conditions and sentiment data. Based on the analyzed data, it prepares queries to determine which information device is best suited to the user's sentiment and conditions.

[0689] Step 4:

[0690] The server uses the generated query to access the database and search for information devices that match the conditions and sentiment. The database stores information such as the technical specifications and user reviews of each device.

[0691] Step 5:

[0692] The server calculates the suitability of each device based on the searched list of devices and ranks them based on the user's emotions. For example, if the user is excited, devices with high gaming performance will be ranked higher.

[0693] Step 6:

[0694] The server sends a list of ranked information devices to the terminal. This presents the option that best suits the user's preferences and emotional state.

[0695] Step 7:

[0696] The terminal receives information transmitted from the server and displays it in a visually easy-to-understand format on the user interface. Based on this information, the user can compare, consider, and select the most suitable information device.

[0697] (Example 2)

[0698] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0699] Conventional information equipment selection systems propose the most suitable equipment based on the user's technical requirements, but they fail to consider the user's emotions and psychological factors. Therefore, they may not adequately improve the user experience, potentially leading to decreased user satisfaction with the selected equipment.

[0700] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0701] In this invention, the server includes means for receiving user preferences, means for analyzing user emotional data, and means for searching a database to select information equipment based on the user's preferences and emotional state. This makes it possible to select information equipment that is more suitable based on the user's preferences and emotional state.

[0702] "User requirements" refer to specific requirements such as budget, purpose of use, and screen size that users desire when selecting information equipment.

[0703] "Emotional data" refers to information that represents the user's current emotional state, obtained by analyzing the user's voice and facial expressions.

[0704] A "server" refers to a computer system that receives information sent by a user, searches a database, selects the appropriate information device, and provides the results to the user's terminal.

[0705] A "database" refers to a collection of information that stores the specifications and characteristics of various information devices, which a server uses to search for and select information devices.

[0706] "Information equipment" refers to all electronic devices that possess the technical functions and performance to meet user needs.

[0707] "Ranking" refers to the process of prioritizing and ranking selected information devices based on the user's desired conditions and emotional state.

[0708] "User interface" refers to the screen layout of digital displays and applications that present information to users in a way that is easy for them to understand visually.

[0709] This invention provides a system that allows users to make more appropriate selections of information devices by taking into account not only technical requirements but also emotional factors. This system consists of a user terminal, a network, a server, a database, and an emotion analysis engine.

[0710] The user uses a device to input specific requirements such as budget, purpose of use, and screen size into the system. The device has the function to send this data to a server, and also uses the microphone and camera attached to the device to collect emotional data such as the user's voice and facial expressions. This emotional data is evaluated by an emotion analysis engine, which quantifies the user's emotional state.

[0711] The server receives these preference conditions and emotional data and searches its database. This database contains the characteristics of a wide variety of information devices, and the server selects the device that best matches the user's conditions and emotional state. This selection process involves database searches using SQL queries and employs an algorithm to prioritize the selection results.

[0712] The selected information devices are ranked and the information is transmitted from the server to the terminal. Based on this information, the terminal displays it to the user in an easy-to-understand visual format through the user interface. This allows the user to compare and consider the presented information devices and select the one that best matches their emotional state.

[0713] As a concrete example, consider a case where a user inputs the following conditions: "budget under 50,000 yen, screen size 6 inches or larger, and excited state." Based on this input, the server can identify and suggest information devices with high graphics and gaming performance. An example of a prompt in this system operation is as follows: "The user is looking for a smartphone with a screen size of 6 inches or larger and a budget of under 50,000 yen. The user is excited and prioritizes graphics and gaming performance. Please suggest a list of smartphones that best meet these conditions."

[0714] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0715] Step 1:

[0716] The user enters their desired specifications using a terminal. These specifications include specific requirements such as the budget, intended use, and screen size of the information equipment. The entered data is registered directly to the terminal via the user interface. Once this input is complete, the specifications are converted into an internal data format and prepared for the next step.

[0717] Step 2:

[0718] The device sends the user's desired conditions to the server. Simultaneously, it uses its built-in microphone and camera to collect the user's voice and facial expressions. This collected data is sent to an emotion analysis engine. Using the voice and video data as input, the emotion analysis engine numerically evaluates the user's emotional state and generates a result. This results in outputting data that reflects the user's psychological state.

[0719] Step 3:

[0720] The server receives preference and sentiment data sent from the terminal. Based on the received data, a process is triggered to search the database. The server queries the database using SQL queries to select information devices that may match the user's requirements and sentiment state. In this process, the data is processed using filtering and scoring algorithms to generate a list of optimal devices.

[0721] Step 4:

[0722] The server performs a process of ranking the identified information devices based on the database search results. Ranking is performed considering the degree to which the devices match the user's desired criteria and their suitability to their emotional state. This results in a prioritized list of devices. The list is then sorted from the most suitable devices downwards and prepared as output data.

[0723] Step 5:

[0724] A list of ranked information devices from the server is sent to the terminal. The terminal displays this list to the user through a user interface. Specifically, it displays images and specifications of the information devices in a list format on the screen, providing information arranged to allow for easy visual comparison. This enables the user to make the best choice based on the information presented.

[0725] (Application Example 2)

[0726] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0727] Existing information equipment selection systems tend to consider only the user's technical requirements, making it difficult to provide suggestions based on the user's emotions and preferences. As a result, users are not always able to make satisfactory choices, and the selection process can become stressful. To solve this problem, a system is needed that can balance the user's emotional factors with those of technical requirements.

[0728] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0729] In this invention, the server includes means for analyzing user input and the user's emotional state, means for searching a database based on the analysis results and identifying the optimal information device, and means for displaying the search results to the user via a user interface. This enables personalized suggestions based on the user's technical preferences and emotional state.

[0730] "Means of receiving user input" refers to a device or interface for users to input selection criteria or preferences.

[0731] "Means of analysis" refers to components that perform the necessary processes to analyze user input data and emotional states and identify appropriate information devices.

[0732] A "server" refers to a central processing unit that searches for information devices based on user input data and analyzed emotional state data, and selects the optimal information device using a database.

[0733] A "database" refers to a data system used to organize and store the specifications, features, and available options of information devices.

[0734] "User interface" refers to a screen display that visually presents the optimal information device to the user, allowing the user to easily understand and operate the proposed device.

[0735] "Emotional state" refers to the user's psychological state and emotional responses, and is derived from data obtained through analysis of facial expressions and voice.

[0736] "Personalized suggestions" refer to recommendations for information devices that are optimized according to the technical needs and emotional state of individual users.

[0737] To implement this invention, the user's terminal receives input regarding the information device they desire. The terminal acquires the user's voice and facial expressions through a camera and microphone, and analyzes their emotional state. For the analysis, OpenCV is used to process the camera image, speech recognition software is used to process the audio data, and a generative AI model such as TensorFlow is used to integrate this data and infer emotions.

[0738] The server processes data on technical requirements and emotional states received from the user and searches a database to identify the most suitable information device for the user. The database stores the technical specifications and characteristics of each information device. As a result, a list of products that are emotionally suitable for the user and meet their technical requirements is generated and sent to the terminal via the user interface.

[0739] As a concrete example, consider a situation where a user is searching for "products perfect for relaxing time" via their smartphone. In this case, the device determines that the user is in a relaxed state, and the server prioritizes suggesting relaxation goods such as aromatherapy candles and cushions. An example of a prompt to the generating AI model would be input in the format, "What products would you recommend when the user is in a relaxed state?"

[0740] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0741] Step 1:

[0742] The user enters their desired specifications into the terminal. These specifications include technical requirements such as budget and intended use. This data is collected via the terminal's input interface and prepared for transmission to the server.

[0743] Step 2:

[0744] The device captures the user's voice and facial expressions through its camera and microphone. The acquired data is prepared to be sent to the server as primary data for emotion analysis. At this stage, the data is still raw.

[0745] Step 3:

[0746] The server receives the audio data, converts it into text using speech recognition software (e.g., Google Cloud Speech-to-Text), and inputs this text data into a generative AI model for sentiment analysis. Here, the data is processed to extract speech features and obtain information about emotions.

[0747] Step 4:

[0748] The server processes the facial expression data it receives using tools like OpenCV to analyze its characteristics. This analysis helps to estimate the user's current emotional state, and this data is then integrated into a generative AI model for emotion analysis.

[0749] Step 5:

[0750] The server searches the database based on the user's technical skills and emotional state. The search selects the most suitable information devices from those stored in the database, prioritizing them and creating a list. The output here is a list of information devices recommended to the user.

[0751] Step 6:

[0752] The server sends a list of generated information devices to the terminal, which then displays it to the user through a user interface. The list is personalized based on emotions and presented in a format that makes it easy for the user to select.

[0753] Step 7:

[0754] The user selects an information device based on the displayed information. The selected data is then sent back from the terminal to the server, where the final purchase process is managed.

[0755] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0756] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include those described above. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions shown by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0757] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0758] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0759] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0760] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0761] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0762] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0763] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0764] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0765] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0766] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0767] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0768] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0769] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0770] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0771] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0772] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0773] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0774] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0775] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[0776] The following is further disclosed regarding the embodiments described above.

[0777] (Claim 1)

[0778] A means of receiving input from the user,

[0779] Means for transmitting the aforementioned input to a server,

[0780] The server includes means for searching for the optimal information device from the database based on the input,

[0781] Means for displaying the aforementioned search results to the user,

[0782] A system that includes this.

[0783] (Claim 2)

[0784] The system according to claim 1, wherein the server analyzes the input and ranks a plurality of information devices suitable for the user based on priority.

[0785] (Claim 3)

[0786] The system according to claim 1, wherein the server transmits information including the characteristics of an information device to a terminal based on the ranking, and the terminal displays the information on a user interface.

[0787] "Example 1"

[0788] (Claim 1)

[0789] A terminal device in which the user inputs multiple conditions,

[0790] Means for transmitting the aforementioned conditions to a server via communication means,

[0791] The server includes means for identifying an information processing device from a data storage device based on the conditions,

[0792] Means for sorting the aforementioned information processing devices in order of priority based on their suitability for the conditions,

[0793] A means for transmitting the rearranged information to a terminal and making it visible,

[0794] A system that includes this.

[0795] (Claim 2)

[0796] The system according to claim 1, wherein the server analyzes the user's priorities, scores the information processing device, and provides optimized options.

[0797] (Claim 3)

[0798] The system according to claim 1, wherein the server sends the aggregated information, collected using data aggregation means, to a terminal and displays it in a way that the user can intuitively understand.

[0799] "Application Example 1"

[0800] (Claim 1)

[0801] A device for inputting user requirements,

[0802] A device that transmits the above conditions to a network device,

[0803] The network device is a device that searches for a suitable information device from a storage device based on the above conditions,

[0804] A device for displaying the search results on a user device,

[0805] The device is characterized in that the aforementioned user can use it on a multi-purpose commercial platform,

[0806] A system that includes this.

[0807] (Claim 2)

[0808] The system according to claim 1, wherein the network device analyzes the conditions, ranks a plurality of information devices suitable for the user based on priority, and recommends the optimal device.

[0809] (Claim 3)

[0810] The system according to claim 1, wherein the network device transmits information including the characteristics of information devices to the user interface device based on the ranking, and the user interface device presents the information on an interactive display device.

[0811] "Example 2 of combining an emotion engine"

[0812] (Claim 1)

[0813] A means of receiving user requests and conditions,

[0814] A means of analyzing user sentiment data,

[0815] Means for transmitting the aforementioned desired conditions and emotional data to a server,

[0816] A means by which the server searches a database to select information devices based on the user's conditions and emotional state,

[0817] A means for ranking the selected information devices and displaying them based on priority,

[0818] A system that includes this.

[0819] (Claim 2)

[0820] The system according to claim 1, wherein the server analyzes the desired conditions and emotional data to identify an information device suitable for the user's emotional state.

[0821] (Claim 3)

[0822] The system according to claim 1, wherein the server transmits information about ranked information devices to a terminal, and the terminal displays the information visually in a way that is easy for the user to understand.

[0823] "Application example 2 when combining with an emotional engine"

[0824] (Claim 1)

[0825] A means of receiving input from the user,

[0826] Means for analyzing the aforementioned input and the user's emotional state,

[0827] Means for transmitting the analysis results to a server,

[0828] The server includes means for searching for the optimal information device from the database based on the analysis results,

[0829] Means for displaying the search results to the user via a user interface,

[0830] A system that includes this.

[0831] (Claim 2)

[0832] The system according to claim 1, wherein the server ranks a plurality of information devices suitable for the user based on the analysis results, and proposes products that are appropriate to the user's emotional state.

[0833] (Claim 3)

[0834] The system according to claim 1, wherein the server transmits information including the characteristics of the information device based on the ranking, the terminal displays the information on a user interface, and assists the user in purchasing products that match their emotional state. [Explanation of symbols]

[0835] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A device for inputting user requirements, A device that transmits the above conditions to a network device, The network device is a device that searches for a suitable information device from a storage device based on the above conditions, A device for displaying the search results on a user device, The device is characterized in that the aforementioned user can use it on a multi-purpose commercial platform, A system that includes this.

2. The system according to claim 1, wherein the network device analyzes the conditions, ranks a plurality of information devices suitable for the user based on priority, and recommends the optimal device.

3. The system according to claim 1, wherein the network device transmits information including the characteristics of information devices to the user interface device based on the ranking, and the user interface device presents the information on an interactive display device.

Images