System

Abstract

To provide a system.SOLUTION: A system includes: providing means for providing a database storing the manuals of home appliances usable by a user, update information of the home appliances, and the support deadlines of the home appliances, and by inputting a specific prompt text into a generative AI model, searching for manual information, which is a response about the usages of the home appliances and the setup methods of the home appliances that the user inquired about and providing a terminal of the user with the searched information; a feeling engine which recognizes the feeling of the user; adjusting means for adjusting the information providing method on the basis of the feeling; and notification means for notifying the user of information indicating that the support deadline of a user-owned appliance is approaching when the support deadline is approaching by referencing the database.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Currently, there is no system that centrally manages online information and various manuals for individual home appliances and other devices, and provides personalized support based on this information. There is also a lack of methods to properly grasp information such as update information and support expiration dates, and to hedge security and warranty risks. Furthermore, it is difficult to provide services to people of all ages and genders, including those with low IT literacy, using natural language. A system that can solve these issues is needed. [Means for solving the problem]

[0005] As a means for solving this problem, the system of the present invention includes a database that stores manuals for home appliances that can be used by a user, update information for the home appliances, and support expiration dates for the home appliances; a provision means that searches the database for manual information that is a response to the user's inquiry about how to use or set up the home appliance by inputting a specific prompt sentence into a generative AI model, and provides the searched information to the user's terminal; an emotion engine that recognizes the user's emotions; an adjustment means that adjusts the method of providing the information based on the emotion; and a notification means that, by referring to the database, notifies the user of information indicating that the support expiration date is approaching for the home appliance owned by the user. [Brief explanation of the drawings]

[0006] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10]1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 2 is a sequence diagram showing a flow of processing in the data processing system according to the first embodiment of the first form example. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Embodiment 1. [Figure 13] FIG. 10 is a sequence diagram showing a processing flow of a data processing system in a second embodiment of the second form example. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Embodiment Example 2. [Figure 15] FIG. 10 is a sequence diagram showing the flow of processing in a data processing system according to a third embodiment of the third embodiment. [Figure 16] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Embodiment 3. [Figure 17] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the first embodiment of the first form example when an emotion engine is combined. [Figure 18] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Form Example 1 when an emotion engine is combined. [Figure 19] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the second embodiment of the second form example when an emotion engine is combined. [Figure 20] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Form Example 2 when an emotion engine is combined. [Figure 21] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the third embodiment of the third form example when an emotion engine is combined. [Figure 22] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Form Example 3 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0007] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0008] First, the terms used in the following description will be explained.

[0009] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, the processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), or a TPU (TENSOR PROCESSING UNIT (registered trademark)).

[0010] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0011] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0012] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0013] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0014] [First embodiment]

[0015] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0016] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0017] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0018] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44.

[0019] The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0020] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0021] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0022] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0023] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0024] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0025] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0026] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0027] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0028] "Example 1"

[0029] This embodiment of the present invention includes a database that stores various manuals for home appliances owned by individuals in addition to online information. This database centrally manages manual information for home appliances owned by customers and provides personalized support based on this information. For example, when a customer wants to know how to set the temperature of a refrigerator, the database searches for the relevant manual information and provides it to the customer.

[0030] "Example 2"

[0031] Furthermore, this embodiment of the present invention is equipped with a function for reading information such as update information and support expiration dates. This function periodically checks the information stored in the database, such as update information and support expiration dates, and acquires the relevant information. For example, if the support expiration date of a home appliance owned by a customer is approaching, the information is notified to the customer. This hedges against security and warranty risks.

[0032] "Example 3"

[0033] Furthermore, this embodiment of the present invention has a function that uses natural language to provide services to people of all ages and genders, including those with low IT literacy. This function analyzes inquiries from customers in natural language and provides appropriate manual information. For example, if a customer inquires, "I want to lower the temperature in my refrigerator," the system analyzes the inquiry and provides manual information on how to set the refrigerator temperature.

[0034] The processing flow of each embodiment will be described below.

[0035] "Example 1"

[0036] Step 1: Store the manual information for the home appliances owned by the customer in a database.

[0037] Step 2: A customer inquires about how to operate a particular appliance.

[0038] Step 3: Search the database for the relevant manual information.

[0039] Step 4: Provide search results to the customer.

[0040] "Example 2"

[0041] Step 1: Regularly check the information stored in the database, such as update information and support expiration dates.

[0042] Step 2: If there is any relevant information, obtain that information.

[0043] Step 3: Notify the customer of the information obtained.

[0044] "Example 3"

[0045] Step 1: Accept natural language inquiries from customers.

[0046] Step 2: Analyze the inquiry and search for the relevant manual information.

[0047] Step 3: Provide search results to the customer.

[0048] Example 1

[0049] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0050] Modern homes contain a wide variety of home appliances, and in order to understand how to operate and set up each one, users must refer to the manuals for each product. However, these manuals are often provided in paper form, which means there is a risk of them being lost or damaged. Furthermore, even when searching for information on the Internet, it is difficult for users to obtain accurate information, as unreliable and inaccurate information is mixed in. Furthermore, users with low IT literacy find it even more difficult to find appropriate information. There is a need for a system that can solve these problems and allow users to easily obtain accurate instructions for operating home appliances.

[0051] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0052] In this invention, the server includes means for storing various manuals for individual home appliances and other items owned by individuals in addition to online information, means for providing personalized support to the customer, means for reading information such as update information and support expiration dates, means for hedging security and warranty risks, means for providing services using natural language to anyone, regardless of age or gender, including those with low IT literacy, means for reducing opportunity losses to related suppliers or enabling new proposals through reverse auctions, means for providing an interface through which users can search for operating instructions for home appliances, means for sending user search queries to the server, means for searching for relevant manual information from a database, means for providing appropriate support information to users based on the search results, and means for providing information based on prompt sentences using a generative AI model.This allows users to easily and accurately obtain operating instructions for home appliances.

[0053] "Online information" refers to data and content accessible via the Internet.

[0054] "Home appliances" refers to electrical appliances used in the home.

[0055] "Manual" refers to an instruction manual that describes how to operate and set up a product.

[0056] A "database" refers to a system that systematically organizes and stores information so that it can be searched and retrieved efficiently.

[0057] "Support" means assistance and advice to enable a User to use the Product properly.

[0058] "Update Information" means new versions or modifications of products or software.

[0059] "Support Life" refers to the period for which support is provided for a product.

[0060] "Security" refers to measures taken to protect information and systems from unauthorized access and data leakage.

[0061] "Warranty" refers to a manufacturer's promise of product quality or performance.

[0062] "Hedging risk" means taking measures to prevent or mitigate potential risks.

[0063] "Natural language" refers to a language that humans use on a daily basis.

[0064] "IT literacy" refers to the ability to understand and appropriately utilize information technology.

[0065] "Supplier" refers to a company or individual that provides a product or service.

[0066] "Opportunity cost" refers to benefits that are not obtained by not making a certain choice.

[0067] A "reverse auction" refers to an auction format in which buyers state a price and sellers compete according to that price.

[0068] "Interface" refers to the means or method by which a user interacts with a system.

[0069] A "search query" refers to a keyword or phrase that a user enters to search for information.

[0070] A "generative AI model" refers to an algorithm or system that uses artificial intelligence to generate and process data.

[0071] A "prompt" refers to an instruction or question input to a generative AI model.

[0072] This invention is a system equipped with a database that stores not only online information but also various manuals for home appliances owned by individuals. This system is designed to enable users to easily search for and obtain accurate information on how to operate home appliances.

[0073] Hardware and software used

[0074] Hardware: Servers, devices (PCs, smartphones, tablets, etc.)

[0075] Software: Database management systems (e.g., MySQL®, PostgreSQL), web servers (e.g., Apache®, Nginx), generative AI models (e.g., OpenAI® GPT-3®)

[0076] System configuration

[0077] server

[0078] The server manages a database that stores online information and manuals for home appliances owned by customers. When a user wants to know how to operate a particular appliance, the server searches the database for the relevant manual information and provides the user with appropriate support information based on the search results. The server also uses a generative AI model to provide information based on prompts.

[0079] Terminal

[0080] The terminal provides an interface for users to search for operating instructions for home appliances. It sends the search query entered by the user to the server and displays the manual information received from the server to the user. The terminal operates on devices such as smartphones, PCs, and tablets.

[0081] User

[0082] A user uses a terminal to search for how to operate a home appliance. For example, if the user wants to know how to set the temperature on a refrigerator, the user enters "how to set the temperature on a refrigerator." The user operates the home appliance based on the information displayed on the terminal.

[0083] Specific examples

[0084] Example 1: Want to know how to set the refrigerator temperature?

[0085] 1. The user opens the app on their smartphone and types in "How to set the refrigerator temperature."

[0086] 2. The device sends this search query to the server, specifically by sending the data to the " / search" endpoint using an HTTP POST request.

[0087] 3. The server searches the database for the manual information for the corresponding refrigerator by executing the SQL query "SELECT FROM manuals WHERE appliance='refrigerator' AND topic='temperature setting'".

[0088] 4. The server sends the search results in JSON format to the device. Specifically, it returns data like this as an HTTP response: {"appliance": "Refrigerator", "topic": "Temperature setting", "content": "How to set the refrigerator temperature..."}.

[0089] 5. The device displays the received information to the user. Specifically, it displays the text "To set the refrigerator temperature..." on the app's UI.

[0090] 6. The user sets the refrigerator temperature based on the displayed information. Specifically, the user adjusts the temperature using the refrigerator's control panel.

[0091] Example prompts for generative AI models

[0092] How do I set the temperature in my refrigerator?

[0093] When this prompt sentence is input into the generative AI model, the AI ​​searches for the relevant manual information from the database and provides the user with appropriate support information.

[0094] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0095] Step 1:

[0096] A user uses a device to search for how to operate a home appliance. Specifically, they open an application on their smartphone or PC and enter a search query such as "how to set the refrigerator temperature" in the search bar. The entered search query becomes the input data for the device.

[0097] Step 2:

[0098] The device sends the search query entered by the user to the server. Specifically, it sends data to the " / search" endpoint using an HTTP POST request. At this time, the search query is sent to the server as part of the request. The input data is the search query, and the output data is the request to the server.

[0099] Step 3:

[0100] The server searches the database based on the received search query. Specifically, it uses an SQL query to retrieve the relevant manual information from the database. For example, it executes the SQL query "SELECT FROM manuals WHERE appliance="refrigerator" AND topic="temperature setting". The input data is the search query, and the output data is the relevant manual information.

[0101] Step 4:

[0102] The server sends the manual information retrieved from the database to the terminal in JSON format. Specifically, it returns data like this as an HTTP response: {"appliance": "Refrigerator", "topic": "Temperature setting", "content": "How to set the refrigerator temperature..."}. The input data is the manual information retrieved from the database, and the output data is a JSON-formatted response.

[0103] Step 5:

[0104] The terminal displays the manual information received from the server to the user. Specifically, it displays the text "To set the refrigerator temperature..." on the application UI. The input data is the response from the server, and the output data is the information displayed to the user.

[0105] Step 6:

[0106] The user operates the appliance based on the information displayed on the terminal. Specifically, the refrigerator's operation panel is used to adjust the temperature. The input data is the manual information displayed on the terminal, and the output data is the setting changes of the appliance.

[0107] (Application example 1)

[0108] Next, a description will be given of Application Example 1 of Embodiment Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0109] Modern homes have a wide variety of home appliances, each of which requires its own corresponding manual. However, these manuals are often provided in paper form, which means there is a risk of them being lost or damaged. Furthermore, when a user needs to quickly learn how to operate or troubleshoot a specific home appliance, it can take a long time to find the relevant manual. Furthermore, for users with low IT literacy, searching for information on the Internet is difficult in itself. To solve these problems, a system is needed that centrally manages home appliance manual information and provides it to users quickly and easily.

[0110] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0111] In this invention, the server includes: means for storing various manuals for individually owned home appliances and the like in addition to online information; means for providing customer-oriented support; means for reading information such as update information and support expiration dates; means for hedging security and warranty risks; means for providing services using natural language to anyone, regardless of age or gender, including those with low IT literacy; means for reducing opportunity losses to related suppliers or for enabling new proposals through reverse auctions; means for users to search for manual information for specific home appliances via an application installed on their smartphones and provide the relevant information; and means for quickly providing users with manual information retrieved from the database. This allows users to easily search for home appliance manual information using their smartphones and quickly obtain the information they need.

[0112] "Online information" is a general term for data and content that can be accessed via the Internet.

[0113] "Home appliances" is a general term for electrical appliances used in the home.

[0114] A "manual" is a document that describes how to use a product and operating procedures.

[0115] A database is a collection of information that is systematically organized and stored so that it can be efficiently searched and used.

[0116] "Support" is a general term for services and features that assist users in using the product properly.

[0117] "Update Information" means information about the latest changes and additions to a product or software.

[0118] "Support period" means the period during which support is provided for a product or service.

[0119] "Security" refers to the means and measures taken to protect information and systems from unauthorized access and data leakage.

[0120] "Warranty" is a system that guarantees the quality and performance of products and services for a certain period of time.

[0121] "Hedging risk" means taking measures to reduce or avoid a predicted risk.

[0122] "Natural language" refers to the language used by humans on a daily basis, not a specific programming language or technical term.

[0123] "IT literacy" refers to the ability to understand and appropriately utilize information technology.

[0124] "Supplier" means a supplier or trader of products or services.

[0125] "Opportunity cost" refers to benefits or results that are not obtained because a certain choice is not made.

[0126] A "reverse auction" is an auction format in which a buyer presents desired conditions and multiple sellers bid lower to meet those conditions.

[0127] A "smartphone" is a highly functional mobile phone that can connect to the Internet and use applications.

[0128] An "application" is a software program that provides a particular function or service.

[0129] "User" means a person who uses a product or service.

[0130] As an embodiment of the present invention, a "smart home appliance support app" installed on a smartphone is used. A specific implementation method thereof will be described below.

[0131] System Configuration

[0132] This system uses the following hardware and software:

[0133] Hardware: Smartphone

[0134] Software: Flask (web framework), SQLite (database management system)

[0135] Program processing

[0136] The server uses the Flask framework to build a web application. It uses SQLite as the database to store home appliance manual information. When a user searches for manual information for a specific home appliance, they send a request to the server via a smartphone application. The server searches the database for the relevant information and provides it to the user.

[0137] Data processing and calculation

[0138] Data processing: Receives a request from the user and searches the database for the relevant manual information.

[0139] Data Calculation: Uses SQL queries to retrieve information from a database and return it to the user.

[0140] Specific examples

[0141] If a user wants to know how to set the temperature on a refrigerator, they open the smartphone application and type in "how to set the temperature on a refrigerator." The application sends this request to the server, which then searches the database for the relevant manual information and provides it to the user.

[0142] Prompt Sentence Examples

[0143] How do I set the temperature in my refrigerator?

[0144] In this way, users can easily search for manual information for home appliances using their smartphones and quickly obtain the information they need.

[0145] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0146] Step 1:

[0147] A user opens a smartphone application and inputs a prompt to search for manual information for a specific appliance. For example, they input, "How do I set the temperature on my refrigerator?" This input is sent to the application.

[0148] Step 2:

[0149] The device (smartphone application) receives the user's input and sends a request to the server. This request includes the prompt text entered by the user. Specifically, it is sent to the server as an HTTP request.

[0150] Step 3:

[0151] The server analyzes the received request and extracts search keywords from the prompt. For example, it extracts the keywords "refrigerator" and "temperature setting method." This analysis may use natural language processing techniques.

[0152] Step 4:

[0153] The server executes an SQL query based on the extracted keywords to search for the corresponding manual information. The database stores manual information for home appliances. The corresponding manual information is retrieved as a result of the SQL query execution.

[0154] Step 5:

[0155] The server formats the retrieved manual information and generates a response to return to the user. This response contains the specific manual information the user is looking for. For example, it may contain detailed instructions on how to set the refrigerator temperature.

[0156] Step 6:

[0157] The device (smartphone application) receives the response from the server and displays it to the user, who can then check the relevant manual information on the application screen.

[0158] Step 7:

[0159] The user operates the appliance based on the displayed manual information. For example, to change the temperature setting of a refrigerator. In this way, the user can quickly obtain the necessary information and operate the appliance appropriately.

[0160] Example 2

[0161] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0162] Many consumers today have difficulty understanding update information and support expiration dates for their electronic devices, which can lead to security and warranty risks. Furthermore, users with low IT literacy find it even more difficult to properly manage this information. Furthermore, this can result in opportunity losses for suppliers. To solve these issues, a system is needed that notifies users of update information and support expiration dates in a timely manner.

[0163] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes: a means for storing various instruction manuals for electronic devices owned by individuals in addition to online information; a means for providing personalized support to the customer; a means for reading information such as update information and support expiration dates; a means for reducing security and warranty risks; a means for providing information in natural language to anyone, regardless of age or gender, including those with low IT literacy; a means for reducing opportunity losses to related suppliers or enabling new proposals through reverse auctions; a means for periodically checking information stored in a database and acquiring relevant information; a means for analyzing the acquired information and extracting relevant information; and a means for generating and transmitting notifications based on the extracted information. This allows users to properly understand update information and support expiration dates for their electronic devices and reduce security and warranty risks. It also reduces opportunity losses for suppliers and increases opportunities for new proposals.

[0164] "Online information" refers to data and content accessible via the Internet.

[0165] "Electronic devices" refer to devices or equipment that operate using electricity.

[0166] An "instruction manual" refers to a document that describes how to use and precautions for electronic devices and other products.

[0167] "Customer-oriented support" refers to providing appropriate support according to the user's needs and situation.

[0168] "Update Information" refers to new versions or modifications of software or hardware.

[0169] "Support Period" refers to the period for which warranty or support is provided for a product or service.

[0170] "Security risk" refers to the possibility that information or systems may be exposed to threats such as unauthorized access or data leakage.

[0171] "Warranty risk" refers to the possibility that a product or service will malfunction or fail within the warranty period.

[0172] "Information technology literacy" refers to the ability to understand and use information technology appropriately.

[0173] "Supplier" refers to a company or individual that provides a product or service.

[0174] "Opportunity loss" refers to profits or results that are not obtained because appropriate responses or actions were not taken.

[0175] A "reverse auction" is an auction format in which the seller lowers the price.

[0176] "Database" refers to a system for efficiently managing, searching, and updating data.

[0177] "Analysis" refers to examining data in detail to find meaning and patterns.

[0178] "Notification" refers to a message or alert that informs a user of specific information.

[0179] This invention is a system for appropriately managing update information and support expiration dates for electronic devices owned by users, thereby reducing security risks and warranty risks. This system is composed of elements such as a server, a terminal, and a user.

[0180] Server Roles

[0181] The server uses the following hardware and software to manage and process data.

[0182] Hardware: Server equipment with a powerful processor, sufficient memory, and storage

[0183] Software: Database management systems such as MySQL or PostgreSQL, programming languages ​​such as Python or Java, and notification services such as SendGrid or Firebase Cloud Messaging

[0184] The server periodically accesses the database to check information such as update information, support expiration dates, etc. For example, the server checks the database at 2:00 AM every day to obtain update information or records whose support expiration dates are approaching.

[0185] The server then analyzes the information and extracts relevant information. This process is performed using a Python script that uses the pandas library to process the data. For example, it extracts information about appliances whose support period expires within the next 30 days.

[0186] Finally, the server uses the extracted information to generate and send notifications to customers, using SendGrid's API to generate email content and send it to customers, including details about the appliances that are nearing the end of their support life.

[0187] Device Role

[0188] The device refers to the electronic device or computer owned by the user, and is responsible for receiving notifications from the server. The device displays the notifications sent from the server using an email client or push notification application.

[0189] User Roles

[0190] The user receives the notification from the server and takes necessary action, such as updating an appliance whose support period is approaching or applying for an extension of the warranty.

[0191] Specific examples

[0192] For example, if a customer owns a refrigerator and their support is due to expire in 30 days, the server checks the database to retrieve that information, then runs a Python script to extract the relevant information and uses SendGrid to send an email notification to the customer.

[0193] Example prompts for generative AI models

[0194] Describe a system that notifies customers when their appliances are nearing the end of their support life. Include detailed instructions for periodically checking a database, extracting the information, and generating and sending the notification. Include the names of the hardware and software involved.

[0195] In this way, the system can notify users of important updates and support expiration dates, reducing security and warranty risks.

[0196] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0197] Step 1: Regularly check your database

[0198] The server periodically accesses the database to check information such as update information, support expiration dates, etc. This process is scheduled to be executed, for example, at 2:00 AM every day.

[0199] Input: Database connection information, query

[0200] Output: Records with upcoming renewal information or support expiration

[0201] What happens: The server uses a cron job to run a Python script called db_check.py every day at 2 AM. db_check.py connects to a MySQL database and runs the following query:

[0202] sql

[0203] SELECT FROM support_info WHERE support_end_date <= CURDATE() + INTERVAL 30 DAY;

[0204] Step 2: Extracting information

[0205] The server parses the information retrieved from the database and extracts the relevant information, using a Python script.

[0206] Input: Records retrieved from the database

[0207] Output: Information on appliances whose support period expires within the next 30 days

[0208] What happens: The server runs a Python script called data_extract.py, which loads the retrieved data into a pandas data frame. The data frame is then filtered to extract information about appliances whose support period expires within the next 30 days:

[0209] python

[0210] import pandas as pd

[0211] df = pd.read_sql(query_result, connection)

[0212] filtered_df = df[df['support_end_date'] <= pd.Timestamp.now() + pd.DateOffset(days=30)]

[0213] Step 3: Generate and send notifications

[0214] The server uses the extracted information to generate and send notifications to customers, using SendGrid's API.

[0215] Input: Extracted appliance information, customer email address

[0216] Output: Notification email sent to customer

[0217] What happens: The server runs a Python script called send_notification.py, which uses SendGrid's API to send an email. The email content is generated as follows:

[0218] python

[0219] import sendgrid

[0220] from sendgrid.helpers.mail import Mail

[0221] sg = sendgrid.SendGridAPIClient(api_key='YOUR_SENDGRID_API_KEY')

[0222] for index, row in filtered_df.iterrows():

[0223] message = Mail(

[0224] from_email='noreply@example.com',

[0225] to_emails=row['customer_email'],

[0226] subject='Support expiration notice',

[0227] plain_text_content=f"The support period for your appliance ({row['product_name']}) will expire on {row['support_end_date']}."

[0228] )

[0229] sg.send(message)

[0230] In this way, the system can notify users of important updates and support expiration dates, reducing security and warranty risks.

[0231] (Application example 2)

[0232] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0233] Many users today have difficulty understanding update information and support expiration dates for their home appliances and devices, which increases security and warranty risks. Furthermore, users with low IT literacy find it even more difficult to properly manage this information. Furthermore, this can result in opportunity losses for related suppliers.

[0234] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: a means for storing various manuals for individual home appliances and the like in addition to online information; a means for providing personalized support to the customer; a means for reading information such as update information and support expiration dates; a means for hedging security and warranty risks; a means for providing services using natural language to anyone, regardless of age or gender, including those with low IT literacy; a means for reducing opportunity losses to related suppliers or enabling new proposals through reverse auctions; a means for accessing a database and acquiring update information and support expiration dates; a means for notifying users based on the acquired information; and a means for evaluating security risks based on the update information and support expiration dates and sending emergency notifications. This allows users to properly manage update information and support expiration dates for their devices and software and prevent security and warranty risks.

[0235] "Online information" refers to data and materials that can be accessed via the Internet.

[0236] "Home appliances" is a general term for electrical appliances used in the home.

[0237] A "manual" is a document that describes how to use a product or service and the operating procedures.

[0238] A "database" is a system for efficiently managing, searching, and updating data.

[0239] "Update Information" means information about new versions and patches for software or devices.

[0240] "Support end date" is the date on which manufacturer or provider support for a product or service ends.

[0241] "Security risk" refers to the possibility that information systems and devices may be exposed to threats such as unauthorized access and data leakage.

[0242] "Warranty risk" refers to the risk that arises when the warranty period for a product or service expires.

[0243] "Natural language" refers to the language used by humans on a daily basis, often translated into a form that is easy for computers to understand.

[0244] "IT literacy" refers to the ability to understand and use information technology appropriately.

[0245] "Supplier" means a company or individual that provides products or services.

[0246] "Opportunity cost" refers to the potential gain lost by not making a choice.

[0247] A "reverse auction" is a type of auction in which a buyer submits a price and multiple sellers compete based on that price.

[0248] A "notification" is a message or alert that informs the user of specific information.

[0249] "Emergency notifications" are messages or alerts that inform users of important information that requires immediate action.

[0250] As an embodiment of the present invention, the following system is constructed.

[0251] System Overview

[0252] This system manages update information and support expiration dates for devices and software owned by users, and prevents security and warranty risks. The system consists of a server, user terminals (such as smartphones and smart glasses), and a database.

[0253] Program processing

[0254] The server performs the process using the following means.

[0255] 1. Database access method:

[0256] The server accesses the database to obtain update information and support expiration dates for devices and software registered by the user. This database also stores manual information for the home appliances and devices owned by the user.

[0257] 2. Means of notification:

[0258] The server notifies the user based on the acquired update information and support expiration date. Notifications are sent via push notification or email. For example, if the support expiration date is approaching, the server sends the user a message saying, "Your device's support expiration date is approaching."

[0259] 3. Security Risk Assessment Tools:

[0260] The server evaluates security risks based on update information and support expiration dates. If the risk is deemed high, an emergency notification is sent. For example, if an important security patch has not been applied, a message is sent to the user stating, "There is an important security update for your device. Please update immediately."

[0261] Hardware and software used

[0262] Hardware:

[0263] Server: Server for managing the database and sending notifications

[0264] User devices: smartphones, smart glasses, etc.

[0265] software:

[0266] Database management systems (e.g., SQLite)

[0267] Email sending library (e.g. smtplib)

[0268] Push notification service (e.g. Firebase Cloud Messaging)

[0269] Specific examples

[0270] For example, if a user's smartphone's support expiration date is approaching within 30 days, the system will send a notification like this:

[0271] Prompt Sentence Examples

[0272] If a user's smartphone is within 30 days of reaching the end of its support life, send them a notification like this:

[0273] "Your device [device name] is nearing the end of its support life [support end date]."

[0274] In this way, users can keep track of update information and support expiration dates for their devices and software, and prevent security and warranty risks before they occur.

[0275] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0276] Step 1:

[0277] The server periodically accesses the database to retrieve update information and support expiration dates for devices and software registered by the user. User IDs and device IDs are required as input, and update information and support expiration dates for the corresponding devices and software are obtained as output. This process involves executing a database query to extract the required information.

[0278] Step 2:

[0279] The server analyzes the acquired update information and support expiration dates and determines whether or not the user needs to be notified. The input is the update information and support expiration dates acquired in step 1, and the output is a list of devices and software that require notification. In this process, the update information and support expiration dates are compared to evaluate whether they meet the notification criteria.

[0280] Step 3:

[0281] The server notifies the user of information about devices and software that are determined to require notification. The input is the list of devices and software that require notification obtained in step 2, and the output is the notification message to be sent to the user. This process uses an email sending library or push notification service to send the notification to the user.

[0282] Step 4:

[0283] The server evaluates the security risk based on the update information and support expiration date. The input is the update information and support expiration date obtained in step 1, and the output is the security risk assessment result. In this process, an algorithm is run to analyze the update information and support expiration date and evaluate the risk level.

[0284] Step 5:

[0285] If the server determines that the risk is high, it sends an emergency notification to the user. The security risk assessment result obtained in step 4 is required as input, and the emergency notification message to be sent to the user is obtained as output. This process uses an email sending library or push notification service to send the emergency notification.

[0286] Step 6:

[0287] The user takes necessary steps for updates or support based on the received notifications or emergency notifications. The input is the notification message sent from the server, and the output is the update or support procedure to be carried out by the user. In this process, the user checks the notification content and takes appropriate action.

[0288] Example 3

[0289] Next, a description will be given of a third embodiment of the third embodiment. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0290] Providing support for today's diverse range of electronic devices is difficult to do efficiently and effectively due to differences in users' IT literacy and the scattering of manual information for each device. While there is a demand for prompt provision of appropriate manual information in response to customer inquiries, this has been difficult to achieve with conventional systems. Furthermore, a means is needed to reduce opportunity losses for related suppliers and enable new proposals.

[0291] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[0292] In this invention, the server includes: a means for storing various manuals for electronic devices owned by individuals in addition to online information; a means for providing personalized support to the customer; a means for reading information such as update information and support expiration dates; a means for hedging security and warranty risks; a means for providing support using natural language to anyone, regardless of age or gender, including those with low IT literacy; a means for analyzing inquiries from customers in natural language and providing appropriate manual information; a means for analyzing inquiries using a generative AI model; a means for searching for manual information from a database based on the analysis results; and a means for reducing opportunity losses to related suppliers or enabling new proposals through reverse auctions. This makes it possible to provide prompt and appropriate support regardless of the user's IT literacy.

[0293] "Online information" refers to data and content accessible via the Internet.

[0294] "Electronic devices" refer to devices or equipment that operate using electricity.

[0295] "Manual" refers to a document that describes how to use or operate a particular product or service.

[0296] "Support" means assistance and advice provided to Customer in using a Product or Service.

[0297] "Updates" means recent changes or additions to products or services.

[0298] "Support Period" refers to the period during which support is provided for a product or service.

[0299] "Security" refers to measures to protect information and systems from unauthorized access and attacks.

[0300] "Warranty" means any guarantee of quality or performance provided for a product or service.

[0301] "Natural language" refers to a language that humans use on a daily basis.

[0302] "IT literacy" refers to the ability to understand and use information technology appropriately.

[0303] A "generative AI model" refers to a model that uses artificial intelligence to analyze data and generate results.

[0304] A "prompt sentence" refers to an instruction sentence to be input into a generative AI model.

[0305] A "database" refers to a system for systematically organizing data and efficiently searching and managing it.

[0306] "Supplier" refers to a company or individual that provides a product or service.

[0307] "Opportunity loss" refers to the loss that occurs when a business opportunity is missed.

[0308] A "reverse auction" is an auction format in which a buyer presents their desired terms and multiple sellers make competitive bids.

[0309] The present invention provides a system that allows a user to make inquiries about the operation and settings of an electronic device in natural language and provides appropriate manual information in response to the inquiries. Specific embodiments of this system will be described below.

[0310] Server Roles

[0311] The server plays a central role in receiving and analyzing natural language queries from users and providing appropriate manual information. The server uses the following hardware and software:

[0312] Hardware: A server machine with a powerful processor, sufficient memory, and storage.

[0313] Software: Generative AI models (e.g., OpenAI's GPT-4®), database management systems (e.g., MySQL)

[0314] When the server receives a user inquiry, it analyzes the inquiry using the generative AI model. Based on the analysis results, it searches for appropriate manual information from the database and provides it to the user.

[0315] Device Role

[0316] A terminal is a device that allows users to enter queries in natural language and receive and display the results. The terminal uses the following hardware and software:

[0317] Hardware: Personal computers, smartphones, tablets, etc.

[0318] Software: Web browser, dedicated application

[0319] The terminal transmits the query entered by the user to the server, receives the analysis results and manual information returned from the server, and displays them.

[0320] User Roles

[0321] Users can use a terminal to input inquiries in natural language, check the provided manual information, and perform operations. Users do not need special IT literacy and can make inquiries in everyday language.

[0322] Specific examples

[0323] For example, if a user types "I want to lower the refrigerator temperature" into the device, the device sends this query to the server. The server uses a generative AI model to analyze the query and search a database for manual information on how to set the refrigerator temperature. The server sends the search results back to the device, which then displays the information to the user.

[0324] Prompt Sentence Examples

[0325] An example of a prompt sentence to parse the query "I want to lower the temperature of the refrigerator" and provide appropriate manual information:

[0326] User inquiry: "I want to lower the temperature in my refrigerator."

[0327] Prompt for generative AI model: "The user wants to lower the refrigerator temperature. Please provide the manual information on how to set the refrigerator temperature."

[0328] By inputting this prompt sentence into the generative AI model, appropriate manual information can be acquired and provided to the user. The flow of the identification process in the third embodiment will be described with reference to FIG.

[0329] Step 1:

[0330] User query input

[0331] The user inputs a query in natural language into an input field on the terminal, for example, "I want to lower the temperature of the refrigerator."

[0332] Input: User's natural language query

[0333] Output: Query data sent to the terminal

[0334] Specific operation: The user uses the device's keyboard or touch screen to input the inquiry.

[0335] Step 2:

[0336] Submit an inquiry

[0337] The terminal transmits a natural language query entered by the user to the server.

[0338] Input: User query data

[0339] Output: HTTP request sent to the server

[0340] Specific operation: The terminal formats the query data as an HTTP request and sends it to the server's API endpoint.

[0341] Step 3:

[0342] Receiving inquiries

[0343] The server receives a natural language inquiry sent from the terminal.

[0344] Input: HTTP request from the terminal

[0345] Output: Query data to be analyzed

[0346] Specific operation: The server receives an HTTP request and extracts the query content.

[0347] Step 4:

[0348] Query Analysis

[0349] The server uses the generative AI model to analyze the received query.

[0350] Input: Query data to be analyzed

[0351] Output: Analysis results (intention of inquiry and related information)

[0352] Specific operation: The server inputs the query content into the generative AI model as a prompt sentence and obtains the analysis results.

[0353] Step 5:

[0354] Searching for manual information

[0355] The server searches the database for appropriate manual information based on the analysis results.

[0356] Input: Analysis results

[0357] Output: Searched manual information

[0358] Specific operation: The server executes a database query using the analysis result as a key to obtain related manual information.

[0359] Step 6:

[0360] Providing manual information

[0361] The server transmits the retrieved manual information to the terminal for provision to the user.

[0362] Input: Searched manual information

[0363] Output: HTTP response sent to the device

[0364] Specific operation: The server formats the acquired manual information as an HTTP response and sends it to the terminal.

[0365] Step 7:

[0366] Receive analysis results and manual information

[0367] The terminal receives the analysis results and manual information returned from the server.

[0368] Input: HTTP response from the server

[0369] Output: Manual information displayed to the user

[0370] Specific operation: The terminal receives the HTTP response, analyzes the contents, and displays them.

[0371] Step 8:

[0372] Viewing manual information

[0373] The terminal displays the received manual information to the user.

[0374] Input: Parsed manual information

[0375] Output: Information displayed to the user

[0376] Specific operation: The terminal displays the received information on a GUI (graphical user interface).

[0377] Step 9:

[0378] Executing an operation

[0379] The user performs the operation according to the displayed manual information.

[0380] Input: Displayed manual information

[0381] Output: User operation result

[0382] Specific operation: The user operates the refrigerator temperature setting button to lower the temperature.

[0383] (Application example 3)

[0384] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0385] Today's consumers want to quickly and accurately obtain information about products and services in physical stores. However, traditional methods require direct inquiries to store staff, which may not be able to respond or provide the appropriate information. There is also a need for a method to easily provide information to customers with low IT literacy. Furthermore, there is a lack of systems that provide appropriate manuals and guidance information in response to customer questions in stores.

[0386] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means. In this invention, the server includes a means for storing various manuals for individually owned home appliances and the like in addition to online information, a means for providing support tailored to the customer, a means for reading information such as update information and support expiration dates, a means for hedging security and warranty risks, a means for providing information using natural language that can be provided to people of all ages and genders, including those with low IT literacy, a means for reducing opportunity losses for related suppliers, a means for customers in physical stores to input questions in natural language using their smartphones and receive appropriate manual information and in-store guidance information, and a means for generating appropriate answers to customer questions using a generative AI model. This enables customers in physical stores to obtain information quickly and accurately.

[0387] "Online information" is a general term for data and content that can be accessed via the Internet.

[0388] "Home appliances" is a general term for electrical appliances used in the home.

[0389] A "manual" is a document that explains how to use a product or service and provides instructions on how to use it.

[0390] "Customer-oriented support" refers to providing appropriate assistance according to the customer's needs and situation.

[0391] "Updates" means the latest information or changes regarding products or services.

[0392] "Support Life" refers to the period for which support is provided for a product or service.

[0393] "Security" refers to protecting information and systems from unauthorized access and attacks.

[0394] "Hedging warranty risk" refers to mitigating the risks associated with warranties on products and services.

[0395] "Natural language" refers to the language used by humans on a daily basis, not a specific programming language or technical term.

[0396] "IT literacy" refers to the ability to understand and effectively use information technology.

[0397] "Supplier" refers to a company or individual that provides products or services.

[0398] "Reducing opportunity loss" means not missing out on business opportunities.

[0399] A "reverse auction" refers to an auction format in which a buyer submits a price and multiple sellers compete based on that price.

[0400] "Brick and Mortar Store" means a retailer that has a physical location.

[0401] A "smartphone" refers to a mobile phone that can connect to the Internet and use applications.

[0402] "Entering a question in natural language" refers to a user entering a question using everyday language.

[0403] A "generative AI model" refers to an algorithm that uses artificial intelligence to generate appropriate answers or information from data.

[0404] "Appropriate manual information" refers to manual content that is accurate and useful in answering a user's question.

[0405] "In-store guidance information" refers to information about the location of products and service locations within a physical store.

[0406] As an embodiment of the present invention, a system is constructed in which customers in a physical store input questions in natural language using a smartphone and are provided with appropriate manual information and in-store guidance information. A specific embodiment of this system is described below.

[0407] System Configuration

[0408] This system uses the following hardware and software:

[0409] Hardware: Smartphones, servers

[0410] Software: Python, spaCy, OpenAI GPT-3

[0411] Program processing

[0412] The server includes the following means:

[0413] 1. A means of storing various manuals for personal home appliances, etc., in addition to online information:

[0414] The server stores the manual information in a database and searches and retrieves it as needed.

[0415] 2. Ways to provide customer-focused support:

[0416] The server analyzes the customer's question in natural language and provides appropriate manual information and guidance information.

[0417] 3. How to read information such as update information and support expiration date:

[0418] The server periodically checks the information stored in the database, such as update information and support expiration dates, and acquires the relevant information.

[0419] 4. Means of hedging security and guarantee risks:

[0420] The server implements security measures to mitigate risks associated with the warranty.

[0421] 5. A method that can be provided to people of all ages and genders, including those with low IT literacy, using natural language:

[0422] The server uses natural language processing technology to provide an interface that is also suitable for customers with low IT literacy.

[0423] 6. Measures to reduce opportunity losses for related suppliers:

[0424] The server provides appropriate information to suppliers, reducing opportunity loss.

[0425] 7. A method for customers in physical stores to input questions in natural language using their smartphones and receive appropriate manual information and in-store guidance information:

[0426] When a customer enters a question using a smartphone, the question is sent to the server, which analyzes the question and generates the appropriate information.

[0427] 8. How to use generative AI models to generate relevant answers to customer questions:

[0428] The server uses OpenAI GPT-3 to generate appropriate answers to customer questions.

[0429] Specific examples

[0430] For example, if a customer asks, "What is the most popular item in this store?", the server sends the following prompt to the generative AI model:

[0431] Example prompt sentence:

[0432] Customer Question: What is the most popular item in this store?

[0433] Please provide the appropriate documentation information.

[0434] Based on this prompt, the generative AI model generates the following answer:

[0435] The most popular item at this store is the "XYZ brand smartphone," which is especially popular for its high-performance camera and long battery life.

[0436] In this way, customers can get fast and relevant information for their questions in-store.

[0437] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[0438] Step 1:

[0439] A user inputs a question using a smartphone. The input question is sent to a server by an application on the smartphone. The input data is a question in the user's natural language.

[0440] Step 2:

[0441] The server analyzes the received question using a natural language processing library (e.g., spaCy). As a result of the analysis, the intent and keywords of the question are extracted. The input data is the user's question, and the output data is the analyzed intent and keywords of the question.

[0442] Step 3:

[0443] The server generates a prompt for a generative AI model (e.g., OpenAI GPT-3) based on the analyzed question intent and keywords. The generated prompt is used as input to obtain an appropriate answer to the question. The input data is the analyzed question intent and keywords, and the output data is the generated prompt.

[0444] Step 4:

[0445] The server sends the generated prompt sentence to the generative AI model, which generates an appropriate answer. The generative AI model generates an answer based on the prompt sentence and returns it to the server. The input data is the generated prompt sentence, and the output data is the generated answer.

[0446] Step 5:

[0447] The server sends the generated answer to the user's smartphone. The user checks the answer through the smartphone application. The input data is the generated answer, and the output data is the answer displayed on the user's smartphone.

[0448] Step 6:

[0449] If the user enters an additional question, the process is repeated from step 1. This allows the user to ask consecutive questions and obtain the appropriate information.

[0450] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0451] "Example 1"

[0452] As one embodiment of the present invention, a system incorporating an emotion engine is provided. This system recognizes a user's emotions and provides support accordingly. Specifically, if the user feels confused, the system provides more detailed explanations and guidance. If the user feels angry, the system sends an apology message and takes prompt action to resolve the issue. In this way, the emotion engine understands the user's emotions and responds optimally accordingly, improving the user experience.

[0453] "Example 2"

[0454] Another embodiment of the present invention provides a system incorporating an emotion engine. This system recognizes the user's emotions and adjusts the way manual information is provided accordingly. Specifically, if the user feels anxious, the system prioritizes providing the most important information. On the other hand, if the user feels relaxed, the system provides more detailed information. In this way, the emotion engine understands the user's emotions and adjusts the way information is provided accordingly, thereby improving the user experience.

[0455] "Example 3"

[0456] Furthermore, as another embodiment of the present invention, a system incorporating an emotion engine is provided. This system recognizes the user's emotions and adjusts the way in which information such as update information and support deadlines is provided accordingly. Specifically, when the user is feeling anxious, the system prioritizes providing information that provides a sense of security. Also, when the user is excited, the system provides new update information. In this way, the emotion engine understands the user's emotions and adjusts the way in which information is provided accordingly, thereby improving the user experience.

[0457] The processing flow of each embodiment will be described below.

[0458] "Example 1"

[0459] Step 1: The system recognizes the user's emotions using an emotion engine.

[0460] Step 2: The emotion engine determines that the user's emotion is confusion.

[0461] Step 3: The system provides more detailed instructions and guidance.

[0462] "Example 2"

[0463] Step 1: The system recognizes the user's emotions using an emotion engine.

[0464] Step 2: The emotion engine determines that the user's emotion is impatience.

[0465] Step 3: The system prioritizes the most important information.

[0466] "Example 3"

[0467] Step 1: The system recognizes the user's emotions using an emotion engine.

[0468] Step 2: The emotion engine determines that the user's emotion is anxiety.

[0469] Step 3: The system prioritizes providing information that provides reassurance.

[0470] Example 1

[0471] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0472] With conventional support systems for home appliances, it can be difficult to quickly and accurately provide the manual information users need. Furthermore, they are unable to provide support that responds to the user's emotions, which can result in a poor user experience. Furthermore, there is a need to provide appropriate support to users with low IT literacy. To solve these issues, a system is needed that quickly provides manual information based on user requests and responds in accordance with the user's emotions.

[0473] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0474] In this invention, the server includes means for storing various manuals for individual home appliances and the like in addition to online information, means for providing personalized support to the customer, means for reading information such as update information and support expiration dates, means for hedging security and warranty risks, means for providing services to people of all ages and genders, including those with low IT literacy, using natural language, means for reducing opportunity losses to related suppliers or enabling new proposals through reverse auctions, means for analyzing user sentiment and providing corresponding support, means for searching a database based on a user request and retrieving relevant manual information, means for providing the retrieved manual information to the user, means for generating an appropriate response based on the sentiment analysis results, and means for transmitting the generated response to the user's terminal. This makes it possible to respond quickly and accurately to user requests and provide optimal support tailored to the user's sentiment.

[0475] "Online information" refers to data and materials accessible via the Internet.

[0476] "Home appliances" refers to electrical appliances used in the home.

[0477] "Manual" refers to a document that describes how to use a product and operating procedures.

[0478] A "database" refers to a collection of information that is systematically organized and stored so that it can be efficiently searched and used.

[0479] "Support" means assistance and advice to enable a User to use the Product properly.

[0480] "Update Information" means information regarding new versions or modifications of products or software.

[0481] "Support Life" refers to the period during which support or warranty coverage for a product is in effect.

[0482] "Security" refers to measures to protect information and systems from unauthorized access and attacks.

[0483] "Warranty" refers to a manufacturer's promise regarding the quality or performance of a product.

[0484] "Natural language" refers to a language that humans use on a daily basis.

[0485] "IT literacy" refers to the ability to understand and use information technology appropriately.

[0486] "Supplier" refers to a company or individual that provides a product or service.

[0487] "Opportunity cost" refers to benefits that are not obtained by not making a certain choice.

[0488] A "reverse auction" refers to an auction format in which buyers state a price and sellers compete according to that price.

[0489] "Sentiment analysis" refers to the technology of identifying and analyzing emotions from a user's text or voice.

[0490] A "response" refers to a reply or response to a user request.

[0491] "Terminal" refers to a device that allows a user to input or receive information.

[0492] This invention is a system that centrally manages manual information for home appliances owned by users and provides appropriate support in response to user requests. The system has a database that stores online information and the manuals for the home appliances owned by users. Furthermore, by combining it with an emotion engine, it provides support that responds to the user's emotions.

[0493] The server uses a database server (e.g., MySQL server) to store and manage manual information for home appliances. When a user sends a request from a device (smartphone, tablet, PC, etc.), the server receives the request and searches the database to retrieve the relevant manual information. For example, if a user types, "Please tell me how to set the temperature on my refrigerator," the server searches the database for refrigerator manual information and retrieves that information.

[0494] The server uses an emotion engine (e.g., IBM Watson (registered trademark) Tone Analyzer) to analyze the emotion from the user's input text. Based on the result of the emotion analysis, the server generates an appropriate response. For example, if the server determines that the user is confused, it generates a response that includes a more detailed explanation or guidance. If the server determines that the user is angry, it generates a response that includes an apology message.

[0495] The generated response is sent from the server to the user's device, where the user can check the response and receive the necessary information or support.

[0496] As a concrete example, consider a case where a user wants to know how to set the temperature on a refrigerator. If the user types, "Please tell me how to set the temperature on my refrigerator," the server will search the database for the relevant manual information and provide that information to the user. If the user also types, "My refrigerator isn't cooling," the emotion engine will recognize the user's confusion, and the server will provide a detailed troubleshooting guide.

[0497] Example prompt sentence:

[0498] How do I set the temperature in my refrigerator?

[0499] "What does the washing machine error code E1 mean?"

[0500] "My air conditioner isn't working, what should I do?"

[0501] In this way, the server can respond quickly and accurately to the user's requests and provide optimal support according to the user's feelings.

[0502] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0503] Step 1:

[0504] The user sends a request from the terminal.

[0505] A user inputs a question about how to operate or troubleshoot a specific appliance from their device (e.g., smartphone, tablet, PC, etc.), for example, "How do I set the temperature on my refrigerator?" The input request is sent to the server.

[0506] Step 2:

[0507] The server receives the request and searches the database.

[0508] The server receives a request from the user. It analyzes the received request and identifies the required information. The server then searches a database (e.g., MySQL server) to find the manual information for the relevant home appliance. The input is the user request, and the output is the relevant manual information.

[0509] Step 3:

[0510] The server retrieves the relevant manual information.

[0511] The server retrieves the relevant manual information from the database. For example, it retrieves information about how to set the temperature of a refrigerator. The retrieved manual information is used in the next processing step. The input is the database search result, and the output is the retrieved manual information.

[0512] Step 4:

[0513] The server analyzes the user's emotions using an emotion engine.

[0514] The server uses an emotion engine (e.g., IBM Watson Tone Analyzer) to analyze the emotion from the user's input text. It determines whether the user is confused, angry, etc. The input is the user's request text, and the output is the emotion analysis result.

[0515] Step 5:

[0516] The server generates an appropriate response based on the analysis results.

[0517] The server generates an appropriate response based on the analysis results of the emotion engine. For example, if the server determines that the user is confused, it generates a response with more detailed explanations and guidance. If the server determines that the user is angry, it generates a response with an apology message. The input is the emotion analysis result and the obtained manual information, and the output is the generated response.

[0518] Step 6:

[0519] The server sends the response to the user's terminal.

[0520] The server sends the generated response to the user's device. The response includes the relevant manual information and a message corresponding to the emotion. The input is the generated response, and the output is the response sent to the user's device.

[0521] Step 7:

[0522] The user checks the response on the device.

[0523] The user checks the response sent by the server on their device, for example, detailed instructions on how to set the refrigerator temperature or additional guidance if they are confused. The input is the response sent by the server, and the output is the information checked by the user.

[0524] (Application example 1)

[0525] Next, a description will be given of Application Example 1 of Embodiment Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0526] Today's consumers own a wide variety of home appliances, making it difficult to manage the manual information for each product individually. Furthermore, when customers in physical stores ask about how to use or set up their appliances, they need to be able to provide prompt and appropriate support. Furthermore, being able to recognize customers' emotions and provide support that responds to them can improve customer satisfaction. However, current systems are unable to adequately resolve these issues.

[0527] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means. In this invention, the server includes: a means for storing various manuals for home appliances owned by individuals in addition to online information; a means for providing personalized support to the customer; a means for reading information such as update information and support expiration dates; a means for hedging security and warranty risks; a means for providing services to people of all ages and genders, including those with low IT literacy, using natural language; a means for reducing opportunity losses to related suppliers or enabling new proposals through reverse auctions; a means for recognizing emotions and providing corresponding support; and a means for searching for and providing relevant manual information when a customer asks about how to use or set up a home appliance in a physical store. This allows for centralized management of manual information for the home appliances owned by the customer, enabling prompt and appropriate support in a physical store. Furthermore, recognizing customer emotions and providing corresponding support can improve customer satisfaction.

[0528] "Online information" is a general term for data and materials that can be accessed via the Internet.

[0529] "Home appliances" is a general term for electrical appliances used in the home.

[0530] A "manual" is a document that explains how to use and configure a product.

[0531] A "database" is a collection of information that is systematically organized and made available for efficient search and retrieval.

[0532] "Customer-oriented support" refers to providing appropriate assistance according to the customer's needs and situation.

[0533] "Updates" means the latest information or changes regarding products or services.

[0534] "Support Life" refers to the period for which support is provided for a product or service.

[0535] "Security" refers to measures to protect information and systems from unauthorized access and data leaks.

[0536] "Hedging warranty risk" refers to reducing the risks associated with warranties on products and services.

[0537] "Natural language" refers to a language that humans use on a daily basis.

[0538] "IT literacy" refers to the ability to understand and appropriately utilize information technology.

[0539] "Supplier" refers to a trader or company that provides products or services.

[0540] "Reducing opportunity loss" means not missing out on business opportunities.

[0541] A "reverse auction" is a type of auction in which a buyer presents their desired conditions and multiple sellers bid lower in accordance with those conditions.

[0542] "Emotion recognition" refers to determining a user's emotional state from their facial expressions and behavior.

[0543] "Brick and Mortar Store" means a retailer that has a physical location.

[0544] "How to use and set up home appliances" refers to the procedures and settings for using home appliances correctly.

[0545] The system for implementing this invention includes a database that stores various manuals for home appliances owned by individuals in addition to online information. The server centrally manages the manual information for home appliances owned by customers, enabling prompt and appropriate support to be provided in physical stores. Furthermore, an emotion engine is used to recognize customer emotions and provide support in response to those emotions, thereby improving customer satisfaction.

[0546] Hardware and software used

[0547] Hardware: Smartphones, servers

[0548] Software: Python, EmotionRecognizer library, ManualDatabase library

[0549] Data processing and calculation

[0550] The server performs the following process.

[0551] 1. Receiving user input: A customer types a question into a smartphone app. For example, "How do I set the temperature on my refrigerator?"

[0552] 2. Emotion Recognition: Use the EmotionRecognizer library to recognize the user's emotion. For example, if the user is confused, the emotion engine will recognize it as "confused."

[0553] 3. Searching for manual information: Using the ManualDatabase library, the database is searched for manual information for the relevant home appliance. For example, manual information on "how to set the temperature of a refrigerator" is searched for.

[0554] 4. Providing support: Generates appropriate support messages based on the recognized emotions. For example, if the user is confused, a message such as "We will provide detailed explanations" will be generated.

[0555] 5. Displaying the result: Providing the customer with manual information and support messages. For example, a support message will be displayed along with detailed instructions on "How to set the refrigerator temperature."

[0556] Specific examples

[0557] User Input: "How do I set the temperature on my refrigerator?"

[0558] Emotion recognition result: confused

[0559] Support message: "We will provide you with a detailed explanation."

[0560] Prompt Sentence Examples

[0561] A user asks, "How do I set the temperature on my refrigerator?" The user's emotion is confusion. Please provide a detailed explanation.

[0562] In this way, a smartphone application that strengthens customer support in brick-and-mortar stores can be realized. The server can quickly provide appropriate manual information in response to customer questions and use an emotion engine to provide support that responds to the customer's emotions, thereby improving customer satisfaction.

[0563] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0564] Step 1:

[0565] A user inputs a question into a smartphone app. For example, "How do I set the temperature on my refrigerator?" The input data is sent to the server in text format.

[0566] Step 2:

[0567] The server passes the received user question to the EmotionRecognizer library to recognize the user's emotion. The input data is the user's question text, and the output data is the recognized emotion (e.g., confusion, anger, joy). Specifically, it performs text analysis and classifies the emotion using an emotion model.

[0568] Step 3:

[0569] The server generates an appropriate support message based on the recognized emotion. For example, if the user is confused, a message such as "We will provide a detailed explanation" is generated. The input data is the recognized emotion, and the output data is the support message. Specifically, a message template corresponding to the emotion is selected and customized.

[0570] Step 4:

[0571] The server passes the user's question text to the ManualDatabase library, which searches the database for the manual information of the relevant home appliance. The input data is the user's question text, and the output data is the relevant manual information. Specifically, a keyword search is performed to extract relevant manual information.

[0572] Step 5:

[0573] The server combines the retrieved manual information with the generated support message and provides it to the user. The input data is the manual information and the support message, and the output data is the information displayed to the user. Specifically, the server integrates the manual information and the support message and displays them in a user-friendly format.

[0574] Step 6:

[0575] Users check the manual information and support messages provided through the smartphone app to understand how to set up and use the home appliance. The input data is the information sent from the server, and the output data is the user's understanding. Specifically, users view the information through the app interface and perform the necessary operations.

[0576] Example 2

[0577] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0578] Many users today have difficulty properly managing update information and support expiration dates for their electronic devices. Providing appropriate support is also required for users with low IT literacy. Furthermore, the lack of adjustment of information delivery methods based on the user's emotions results in a lack of improvement in the user experience. To solve these issues, a system is needed that integrates management of update information and support expiration dates, adjustment of information delivery methods based on emotion recognition, and support tailored to the user.

[0579] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0580] In this invention, the server includes a means for storing various manuals for electronic devices owned by individuals in addition to online information, a means for providing personalized support to users, a means for reading information such as update information and support expiration dates, a means for reducing security and warranty risks, a means for providing services using natural language to anyone, regardless of age or gender, including those with low IT literacy, a means for reducing opportunity losses to related suppliers or enabling new proposals through reverse auctions, and a means for recognizing users' emotions using an emotion engine and adjusting the information provision method. This makes it possible to appropriately manage update information and support expiration dates for users' electronic devices and adjust the information provision method according to their emotions. It is also possible to provide appropriate support to users with low IT literacy.

[0581] "Online information" refers to data and content accessible via the Internet.

[0582] "Electronic devices" is a general term for machines and devices that operate using electricity.

[0583] A "manual" is a document or guide that describes how to use or operate an electronic device.

[0584] "User" means any person or entity that uses a system or electronic device.

[0585] "Assistance" refers to support and help that enables users to use systems and electronic devices effectively.

[0586] "Update information" refers to information about new versions and patches for electronic devices and software.

[0587] "Support period" refers to the period during which any warranty or technical support provided for electronic equipment or software is valid.

[0588] "Security" refers to the measures and procedures for protecting systems and data from unauthorized access or attack.

[0589] "Warranty" means a guarantee of quality or performance provided for a product or service.

[0590] "Information technology literacy" refers to the ability to understand and effectively use information technology such as computers and the Internet.

[0591] "Supplier" means a company or organization that provides a product or service.

[0592] "Opportunity cost" refers to benefits or opportunities that are not obtained because a certain choice is not made.

[0593] A "reverse auction" is an auction in which sellers bid lower.

[0594] An "emotion engine" is a technology that recognizes the user's emotions and adjusts the system's behavior based on them.

[0595] "Information provision method" refers to the means or format of conveying information to users.

[0596] This invention is a system that stores various manuals for electronic devices owned by individuals in addition to online information, and provides personalized support to users. This system reads information such as update information and support expiration dates, reducing security and warranty risks. It also includes a means of providing support in natural language that can be used by people of all ages and genders, including those with low IT literacy, and includes a means of reducing opportunity losses for related suppliers and enabling new proposals through reverse auctions. Furthermore, it can recognize users' emotions using an emotion engine and adjust the way information is provided.

[0597] Server Processing

[0598] The server periodically checks the information stored in the database, such as update information and support expiration dates. A database management system such as MySQL is used for this process. The server executes queries based on a regular schedule to retrieve the relevant information. For example, if the support period for a customer's refrigerator is due to expire in one month, the server retrieves that information and generates a notification message. This process is often performed using Python scripts.

[0599] Terminal handling

[0600] The device receives the notification sent from the server and displays it to the user. This process is performed using an ANDROID (registered trademark) or iOS mobile application. The device provides information to the user through push notifications or in-app notifications. For example, a notification might be displayed saying, "Your refrigerator's support period will expire in one month. Please consider extending the warranty."

[0601] User Action

[0602] The user checks the notification displayed on the device and takes necessary action, such as extending the warranty on a refrigerator whose support period is approaching.

[0603] Emotion engine processing

[0604] The server runs an emotion engine to recognize the user's emotions. This process uses emotion analysis tools such as Google® Cloud Natural Language API and IBM Watson. The server analyzes the user's input and behavioral data to identify emotions. For example, if the user frequently clicks the help button, it can determine that the user is impatient.

[0605] Adjusting how information is provided

[0606] The server adjusts how it presents manual information based on the user's emotions. For example, if it determines that the user is in a hurry, it will prioritize providing the most important information. This process involves logic that includes conditional branching.

[0607] Specific examples

[0608] 1. The server runs a scheduled task every day at 2:00 AM to check the support expiration date of all electronic devices in the database.

[0609] 2. The server obtains information about refrigerators whose support period will expire within one month and generates a notification message stating, "Your refrigerator's support period will expire in one month. Please consider extending the warranty."

[0610] 3. The server uses Firebase Cloud Messaging (FCM) to send the generated notification message to the user's smartphone.

[0611] 4. The device collects user input and behavior data and sends it to the server. For example, if the user frequently clicks the help button, that data is sent.

[0612] 5. The server uses the Google Cloud Natural Language API to determine that the user is impatient.

[0613] 6. The server is configured to provide the most important information to impatient users first.

[0614] 7. The device displays the message to the user: "Your refrigerator's support period expires in one month. Please apply for warranty extension now."

[0615] Prompt Sentence Examples

[0616] "Create a program that notifies the user when the refrigerator's support expires in a month. Also, if the user is in a hurry, prioritize the display of important information."

[0617] In this way, the roles of the server, terminal, and user are clarified, and a system that processes and calculates data using specific hardware and software has been described.

[0618] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0619] Step 1:

[0620] The server periodically checks the information stored in the database, such as update information and support expiration dates. As input, it retrieves information about all electronic devices in the database. It runs a query using a database management system (e.g., MySQL) to extract information about electronic devices whose support expiration date is approaching. As output, it obtains a list of electronic devices whose support expiration date will expire within the next month. Specifically, the server executes a scheduled task at 2:00 AM every day.

[0621] Step 2:

[0622] The server generates a notification message based on the obtained information. As input, it uses the list of electronic devices whose support expiration date is approaching obtained in step 1. It uses a Python script to generate a notification message for each electronic device. As output, it obtains a list of notification messages. Specifically, the server generates a message saying, "Your refrigerator's support expiration date will expire in one month. Please consider extending the warranty."

[0623] Step 3:

[0624] The server sends the generated notification message to the device. As input, it uses the list of notification messages generated in step 2. It uses Firebase Cloud Messaging (FCM) to send the notification message to the user's smartphone. As output, the notification is displayed on the user's device. Specifically, the server sends the notification message to FCM.

[0625] Step 4:

[0626] The device receives the notification sent from the server and displays it to the user. As input, it uses the notification message received from the server. It uses the device's mobile application (e.g., Android or iOS) to display a push notification or an in-app notification. As output, the notification is displayed to the user. Specifically, the device displays a notification saying, "Your refrigerator's support period will expire in one month. Please consider extending the warranty."

[0627] Step 5:

[0628] The user checks the notification displayed on the terminal and takes the necessary action. The notification message displayed on the terminal is used as input. The user checks the notification and completes the warranty extension procedure for the electronic device whose support expiration date is approaching. The output is that the warranty extension procedure is completed. As a specific operation, the user accesses the website for warranty extension and completes the procedure.

[0629] Step 6:

[0630] The terminal collects user input and behavioral data and sends it to the server. The user's operation log and behavioral data are used as input. The terminal collects data if the user frequently clicks the help button. The collected data is sent to the server as output. Specifically, the terminal periodically sends the user's operation log to the server.

[0631] Step 7:

[0632] The server uses an emotion engine to recognize the user's emotions. As input, it uses the user's behavioral data collected in step 6. It uses an emotion analysis tool such as Google Cloud Natural Language API or IBM Watson to identify the user's emotions. As output, it obtains the user's emotion information. Specifically, the server inputs the user's behavioral data into the emotion analysis tool to recognize emotions.

[0633] Step 8:

[0634] The server adjusts the method of providing manual information based on the recognized emotion. As input, it uses the user's emotion information obtained in step 7. It adjusts the method of providing information using logic including conditional branching. As output, it obtains the adjusted method of providing information. Specifically, the server sets up the system to provide the most important information to the impatient user.

[0635] Step 9:

[0636] The terminal displays the adjusted information to the user. As input, it uses the information provision method adjusted in step 8. It uses the mobile application on the terminal to display the information to the user. As output, the adjusted information is displayed to the user. Specifically, the terminal displays a message saying, "Your refrigerator's support period will expire in one month. Please apply for warranty extension now."

[0637] (Application example 2)

[0638] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0639] With conventional systems, it was difficult to properly manage update information and support expiration dates for home appliances owned by customers, which led to issues with increased security and warranty risks. Furthermore, there was also the issue of not providing information based on the user's emotions, which did not improve the user experience. Furthermore, there was a lack of a way to notify customers of product update information and support expiration dates in real time while they were browsing products in physical stores.

[0640] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0641] In this invention, the server includes: a means for storing various manuals for individual home appliances and the like in addition to online information; a means for providing personalized support to the customer; a means for reading information such as update information and support expiration dates; a means for hedging security and warranty risks; a means for providing services using natural language to anyone, regardless of age or gender, including those with low IT literacy; a means for reducing opportunity losses to related suppliers or enabling new proposals through reverse auctions; a means for recognizing user emotions and adjusting the method of providing information accordingly; and a means for notifying customers of product update information and support expiration dates while they are viewing products in a physical store. This reduces security and warranty risks, enables information to be provided in accordance with user emotions, and improves the shopping experience in physical stores.

[0642] "Online information" is a general term for data and content that can be accessed via the Internet.

[0643] "Home appliances" is a general term for electrical appliances used in the home.

[0644] A "manual" is a document that describes how to use a product or service and the operating procedures.

[0645] "Support" refers to the assistance and advice provided to customers when using products and services.

[0646] "Updates" means the latest information or changes regarding products or services.

[0647] "Support End Date" means the date and time when support for a product or service ends.

[0648] "Security" refers to the means and measures to protect information and systems from unauthorized access and attacks.

[0649] A "warranty" is a promise to repair or replace a product or service free of charge if any defects or malfunctions occur within a certain period of time.

[0650] "Risk" refers to the possibility of unexpected events or losses occurring.

[0651] "Natural language" refers to a language that humans use on a daily basis.

[0652] "IT literacy" refers to the ability to understand and use information technology appropriately.

[0653] "Supplier" refers to a company or individual that provides products or services.

[0654] "Opportunity loss" refers to missing out on profits or opportunities that could have been obtained.

[0655] A "reverse auction" is an auction format in which a buyer presents desired conditions and multiple sellers bid lower to meet those conditions.

[0656] "Emotion" refers to the psychological response a person has to a particular situation or stimulus.

[0657] "Brick and mortar store" refers to a retailer that has a physical location.

[0658] "Notification" refers to the act of informing a user of specific information.

[0659] To implement the present invention, the following system configuration and program are required.

[0660] First, the server has a means for storing various manuals for home appliances owned by individuals in addition to information on the Internet. This means includes a function for searching manual information stored in a database and retrieving the relevant manual information. This allows the manual information required by the user to be provided quickly.

[0661] Next, the server has a means for reading information such as update information and support expiration dates. This means includes a function for periodically checking the information stored in the database, such as update information and support expiration dates, and retrieving the relevant information. This allows users to always have the latest information on their home appliances.

[0662] Furthermore, the server has a means for recognizing the user's emotions and adjusting the way information is provided accordingly. This means includes a function for recognizing the user's emotions using the EmotionRecognizer library and adjusting the way information is provided based on the recognized emotions. For example, if the user is anxious, the server provides the most important information first, and if the user is relaxed, it provides detailed information.

[0663] The server also has a means for notifying customers of product update information and support expiration dates while they are viewing products in a physical store. This means includes a function for sending notifications in real time via a smartphone app while customers are viewing products, allowing customers to immediately grasp the latest product information.

[0664] As a specific example, by inputting the following prompt sentence into a generative AI model, it is possible to simulate the specific behavior of an application that adjusts the way information is presented according to the user's emotions.

[0665] Example prompt sentence:

[0666] "The user took a picture of their face with their smartphone camera. The application recognized the user's emotion using the EmotionRecognizer library. Based on the recognized emotion, the application retrieved product update information and support deadlines from the database and provided them to the user in an appropriate format. For example, if the user is in a hurry, the application prioritizes displaying important information such as sales information and stock status. If the user is relaxed, the application provides detailed product descriptions and reviews."

[0667] In this way, the server can provide information according to the user's emotions and improve the shopping experience in a physical store.

[0668] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0669] Step 1:

[0670] The user takes a picture of their face with the smartphone camera. The input is the user's face image, and the output is facial image data. This facial image data is passed to the EmotionRecognizer library.

[0671] Step 2:

[0672] The device recognizes the user's emotions using the EmotionRecognizer library. The input is facial image data, and the output is the recognized emotion (e.g., anxious, relaxed, etc.). The EmotionRecognizer library analyzes facial features and performs data operations to identify emotions.

[0673] Step 3:

[0674] The server retrieves product update information and support expiration dates from the database. The input is the product ID, and the output is product update information and support expiration date data. The server searches the database based on the product ID and retrieves the relevant information.

[0675] Step 4:

[0676] The server adjusts the information presentation method based on the recognized emotion. The input is the recognized emotion and data on product update information and support expiration dates, and the output is the adjusted information presentation content. For example, if the user is in a hurry, important information such as sale information and stock status will be displayed first, and if the user is relaxed, detailed product descriptions and reviews will be provided.

[0677] Step 5:

[0678] The terminal notifies the user of the adjusted information provision content. The input is the adjusted information provision content, and the output is a notification displayed on the user's smartphone screen. The terminal displays the information received from the server to the user in an appropriate format.

[0679] In this way, information is provided that reflects the user's emotions, improving the shopping experience in physical stores.

[0680] Example 3

[0681] Next, a description will be given of a third embodiment of the third embodiment. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0682] With the proliferation of a wide variety of modern home appliances and digital devices, users must manage a large amount of manual information. However, it is difficult for users with low IT literacy or the elderly to properly obtain and use this information. It is also important to provide appropriate support that responds to users' emotions, but this is not adequately addressed in conventional systems. Furthermore, a means is needed to reduce opportunity losses and make new proposals to related suppliers.

[0683] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[0684] In this invention, the server includes a means for storing various manuals for individual home appliances and other products in addition to online information; a means for providing personalized support to customers; a means for reading information such as update information and support expiration dates; a means for hedging security and warranty risks; a means for providing services using natural language to anyone, regardless of age or gender, including those with low IT literacy; a means for reducing opportunity losses to related suppliers or enabling new proposals through reverse auctions; a means for analyzing natural language inquiries from users and providing appropriate manual information; and a means for recognizing user emotions and adjusting the information provision method accordingly. This allows users to easily obtain the necessary manual information and receive appropriate support based on their emotions. It also reduces opportunity losses and enables new proposals to be made to suppliers.

[0685] "Online information" refers to data and materials accessible via the Internet.

[0686] "Home appliances" refers to electrical appliances used in the home.

[0687] "Manual" refers to a document that describes how to use or operate a product or service.

[0688] "Support" means assistance and advice provided to a User in using a Product or Service.

[0689] "Updates" means the latest information or changes regarding products or services.

[0690] "Support Period" refers to the period during which support is provided for a product or service.

[0691] "Security" refers to the means and measures for protecting information and systems.

[0692] "Warranty" means any guarantee of quality or performance provided for a product or service.

[0693] "Natural language" refers to a language that humans use on a daily basis.

[0694] "IT literacy" refers to the ability to understand and use information technology appropriately.

[0695] "Supplier" refers to a company or business that provides products or services.

[0696] "Opportunity loss" refers to the loss that occurs when a business opportunity is missed.

[0697] A "reverse auction" is an auction format in which buyers submit their desired prices and sellers compete to match those prices.

[0698] "Natural language queries" refer to questions or requests made by users in everyday language.

[0699] An "emotion engine" refers to a system that analyzes a user's emotions and adjusts its response accordingly.

[0700] This invention is a system that allows users to make inquiries in natural language and provides appropriate manual information and support information in response. The system operates among three parties: a server, a terminal, and the user.

[0701] 1. Generating the system program

[0702] The system is programmed using Python, uses the open-source BERT model for natural language processing (NLP), and uses a cloud-based sentiment analysis service for emotion recognition.

[0703] 2. Explanation of program processing

[0704] The server receives a natural language query from the user. For example, if the user types, "I want to lower the temperature of the refrigerator," the server sends the query to the BERT model for analysis. The BERT model understands the intent of the query and searches for the appropriate manual information.

[0705] The server then returns the search results to the user, specifically providing manual information on how to set the refrigerator temperature, written in natural language for the user to easily understand.

[0706] Furthermore, if an emotion engine is built in, the server will analyze the user's emotions using an emotion analysis service. For example, if the server determines that the user is feeling anxious, it will prioritize providing information that will provide a sense of security. Conversely, if the server determines that the user is excited, it will provide new updated information.

[0707] 3. Examples and prompts

[0708] As a specific example, consider the case where the user inquires, "I want to lower the temperature of the refrigerator." In this case, the server performs the following process.

[0709] 1. The user opens the app on their smartphone and types, "I want to lower the refrigerator temperature."

[0710] 2. The device sends this query to the server.

[0711] 3. The server receives the query and sends it to the BERT model.

[0712] 4. The BERT model understands "how to set the refrigerator temperature."

[0713] 5. The server searches the database for manual information on "how to set the refrigerator temperature."

[0714] 6. The server sends the search results to the device.

[0715] 7. The device displays to the user, "To lower the refrigerator temperature, press the settings button to adjust the temperature."

[0716] 8. If an emotion engine is installed, the server analyzes the user's emotions.

[0717] 9. The server determines that the user is feeling anxious and prioritizes providing information that will provide reassurance.

[0718] 10. The server sends the adjusted information to the device.

[0719] 11. The device displays the following to the user: "To lower the refrigerator temperature, press the settings button to adjust the temperature. If you have any questions, please contact our support center."

[0720] An example of a prompt sentence might be:

[0721] "I want to lower the temperature in my refrigerator. How do I do that?"

[0722] "I heard there's a new update, could you please tell me the details?"

[0723] In this way, the system analyzes the user's inquiry and provides appropriate information, thereby improving the user experience. The flow of the identification process in the third embodiment will be described with reference to FIG.

[0724] Step 1:

[0725] The user enters a query.

[0726] The user uses a device (such as a smartphone or PC) to input a query in natural language. For example, they might input "I want to lower the temperature of the refrigerator." The input query is saved in an input field on the device.

[0727] Step 2:

[0728] The terminal sends a query to the server.

[0729] The terminal sends the query entered by the user to the server, transmitting data over the Internet. The input is the user's query text, and the output is the data sent to the server.

[0730] Step 3:

[0731] The server receives the query and sends it to the BERT model.

[0732] The server sends the query received from the device to the BERT model, which is a model for natural language processing. The input is the user's query text, and the output is the data sent to the BERT model.

[0733] Step 4:

[0734] The BERT model analyzes the query and understands the intent.

[0735] The BERT model analyzes queries and understands their intent. For example, from the query "I want to lower the refrigerator temperature," it understands "How to set the refrigerator temperature." The input is the user's query text, and the output is the analysis result.

[0736] Step 5:

[0737] The server searches for appropriate manual information based on the analysis results.

[0738] The server searches the database for appropriate manual information based on the analysis results obtained from the BERT model. For example, it searches for information on "how to set the refrigerator temperature." The input is the analysis results, and the output is the search results.

[0739] Step 6:

[0740] The server sends the search results to the terminal.

[0741] The server sends the search results to the terminal. At this time, data is transmitted via the Internet. The input is the search results, and the output is the data transmitted to the terminal.

[0742] Step 7:

[0743] The terminal displays the manual information to the user.

[0744] The terminal displays the manual information received from the server to the user. For example, it displays "To lower the refrigerator temperature, press the setting button to adjust the temperature." The input is the manual information from the server, and the output is the display to the user.

[0745] Step 8:

[0746] If an emotion engine is installed, the server analyzes the user's emotions.

[0747] If an emotion engine is included, the server uses an emotion analysis service to analyze the user's emotion, for example, to determine whether the user is feeling anxious. The input is the user's query text, and the output is the emotion analysis result.

[0748] Step 9:

[0749] The server adjusts the way information is provided according to emotions.

[0750] The server adjusts the information provision method according to the user's emotions. For example, if the user is feeling anxious, it will prioritize providing information that will give a sense of security. The input is the emotion analysis result, and the output is the adjusted information.

[0751] Step 10:

[0752] The server sends the adjusted information to the terminal.

[0753] The server sends the adjusted information to the terminal. At this time, the data is transmitted via the Internet. The input is the adjusted information, and the output is the data transmitted to the terminal.

[0754] Step 11:

[0755] The terminal displays the adjusted information to the user.

[0756] The terminal displays the adjusted information received from the server to the user. For example, it displays "To lower the refrigerator temperature, press the setting button to adjust the temperature. If you have any questions, please contact the support center." The input is the adjusted information from the server, and the output is what is displayed to the user.

[0757] (Application example 3)

[0758] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0759] Today's consumers want to quickly and easily obtain information about home appliances and other devices. However, those who are not familiar with technology, such as those with low IT literacy or the elderly, have difficulty finding the appropriate information. They also need to provide appropriate support according to their emotional state. Furthermore, streamlining customer support in physical stores and improving the customer experience are key challenges.

[0760] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means. In this invention, the server includes a means for storing various manuals for individually owned home appliances and the like in addition to online information, a means for providing personalized support to the customer, a means for reading information such as update information and support expiration dates, a means for hedging security and warranty risks, a means for providing information using natural language to anyone, regardless of age or gender, including those with low IT literacy, a means for reducing opportunity losses to related suppliers or enabling new proposals through reverse auctions, a means for recognizing customer emotions and adjusting the method of providing information accordingly, and a means for using a generative AI model to provide appropriate manual information in response to customer inquiries. This makes it possible to streamline customer support in physical stores and improve the customer experience.

[0761] "Online information" refers to data and materials that can be accessed via the Internet.

[0762] "Home appliances" is a general term for electrical appliances used in the home.

[0763] A "manual" is a document that describes how to use a product or service and the operating procedures.

[0764] "Support" means assistance or advice provided to a customer in using a product or service.

[0765] "Updates" means the latest information or changes regarding products or services.

[0766] "Support Life" means the period during which support is provided for a product or service.

[0767] "Security" refers to the measures and means used to protect information and systems from unauthorized access and attacks.

[0768] A "warranty" is a promise to repair or replace a product or service free of charge if any defects or malfunctions occur within a certain period of time.

[0769] A "natural language" is a language that humans use on a daily basis.

[0770] "IT literacy" refers to the ability to understand and use information technology appropriately.

[0771] "Supplier" means a company or individual that provides a product or service.

[0772] "Opportunity cost" refers to benefits or gains that are not obtained because a certain choice is not made.

[0773] A "reverse auction" is an auction in which buyers state their desired prices and sellers bid accordingly.

[0774] "Emotion recognition" is a technology that analyzes a user's emotions and understands their state.

[0775] A "generative AI model" is a model that uses artificial intelligence to generate new data and information.

[0776] An "inquiry" is an action in which a customer asks a question or makes a request regarding a product or service.

[0777] A system for implementing this invention is configured as follows: The server has a database that stores various manuals for home appliances and other items owned by individuals, in addition to online information. When a user makes an inquiry through a smartphone application, the server analyzes the inquiry using natural language processing technology and provides appropriate manual information.

[0778] The server uses an emotion recognition engine to analyze the user's emotions and adjusts the way it provides information based on the results. For example, if the user is feeling anxious, the server will prioritize providing information that provides a sense of security. If the user is excited, the server will provide new updated information.

[0779] The server uses a generative AI model to generate appropriate manual information in response to the user's inquiry. This generative AI model is implemented using OpenAI's API. Specifically, the user's inquiry is input to the generative AI model as a prompt sentence, and the appropriate manual information is obtained.

[0780] Hardware and software used

[0781] Hardware: Servers, smartphones

[0782] Software: OpenAI API, TextBlob (for sentiment analysis)

[0783] Data processing and calculation

[0784] 1. Natural language analysis: Analyze user inquiries and obtain appropriate manual information. This uses OpenAI's API.

[0785] 2. Emotion Recognition: Uses the TextBlob library to analyze the user's emotions and classify them as positive, negative, or neutral.

[0786] 3. Adjustment of information provision: Adjust the way information is provided based on the results of sentiment analysis, for example, adding a message offering reassurance if the sentiment is negative.

[0787] Specific examples

[0788] When a user asks, "I want to lower the temperature of the refrigerator," the server performs the following process.

[0789] 1. Perform natural language analysis on the user's inquiry and understand that the user's query is, "I want to lower the temperature in the refrigerator."

[0790] 2. An emotion recognition engine is used to analyze the user's emotions. For example, if the user is feeling anxious, the emotion will be classified as "negative."

[0791] 3. Use the generative AI model to obtain the appropriate manual information. An example of a prompt is as follows:

[0792] Provide the appropriate manual information when a customer asks, "I want to lower the temperature in my refrigerator."

[0793] 4. Adjust the way you provide information based on the results of sentiment analysis, for example, "Don't worry, the following information may be helpful: How to set the refrigerator temperature..."

[0794] In this way, it is possible to streamline customer support in physical stores and improve the customer experience.

[0795] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[0796] Step 1:

[0797] A user inputs a query through a smartphone application. The input query is sent to the server in text format. The input data is the user's question.

[0798] Step 2:

[0799] The server passes the received query to a natural language analysis engine. The natural language analysis engine analyzes the query content and extracts keywords and context to retrieve appropriate manual information. The input is the user's query text, and the output is the analyzed keywords and context information.

[0800] Step 3:

[0801] The server analyzes the user's emotions using an emotion recognition engine. The emotion recognition engine uses the TextBlob library to classify the emotion of the query text as positive, negative, or neutral. The input is the user's query text, and the output is the emotion classification result.

[0802] Step 4:

[0803] The server uses a generative AI model to generate appropriate manual information in response to the user's inquiry. The generative AI model is implemented using OpenAI's API. The server inputs the analyzed keywords and contextual information into the generative AI model as a prompt sentence to obtain the appropriate manual information. The input is the prompt sentence, and the output is the generated manual information.

[0804] Step 5:

[0805] The server adjusts the information provision method based on the results of the emotion analysis. For example, if the emotion is classified as negative, the server adds a message to provide reassurance. The input is the emotion classification result and the generated manual information, and the output is the adjusted information provision message.

[0806] Step 6:

[0807] The server sends the tailored information message to the user's smartphone application. The user receives appropriate manual information and a message according to the user's emotion through the smartphone application. The input is the tailored information message, and the output is the information displayed on the user's smartphone screen.

[0808] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0809] The data generation model 58 is a so-called generative AI (Artificial Intelligence).

[0810] An example of the data generation model 58 is ChatGPT (registered trademark)<URL: https: / / openai.com / blog / chatgpt> ) and other generative AIs.

[0811] The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in the form of data such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0812] Another example of generative AI is Gemini (registered trademark) (Internet search engine). <url: https: gemini.google.com ?hl="ja">) are mentioned.

[0813] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0814] [Second embodiment]

[0815] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0816] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0817] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0818] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0819] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0820] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0821] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0822] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0823] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0824] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0825] In the smart glasses 214, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0826] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0827] "Example 1"

[0828] This embodiment of the present invention includes a database that stores various manuals for home appliances owned by individuals in addition to online information. This database centrally manages manual information for home appliances owned by customers and provides personalized support based on this information. For example, when a customer wants to know how to set the temperature of a refrigerator, the database searches for the relevant manual information and provides it to the customer.

[0829] "Example 2"

[0830] Furthermore, this embodiment of the present invention is equipped with a function for reading information such as update information and support expiration dates. This function periodically checks the information stored in the database, such as update information and support expiration dates, and acquires the relevant information. For example, if the support expiration date of a home appliance owned by a customer is approaching, the information is notified to the customer. This hedges against security and warranty risks.

[0831] "Example 3"

[0832] Furthermore, this embodiment of the present invention has a function that uses natural language to provide services to people of all ages and genders, including those with low IT literacy. This function analyzes inquiries from customers in natural language and provides appropriate manual information. For example, if a customer inquires, "I want to lower the temperature in my refrigerator," the system analyzes the inquiry and provides manual information on how to set the refrigerator temperature.

[0833] The processing flow of each embodiment will be described below.

[0834] "Example 1"

[0835] Step 1: Store the manual information for the home appliances owned by the customer in a database.

[0836] Step 2: A customer inquires about how to operate a particular appliance.

[0837] Step 3: Search the database for the relevant manual information.

[0838] Step 4: Provide search results to the customer.

[0839] "Example 2"

[0840] Step 1: Regularly check the information stored in the database, such as update information and support expiration dates.

[0841] Step 2: If there is any relevant information, obtain that information.

[0842] Step 3: Notify the customer of the information obtained.

[0843] "Example 3"

[0844] Step 1: Accept natural language inquiries from customers.

[0845] Step 2: Analyze the inquiry and search for the relevant manual information.

[0846] Step 3: Provide search results to the customer.

[0847] Example 1

[0848] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0849] Modern homes contain a wide variety of home appliances, and in order to understand how to operate and set up each one, users must refer to the manuals for each product. However, these manuals are often provided in paper form, which means there is a risk of them being lost or damaged. Furthermore, even when searching for information on the Internet, it is difficult for users to obtain accurate information, as unreliable and inaccurate information is mixed in. Furthermore, users with low IT literacy find it even more difficult to find appropriate information. There is a need for a system that can solve these problems and allow users to easily obtain accurate instructions for operating home appliances.

[0850] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0851] In this invention, the server includes means for storing various manuals for individual home appliances and other items owned by individuals in addition to online information, means for providing personalized support to the customer, means for reading information such as update information and support expiration dates, means for hedging security and warranty risks, means for providing services using natural language to anyone, regardless of age or gender, including those with low IT literacy, means for reducing opportunity losses to related suppliers or enabling new proposals through reverse auctions, means for providing an interface through which users can search for operating instructions for home appliances, means for sending user search queries to the server, means for searching for relevant manual information from a database, means for providing appropriate support information to users based on the search results, and means for providing information based on prompt sentences using a generative AI model.This allows users to easily and accurately obtain operating instructions for home appliances.

[0852] "Online information" refers to data and content accessible via the Internet.

[0853] "Home appliances" refers to electrical appliances used in the home.

[0854] "Manual" refers to an instruction manual that describes how to operate and set up a product.

[0855] A "database" refers to a system that systematically organizes and stores information so that it can be searched and retrieved efficiently.

[0856] "Support" means assistance and advice to enable a User to use the Product properly.

[0857] "Update Information" means new versions or modifications of products or software.

[0858] "Support Life" refers to the period for which support is provided for a product.

[0859] "Security" refers to measures taken to protect information and systems from unauthorized access and data leakage.

[0860] "Warranty" refers to a manufacturer's promise of product quality or performance.

[0861] "Hedging risk" means taking measures to prevent or mitigate potential risks.

[0862] "Natural language" refers to a language that humans use on a daily basis.

[0863] "IT literacy" refers to the ability to understand and appropriately utilize information technology.

[0864] "Supplier" refers to a company or individual that provides a product or service.

[0865] "Opportunity cost" refers to benefits that are not obtained by not making a certain choice.

[0866] A "reverse auction" refers to an auction format in which buyers state a price and sellers compete according to that price.

[0867] "Interface" refers to the means or method by which a user interacts with a system.

[0868] A "search query" refers to a keyword or phrase that a user enters to search for information.

[0869] A "generative AI model" refers to an algorithm or system that uses artificial intelligence to generate and process data.

[0870] A "prompt" refers to an instruction or question input to a generative AI model.

[0871] This invention is a system equipped with a database that stores not only online information but also various manuals for home appliances owned by individuals. This system is designed to enable users to easily search for and obtain accurate information on how to operate home appliances.

[0872] Hardware and software used

[0873] Hardware: Servers, devices (PCs, smartphones, tablets, etc.)

[0874] Software: Database management systems (e.g., MySQL, PostgreSQL), web servers (e.g., Apache, Nginx), generative AI models (e.g., OpenAI GPT-3)

[0875] System configuration

[0876] server

[0877] The server manages a database that stores online information and manuals for home appliances owned by customers. When a user wants to know how to operate a particular appliance, the server searches the database for the relevant manual information and provides the user with appropriate support information based on the search results. The server also uses a generative AI model to provide information based on prompts.

[0878] Terminal

[0879] The terminal provides an interface for users to search for operating instructions for home appliances. It sends the search query entered by the user to the server and displays the manual information received from the server to the user. The terminal operates on devices such as smartphones, PCs, and tablets.

[0880] User

[0881] A user uses a terminal to search for how to operate a home appliance. For example, if the user wants to know how to set the temperature on a refrigerator, the user enters "how to set the temperature on a refrigerator." The user operates the home appliance based on the information displayed on the terminal.

[0882] Specific examples

[0883] Example 1: Want to know how to set the refrigerator temperature?

[0884] 1. The user opens the app on their smartphone and types in "How to set the refrigerator temperature."

[0885] 2. The device sends this search query to the server, specifically by sending the data to the " / search" endpoint using an HTTP POST request.

[0886] 3. The server searches the database for the manual information for the corresponding refrigerator by executing the SQL query "SELECT FROM manuals WHERE appliance='refrigerator' AND topic='temperature setting'".

[0887] 4. The server sends the search results in JSON format to the device. Specifically, it returns data like this as an HTTP response: {"appliance": "Refrigerator", "topic": "Temperature setting", "content": "How to set the refrigerator temperature..."}.

[0888] 5. The device displays the received information to the user. Specifically, it displays the text "To set the refrigerator temperature..." on the app's UI.

[0889] 6. The user sets the refrigerator temperature based on the displayed information. Specifically, the user adjusts the temperature using the refrigerator's control panel.

[0890] Example prompts for generative AI models

[0891] How do I set the temperature in my refrigerator?

[0892] When this prompt sentence is input into the generative AI model, the AI ​​searches for the relevant manual information from the database and provides the user with appropriate support information.

[0893] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0894] Step 1:

[0895] A user uses a device to search for how to operate a home appliance. Specifically, they open an application on their smartphone or PC and enter a search query such as "how to set the refrigerator temperature" in the search bar. The entered search query becomes the input data for the device.

[0896] Step 2:

[0897] The device sends the search query entered by the user to the server. Specifically, it sends data to the " / search" endpoint using an HTTP POST request. At this time, the search query is sent to the server as part of the request. The input data is the search query, and the output data is the request to the server.

[0898] Step 3:

[0899] The server searches the database based on the received search query. Specifically, it uses an SQL query to retrieve the relevant manual information from the database. For example, it executes the SQL query "SELECT FROM manuals WHERE appliance="refrigerator" AND topic="temperature setting". The input data is the search query, and the output data is the relevant manual information.

[0900] Step 4:

[0901] The server sends the manual information retrieved from the database to the terminal in JSON format. Specifically, it returns data like this as an HTTP response: {"appliance": "Refrigerator", "topic": "Temperature setting", "content": "How to set the refrigerator temperature..."}. The input data is the manual information retrieved from the database, and the output data is a JSON-formatted response.

[0902] Step 5:

[0903] The terminal displays the manual information received from the server to the user. Specifically, it displays the text "To set the refrigerator temperature..." on the application UI. The input data is the response from the server, and the output data is the information displayed to the user.

[0904] Step 6:

[0905] The user operates the appliance based on the information displayed on the terminal. Specifically, the refrigerator's operation panel is used to adjust the temperature. The input data is the manual information displayed on the terminal, and the output data is the setting changes of the appliance.

[0906] (Application example 1)

[0907] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0908] Modern homes have a wide variety of home appliances, each of which requires its own corresponding manual. However, these manuals are often provided in paper form, which means there is a risk of them being lost or damaged. Furthermore, when a user needs to quickly learn how to operate or troubleshoot a specific home appliance, it can take a long time to find the relevant manual. Furthermore, for users with low IT literacy, searching for information on the Internet is difficult in itself. To solve these problems, a system is needed that centrally manages home appliance manual information and provides it to users quickly and easily.

[0909] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0910] In this invention, the server includes: means for storing various manuals for individually owned home appliances and the like in addition to online information; means for providing customer-oriented support; means for reading information such as update information and support expiration dates; means for hedging security and warranty risks; means for providing services using natural language to anyone, regardless of age or gender, including those with low IT literacy; means for reducing opportunity losses to related suppliers or for enabling new proposals through reverse auctions; means for users to search for manual information for specific home appliances via an application installed on their smartphones and provide the relevant information; and means for quickly providing users with manual information retrieved from the database. This allows users to easily search for home appliance manual information using their smartphones and quickly obtain the information they need.

[0911] "Online information" is a general term for data and content that can be accessed via the Internet.

[0912] "Home appliances" is a general term for electrical appliances used in the home.

[0913] A "manual" is a document that describes how to use a product and operating procedures.

[0914] A database is a collection of information that is systematically organized and stored so that it can be efficiently searched and used.

[0915] "Support" is a general term for services and features that assist users in using the product properly.

[0916] "Update Information" means information about the latest changes and additions to a product or software.

[0917] "Support period" means the period during which support is provided for a product or service.

[0918] "Security" refers to the means and measures taken to protect information and systems from unauthorized access and data leakage.

[0919] "Warranty" is a system that guarantees the quality and performance of products and services for a certain period of time.

[0920] "Hedging risk" means taking measures to reduce or avoid a predicted risk.

[0921] "Natural language" refers to the language used by humans on a daily basis, not a specific programming language or technical term.

[0922] "IT literacy" refers to the ability to understand and appropriately utilize information technology.

[0923] "Supplier" means a supplier or trader of products or services.

[0924] "Opportunity cost" refers to benefits or results that are not obtained because a certain choice is not made.

[0925] A "reverse auction" is an auction format in which a buyer presents desired conditions and multiple sellers bid lower to meet those conditions.

[0926] A "smartphone" is a highly functional mobile phone that can connect to the Internet and use applications.

[0927] An "application" is a software program that provides a particular function or service.

[0928] "User" means a person who uses a product or service.

[0929] As an embodiment of the present invention, a "smart home appliance support app" installed on a smartphone is used. A specific implementation method thereof will be described below.

[0930] System Configuration

[0931] This system uses the following hardware and software:

[0932] Hardware: Smartphone

[0933] Software: Flask (web framework), SQLite (database management system)

[0934] Program processing

[0935] The server uses the Flask framework to build a web application. It uses SQLite as the database to store home appliance manual information. When a user searches for manual information for a specific home appliance, they send a request to the server via a smartphone application. The server searches the database for the relevant information and provides it to the user.

[0936] Data processing and calculation

[0937] Data processing: Receives a request from the user and searches the database for the relevant manual information.

[0938] Data Calculation: Uses SQL queries to retrieve information from a database and return it to the user.

[0939] Specific examples

[0940] If a user wants to know how to set the temperature on a refrigerator, they open the smartphone application and type in "how to set the temperature on a refrigerator." The application sends this request to the server, which then searches the database for the relevant manual information and provides it to the user.

[0941] Prompt Sentence Examples

[0942] How do I set the temperature in my refrigerator?

[0943] In this way, users can easily search for manual information for home appliances using their smartphones and quickly obtain the information they need.

[0944] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0945] Step 1:

[0946] A user opens a smartphone application and inputs a prompt to search for manual information for a specific appliance. For example, they input, "How do I set the temperature on my refrigerator?" This input is sent to the application.

[0947] Step 2:

[0948] The device (smartphone application) receives the user's input and sends a request to the server. This request includes the prompt text entered by the user. Specifically, it is sent to the server as an HTTP request.

[0949] Step 3:

[0950] The server analyzes the received request and extracts search keywords from the prompt. For example, it extracts the keywords "refrigerator" and "temperature setting method." This analysis may use natural language processing techniques.

[0951] Step 4:

[0952] The server executes an SQL query based on the extracted keywords to search for the corresponding manual information. The database stores manual information for home appliances. The corresponding manual information is retrieved as a result of the SQL query execution.

[0953] Step 5:

[0954] The server formats the retrieved manual information and generates a response to return to the user. This response contains the specific manual information the user is looking for. For example, it may contain detailed instructions on how to set the refrigerator temperature.

[0955] Step 6:

[0956] The device (smartphone application) receives the response from the server and displays it to the user, who can then check the relevant manual information on the application screen.

[0957] Step 7:

[0958] The user operates the appliance based on the displayed manual information. For example, to change the temperature setting of a refrigerator. In this way, the user can quickly obtain the necessary information and operate the appliance appropriately.

[0959] Example 2

[0960] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0961] Many consumers today have difficulty understanding update information and support expiration dates for their electronic devices, which can lead to security and warranty risks. Furthermore, users with low IT literacy find it even more difficult to properly manage this information. Furthermore, this can result in opportunity losses for suppliers. To solve these issues, a system is needed that notifies users of update information and support expiration dates in a timely manner.

[0962] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes: a means for storing various instruction manuals for electronic devices owned by individuals in addition to online information; a means for providing personalized support to the customer; a means for reading information such as update information and support expiration dates; a means for reducing security and warranty risks; a means for providing information in natural language to anyone, regardless of age or gender, including those with low IT literacy; a means for reducing opportunity losses to related suppliers or enabling new proposals through reverse auctions; a means for periodically checking information stored in a database and acquiring relevant information; a means for analyzing the acquired information and extracting relevant information; and a means for generating and transmitting notifications based on the extracted information. This allows users to properly understand update information and support expiration dates for their electronic devices and reduce security and warranty risks. It also reduces opportunity losses for suppliers and increases opportunities for new proposals.

[0963] "Online information" refers to data and content accessible via the Internet.

[0964] "Electronic devices" refer to devices or equipment that operate using electricity.

[0965] An "instruction manual" refers to a document that describes how to use and precautions for electronic devices and other products.

[0966] "Customer-oriented support" refers to providing appropriate support according to the user's needs and situation.

[0967] "Update Information" refers to new versions or modifications of software or hardware.

[0968] "Support Period" refers to the period for which warranty or support is provided for a product or service.

[0969] "Security risk" refers to the possibility that information or systems may be exposed to threats such as unauthorized access or data leakage.

[0970] "Warranty risk" refers to the possibility that a product or service will malfunction or fail within the warranty period.

[0971] "Information technology literacy" refers to the ability to understand and use information technology appropriately.

[0972] "Supplier" refers to a company or individual that provides a product or service.

[0973] "Opportunity loss" refers to profits or results that are not obtained because appropriate responses or actions were not taken.

[0974] A "reverse auction" is an auction format in which the seller lowers the price.

[0975] "Database" refers to a system for efficiently managing, searching, and updating data.

[0976] "Analysis" refers to examining data in detail to find meaning and patterns.

[0977] "Notification" refers to a message or alert that informs a user of specific information.

[0978] This invention is a system for appropriately managing update information and support expiration dates for electronic devices owned by users, thereby reducing security risks and warranty risks. This system is composed of elements such as a server, a terminal, and a user.

[0979] Server Roles

[0980] The server uses the following hardware and software to manage and process data.

[0981] Hardware: Server equipment with a powerful processor, sufficient memory, and storage

[0982] Software: Database management systems such as MySQL or PostgreSQL, programming languages ​​such as Python or Java, and notification services such as SendGrid or Firebase Cloud Messaging

[0983] The server periodically accesses the database to check information such as update information, support expiration dates, etc. For example, the server checks the database at 2:00 AM every day to obtain update information or records whose support expiration dates are approaching.

[0984] The server then analyzes the information and extracts relevant information. This process is performed using a Python script that uses the pandas library to process the data. For example, it extracts information about appliances whose support period expires within the next 30 days.

[0985] Finally, the server uses the extracted information to generate and send notifications to customers, using SendGrid's API to generate email content and send it to customers, including details about the appliances that are nearing the end of their support life.

[0986] Device Role

[0987] The device refers to the electronic device or computer owned by the user, and is responsible for receiving notifications from the server. The device displays the notifications sent from the server using an email client or push notification application.

[0988] User Roles

[0989] The user receives the notification from the server and takes necessary action, such as updating an appliance whose support period is approaching or applying for an extension of the warranty.

[0990] Specific examples

[0991] For example, if a customer owns a refrigerator and their support is due to expire in 30 days, the server checks the database to retrieve that information, then runs a Python script to extract the relevant information and uses SendGrid to send an email notification to the customer.

[0992] Example prompts for generative AI models

[0993] Describe a system that notifies customers when their appliances are nearing the end of their support life. Include detailed instructions for periodically checking a database, extracting the information, and generating and sending the notification. Include the names of the hardware and software involved.

[0994] In this way, the system can notify users of important updates and support expiration dates, reducing security and warranty risks.

[0995] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0996] Step 1: Regularly check your database

[0997] The server periodically accesses the database to check information such as update information, support expiration dates, etc. This process is scheduled to be executed, for example, at 2:00 AM every day.

[0998] Input: Database connection information, query

[0999] Output: Records with upcoming renewal information or support expiration

[1000] What happens: The server uses a cron job to run a Python script called db_check.py every day at 2 AM. db_check.py connects to a MySQL database and runs the following query:

[1001] sql

[1002] SELECT FROM support_info WHERE support_end_date <= CURDATE() + INTERVAL 30 DAY;

[1003] Step 2: Extracting information

[1004] The server parses the information retrieved from the database and extracts the relevant information, using a Python script.

[1005] Input: Records retrieved from the database

[1006] Output: Information on appliances whose support period expires within the next 30 days

[1007] What happens: The server runs a Python script called data_extract.py, which loads the retrieved data into a pandas data frame. The data frame is then filtered to extract information about appliances whose support period expires within the next 30 days:

[1008] python

[1009] import pandas as pd

[1010] df = pd.read_sql(query_result, connection)

[1011] filtered_df = df[df['support_end_date'] <= pd.Timestamp.now() + pd.DateOffset(days=30)]

[1012] Step 3: Generate and send notifications

[1013] The server uses the extracted information to generate and send notifications to customers, using SendGrid's API.

[1014] Input: Extracted appliance information, customer email address

[1015] Output: Notification email sent to customer

[1016] What happens: The server runs a Python script called send_notification.py, which uses SendGrid's API to send an email. The email content is generated as follows:

[1017] python

[1018] import sendgrid

[1019] from sendgrid.helpers.mail import Mail

[1020] sg = sendgrid.SendGridAPIClient(api_key='YOUR_SENDGRID_API_KEY')

[1021] for index, row in filtered_df.iterrows():

[1022] message = Mail(

[1023] from_email='noreply@example.com',

[1024] to_emails=row['customer_email'],

[1025] subject='Support expiration notice',

[1026] plain_text_content=f"The support period for your appliance ({row['product_name']}) will expire on {row['support_end_date']}."

[1027] )

[1028] sg.send(message)

[1029] In this way, the system can notify users of important updates and support expiration dates, reducing security and warranty risks.

[1030] (Application example 2)

[1031] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1032] Many users today have difficulty understanding update information and support expiration dates for their home appliances and devices, which increases security and warranty risks. Furthermore, users with low IT literacy find it even more difficult to properly manage this information. Furthermore, this can result in opportunity losses for related suppliers.

[1033] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: a means for storing various manuals for individual home appliances and the like in addition to online information; a means for providing personalized support to the customer; a means for reading information such as update information and support expiration dates; a means for hedging security and warranty risks; a means for providing services using natural language to anyone, regardless of age or gender, including those with low IT literacy; a means for reducing opportunity losses to related suppliers or enabling new proposals through reverse auctions; a means for accessing a database and acquiring update information and support expiration dates; a means for notifying users based on the acquired information; and a means for evaluating security risks based on the update information and support expiration dates and sending emergency notifications. This allows users to properly manage update information and support expiration dates for their devices and software and prevent security and warranty risks.

[1034] "Online information" refers to data and materials that can be accessed via the Internet.

[1035] "Home appliances" is a general term for electrical appliances used in the home.

[1036] A "manual" is a document that describes how to use a product or service and the operating procedures.

[1037] A "database" is a system for efficiently managing, searching, and updating data.

[1038] "Update Information" means information about new versions and patches for software or devices.

[1039] "Support end date" is the date on which manufacturer or provider support for a product or service ends.

[1040] "Security risk" refers to the possibility that information systems and devices may be exposed to threats such as unauthorized access and data leakage.

[1041] "Warranty risk" refers to the risk that arises when the warranty period for a product or service expires.

[1042] "Natural language" refers to the language used by humans on a daily basis, often translated into a form that is easy for computers to understand.

[1043] "IT literacy" refers to the ability to understand and use information technology appropriately.

[1044] "Supplier" means a company or individual that provides products or services.

[1045] "Opportunity cost" refers to the potential gain lost by not making a choice.

[1046] A "reverse auction" is a type of auction in which a buyer submits a price and multiple sellers compete based on that price.

[1047] A "notification" is a message or alert that informs the user of specific information.

[1048] "Emergency notifications" are messages or alerts that inform users of important information that requires immediate action.

[1049] As an embodiment of the present invention, the following system is constructed.

[1050] System Overview

[1051] This system manages update information and support expiration dates for devices and software owned by users, and prevents security and warranty risks. The system consists of a server, user terminals (such as smartphones and smart glasses), and a database.

[1052] Program processing

[1053] The server performs the process using the following means.

[1054] 1. Database access method:

[1055] The server accesses the database to obtain update information and support expiration dates for devices and software registered by the user. This database also stores manual information for the home appliances and devices owned by the user.

[1056] 2. Means of notification:

[1057] The server notifies the user based on the acquired update information and support expiration date. Notifications are sent via push notification or email. For example, if the support expiration date is approaching, the server sends the user a message saying, "Your device's support expiration date is approaching."

[1058] 3. Security Risk Assessment Tools:

[1059] The server evaluates security risks based on update information and support expiration dates. If the risk is deemed high, an emergency notification is sent. For example, if an important security patch has not been applied, a message is sent to the user stating, "There is an important security update for your device. Please update immediately."

[1060] Hardware and software used

[1061] Hardware:

[1062] Server: Server for managing the database and sending notifications

[1063] User devices: smartphones, smart glasses, etc.

[1064] software:

[1065] Database management systems (e.g., SQLite)

[1066] Email sending library (e.g. smtplib)

[1067] Push notification service (e.g. Firebase Cloud Messaging)

[1068] Specific examples

[1069] For example, if a user's smartphone's support expiration date is approaching within 30 days, the system will send a notification like this:

[1070] Prompt Sentence Examples

[1071] If a user's smartphone is within 30 days of reaching the end of its support life, send them a notification like this:

[1072] "Your device [device name] is nearing the end of its support life [support end date]."

[1073] In this way, users can keep track of update information and support expiration dates for their devices and software, and prevent security and warranty risks before they occur.

[1074] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1075] Step 1:

[1076] The server periodically accesses the database to retrieve update information and support expiration dates for devices and software registered by the user. User IDs and device IDs are required as input, and update information and support expiration dates for the corresponding devices and software are obtained as output. This process involves executing a database query to extract the required information.

[1077] Step 2:

[1078] The server analyzes the acquired update information and support expiration dates and determines whether or not the user needs to be notified. The input is the update information and support expiration dates acquired in step 1, and the output is a list of devices and software that require notification. In this process, the update information and support expiration dates are compared to evaluate whether they meet the notification criteria.

[1079] Step 3:

[1080] The server notifies the user of information about devices and software that are determined to require notification. The input is the list of devices and software that require notification obtained in step 2, and the output is the notification message to be sent to the user. This process uses an email sending library or push notification service to send the notification to the user.

[1081] Step 4:

[1082] The server evaluates the security risk based on the update information and support expiration date. The input is the update information and support expiration date obtained in step 1, and the output is the security risk assessment result. In this process, an algorithm is run to analyze the update information and support expiration date and evaluate the risk level.

[1083] Step 5:

[1084] If the server determines that the risk is high, it sends an emergency notification to the user. The security risk assessment result obtained in step 4 is required as input, and the emergency notification message to be sent to the user is obtained as output. This process uses an email sending library or push notification service to send the emergency notification.

[1085] Step 6:

[1086] The user takes necessary steps for updates or support based on the received notifications or emergency notifications. The input is the notification message sent from the server, and the output is the update or support procedure to be carried out by the user. In this process, the user checks the notification content and takes appropriate action.

[1087] Example 3

[1088] Next, a description will be given of Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1089] Providing support for today's diverse range of electronic devices is difficult to do efficiently and effectively due to differences in users' IT literacy and the scattering of manual information for each device. While there is a demand for prompt provision of appropriate manual information in response to customer inquiries, this has been difficult to achieve with conventional systems. Furthermore, a means is needed to reduce opportunity losses for related suppliers and enable new proposals.

[1090] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[1091] In this invention, the server includes: a means for storing various manuals for electronic devices owned by individuals in addition to online information; a means for providing personalized support to the customer; a means for reading information such as update information and support expiration dates; a means for hedging security and warranty risks; a means for providing support using natural language to anyone, regardless of age or gender, including those with low IT literacy; a means for analyzing inquiries from customers in natural language and providing appropriate manual information; a means for analyzing inquiries using a generative AI model; a means for searching for manual information from a database based on the analysis results; and a means for reducing opportunity losses to related suppliers or enabling new proposals through reverse auctions. This makes it possible to provide prompt and appropriate support regardless of the user's IT literacy.

[1092] "Online information" refers to data and content accessible via the Internet.

[1093] "Electronic devices" refer to devices or equipment that operate using electricity.

[1094] "Manual" refers to a document that describes how to use or operate a particular product or service.

[1095] "Support" means assistance and advice provided to Customer in using a Product or Service.

[1096] "Updates" means recent changes or additions to products or services.

[1097] "Support Period" refers to the period during which support is provided for a product or service.

[1098] "Security" refers to measures to protect information and systems from unauthorized access and attacks.

[1099] "Warranty" means any guarantee of quality or performance provided for a product or service.

[1100] "Natural language" refers to a language that humans use on a daily basis.

[1101] "IT literacy" refers to the ability to understand and use information technology appropriately.

[1102] A "generative AI model" refers to a model that uses artificial intelligence to analyze data and generate results.

[1103] A "prompt sentence" refers to an instruction sentence to be input into a generative AI model.

[1104] A "database" refers to a system for systematically organizing data and efficiently searching and managing it.

[1105] "Supplier" refers to a company or individual that provides a product or service.

[1106] "Opportunity loss" refers to the loss that occurs when a business opportunity is missed.

[1107] A "reverse auction" is an auction format in which a buyer presents their desired terms and multiple sellers make competitive bids.

[1108] The present invention provides a system that allows a user to make inquiries about the operation and settings of an electronic device in natural language and provides appropriate manual information in response to the inquiries. Specific embodiments of this system will be described below.

[1109] Server Roles

[1110] The server plays a central role in receiving and analyzing natural language queries from users and providing appropriate manual information. The server uses the following hardware and software:

[1111] Hardware: A server machine with a powerful processor, sufficient memory, and storage.

[1112] Software: Generative AI models (e.g., OpenAI's GPT-4), database management systems (e.g., MySQL)

[1113] When the server receives a user inquiry, it analyzes the inquiry using the generative AI model. Based on the analysis results, it searches for appropriate manual information from the database and provides it to the user.

[1114] Device Role

[1115] A terminal is a device that allows users to enter queries in natural language and receive and display the results. The terminal uses the following hardware and software:

[1116] Hardware: Personal computers, smartphones, tablets, etc.

[1117] Software: Web browser, dedicated application

[1118] The terminal transmits the query entered by the user to the server, receives the analysis results and manual information returned from the server, and displays them.

[1119] User Roles

[1120] Users can use a terminal to input inquiries in natural language, check the provided manual information, and perform operations. Users do not need special IT literacy and can make inquiries in everyday language.

[1121] Specific examples

[1122] For example, if a user types "I want to lower the refrigerator temperature" into the device, the device sends this query to the server. The server uses a generative AI model to analyze the query and search a database for manual information on how to set the refrigerator temperature. The server sends the search results back to the device, which then displays the information to the user.

[1123] Prompt Sentence Examples

[1124] An example of a prompt sentence to parse the query "I want to lower the temperature of the refrigerator" and provide appropriate manual information:

[1125] User inquiry: "I want to lower the temperature in my refrigerator."

[1126] Prompt for generative AI model: "The user wants to lower the refrigerator temperature. Please provide the manual information on how to set the refrigerator temperature."

[1127] By inputting this prompt sentence into the generative AI model, appropriate manual information can be acquired and provided to the user. The flow of the identification process in the third embodiment will be described with reference to FIG.

[1128] Step 1:

[1129] User query input

[1130] The user inputs a query in natural language into an input field on the terminal, for example, "I want to lower the temperature of the refrigerator."

[1131] Input: User's natural language query

[1132] Output: Query data sent to the terminal

[1133] Specific operation: The user uses the device's keyboard or touch screen to input the inquiry.

[1134] Step 2:

[1135] Submit an inquiry

[1136] The terminal transmits a natural language query entered by the user to the server.

[1137] Input: User query data

[1138] Output: HTTP request sent to the server

[1139] Specific operation: The terminal formats the query data as an HTTP request and sends it to the server's API endpoint.

[1140] Step 3:

[1141] Receiving inquiries

[1142] The server receives a natural language inquiry sent from the terminal.

[1143] Input: HTTP request from the terminal

[1144] Output: Query data to be analyzed

[1145] Specific operation: The server receives an HTTP request and extracts the query content.

[1146] Step 4:

[1147] Query Analysis

[1148] The server uses the generative AI model to analyze the received query.

[1149] Input: Query data to be analyzed

[1150] Output: Analysis results (intention of inquiry and related information)

[1151] Specific operation: The server inputs the query content into the generative AI model as a prompt sentence and obtains the analysis results.

[1152] Step 5:

[1153] Searching for manual information

[1154] The server searches the database for appropriate manual information based on the analysis results.

[1155] Input: Analysis results

[1156] Output: Searched manual information

[1157] Specific operation: The server executes a database query using the analysis result as a key to obtain related manual information.

[1158] Step 6:

[1159] Providing manual information

[1160] The server transmits the retrieved manual information to the terminal for provision to the user.

[1161] Input: Searched manual information

[1162] Output: HTTP response sent to the device

[1163] Specific operation: The server formats the acquired manual information as an HTTP response and sends it to the terminal.

[1164] Step 7:

[1165] Receive analysis results and manual information

[1166] The terminal receives the analysis results and manual information returned from the server.

[1167] Input: HTTP response from the server

[1168] Output: Manual information displayed to the user

[1169] Specific operation: The terminal receives the HTTP response, analyzes the contents, and displays them.

[1170] Step 8:

[1171] Viewing manual information

[1172] The terminal displays the received manual information to the user.

[1173] Input: Parsed manual information

[1174] Output: Information displayed to the user

[1175] Specific operation: The terminal displays the received information on a GUI (graphical user interface).

[1176] Step 9:

[1177] Executing an operation

[1178] The user performs the operation according to the displayed manual information.

[1179] Input: Displayed manual information

[1180] Output: User operation result

[1181] Specific operation: The user operates the refrigerator temperature setting button to lower the temperature.

[1182] (Application example 3)

[1183] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1184] Today's consumers want to quickly and accurately obtain information about products and services in physical stores. However, traditional methods require direct inquiries to store staff, which may not be able to respond or provide the appropriate information. There is also a need for a method to easily provide information to customers with low IT literacy. Furthermore, there is a lack of systems that provide appropriate manuals and guidance information in response to customer questions in stores.

[1185] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means. In this invention, the server includes a means for storing various manuals for individually owned home appliances and the like in addition to online information, a means for providing support tailored to the customer, a means for reading information such as update information and support expiration dates, a means for hedging security and warranty risks, a means for providing information using natural language that can be provided to people of all ages and genders, including those with low IT literacy, a means for reducing opportunity losses for related suppliers, a means for customers in physical stores to input questions in natural language using their smartphones and receive appropriate manual information and in-store guidance information, and a means for generating appropriate answers to customer questions using a generative AI model. This enables customers in physical stores to obtain information quickly and accurately.

[1186] "Online information" is a general term for data and content that can be accessed via the Internet.

[1187] "Home appliances" is a general term for electrical appliances used in the home.

[1188] A "manual" is a document that explains how to use a product or service and provides instructions on how to use it.

[1189] "Customer-oriented support" refers to providing appropriate assistance according to the customer's needs and situation.

[1190] "Updates" means the latest information or changes regarding products or services.

[1191] "Support Life" refers to the period for which support is provided for a product or service.

[1192] "Security" refers to protecting information and systems from unauthorized access and attacks.

[1193] "Hedging warranty risk" refers to mitigating the risks associated with warranties on products and services.

[1194] "Natural language" refers to the language used by humans on a daily basis, not a specific programming language or technical term.

[1195] "IT literacy" refers to the ability to understand and effectively use information technology.

[1196] "Supplier" refers to a company or individual that provides products or services.

[1197] "Reducing opportunity loss" means not missing out on business opportunities.

[1198] A "reverse auction" refers to an auction format in which a buyer submits a price and multiple sellers compete based on that price.

[1199] "Brick and Mortar Store" means a retailer that has a physical location.

[1200] A "smartphone" refers to a mobile phone that can connect to the Internet and use applications.

[1201] "Entering a question in natural language" refers to a user entering a question using everyday language.

[1202] A "generative AI model" refers to an algorithm that uses artificial intelligence to generate appropriate answers or information from data.

[1203] "Appropriate manual information" refers to manual content that is accurate and useful in answering a user's question.

[1204] "In-store guidance information" refers to information about the location of products and service locations within a physical store.

[1205] As an embodiment of the present invention, a system is constructed in which customers in a physical store input questions in natural language using a smartphone and are provided with appropriate manual information and in-store guidance information. A specific embodiment of this system is described below.

[1206] System Configuration

[1207] This system uses the following hardware and software:

[1208] Hardware: Smartphones, servers

[1209] Software: Python, spaCy, OpenAI GPT-3

[1210] Program processing

[1211] The server includes the following means:

[1212] 1. A means of storing various manuals for personal home appliances, etc., in addition to online information:

[1213] The server stores the manual information in a database and searches and retrieves it as needed.

[1214] 2. Ways to provide customer-focused support:

[1215] The server analyzes the customer's question in natural language and provides appropriate manual information and guidance information.

[1216] 3. How to read information such as update information and support expiration date:

[1217] The server periodically checks the information stored in the database, such as update information and support expiration dates, and acquires the relevant information.

[1218] 4. Means of hedging security and guarantee risks:

[1219] The server implements security measures to mitigate risks associated with the warranty.

[1220] 5. A method that can be provided to people of all ages and genders, including those with low IT literacy, using natural language:

[1221] The server uses natural language processing technology to provide an interface that is also suitable for customers with low IT literacy.

[1222] 6. Measures to reduce opportunity losses for related suppliers:

[1223] The server provides appropriate information to suppliers, reducing opportunity loss.

[1224] 7. A method for customers in physical stores to input questions in natural language using their smartphones and receive appropriate manual information and in-store guidance information:

[1225] When a customer enters a question using a smartphone, the question is sent to the server, which analyzes the question and generates the appropriate information.

[1226] 8. How to use generative AI models to generate relevant answers to customer questions:

[1227] The server uses OpenAI GPT-3 to generate appropriate answers to customer questions.

[1228] Specific examples

[1229] For example, if a customer asks, "What is the most popular item in this store?", the server sends the following prompt to the generative AI model:

[1230] Example prompt sentence:

[1231] Customer Question: What is the most popular item in this store?

[1232] Please provide the appropriate documentation information.

[1233] Based on this prompt, the generative AI model generates the following answer:

[1234] The most popular item at this store is the "XYZ brand smartphone," which is especially popular for its high-performance camera and long battery life.

[1235] In this way, customers can get fast and relevant information for their questions in-store.

[1236] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[1237] Step 1:

[1238] A user inputs a question using a smartphone. The input question is sent to a server by an application on the smartphone. The input data is a question in the user's natural language.

[1239] Step 2:

[1240] The server analyzes the received question using a natural language processing library (e.g., spaCy). As a result of the analysis, the intent and keywords of the question are extracted. The input data is the user's question, and the output data is the analyzed intent and keywords of the question.

[1241] Step 3:

[1242] The server generates a prompt for a generative AI model (e.g., OpenAI GPT-3) based on the analyzed question intent and keywords. The generated prompt is used as input to obtain an appropriate answer to the question. The input data is the analyzed question intent and keywords, and the output data is the generated prompt.

[1243] Step 4:

[1244] The server sends the generated prompt sentence to the generative AI model, which generates an appropriate answer. The generative AI model generates an answer based on the prompt sentence and returns it to the server. The input data is the generated prompt sentence, and the output data is the generated answer.

[1245] Step 5:

[1246] The server sends the generated answer to the user's smartphone. The user checks the answer through the smartphone application. The input data is the generated answer, and the output data is the answer displayed on the user's smartphone.

[1247] Step 6:

[1248] If the user enters an additional question, the process is repeated from step 1. This allows the user to ask consecutive questions and obtain the appropriate information.

[1249] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1250] "Example 1"

[1251] In one embodiment of the present invention, a system combining emotion engines is provided.

[1252] The system recognizes the user's emotions and provides support accordingly. Specifically, if the user feels confused, the system will provide more detailed explanations and guidance. If the user feels angry, the system will send an apology message and take prompt action to resolve the issue. In this way, the emotion engine improves the user experience by understanding the user's emotions and responding optimally accordingly.

[1253] "Example 2"

[1254] Another embodiment of the present invention provides a system incorporating an emotion engine. This system recognizes the user's emotions and adjusts the way manual information is provided accordingly. Specifically, if the user feels anxious, the system prioritizes providing the most important information. On the other hand, if the user feels relaxed, the system provides more detailed information. In this way, the emotion engine understands the user's emotions and adjusts the way information is provided accordingly, thereby improving the user experience.

[1255] "Example 3"

[1256] Furthermore, as another embodiment of the present invention, a system incorporating an emotion engine is provided. This system recognizes the user's emotions and adjusts the way in which information such as update information and support deadlines is provided accordingly. Specifically, when the user is feeling anxious, the system prioritizes providing information that provides a sense of security. Also, when the user is excited, the system provides new update information. In this way, the emotion engine understands the user's emotions and adjusts the way in which information is provided accordingly, thereby improving the user experience.

[1257] The processing flow of each embodiment will be described below.

[1258] "Example 1"

[1259] Step 1: The system recognizes the user's emotions using an emotion engine.

[1260] Step 2: The emotion engine determines that the user's emotion is confusion.

[1261] Step 3: The system provides more detailed instructions and guidance.

[1262] "Example 2"

[1263] Step 1: The system recognizes the user's emotions using an emotion engine.

[1264] Step 2: The emotion engine determines that the user's emotion is impatience.

[1265] Step 3: The system prioritizes the most important information.

[1266] "Example 3"

[1267] Step 1: The system recognizes the user's emotions using an emotion engine.

[1268] Step 2: The emotion engine determines that the user's emotion is anxiety.

[1269] Step 3: The system prioritizes providing information that provides reassurance.

[1270] Example 1

[1271] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1272] With conventional support systems for home appliances, it can be difficult to quickly and accurately provide the manual information users need. Furthermore, they are unable to provide support that responds to the user's emotions, which can result in a poor user experience. Furthermore, there is a need to provide appropriate support to users with low IT literacy. To solve these issues, a system is needed that quickly provides manual information based on user requests and responds in accordance with the user's emotions.

[1273] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1274] In this invention, the server includes means for storing various manuals for individual home appliances and the like in addition to online information, means for providing personalized support to the customer, means for reading information such as update information and support expiration dates, means for hedging security and warranty risks, means for providing services to people of all ages and genders, including those with low IT literacy, using natural language, means for reducing opportunity losses to related suppliers or enabling new proposals through reverse auctions, means for analyzing user sentiment and providing corresponding support, means for searching a database based on a user request and retrieving relevant manual information, means for providing the retrieved manual information to the user, means for generating an appropriate response based on the sentiment analysis results, and means for transmitting the generated response to the user's terminal. This makes it possible to respond quickly and accurately to user requests and provide optimal support tailored to the user's sentiment.

[1275] "Online information" refers to data and materials accessible via the Internet.

[1276] "Home appliances" refers to electrical appliances used in the home.

[1277] "Manual" refers to a document that describes how to use a product and operating procedures.

[1278] A "database" refers to a collection of information that is systematically organized and stored so that it can be efficiently searched and used.

[1279] "Support" means assistance and advice to enable a User to use the Product properly.

[1280] "Update Information" means information regarding new versions or modifications of products or software.

[1281] "Support Life" refers to the period during which support or warranty coverage for a product is in effect.

[1282] "Security" refers to measures to protect information and systems from unauthorized access and attacks.

[1283] "Warranty" refers to a manufacturer's promise regarding the quality or performance of a product.

[1284] "Natural language" refers to a language that humans use on a daily basis.

[1285] "IT literacy" refers to the ability to understand and use information technology appropriately.

[1286] "Supplier" refers to a company or individual that provides a product or service.

[1287] "Opportunity cost" refers to benefits that are not obtained by not making a certain choice.

[1288] A "reverse auction" refers to an auction format in which buyers state a price and sellers compete according to that price.

[1289] "Sentiment analysis" refers to the technology of identifying and analyzing emotions from a user's text or voice.

[1290] A "response" refers to a reply or response to a user request.

[1291] "Terminal" refers to a device that allows a user to input or receive information.

[1292] This invention is a system that centrally manages manual information for home appliances owned by users and provides appropriate support in response to user requests. The system has a database that stores online information and the manuals for the home appliances owned by users. Furthermore, by combining it with an emotion engine, it provides support that responds to the user's emotions.

[1293] The server uses a database server (e.g., MySQL server) to store and manage manual information for home appliances. When a user sends a request from a device (smartphone, tablet, PC, etc.), the server receives the request and searches the database to retrieve the relevant manual information. For example, if a user types, "Please tell me how to set the temperature on my refrigerator," the server searches the database for refrigerator manual information and retrieves that information.

[1294] The server uses an emotion engine (e.g., IBM Watson Tone Analyzer) to analyze the emotion from the user's input text. Based on the results of the emotion analysis, the server generates an appropriate response. For example, if the server determines that the user is confused, it generates a response that includes a more detailed explanation or guidance. If the server determines that the user is angry, it generates a response that includes an apology message.

[1295] The generated response is sent from the server to the user's device, where the user can check the response and receive the necessary information or support.

[1296] As a concrete example, consider a case where a user wants to know how to set the temperature on a refrigerator. If the user types, "Please tell me how to set the temperature on my refrigerator," the server will search the database for the relevant manual information and provide that information to the user. If the user also types, "My refrigerator isn't cooling," the emotion engine will recognize the user's confusion, and the server will provide a detailed troubleshooting guide.

[1297] Example prompt sentence:

[1298] How do I set the temperature in my refrigerator?

[1299] "What does the washing machine error code E1 mean?"

[1300] "My air conditioner isn't working, what should I do?"

[1301] In this way, the server can respond quickly and accurately to the user's requests and provide optimal support according to the user's feelings.

[1302] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1303] Step 1:

[1304] The user sends a request from the terminal.

[1305] A user inputs a question about how to operate or troubleshoot a specific appliance from their device (e.g., smartphone, tablet, PC, etc.), for example, "How do I set the temperature on my refrigerator?" The input request is sent to the server.

[1306] Step 2:

[1307] The server receives the request and searches the database.

[1308] The server receives a request from the user. It analyzes the received request and identifies the required information. The server then searches a database (e.g., MySQL server) to find the manual information for the relevant home appliance. The input is the user request, and the output is the relevant manual information.

[1309] Step 3:

[1310] The server retrieves the relevant manual information.

[1311] The server retrieves the relevant manual information from the database. For example, it retrieves information about how to set the temperature of a refrigerator. The retrieved manual information is used in the next processing step. The input is the database search result, and the output is the retrieved manual information.

[1312] Step 4:

[1313] The server analyzes the user's emotions using an emotion engine.

[1314] The server uses an emotion engine (e.g., IBM Watson Tone Analyzer) to analyze the emotion from the user's input text. It determines whether the user is confused, angry, etc. The input is the user's request text, and the output is the emotion analysis result.

[1315] Step 5:

[1316] The server generates an appropriate response based on the analysis results.

[1317] The server generates an appropriate response based on the analysis results of the emotion engine. For example, if the server determines that the user is confused, it generates a response with more detailed explanations and guidance. If the server determines that the user is angry, it generates a response with an apology message. The input is the emotion analysis result and the obtained manual information, and the output is the generated response.

[1318] Step 6:

[1319] The server sends the response to the user's terminal.

[1320] The server sends the generated response to the user's device. The response includes the relevant manual information and a message corresponding to the emotion. The input is the generated response, and the output is the response sent to the user's device.

[1321] Step 7:

[1322] The user checks the response on the device.

[1323] The user checks the response sent by the server on their device, for example, detailed instructions on how to set the refrigerator temperature or additional guidance if they are confused. The input is the response sent by the server, and the output is the information checked by the user.

[1324] (Application example 1)

[1325] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1326] Today's consumers own a wide variety of home appliances, making it difficult to manage the manual information for each product individually. Furthermore, when customers in physical stores ask about how to use or set up their appliances, they need to be able to provide prompt and appropriate support. Furthermore, being able to recognize customers' emotions and provide support that responds to them can improve customer satisfaction. However, current systems are unable to adequately resolve these issues.

[1327] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means. In this invention, the server includes: a means for storing various manuals for home appliances owned by individuals in addition to online information; a means for providing personalized support to the customer; a means for reading information such as update information and support expiration dates; a means for hedging security and warranty risks; a means for providing services to people of all ages and genders, including those with low IT literacy, using natural language; a means for reducing opportunity losses to related suppliers or enabling new proposals through reverse auctions; a means for recognizing emotions and providing corresponding support; and a means for searching for and providing relevant manual information when a customer asks about how to use or set up a home appliance in a physical store. This allows for centralized management of manual information for the home appliances owned by the customer, enabling prompt and appropriate support in a physical store. Furthermore, recognizing customer emotions and providing corresponding support can improve customer satisfaction.

[1328] "Online information" is a general term for data and materials that can be accessed via the Internet.

[1329] "Home appliances" is a general term for electrical appliances used in the home.

[1330] A "manual" is a document that explains how to use and configure a product.

[1331] A "database" is a collection of information that is systematically organized and made available for efficient search and retrieval.

[1332] "Customer-oriented support" refers to providing appropriate assistance according to the customer's needs and situation.

[1333] "Updates" means the latest information or changes regarding products or services.

[1334] "Support Life" refers to the period for which support is provided for a product or service.

[1335] "Security" refers to measures to protect information and systems from unauthorized access and data leaks.

[1336] "Hedging warranty risk" refers to reducing the risks associated with warranties on products and services.

[1337] "Natural language" refers to a language that humans use on a daily basis.

[1338] "IT literacy" refers to the ability to understand and appropriately utilize information technology.

[1339] "Supplier" refers to a trader or company that provides products or services.

[1340] "Reducing opportunity loss" means not missing out on business opportunities.

[1341] A "reverse auction" is a type of auction in which a buyer presents their desired conditions and multiple sellers bid lower in accordance with those conditions.

[1342] "Emotion recognition" refers to determining a user's emotional state from their facial expressions and behavior.

[1343] "Brick and Mortar Store" means a retailer that has a physical location.

[1344] "How to use and set up home appliances" refers to the procedures and settings for using home appliances correctly.

[1345] The system for implementing this invention includes a database that stores various manuals for home appliances owned by individuals in addition to online information. The server centrally manages the manual information for home appliances owned by customers, enabling prompt and appropriate support to be provided in physical stores. Furthermore, an emotion engine is used to recognize customer emotions and provide support in response to those emotions, thereby improving customer satisfaction.

[1346] Hardware and software used

[1347] Hardware: Smartphones, servers

[1348] Software: Python, EmotionRecognizer library, ManualDatabase library

[1349] Data processing and calculation

[1350] The server performs the following process.

[1351] 1. Receiving user input: A customer types a question into a smartphone app. For example, "How do I set the temperature on my refrigerator?"

[1352] 2. Emotion Recognition: Use the EmotionRecognizer library to recognize the user's emotion. For example, if the user is confused, the emotion engine will recognize it as "confused."

[1353] 3. Searching for manual information: Using the ManualDatabase library, the database is searched for manual information for the relevant home appliance. For example, manual information on "how to set the temperature of a refrigerator" is searched for.

[1354] 4. Providing support: Generates appropriate support messages based on the recognized emotions. For example, if the user is confused, a message such as "We will provide detailed explanations" will be generated.

[1355] 5. Displaying the result: Providing the customer with manual information and support messages. For example, a support message will be displayed along with detailed instructions on "How to set the refrigerator temperature."

[1356] Specific examples

[1357] User Input: "How do I set the temperature on my refrigerator?"

[1358] Emotion recognition result: confused

[1359] Support message: "We will provide you with a detailed explanation."

[1360] Prompt Sentence Examples

[1361] A user asks, "How do I set the temperature on my refrigerator?" The user's emotion is confusion. Please provide a detailed explanation.

[1362] In this way, a smartphone application that strengthens customer support in brick-and-mortar stores can be realized. The server can quickly provide appropriate manual information in response to customer questions and use an emotion engine to provide support that responds to the customer's emotions, thereby improving customer satisfaction.

[1363] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1364] Step 1:

[1365] A user inputs a question into a smartphone app. For example, "How do I set the temperature on my refrigerator?" The input data is sent to the server in text format.

[1366] Step 2:

[1367] The server passes the received user question to the EmotionRecognizer library to recognize the user's emotion. The input data is the user's question text, and the output data is the recognized emotion (e.g., confusion, anger, joy). Specifically, it performs text analysis and classifies the emotion using an emotion model.

[1368] Step 3:

[1369] The server generates an appropriate support message based on the recognized emotion. For example, if the user is confused, a message such as "We will provide a detailed explanation" is generated. The input data is the recognized emotion, and the output data is the support message. Specifically, a message template corresponding to the emotion is selected and customized.

[1370] Step 4:

[1371] The server passes the user's question text to the ManualDatabase library, which searches the database for the manual information of the relevant home appliance. The input data is the user's question text, and the output data is the relevant manual information. Specifically, a keyword search is performed to extract relevant manual information.

[1372] Step 5:

[1373] The server combines the retrieved manual information with the generated support message and provides it to the user. The input data is the manual information and the support message, and the output data is the information displayed to the user. Specifically, the server integrates the manual information and the support message and displays them in a user-friendly format.

[1374] Step 6:

[1375] Users check the manual information and support messages provided through the smartphone app to understand how to set up and use the home appliance. The input data is the information sent from the server, and the output data is the user's understanding. Specifically, users view the information through the app interface and perform the necessary operations.

[1376] Example 2

[1377] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1378] Many users today have difficulty properly managing update information and support expiration dates for their electronic devices. Providing appropriate support is also required for users with low IT literacy. Furthermore, the lack of adjustment of information delivery methods based on the user's emotions results in a lack of improvement in the user experience. To solve these issues, a system is needed that integrates management of update information and support expiration dates, adjustment of information delivery methods based on emotion recognition, and support tailored to the user.

[1379] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1380] In this invention, the server includes a means for storing various manuals for electronic devices owned by individuals in addition to online information, a means for providing personalized support to users, a means for reading information such as update information and support expiration dates, a means for reducing security and warranty risks, a means for providing services using natural language to anyone, regardless of age or gender, including those with low IT literacy, a means for reducing opportunity losses to related suppliers or enabling new proposals through reverse auctions, and a means for recognizing users' emotions using an emotion engine and adjusting the information provision method. This makes it possible to appropriately manage update information and support expiration dates for users' electronic devices and adjust the information provision method according to their emotions. It is also possible to provide appropriate support to users with low IT literacy.

[1381] "Online information" refers to data and content accessible via the Internet.

[1382] "Electronic devices" is a general term for machines and devices that operate using electricity.

[1383] A "manual" is a document or guide that describes how to use or operate an electronic device.

[1384] "User" means any person or entity that uses a system or electronic device.

[1385] "Assistance" refers to support and help that enables users to use systems and electronic devices effectively.

[1386] "Update information" refers to information about new versions and patches for electronic devices and software.

[1387] "Support period" refers to the period during which any warranty or technical support provided for electronic equipment or software is valid.

[1388] "Security" refers to the measures and procedures for protecting systems and data from unauthorized access or attack.

[1389] "Warranty" means a guarantee of quality or performance provided for a product or service.

[1390] "Information technology literacy" refers to the ability to understand and effectively use information technology such as computers and the Internet.

[1391] "Supplier" means a company or organization that provides a product or service.

[1392] "Opportunity cost" refers to benefits or opportunities that are not obtained because a certain choice is not made.

[1393] A "reverse auction" is an auction in which sellers bid lower.

[1394] An "emotion engine" is a technology that recognizes the user's emotions and adjusts the system's behavior based on them.

[1395] "Information provision method" refers to the means or format of conveying information to users.

[1396] This invention is a system that stores various manuals for electronic devices owned by individuals in addition to online information, and provides personalized support to users. This system reads information such as update information and support expiration dates, reducing security and warranty risks. It also includes a means of providing support in natural language that can be used by people of all ages and genders, including those with low IT literacy, and includes a means of reducing opportunity losses for related suppliers and enabling new proposals through reverse auctions. Furthermore, it can recognize users' emotions using an emotion engine and adjust the way information is provided.

[1397] Server Processing

[1398] The server periodically checks the information stored in the database, such as update information and support expiration dates. A database management system such as MySQL is used for this process. The server executes queries based on a regular schedule to retrieve the relevant information. For example, if the support period for a customer's refrigerator is due to expire in one month, the server retrieves that information and generates a notification message. This process is often performed using Python scripts.

[1399] Terminal handling

[1400] The device receives the notification sent from the server and displays it to the user. This process is performed using an Android or iOS mobile application. The device provides information to the user through push notifications or in-app notifications. For example, a notification might be displayed saying, "Your refrigerator's support period will expire in one month. Please consider extending the warranty."

[1401] User Action

[1402] The user checks the notification displayed on the device and takes necessary action, such as extending the warranty on a refrigerator whose support period is approaching.

[1403] Emotion engine processing

[1404] The server runs an emotion engine to recognize the user's emotions. This process uses emotion analysis tools such as Google Cloud Natural Language API and IBM Watson. The server analyzes the user's input and behavioral data to identify emotions. For example, if the user frequently clicks the help button, it can determine that the user is impatient.

[1405] Adjusting how information is provided

[1406] The server adjusts how it presents manual information based on the user's emotions. For example, if it determines that the user is in a hurry, it will prioritize providing the most important information. This process involves logic that includes conditional branching.

[1407] Specific examples

[1408] 1. The server runs a scheduled task every day at 2:00 AM to check the support expiration date of all electronic devices in the database.

[1409] 2. The server obtains information about refrigerators whose support period will expire within one month and generates a notification message stating, "Your refrigerator's support period will expire in one month. Please consider extending the warranty."

[1410] 3. The server uses Firebase Cloud Messaging (FCM) to send the generated notification message to the user's smartphone.

[1411] 4. The device collects user input and behavior data and sends it to the server. For example, if the user frequently clicks the help button, that data is sent.

[1412] 5. The server uses the Google Cloud Natural Language API to determine that the user is impatient.

[1413] 6. The server is configured to provide the most important information to impatient users first.

[1414] 7. The device displays the message to the user: "Your refrigerator's support period expires in one month. Please apply for warranty extension now."

[1415] Prompt Sentence Examples

[1416] "Create a program that notifies the user when the refrigerator's support expires in a month. Also, if the user is in a hurry, prioritize the display of important information."

[1417] In this way, the roles of the server, terminal, and user are clarified, and a system that processes and calculates data using specific hardware and software has been described.

[1418] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1419] Step 1:

[1420] The server periodically checks the information stored in the database, such as update information and support expiration dates. As input, it retrieves information about all electronic devices in the database. It runs a query using a database management system (e.g., MySQL) to extract information about electronic devices whose support expiration date is approaching. As output, it obtains a list of electronic devices whose support expiration date will expire within the next month. Specifically, the server executes a scheduled task at 2:00 AM every day.

[1421] Step 2:

[1422] The server generates a notification message based on the obtained information. As input, it uses the list of electronic devices whose support expiration date is approaching obtained in step 1. It uses a Python script to generate a notification message for each electronic device. As output, it obtains a list of notification messages. Specifically, the server generates a message saying, "Your refrigerator's support expiration date will expire in one month. Please consider extending the warranty."

[1423] Step 3:

[1424] The server sends the generated notification message to the device. As input, it uses the list of notification messages generated in step 2. It uses Firebase Cloud Messaging (FCM) to send the notification message to the user's smartphone. As output, the notification is displayed on the user's device. Specifically, the server sends the notification message to FCM.

[1425] Step 4:

[1426] The device receives the notification sent from the server and displays it to the user. As input, it uses the notification message received from the server. It uses the device's mobile application (e.g., Android or iOS) to display a push notification or an in-app notification. As output, the notification is displayed to the user. Specifically, the device displays a notification saying, "Your refrigerator's support period will expire in one month. Please consider extending the warranty."

[1427] Step 5:

[1428] The user checks the notification displayed on the terminal and takes the necessary action. The notification message displayed on the terminal is used as input. The user checks the notification and completes the warranty extension procedure for the electronic device whose support expiration date is approaching. The output is that the warranty extension procedure is completed. As a specific operation, the user accesses the website for warranty extension and completes the procedure.

[1429] Step 6:

[1430] The terminal collects user input and behavioral data and sends it to the server. The user's operation log and behavioral data are used as input. The terminal collects data if the user frequently clicks the help button. The collected data is sent to the server as output. Specifically, the terminal periodically sends the user's operation log to the server.

[1431] Step 7:

[1432] The server uses an emotion engine to recognize the user's emotions. As input, it uses the user's behavioral data collected in step 6. It uses an emotion analysis tool such as Google Cloud Natural Language API or IBM Watson to identify the user's emotions. As output, it obtains the user's emotion information. Specifically, the server inputs the user's behavioral data into the emotion analysis tool to recognize emotions.

[1433] Step 8:

[1434] The server adjusts the method of providing manual information based on the recognized emotion. As input, it uses the user's emotion information obtained in step 7. It adjusts the method of providing information using logic including conditional branching. As output, it obtains the adjusted method of providing information. Specifically, the server sets up the system to provide the most important information to the impatient user.

[1435] Step 9:

[1436] The terminal displays the adjusted information to the user. As input, it uses the information provision method adjusted in step 8. It uses the mobile application on the terminal to display the information to the user. As output, the adjusted information is displayed to the user. Specifically, the terminal displays a message saying, "Your refrigerator's support period will expire in one month. Please apply for warranty extension now."

[1437] (Application example 2)

[1438] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1439] With conventional systems, it was difficult to properly manage update information and support expiration dates for home appliances owned by customers, which led to issues with increased security and warranty risks. Furthermore, there was also the issue of not providing information based on the user's emotions, which did not improve the user experience. Furthermore, there was a lack of a way to notify customers of product update information and support expiration dates in real time while they were browsing products in physical stores.

[1440] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1441] In this invention, the server includes: a means for storing various manuals for individual home appliances and the like in addition to online information; a means for providing personalized support to the customer; a means for reading information such as update information and support expiration dates; a means for hedging security and warranty risks; a means for providing services using natural language to anyone, regardless of age or gender, including those with low IT literacy; a means for reducing opportunity losses to related suppliers or enabling new proposals through reverse auctions; a means for recognizing user emotions and adjusting the method of providing information accordingly; and a means for notifying customers of product update information and support expiration dates while they are viewing products in a physical store. This reduces security and warranty risks, enables information to be provided in accordance with user emotions, and improves the shopping experience in physical stores.

[1442] "Online information" is a general term for data and content that can be accessed via the Internet.

[1443] "Home appliances" is a general term for electrical appliances used in the home.

[1444] A "manual" is a document that describes how to use a product or service and the operating procedures.

[1445] "Support" refers to the assistance and advice provided to customers when using products and services.

[1446] "Updates" means the latest information or changes regarding products or services.

[1447] "Support End Date" means the date and time when support for a product or service ends.

[1448] "Security" refers to the means and measures to protect information and systems from unauthorized access and attacks.

[1449] A "warranty" is a promise to repair or replace a product or service free of charge if any defects or malfunctions occur within a certain period of time.

[1450] "Risk" refers to the possibility of unexpected events or losses occurring.

[1451] "Natural language" refers to a language that humans use on a daily basis.

[1452] "IT literacy" refers to the ability to understand and use information technology appropriately.

[1453] "Supplier" refers to a company or individual that provides products or services.

[1454] "Opportunity loss" refers to missing out on profits or opportunities that could have been obtained.

[1455] A "reverse auction" is an auction format in which a buyer presents desired conditions and multiple sellers bid lower to meet those conditions.

[1456] "Emotion" refers to the psychological response a person has to a particular situation or stimulus.

[1457] "Brick and mortar store" refers to a retailer that has a physical location.

[1458] "Notification" refers to the act of informing a user of specific information.

[1459] To implement the present invention, the following system configuration and program are required.

[1460] First, the server has a means for storing various manuals for home appliances owned by individuals in addition to information on the Internet. This means includes a function for searching manual information stored in a database and retrieving the relevant manual information. This allows the manual information required by the user to be provided quickly.

[1461] Next, the server has a means for reading information such as update information and support expiration dates. This means includes a function for periodically checking the information stored in the database, such as update information and support expiration dates, and retrieving the relevant information. This allows users to always have the latest information on their home appliances.

[1462] Furthermore, the server has a means for recognizing the user's emotions and adjusting the way information is provided accordingly. This means includes a function for recognizing the user's emotions using the EmotionRecognizer library and adjusting the way information is provided based on the recognized emotions. For example, if the user is anxious, the server provides the most important information first, and if the user is relaxed, it provides detailed information.

[1463] The server also has a means for notifying customers of product update information and support expiration dates while they are viewing products in a physical store. This means includes a function for sending notifications in real time via a smartphone app while customers are viewing products, allowing customers to immediately grasp the latest product information.

[1464] As a specific example, by inputting the following prompt sentence into a generative AI model, it is possible to simulate the specific behavior of an application that adjusts the way information is presented according to the user's emotions.

[1465] Example prompt sentence:

[1466] "The user took a picture of their face with their smartphone camera. The application recognized the user's emotion using the EmotionRecognizer library. Based on the recognized emotion, the application retrieved product update information and support deadlines from the database and provided them to the user in an appropriate format. For example, if the user is in a hurry, the application prioritizes displaying important information such as sales information and stock status. If the user is relaxed, the application provides detailed product descriptions and reviews."

[1467] In this way, the server can provide information according to the user's emotions and improve the shopping experience in a physical store.

[1468] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1469] Step 1:

[1470] The user takes a picture of their face with the smartphone camera. The input is the user's face image, and the output is facial image data. This facial image data is passed to the EmotionRecognizer library.

[1471] Step 2:

[1472] The device recognizes the user's emotions using the EmotionRecognizer library. The input is facial image data, and the output is the recognized emotion (e.g., anxious, relaxed, etc.). The EmotionRecognizer library analyzes facial features and performs data operations to identify emotions.

[1473] Step 3:

[1474] The server retrieves product update information and support expiration dates from the database. The input is the product ID, and the output is product update information and support expiration date data. The server searches the database based on the product ID and retrieves the relevant information.

[1475] Step 4:

[1476] The server adjusts the information presentation method based on the recognized emotion. The input is the recognized emotion and data on product update information and support expiration dates, and the output is the adjusted information presentation content. For example, if the user is in a hurry, important information such as sale information and stock status will be displayed first, and if the user is relaxed, detailed product descriptions and reviews will be provided.

[1477] Step 5:

[1478] The terminal notifies the user of the adjusted information provision content. The input is the adjusted information provision content, and the output is a notification displayed on the user's smartphone screen. The terminal displays the information received from the server to the user in an appropriate format.

[1479] In this way, information is provided that reflects the user's emotions, improving the shopping experience in physical stores.

[1480] Example 3

[1481] Next, a description will be given of Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1482] With the proliferation of a wide variety of modern home appliances and digital devices, users must manage a large amount of manual information. However, it is difficult for users with low IT literacy or the elderly to properly obtain and use this information. It is also important to provide appropriate support that responds to users' emotions, but this is not adequately addressed in conventional systems. Furthermore, a means is needed to reduce opportunity losses and make new proposals to related suppliers.

[1483] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[1484] In this invention, the server includes a means for storing various manuals for individual home appliances and other products in addition to online information; a means for providing personalized support to customers; a means for reading information such as update information and support expiration dates; a means for hedging security and warranty risks; a means for providing services using natural language to anyone, regardless of age or gender, including those with low IT literacy; a means for reducing opportunity losses to related suppliers or enabling new proposals through reverse auctions; a means for analyzing natural language inquiries from users and providing appropriate manual information; and a means for recognizing user emotions and adjusting the information provision method accordingly. This allows users to easily obtain the necessary manual information and receive appropriate support based on their emotions. It also reduces opportunity losses and enables new proposals to be made to suppliers.

[1485] "Online information" refers to data and materials accessible via the Internet.

[1486] "Home appliances" refers to electrical appliances used in the home.

[1487] "Manual" refers to a document that describes how to use or operate a product or service.

[1488] "Support" means assistance and advice provided to a User in using a Product or Service.

[1489] "Updates" means the latest information or changes regarding products or services.

[1490] "Support Period" refers to the period during which support is provided for a product or service.

[1491] "Security" refers to the means and measures for protecting information and systems.

[1492] "Warranty" means any guarantee of quality or performance provided for a product or service.

[1493] "Natural language" refers to a language that humans use on a daily basis.

[1494] "IT literacy" refers to the ability to understand and use information technology appropriately.

[1495] "Supplier" refers to a company or business that provides products or services.

[1496] "Opportunity loss" refers to the loss that occurs when a business opportunity is missed.

[1497] A "reverse auction" is an auction format in which buyers submit their desired prices and sellers compete to match those prices.

[1498] "Natural language queries" refer to questions or requests made by users in everyday language.

[1499] An "emotion engine" refers to a system that analyzes a user's emotions and adjusts its response accordingly.

[1500] This invention is a system that allows users to make inquiries in natural language and provides appropriate manual information and support information in response. The system operates among three parties: a server, a terminal, and the user.

[1501] 1. Generating the system program

[1502] The system is programmed using Python, uses the open-source BERT model for natural language processing (NLP), and uses a cloud-based sentiment analysis service for emotion recognition.

[1503] 2. Explanation of program processing

[1504] The server receives a natural language query from the user. For example, if the user types, "I want to lower the temperature of the refrigerator," the server sends the query to the BERT model for analysis. The BERT model understands the intent of the query and searches for the appropriate manual information.

[1505] The server then returns the search results to the user, specifically providing manual information on how to set the refrigerator temperature, written in natural language for the user to easily understand.

[1506] Furthermore, if an emotion engine is built in, the server will analyze the user's emotions using an emotion analysis service. For example, if the server determines that the user is feeling anxious, it will prioritize providing information that will provide a sense of security. Conversely, if the server determines that the user is excited, it will provide new updated information.

[1507] 3. Examples and prompts

[1508] As a specific example, consider the case where the user inquires, "I want to lower the temperature of the refrigerator." In this case, the server performs the following process.

[1509] 1. The user opens the app on their smartphone and types, "I want to lower the refrigerator temperature."

[1510] 2. The device sends this query to the server.

[1511] 3. The server receives the query and sends it to the BERT model.

[1512] 4. The BERT model understands "how to set the refrigerator temperature."

[1513] 5. The server searches the database for manual information on "how to set the refrigerator temperature."

[1514] 6. The server sends the search results to the device.

[1515] 7. The device displays to the user, "To lower the refrigerator temperature, press the settings button to adjust the temperature."

[1516] 8. If an emotion engine is installed, the server analyzes the user's emotions.

[1517] 9. The server determines that the user is feeling anxious and prioritizes providing information that will provide reassurance.

[1518] 10. The server sends the adjusted information to the device.

[1519] 11. The device displays the following to the user: "To lower the refrigerator temperature, press the settings button to adjust the temperature. If you have any questions, please contact our support center."

[1520] An example of a prompt sentence might be:

[1521] "I want to lower the temperature in my refrigerator. How do I do that?"

[1522] "I heard there's a new update, could you please tell me the details?"

[1523] In this way, the system analyzes the user's inquiry and provides appropriate information, thereby improving the user experience. The flow of the identification process in the third embodiment will be described with reference to FIG.

[1524] Step 1:

[1525] The user enters a query.

[1526] The user uses a device (such as a smartphone or PC) to input a query in natural language. For example, they might input "I want to lower the temperature of the refrigerator." The input query is saved in an input field on the device.

[1527] Step 2:

[1528] The terminal sends a query to the server.

[1529] The terminal sends the query entered by the user to the server, transmitting data over the Internet. The input is the user's query text, and the output is the data sent to the server.

[1530] Step 3:

[1531] The server receives the query and sends it to the BERT model.

[1532] The server sends the query received from the device to the BERT model, which is a model for natural language processing. The input is the user's query text, and the output is the data sent to the BERT model.

[1533] Step 4:

[1534] The BERT model analyzes the query and understands the intent.

[1535] The BERT model analyzes queries and understands their intent. For example, from the query "I want to lower the refrigerator temperature," it understands "How to set the refrigerator temperature." The input is the user's query text, and the output is the analysis result.

[1536] Step 5:

[1537] The server searches for appropriate manual information based on the analysis results.

[1538] The server searches the database for appropriate manual information based on the analysis results obtained from the BERT model. For example, it searches for information on "how to set the refrigerator temperature." The input is the analysis results, and the output is the search results.

[1539] Step 6:

[1540] The server sends the search results to the terminal.

[1541] The server sends the search results to the terminal. At this time, data is transmitted via the Internet. The input is the search results, and the output is the data transmitted to the terminal.

[1542] Step 7:

[1543] The terminal displays the manual information to the user.

[1544] The terminal displays the manual information received from the server to the user. For example, it displays "To lower the refrigerator temperature, press the setting button to adjust the temperature." The input is the manual information from the server, and the output is the display to the user.

[1545] Step 8:

[1546] If an emotion engine is installed, the server analyzes the user's emotions.

[1547] If an emotion engine is included, the server uses an emotion analysis service to analyze the user's emotion, for example, to determine whether the user is feeling anxious. The input is the user's query text, and the output is the emotion analysis result.

[1548] Step 9:

[1549] The server adjusts the way information is provided according to emotions.

[1550] The server adjusts the information provision method according to the user's emotions. For example, if the user is feeling anxious, it will prioritize providing information that will give a sense of security. The input is the emotion analysis result, and the output is the adjusted information.

[1551] Step 10:

[1552] The server sends the adjusted information to the terminal.

[1553] The server sends the adjusted information to the terminal. At this time, the data is transmitted via the Internet. The input is the adjusted information, and the output is the data transmitted to the terminal.

[1554] Step 11:

[1555] The terminal displays the adjusted information to the user.

[1556] The terminal displays the adjusted information received from the server to the user. For example, it displays "To lower the refrigerator temperature, press the setting button to adjust the temperature. If you have any questions, please contact the support center." The input is the adjusted information from the server, and the output is what is displayed to the user.

[1557] (Application example 3)

[1558] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1559] Today's consumers want to quickly and easily obtain information about home appliances and other devices. However, those who are not familiar with technology, such as those with low IT literacy or the elderly, have difficulty finding the appropriate information. They also need to provide appropriate support according to their emotional state. Furthermore, streamlining customer support in physical stores and improving the customer experience are key challenges.

[1560] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means. In this invention, the server includes a means for storing various manuals for individually owned home appliances and the like in addition to online information, a means for providing personalized support to the customer, a means for reading information such as update information and support expiration dates, a means for hedging security and warranty risks, a means for providing information using natural language to anyone, regardless of age or gender, including those with low IT literacy, a means for reducing opportunity losses to related suppliers or enabling new proposals through reverse auctions, a means for recognizing customer emotions and adjusting the method of providing information accordingly, and a means for using a generative AI model to provide appropriate manual information in response to customer inquiries. This makes it possible to streamline customer support in physical stores and improve the customer experience.

[1561] "Online information" refers to data and materials that can be accessed via the Internet.

[1562] "Home appliances" is a general term for electrical appliances used in the home.

[1563] A "manual" is a document that describes how to use a product or service and the operating procedures.

[1564] "Support" means assistance or advice provided to a customer in using a product or service.

[1565] "Updates" means the latest information or changes regarding products or services.

[1566] "Support Life" means the period during which support is provided for a product or service.

[1567] "Security" refers to the measures and means used to protect information and systems from unauthorized access and attacks.

[1568] A "warranty" is a promise to repair or replace a product or service free of charge if any defects or malfunctions occur within a certain period of time.

[1569] A "natural language" is a language that humans use on a daily basis.

[1570] "IT literacy" refers to the ability to understand and use information technology appropriately.

[1571] "Supplier" means a company or individual that provides a product or service.

[1572] "Opportunity cost" refers to benefits or gains that are not obtained because a certain choice is not made.

[1573] A "reverse auction" is an auction in which buyers state their desired prices and sellers bid accordingly.

[1574] "Emotion recognition" is a technology that analyzes a user's emotions and understands their state.

[1575] A "generative AI model" is a model that uses artificial intelligence to generate new data and information.

[1576] An "inquiry" is an action in which a customer asks a question or makes a request regarding a product or service.

[1577] A system for implementing this invention is configured as follows: The server has a database that stores various manuals for home appliances and other items owned by individuals, in addition to online information. When a user makes an inquiry through a smartphone application, the server analyzes the inquiry using natural language processing technology and provides appropriate manual information.

[1578] The server uses an emotion recognition engine to analyze the user's emotions and adjusts the way it provides information based on the results. For example, if the user is feeling anxious, the server will prioritize providing information that provides a sense of security. If the user is excited, the server will provide new updated information.

[1579] The server uses a generative AI model to generate appropriate manual information in response to the user's inquiry. This generative AI model is implemented using OpenAI's API. Specifically, the user's inquiry is input to the generative AI model as a prompt sentence, and the appropriate manual information is obtained.

[1580] Hardware and software used

[1581] Hardware: Servers, smartphones

[1582] Software: OpenAI API, TextBlob (for sentiment analysis)

[1583] Data processing and calculation

[1584] 1. Natural language analysis: Analyze user inquiries and obtain appropriate manual information. This uses OpenAI's API.

[1585] 2. Emotion Recognition: Uses the TextBlob library to analyze the user's emotions and classify them as positive, negative, or neutral.

[1586] 3. Adjustment of information provision: Adjust the way information is provided based on the results of sentiment analysis, for example, adding a message offering reassurance if the sentiment is negative.

[1587] Specific examples

[1588] When a user asks, "I want to lower the temperature of the refrigerator," the server performs the following process.

[1589] 1. Perform natural language analysis on the user's inquiry and understand that the user's query is, "I want to lower the temperature in the refrigerator."

[1590] 2. An emotion recognition engine is used to analyze the user's emotions. For example, if the user is feeling anxious, the emotion will be classified as "negative."

[1591] 3. Use the generative AI model to obtain the appropriate manual information. An example of a prompt is as follows:

[1592] Provide the appropriate manual information when a customer asks, "I want to lower the temperature in my refrigerator."

[1593] 4. Adjust the way you provide information based on the results of sentiment analysis, for example, "Don't worry, the following information may be helpful: How to set the refrigerator temperature..."

[1594] In this way, it is possible to streamline customer support in physical stores and improve the customer experience.

[1595] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[1596] Step 1:

[1597] A user inputs a query through a smartphone application. The input query is sent to the server in text format. The input data is the user's question.

[1598] Step 2:

[1599] The server passes the received query to a natural language analysis engine. The natural language analysis engine analyzes the query content and extracts keywords and context to retrieve appropriate manual information. The input is the user's query text, and the output is the analyzed keywords and context information.

[1600] Step 3:

[1601] The server analyzes the user's emotions using an emotion recognition engine. The emotion recognition engine uses the TextBlob library to classify the emotion of the query text as positive, negative, or neutral. The input is the user's query text, and the output is the emotion classification result.

[1602] Step 4:

[1603] The server uses a generative AI model to generate appropriate manual information in response to the user's inquiry. The generative AI model is implemented using OpenAI's API. The server inputs the analyzed keywords and contextual information into the generative AI model as a prompt sentence to obtain the appropriate manual information. The input is the prompt sentence, and the output is the generated manual information.

[1604] Step 5:

[1605] The server adjusts the information provision method based on the results of the emotion analysis. For example, if the emotion is classified as negative, the server adds a message to provide reassurance. The input is the emotion classification result and the generated manual information, and the output is the adjusted information provision message.

[1606] Step 6:

[1607] The server sends the tailored information message to the user's smartphone application. The user receives appropriate manual information and a message according to the user's emotion through the smartphone application. The input is the tailored information message, and the output is the information displayed on the user's smartphone screen.

[1608] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1609] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in the form of data such as voice data and text data.

[1610] Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1611] Another example of generative AI is Gemini (internet search engine). <url: https: gemini.google.com ?hl="ja">) are mentioned.

[1612] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1613] [Third embodiment]

[1614] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1615] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1616] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1617] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1618] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1619] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1620] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1621] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1622] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1623] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1624] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1625] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[1626] "Example 1"

[1627] This embodiment of the present invention includes a database that stores various manuals for home appliances owned by individuals in addition to online information. This database centrally manages manual information for home appliances owned by customers and provides personalized support based on this information. For example, when a customer wants to know how to set the temperature of a refrigerator, the database searches for the relevant manual information and provides it to the customer.

[1628] "Example 2"

[1629] Furthermore, this embodiment of the present invention is equipped with a function for reading information such as update information and support expiration dates. This function periodically checks the information stored in the database, such as update information and support expiration dates, and acquires the relevant information. For example, if the support expiration date of a home appliance owned by a customer is approaching, the information is notified to the customer. This hedges against security and warranty risks.

[1630] "Example 3"

[1631] Furthermore, this embodiment of the present invention has a function that uses natural language to provide services to people of all ages and genders, including those with low IT literacy. This function analyzes inquiries from customers in natural language and provides appropriate manual information. For example, if a customer inquires, "I want to lower the temperature in my refrigerator," the system analyzes the inquiry and provides manual information on how to set the refrigerator temperature.

[1632] The processing flow of each embodiment will be described below.

[1633] "Example 1"

[1634] Step 1: Store the manual information for the home appliances owned by the customer in a database.

[1635] Step 2: A customer inquires about how to operate a particular appliance.

[1636] Step 3: Search the database for the relevant manual information.

[1637] Step 4: Provide search results to the customer.

[1638] "Example 2"

[1639] Step 1: Regularly check the information stored in the database, such as update information and support expiration dates.

[1640] Step 2: If there is any relevant information, obtain that information.

[1641] Step 3: Notify the customer of the information obtained.

[1642] "Example 3"

[1643] Step 1: Accept natural language inquiries from customers.

[1644] Step 2: Analyze the inquiry and search for the relevant manual information.

[1645] Step 3: Provide search results to the customer.

[1646] Example 1

[1647] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1648] Modern homes contain a wide variety of home appliances, and in order to understand how to operate and set up each one, users need to refer to the manuals for each product. However, these manuals are often provided in paper form, which means there is a risk of them being lost or damaged. Furthermore, even when searching for information on the Internet, it is difficult for users to obtain accurate information, as unreliable and inaccurate information is mixed in. Furthermore, users with low IT literacy find it even more difficult to find appropriate information. There is a need for a system that can solve these problems and allow users to easily obtain accurate instructions for operating home appliances.

[1649] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1650] In this invention, the server includes means for storing various manuals for individual home appliances and other items owned by individuals in addition to online information, means for providing personalized support to the customer, means for reading information such as update information and support expiration dates, means for hedging security and warranty risks, means for providing services using natural language to anyone, regardless of age or gender, including those with low IT literacy, means for reducing opportunity losses to related suppliers or enabling new proposals through reverse auctions, means for providing an interface through which users can search for operating instructions for home appliances, means for sending user search queries to the server, means for searching for relevant manual information from a database, means for providing appropriate support information to users based on the search results, and means for providing information based on prompt sentences using a generative AI model.This allows users to easily and accurately obtain operating instructions for home appliances.

[1651] "Online information" refers to data and content accessible via the Internet.

[1652] "Home appliances" refers to electrical appliances used in the home.

[1653] "Manual" refers to an instruction manual that describes how to operate and set up a product.

[1654] A "database" refers to a system that systematically organizes and stores information so that it can be searched and retrieved efficiently.

[1655] "Support" means assistance and advice to enable a User to use the Product properly.

[1656] "Update Information" means new versions or modifications of products or software.

[1657] "Support Life" refers to the period for which support is provided for a product.

[1658] "Security" refers to measures taken to protect information and systems from unauthorized access and data leakage.

[1659] "Warranty" refers to a manufacturer's promise of product quality or performance.

[1660] "Hedging risk" means taking measures to prevent or mitigate potential risks.

[1661] "Natural language" refers to a language that humans use on a daily basis.

[1662] "IT literacy" refers to the ability to understand and appropriately utilize information technology.

[1663] "Supplier" refers to a company or individual that provides a product or service.

[1664] "Opportunity cost" refers to benefits that are not obtained by not making a certain choice.

[1665] A "reverse auction" refers to an auction format in which buyers state a price and sellers compete according to that price.

[1666] "Interface" refers to the means or method by which a user interacts with a system.

[1667] A "search query" refers to a keyword or phrase that a user enters to search for information.

[1668] A "generative AI model" refers to an algorithm or system that uses artificial intelligence to generate and process data.

[1669] A "prompt" refers to an instruction or question input to a generative AI model.

[1670] This invention is a system equipped with a database that stores not only online information but also various manuals for home appliances owned by individuals. This system is designed to enable users to easily search for and obtain accurate information on how to operate home appliances.

[1671] Hardware and software used

[1672] Hardware: Servers, devices (PCs, smartphones, tablets, etc.)

[1673] Software: Database management systems (e.g., MySQL, PostgreSQL), web servers (e.g., Apache, Nginx), generative AI models (e.g., OpenAI GPT-3)

[1674] System configuration

[1675] server

[1676] The server manages a database that stores online information and manuals for home appliances owned by customers. When a user wants to know how to operate a particular appliance, the server searches the database for the relevant manual information and provides the user with appropriate support information based on the search results. The server also uses a generative AI model to provide information based on prompts.

[1677] Terminal

[1678] The terminal provides an interface for users to search for operating instructions for home appliances. It sends the search query entered by the user to the server and displays the manual information received from the server to the user. The terminal operates on devices such as smartphones, PCs, and tablets.

[1679] User

[1680] A user uses a terminal to search for how to operate a home appliance. For example, if the user wants to know how to set the temperature on a refrigerator, the user enters "how to set the temperature on a refrigerator." The user operates the home appliance based on the information displayed on the terminal.

[1681] Specific examples

[1682] Example 1: Want to know how to set the refrigerator temperature?

[1683] 1. The user opens the app on their smartphone and types in "How to set the refrigerator temperature."

[1684] 2. The device sends this search query to the server, specifically by sending the data to the " / search" endpoint using an HTTP POST request.

[1685] 3. The server searches the database for the manual information for the corresponding refrigerator by executing the SQL query "SELECT FROM manuals WHERE appliance='refrigerator' AND topic='temperature setting'".

[1686] 4. The server sends the search results in JSON format to the device. Specifically, it returns data like this as an HTTP response: {"appliance": "Refrigerator", "topic": "Temperature setting", "content": "How to set the refrigerator temperature..."}.

[1687] 5. The device displays the received information to the user. Specifically, it displays the text "To set the refrigerator temperature..." on the app's UI.

[1688] 6. The user sets the refrigerator temperature based on the displayed information. Specifically, the user adjusts the temperature using the refrigerator's control panel.

[1689] Example prompts for generative AI models

[1690] How do I set the temperature in my refrigerator?

[1691] When this prompt sentence is input into the generative AI model, the AI ​​searches for the relevant manual information from the database and provides the user with appropriate support information.

[1692] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1693] Step 1:

[1694] A user uses a device to search for how to operate a home appliance. Specifically, they open an application on their smartphone or PC and enter a search query such as "how to set the refrigerator temperature" in the search bar. The entered search query becomes the input data for the device.

[1695] Step 2:

[1696] The device sends the search query entered by the user to the server. Specifically, it sends data to the " / search" endpoint using an HTTP POST request. At this time, the search query is sent to the server as part of the request. The input data is the search query, and the output data is the request to the server.

[1697] Step 3:

[1698] The server searches the database based on the received search query. Specifically, it uses an SQL query to retrieve the relevant manual information from the database. For example, it executes the SQL query "SELECT FROM manuals WHERE appliance="refrigerator" AND topic="temperature setting". The input data is the search query, and the output data is the relevant manual information.

[1699] Step 4:

[1700] The server sends the manual information retrieved from the database to the terminal in JSON format. Specifically, it returns data like this as an HTTP response: {"appliance": "Refrigerator", "topic": "Temperature setting", "content": "How to set the refrigerator temperature..."}. The input data is the manual information retrieved from the database, and the output data is a JSON-formatted response.

[1701] Step 5:

[1702] The terminal displays the manual information received from the server to the user. Specifically, it displays the text "To set the refrigerator temperature..." on the application UI. The input data is the response from the server, and the output data is the information displayed to the user.

[1703] Step 6:

[1704] The user operates the appliance based on the information displayed on the terminal. Specifically, the refrigerator's operation panel is used to adjust the temperature. The input data is the manual information displayed on the terminal, and the output data is the setting changes of the appliance.

[1705] (Application example 1)

[1706] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1707] Modern homes have a wide variety of home appliances, each of which requires its own corresponding manual. However, these manuals are often provided in paper form, which means there is a risk of them being lost or damaged. Furthermore, when a user needs to quickly learn how to operate or troubleshoot a specific home appliance, it can take a long time to find the relevant manual. Furthermore, for users with low IT literacy, searching for information on the Internet is difficult in itself. To solve these problems, a system is needed that centrally manages home appliance manual information and provides it to users quickly and easily.

[1708] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1709] In this invention, the server includes: means for storing various manuals for individually owned home appliances and the like in addition to online information; means for providing customer-oriented support; means for reading information such as update information and support expiration dates; means for hedging security and warranty risks; means for providing services using natural language to anyone, regardless of age or gender, including those with low IT literacy; means for reducing opportunity losses to related suppliers or for enabling new proposals through reverse auctions; means for users to search for manual information for specific home appliances via an application installed on their smartphones and provide the relevant information; and means for quickly providing users with manual information retrieved from the database. This allows users to easily search for home appliance manual information using their smartphones and quickly obtain the information they need.

[1710] "Online information" is a general term for data and content that can be accessed via the Internet.

[1711] "Home appliances" is a general term for electrical appliances used in the home.

[1712] A "manual" is a document that describes how to use a product and operating procedures.

[1713] A database is a collection of information that is systematically organized and stored so that it can be searched and used efficiently.

[1714] "Support" is a general term for services and features that assist users in using the product properly.

[1715] "Update Information" means information about the latest changes and additions to a product or software.

[1716] "Support period" means the period during which support is provided for a product or service.

[1717] "Security" refers to the means and measures taken to protect information and systems from unauthorized access and data leakage.

[1718] "Warranty" is a system that guarantees the quality and performance of products and services for a certain period of time.

[1719] "Hedging risk" means taking measures to reduce or avoid a predicted risk.

[1720] "Natural language" refers to the language used by humans on a daily basis, not a specific programming language or technical term.

[1721] "IT literacy" refers to the ability to understand and appropriately utilize information technology.

[1722] "Supplier" means a supplier or trader of products or services.

[1723] "Opportunity cost" refers to benefits or results that are not obtained because a certain choice is not made.

[1724] A "reverse auction" is an auction format in which a buyer presents desired conditions and multiple sellers bid lower to meet those conditions.

[1725] A "smartphone" is a highly functional mobile phone that can connect to the Internet and use applications.

[1726] An "application" is a software program that provides a particular function or service.

[1727] "User" means a person who uses a product or service.

[1728] As an embodiment of the present invention, a "smart home appliance support app" installed on a smartphone is used. A specific implementation method thereof will be described below.

[1729] System Configuration

[1730] This system uses the following hardware and software:

[1731] Hardware: Smartphone

[1732] Software: Flask (web framework), SQLite (database management system)

[1733] Program processing

[1734] The server uses the Flask framework to build a web application. It uses SQLite as the database to store home appliance manual information. When a user searches for manual information for a specific home appliance, they send a request to the server via a smartphone application. The server searches the database for the relevant information and provides it to the user.

[1735] Data processing and calculation

[1736] Data processing: Receives a request from the user and searches the database for the relevant manual information.

[1737] Data Calculation: Uses SQL queries to retrieve information from a database and return it to the user.

[1738] Specific examples

[1739] If a user wants to know how to set the temperature on a refrigerator, they open the smartphone application and type in "how to set the temperature on a refrigerator." The application sends this request to the server, which then searches the database for the relevant manual information and provides it to the user.

[1740] Prompt Sentence Examples

[1741] How do I set the temperature in my refrigerator?

[1742] In this way, users can easily search for manual information for home appliances using their smartphones and quickly obtain the information they need.

[1743] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1744] Step 1:

[1745] A user opens a smartphone application and inputs a prompt to search for manual information for a specific appliance. For example, they input, "How do I set the temperature on my refrigerator?" This input is sent to the application.

[1746] Step 2:

[1747] The device (smartphone application) receives the user's input and sends a request to the server. This request includes the prompt text entered by the user. Specifically, it is sent to the server as an HTTP request.

[1748] Step 3:

[1749] The server analyzes the received request and extracts search keywords from the prompt. For example, it extracts the keywords "refrigerator" and "temperature setting method." This analysis may use natural language processing techniques.

[1750] Step 4:

[1751] The server executes an SQL query based on the extracted keywords to search for the corresponding manual information. The database stores manual information for home appliances. The corresponding manual information is retrieved as a result of the SQL query execution.

[1752] Step 5:

[1753] The server formats the retrieved manual information and generates a response to return to the user. This response contains the specific manual information the user is looking for. For example, it may contain detailed instructions on how to set the refrigerator temperature.

[1754] Step 6:

[1755] The device (smartphone application) receives the response from the server and displays it to the user, who can then check the relevant manual information on the application screen.

[1756] Step 7:

[1757] The user operates the appliance based on the displayed manual information. For example, the user changes the temperature setting of a refrigerator. In this way, the user can quickly obtain the necessary information and operate the appliance appropriately.

[1758] Example 2

[1759] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1760] Many consumers today have difficulty understanding update information and support expiration dates for their electronic devices, which can lead to security and warranty risks. Furthermore, users with low IT literacy find it even more difficult to properly manage this information. Furthermore, this can result in opportunity losses for suppliers. To solve these issues, a system is needed that notifies users of update information and support expiration dates in a timely manner.

[1761] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes: a means for storing various instruction manuals for electronic devices owned by individuals in addition to online information; a means for providing personalized support to the customer; a means for reading information such as update information and support expiration dates; a means for reducing security and warranty risks; a means for providing information in natural language to anyone, regardless of age or gender, including those with low IT literacy; a means for reducing opportunity losses to related suppliers or enabling new proposals through reverse auctions; a means for periodically checking information stored in a database and acquiring relevant information; a means for analyzing the acquired information and extracting relevant information; and a means for generating and transmitting notifications based on the extracted information. This allows users to properly understand update information and support expiration dates for their electronic devices and reduce security and warranty risks. It also reduces opportunity losses for suppliers and increases opportunities for new proposals.

[1762] "Online information" refers to data and content accessible via the Internet.

[1763] "Electronic devices" refer to devices or equipment that operate using electricity.

[1764] An "instruction manual" refers to a document that describes how to use and precautions for electronic devices and other products.

[1765] "Customer-oriented support" refers to providing appropriate support according to the user's needs and situation.

[1766] "Update Information" refers to new versions or modifications of software or hardware.

[1767] "Support Period" refers to the period during which warranty or support is provided for a product or service.

[1768] "Security risk" refers to the possibility that information or systems may be exposed to threats such as unauthorized access or data leakage.

[1769] "Warranty risk" refers to the possibility that a product or service will malfunction or fail within the warranty period.

[1770] "Information technology literacy" refers to the ability to understand and use information technology appropriately.

[1771] "Supplier" refers to a company or individual that provides a product or service.

[1772] "Opportunity loss" refers to profits or results that are not obtained because appropriate responses or actions were not taken.

[1773] A "reverse auction" is an auction format in which the seller lowers the price.

[1774] "Database" refers to a system for efficiently managing, searching, and updating data.

[1775] "Analysis" refers to examining data in detail to find meaning and patterns.

[1776] "Notification" refers to a message or alert that informs a user of specific information.

[1777] This invention is a system for appropriately managing update information and support expiration dates for electronic devices owned by users, thereby reducing security risks and warranty risks. This system is composed of elements such as a server, a terminal, and a user.

[1778] Server Roles

[1779] The server uses the following hardware and software to manage and process data.

[1780] Hardware: Server equipment with a powerful processor, sufficient memory, and storage

[1781] Software: Database management systems such as MySQL or PostgreSQL, programming languages ​​such as Python or Java, and notification services such as SendGrid or Firebase Cloud Messaging

[1782] The server periodically accesses the database to check information such as update information, support expiration dates, etc. For example, the server checks the database at 2:00 AM every day to obtain update information or records whose support expiration dates are approaching.

[1783] The server then analyzes the information and extracts relevant information. This process is performed using a Python script that uses the pandas library to process the data. For example, it extracts information about appliances whose support period expires within the next 30 days.

[1784] Finally, the server uses the extracted information to generate and send notifications to customers, using SendGrid's API to generate email content and send it to customers, including details about the appliances that are nearing the end of their support life.

[1785] Device Role

[1786] The device refers to the electronic device or computer owned by the user, and is responsible for receiving notifications from the server. The device displays the notifications sent from the server using an email client or push notification application.

[1787] User Roles

[1788] The user receives the notification from the server and takes necessary action, such as updating an appliance whose support period is approaching or applying for an extension of the warranty.

[1789] Specific examples

[1790] For example, if a customer owns a refrigerator and their support is due to expire in 30 days, the server checks the database to retrieve that information, then runs a Python script to extract the relevant information and uses SendGrid to send an email notification to the customer.

[1791] Example prompts for generative AI models

[1792] Describe a system that notifies customers when their appliances are nearing the end of their support life. Include detailed instructions for periodically checking a database, extracting the information, and generating and sending the notification. Include the names of the hardware and software involved.

[1793] In this way, the system can notify users of important updates and support expiration dates, reducing security and warranty risks.

[1794] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1795] Step 1: Regularly check your database

[1796] The server periodically accesses the database to check information such as update information, support expiration dates, etc. This process is scheduled to be executed at 2:00 AM every day, for example.

[1797] Input: Database connection information, query

[1798] Output: Records with upcoming renewal information or support expiration

[1799] What happens: The server uses a cron job to run a Python script called db_check.py every day at 2 AM. db_check.py connects to a MySQL database and runs the following query:

[1800] sql

[1801] SELECT FROM support_info WHERE support_end_date <= CURDATE() + INTERVAL 30 DAY;

[1802] Step 2: Extracting information

[1803] The server parses the information retrieved from the database and extracts the relevant information, using a Python script.

[1804] Input: Records retrieved from the database

[1805] Output: Information on appliances whose support period expires within the next 30 days

[1806] What happens: The server runs a Python script called data_extract.py, which loads the retrieved data into a pandas data frame. The data frame is then filtered to extract information about appliances whose support period expires within the next 30 days:

[1807] python

[1808] import pandas as pd

[1809] df = pd.read_sql(query_result, connection)

[1810] filtered_df = df[df['support_end_date'] <= pd.Timestamp.now() + pd.DateOffset(days=30)]

[1811] Step 3: Generate and send notifications

[1812] The server uses the extracted information to generate and send notifications to customers, using SendGrid's API.

[1813] Input: Extracted appliance information, customer email address

[1814] Output: Notification email sent to customer

[1815] What happens: The server runs a Python script called send_notification.py, which uses SendGrid's API to send an email. The email content is generated as follows:

[1816] python

[1817] import sendgrid

[1818] from sendgrid.helpers.mail import Mail

[1819] sg = sendgrid.SendGridAPIClient(api_key='YOUR_SENDGRID_API_KEY')

[1820] for index, row in filtered_df.iterrows():

[1821] message = Mail(

[1822] from_email='noreply@example.com',

[1823] to_emails=row['customer_email'],

[1824] subject='Support expiration notice',

[1825] plain_text_content=f"The support period for your appliance ({row['product_name']}) will expire on {row['support_end_date']}."

[1826] )

[1827] sg.send(message)

[1828] In this way, the system can notify users of important updates and support expiration dates, reducing security and warranty risks.

[1829] (Application example 2)

[1830] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1831] Many users today have difficulty understanding update information and support expiration dates for their home appliances and devices, which increases security and warranty risks. Furthermore, users with low IT literacy find it even more difficult to properly manage this information. Furthermore, this can result in opportunity losses for related suppliers.

[1832] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: a means for storing various manuals for individual home appliances and the like in addition to online information; a means for providing personalized support to the customer; a means for reading information such as update information and support expiration dates; a means for hedging security and warranty risks; a means for providing services using natural language to anyone, regardless of age or gender, including those with low IT literacy; a means for reducing opportunity losses to related suppliers or enabling new proposals through reverse auctions; a means for accessing a database and acquiring update information and support expiration dates; a means for notifying users based on the acquired information; and a means for evaluating security risks based on the update information and support expiration dates and sending emergency notifications. This allows users to properly manage update information and support expiration dates for their devices and software and prevent security and warranty risks.

[1833] "Online information" refers to data and materials that can be accessed via the Internet.

[1834] "Home appliances" is a general term for electrical appliances used in the home.

[1835] A "manual" is a document that describes how to use a product or service and the operating procedures.

[1836] A "database" is a system for efficiently managing, searching, and updating data.

[1837] "Update Information" means information about new versions and patches for software or devices.

[1838] "Support end date" is the date on which manufacturer or provider support for a product or service ends.

[1839] "Security risk" refers to the possibility that information systems and devices may be exposed to threats such as unauthorized access and data leakage.

[1840] "Warranty risk" refers to the risk that arises when the warranty period for a product or service expires.

[1841] "Natural language" refers to the language used by humans on a daily basis, often translated into a form that is easy for computers to understand.

[1842] "IT literacy" refers to the ability to understand and use information technology appropriately.

[1843] "Supplier" means a company or individual that provides products or services.

[1844] "Opportunity cost" refers to the potential gain lost by not making a choice.

[1845] A "reverse auction" is a type of auction in which a buyer submits a price and multiple sellers compete based on that price.

[1846] A "notification" is a message or alert that informs the user of specific information.

[1847] "Emergency notifications" are messages or alerts that inform users of important information that requires immediate action.

[1848] As an embodiment of the present invention, the following system is constructed.

[1849] System Overview

[1850] This system manages update information and support expiration dates for devices and software owned by users, preventing security and warranty risks. The system consists of a server, user terminals (such as smartphones and smart glasses), and a database.

[1851] Program processing

[1852] The server performs the process using the following means.

[1853] 1. Database access method:

[1854] The server accesses the database to obtain update information and support expiration dates for devices and software registered by the user. This database also stores manual information for the home appliances and devices owned by the user.

[1855] 2. Means of notification:

[1856] The server noti...

Claims

1. a database that stores manuals for home appliances that can be used by users, update information for the home appliances, and support expiration dates for the home appliances; A provision means for inputting a specific prompt sentence into a generation AI model, thereby searching the database for manual information that is a response to the user's inquiry about how to use the home appliance or how to set the home appliance, and providing the searched information to the user's terminal; an emotion engine that recognizes the emotion of the user; an adjustment means for adjusting a method of providing the information based on the emotion; a notification means for notifying the user of information indicating that a support deadline for a home appliance owned by the user is approaching, when the support deadline for the home appliance is approaching, by referring to the database; A system including:

2. The system described in claim 1, wherein the adjustment means, when detecting that the user is anxious based on the emotion, displays sale information for the home appliance and the inventory status of the home appliance on the user's terminal, and when detecting that the user is relaxed based on the emotion, displays a product description and reviews of the home appliance on the user's terminal.

3. 2. The system according to claim 1, wherein the notification means notifies a terminal of the user of information indicating that the support deadline is approaching, and also notifies a supplier of the home appliance owned by the user.

Images