system

Abstract

We provide the system. [Solution] A means for receiving questions and requests entered by the user via a terminal, A means for analyzing the aforementioned questions and requests and extracting important keywords, A means for searching for related information from a database based on the aforementioned important keywords, A means for automatically generating individual brochures based on the aforementioned related information, The means for displaying the automatically generated pamphlet on the user terminal, A system that includes this.

Description

Technical Field

[0004] , , , ,

[0005] , , , , ,

[0003] , ,

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor and includes steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance that responds to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In a conventional pamphlet creation system, it has been difficult to quickly and appropriately respond to various user questions and requests, and it has been impossible to provide the most suitable information for users. In addition, there are limitations in providing immediate information and customization in stores, and the ability to respond to specific needs is insufficient.

Means for Solving the Problems

[0005] This invention provides a system that receives questions and requests entered by a user via a terminal, analyzes them to extract important keywords, and searches a database for related information based on those keywords. Furthermore, it includes a function to automatically generate individual brochures based on this related information and display the automatically generated brochures on the user's terminal. In addition, it includes means for the user to confirm and correct the brochures from the terminal, and means for finalizing the corrected brochures and sending them to the terminal. In this way, the invention provides a system that can respond quickly and appropriately to the individual needs of users.

[0006] A "terminal" is an electronic device used by a user to input information and display it.

[0007] A "user" is a person or individual who uses the system to input questions or requests.

[0008] "Questions and requests" refer to the information and requests that users input into the system.

[0009] "Means" refers to the mechanisms or methods provided to perform a specific function or operation.

[0010] "Analysis" is the process of analyzing input questions and requests and understanding their meaning.

[0011] "Key keywords" are words or phrases extracted through analysis that contain particularly important information in the user's questions or requests.

[0012] "Related information" refers to information retrieved from the database based on the extracted important keywords.

[0013] A "database" is a collection of information that is systematically stored and made searchable and retrievalable.

[0014] "Automatic generation" refers to the process by which a system automatically creates documents and brochures based on the content input by the user.

[0015] A "brochure" is a document that contains information generated for providing to the user.

[0016] "Display" refers to the act of projecting the generated brochure onto the screen of a terminal.

[0017] "Confirmation" refers to the act of the user checking whether the content of the generated brochure is appropriate by viewing the content.

[0018] "Modification" refers to the act of the user making changes to the content of the brochure.

[0019] "Finalization" refers to the act of the user finally approving the content of the brochure.

[0020] "Transmission" refers to the act of sending the generated or modified brochure data from the terminal to another system such as a server.

Brief Description of Drawings

[0021] [Figure 1] It is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] It is a conceptual diagram showing an example of the main functions of a data processing device and a smart device according to the first embodiment. [Figure 3] It is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] It is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] It is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] It is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] It is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] It is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] It shows an emotion map to which a plurality of emotions are mapped. [Figure 10] It shows an emotion map to which a plurality of emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Example 2 when an emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when an emotion engine is combined.

Mode for Carrying Out the Invention

[0022] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0023] First, the language used in the following description will be explained.

[0024] In the following embodiments, the signed processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Furthermore, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include CPU (Central Processing Unit), GPU (Graphics Processing Unit), GPGPU (General-Purpose computing on Graphics Processing Units), and APU (Accelerated Processing Unit).

[0025] In the following embodiments, signed RAM (Random Access Memory) is a memory that temporarily stores information and is used as work memory by the processor.

[0026] In the following embodiments, the signed storage is one or more non-volatile storage devices that store various programs and various parameters. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes.

[0027] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0028] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0029] [First Embodiment]

[0030] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0031] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0032] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0033] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0034] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0035] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0036] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0037] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0038] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0039] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0040] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0041] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0042] This invention relates to a system that automatically generates, displays, and prints individual brochures based on questions and requests entered by users via a terminal. This system utilizes natural language processing (NLP) and database search technologies to quickly provide customized information tailored to the specific needs of each user.

[0043] Overall system configuration

[0044] 1. Receiving user input

[0045] Terminal: Users enter questions and requests through terminals installed in the store or via a website. For example, they might enter a specific request such as, "Which air conditioner has high energy efficiency?"

[0046] 2. Analysis of user requirements

[0047] Server: Receives questions and requests sent from terminals and analyzes the text using natural language processing techniques. Extracts keywords deemed important.

[0048] 3. Searching for related information

[0049] Server: Based on the extracted keywords, it searches the database for relevant information and images. For example, if the keywords "energy efficiency" and "air conditioner" are extracted, it retrieves product information and images related to them.

[0050] 4. Generating the content of the brochure

[0051] Server: Using the retrieved information, the server automatically generates the content of the brochure according to a pre-configured template. This template includes the placement of elements such as title, description, and images.

[0052] 5. Display and verification of the brochure.

[0053] Terminal: Displays a preview of the automatically generated brochure to the user. The user reviews this preview and makes corrections as needed.

[0054] User: Review the preview content and confirm if you are satisfied.

[0055] 6. Final creation and printing of the brochure

[0056] Terminal: The user sends the confirmed information to the server to generate the final version of the brochure.

[0057] Server: Generates the finalized brochure data and sends it to the terminal.

[0058] Terminal: Displays the final version of the brochure to the user, and allows printing as needed in stores.

[0059] Specific example

[0060] Example 1: User seeking product information

[0061] 1. User: Enters "Please tell me about the latest energy-saving air conditioners" into the store's terminal.

[0062] 2. Terminal: Send the above input to the server.

[0063] 3. Server: Uses natural language processing technology to extract important keywords such as "latest," "energy-saving," and "air conditioner."

[0064] 4. Server: Searches the database for relevant air conditioner information (e.g., specifications, price, and images for each product).

[0065] 5. Server: Based on the acquired information, it automatically generates the brochure by inserting the data into the template.

[0066] 6. Terminal: Displays a preview of the automatically generated brochure to the user.

[0067] 7. User: Review the preview and confirm if you are satisfied with the content.

[0068] 8. Terminal: Sends the confirmed information to the server.

[0069] 9. Server: Generates the final brochure and sends it to the terminal.

[0070] 10. Terminal: Display the final version of the brochure to the user and print it as needed.

[0071] In this way, the present invention can respond quickly and accurately to the individual needs of users, and in particular, it enables real-time information provision and customized services in stores.

[0072] The following describes the processing flow.

[0073] Step 1:

[0074] User: Accesses a website or in-store terminal and enters a question or request. For example, enters the request, "Which air conditioner is the most energy-efficient?"

[0075] Step 2:

[0076] Terminal: Receives input from the user and sends that text data to the server.

[0077] Step 3:

[0078] Server: The received text data is passed to a natural language processing (NLP) engine to analyze the questions and requests. Here, important keywords (e.g., "energy efficiency," "air conditioner") are extracted.

[0079] Step 4:

[0080] Server: Based on the extracted keywords, it queries the database to find relevant information (e.g., a list of air conditioners with excellent energy efficiency).

[0081] Step 5:

[0082] Server: Receives search results and inserts the data into a template for generating brochures. This template has pre-configured layouts for titles, descriptions, images, etc.

[0083] Step 6:

[0084] Server: Generates a preview of the brochure and sends that data to the terminal.

[0085] Step 7:

[0086] Terminal: Displays a preview to the user and prompts them to confirm the content. The user reviews the preview and selects "Confirm" if they are satisfied with the content.

[0087] Step 8:

[0088] User: Review the preview, re-enter any necessary corrections, and perform a final check. If satisfied, press the confirm button.

[0089] Step 9:

[0090] Terminal: Receives user confirmation and sends that information to the server.

[0091] Step 10:

[0092] Server: Generates the finalized brochure data and sends that data to the terminal.

[0093] Step 11:

[0094] Terminal: Displays the final version of the brochure to the user, and allows printing as needed in stores.

[0095] (Example 1)

[0096] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0097] Conventional information systems make it difficult for users to quickly obtain the specific information they need, and in particular, they lack the means to provide customized information tailored to individual user needs. This can lead to ineffective real-time information provision and the creation of customized brochures in stores, potentially resulting in decreased user satisfaction.

[0098] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0099] In this invention, the server includes means for receiving questions and requests entered by the user via a terminal, means for analyzing the questions and requests and extracting important keywords using natural language processing technology, means for searching a database for relevant information based on the important keywords, means for automatically generating individual brochures using pre-configured templates based on the relevant information, and means for displaying the automatically generated brochures on the user terminal. This enables the rapid and accurate acquisition, display, and printing of customized information that corresponds to the user's individual requests.

[0100] A "user" refers to an individual or legal entity that uses the system to input questions or requests.

[0101] A "terminal" is a computer device used by users to input information, and can refer to information input devices installed in stores or websites.

[0102] "Questions and requests" refer to the information or requests that users want to obtain through the system.

[0103] "Natural language processing technology" refers to the technology used to analyze human language and convert it into a format that computers can understand and process.

[0104] "Key keywords" refer to words or phrases that are extracted through analysis from questions or requests and are particularly necessary for information retrieval and processing.

[0105] A "database" refers to a collection of information in which related information is stored in a structured manner.

[0106] A "template" refers to a pre-configured framework or format used to automatically generate the content of documents or brochures.

[0107] A "personalized brochure" refers to an informational document containing information customized to the specific needs of a particular user.

[0108] "Preview" refers to a display format that allows users to check the contents of an automatically generated brochure.

[0109] "Printing" refers to the process of outputting the generated brochure onto physical paper.

[0110] This invention relates to a system that automatically generates, displays, and prints individual brochures based on questions and requests entered by users via terminals installed in stores or through a website. The system utilizes natural language processing technology and database search technology to quickly provide customized information tailored to the specific needs of each user.

[0111] Components and technologies used

[0112] Acceptance of user input

[0113] Users input information through touchscreens on their devices or forms on websites. For example, they might input, "Which is the latest air conditioner with high energy efficiency?"

[0114] The terminal receives user input and sends it to the server as an HTTP request.

[0115] Analysis of user requirements

[0116] The server uses Python natural language processing libraries (such as NLTK and spaCy) to analyze the received questions and requests. The analysis extracts important keywords, such as "energy saving" and "air conditioner."

[0117] Search for related information

[0118] The server generates SQL statements based on the extracted keywords and executes queries against database management systems such as MySQL (registered trademark) and PostgreSQL. An example of such a query is "SELECT FROM products WHERE type='air conditioner' AND feature='energy saving'".

[0119] Generating brochure content

[0120] The server uses an HTML templating engine like Jinja2 to embed information retrieved from the database into pre-configured templates, automatically generating structured brochures.

[0121] Display and verification of the brochure

[0122] The terminal displays a preview of the generated brochure to the user. The user can review the content and make corrections as needed.

[0123] Final generation and printing of the brochure

[0124] If the user is satisfied with the preview, they press the confirm button.

[0125] The terminal sends the confirmed information to the server, and the server generates the final version of the brochure and sends it back to the terminal.

[0126] The terminal displays the final version of the brochure and allows printing as needed.

[0127] Specific example

[0128] Specific examples of users seeking product information

[0129] 1. The user enters "Tell me about the latest energy-saving air conditioners" into their device.

[0130] 2. The terminal sends the input content to the server.

[0131] 3. The server uses natural language processing technology to extract the keywords "latest," "energy-saving," and "air conditioner."

[0132] 4. The server searches the database for relevant air conditioner information (e.g., specifications, price, and images for each product).

[0133] 5. The server inserts the search results into a template to automatically generate the brochure.

[0134] 6. The device displays a preview of the brochure for the user to review.

[0135] 7. The user presses the confirm button.

[0136] 8. The terminal sends the confirmed data to the server.

[0137] 9. The server generates the final version of the brochure and sends it to the terminal.

[0138] 10. The terminal displays the final version and prints it if necessary.

[0139] Example of a prompt

[0140] "Please tell me about the latest energy-efficient air conditioners and their prices. Specifically, I'd like to know about the annual electricity cost savings."

[0141] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0142] Program processing flow

[0143] Step 1: Accepting user input

[0144] user:

[0145] Input: Enter your questions or requests into terminals installed in the store or into forms on the website.

[0146] Specific actions: Users input questions such as "Which air conditioner has the latest energy efficiency?" using a touchscreen or keyboard.

[0147] Output: User questions and requests are saved digitally on the device.

[0148] Terminal:

[0149] Input: Digital data of questions and requests entered by users.

[0150] Specific operation: Receives input and sends it to the server as appropriately formatted data.

[0151] Output: Formatted user questions and requests are sent to the server.

[0152] Step 2: Analyze user requirements

[0153] server:

[0154] Input: User questions and request data sent from the device.

[0155] Specific operation: Analyze text using natural language processing techniques and extract important keywords. Specifically, use Python's NLTK and spaCy to analyze sentences and extract important keywords such as "energy saving" and "air conditioner".

[0156] Output: A list of key keywords extracted.

[0157] Step 3: Search for related information

[0158] server:

[0159] Input: A list of key keywords extracted.

[0160] Specific operation: Generates SQL statements based on keywords and executes queries in database management systems such as MySQL and PostgreSQL. For example, it executes a query like "SELECT FROM products WHERE type='air conditioner' AND feature='energy saving'".

[0161] Output: A list of relevant information retrieved from the database (e.g., product specifications, price, images, etc.).

[0162] Step 4: Generating the brochure content

[0163] server:

[0164] Input: A list of relevant information retrieved from the database.

[0165] Specific operation: Using an HTML templating engine like Jinja2, the system automatically generates structured brochures by embedding the retrieved information into a pre-configured template. For example, it might embed data such as "Air conditioner A - Price: 50,000 yen, Annual electricity cost: 12,000 yen" into the template.

[0166] Output: Digital data of an automatically generated brochure.

[0167] Step 5: View and verify the brochure.

[0168] Terminal:

[0169] Input: Digital data of automatically generated brochures sent from the server.

[0170] Specific operation: A preview of the generated brochure is displayed on a web browser or device screen.

[0171] Output: A preview of the brochure that the user can view.

[0172] user:

[0173] Input: A preview of the brochure displayed on the terminal.

[0174] Specific actions: Review the displayed preview and make corrections as needed. If corrections are required, enter the corrections through the terminal interface.

[0175] Output: Brochure data containing the revised content.

[0176] Step 6: Final generation and printing of the brochure

[0177] user:

[0178] Input: Preview of the finalized brochure.

[0179] Specific action: Confirm that the preview is correct and press the confirm button.

[0180] Output: Confirmed information is set on the terminal.

[0181] Terminal:

[0182] Input: Confirmed information from the user.

[0183] Specific action: Send confirmed information to the server.

[0184] Output: Confirmed information is sent to the server.

[0185] server:

[0186] Input: Confirmed information sent from the device.

[0187] Specific action: Generate the final version of the brochure data and send it to the terminal.

[0188] Output: Final version of the brochure data.

[0189] Terminal:

[0190] Input: Final version of the brochure data.

[0191] Specific actions: Display the final version of the brochure and print it using a printer if necessary.

[0192] Output: The final version of the brochure that the user can review, and printed copies of the brochure.

[0193] (Application Example 1)

[0194] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0195] Currently, in many physical stores, customers need to browse through a large number of brochures and catalogs to obtain detailed information about products. However, much of this information is general and does not address individual needs, making it difficult for customers to find information that suits their requirements. Furthermore, it is time-consuming and laborious for store staff to answer each question, making efficient service provision difficult. This can lead to decreased customer satisfaction and negatively impact sales. This invention aims to solve these problems.

[0196] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0197] In this invention, the server includes means for receiving questions and requests entered by the user via a terminal, means for analyzing the questions and requests and extracting important keywords, means for searching a database for relevant information based on the important keywords, means for automatically generating individual brochures based on the relevant information, means for displaying the automatically generated brochures on the user terminal for confirmation and modification, means for generating a final version of the modified brochure and sending it to the terminal, and means for printing the finalized brochure. This enables customers to quickly and accurately obtain customized information that meets their needs. It also reduces the burden on store staff and enables efficient service provision.

[0198] A "terminal" is an electronic device used by users to input questions and requests and receive information.

[0199] "Means for receiving questions and requests" refers to a function for sending text information entered by the user to the server.

[0200] "Means for analyzing questions and requests" refers to a function that uses natural language processing technology to extract important keywords from input text data.

[0201] "Key keywords" are words or phrases that are particularly meaningful in a question or request.

[0202] "Means of searching for related information from a database" refers to a function that searches for related information within a database based on extracted keywords.

[0203] "Method for automatically generating individual brochures" refers to a function that automatically creates brochures according to a template based on the searched relevant information.

[0204] "A means of displaying, reviewing, and correcting automatically generated brochures on a user's terminal" refers to a function that provides the user with a view of the generated brochure's content, allowing the user to review and correct that content.

[0205] "Means for generating and sending a final version of the revised brochure to the terminal" refers to a function that confirms and revises the brochure as reviewed and corrected by the user, generates the final version, and sends it to the user's terminal.

[0206] "Means of printing brochures" refers to the function of printing a finalized brochure onto physical paper media.

[0207] "Natural language processing technology" is a general term for technologies that enable computers to understand, analyze, and process human language.

[0208] This invention details an embodiment of a system in which a user inputs questions and requests regarding products through a terminal in a physical store, and a customized brochure is automatically generated based on that information.

[0209] The system configuration includes user terminals, servers for analysis and generation processing, and a database. Specifically, it consists of the following:

[0210] First, users enter their questions or requests using an electronic terminal or tablet installed in the physical store. For example, they can enter a request such as, "Please tell me about the latest energy-saving air conditioners."

[0211] The input information is sent to the server. The server uses natural language processing (NLP) techniques to analyze this input text and extract important keywords. This analysis primarily uses the Python NLTK library.

[0212] Based on the extracted keywords, the server searches the database for information on related products. The database is built on an SQL basis and stores information such as product specifications, prices, and images.

[0213] After the relevant information is retrieved, the server automatically generates a customized brochure based on this information. The generation process uses the Django framework, and the ReportLab library is used for PDF generation. At this stage, the information is arranged according to a pre-configured template, and the brochure is generated.

[0214] A preview of the generated brochure is displayed on the user's device. The user can review this preview and make corrections as needed. The corrected content is then sent back to the server, which generates the final version of the brochure.

[0215] Finally, the finalized brochure is sent to the terminal and printed as needed. This allows users to quickly obtain information optimized for their needs.

[0216] Specific example:

[0217] When a user types "Tell me about the latest smartphones" into a store's tablet terminal, the system performs the following steps: First, it extracts the keywords "latest" and "smartphone" and searches the database for relevant smartphone information. Next, it generates a customized brochure based on the retrieved information and displays this brochure to the user. Once the user reviews and makes corrections, the corrected information is sent back to the server to generate a final version. Finally, the final version of the brochure is displayed to the user and printed.

[0218] Example of a prompt:

[0219] "Design a system that generates customized brochures based on questions and requests entered by users on their devices. Specifically, describe the entire process, including keyword extraction using natural language processing, database search, brochure generation using templates, user confirmation, and final version generation and printing."

[0220] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0221] Step 1:

[0222] Process name: User input reception

[0223] Subject: User

[0224] Specific operation: Users use terminals in physical stores to input questions or requests. This input is done through the interface of a tablet or kiosk terminal.

[0225] Input: User questions or requests (e.g., "Please tell me about the latest energy-saving air conditioners")

[0226] Output: Input text data

[0227] Step 2:

[0228] Process name: Sending input

[0229] Subject: terminal

[0230] Specific operation: The entered text data is sent to the server. The HTTP protocol is used for this process.

[0231] Input: Text data

[0232] Output: Text data is sent to the server.

[0233] Step 3:

[0234] Process name: Analysis of questions and requests

[0235] Subject: Server

[0236] Specific operation: The server uses natural language processing (NLP) techniques to analyze the received text data. It uses the Python NLTK library to extract important keywords.

[0237] Input: Text data

[0238] Data Processing / Data Calculation: Analysis and Keyword Extraction using NLP Technology

[0239] Output: Keywords (e.g., "latest", "energy-saving", "air conditioner")

[0240] Step 4:

[0241] Process name: Search for related information

[0242] Subject: Server

[0243] Specific operation: Based on the extracted keywords, the server searches for relevant information in the SQL database.

[0244] Input: Keyword

[0245] Data Processing / Data Calculation: Data Retrieval using SQL Queries

[0246] Output: Related information (product information, images, specifications, price, etc.)

[0247] Step 5:

[0248] Process name: Automatic generation of brochures

[0249] Subject: Server

[0250] Specific operation: Based on the searched information, the server embeds the information into a brochure template and automatically generates it. The Django framework and ReportLab library are used.

[0251] Input: Related Information

[0252] Data processing / data calculation: Placing information in a template and generating a PDF.

[0253] Output: Automated brochure

[0254] Step 6:

[0255] Process name: Display preview

[0256] Subject: terminal

[0257] Specific operation: An automatically generated brochure is sent to the terminal and displayed to the user as a preview. The user can review the content and make corrections as needed.

[0258] Input: Automated brochure

[0259] Output: Preview screen for user review and modification.

[0260] Step 7:

[0261] Process name: Sending corrected data

[0262] Subject: User and device

[0263] Specific operation: The user reviews the contents of the brochure, makes any necessary corrections, and sends the corrected data to the server.

[0264] Input: Revised brochure data

[0265] Output: Corrected data is sent to the server.

[0266] Step 8:

[0267] Process name: Generation of final version

[0268] Subject: Server

[0269] Specific operation: The server generates the final version of the brochure based on the corrected information.

[0270] Input: Correction data

[0271] Data processing / data calculation: Reflecting revisions and generating the final version of the brochure.

[0272] Output: Final version of the brochure

[0273] Step 9:

[0274] Process name: Sending and printing the final version

[0275] Subject: Terminals and Servers

[0276] Specific actions: The final version of the brochure is sent to the terminal and displayed to the user. Printing is also performed as needed.

[0277] Input: Final version of the pamphlet

[0278] Output: Pamphlet displayed and printed on the user's terminal

[0279] Furthermore, an emotion engine for estimating the user's emotions may be combined. That is, the specific processing unit 290 may estimate the user's emotions using the emotion recognition model 59 and perform specific processing using the user's emotions.

[0280] This invention relates to a system that automatically generates, displays, and prints individual pamphlets based on questions and requests input by a user via a terminal. Furthermore, by combining an emotion engine that recognizes the user's emotions, it realizes customized information provision according to the user's emotions.

[0281] Overall configuration of the system

[0282] 1. Reception of user input

[0283] Terminal: The user inputs questions and requests through a terminal installed in the store or via a website. For example, a specific request such as "Please tell me about the latest energy-saving air conditioners" is input.

[0284] Terminal: When the input is completed, the terminal sends the user's input content to the emotion engine to recognize the user's emotions (e.g., joy, excitement, anxiety).

[0285] 2. Analysis of user requests and emotions

[0286] Server: Receives the text data and emotion data sent from the terminal and analyzes the text using natural language processing (NLP) technology. Here, important keywords (e.g., "energy-saving performance", "air conditioner") are extracted.

[0287] 3. Search for relevant information

[0288] Server: Based on the extracted keywords, it queries the database to find relevant information (e.g., a list of air conditioners with excellent energy efficiency).

[0289] 4. Generating the content of the brochure

[0290] Server: Uses the retrieved information to insert data into a template for generating brochures. The template has pre-configured layouts including title, description, and images.

[0291] Server: Based on data from the emotion engine, adjusts the content and design of the brochure. For example, if a user is feeling anxious, it will highlight detailed specifications and warranty information.

[0292] 5. Display and verification of the brochure.

[0293] Terminal: Displays a preview of the automatically generated brochure to the user. The user reviews this preview and makes corrections as needed.

[0294] User: Review the preview content and confirm if you are satisfied.

[0295] 6. Final creation and printing of the brochure

[0296] Terminal: The user sends the confirmed information to the server to generate the final version of the brochure.

[0297] Server: Generates the finalized brochure data and sends that data to the terminal.

[0298] Terminal: Displays the final version of the brochure to the user, and allows printing as needed in stores.

[0299] Specific example

[0300] Example 1: User seeking product information

[0301] 1. User: Input "Please tell me about the latest energy-saving air conditioners" into the store terminal. At this time, the emotion engine uses the camera and sensors to analyze the user's expression and recognizes that the user is feeling a little anxious.

[0302] 2. Terminal: Send the above input and emotion data to the server.

[0303] 3. Server: Use natural language processing technology to extract important keywords such as "latest", "energy-saving", and "air conditioner". Also, based on the data of the emotion engine, identify the user's sense of uneasiness.

[0304] 4. Server: Search the database for information on relevant air conditioners (e.g., specifications, prices, images of each product).

[0305] 5. Server: Based on the information obtained, automatically generate a pamphlet that emphasizes detailed specification information, warranty period, and customer reviews to reduce the user's uneasiness.

[0306] <00​​​​​​​​​​​​​​​​​​​​In this way, the present invention can respond quickly and accurately to user questions and requests, and furthermore, provide information that takes user emotions into consideration. This can improve the user experience.

[0312] The following describes the processing flow.

[0313] Step 1:

[0314] User: Access a website or in-store terminal and enter your question or request. For example, "Please tell me about the latest energy-saving air conditioners."

[0315] Step 2:

[0316] Terminal: Receives user input and sends it to the server, while also having the emotion engine analyze the user's facial expressions, tone of voice, etc. The emotion engine recognizes the user's emotions (e.g., anxiety, excitement) and sends that data to the server.

[0317] Step 3:

[0318] Server: Text data sent from the terminal is passed to a natural language processing (NLP) engine to analyze questions and requests. Here, important keywords such as "energy efficiency" and "air conditioner" are extracted.

[0319] Step 4:

[0320] Server: Analyzes emotional data sent from the emotion engine to identify the user's current emotional state (e.g., anxiety).

[0321] Step 5:

[0322] Server: Based on the extracted keywords, it searches the database for relevant information (e.g., a list of energy-saving air conditioners, specifications and prices for each product, images).

[0323] Step 6:

[0324] Server: Retrieves search results and automatically generates brochures by inserting the data into a template. The content and design of the brochure are adjusted based on user sentiment data. For example, detailed specifications and warranty information are emphasized for users who are feeling anxious.

[0325] Step 7:

[0326] Server: Creates a preview of the automatically generated brochure and sends the data to the terminal.

[0327] Step 8:

[0328] Terminal: Displays a preview to the user and prompts them to review the content. The user reviews the preview and enters any necessary corrections.

[0329] Step 9:

[0330] User: Review the preview content and, if satisfied, enter your confirmation instructions.

[0331] Step 10:

[0332] Terminal: Receives user confirmation and sends that information to the server.

[0333] Step 11:

[0334] Server: Generates the finalized brochure data and sends that data to the terminal.

[0335] Step 12:

[0336] Terminal: Displays the final version of the brochure to the user, and allows printing as needed in stores.

[0337] (Example 2)

[0338] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0339] While current information systems can adequately respond to user questions and requests, these responses often fail to consider the user's emotional state, potentially leading to decreased user satisfaction. Furthermore, the lack of systems that provide customized information tailored to user emotions hinders the improvement of the user experience.

[0340] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0341] In this invention, the server includes means for receiving questions and requests entered by the user via a terminal, means for collecting user emotion data along with the questions and requests, means for analyzing the questions and requests and extracting important keywords, means for analyzing the emotion data and recognizing the user's emotions, means for searching a database for relevant information based on the important keywords, means for automatically generating individual brochures corresponding to the user's emotions based on the relevant information, and means for displaying the automatically generated brochures on the user terminal. This makes it possible to provide customized information according to the user's emotional state.

[0342] A "terminal" is an information device used by users to input information, and includes terminals installed in stores and those accessed via websites.

[0343] A "user" is an individual who uses the system to enter questions or requests.

[0344] "Questions and requests" refer to text-based requests or inquiries for information entered by the user via their device.

[0345] "Emotional data" refers to emotional information based on the user's facial expressions and actions, collected using the device's camera and sensors.

[0346] Natural Language Processing (NLP) is a technology that analyzes user input text to understand its meaning and context.

[0347] "Key keywords" are central words or phrases extracted from questions and requests using natural language processing technology, which are essential when searching for relevant information.

[0348] An "emotion engine" is software or algorithms that analyze collected emotional data to recognize a user's emotional state.

[0349] A "database" is a collection of information that stores and manages related information in a searchable format.

[0350] "Related information" refers to information and data retrieved from the database based on important keywords.

[0351] A "brochure" is informational material about specific products or services that is automatically generated based on the user's questions, requests, and emotional state.

[0352] "Automated generation" refers to the process by which content and information are created using specific algorithms or templates, without manual intervention.

[0353] A "preview" is a temporary display format shown to the user for final confirmation of the automatically generated brochure's contents.

[0354] "Correction" refers to the process where a user requests changes or additions after reviewing a preview, and those changes are then reflected in the system.

[0355] The "final version" refers to the final version of the brochure that has been confirmed and revised by users.

[0356] This invention relates to a system that automatically generates, displays, and prints individual brochures based on questions and requests entered by the user via a terminal. Furthermore, by combining this with an emotion engine that recognizes the user's emotions, it realizes the provision of customized information that responds to the user's emotions.

[0357] Overall system configuration

[0358] Acceptance of user input

[0359] Users enter questions and requests through terminals installed in stores or via a website. This system allows for specific requests, such as "Please tell me about the latest energy-saving air conditioners." Once the input is complete, the terminal uses cameras and sensors to capture the user's facial expressions and movements, and sends this emotional data to a server.

[0360] Data analysis and extraction

[0361] The server receives text data and sentiment data sent from the terminal. The received text data is analyzed using natural language processing (NLP) techniques, and important keywords such as "energy saving performance" and "air conditioner" are extracted through morphological analysis. At the same time, the sentiment engine is used to analyze the sentiment data and identify the user's emotional state (e.g., joy, anxiety).

[0362] Search for related information

[0363] The server queries its built-in database based on the extracted key keywords to retrieve relevant information (e.g., a list of energy-efficient air conditioners).

[0364] Generating brochure content

[0365] The server uses the retrieved information to insert data into a brochure generation template and generates an initial version of the brochure. This template includes a title, description, images, and other elements. Furthermore, based on the analysis results of the emotion engine, the brochure's content and design are adjusted to match the user's emotions. For example, if the user is feeling anxious, detailed specifications and warranty information will be emphasized.

[0366] View and check the preview

[0367] The terminal displays a preview of the automatically generated brochure to the user. The user can review this preview and enter any necessary corrections. If there are any corrections, the terminal resends the information to the server, which then applies the changes.

[0368] Final creation and printing of the brochure

[0369] When the user presses the confirm button, the terminal sends the confirmed information to the server. The server generates the final version of the brochure based on the confirmed data and sends it to the terminal in a format such as PDF. The final version of the brochure is displayed on the terminal and can be printed on the spot at the store if needed.

[0370] Specific example

[0371] Example 1: User seeking product information

[0372] 1. User: Enters "Please tell me about the latest energy-saving air conditioners" into the store's terminal. At this time, cameras and sensors analyze the user's facial expressions and recognize that they are feeling anxious.

[0373] 2. Terminal: Sends the above input content and emotion data to the server.

[0374] 3. Server: Uses natural language processing technology to extract important keywords such as "latest," "energy-saving," and "air conditioner." It also identifies user anxieties based on data from the emotion engine.

[0375] 4. Server: Searches the database for relevant air conditioner information (e.g., specifications, price, and images for each product).

[0376] 5. Server: Based on the acquired information, it automatically generates brochures that highlight detailed specifications, warranty periods, and customer reviews to alleviate user concerns.

[0377] 6. Terminal: Displays a preview of the automatically generated brochure to the user.

[0378] 7. User: Review the preview and confirm if you are satisfied with the content.

[0379] 8. Terminal: Sends the confirmed information to the server.

[0380] 9. Server: Generates the final brochure and sends it to the terminal.

[0381] 10. Terminal: Display the final version of the brochure to the user and print it as needed.

[0382] Examples of prompt statements

[0383] "Please create a brochure about the latest energy-saving air conditioners. Based on the sentiment analysis results, emphasize the detailed specifications and warranty period to users who are feeling anxious."

[0384] By using this prompt, the generative AI model can generate brochures that provide information tailored to the user's needs and emotions.

[0385] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0386] Step 1: Accepting user input

[0387] User: Enters their questions and requests via terminals installed in the store or through the website. An example input would be, "Please tell me about the latest energy-saving air conditioners."

[0388] Device: Records entered text data. It also uses the device's built-in camera and sensors to capture the user's facial expressions and movements, collecting emotional data.

[0389] Input: Questions, requests, and sentiment data entered by the user.

[0390] Output: Recorded text data and sentiment data.

[0391] Step 2: Send

[0392] Terminal: Encrypts recorded text and sentiment data and sends it to the server via secure communication.

[0393] Input: Recorded text data and sentiment data.

[0394] Output: Text data and sentiment data sent to the server.

[0395] Step 3: Analysis using Natural Language Processing (NLP)

[0396] Server: Analyzes received text data using natural language processing (NLP) techniques. Through morphological analysis, it extracts important keywords such as "energy saving" and "air conditioner" from the text.

[0397] Input: Text data sent to the server.

[0398] Data processing: Perform morphological analysis and extract important keywords.

[0399] Output: Key keywords extracted.

[0400] Step 4: Emotion Analysis

[0401] Server: Analyzes received emotional data using an emotion engine to identify the user's emotional state (e.g., joy, anxiety).

[0402] Input: Emotional data sent to the server.

[0403] Data processing: Perform sentiment analysis to identify the user's emotional state.

[0404] Output: The emotional state of the identified user.

[0405] Step 5: Search for related information

[0406] Server: Based on the extracted key keywords, it queries the built-in database to retrieve relevant information (e.g., a list of energy-efficient air conditioners).

[0407] Input: Key keywords extracted.

[0408] Data Calculation: Execute database queries to retrieve relevant information.

[0409] Output: Relevant information retrieved.

[0410] Step 6: Creating the brochure

[0411] Server: Inserts the searched information into a template and generates an initial version of the brochure. The template includes a title, description, images, etc. It also adjusts the content and design of the brochure based on the results of the emotion engine's analysis. For example, if the user is feeling anxious, it will emphasize detailed specifications and warranty information.

[0412] Input: Relevant information obtained and the identified user's emotional state.

[0413] Data processing: Insert information into templates and customize brochures.

[0414] Output: Early version of the brochure.

[0415] Step 7: Displaying the preview

[0416] Terminal: Displays a preview of the automatically generated brochure to the user.

[0417] Input: Early version of the brochure.

[0418] Output: The brochure displayed as a preview to the user.

[0419] Step 8: User verification and correction

[0420] User: Review the preview and enter any necessary corrections. For example, enter requests such as changing the image or adding a description.

[0421] Input: Preview content and user modifications.

[0422] Output: Revised brochure content.

[0423] Step 9: Applying the changes

[0424] Server: Receives corrections submitted by users and reflects them in the brochure.

[0425] Input: Revised brochure content.

[0426] Data processing: Add / modify the correction details to the brochure.

[0427] Output: Revised brochure.

[0428] Step 10: Final generation and printing

[0429] Terminal: When the user presses the confirm button, the confirmed information is sent to the server.

[0430] Server: Generates the final version of the brochure based on the confirmed data. Sends the generated brochure to the terminal in a format such as PDF.

[0431] Input: Revised brochure content.

[0432] Data processing: Generate the final version of the brochure.

[0433] Output: Final version of the brochure.

[0434] Terminal: Displays the final version of the brochure to the user and prints it on the spot if necessary.

[0435] Input: Final version of the brochure.

[0436] Output: The final version of the brochure displayed to the user and the printed brochure.

[0437] (Application Example 2)

[0438] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0439] Traditional information systems could only provide standardized information in response to user questions and requests, failing to adequately address individual needs. Furthermore, services that considered user emotions were rarely offered, highlighting the room for improvement in the user experience. In particular, customer service in physical stores demands real-time, emotionally responsive, and personalized information.

[0440] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0441] In this invention, the server includes means for receiving user questions and requests, means for extracting important keywords, means for searching for relevant information from information sources, and means for adjusting the content and design of the generated materials using an emotion engine. This enables the automatic generation of materials based on user-inputted questions and requests, and also allows for emotion-based customization.

[0442] "Device" refers to a terminal or equipment where users input questions or requests and that information is processed.

[0443] "Questions and requests" refer to input from users that seek information or knowledge to be provided.

[0444] "Key keywords" refer to the main words and phrases necessary for information retrieval and document generation, extracted from user questions and requests.

[0445] "Information source" refers to data provision systems such as databases and APIs used to search for and retrieve relevant information.

[0446] "Materials" refers to a collection of information automatically generated in response to user questions and requests, and is provided in the form of brochures, documents, and other similar materials.

[0447] An "emotion engine" refers to a system that recognizes a user's emotions and adjusts the information provided based on those emotions.

[0448] A "user terminal" refers to a device, such as a display device or printing device, that allows the user to view and manipulate the final generated document.

[0449] This invention relates to a system that automatically generates, displays, and prints individual materials based on questions and requests entered by the user through a device. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it provides customized information tailored to the user's feelings.

[0450] System Configuration

[0451] 1. Acceptance of user input:

[0452] Device: Users enter questions and requests through a terminal installed on the device or via an internet site. For example, they might enter a specific request such as, "Please tell me about the latest energy-saving air conditioners." The device is equipped with a camera that captures the user's facial expressions.

[0453] 2. Analysis of user requirements and emotions:

[0454] Server: Receives text and sentiment data transmitted from the device and analyzes the text using natural language processing (NLP) techniques. Here, important keywords (e.g., "energy-saving," "air conditioner") are extracted.

[0455] Emotion Engine: Analyzes captured user facial expression data to identify the user's emotions (e.g., joy, excitement, anxiety).

[0456] 3. Search for related information:

[0457] Server: Based on the extracted keywords, it queries information sources to find relevant information (e.g., a list of energy-efficient air conditioners).

[0458] 4. Generating the document content:

[0459] Server: Uses the retrieved information to insert data into a template for generating documents. The template has pre-configured layouts including title, description, and images.

[0460] Emotional Engine: Adjusts the content and design of materials based on emotional data. For example, if a user is feeling anxious, it will highlight detailed specifications and warranty information.

[0461] 5. Display and verify the documents:

[0462] Device: Displays a preview of automatically generated documents to the user. The user reviews this preview and makes corrections as needed.

[0463] User: Review the preview content and confirm if you are satisfied.

[0464] 6. Final generation and printing of the document:

[0465] Device: The user submits the confirmed information to the server, which then generates the final version of the document.

[0466] Server: Generates the finalized data and sends it to the device.

[0467] Device: Displays the final version of the document to the user and prints it as needed.

[0468] Hardware and software to be used

[0469] Hardware: Smart devices, cameras

[0470] software:

[0471] Emotion engine: facial_emotion_recognition (Python library)

[0472] Natural Language Processing: TextBlob (Python library)

[0473] Data retrieval: Requests (Python library)

[0474] Specific example

[0475] Example 1: User seeking product information

[0476] 1. User: Enters "Tell me about the latest energy-saving air conditioners" into a device at a physical store. A camera captures the user's facial expression, and an emotion engine analyzes whether the user is feeling slightly anxious.

[0477] 2. Server: Uses natural language processing technology to extract important keywords such as "latest," "energy-saving," and "air conditioner." It also identifies user anxiety levels based on sentiment data.

[0478] 3. Server: Searches the database for relevant air conditioner information (e.g., specifications, price, and images for each product).

[0479] 4. Server: Based on the acquired information, it automatically generates materials that highlight detailed specifications, warranty periods, and customer reviews to alleviate user concerns.

[0480] 5. Device: Displays a preview of automatically generated documents to the user.

[0481] 6. User: Review the preview, and if satisfied with the content, confirm it to generate and print the final version.

[0482] Example of a prompt

[0483] User question: Please tell me more about the latest energy-saving air conditioners. User facial expression image path: path_to_user_image.jpg. Use the emotion engine to perform emotion analysis and generate a brochure containing appropriate information.

[0484] This system enables quick and accurate responses to user-submitted questions and requests, and also allows for the provision of information that is sensitive to the user's feelings.

[0485] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0486] Step 1:

[0487] The stage where the user enters questions or requests into the device.

[0488] Input: The user enters a question or request on their smart device. Example: "Please tell me about the latest energy-saving air conditioners."

[0489] Specific operation: The user enters questions or requests into an input form that appears on the smart device's display. The device's camera simultaneously captures the user's facial expressions.

[0490] Step 2:

[0491] The stage where the terminal sends user input and facial expression data to the server.

[0492] Input: User text input data and captured facial expression images.

[0493] Specific operation: The terminal sends the acquired text data and facial expression image data to the server. HTTP requests are used for communication.

[0494] Step 3:

[0495] The server analyzes questions and requests using natural language processing.

[0496] Input: Text data of user questions or requests.

[0497] Data processing: The server uses TextBlob to analyze questions and requests and extract important keywords. Examples: "latest," "energy-saving," "air conditioner."

[0498] Output: Extracted key keywords.

[0499] Specific operation: The server parses the received text data using TextBlob and passes the extracted keywords to the next process.

[0500] Step 4:

[0501] The server analyzes facial expression data using the emotion engine.

[0502] Input: User's facial expression image data.

[0503] Data processing: Use an emotion engine to analyze facial expression data and identify emotions. Examples: anxiety, joy.

[0504] Output: Identified user sentiment data.

[0505] Specific operation: The server inputs facial image data into the emotion engine and extracts the analysis results as emotion data.

[0506] Step 5:

[0507] The server searches for relevant information from the database.

[0508] Input: Extracted key keywords.

[0509] Data retrieval: The server queries the database or API based on these keywords to retrieve relevant information.

[0510] Output: Related information (e.g., product specifications, images, price).

[0511] Specific operation: The server executes a search query against the database and passes the returned results as components to the next stage.

[0512] Step 6:

[0513] The server generates document content based on emotional data.

[0514] Input: Related information and user sentiment data.

[0515] Data processing: The server inserts relevant information into the template and generates materials with content and design adjusted based on user sentiment data.

[0516] Output: Automated document data.

[0517] Specific operation: The server reads a template, and generates materials by customizing them based on the retrieved relevant information and the user's sentiment.

[0518] Step 7:

[0519] The terminal displays a preview of the automatically generated document.

[0520] Input: Data from automatically generated documents.

[0521] Specific action: The device displays the generated document on its screen and prompts the user for confirmation.

[0522] Step 8:

[0523] The stage where the user reviews and modifies the document.

[0524] Input: Previewed document.

[0525] Output: Data from the document, corrected as needed.

[0526] Specific actions: The user reviews the displayed document and makes corrections as needed using the touch panel or keyboard.

[0527] Step 9:

[0528] The stage where the terminal sends confirmed documents to the server.

[0529] Input: Data from corrected and finalized documents.

[0530] Specific operation: Once the user confirms the document, the terminal sends the revised document to the server.

[0531] Step 10:

[0532] The server generates the final version of the document and sends it to the terminal.

[0533] Input: Data from the corrected document.

[0534] Data processing: Format the final document and generate it as the final version.

[0535] Output: Data from the final version of the document.

[0536] Specific operation: The server generates the final version of the document based on the received data and sends it to the terminal.

[0537] Step 11:

[0538] The terminal is at the stage where it displays and prints the final version of the document.

[0539] Input: Data from the final version of the document.

[0540] Specific operation: The terminal displays the final version of the document on its screen and prints it upon user request.

[0541] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0542] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0543] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0544] [Second Embodiment]

[0545] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0546] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0547] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0548] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0549] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0550] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0551] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0552] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0553] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0554] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0555] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0556] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0557] This invention relates to a system that automatically generates, displays, and prints individual brochures based on questions and requests entered by users via a terminal. This system utilizes natural language processing (NLP) and database search technologies to quickly provide customized information tailored to the specific needs of each user.

[0558] Overall system configuration

[0559] 1. Receiving user input

[0560] Terminal: Users enter questions and requests through terminals installed in the store or via a website. For example, they might enter a specific request such as, "Which air conditioner has high energy efficiency?"

[0561] 2. Analysis of user requirements

[0562] Server: Receives questions and requests sent from terminals and analyzes the text using natural language processing techniques. Extracts keywords deemed important.

[0563] 3. Searching for related information

[0564] Server: Based on the extracted keywords, it searches the database for relevant information and images. For example, if the keywords "energy efficiency" and "air conditioner" are extracted, it retrieves product information and images related to them.

[0565] 4. Generating the content of the brochure

[0566] Server: Using the retrieved information, the server automatically generates the content of the brochure according to a pre-configured template. This template includes the placement of elements such as title, description, and images.

[0567] 5. Display and verification of the brochure.

[0568] Terminal: Displays a preview of the automatically generated brochure to the user. The user reviews this preview and makes corrections as needed.

[0569] User: Review the preview content and confirm if you are satisfied.

[0570] 6. Final creation and printing of the brochure

[0571] Terminal: The user sends the confirmed information to the server to generate the final version of the brochure.

[0572] Server: Generates the finalized brochure data and sends it to the terminal.

[0573] Terminal: Displays the final version of the brochure to the user, and allows printing as needed in stores.

[0574] Specific example

[0575] Example 1: User seeking product information

[0576] 1. User: Enters "Please tell me about the latest energy-saving air conditioners" into the store's terminal.

[0577] 2. Terminal: Send the above input to the server.

[0578] 3. Server: Uses natural language processing technology to extract important keywords such as "latest," "energy-saving," and "air conditioner."

[0579] 4. Server: Searches the database for relevant air conditioner information (e.g., specifications, price, and images for each product).

[0580] 5. Server: Based on the acquired information, it automatically generates the brochure by inserting the data into the template.

[0581] 6. Terminal: Displays a preview of the automatically generated brochure to the user.

[0582] 7. User: Review the preview and confirm if you are satisfied with the content.

[0583] 8. Terminal: Sends the confirmed information to the server.

[0584] 9. Server: Generates the final brochure and sends it to the terminal.

[0585] 10. Terminal: Display the final version of the brochure to the user and print it as needed.

[0586] In this way, the present invention can respond quickly and accurately to the individual needs of users, and in particular, it enables real-time information provision and customized services in stores.

[0587] The following describes the processing flow.

[0588] Step 1:

[0589] User: Accesses a website or in-store terminal and enters a question or request. For example, enters the request, "Which air conditioner is the most energy-efficient?"

[0590] Step 2:

[0591] Terminal: Receives input from the user and sends that text data to the server.

[0592] Step 3:

[0593] Server: The received text data is passed to a natural language processing (NLP) engine to analyze the questions and requests. Here, important keywords (e.g., "energy efficiency," "air conditioner") are extracted.

[0594] Step 4:

[0595] Server: Based on the extracted keywords, it queries the database to find relevant information (e.g., a list of air conditioners with excellent energy efficiency).

[0596] Step 5:

[0597] Server: Receives search results and inserts the data into a template for generating brochures. This template has pre-configured layouts for titles, descriptions, images, etc.

[0598] Step 6:

[0599] Server: Generates a preview of the brochure and sends that data to the terminal.

[0600] Step 7:

[0601] Terminal: Displays a preview to the user and prompts them to confirm the content. The user reviews the preview and selects "Confirm" if they are satisfied with the content.

[0602] Step 8:

[0603] User: Review the preview, re-enter any necessary corrections, and perform a final check. If satisfied, press the confirm button.

[0604] Step 9:

[0605] Terminal: Receives user confirmation and sends that information to the server.

[0606] Step 10:

[0607] Server: Generates the finalized brochure data and sends that data to the terminal.

[0608] Step 11:

[0609] Terminal: Displays the final version of the brochure to the user, and allows printing as needed in stores.

[0610] (Example 1)

[0611] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0612] Conventional information systems make it difficult for users to quickly obtain the specific information they need, and in particular, they lack the means to provide customized information tailored to individual user needs. This can lead to ineffective real-time information provision and the creation of customized brochures in stores, potentially resulting in decreased user satisfaction.

[0613] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0614] In this invention, the server includes means for receiving questions and requests entered by the user via a terminal, means for analyzing the questions and requests and extracting important keywords using natural language processing technology, means for searching a database for relevant information based on the important keywords, means for automatically generating individual brochures using pre-configured templates based on the relevant information, and means for displaying the automatically generated brochures on the user terminal. This enables the rapid and accurate acquisition, display, and printing of customized information that corresponds to the user's individual requests.

[0615] A "user" refers to an individual or legal entity that uses the system to input questions or requests.

[0616] A "terminal" is a computer device used by users to input information, and can refer to information input devices installed in stores or websites.

[0617] "Questions and requests" refer to the information or requests that users want to obtain through the system.

[0618] "Natural language processing technology" refers to the technology used to analyze human language and convert it into a format that computers can understand and process.

[0619] "Key keywords" refer to words or phrases that are extracted through analysis from questions or requests and are particularly necessary for information retrieval and processing.

[0620] A "database" refers to a collection of information in which related information is stored in a structured manner.

[0621] A "template" refers to a pre-configured framework or format used to automatically generate the content of documents or brochures.

[0622] A "personalized brochure" refers to an informational document containing information customized to the specific needs of a particular user.

[0623] "Preview" refers to a display format that allows users to check the contents of an automatically generated brochure.

[0624] "Printing" refers to the process of outputting the generated brochure onto physical paper.

[0625] This invention relates to a system that automatically generates, displays, and prints individual brochures based on questions and requests entered by users via terminals installed in stores or through a website. The system utilizes natural language processing technology and database search technology to quickly provide customized information tailored to the specific needs of each user.

[0626] Components and technologies used

[0627] Acceptance of user input

[0628] Users input information through touchscreens on their devices or forms on websites. For example, they might input, "Which is the latest air conditioner with high energy efficiency?"

[0629] The terminal receives user input and sends it to the server as an HTTP request.

[0630] Analysis of user requirements

[0631] The server uses Python natural language processing libraries (such as NLTK and spaCy) to analyze the received questions and requests. The analysis extracts important keywords, such as "energy saving" and "air conditioner."

[0632] Search for related information

[0633] The server generates SQL statements based on the extracted keywords and executes queries against database management systems such as MySQL and PostgreSQL. An example of such a query is "SELECT FROM products WHERE type='air conditioner' AND feature='energy saving'".

[0634] Generating brochure content

[0635] The server uses an HTML templating engine like Jinja2 to embed information retrieved from the database into pre-configured templates, automatically generating structured brochures.

[0636] Display and verification of the brochure

[0637] The terminal displays a preview of the generated brochure to the user. The user can review the content and make corrections as needed.

[0638] Final generation and printing of the brochure

[0639] If the user is satisfied with the preview, they press the confirm button.

[0640] The terminal sends the confirmed information to the server, and the server generates the final version of the brochure and sends it back to the terminal.

[0641] The terminal displays the final version of the brochure and allows printing as needed.

[0642] Specific example

[0643] Specific examples of users seeking product information

[0644] 1. The user enters "Tell me about the latest energy-saving air conditioners" into their device.

[0645] 2. The terminal sends the input content to the server.

[0646] 3. The server uses natural language processing technology to extract the keywords "latest," "energy-saving," and "air conditioner."

[0647] 4. The server searches the database for relevant air conditioner information (e.g., specifications, price, and images for each product).

[0648] 5. The server inserts the search results into a template to automatically generate the brochure.

[0649] 6. The device displays a preview of the brochure for the user to review.

[0650] 7. The user presses the confirm button.

[0651] 8. The terminal sends the confirmed data to the server.

[0652] 9. The server generates the final version of the brochure and sends it to the terminal.

[0653] 10. The terminal displays the final version and prints it if necessary.

[0654] Example of a prompt

[0655] "Please tell me about the latest energy-efficient air conditioners and their prices. Specifically, I'd like to know about the annual electricity cost savings."

[0656] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0657] Program processing flow

[0658] Step 1: Accepting user input

[0659] user:

[0660] Input: Enter your questions or requests into terminals installed in the store or into forms on the website.

[0661] Specific actions: Users input questions such as "Which air conditioner has the latest energy efficiency?" using a touchscreen or keyboard.

[0662] Output: User questions and requests are saved digitally on the device.

[0663] Terminal:

[0664] Input: Digital data of questions and requests entered by users.

[0665] Specific operation: Receives input and sends it to the server as appropriately formatted data.

[0666] Output: Formatted user questions and requests are sent to the server.

[0667] Step 2: Analyze user requirements

[0668] server:

[0669] Input: User questions and request data sent from the device.

[0670] Specific operation: Analyze text using natural language processing techniques and extract important keywords. Specifically, use Python's NLTK and spaCy to analyze sentences and extract important keywords such as "energy saving" and "air conditioner".

[0671] Output: A list of key keywords extracted.

[0672] Step 3: Search for related information

[0673] server:

[0674] Input: A list of key keywords extracted.

[0675] Specific operation: Generates SQL statements based on keywords and executes queries in database management systems such as MySQL and PostgreSQL. For example, it executes a query like "SELECT FROM products WHERE type='air conditioner' AND feature='energy saving'".

[0676] Output: A list of relevant information retrieved from the database (e.g., product specifications, price, images, etc.).

[0677] Step 4: Generating the brochure content

[0678] server:

[0679] Input: A list of relevant information retrieved from the database.

[0680] Specific operation: Using an HTML templating engine like Jinja2, the system automatically generates structured brochures by embedding the retrieved information into a pre-configured template. For example, it might embed data such as "Air conditioner A - Price: 50,000 yen, Annual electricity cost: 12,000 yen" into the template.

[0681] Output: Digital data of an automatically generated brochure.

[0682] Step 5: View and verify the brochure.

[0683] Terminal:

[0684] Input: Digital data of automatically generated brochures sent from the server.

[0685] Specific operation: A preview of the generated brochure is displayed on a web browser or device screen.

[0686] Output: A preview of the brochure that the user can view.

[0687] user:

[0688] Input: A preview of the brochure displayed on the terminal.

[0689] Specific actions: Review the displayed preview and make corrections as needed. If corrections are required, enter the corrections through the terminal interface.

[0690] Output: Brochure data containing the revised content.

[0691] Step 6: Final generation and printing of the brochure

[0692] user:

[0693] Input: Preview of the finalized brochure.

[0694] Specific action: Confirm that the preview is correct and press the confirm button.

[0695] Output: Confirmed information is set on the terminal.

[0696] Terminal:

[0697] Input: Confirmed information from the user.

[0698] Specific action: Send confirmed information to the server.

[0699] Output: Confirmed information is sent to the server.

[0700] server:

[0701] Input: Confirmed information sent from the device.

[0702] Specific action: Generate the final version of the brochure data and send it to the terminal.

[0703] Output: Final version of the brochure data.

[0704] Terminal:

[0705] Input: Final version of the brochure data.

[0706] Specific actions: Display the final version of the brochure and print it using a printer if necessary.

[0707] Output: The final version of the brochure that the user can review, and printed copies of the brochure.

[0708] (Application Example 1)

[0709] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0710] Currently, in many physical stores, customers need to browse through a large number of brochures and catalogs to obtain detailed information about products. However, much of this information is general and does not address individual needs, making it difficult for customers to find information that suits their requirements. Furthermore, it is time-consuming and laborious for store staff to answer each question, making efficient service provision difficult. This can lead to decreased customer satisfaction and negatively impact sales. This invention aims to solve these problems.

[0711] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0712] In this invention, the server includes means for receiving questions and requests entered by the user via a terminal, means for analyzing the questions and requests and extracting important keywords, means for searching a database for relevant information based on the important keywords, means for automatically generating individual brochures based on the relevant information, means for displaying the automatically generated brochures on the user terminal for confirmation and modification, means for generating a final version of the modified brochure and sending it to the terminal, and means for printing the finalized brochure. This enables customers to quickly and accurately obtain customized information that meets their needs. It also reduces the burden on store staff and enables efficient service provision.

[0713] A "terminal" is an electronic device used by users to input questions and requests and receive information.

[0714] "Means for receiving questions and requests" refers to a function for sending text information entered by the user to the server.

[0715] "Means for analyzing questions and requests" refers to a function that uses natural language processing technology to extract important keywords from input text data.

[0716] "Key keywords" are words or phrases that are particularly meaningful in a question or request.

[0717] "Means of searching for related information from a database" refers to a function that searches for related information within a database based on extracted keywords.

[0718] "Method for automatically generating individual brochures" refers to a function that automatically creates brochures according to a template based on the searched relevant information.

[0719] "A means of displaying, reviewing, and correcting automatically generated brochures on a user's terminal" refers to a function that provides the user with a view of the generated brochure's content, allowing the user to review and correct that content.

[0720] "Means for generating and sending a final version of the revised brochure to the terminal" refers to a function that confirms and revises the brochure as reviewed and corrected by the user, generates the final version, and sends it to the user's terminal.

[0721] "Means of printing brochures" refers to the function of printing a finalized brochure onto physical paper media.

[0722] "Natural language processing technology" is a general term for technologies that enable computers to understand, analyze, and process human language.

[0723] This invention details an embodiment of a system in which a user inputs questions and requests regarding products through a terminal in a physical store, and a customized brochure is automatically generated based on that information.

[0724] The system configuration includes user terminals, servers for analysis and generation processing, and a database. Specifically, it consists of the following:

[0725] First, users enter their questions or requests using an electronic terminal or tablet installed in the physical store. For example, they can enter a request such as, "Please tell me about the latest energy-saving air conditioners."

[0726] The input information is sent to the server. The server uses natural language processing (NLP) techniques to analyze this input text and extract important keywords. This analysis primarily uses the Python NLTK library.

[0727] Based on the extracted keywords, the server searches the database for information on related products. The database is built on an SQL basis and stores information such as product specifications, prices, and images.

[0728] After the relevant information is retrieved, the server automatically generates a customized brochure based on this information. The generation process uses the Django framework, and the ReportLab library is used for PDF generation. At this stage, the information is arranged according to a pre-configured template, and the brochure is generated.

[0729] A preview of the generated brochure is displayed on the user's device. The user can review this preview and make corrections as needed. The corrected content is then sent back to the server, which generates the final version of the brochure.

[0730] Finally, the finalized brochure is sent to the terminal and printed as needed. This allows users to quickly obtain information optimized for their needs.

[0731] Specific example:

[0732] When a user types "Tell me about the latest smartphones" into a store's tablet terminal, the system performs the following steps: First, it extracts the keywords "latest" and "smartphone" and searches the database for relevant smartphone information. Next, it generates a customized brochure based on the retrieved information and displays this brochure to the user. Once the user reviews and makes corrections, the corrected information is sent back to the server to generate a final version. Finally, the final version of the brochure is displayed to the user and printed.

[0733] Example of a prompt:

[0734] "Design a system that generates customized brochures based on questions and requests entered by users on their devices. Specifically, describe the entire process, including keyword extraction using natural language processing, database search, brochure generation using templates, user confirmation, and final version generation and printing."

[0735] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0736] Step 1:

[0737] Process name: User input reception

[0738] Subject: User

[0739] Specific operation: Users use terminals in physical stores to input questions or requests. This input is done through the interface of a tablet or kiosk terminal.

[0740] Input: User questions or requests (e.g., "Please tell me about the latest energy-saving air conditioners")

[0741] Output: Input text data

[0742] Step 2:

[0743] Process name: Sending input

[0744] Subject: terminal

[0745] Specific operation: The entered text data is sent to the server. The HTTP protocol is used for this process.

[0746] Input: Text data

[0747] Output: Text data is sent to the server.

[0748] Step 3:

[0749] Process name: Analysis of questions and requests

[0750] Subject: Server

[0751] Specific operation: The server uses natural language processing (NLP) techniques to analyze the received text data. It uses the Python NLTK library to extract important keywords.

[0752] Input: Text data

[0753] Data Processing / Data Calculation: Analysis and Keyword Extraction using NLP Technology

[0754] Output: Keywords (e.g., "latest", "energy-saving", "air conditioner")

[0755] Step 4:

[0756] Process name: Search for related information

[0757] Subject: Server

[0758] Specific operation: Based on the extracted keywords, the server searches for relevant information in the SQL database.

[0759] Input: Keyword

[0760] Data Processing / Data Calculation: Data Retrieval using SQL Queries

[0761] Output: Related information (product information, images, specifications, price, etc.)

[0762] Step 5:

[0763] Process name: Automatic generation of brochures

[0764] Subject: Server

[0765] Specific operation: Based on the searched information, the server embeds the information into a brochure template and automatically generates it. The Django framework and ReportLab library are used.

[0766] Input: Related Information

[0767] Data processing / data calculation: Placing information in a template and generating a PDF.

[0768] Output: Automated brochure

[0769] Step 6:

[0770] Process name: Display preview

[0771] Subject: terminal

[0772] Specific operation: An automatically generated brochure is sent to the terminal and displayed to the user as a preview. The user can review the content and make corrections as needed.

[0773] Input: Automated brochure

[0774] Output: Preview screen for user review and modification.

[0775] Step 7:

[0776] Process name: Sending corrected data

[0777] Subject: User and device

[0778] Specific operation: The user reviews the contents of the brochure, makes any necessary corrections, and sends the corrected data to the server.

[0779] Input: Revised brochure data

[0780] Output: Corrected data is sent to the server.

[0781] Step 8:

[0782] Process name: Generation of final version

[0783] Subject: Server

[0784] Specific operation: The server generates the final version of the brochure based on the corrected information.

[0785] Input: Correction data

[0786] Data processing / data calculation: Reflecting revisions and generating the final version of the brochure.

[0787] Output: Final version of the brochure

[0788] Step 9:

[0789] Process name: Sending and printing the final version

[0790] Subject: Terminals and Servers

[0791] Specific actions: The final version of the brochure is sent to the terminal and displayed to the user. Printing is also performed as needed.

[0792] Input: Final version of the brochure

[0793] Output: Brochures displayed and printed on the user's device.

[0794] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0795] This invention relates to a system that automatically generates, displays, and prints individual brochures based on questions and requests entered by the user via a terminal. Furthermore, by combining this with an emotion engine that recognizes the user's emotions, it realizes the provision of customized information that responds to the user's emotions.

[0796] Overall system configuration

[0797] 1. Receiving user input

[0798] Terminal: Users enter questions and requests through terminals installed in the store or via a website. For example, they might enter a specific request such as, "Please tell me about the latest energy-saving air conditioners."

[0799] Terminal: Once input is complete, the terminal sends the user's input to the emotion engine to recognize the user's emotions (e.g., joy, excitement, anxiety).

[0800] 2. Analysis of user requirements and emotions

[0801] Server: Receives text and sentiment data sent from the terminal and analyzes the text using natural language processing (NLP) techniques. Here, important keywords (e.g., "energy efficiency," "air conditioner") are extracted.

[0802] 3. Searching for related information

[0803] Server: Based on the extracted keywords, it queries the database to find relevant information (e.g., a list of air conditioners with excellent energy efficiency).

[0804] 4. Generating the content of the brochure

[0805] Server: Uses the retrieved information to insert data into a template for generating brochures. The template has pre-configured layouts including title, description, and images.

[0806] Server: Based on data from the emotion engine, adjusts the content and design of the brochure. For example, if a user is feeling anxious, it will highlight detailed specifications and warranty information.

[0807] 5. Display and verification of the brochure.

[0808] Terminal: Displays a preview of the automatically generated brochure to the user. The user reviews this preview and makes corrections as needed.

[0809] User: Review the preview content and confirm if you are satisfied.

[0810] 6. Final creation and printing of the brochure

[0811] Terminal: The user sends the confirmed information to the server to generate the final version of the brochure.

[0812] Server: Generates the finalized brochure data and sends that data to the terminal.

[0813] Terminal: Displays the final version of the brochure to the user, and allows printing as needed in stores.

[0814] Specific example

[0815] Example 1: User seeking product information

[0816] 1. User: Enters "Please tell me about the latest energy-saving air conditioners" into the store's terminal. At the same time, the emotion engine uses cameras and sensors to analyze the user's facial expressions and recognizes that the user is feeling slightly anxious.

[0817] 2. Terminal: Sends the above input and emotion data to the server.

[0818] 3. Server: Uses natural language processing technology to extract important keywords such as "latest," "energy-saving," and "air conditioner." It also identifies user anxieties based on data from the emotion engine.

[0819] 4. Server: Searches the database for relevant air conditioner information (e.g., specifications, price, and images for each product).

[0820] 5. Server: Based on the acquired information, it automatically generates brochures that highlight detailed specifications, warranty periods, and customer reviews to alleviate user concerns.

[0821] 6. Terminal: Displays a preview of the automatically generated brochure to the user.

[0822] 7. User: Review the preview and confirm if you are satisfied with the content.

[0823] 8. Terminal: Sends the confirmed information to the server.

[0824] 9. Server: Generates the final brochure and sends it to the terminal.

[0825] 10. Terminal: Display the final version of the brochure to the user and print it as needed.

[0826] In this way, the present invention can respond quickly and accurately to user questions and requests, and furthermore, provide information that takes user emotions into consideration. This can improve the user experience.

[0827] The following describes the processing flow.

[0828] Step 1:

[0829] User: Access a website or in-store terminal and enter your question or request. For example, "Please tell me about the latest energy-saving air conditioners."

[0830] Step 2:

[0831] Terminal: Receives user input and sends it to the server, while also having the emotion engine analyze the user's facial expressions, tone of voice, etc. The emotion engine recognizes the user's emotions (e.g., anxiety, excitement) and sends that data to the server.

[0832] Step 3:

[0833] Server: Text data sent from the terminal is passed to a natural language processing (NLP) engine to analyze questions and requests. Here, important keywords such as "energy efficiency" and "air conditioner" are extracted.

[0834] Step 4:

[0835] Server: Analyzes emotional data sent from the emotion engine to identify the user's current emotional state (e.g., anxiety).

[0836] Step 5:

[0837] Server: Based on the extracted keywords, it searches the database for relevant information (e.g., a list of energy-saving air conditioners, specifications and prices for each product, images).

[0838] Step 6:

[0839] Server: Retrieves search results and automatically generates brochures by inserting the data into a template. The content and design of the brochure are adjusted based on user sentiment data. For example, detailed specifications and warranty information are emphasized for users who are feeling anxious.

[0840] Step 7:

[0841] Server: Creates a preview of the automatically generated brochure and sends the data to the terminal.

[0842] Step 8:

[0843] Terminal: Displays a preview to the user and prompts them to review the content. The user reviews the preview and enters any necessary corrections.

[0844] Step 9:

[0845] User: Review the preview content and, if satisfied, enter your confirmation instructions.

[0846] Step 10:

[0847] Terminal: Receives user confirmation and sends that information to the server.

[0848] Step 11:

[0849] Server: Generates the finalized brochure data and sends that data to the terminal.

[0850] Step 12:

[0851] Terminal: Displays the final version of the brochure to the user, and allows printing as needed in stores.

[0852] (Example 2)

[0853] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0854] While current information systems can adequately respond to user questions and requests, these responses often fail to consider the user's emotional state, potentially leading to decreased user satisfaction. Furthermore, the lack of systems that provide customized information tailored to user emotions hinders the improvement of the user experience.

[0855] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0856] In this invention, the server includes means for receiving questions and requests entered by the user via a terminal, means for collecting user emotion data along with the questions and requests, means for analyzing the questions and requests and extracting important keywords, means for analyzing the emotion data and recognizing the user's emotions, means for searching a database for relevant information based on the important keywords, means for automatically generating individual brochures corresponding to the user's emotions based on the relevant information, and means for displaying the automatically generated brochures on the user terminal. This makes it possible to provide customized information according to the user's emotional state.

[0857] A "terminal" is an information device used by users to input information, and includes terminals installed in stores and those accessed via websites.

[0858] A "user" is an individual who uses the system to enter questions or requests.

[0859] "Questions and requests" refer to text-based requests or inquiries for information entered by the user via their device.

[0860] "Emotional data" refers to emotional information based on the user's facial expressions and actions, collected using the device's camera and sensors.

[0861] Natural Language Processing (NLP) is a technology that analyzes user input text to understand its meaning and context.

[0862] "Key keywords" are central words or phrases extracted from questions and requests using natural language processing technology, which are essential when searching for relevant information.

[0863] An "emotion engine" is software or algorithms that analyze collected emotional data to recognize a user's emotional state.

[0864] A "database" is a collection of information that stores and manages related information in a searchable format.

[0865] "Related information" refers to information and data retrieved from the database based on important keywords.

[0866] A "brochure" is informational material about specific products or services that is automatically generated based on the user's questions, requests, and emotional state.

[0867] "Automated generation" refers to the process by which content and information are created using specific algorithms or templates, without manual intervention.

[0868] A "preview" is a temporary display format shown to the user for final confirmation of the automatically generated brochure's contents.

[0869] "Correction" refers to the process where a user requests changes or additions after reviewing a preview, and those changes are then reflected in the system.

[0870] The "final version" refers to the final version of the brochure that has been confirmed and revised by users.

[0871] This invention relates to a system that automatically generates, displays, and prints individual brochures based on questions and requests entered by the user via a terminal. Furthermore, by combining this with an emotion engine that recognizes the user's emotions, it realizes the provision of customized information that responds to the user's emotions.

[0872] Overall system configuration

[0873] Acceptance of user input

[0874] Users enter questions and requests through terminals installed in stores or via a website. This system allows for specific requests, such as "Please tell me about the latest energy-saving air conditioners." Once the input is complete, the terminal uses cameras and sensors to capture the user's facial expressions and movements, and sends this emotional data to a server.

[0875] Data analysis and extraction

[0876] The server receives text data and sentiment data sent from the terminal. The received text data is analyzed using natural language processing (NLP) techniques, and important keywords such as "energy saving performance" and "air conditioner" are extracted through morphological analysis. At the same time, the sentiment engine is used to analyze the sentiment data and identify the user's emotional state (e.g., joy, anxiety).

[0877] Search for related information

[0878] The server queries its built-in database based on the extracted key keywords to retrieve relevant information (e.g., a list of energy-efficient air conditioners).

[0879] Generating brochure content

[0880] The server uses the retrieved information to insert data into a brochure generation template and generates an initial version of the brochure. This template includes a title, description, images, and other elements. Furthermore, based on the analysis results of the emotion engine, the brochure's content and design are adjusted to match the user's emotions. For example, if the user is feeling anxious, detailed specifications and warranty information will be emphasized.

[0881] View and check the preview

[0882] The terminal displays a preview of the automatically generated brochure to the user. The user can review this preview and enter any necessary corrections. If there are any corrections, the terminal resends the information to the server, which then applies the changes.

[0883] Final creation and printing of the brochure

[0884] When the user presses the confirm button, the terminal sends the confirmed information to the server. The server generates the final version of the brochure based on the confirmed data and sends it to the terminal in a format such as PDF. The final version of the brochure is displayed on the terminal and can be printed on the spot at the store if needed.

[0885] Specific example

[0886] Example 1: User seeking product information

[0887] 1. User: Enters "Please tell me about the latest energy-saving air conditioners" into the store's terminal. At this time, cameras and sensors analyze the user's facial expressions and recognize that they are feeling anxious.

[0888] 2. Terminal: Sends the above input content and emotion data to the server.

[0889] 3. Server: Uses natural language processing technology to extract important keywords such as "latest," "energy-saving," and "air conditioner." It also identifies user anxieties based on data from the emotion engine.

[0890] 4. Server: Searches the database for relevant air conditioner information (e.g., specifications, price, and images for each product).

[0891] 5. Server: Based on the acquired information, it automatically generates brochures that highlight detailed specifications, warranty periods, and customer reviews to alleviate user concerns.

[0892] 6. Terminal: Displays a preview of the automatically generated brochure to the user.

[0893] 7. User: Review the preview and confirm if you are satisfied with the content.

[0894] 8. Terminal: Sends the confirmed information to the server.

[0895] 9. Server: Generates the final brochure and sends it to the terminal.

[0896] 10. Terminal: Display the final version of the brochure to the user and print it as needed.

[0897] Examples of prompt statements

[0898] "Please create a brochure about the latest energy-saving air conditioners. Based on the sentiment analysis results, emphasize the detailed specifications and warranty period to users who are feeling anxious."

[0899] By using this prompt, the generative AI model can generate brochures that provide information tailored to the user's needs and emotions.

[0900] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0901] Step 1: Accepting user input

[0902] User: Enters their questions and requests via terminals installed in the store or through the website. An example input would be, "Please tell me about the latest energy-saving air conditioners."

[0903] Device: Records entered text data. It also uses the device's built-in camera and sensors to capture the user's facial expressions and movements, collecting emotional data.

[0904] Input: Questions, requests, and sentiment data entered by the user.

[0905] Output: Recorded text data and sentiment data.

[0906] Step 2: Send

[0907] Terminal: Encrypts recorded text and sentiment data and sends it to the server via secure communication.

[0908] Input: Recorded text data and sentiment data.

[0909] Output: Text data and sentiment data sent to the server.

[0910] Step 3: Analysis using Natural Language Processing (NLP)

[0911] Server: Analyzes received text data using natural language processing (NLP) techniques. Through morphological analysis, it extracts important keywords such as "energy saving" and "air conditioner" from the text.

[0912] Input: Text data sent to the server.

[0913] Data processing: Perform morphological analysis and extract important keywords.

[0914] Output: Key keywords extracted.

[0915] Step 4: Emotion Analysis

[0916] Server: Analyzes received emotional data using an emotion engine to identify the user's emotional state (e.g., joy, anxiety).

[0917] Input: Emotional data sent to the server.

[0918] Data processing: Perform sentiment analysis to identify the user's emotional state.

[0919] Output: The emotional state of the identified user.

[0920] Step 5: Search for related information

[0921] Server: Based on the extracted key keywords, it queries the built-in database to retrieve relevant information (e.g., a list of energy-efficient air conditioners).

[0922] Input: Key keywords extracted.

[0923] Data Calculation: Execute database queries to retrieve relevant information.

[0924] Output: Relevant information retrieved.

[0925] Step 6: Creating the brochure

[0926] Server: Inserts the searched information into a template and generates an initial version of the brochure. The template includes a title, description, images, etc. It also adjusts the content and design of the brochure based on the results of the emotion engine's analysis. For example, if the user is feeling anxious, it will emphasize detailed specifications and warranty information.

[0927] Input: Relevant information obtained and the identified user's emotional state.

[0928] Data processing: Insert information into templates and customize brochures.

[0929] Output: Early version of the brochure.

[0930] Step 7: Displaying the preview

[0931] Terminal: Displays a preview of the automatically generated brochure to the user.

[0932] Input: Early version of the brochure.

[0933] Output: The brochure displayed as a preview to the user.

[0934] Step 8: User verification and correction

[0935] User: Review the preview and enter any necessary corrections. For example, enter requests such as changing the image or adding a description.

[0936] Input: Preview content and user modifications.

[0937] Output: Revised brochure content.

[0938] Step 9: Applying the changes

[0939] Server: Receives corrections submitted by users and reflects them in the brochure.

[0940] Input: Revised brochure content.

[0941] Data processing: Add / modify the correction details to the brochure.

[0942] Output: Revised brochure.

[0943] Step 10: Final generation and printing

[0944] Terminal: When the user presses the confirm button, the confirmed information is sent to the server.

[0945] Server: Generates the final version of the brochure based on the confirmed data. Sends the generated brochure to the terminal in a format such as PDF.

[0946] Input: Revised brochure content.

[0947] Data processing: Generate the final version of the brochure.

[0948] Output: Final version of the brochure.

[0949] Terminal: Displays the final version of the brochure to the user and prints it on the spot if necessary.

[0950] Input: Final version of the brochure.

[0951] Output: The final version of the brochure displayed to the user and the printed brochure.

[0952] (Application Example 2)

[0953] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0954] Traditional information systems could only provide standardized information in response to user questions and requests, failing to adequately address individual needs. Furthermore, services that considered user emotions were rarely offered, highlighting the room for improvement in the user experience. In particular, customer service in physical stores demands real-time, emotionally responsive, and personalized information.

[0955] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0956] In this invention, the server includes means for receiving user questions and requests, means for extracting important keywords, means for searching for relevant information from information sources, and means for adjusting the content and design of the generated materials using an emotion engine. This enables the automatic generation of materials based on user-inputted questions and requests, and also allows for emotion-based customization.

[0957] "Device" refers to a terminal or equipment where users input questions or requests and that information is processed.

[0958] "Questions and requests" refer to input from users that seek information or knowledge to be provided.

[0959] "Key keywords" refer to the main words and phrases necessary for information retrieval and document generation, extracted from user questions and requests.

[0960] "Information source" refers to data provision systems such as databases and APIs used to search for and retrieve relevant information.

[0961] "Materials" refers to a collection of information automatically generated in response to user questions and requests, and is provided in the form of brochures, documents, and other similar materials.

[0962] An "emotion engine" refers to a system that recognizes a user's emotions and adjusts the information provided based on those emotions.

[0963] A "user terminal" refers to a device, such as a display device or printing device, that allows the user to view and manipulate the final generated document.

[0964] This invention relates to a system that automatically generates, displays, and prints individual materials based on questions and requests entered by the user through a device. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it provides customized information tailored to the user's feelings.

[0965] System Configuration

[0966] 1. Acceptance of user input:

[0967] Device: Users enter questions and requests through a terminal installed on the device or via an internet site. For example, they might enter a specific request such as, "Please tell me about the latest energy-saving air conditioners." The device is equipped with a camera that captures the user's facial expressions.

[0968] 2. Analysis of user requirements and emotions:

[0969] Server: Receives text and sentiment data transmitted from the device and analyzes the text using natural language processing (NLP) techniques. Here, important keywords (e.g., "energy-saving," "air conditioner") are extracted.

[0970] Emotion Engine: Analyzes captured user facial expression data to identify the user's emotions (e.g., joy, excitement, anxiety).

[0971] 3. Search for related information:

[0972] Server: Based on the extracted keywords, it queries information sources to find relevant information (e.g., a list of energy-efficient air conditioners).

[0973] 4. Generating the document content:

[0974] Server: Uses the retrieved information to insert data into a template for generating documents. The template has pre-configured layouts including title, description, and images.

[0975] Emotional Engine: Adjusts the content and design of materials based on emotional data. For example, if a user is feeling anxious, it will highlight detailed specifications and warranty information.

[0976] 5. Display and verify the documents:

[0977] Device: Displays a preview of automatically generated documents to the user. The user reviews this preview and makes corrections as needed.

[0978] User: Review the preview content and confirm if you are satisfied.

[0979] 6. Final generation and printing of the document:

[0980] Device: The user submits the confirmed information to the server, which then generates the final version of the document.

[0981] Server: Generates the finalized data and sends it to the device.

[0982] Device: Displays the final version of the document to the user and prints it as needed.

[0983] Hardware and software to be used

[0984] Hardware: Smart devices, cameras

[0985] software:

[0986] Emotion engine: facial_emotion_recognition (Python library)

[0987] Natural Language Processing: TextBlob (Python library)

[0988] Data retrieval: Requests (Python library)

[0989] Specific example

[0990] Example 1: User seeking product information

[0991] 1. User: Enters "Tell me about the latest energy-saving air conditioners" into a device at a physical store. A camera captures the user's facial expression, and an emotion engine analyzes whether the user is feeling slightly anxious.

[0992] 2. Server: Uses natural language processing technology to extract important keywords such as "latest," "energy-saving," and "air conditioner." It also identifies user anxiety levels based on sentiment data.

[0993] 3. Server: Searches the database for relevant air conditioner information (e.g., specifications, price, and images for each product).

[0994] 4. Server: Based on the acquired information, it automatically generates materials that highlight detailed specifications, warranty periods, and customer reviews to alleviate user concerns.

[0995] 5. Device: Displays a preview of automatically generated documents to the user.

[0996] 6. User: Review the preview, and if satisfied with the content, confirm it to generate and print the final version.

[0997] Example of a prompt

[0998] User question: Please tell me more about the latest energy-saving air conditioners. User facial expression image path: path_to_user_image.jpg. Use the emotion engine to perform emotion analysis and generate a brochure containing appropriate information.

[0999] This system enables quick and accurate responses to user-submitted questions and requests, and also allows for the provision of information that is sensitive to the user's feelings.

[1000] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1001] Step 1:

[1002] The stage where the user enters questions or requests into the device.

[1003] Input: The user enters a question or request on their smart device. Example: "Please tell me about the latest energy-saving air conditioners."

[1004] Specific operation: The user enters questions or requests into an input form that appears on the smart device's display. The device's camera simultaneously captures the user's facial expressions.

[1005] Step 2:

[1006] The stage where the terminal sends user input and facial expression data to the server.

[1007] Input: User text input data and captured facial expression images.

[1008] Specific operation: The terminal sends the acquired text data and facial expression image data to the server. HTTP requests are used for communication.

[1009] Step 3:

[1010] The server analyzes questions and requests using natural language processing.

[1011] Input: Text data of user questions or requests.

[1012] Data processing: The server uses TextBlob to analyze questions and requests and extract important keywords. Examples: "latest," "energy-saving," "air conditioner."

[1013] Output: Extracted key keywords.

[1014] Specific operation: The server parses the received text data using TextBlob and passes the extracted keywords to the next process.

[1015] Step 4:

[1016] The server analyzes facial expression data using the emotion engine.

[1017] Input: User's facial expression image data.

[1018] Data processing: Use an emotion engine to analyze facial expression data and identify emotions. Examples: anxiety, joy.

[1019] Output: Identified user sentiment data.

[1020] Specific operation: The server inputs facial image data into the emotion engine and extracts the analysis results as emotion data.

[1021] Step 5:

[1022] The server searches for relevant information from the database.

[1023] Input: Extracted key keywords.

[1024] Data retrieval: The server queries the database or API based on these keywords to retrieve relevant information.

[1025] Output: Related information (e.g., product specifications, images, price).

[1026] Specific operation: The server executes a search query against the database and passes the returned results as components to the next stage.

[1027] Step 6:

[1028] The server generates document content based on emotional data.

[1029] Input: Related information and user sentiment data.

[1030] Data processing: The server inserts relevant information into the template and generates materials with content and design adjusted based on user sentiment data.

[1031] Output: Automated document data.

[1032] Specific operation: The server reads a template, and generates materials by customizing them based on the retrieved relevant information and the user's sentiment.

[1033] Step 7:

[1034] The terminal displays a preview of the automatically generated document.

[1035] Input: Data from automatically generated documents.

[1036] Specific action: The device displays the generated document on its screen and prompts the user for confirmation.

[1037] Step 8:

[1038] The stage where the user reviews and modifies the document.

[1039] Input: Previewed document.

[1040] Output: Data from the document, corrected as needed.

[1041] Specific actions: The user reviews the displayed document and makes corrections as needed using the touch panel or keyboard.

[1042] Step 9:

[1043] The stage where the terminal sends confirmed documents to the server.

[1044] Input: Data from corrected and finalized documents.

[1045] Specific operation: Once the user confirms the document, the terminal sends the revised document to the server.

[1046] Step 10:

[1047] The server generates the final version of the document and sends it to the terminal.

[1048] Input: Data from the corrected document.

[1049] Data processing: Format the final document and generate it as the final version.

[1050] Output: Data from the final version of the document.

[1051] Specific operation: The server generates the final version of the document based on the received data and sends it to the terminal.

[1052] Step 11:

[1053] The terminal is at the stage where it displays and prints the final version of the document.

[1054] Input: Data from the final version of the document.

[1055] Specific operation: The terminal displays the final version of the document on its screen and prints it upon user request.

[1056] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1057] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1058] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[1059] [Third Embodiment]

[1060] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[1061] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1062] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1063] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[1064] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1065] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1066] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1067] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1068] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1069] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1070] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1071] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[1072] This invention relates to a system that automatically generates, displays, and prints individual brochures based on questions and requests entered by users via a terminal. This system utilizes natural language processing (NLP) and database search technologies to quickly provide customized information tailored to the specific needs of each user.

[1073] Overall system configuration

[1074] 1. Receiving user input

[1075] Terminal: Users enter questions and requests through terminals installed in the store or via a website. For example, they might enter a specific request such as, "Which air conditioner has high energy efficiency?"

[1076] 2. Analysis of user requirements

[1077] Server: Receives questions and requests sent from terminals and analyzes the text using natural language processing techniques. Extracts keywords deemed important.

[1078] 3. Searching for related information

[1079] Server: Based on the extracted keywords, it searches the database for relevant information and images. For example, if the keywords "energy efficiency" and "air conditioner" are extracted, it retrieves product information and images related to them.

[1080] 4. Generating the content of the brochure

[1081] Server: Using the retrieved information, the server automatically generates the content of the brochure according to a pre-configured template. This template includes the placement of elements such as title, description, and images.

[1082] 5. Display and verification of the brochure.

[1083] Terminal: Displays a preview of the automatically generated brochure to the user. The user reviews this preview and makes corrections as needed.

[1084] User: Review the preview content and confirm if you are satisfied.

[1085] 6. Final creation and printing of the brochure

[1086] Terminal: The user sends the confirmed information to the server to generate the final version of the brochure.

[1087] Server: Generates the finalized brochure data and sends it to the terminal.

[1088] Terminal: Displays the final version of the brochure to the user, and allows printing as needed in stores.

[1089] Specific example

[1090] Example 1: User seeking product information

[1091] 1. User: Enters "Please tell me about the latest energy-saving air conditioners" into the store's terminal.

[1092] 2. Terminal: Send the above input to the server.

[1093] 3. Server: Uses natural language processing technology to extract important keywords such as "latest," "energy-saving," and "air conditioner."

[1094] 4. Server: Searches the database for relevant air conditioner information (e.g., specifications, price, and images for each product).

[1095] 5. Server: Based on the acquired information, it automatically generates the brochure by inserting the data into the template.

[1096] 6. Terminal: Displays a preview of the automatically generated brochure to the user.

[1097] 7. User: Review the preview and confirm if you are satisfied with the content.

[1098] 8. Terminal: Sends the confirmed information to the server.

[1099] 9. Server: Generates the final brochure and sends it to the terminal.

[1100] 10. Terminal: Display the final version of the brochure to the user and print it as needed.

[1101] In this way, the present invention can respond quickly and accurately to the individual needs of users, and in particular, it enables real-time information provision and customized services in stores.

[1102] The following describes the processing flow.

[1103] Step 1:

[1104] User: Accesses a website or in-store terminal and enters a question or request. For example, enters the request, "Which air conditioner is the most energy-efficient?"

[1105] Step 2:

[1106] Terminal: Receives input from the user and sends that text data to the server.

[1107] Step 3:

[1108] Server: The received text data is passed to a natural language processing (NLP) engine to analyze the questions and requests. Here, important keywords (e.g., "energy efficiency," "air conditioner") are extracted.

[1109] Step 4:

[1110] Server: Based on the extracted keywords, it queries the database to find relevant information (e.g., a list of air conditioners with excellent energy efficiency).

[1111] Step 5:

[1112] Server: Receives search results and inserts the data into a template for generating brochures. This template has pre-configured layouts for titles, descriptions, images, etc.

[1113] Step 6:

[1114] Server: Generates a preview of the brochure and sends that data to the terminal.

[1115] Step 7:

[1116] Terminal: Displays a preview to the user and prompts them to confirm the content. The user reviews the preview and selects "Confirm" if they are satisfied with the content.

[1117] Step 8:

[1118] User: Review the preview, re-enter any necessary corrections, and perform a final check. If satisfied, press the confirm button.

[1119] Step 9:

[1120] Terminal: Receives user confirmation and sends that information to the server.

[1121] Step 10:

[1122] Server: Generates the finalized brochure data and sends that data to the terminal.

[1123] Step 11:

[1124] Terminal: Displays the final version of the brochure to the user, and allows printing as needed in stores.

[1125] (Example 1)

[1126] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1127] Conventional information systems make it difficult for users to quickly obtain the specific information they need, and in particular, they lack the means to provide customized information tailored to individual user needs. This can lead to ineffective real-time information provision and the creation of customized brochures in stores, potentially resulting in decreased user satisfaction.

[1128] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1129] In this invention, the server includes means for receiving questions and requests entered by the user via a terminal, means for analyzing the questions and requests and extracting important keywords using natural language processing technology, means for searching a database for relevant information based on the important keywords, means for automatically generating individual brochures using pre-configured templates based on the relevant information, and means for displaying the automatically generated brochures on the user terminal. This enables the rapid and accurate acquisition, display, and printing of customized information that corresponds to the user's individual requests.

[1130] A "user" refers to an individual or legal entity that uses the system to input questions or requests.

[1131] A "terminal" is a computer device used by users to input information, and can refer to information input devices installed in stores or websites.

[1132] "Questions and requests" refer to the information or requests that users want to obtain through the system.

[1133] "Natural language processing technology" refers to the technology used to analyze human language and convert it into a format that computers can understand and process.

[1134] "Key keywords" refer to words or phrases that are extracted through analysis from questions or requests and are particularly necessary for information retrieval and processing.

[1135] A "database" refers to a collection of information in which related information is stored in a structured manner.

[1136] A "template" refers to a pre-configured framework or format used to automatically generate the content of documents or brochures.

[1137] A "personalized brochure" refers to an informational document containing information customized to the specific needs of a particular user.

[1138] "Preview" refers to a display format that allows users to check the contents of an automatically generated brochure.

[1139] "Printing" refers to the process of outputting the generated brochure onto physical paper.

[1140] This invention relates to a system that automatically generates, displays, and prints individual brochures based on questions and requests entered by users via terminals installed in stores or through a website. The system utilizes natural language processing technology and database search technology to quickly provide customized information tailored to the specific needs of each user.

[1141] Components and technologies used

[1142] Acceptance of user input

[1143] Users input information through touchscreens on their devices or forms on websites. For example, they might input, "Which is the latest air conditioner with high energy efficiency?"

[1144] The terminal receives user input and sends it to the server as an HTTP request.

[1145] Analysis of user requirements

[1146] The server uses Python natural language processing libraries (such as NLTK and spaCy) to analyze the received questions and requests. The analysis extracts important keywords, such as "energy saving" and "air conditioner."

[1147] Search for related information

[1148] The server generates SQL statements based on the extracted keywords and executes queries against database management systems such as MySQL and PostgreSQL. An example of such a query is "SELECT FROM products WHERE type='air conditioner' AND feature='energy saving'".

[1149] Generating brochure content

[1150] The server uses an HTML templating engine like Jinja2 to embed information retrieved from the database into pre-configured templates, automatically generating structured brochures.

[1151] Display and verification of the brochure

[1152] The terminal displays a preview of the generated brochure to the user. The user can review the content and make corrections as needed.

[1153] Final generation and printing of the brochure

[1154] If the user is satisfied with the preview, they press the confirm button.

[1155] The terminal sends the confirmed information to the server, and the server generates the final version of the brochure and sends it back to the terminal.

[1156] The terminal displays the final version of the brochure and allows printing as needed.

[1157] Specific example

[1158] Specific examples of users seeking product information

[1159] 1. The user enters "Tell me about the latest energy-saving air conditioners" into their device.

[1160] 2. The terminal sends the input content to the server.

[1161] 3. The server uses natural language processing technology to extract the keywords "latest," "energy-saving," and "air conditioner."

[1162] 4. The server searches the database for relevant air conditioner information (e.g., specifications, price, and images for each product).

[1163] 5. The server inserts the search results into a template to automatically generate the brochure.

[1164] 6. The device displays a preview of the brochure for the user to review.

[1165] 7. The user presses the confirm button.

[1166] 8. The terminal sends the confirmed data to the server.

[1167] 9. The server generates the final version of the brochure and sends it to the terminal.

[1168] 10. The terminal displays the final version and prints it if necessary.

[1169] Example of a prompt

[1170] "Please tell me about the latest energy-efficient air conditioners and their prices. Specifically, I'd like to know about the annual electricity cost savings."

[1171] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1172] Program processing flow

[1173] Step 1: Accepting user input

[1174] user:

[1175] Input: Enter your questions or requests into terminals installed in the store or into forms on the website.

[1176] Specific actions: Users input questions such as "Which air conditioner has the latest energy efficiency?" using a touchscreen or keyboard.

[1177] Output: User questions and requests are saved digitally on the device.

[1178] Terminal:

[1179] Input: Digital data of questions and requests entered by users.

[1180] Specific operation: Receives input and sends it to the server as appropriately formatted data.

[1181] Output: Formatted user questions and requests are sent to the server.

[1182] Step 2: Analyze user requirements

[1183] server:

[1184] Input: User questions and request data sent from the device.

[1185] Specific operation: Analyze text using natural language processing techniques and extract important keywords. Specifically, use Python's NLTK and spaCy to analyze sentences and extract important keywords such as "energy saving" and "air conditioner".

[1186] Output: A list of key keywords extracted.

[1187] Step 3: Search for related information

[1188] server:

[1189] Input: A list of key keywords extracted.

[1190] Specific operation: Generates SQL statements based on keywords and executes queries in database management systems such as MySQL and PostgreSQL. For example, it executes a query like "SELECT FROM products WHERE type='air conditioner' AND feature='energy saving'".

[1191] Output: A list of relevant information retrieved from the database (e.g., product specifications, price, images, etc.).

[1192] Step 4: Generating the brochure content

[1193] server:

[1194] Input: A list of relevant information retrieved from the database.

[1195] Specific operation: Using an HTML templating engine like Jinja2, the system automatically generates structured brochures by embedding the retrieved information into a pre-configured template. For example, it might embed data such as "Air conditioner A - Price: 50,000 yen, Annual electricity cost: 12,000 yen" into the template.

[1196] Output: Digital data of an automatically generated brochure.

[1197] Step 5: View and verify the brochure.

[1198] Terminal:

[1199] Input: Digital data of automatically generated brochures sent from the server.

[1200] Specific operation: A preview of the generated brochure is displayed on a web browser or device screen.

[1201] Output: A preview of the brochure that the user can view.

[1202] user:

[1203] Input: A preview of the brochure displayed on the terminal.

[1204] Specific actions: Review the displayed preview and make corrections as needed. If corrections are required, enter the corrections through the terminal interface.

[1205] Output: Brochure data containing the revised content.

[1206] Step 6: Final generation and printing of the brochure

[1207] user:

[1208] Input: Preview of the finalized brochure.

[1209] Specific action: Confirm that the preview is correct and press the confirm button.

[1210] Output: Confirmed information is set on the terminal.

[1211] Terminal:

[1212] Input: Confirmed information from the user.

[1213] Specific action: Send confirmed information to the server.

[1214] Output: Confirmed information is sent to the server.

[1215] server:

[1216] Input: Confirmed information sent from the device.

[1217] Specific action: Generate the final version of the brochure data and send it to the terminal.

[1218] Output: Final version of the brochure data.

[1219] Terminal:

[1220] Input: Final version of the brochure data.

[1221] Specific actions: Display the final version of the brochure and print it using a printer if necessary.

[1222] Output: The final version of the brochure that the user can review, and printed copies of the brochure.

[1223] (Application Example 1)

[1224] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1225] Currently, in many physical stores, customers need to browse through a large number of brochures and catalogs to obtain detailed information about products. However, much of this information is general and does not address individual needs, making it difficult for customers to find information that suits their requirements. Furthermore, it is time-consuming and laborious for store staff to answer each question, making efficient service provision difficult. This can lead to decreased customer satisfaction and negatively impact sales. This invention aims to solve these problems.

[1226] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1227] In this invention, the server includes means for receiving questions and requests entered by the user via a terminal, means for analyzing the questions and requests and extracting important keywords, means for searching a database for relevant information based on the important keywords, means for automatically generating individual brochures based on the relevant information, means for displaying the automatically generated brochures on the user terminal for confirmation and modification, means for generating a final version of the modified brochure and sending it to the terminal, and means for printing the finalized brochure. This enables customers to quickly and accurately obtain customized information that meets their needs. It also reduces the burden on store staff and enables efficient service provision.

[1228] A "terminal" is an electronic device used by users to input questions and requests and receive information.

[1229] "Means for receiving questions and requests" refers to a function for sending text information entered by the user to the server.

[1230] "Means for analyzing questions and requests" refers to a function that uses natural language processing technology to extract important keywords from input text data.

[1231] "Key keywords" are words or phrases that are particularly meaningful in a question or request.

[1232] "Means of searching for related information from a database" refers to a function that searches for related information within a database based on extracted keywords.

[1233] "Method for automatically generating individual brochures" refers to a function that automatically creates brochures according to a template based on the searched relevant information.

[1234] "A means of displaying, reviewing, and correcting automatically generated brochures on a user's terminal" refers to a function that provides the user with a view of the generated brochure's content, allowing the user to review and correct that content.

[1235] "Means for generating and sending a final version of the revised brochure to the terminal" refers to a function that confirms and revises the brochure as reviewed and corrected by the user, generates the final version, and sends it to the user's terminal.

[1236] "Means of printing brochures" refers to the function of printing a finalized brochure onto physical paper media.

[1237] "Natural language processing technology" is a general term for technologies that enable computers to understand, analyze, and process human language.

[1238] This invention details an embodiment of a system in which a user inputs questions and requests regarding products through a terminal in a physical store, and a customized brochure is automatically generated based on that information.

[1239] The system configuration includes user terminals, servers for analysis and generation processing, and a database. Specifically, it consists of the following:

[1240] First, users enter their questions or requests using an electronic terminal or tablet installed in the physical store. For example, they can enter a request such as, "Please tell me about the latest energy-saving air conditioners."

[1241] The input information is sent to the server. The server uses natural language processing (NLP) techniques to analyze this input text and extract important keywords. This analysis primarily uses the Python NLTK library.

[1242] Based on the extracted keywords, the server searches the database for information on related products. The database is built on an SQL basis and stores information such as product specifications, prices, and images.

[1243] After the relevant information is retrieved, the server automatically generates a customized brochure based on this information. The generation process uses the Django framework, and the ReportLab library is used for PDF generation. At this stage, the information is arranged according to a pre-configured template, and the brochure is generated.

[1244] A preview of the generated brochure is displayed on the user's device. The user can review this preview and make corrections as needed. The corrected content is then sent back to the server, which generates the final version of the brochure.

[1245] Finally, the finalized brochure is sent to the terminal and printed as needed. This allows users to quickly obtain information optimized for their needs.

[1246] Specific example:

[1247] When a user types "Tell me about the latest smartphones" into a store's tablet terminal, the system performs the following steps: First, it extracts the keywords "latest" and "smartphone" and searches the database for relevant smartphone information. Next, it generates a customized brochure based on the retrieved information and displays this brochure to the user. Once the user reviews and makes corrections, the corrected information is sent back to the server to generate a final version. Finally, the final version of the brochure is displayed to the user and printed.

[1248] Example of a prompt:

[1249] "Design a system that generates customized brochures based on questions and requests entered by users on their devices. Specifically, describe the entire process, including keyword extraction using natural language processing, database search, brochure generation using templates, user confirmation, and final version generation and printing."

[1250] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1251] Step 1:

[1252] Process name: User input reception

[1253] Subject: User

[1254] Specific operation: Users use terminals in physical stores to input questions or requests. This input is done through the interface of a tablet or kiosk terminal.

[1255] Input: User questions or requests (e.g., "Please tell me about the latest energy-saving air conditioners")

[1256] Output: Input text data

[1257] Step 2:

[1258] Process name: Sending input

[1259] Subject: terminal

[1260] Specific operation: The entered text data is sent to the server. The HTTP protocol is used for this process.

[1261] Input: Text data

[1262] Output: Text data is sent to the server.

[1263] Step 3:

[1264] Process name: Analysis of questions and requests

[1265] Subject: Server

[1266] Specific operation: The server uses natural language processing (NLP) techniques to analyze the received text data. It uses the Python NLTK library to extract important keywords.

[1267] Input: Text data

[1268] Data Processing / Data Calculation: Analysis and Keyword Extraction using NLP Technology

[1269] Output: Keywords (e.g., "latest", "energy-saving", "air conditioner")

[1270] Step 4:

[1271] Process name: Search for related information

[1272] Subject: Server

[1273] Specific operation: Based on the extracted keywords, the server searches for relevant information in the SQL database.

[1274] Input: Keyword

[1275] Data Processing / Data Calculation: Data Retrieval using SQL Queries

[1276] Output: Related information (product information, images, specifications, price, etc.)

[1277] Step 5:

[1278] Process name: Automatic generation of brochures

[1279] Subject: Server

[1280] Specific operation: Based on the searched information, the server embeds the information into a brochure template and automatically generates it. The Django framework and ReportLab library are used.

[1281] Input: Related Information

[1282] Data processing / data calculation: Placing information in a template and generating a PDF.

[1283] Output: Automated brochure

[1284] Step 6:

[1285] Process name: Display preview

[1286] Subject: terminal

[1287] Specific operation: An automatically generated brochure is sent to the terminal and displayed to the user as a preview. The user can review the content and make corrections as needed.

[1288] Input: Automated brochure

[1289] Output: Preview screen for user review and modification.

[1290] Step 7:

[1291] Process name: Sending corrected data

[1292] Subject: User and device

[1293] Specific operation: The user reviews the contents of the brochure, makes any necessary corrections, and sends the corrected data to the server.

[1294] Input: Revised brochure data

[1295] Output: Corrected data is sent to the server.

[1296] Step 8:

[1297] Process name: Generation of final version

[1298] Subject: Server

[1299] Specific operation: The server generates the final version of the brochure based on the corrected information.

[1300] Input: Correction data

[1301] Data processing / data calculation: Reflecting revisions and generating the final version of the brochure.

[1302] Output: Final version of the brochure

[1303] Step 9:

[1304] Process name: Sending and printing the final version

[1305] Subject: Terminals and Servers

[1306] Specific actions: The final version of the brochure is sent to the terminal and displayed to the user. Printing is also performed as needed.

[1307] Input: Final version of the brochure

[1308] Output: Brochures displayed and printed on the user's device.

[1309] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1310] This invention relates to a system that automatically generates, displays, and prints individual brochures based on questions and requests entered by the user via a terminal. Furthermore, by combining this with an emotion engine that recognizes the user's emotions, it realizes the provision of customized information that responds to the user's emotions.

[1311] Overall system configuration

[1312] 1. Receiving user input

[1313] Terminal: Users enter questions and requests through terminals installed in the store or via a website. For example, they might enter a specific request such as, "Please tell me about the latest energy-saving air conditioners."

[1314] Terminal: Once input is complete, the terminal sends the user's input to the emotion engine to recognize the user's emotions (e.g., joy, excitement, anxiety).

[1315] 2. Analysis of user requirements and emotions

[1316] Server: Receives text and sentiment data sent from the terminal and analyzes the text using natural language processing (NLP) techniques. Here, important keywords (e.g., "energy efficiency," "air conditioner") are extracted.

[1317] 3. Searching for related information

[1318] Server: Based on the extracted keywords, it queries the database to find relevant information (e.g., a list of air conditioners with excellent energy efficiency).

[1319] 4. Generating the content of the brochure

[1320] Server: Uses the retrieved information to insert data into a template for generating brochures. The template has pre-configured layouts including title, description, and images.

[1321] Server: Based on data from the emotion engine, adjusts the content and design of the brochure. For example, if a user is feeling anxious, it will highlight detailed specifications and warranty information.

[1322] 5. Display and verification of the brochure.

[1323] Terminal: Displays a preview of the automatically generated brochure to the user. The user reviews this preview and makes corrections as needed.

[1324] User: Review the preview content and confirm if you are satisfied.

[1325] 6. Final creation and printing of the brochure

[1326] Terminal: The user sends the confirmed information to the server to generate the final version of the brochure.

[1327] Server: Generates the finalized brochure data and sends that data to the terminal.

[1328] Terminal: Displays the final version of the brochure to the user, and allows printing as needed in stores.

[1329] Specific example

[1330] Example 1: User seeking product information

[1331] 1. User: Enters "Please tell me about the latest energy-saving air conditioners" into the store's terminal. At the same time, the emotion engine uses cameras and sensors to analyze the user's facial expressions and recognizes that the user is feeling slightly anxious.

[1332] 2. Terminal: Sends the above input and emotion data to the server.

[1333] 3. Server: Uses natural language processing technology to extract important keywords such as "latest," "energy-saving," and "air conditioner." It also identifies user anxieties based on data from the emotion engine.

[1334] 4. Server: Searches the database for relevant air conditioner information (e.g., specifications, price, and images for each product).

[1335] 5. Server: Based on the acquired information, it automatically generates brochures that highlight detailed specifications, warranty periods, and customer reviews to alleviate user concerns.

[1336] 6. Terminal: Displays a preview of the automatically generated brochure to the user.

[1337] 7. User: Review the preview and confirm if you are satisfied with the content.

[1338] 8. Terminal: Sends the confirmed information to the server.

[1339] 9. Server: Generates the final brochure and sends it to the terminal.

[1340] 10. Terminal: Display the final version of the brochure to the user and print it as needed.

[1341] In this way, the present invention can respond quickly and accurately to user questions and requests, and furthermore, provide information that takes user emotions into consideration. This can improve the user experience.

[1342] The following describes the processing flow.

[1343] Step 1:

[1344] User: Access a website or in-store terminal and enter your question or request. For example, "Please tell me about the latest energy-saving air conditioners."

[1345] Step 2:

[1346] Terminal: Receives user input and sends it to the server, while also having the emotion engine analyze the user's facial expressions, tone of voice, etc. The emotion engine recognizes the user's emotions (e.g., anxiety, excitement) and sends that data to the server.

[1347] Step 3:

[1348] Server: Text data sent from the terminal is passed to a natural language processing (NLP) engine to analyze questions and requests. Here, important keywords such as "energy efficiency" and "air conditioner" are extracted.

[1349] Step 4:

[1350] Server: Analyzes emotional data sent from the emotion engine to identify the user's current emotional state (e.g., anxiety).

[1351] Step 5:

[1352] Server: Based on the extracted keywords, it searches the database for relevant information (e.g., a list of energy-saving air conditioners, specifications and prices for each product, images).

[1353] Step 6:

[1354] Server: Retrieves search results and automatically generates brochures by inserting the data into a template. The content and design of the brochure are adjusted based on user sentiment data. For example, detailed specifications and warranty information are emphasized for users who are feeling anxious.

[1355] Step 7:

[1356] Server: Creates a preview of the automatically generated brochure and sends the data to the terminal.

[1357] Step 8:

[1358] Terminal: Displays a preview to the user and prompts them to review the content. The user reviews the preview and enters any necessary corrections.

[1359] Step 9:

[1360] User: Review the preview content and, if satisfied, enter your confirmation instructions.

[1361] Step 10:

[1362] Terminal: Receives user confirmation and sends that information to the server.

[1363] Step 11:

[1364] Server: Generates the finalized brochure data and sends that data to the terminal.

[1365] Step 12:

[1366] Terminal: Displays the final version of the brochure to the user, and allows printing as needed in stores.

[1367] (Example 2)

[1368] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1369] While current information systems can adequately respond to user questions and requests, these responses often fail to consider the user's emotional state, potentially leading to decreased user satisfaction. Furthermore, the lack of systems that provide customized information tailored to user emotions hinders the improvement of the user experience.

[1370] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[1371] In this invention, the server includes means for receiving questions and requests entered by the user via a terminal, means for collecting user emotion data along with the questions and requests, means for analyzing the questions and requests and extracting important keywords, means for analyzing the emotion data and recognizing the user's emotions, means for searching a database for relevant information based on the important keywords, means for automatically generating individual brochures corresponding to the user's emotions based on the relevant information, and means for displaying the automatically generated brochures on the user terminal. This makes it possible to provide customized information according to the user's emotional state.

[1372] A "terminal" is an information device used by users to input information, and includes terminals installed in stores and those accessed via websites.

[1373] A "user" is an individual who uses the system to enter questions or requests.

[1374] "Questions and requests" refer to text-based requests or inquiries for information entered by the user via their device.

[1375] "Emotional data" refers to emotional information based on the user's facial expressions and actions, collected using the device's camera and sensors.

[1376] Natural Language Processing (NLP) is a technology that analyzes user input text to understand its meaning and context.

[1377] "Key keywords" are central words or phrases extracted from questions and requests using natural language processing technology, which are essential when searching for relevant information.

[1378] An "emotion engine" is software or algorithms that analyze collected emotional data to recognize a user's emotional state.

[1379] A "database" is a collection of information that stores and manages related information in a searchable format.

[1380] "Related information" refers to information and data retrieved from the database based on important keywords.

[1381] A "brochure" is informational material about specific products or services that is automatically generated based on the user's questions, requests, and emotional state.

[1382] "Automated generation" refers to the process by which content and information are created using specific algorithms or templates, without manual intervention.

[1383] A "preview" is a temporary display format shown to the user for final confirmation of the automatically generated brochure's contents.

[1384] "Correction" refers to the process where a user requests changes or additions after reviewing a preview, and those changes are then reflected in the system.

[1385] The "final version" refers to the final version of the brochure that has been confirmed and revised by users.

[1386] This invention relates to a system that automatically generates, displays, and prints individual brochures based on questions and requests entered by the user via a terminal. Furthermore, by combining this with an emotion engine that recognizes the user's emotions, it realizes the provision of customized information that responds to the user's emotions.

[1387] Overall system configuration

[1388] Acceptance of user input

[1389] Users enter questions and requests through terminals installed in stores or via a website. This system allows for specific requests, such as "Please tell me about the latest energy-saving air conditioners." Once the input is complete, the terminal uses cameras and sensors to capture the user's facial expressions and movements, and sends this emotional data to a server.

[1390] Data analysis and extraction

[1391] The server receives text data and sentiment data sent from the terminal. The received text data is analyzed using natural language processing (NLP) techniques, and important keywords such as "energy saving performance" and "air conditioner" are extracted through morphological analysis. At the same time, the sentiment engine is used to analyze the sentiment data and identify the user's emotional state (e.g., joy, anxiety).

[1392] Search for related information

[1393] The server queries its built-in database based on the extracted key keywords to retrieve relevant information (e.g., a list of energy-efficient air conditioners).

[1394] Generating brochure content

[1395] The server uses the retrieved information to insert data into a brochure generation template and generates an initial version of the brochure. This template includes a title, description, images, and other elements. Furthermore, based on the analysis results of the emotion engine, the brochure's content and design are adjusted to match the user's emotions. For example, if the user is feeling anxious, detailed specifications and warranty information will be emphasized.

[1396] View and check the preview

[1397] The terminal displays a preview of the automatically generated brochure to the user. The user can review this preview and enter any necessary corrections. If there are any corrections, the terminal resends the information to the server, which then applies the changes.

[1398] Final creation and printing of the brochure

[1399] When the user presses the confirm button, the terminal sends the confirmed information to the server. The server generates the final version of the brochure based on the confirmed data and sends it to the terminal in a format such as PDF. The final version of the brochure is displayed on the terminal and can be printed on the spot at the store if needed.

[1400] Specific example

[1401] Example 1: User seeking product information

[1402] 1. User: Enters "Please tell me about the latest energy-saving air conditioners" into the store's terminal. At this time, cameras and sensors analyze the user's facial expressions and recognize that they are feeling anxious.

[1403] 2. Terminal: Sends the above input content and emotion data to the server.

[1404] 3. Server: Uses natural language processing technology to extract important keywords such as "latest," "energy-saving," and "air conditioner." It also identifies user anxieties based on data from the emotion engine.

[1405] 4. Server: Searches the database for relevant air conditioner information (e.g., specifications, price, and images for each product).

[1406] 5. Server: Based on the acquired information, it automatically generates brochures that highlight detailed specifications, warranty periods, and customer reviews to alleviate user concerns.

[1407] 6. Terminal: Displays a preview of the automatically generated brochure to the user.

[1408] 7. User: Review the preview and confirm if you are satisfied with the content.

[1409] 8. Terminal: Sends the confirmed information to the server.

[1410] 9. Server: Generates the final brochure and sends it to the terminal.

[1411] 10. Terminal: Display the final version of the brochure to the user and print it as needed.

[1412] Examples of prompt statements

[1413] "Please create a brochure about the latest energy-saving air conditioners. Based on the sentiment analysis results, emphasize the detailed specifications and warranty period to users who are feeling anxious."

[1414] By using this prompt, the generative AI model can generate brochures that provide information tailored to the user's needs and emotions.

[1415] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1416] Step 1: Accepting user input

[1417] User: Enters their questions and requests via terminals installed in the store or through the website. An example input would be, "Please tell me about the latest energy-saving air conditioners."

[1418] Device: Records entered text data. It also uses the device's built-in camera and sensors to capture the user's facial expressions and movements, collecting emotional data.

[1419] Input: Questions, requests, and sentiment data entered by the user.

[1420] Output: Recorded text data and sentiment data.

[1421] Step 2: Send

[1422] Terminal: Encrypts recorded text and sentiment data and sends it to the server via secure communication.

[1423] Input: Recorded text data and sentiment data.

[1424] Output: Text data and sentiment data sent to the server.

[1425] Step 3: Analysis using Natural Language Processing (NLP)

[1426] Server: Analyzes received text data using natural language processing (NLP) techniques. Through morphological analysis, it extracts important keywords such as "energy saving" and "air conditioner" from the text.

[1427] Input: Text data sent to the server.

[1428] Data processing: Perform morphological analysis and extract important keywords.

[1429] Output: Key keywords extracted.

[1430] Step 4: Emotion Analysis

[1431] Server: Analyzes received emotional data using an emotion engine to identify the user's emotional state (e.g., joy, anxiety).

[1432] Input: Emotional data sent to the server.

[1433] Data processing: Perform sentiment analysis to identify the user's emotional state.

[1434] Output: The emotional state of the identified user.

[1435] Step 5: Search for related information

[1436] Server: Based on the extracted key keywords, it queries the built-in database to retrieve relevant information (e.g., a list of energy-efficient air conditioners).

[1437] Input: Key keywords extracted.

[1438] Data Calculation: Execute database queries to retrieve relevant information.

[1439] Output: Relevant information retrieved.

[1440] Step 6: Creating the brochure

[1441] Server: Inserts the searched information into a template and generates an initial version of the brochure. The template includes a title, description, images, etc. It also adjusts the content and design of the brochure based on the results of the emotion engine's analysis. For example, if the user is feeling anxious, it will emphasize detailed specifications and warranty information.

[1442] Input: Relevant information obtained and the identified user's emotional state.

[1443] Data processing: Insert information into templates and customize brochures.

[1444] Output: Early version of the brochure.

[1445] Step 7: Displaying the preview

[1446] Terminal: Displays a preview of the automatically generated brochure to the user.

[1447] Input: Early version of the brochure.

[1448] Output: The brochure displayed as a preview to the user.

[1449] Step 8: User verification and correction

[1450] User: Review the preview and enter any necessary corrections. For example, enter requests such as changing the image or adding a description.

[1451] Input: Preview content and user modifications.

[1452] Output: Revised brochure content.

[1453] Step 9: Applying the changes

[1454] Server: Receives corrections submitted by users and reflects them in the brochure.

[1455] Input: Revised brochure content.

[1456] Data processing: Add / modify the correction details to the brochure.

[1457] Output: Revised brochure.

[1458] Step 10: Final generation and printing

[1459] Terminal: When the user presses the confirm button, the confirmed information is sent to the server.

[1460] Server: Generates the final version of the brochure based on the confirmed data. Sends the generated brochure to the terminal in a format such as PDF.

[1461] Input: Revised brochure content.

[1462] Data processing: Generate the final version of the brochure.

[1463] Output: Final version of the brochure.

[1464] Terminal: Displays the final version of the brochure to the user and prints it on the spot if necessary.

[1465] Input: Final version of the brochure.

[1466] Output: The final version of the brochure displayed to the user and the printed brochure.

[1467] (Application Example 2)

[1468] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1469] Traditional information systems could only provide standardized information in response to user questions and requests, failing to adequately address individual needs. Furthermore, services that considered user emotions were rarely offered, highlighting the room for improvement in the user experience. In particular, customer service in physical stores demands real-time, emotionally responsive, and personalized information.

[1470] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[1471] In this invention, the server includes means for receiving user questions and requests, means for extracting important keywords, means for searching for relevant information from information sources, and means for adjusting the content and design of the generated materials using an emotion engine. This enables the automatic generation of materials based on user-inputted questions and requests, and also allows for emotion-based customization.

[1472] "Device" refers to a terminal or equipment where users input questions or requests and that information is processed.

[1473] "Questions and requests" refer to input from users that seek information or knowledge to be provided.

[1474] "Key keywords" refer to the main words and phrases necessary for information retrieval and document generation, extracted from user questions and requests.

[1475] "Information source" refers to data provision systems such as databases and APIs used to search for and retrieve relevant information.

[1476] "Materials" refers to a collection of information automatically generated in response to user questions and requests, and is provided in the form of brochures, documents, and other similar materials.

[1477] An "emotion engine" refers to a system that recognizes a user's emotions and adjusts the information provided based on those emotions.

[1478] A "user terminal" refers to a device, such as a display device or printing device, that allows the user to view and manipulate the final generated document.

[1479] This invention relates to a system that automatically generates, displays, and prints individual materials based on questions and requests entered by the user through a device. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it provides customized information tailored to the user's feelings.

[1480] System Configuration

[1481] 1. Acceptance of user input:

[1482] Device: Users enter questions and requests through a terminal installed on the device or via an internet site. For example, they might enter a specific request such as, "Please tell me about the latest energy-saving air conditioners." The device is equipped with a camera that captures the user's facial expressions.

[1483] 2. Analysis of user requirements and emotions:

[1484] Server: Receives text and sentiment data transmitted from the device and analyzes the text using natural language processing (NLP) techniques. Here, important keywords (e.g., "energy-saving," "air conditioner") are extracted.

[1485] Emotion Engine: Analyzes captured user facial expression data to identify the user's emotions (e.g., joy, excitement, anxiety).

[1486] 3. Search for related information:

[1487] Server: Based on the extracted keywords, it queries information sources to find relevant information (e.g., a list of energy-efficient air conditioners).

[1488] 4. Generating the document content:

[1489] Server: Uses the retrieved information to insert data into a template for generating documents. The template has pre-configured layouts including title, description, and images.

[1490] Emotional Engine: Adjusts the content and design of materials based on emotional data. For example, if a user is feeling anxious, it will highlight detailed specifications and warranty information.

[1491] 5. Display and verify the documents:

[1492] Device: Displays a preview of automatically generated documents to the user. The user reviews this preview and makes corrections as needed.

[1493] User: Review the preview content and confirm if you are satisfied.

[1494] 6. Final generation and printing of the document:

[1495] Device: The user submits the confirmed information to the server, which then generates the final version of the document.

[1496] Server: Generates the finalized data and sends it to the device.

[1497] Device: Displays the final version of the document to the user and prints it as needed.

[1498] Hardware and software to be used

[1499] Hardware: Smart devices, cameras

[1500] software:

[1501] Emotion engine: facial_emotion_recognition (Python library)

[1502] Natural Language Processing: TextBlob (Python library)

[1503] Data retrieval: Requests (Python library)

[1504] Specific example

[1505] Example 1: User seeking product information

[1506] 1. User: Enters "Tell me about the latest energy-saving air conditioners" into a device at a physical store. A camera captures the user's facial expression, and an emotion engine analyzes whether the user is feeling slightly anxious.

[1507] 2. Server: Uses natural language processing technology to extract important keywords such as "latest," "energy-saving," and "air conditioner." It also identifies user anxiety levels based on sentiment data.

[1508] 3. Server: Searches the database for relevant air conditioner information (e.g., specifications, price, and images for each product).

[1509] 4. Server: Based on the acquired information, it automatically generates materials that highlight detailed specifications, warranty periods, and customer reviews to alleviate user concerns.

[1510] 5. Device: Displays a preview of automatically generated documents to the user.

[1511] 6. User: Review the preview, and if satisfied with the content, confirm it to generate and print the final version.

[1512] Example of a prompt

[1513] User question: Please tell me more about the latest energy-saving air conditioners. User facial expression image path: path_to_user_image.jpg. Use the emotion engine to perform emotion analysis and generate a brochure containing appropriate information.

[1514] This system enables quick and accurate responses to user-submitted questions and requests, and also allows for the provision of information that is sensitive to the user's feelings.

[1515] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1516] Step 1:

[1517] The stage where the user enters questions or requests into the device.

[1518] Input: The user enters a question or request on their smart device. Example: "Please tell me about the latest energy-saving air conditioners."

[1519] Specific operation: The user enters questions or requests into an input form that appears on the smart device's display. The device's camera simultaneously captures the user's facial expressions.

[1520] Step 2:

[1521] The stage where the terminal sends user input and facial expression data to the server.

[1522] Input: User text input data and captured facial expression images.

[1523] Specific operation: The terminal sends the acquired text data and facial expression image data to the server. HTTP requests are used for communication.

[1524] Step 3:

[1525] The server analyzes questions and requests using natural language processing.

[1526] Input: Text data of user questions or requests.

[1527] Data processing: The server uses TextBlob to analyze questions and requests and extract important keywords. Examples: "latest," "energy-saving," "air conditioner."

[1528] Output: Extracted key keywords.

[1529] Specific operation: The server parses the received text data using TextBlob and passes the extracted keywords to the next process.

[1530] Step 4:

[1531] The server analyzes facial expression data using the emotion engine.

[1532] Input: User's facial expression image data.

[1533] Data processing: Use an emotion engine to analyze facial expression data and identify emotions. Examples: anxiety, joy.

[1534] Output: Identified user sentiment data.

[1535] Specific operation: The server inputs facial image data into the emotion engine and extracts the analysis results as emotion data.

[1536] Step 5:

[1537] The server searches for relevant information from the database.

[1538] Input: Extracted key keywords.

[1539] Data retrieval: The server queries the database or API based on these keywords to retrieve relevant information.

[1540] Output: Related information (e.g., product specifications, images, price).

[1541] Specific operation: The server executes a search query against the database and passes the returned results as components to the next stage.

[1542] Step 6:

[1543] The server generates document content based on emotional data.

[1544] Input: Related information and user sentiment data.

[1545] Data processing: The server inserts relevant information into the template and generates materials with content and design adjusted based on user sentiment data.

[1546] Output: Automated document data.

[1547] Specific operation: The server reads a template, and generates materials by customizing them based on the retrieved relevant information and the user's sentiment.

[1548] Step 7:

[1549] The terminal displays a preview of the automatically generated document.

[1550] Input: Data from automatically generated documents.

[1551] Specific action: The device displays the generated document on its screen and prompts the user for confirmation.

[1552] Step 8:

[1553] The stage where the user reviews and modifies the document.

[1554] Input: Previewed document.

[1555] Output: Data from the document, corrected as needed.

[1556] Specific actions: The user reviews the displayed document and makes corrections as needed using the touch panel or keyboard.

[1557] Step 9:

[1558] The stage where the terminal sends confirmed documents to the server.

[1559] Input: Data from corrected and finalized documents.

[1560] Specific operation: Once the user confirms the document, the terminal sends the revised document to the server.

[1561] Step 10:

[1562] The server generates the final version of the document and sends it to the terminal.

[1563] Input: Data from the corrected document.

[1564] Data processing: Format the final document and generate it as the final version.

[1565] Output: Data from the final version of the document.

[1566] Specific operation: The server generates the final version of the document based on the received data and sends it to the terminal.

[1567] Step 11:

[1568] The terminal is at the stage where it displays and prints the final version of the document.

[1569] Input: Data from the final version of the document.

[1570] Specific operation: The terminal displays the final version of the document on its screen and prints it upon user request.

[1571] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1572] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1573] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[1574] [Fourth Embodiment]

[1575] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[1576] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1577] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1578] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[1579] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1580] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1581] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1582] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[1583] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1584] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1585] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1586] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1587] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1588] This invention relates to a system that automatically generates, displays, and prints individual brochures based on questions and requests entered by users via a terminal. This system utilizes natural language processing (NLP) and database search technologies to quickly provide customized information tailored to the specific needs of each user.

[1589] Overall system configuration

[1590] 1. Receiving user input

[1591] Terminal: Users enter questions and requests through terminals installed in the store or via a website. For example, they might enter a specific request such as, "Which air conditioner has high energy efficiency?"

[1592] 2. Analysis of user requirements

[1593] Server: Receives questions and requests sent from terminals and analyzes the text using natural language processing techniques. Extracts keywords deemed important.

[1594] 3. Searching for related information

[1595] Server: Based on the extracted keywords, it searches the database for relevant information and images. For example, if the keywords "energy efficiency" and "air conditioner" are extracted, it retrieves product information and images related to them.

[1596] 4. Generating the content of the brochure

[1597] Server: Using the retrieved information, the server automatically generates the content of the brochure according to a pre-configured template. This template includes the placement of elements such as title, description, and images.

[1598] 5. Display and verification of the brochure.

[1599] Terminal: Displays a preview of the automatically generated brochure to the user. The user reviews this preview and makes corrections as needed.

[1600] User: Review the preview content and confirm if you are satisfied.

[1601] 6. Final creation and printing of the brochure

[1602] Terminal: The user sends the confirmed information to the server to generate the final version of the brochure.

[1603] Server: Generates the finalized brochure data and sends it to the terminal.

[1604] Terminal: Displays the final version of the brochure to the user, and allows printing as needed in stores.

[1605] Specific example

[1606] Example 1: User seeking product information

[1607] 1. User: Enters "Please tell me about the latest energy-saving air conditioners" into the store's terminal.

[1608] 2. Terminal: Send the above input to the server.

[1609] 3. Server: Uses natural language processing technology to extract important keywords such as "latest," "energy-saving," and "air conditioner."

[1610] 4. Server: Searches the database for relevant air conditioner information (e.g., specifications, price, and images for each product).

[1611] 5. Server: Based on the acquired information, it automatically generates the brochure by inserting the data into the template.

[1612] 6. Terminal: Displays a preview of the automatically generated brochure to the user.

[1613] 7. User: Review the preview and confirm if you are satisfied with the content.

[1614] 8. Terminal: Sends the confirmed information to the server.

[1615] 9. Server: Generates the final brochure and sends it to the terminal.

[1616] 10. Terminal: Display the final version of the brochure to the user and print it as needed.

[1617] In this way, the present invention can respond quickly and accurately to the individual needs of users, and in particular, it enables real-time information provision and customized services in stores.

[1618] The following describes the processing flow.

[1619] Step 1:

[1620] User: Accesses a website or in-store terminal and enters a question or request. For example, enters the request, "Which air conditioner is the most energy-efficient?"

[1621] Step 2:

[1622] Terminal: Receives input from the user and sends that text data to the server.

[1623] Step 3:

[1624] Server: The received text data is passed to a natural language processing (NLP) engine to analyze the questions and requests. Here, important keywords (e.g., "energy efficiency," "air conditioner") are extracted.

[1625] Step 4:

[1626] Server: Based on the extracted keywords, it queries the database to find relevant information (e.g., a list of air conditioners with excellent energy efficiency).

[1627] Step 5:

[1628] Server: Receives search results and inserts the data into a template for generating brochures. This template has pre-configured layouts for titles, descriptions, images, etc.

[1629] Step 6:

[1630] Server: Generates a preview of the brochure and sends that data to the terminal.

[1631] Step 7:

[1632] Terminal: Displays a preview to the user and prompts them to confirm the content. The user reviews the preview and selects "Confirm" if they are satisfied with the content.

[1633] Step 8:

[1634] User: Review the preview, re-enter any necessary corrections, and perform a final check. If satisfied, press the confirm button.

[1635] Step 9:

[1636] Terminal: Receives user confirmation and sends that information to the server.

[1637] Step 10:

[1638] Server: Generates the finalized brochure data and sends that data to the terminal.

[1639] Step 11:

[1640] Terminal: Displays the final version of the brochure to the user, and allows printing as needed in stores.

[1641] (Example 1)

[1642] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1643] Conventional information systems make it difficult for users to quickly obtain the specific information they need, and in particular, they lack the means to provide customized information tailored to individual user needs. This can lead to ineffective real-time information provision and the creation of customized brochures in stores, potentially resulting in decreased user satisfaction.

[1644] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1645] In this invention, the server includes means for receiving questions and requests entered by the user via a terminal, means for analyzing the questions and requests and extracting important keywords using natural language processing technology, means for searching a database for relevant information based on the important keywords, means for automatically generating individual brochures using pre-configured templates based on the relevant information, and means for displaying the automatically generated brochures on the user terminal. This enables the rapid and accurate acquisition, display, and printing of customized information that corresponds to the user's individual requests.

[1646] A "user" refers to an individual or legal entity that uses the system to input questions or requests.

[1647] A "terminal" is a computer device used by users to input information, and can refer to information input devices installed in stores or websites.

[1648] "Questions and requests" refer to the information or requests that users want to obtain through the system.

[1649] "Natural language processing technology" refers to the technology used to analyze human language and convert it into a format that computers can understand and process.

[1650] "Key keywords" refer to words or phrases that are extracted through analysis from questions or requests and are particularly necessary for information retrieval and processing.

[1651] A "database" refers to a collection of information in which related information is stored in a structured manner.

[1652] A "template" refers to a pre-configured framework or format used to automatically generate the content of documents or brochures.

[1653] A "personalized brochure" refers to an informational document containing information customized to the specific needs of a particular user.

[1654] "Preview" refers to a display format that allows users to check the contents of an automatically generated brochure.

[1655] "Printing" refers to the process of outputting the generated brochure onto physical paper.

[1656] This invention relates to a system that automatically generates, displays, and prints individual brochures based on questions and requests entered by users via terminals installed in stores or through a website. The system utilizes natural language processing technology and database search technology to quickly provide customized information tailored to the specific needs of each user.

[1657] Components and technologies used

[1658] Acceptance of user input

[1659] Users input information through touchscreens on their devices or forms on websites. For example, they might input, "Which is the latest air conditioner with high energy efficiency?"

[1660] The terminal receives user input and sends it to the server as an HTTP request.

[1661] Analysis of user requirements

[1662] The server uses Python natural language processing libraries (such as NLTK and spaCy) to analyze the received questions and requests. The analysis extracts important keywords, such as "energy saving" and "air conditioner."

[1663] Search for related information

[1664] The server generates SQL statements based on the extracted keywords and executes queries against database management systems such as MySQL and PostgreSQL. An example of such a query is "SELECT FROM products WHERE type='air conditioner' AND feature='energy saving'".

[1665] Generating brochure content

[1666] The server uses an HTML templating engine like Jinja2 to embed information retrieved from the database into pre-configured templates, automatically generating structured brochures.

[1667] Display and verification of the brochure

[1668] The terminal displays a preview of the generated brochure to the user. The user can review the content and make corrections as needed.

[1669] Final generation and printing of the brochure

[1670] If the user is satisfied with the preview, they press the confirm button.

[1671] The terminal sends the confirmed information to the server, and the server generates the final version of the brochure and sends it back to the terminal.

[1672] The terminal displays the final version of the brochure and allows printing as needed.

[1673] Specific example

[1674] Specific examples of users seeking product information

[1675] 1. The user enters "Tell me about the latest energy-saving air conditioners" into their device.

[1676] 2. The terminal sends the input content to the server.

[1677] 3. The server uses natural language processing technology to extract the keywords "latest," "energy-saving," and "air conditioner."

[1678] 4. The server searches the database for relevant air conditioner information (e.g., specifications, price, and images for each product).

[1679] 5. The server inserts the search results into a template to automatically generate the brochure.

[1680] 6. The device displays a preview of the brochure for the user to review.

[1681] 7. The user presses the confirm button.

[1682] 8. The terminal sends the confirmed data to the server.

[1683] 9. The server generates the final version of the brochure and sends it to the terminal.

[1684] 10. The terminal displays the final version and prints it if necessary.

[1685] Example of a prompt

[1686] "Please tell me about the latest energy-efficient air conditioners and their prices. Specifically, I'd like to know about the annual electricity cost savings."

[1687] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1688] Program processing flow

[1689] Step 1: Accepting user input

[1690] user:

[1691] Input: Enter your questions or requests into terminals installed in the store or into forms on the website.

[1692] Specific actions: Users input questions such as "Which air conditioner has the latest energy efficiency?" using a touchscreen or keyboard.

[1693] Output: User questions and requests are saved digitally on the device.

[1694] Terminal:

[1695] Input: Digital data of questions and requests entered by users.

[1696] Specific operation: Receives input and sends it to the server as appropriately formatted data.

[1697] Output: Formatted user questions and requests are sent to the server.

[1698] Step 2: Analyze user requirements

[1699] server:

[1700] Input: User questions and request data sent from the device.

[1701] Specific operation: Analyze text using natural language processing techniques and extract important keywords. Specifically, use Python's NLTK and spaCy to analyze sentences and extract important keywords such as "energy saving" and "air conditioner".

[1702] Output: A list of key keywords extracted.

[1703] Step 3: Search for related information

[1704] server:

[1705] Input: A list of key keywords extracted.

[1706] Specific operation: Generates SQL statements based on keywords and executes queries in database management systems such as MySQL and PostgreSQL. For example, it executes a query like "SELECT FROM products WHERE type='air conditioner' AND feature='energy saving'".

[1707] Output: A list of relevant information retrieved from the database (e.g., product specifications, price, images, etc.).

[1708] Step 4: Generating the brochure content

[1709] server:

[1710] Input: A list of relevant information retrieved from the database.

[1711] Specific operation: Using an HTML templating engine like Jinja2, the system automatically generates structured brochures by embedding the retrieved information into a pre-configured template. For example, it might embed data such as "Air conditioner A - Price: 50,000 yen, Annual electricity cost: 12,000 yen" into the template.

[1712] Output: Digital data of an automatically generated brochure.

[1713] Step 5: View and verify the brochure.

[1714] Terminal:

[1715] Input: Digital data of automatically generated brochures sent from the server.

[1716] Specific operation: A preview of the generated brochure is displayed on a web browser or device screen.

[1717] Output: A preview of the brochure that the user can view.

[1718] user:

[1719] Input: A preview of the brochure displayed on the terminal.

[1720] Specific actions: Review the displayed preview and make corrections as needed. If corrections are required, enter the corrections through the terminal interface.

[1721] Output: Brochure data containing the revised content.

[1722] Step 6: Final generation and printing of the brochure

[1723] user:

[1724] Input: Preview of the finalized brochure.

[1725] Specific action: Confirm that the preview is correct and press the confirm button.

[1726] Output: Confirmed information is set on the terminal.

[1727] Terminal:

[1728] Input: Confirmed information from the user.

[1729] Specific action: Send confirmed information to the server.

[1730] Output: Confirmed information is sent to the server.

[1731] server:

[1732] Input: Confirmed information sent from the device.

[1733] Specific action: Generate the final version of the brochure data and send it to the terminal.

[1734] Output: Final version of the brochure data.

[1735] Terminal:

[1736] Input: Final version of the brochure data.

[1737] Specific actions: Display the final version of the brochure and print it using a printer if necessary.

[1738] Output: The final version of the brochure that the user can review, and printed copies of the brochure.

[1739] (Application Example 1)

[1740] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1741] Currently, in many physical stores, customers need to browse through a large number of brochures and catalogs to obtain detailed information about products. However, much of this information is general and does not address individual needs, making it difficult for customers to find information that suits their requirements. Furthermore, it is time-consuming and laborious for store staff to answer each question, making efficient service provision difficult. This can lead to decreased customer satisfaction and negatively impact sales. This invention aims to solve these problems.

[1742] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1743] In this invention, the server includes means for receiving questions and requests entered by the user via a terminal, means for analyzing the questions and requests and extracting important keywords, means for searching a database for relevant information based on the important keywords, means for automatically generating individual brochures based on the relevant information, means for displaying the automatically generated brochures on the user terminal for confirmation and modification, means for generating a final version of the modified brochure and sending it to the terminal, and means for printing the finalized brochure. This enables customers to quickly and accurately obtain customized information that meets their needs. It also reduces the burden on store staff and enables efficient service provision.

[1744] A "terminal" is an electronic device used by users to input questions and requests and receive information.

[1745] "Means for receiving questions and requests" refers to a function for sending text information entered by the user to the server.

[1746] "Means for analyzing questions and requests" refers to a function that uses natural language processing technology to extract important keywords from input text data.

[1747] "Key keywords" are words or phrases that are particularly meaningful in a question or request.

[1748] "Means of searching for related information from a database" refers to a function that searches for related information within a database based on extracted keywords.

[1749] "Method for automatically generating individual brochures" refers to a function that automatically creates brochures according to a template based on the searched relevant information.

[1750] "A means of displaying, reviewing, and correcting automatically generated brochures on a user's terminal" refers to a function that provides the user with a view of the generated brochure's content, allowing the user to review and correct that content.

[1751] "Means for generating and sending a final version of the revised brochure to the terminal" refers to a function that confirms and revises the brochure as reviewed and corrected by the user, generates the final version, and sends it to the user's terminal.

[1752] "Means of printing brochures" refers to the function of printing a finalized brochure onto physical paper media.

[1753] "Natural language processing technology" is a general term for technologies that enable computers to understand, analyze, and process human language.

[1754] This invention details an embodiment of a system in which a user inputs questions and requests regarding products through a terminal in a physical store, and a customized brochure is automatically generated based on that information.

[1755] The system configuration includes user terminals, servers for analysis and generation processing, and a database. Specifically, it consists of the following:

[1756] First, users enter their questions or requests using an electronic terminal or tablet installed in the physical store. For example, they can enter a request such as, "Please tell me about the latest energy-saving air conditioners."

[1757] The input information is sent to the server. The server uses natural language processing (NLP) techniques to analyze this input text and extract important keywords. This analysis primarily uses the Python NLTK library.

[1758] Based on the extracted keywords, the server searches the database for information on related products. The database is built on an SQL basis and stores information such as product specifications, prices, and images.

[1759] After the relevant information is retrieved, the server automatically generates a customized brochure based on this information. The generation process uses the Django framework, and the ReportLab library is used for PDF generation. At this stage, the information is arranged according to a pre-configured template, and the brochure is generated.

[1760] A preview of the generated brochure is displayed on the user's device. The user can review this preview and make corrections as needed. The corrected content is then sent back to the server, which generates the final version of the brochure.

[1761] Finally, the finalized brochure is sent to the terminal and printed as needed. This allows users to quickly obtain information optimized for their needs.

[1762] Specific example:

[1763] When a user types "Tell me about the latest smartphones" into a store's tablet terminal, the system performs the following steps: First, it extracts the keywords "latest" and "smartphone" and searches the database for relevant smartphone information. Next, it generates a customized brochure based on the retrieved information and displays this brochure to the user. Once the user reviews and makes corrections, the corrected information is sent back to the server to generate a final version. Finally, the final version of the brochure is displayed to the user and printed.

[1764] Example of a prompt:

[1765] "Design a system that generates customized brochures based on questions and requests entered by users on their devices. Specifically, describe the entire process, including keyword extraction using natural language processing, database search, brochure generation using templates, user confirmation, and final version generation and printing."

[1766] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1767] Step 1:

[1768] Process name: User input reception

[1769] Subject: User

[1770] Specific operation: Users use terminals in physical stores to input questions or requests. This input is done through the interface of a tablet or kiosk terminal.

[1771] Input: User questions or requests (e.g., "Please tell me about the latest energy-saving air conditioners")

[1772] Output: Input text data

[1773] Step 2:

[1774] Process name: Sending input

[1775] Subject: terminal

[1776] Specific operation: The entered text data is sent to the server. The HTTP protocol is used for this process.

[1777] Input: Text data

[1778] Output: Text data is sent to the server.

[1779] Step 3:

[1780] Process name: Analysis of questions and requests

[1781] Subject: Server

[1782] Specific operation: The server uses natural language processing (NLP) techniques to analyze the received text data. It uses the Python NLTK library to extract important keywords.

[1783] Input: Text data

[1784] Data Processing / Data Calculation: Analysis and Keyword Extraction using NLP Technology

[1785] Output: Keywords (e.g., "latest", "energy-saving", "air conditioner")

[1786] Step 4:

[1787] Process name: Search for related information

[1788] Subject: Server

[1789] Specific operation: Based on the extracted keywords, the server searches for relevant information in the SQL database.

[1790] Input: Keyword

[1791] Data Processing / Data Calculation: Data Retrieval using SQL Queries

[1792] Output: Related information (product information, images, specifications, price, etc.)

[1793] Step 5:

[1794] Process name: Automatic generation of brochures

[1795] Subject: Server

[1796] Specific operation: Based on the searched information, the server embeds the information into a brochure template and automatically generates it. The Django framework and ReportLab library are used.

[1797] Input: Related Information

[1798] Data processing / data calculation: Placing information in a template and generating a PDF.

[1799] Output: Automated brochure

[1800] Step 6:

[1801] Process name: Display preview

[1802] Subject: terminal

[1803] Specific operation: An automatically generated brochure is sent to the terminal and displayed to the user as a preview. The user can review the content and make corrections as needed.

[1804] Input: Automated brochure

[1805] Output: Preview screen for user review and modification.

[1806] Step 7:

[1807] Process name: Sending corrected data

[1808] Subject: User and device

[1809] Specific operation: The user reviews the contents of the brochure, makes any necessary corrections, and sends the corrected data to the server.

[1810] Input: Revised brochure data

[1811] Output: Corrected data is sent to the server.

[1812] Step 8:

[1813] Process name: Generation of final version

[1814] Subject: Server

[1815] Specific operation: The server generates the final version of the brochure based on the corrected information.

[1816] Input: Correction data

[1817] Data processing / data calculation: Reflecting revisions and generating the final version of the brochure.

[1818] Output: Final version of the brochure

[1819] Step 9:

[1820] Process name: Sending and printing the final version

[1821] Subject: Terminals and Servers

[1822] Specific actions: The final version of the brochure is sent to the terminal and displayed to the user. Printing is also performed as needed.

[1823] Input: Final version of the brochure

[1824] Output: Brochures displayed and printed on the user's device.

[1825] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1826] This invention relates to a system that automatically generates, displays, and prints individual brochures based on questions and requests entered by the user via a terminal. Furthermore, by combining this with an emotion engine that recognizes the user's emotions, it realizes the provision of customized information that responds to the user's emotions.

[1827] Overall system configuration

[1828] 1. Receiving user input

[1829] Terminal: Users enter questions and requests through terminals installed in the store or via a website. For example, they might enter a specific request such as, "Please tell me about the latest energy-saving air conditioners."

[1830] Terminal: Once input is complete, the terminal sends the user's input to the emotion engine to recognize the user's emotions (e.g., joy, excitement, anxiety).

[1831] 2. Analysis of user requirements and emotions

[1832] Server: Receives text and sentiment data sent from the terminal and analyzes the text using natural language processing (NLP) techniques. Here, important keywords (e.g., "energy efficiency," "air conditioner") are extracted.

[1833] 3. Searching for related information

[1834] Server: Based on the extracted keywords, it queries the database to find relevant information (e.g., a list of air conditioners with excellent energy efficiency).

[1835] 4. Generating the content of the brochure

[1836] Server: Uses the retrieved information to insert data into a template for generating brochures. The template has pre-configured layouts including title, description, and images.

[1837] Server: Based on data from the emotion engine, adjusts the content and design of the brochure. For example, if a user is feeling anxious, it will highlight detailed specifications and warranty information.

[1838] 5. Display and verification of the brochure.

[1839] Terminal: Displays a preview of the automatically generated brochure to the user. The user reviews this preview and makes corrections as needed.

[1840] User: Review the preview content and confirm if you are satisfied.

[1841] 6. Final creation and printing of the brochure

[1842] Terminal: The user sends the confirmed information to the server to generate the final version of the brochure.

[1843] Server: Generates the finalized brochure data and sends that data to the terminal.

[1844] Terminal: Displays the final version of the brochure to the user, and allows printing as needed in stores.

[1845] Specific example

[1846] Example 1: User seeking product information

[1847] 1. User: Enters "Please tell me about the latest energy-saving air conditioners" into the store's terminal. At the same time, the emotion engine uses cameras and sensors to analyze the user's facial expressions and recognizes that the user is feeling slightly anxious.

[1848] 2. Terminal: Sends the above input and emotion data to the server.

[1849] 3. Server: Uses natural language processing technology to extract important keywords such as "latest," "energy-saving," and "air conditioner." It also identifies user anxieties based on data from the emotion engine.

[1850] 4. Server: Searches the database for relevant air conditioner information (e.g., specifications, price, and images for each product).

[1851] 5. Server: Based on the acquired information, it automatically generates brochures that highlight detailed specifications, warranty periods, and customer reviews to alleviate user concerns.

[1852] 6. Terminal: Displays a preview of the automatically generated brochure to the user.

[1853] 7. User: Review the preview and confirm if you are satisfied with the content.

[1854] 8. Terminal: Sends the confirmed information to the server.

[1855] 9. Server: Generates the final brochure and sends it to the terminal.

[1856] 10. Terminal: Display the final version of the brochure to the user and print it as needed.

[1857] In this way, the present invention can respond quickly and accurately to user questions and requests, and furthermore, provide information that takes user emotions into consideration. This can improve the user experience.

[1858] The following describes the processing flow.

[1859] Step 1:

[1860] User: Access a website or in-store terminal and enter your question or request. For example, "Please tell me about the latest energy-saving air conditioners."

[1861] Step 2:

[1862] Terminal: Receives user input and sends it to the server, while also having the emotion engine analyze the user's facial expressions, tone of voice, etc. The emotion engine recognizes the user's emotions (e.g., anxiety, excitement) and sends that data to the server.

[1863] Step 3:

[1864] Server: Text data sent from the terminal is passed to a natural language processing (NLP) engine to analyze questions and requests. Here, important keywords such as "energy efficiency" and "air conditioner" are extracted.

[1865] Step 4:

[1866] Server: Analyzes emotional data sent from the emotion engine to identify the user's current emotional state (e.g., anxiety).

[1867] Step 5:

[1868] Server: Based on the extracted keywords, it searches the database for relevant information (e.g., a list of energy-saving air conditioners, specifications and prices for each product, images).

[1869] Step 6:

[1870] Server: Retrieves search results and automatically generates brochures by inserting the data into a template. The content and design of the brochure are adjusted based on user sentiment data. For example, detailed specifications and warranty information are emphasized for users who are feeling anxious.

[1871] Step 7:

[1872] Server: Creates a preview of the automatically generated brochure and sends the data to the terminal.

[1873] Step 8:

[1874] Terminal: Displays a preview to the user and prompts them to review the content. The user reviews the preview and enters any necessary corrections.

[1875] Step 9:

[1876] User: Review the preview content and, if satisfied, enter your confirmation instructions.

[1877] Step 10:

[1878] Terminal: Receives user confirmation and sends that information to the server.

[1879] Step 11:

[1880] Server: Generates the finalized brochure data and sends that data to the terminal.

[1881] Step 12:

[1882] Terminal: Displays the final version of the brochure to the user, and allows printing as needed in stores.

[1883] (Example 2)

[1884] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1885] While current information systems can adequately respond to user questions and requests, these responses often fail to consider the user's emotional state, potentially leading to decreased user satisfaction. Furthermore, the lack of systems that provide customized information tailored to user emotions hinders the improvement of the user experience.

[1886] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[1887] In this invention, the server includes means for receiving questions and requests entered by the user via a terminal, means for collecting user emotion data along with the questions and requests, means for analyzing the questions and requests and extracting important keywords, means for analyzing the emotion data and recognizing the user's emotions, means for searching a database for relevant information based on the important keywords, means for automatically generating individual brochures corresponding to the user's emotions based on the relevant information, and means for displaying the automatically generated brochures on the user terminal. This makes it possible to provide customized information according to the user's emotional state.

[1888] A "terminal" is an information device used by users to input information, and includes terminals installed in stores and those accessed via websites.

[1889] A "user" is an individual who uses the system to enter questions or requests.

[1890] "Questions and requests" refer to text-based requests or inquiries for information entered by the user via their device.

[1891] "Emotional data" refers to emotional information based on the user's facial expressions and actions, collected using the device's camera and sensors.

[1892] Natural Language Processing (NLP) is a technology that analyzes user input text to understand its meaning and context.

[1893] "Key keywords" are central words or phrases extracted from questions and requests using natural language processing technology, which are essential when searching for relevant information.

[1894] An "emotion engine" is software or algorithms that analyze collected emotional data to recognize a user's emotional state.

[1895] A "database" is a collection of information that stores and manages related information in a searchable format.

[1896] "Related information" refers to information and data retrieved from the database based on important keywords.

[1897] A "brochure" is informational material about specific products or services that is automatically generated based on the user's questions, requests, and emotional state.

[1898] "Automated generation" refers to the process by which content and information are created using specific algorithms or templates, without manual intervention.

[1899] A "preview" is a temporary display format shown to the user for final confirmation of the automatically generated brochure's contents.

[1900] "Correction" refers to the process where a user requests changes or additions after reviewing a preview, and those changes are then reflected in the system.

[1901] The "final version" refers to the final version of the brochure that has been confirmed and revised by users.

[1902] This invention relates to a system that automatically generates, displays, and prints individual brochures based on questions and requests entered by the user via a terminal. Furthermore, by combining this with an emotion engine that recognizes the user's emotions, it realizes the provision of customized information that responds to the user's emotions.

[1903] Overall system configuration

[1904] Acceptance of user input

[1905] Users enter questions and requests through terminals installed in stores or via a website. This system allows for specific requests, such as "Please tell me about the latest energy-saving air conditioners." Once the input is complete, the terminal uses cameras and sensors to capture the user's facial expressions and movements, and sends this emotional data to a server.

[1906] Data analysis and extraction

[1907] The server receives text data and sentiment data sent from the terminal. The received text data is analyzed using natural language processing (NLP) techniques, and important keywords such as "energy saving performance" and "air conditioner" are extracted through morphological analysis. At the same time, the sentiment engine is used to analyze the sentiment data and identify the user's emotional state (e.g., joy, anxiety).

[1908] Search for related information

[1909] The server queries its built-in database based on the extracted key keywords to retrieve relevant information (e.g., a list of energy-efficient air conditioners).

[1910] Generating brochure content

[1911] The server uses the retrieved information to insert data into a brochure generation template and generates an initial version of the brochure. This template includes a title, description, images, and other elements. Furthermore, based on the analysis results of the emotion engine, the brochure's content and design are adjusted to match the user's emotions. For example, if the user is feeling anxious, detailed specifications and warranty information will be emphasized.

[1912] View and check the preview

[1913] The terminal displays a preview of the automatically generated brochure to the user. The user can review this preview and enter any necessary corrections. If there are any corrections, the terminal resends the information to the server, which then applies the changes.

[1914] Final creation and printing of the brochure

[1915] When the user presses the confirm button, the terminal sends the confirmed information to the server. The server generates the final version of the brochure based on the confirmed data and sends it to the terminal in a format such as PDF. The final version of the brochure is displayed on the terminal and can be printed on the spot at the store if needed.

[1916] Specific example

[1917] Example 1: User seeking product information

[1918] 1. User: Enters "Please tell me about the latest energy-saving air conditioners" into the store's terminal. At this time, cameras and sensors analyze the user's facial expressions and recognize that they are feeling anxious.

[1919] 2. Terminal: Sends the above input content and emotion data to the server.

[1920] 3. Server: Uses natural language processing technology to extract important keywords such as "latest," "energy-saving," and "air conditioner." It also identifies user anxieties based on data from the emotion engine.

[1921] 4. Server: Searches the database for relevant air conditioner information (e.g., specifications, price, and images for each product).

[1922] 5. Server: Based on the acquired information, it automatically generates brochures that highlight detailed specifications, warranty periods, and customer reviews to alleviate user concerns.

[1923] 6. Terminal: Displays a preview of the automatically generated brochure to the user.

[1924] 7. User: Review the preview and confirm if you are satisfied with the content.

[1925] 8. Terminal: Sends the confirmed information to the server.

[1926] 9. Server: Generates the final brochure and sends it to the terminal.

[1927] 10. Terminal: Display the final version of the brochure to the user and print it as needed.

[1928] Examples of prompt statements

[1929] "Please create a brochure about the latest energy-saving air conditioners. Based on the sentiment analysis results, emphasize the detailed specifications and warranty period to users who are feeling anxious."

[1930] By using this prompt, the generative AI model can generate brochures that provide information tailored to the user's needs and emotions.

[1931] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1932] Step 1: Accepting user input

[1933] User: Enters their questions and requests via terminals installed in the store or through the website. An example input would be, "Please tell me about the latest energy-saving air conditioners."

[1934] Device: Records entered text data. It also uses the device's built-in camera and sensors to capture the user's facial expressions and movements, collecting emotional data.

[1935] Input: Questions, requests, and sentiment data entered by the user.

[1936] Output: Recorded text data and sentiment data.

[1937] Step 2: Send

[1938] Terminal: Encrypts recorded text and sentiment data and sends it to the server via secure communication.

[1939] Input: Recorded text data and sentiment data.

[1940] Output: Text data and sentiment data sent to the server.

[1941] Step 3: Analysis using Natural Language Processing (NLP)

[1942] Server: Analyzes received text data using natural language processing (NLP) techniques. Through morphological analysis, it extracts important keywords such as "energy saving" and "air conditioner" from the text.

[1943] Input: Text data sent to the server.

[1944] Data processing: Perform morphological analysis and extract important keywords.

[1945] Output: Key keywords extracted.

[1946] Step 4: Emotion Analysis

[1947] Server: Analyzes received emotional data using an emotion engine to identify the user's emotional state (e.g., joy, anxiety).

[1948] Input: Emotional data sent to the server.

[1949] Data processing: Perform sentiment analysis to identify the user's emotional state.

[1950] Output: The emotional state of the identified user.

[1951] Step 5: Search for related information

[1952] Server: Based on the extracted key keywords, it queries the built-in database to retrieve relevant information (e.g., a list of energy-efficient air conditioners).

[1953] Input: Key keywords extracted.

[1954] Data Calculation: Execute database queries to retrieve relevant information.

[1955] Output: Relevant information retrieved.

[1956] Step 6: Creating the brochure

[1957] Server: Inserts the searched information into a template and generates an initial version of the brochure. The template includes a title, description, images, etc. It also adjusts the content and design of the brochure based on the results of the emotion engine's analysis. For example, if the user is feeling anxious, it will emphasize detailed specifications and warranty information.

[1958] Input: Relevant information obtained and the identified user's emotional state.

[1959] Data processing: Insert information into templates and customize brochures.

[1960] Output: Early version of the brochure.

[1961] Step 7: Displaying the preview

[1962] Terminal: Displays a preview of the automatically generated brochure to the user.

[1963] Input: Early version of the brochure.

[1964] Output: The brochure displayed as a preview to the user.

[1965] Step 8: User verification and correction

[1966] User: Review the preview and enter any necessary corrections. For example, enter requests such as changing the image or adding a description.

[1967] Input: Preview content and user modifications.

[1968] Output: Revised brochure content.

[1969] Step 9: Applying the changes

[1970] Server: Receives corrections submitted by users and reflects them in the brochure.

[1971] Input: Revised brochure content.

[1972] Data processing: Add / modify the correction details to the brochure.

[1973] Output: Revised brochure.

[1974] Step 10: Final generation and printing

[1975] Terminal: When the user presses the confirm button, the confirmed information is sent to the server.

[1976] Server: Generates the final version of the brochure based on the confirmed data. Sends the generated brochure to the terminal in a format such as PDF.

[1977] Input: Revised brochure content.

[1978] Data processing: Generate the final version of the brochure.

[1979] Output: Final version of the brochure.

[1980] Terminal: Displays the final version of the brochure to the user and prints it on the spot if necessary.

[1981] Input: Final version of the brochure.

[1982] Output: The final version of the brochure displayed to the user and the printed brochure.

[1983] (Application Example 2)

[1984] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1985] Traditional information systems could only provide standardized information in response to user questions and requests, failing to adequately address individual needs. Furthermore, services that considered user emotions were rarely offered, highlighting the room for improvement in the user experience. In particular, customer service in physical stores demands real-time, emotionally responsive, and personalized information.

[1986] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[1987] In this invention, the server includes means for receiving user questions and requests, means for extracting important keywords, means for searching for relevant information from information sources, and means for adjusting the content and design of the generated materials using an emotion engine. This enables the automatic generation of materials based on user-inputted questions and requests, and also allows for emotion-based customization.

[1988] "Device" refers to a terminal or equipment where users input questions or requests and that information is processed.

[1989] "Questions and requests" refer to input from users that seek information or knowledge to be provided.

[1990] "Key keywords" refer to the main words and phrases necessary for information retrieval and document generation, extracted from user questions and requests.

[1991] "Information source" refers to data provision systems such as databases and APIs used to search for and retrieve relevant information.

[1992] "Materials" refers to a collection of information automatically generated in response to user questions and requests, and is provided in the form of brochures, documents, and other similar materials.

[1993] An "emotion engine" refers to a system that recognizes a user's emotions and adjusts the information provided based on those emotions.

[1994] A "user terminal" refers to a device, such as a display device or printing device, that allows the user to view and manipulate the final generated document.

[1995] This invention relates to a system that automatically generates, displays, and prints individual materials based on questions and requests entered by the user through a device. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it provides customized information tailored to the user's feelings.

[1996] System Configuration

[1997] 1. Acceptance of user input:

[1998] Device: Users enter questions and requests through a terminal installed on the device or via an internet site. For example, they might enter a specific request such as, "Please tell me about the latest energy-saving air conditioners." The device is equipped with a camera that captures the user's facial expressions.

[1999] 2. Analysis of user requirements and emotions:

[2000] Server: Receives text and sentiment data transmitted from the device and analyzes the text using natural language processing (NLP) techniques. Here, important keywords (e.g., "energy-saving," "air conditioner") are extracted.

[2001] Emotion Engine: Analyzes captured user facial expression data to identify the user's emotions (e.g., joy, excitement, anxiety).

[2002] 3. Search for related information:

[2003] Server: Based on the extracted keywords, it queries information sources to find relevant information (e.g., a list of energy-efficient air conditioners).

[2004] 4. Generating the document content:

[2005] Server: Uses the retrieved information to insert data into a template for generating documents. The template has pre-configured layouts including title, description, and images.

[2006] Emotional Engine: Adjusts the content and design of materials based on emotional data. For example, if a user is feeling anxious, it will highlight detailed specifications and warranty information.

[2007] 5. Display and verify the documents:

[2008] Device: Displays a preview of automatically generated documents to the user. The user reviews this preview and makes corrections as needed.

[2009] User: Review the preview content and confirm if you are satisfied.

[2010] 6. Final generation and printing of the document:

[2011] Device: The user submits the confirmed information to the server, which then generates the final version of the document.

[2012] Server: Generates the finalized data and sends it to the device.

[2013] Device: Displays the final version of the document to the user and prints it as needed.

[2014] Hardware and software to be used

[2015] Hardware: Smart devices, cameras

[2016] software:

[2017] Emotion engine: facial_emotion_recognition (Python library)

[2018] Natural Language Processing: TextBlob (Python library)

[2019] Data retrieval: Requests (Python library)

[2020] Specific example

[2021] Example 1: User seeking product information

[2022] 1. User: Enters "Tell me about the latest energy-saving air conditioners" into a device at a physical store. A camera captures the user's facial expression, and an emotion engine analyzes whether the user is feeling slightly anxious.

[2023] 2. Server: Uses natural language processing technology to extract important keywords such as "latest," "energy-saving," and "air conditioner." It also identifies user anxiety levels based on sentiment data.

[2024] 3. Server: Searches the database for relevant air conditioner information (e.g., specifications, price, and images for each product).

[2025] 4. Server: Based on the acquired information, it automatically generates materials that highlight detailed specifications, warranty periods, and customer reviews to alleviate user concerns.

[2026] 5. Device: Displays a preview of automatically generated documents to the user.

[2027] 6. User: Review the preview, and if satisfied with the content, confirm it to generate and print the final version.

[2028] Example of a prompt

[2029] User question: Please tell me more about the latest energy-saving air conditioners. User facial expression image path: path_to_user_image.jpg. Use the emotion engine to perform emotion analysis and generate a brochure containing appropriate information.

[2030] This system enables quick and accurate responses to user-submitted questions and requests, and also allows for the provision of information that is sensitive to the user's feelings.

[2031] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[2032] Step 1:

[2033] The stage where the user enters questions or requests into the device.

[2034] Input: The user enters a question or request on their smart device. Example: "Please tell me about the latest energy-saving air conditioners."

[2035] Specific operation: The user enters questions or requests into an input form that appears on the smart device's display. The device's camera simultaneously captures the user's facial expressions.

[2036] Step 2:

[2037] The stage where the terminal sends user input and facial expression data to the server.

[2038] Input: User text input data and captured facial expression images.

[2039] Specific operation: The terminal sends the acquired text data and facial expression image data to the server. HTTP requests are used for communication.

[2040] Step 3:

[2041] The server analyzes questions and requests using natural language processing.

[2042] Input: Text data of user questions or requests.

[2043] Data processing: The server uses TextBlob to analyze questions and requests and extract important keywords. Examples: "latest," "energy-saving," "air conditioner."

[2044] Output: Extracted key keywords.

[2045] Specific operation: The server parses the received text data using TextBlob and passes the extracted keywords to the next process.

[2046] Step 4:

[2047] The server analyzes facial expression data using the emotion engine.

[2048] Input: User's facial expression image data.

[2049] Data processing: Use an emotion engine to analyze facial expression data and identify emotions. Examples: anxiety, joy.

[2050] Output: Identified user sentiment data.

[2051] Specific operation: The server inputs facial image data into the emotion engine and extracts the analysis results as emotion data.

[2052] Step 5:

[2053] The server searches for relevant information from the database.

[2054] Input: Extracted key keywords.

[2055] Data retrieval: The server queries the database or API based on these keywords to retrieve relevant information.

[2056] Output: Related information (e.g., product specifications, images, price).

[2057] Specific operation: The server executes a search query against the database and passes the returned results as components to the next stage.

[2058] Step 6:

[2059] The server generates document content based on emotional data.

[2060] Input: Related information and user sentiment data.

[2061] Data processing: The server inserts relevant information into the template and generates materials with content and design adjusted based on user sentiment data.

[2062] Output: Automated document data.

[2063] Specific operation: The server reads a template, and generates materials by customizing them based on the retrieved relevant information and the user's sentiment.

[2064] Step 7:

[2065] The terminal displays a preview of the automatically generated document.

[2066] Input: Data from automatically generated documents.

[2067] Specific action: The device displays the generated document on its screen and prompts the user for confirmation.

[2068] Step 8:

[2069] The stage where the user reviews and modifies the document.

[2070] Input: Previewed document.

[2071] Output: Data from the document, corrected as needed.

[2072] Specific actions: The user reviews the displayed document and makes corrections as needed using the touch panel or keyboard.

[2073] Step 9:

[2074] The stage where the terminal sends confirmed documents to the server.

[2075] Input: Data from corrected and finalized documents.

[2076] Specific operation: Once the user confirms the document, the terminal sends the revised document to the server.

[2077] Step 10:

[2078] The server generates the final version of the document and sends it to the terminal.

[2079] Input: Data from the corrected document.

[2080] Data processing: Format the final document and generate it as the final version.

[2081] Output: Data from the final version of the document.

[2082] Specific operation: The server generates the final version of the document based on the received data and sends it to the terminal.

[2083] Step 11:

[2084] The terminal is at the stage where it displays and prints the final version of the document.

[2085] Input: Data from the final version of the document.

[2086] Specific operation: The terminal displays the final version of the document on its screen and prints it upon user request.

[2087] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[2088] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2089] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[2090] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2091] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[2092] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[2093] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[2094] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[2095] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[2096] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[2097] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[2098] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[2099] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[2100] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[2101] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[2102] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[2103] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[2104] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[2105] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[2106] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[2107] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted as being incorporated by reference.

[2108] The following is further disclosed regarding the embodiments described above.

[2109] (Claim 1)

[2110] A means of receiving questions and requests entered by the user via the device,

[2111] A means for analyzing the aforementioned questions and requests and extracting important keywords,

[2112] A means for searching for related information from a database based on the aforementioned important keywords,

[2113] A means for automatically generating individual brochures based on the aforementioned related information,

[2114] The means for displaying the automatically generated pamphlet on the user terminal,

[2115] A system that includes this.

[2116] (Claim 2)

[2117] The system according to claim 1, further comprising means for reviewing and modifying the automatically generated pamphlet from a user terminal.

[2118] (Claim 3)

[2119] The system according to claim 1, further comprising means for finalizing the revised brochure and transmitting it to a terminal.

[2120] "Example 1"

[2121] (Claim 1)

[2122] A means of receiving questions and requests entered by the user via the device,

[2123] A means for analyzing the aforementioned questions and requests and extracting important keywords using natural language processing technology,

[2124] A means for searching for related information from a database based on the aforementioned important keywords,

[2125] A means for automatically generating individual brochures using a pre-configured template based on the aforementioned related information,

[2126] The means for displaying the automatically generated pamphlet on the user terminal,

[2127] A system that includes this.

[2128] (Claim 2)

[2129] The system according to claim 1, further comprising means for reviewing and modifying the automatically generated pamphlet from a user terminal.

[2130] (Claim 3)

[2131] The system according to claim 1, further comprising means for finalizing the revised brochure, generating the final version of the brochure data, and transmitting it to a terminal.

[2132] "Application Example 1"

[2133] (Claim 1)

[2134] A means of receiving questions and requests entered by the user via the device,

[2135] A means for analyzing the aforementioned questions and requests and extracting important keywords,

[2136] A means for searching for related information from a database based on the aforementioned important keywords,

[2137] A means for automatically generating individual brochures based on the aforementioned related information,

[2138] The means further includes a means for displaying the automatically generated pamphlet on a user terminal, and for confirming and correcting it.

[2139] A means for generating the final version of the revised pamphlet and transmitting it to a terminal,

[2140] A means for printing the aforementioned finalized pamphlet,

[2141] A system that includes this.

[2142] (Claim 2)

[2143] The system according to claim 1, further comprising means for receiving the aforementioned questions and requests via an electronic terminal in the store.

[2144] (Claim 3)

[2145] The system according to claim 1, further comprising means for analyzing the aforementioned questions and requests using natural language processing technology and extracting keywords.

[2146] "Example 2 of combining an emotion engine"

[2147] (Claim 1)

[2148] A means of receiving questions and requests entered by the user via the device,

[2149] A means of collecting user sentiment data along with the aforementioned questions and requests,

[2150] A means for analyzing the aforementioned questions and requests and extracting important keywords,

[2151] A means for analyzing the aforementioned emotional data and recognizing the user's emotions,

[2152] A means for searching for related information from a database based on the aforementioned important keywords,

[2153] A means for automatically generating individual brochures that respond to the user's emotions based on the aforementioned related information,

[2154] The means for displaying the automatically generated pamphlet on the user terminal,

[2155] A system that includes this.

[2156] (Claim 2)

[2157] The system according to claim 1, further comprising means for reviewing and modifying the automatically generated pamphlet from a user terminal.

[2158] (Claim 3)

[2159] The system according to claim 1, further comprising means for finalizing the revised brochure and transmitting it to a terminal.

[2160] "Application example 2 when combining with an emotional engine"

[2161] (Claim 1)

[2162] A means of receiving questions and requests entered by the user through the device,

[2163] A means for analyzing the aforementioned questions and requests and extracting important keywords,

[2164] A means for searching for relevant information from information sources based on the aforementioned important keywords,

[2165] A means for automatically generating individual documents based on the aforementioned related information,

[2166] A means of adjusting the content and design of generated materials using an emotion engine that recognizes user emotions,

[2167] A means of displaying the generated document on the user's terminal,

[2168] A system that includes this.

[2169] (Claim 2)

[2170] The system according to claim 1, further comprising means for viewing and modifying the generated materials from a user terminal.

[2171] (Claim 3)

[2172] The system according to claim 1, further comprising means for finalizing the aforementioned revised data and transmitting it to the device. [Explanation of Symbols]

[2173] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A means of receiving questions and requests entered by the user via the device, A means for analyzing the aforementioned questions and requests and extracting important keywords, A means for searching for related information from a database based on the aforementioned important keywords, A means for automatically generating individual brochures based on the aforementioned related information, The means for displaying the automatically generated pamphlet on the user terminal, A system that includes this.

2. The system according to claim 1, further comprising means for reviewing and modifying the automatically generated pamphlet from a user terminal.

3. The system according to claim 1, further comprising means for finalizing the revised brochure and transmitting it to a terminal.

Images