system

Abstract

We provide the system. [Solution] An information management device that centrally manages and electronically provides local rule information and public information for residents, Means for collecting local rule information and public information and storing it in a database, Based on the information collected above, a means for searching for appropriate information corresponding to user input, A means for generating a response to present appropriate information to the user using the information retrieved above, A means for sending the above-generated response to the user terminal, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In a condominium, there is a problem that it is difficult for residents to quickly and accurately acquire local rules and important public information. As a result, proper garbage disposal and recognition of local events are insufficient, so troubles and information mismatches within the community are likely to occur. Also, in the case of defect handling via phone calls, there is a problem of passing the buck, leaving inconvenience for the user.

Means for Solving the Problems

[0005] This invention provides an information management device that centrally manages and electronically provides local rules and public information, enabling residents to easily and quickly obtain the information they need. Furthermore, the system searches for appropriate information based on user input and transmits the generated response to the user's terminal, providing quick and accurate answers to residents' questions, thereby eliminating information misunderstandings and inconveniences. This allows residents to smoothly adapt to their local area and community, and achieve efficient communication.

[0006] An "information management device" is a device that centrally manages local rule information and public information, and provides this information electronically to users.

[0007] "Local rules information" refers to the rules and guidelines that residents must follow in and around apartment buildings, and specifically includes information on garbage disposal schedules and noise regulations.

[0008] "Public information" refers to information related to local governments and communities, including information on events, the locations of evacuation shelters, and the use of public facilities.

[0009] A "database" is an electronic data storage system that efficiently stores collected information and allows it to be searched and retrieved as needed.

[0010] A "user terminal" is a means by which a resident accesses information management equipment and receives information from it, and includes smartphones, tablets, and dedicated information terminals.

[0011] "Means for generating responses" refers to a function that searches for appropriate information from a database based on user input and then uses that information to create a response in a format that is easy for the user to understand. [Brief explanation of the drawing]

[0012] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] This is a sequence diagram showing the processing flow of the data processing system in Example 2, which incorporates an emotion engine. [Figure 14] This is a sequence diagram showing the processing flow of the data processing system in Application Example 2, which combines an emotion engine. [Modes for carrying out the invention]

[0013] Hereinafter, an example of an embodiment of the system relating to the technology of this disclosure will be described with reference to the attached drawings.

[0014] First, the terms used in the following description will be explained.

[0015] In the following embodiments, the labeled processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0016] In the following embodiments, the labeled RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0017] In the following embodiments, the labeled storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, etc.

[0018] In the following embodiments, the labeled communication I / F (Interface) is an interface including a communication processor and an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark), etc.

[0019] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0020] [First Embodiment]

[0021] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0022] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0023] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0024] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0025] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0026] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0027] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0028] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0029] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0030] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0031] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0032] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0033] As an embodiment of this invention, an electronic information management device that provides residents with local rules and public information is described. The device includes a user terminal, a server, and a communication infrastructure. Users access information via the terminal, and the server manages the information and generates responses.

[0034] server

[0035] The server collects local rules and public information and stores it in a database. This information includes garbage collection schedules, local events, and evacuation routes in case of disaster. The server periodically updates the information via the internet, reviewing the database whenever new information is added. Furthermore, the server uses natural language processing techniques to analyze user questions and retrieve the most relevant information from the database. For example, if a user asks, "What are the local events this weekend?", the server searches the event information in the database and generates an appropriate response.

[0036] terminal

[0037] The terminal is equipped with a dedicated application that provides an interface with the user. The user can use the terminal to input questions in natural language. The terminal sends the question to the server and displays the received response on the screen. For example, if a user inputs a question to check the garbage collection information for the next day, the terminal will display the response from the server, "Tomorrow is the day for combustible waste collection."

[0038] User

[0039] Users can access the server and retrieve information using a terminal or application designated for residents. Users input questions into the terminal and plan their daily lives based on the information presented. For example, after obtaining information about local events, they can decide whether or not to participate in those events.

[0040] Thus, this invention aims to support community life by providing residents with useful local information quickly through the use of electronic information management and generation AI.

[0041] The following describes the processing flow.

[0042] Step 1:

[0043] The server collects information on apartment building rules, local events, and public institutions from local government agencies and third-party data sources, and records it in a database. This ensures that the database always contains up-to-date information.

[0044] Step 2:

[0045] The terminal automatically runs a dedicated application upon startup and provides a user interface that allows users to easily input questions.

[0046] Step 3:

[0047] Users input and submit questions through the terminal's interface. For example, they can ask questions like, "What type of garbage should I put out tomorrow?"

[0048] Step 4:

[0049] The terminal sends a question message from the user to the server. This message contains the question entered by the user.

[0050] Step 5:

[0051] The server uses natural language processing to analyze the received question and understand the user's intent. In this process, it identifies the information category to search based on the question.

[0052] Step 6:

[0053] The server searches the database for relevant information based on the analysis results. For example, if it needs information about "burnable waste collection days," it will refer to data where Tuesday and Friday are specified.

[0054] Step 7:

[0055] The server generates a response to the user in the appropriate format based on the search results. For example, it might create a response such as, "Tomorrow is the day for burnable waste collection."

[0056] Step 8:

[0057] The server sends the generated response to the terminal. This response is formatted to be clear and easy for the user to understand.

[0058] Step 9:

[0059] The terminal displays the response received from the server to the user. The user confirms the response on the screen.

[0060] Step 10:

[0061] Based on the information provided, users plan and execute necessary actions. For example, they can plan to take out the trash on the appropriate day or to participate in an event.

[0062] (Example 1)

[0063] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0064] In modern society, local rules and public information are provided from numerous sources, making it difficult for residents to quickly and accurately obtain the information they need. Therefore, there is a need for means that enable real-time information updates and information utilization. In particular, providing the most relevant answers to user questions from a vast amount of information is a challenge.

[0065] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0066] In this invention, the server includes means for collecting local regulations and public information and storing it in a data storage device, means for analyzing user input using natural language processing technology and searching for relevant information, and means for generating responses to present appropriate information to the user using generative AI technology. This enables information retrieval and information provision that responds immediately to the user's needs.

[0067] A "resident" refers to an individual who lives within a specific area and is involved with the rules and public information of that area.

[0068] "Local regulations information" refers to information that outlines the specific rules and guidelines that residents must follow in their area.

[0069] "Public information" refers to information such as events, services, and emergency response procedures that should be shared within the local community.

[0070] An "information processing system" refers to an electronic device or group of devices for centrally managing information that is collected, stored, analyzed, and presented.

[0071] A "data storage device" refers to a hardware or software configuration that maintains information over a long period and makes it accessible as needed.

[0072] "Natural language processing technology" refers to technology that enables computers to understand and analyze human language.

[0073] "Generative AI technology" refers to technology that uses artificial intelligence to generate responses in natural language to human instructions and questions.

[0074] "User terminal" refers to a computer or personal information terminal used by a user to access information and input data.

[0075] "Response" refers to a formalized reply of information provided in response to a user's question or request.

[0076] The server plays a central role in the information processing system, collecting local regulations and public information and storing it in a data storage device. The server periodically retrieves data released by local governments and public institutions via the internet. This collection process is automated, ensuring that the latest information is always reflected in the database. The collected information is analyzed using natural language processing and generative AI technologies employed in this invention and used to prepare appropriate responses to user inquiries.

[0077] The terminal functions as an interface for users to access the system. It provides a platform for users to input natural language questions and sends this input to the server. The terminal is equipped with a dedicated application that receives the user's questions as text data through the user interface and quickly sends it to the server.

[0078] Users can obtain everyday local information through their devices. For example, to find out about garbage collection schedules or local events, users can input questions such as "When is the next day for combustible waste collection?" into their devices. This question is then compared with relevant information in the database, and the optimal response is generated by an AI model.

[0079] By using a generative AI model, the system constructs natural and easy-to-understand responses to user questions. A concrete example of a prompt would be, "Generate a natural response to the user's question using appropriate local event information." This prompt allows the AI ​​model to appropriately set the content and tone of the response.

[0080] As described above, specific embodiments of this invention enable users to easily obtain important local information and utilize it in their daily lives.

[0081] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0082] Step 1:

[0083] The server periodically collects local regulations and public information via the internet. Data sources include municipal open data portals and public institution websites. It uses URLs and API endpoints as input, converts the obtained data format, and stores it in data storage. This ensures that the database always contains the most up-to-date information.

[0084] Step 2:

[0085] The user enters a question through an application on their device. For example, a question like "When is the next day for combustible waste collection?" might be entered in text format. The device sends this input to the server. The output is text data sent to the server via the device.

[0086] Step 3:

[0087] The server analyzes the received text-based questions using natural language processing techniques. It receives text data as input and extracts keywords and intent. Based on this, it searches the database and identifies relevant information. For example, it might extract the next garbage collection date from the keyword "burnable waste." The output is the query result related to the user's request.

[0088] Step 4:

[0089] The server uses an AI model to generate natural language responses from the extracted information. The prompt is "Please provide appropriate information in natural language to answer the user's question." The input consists of database query results and the prompt, and the output is a response in a user-friendly format.

[0090] Step 5:

[0091] The terminal receives responses sent from the server and presents them to the user. The input is response data from the server, and the output is a natural language response displayed on the terminal's screen. For example, it might display "The next day for combustible waste collection is Wednesday," and the user can confirm this information.

[0092] (Application Example 1)

[0093] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0094] In modern society, the information users need in local communities and commercial facilities is diverse. There is a need to efficiently obtain information on local events and store operations to improve the quality of users' daily lives. However, there is a challenge in the lack of means to provide this information in a timely and accurate manner.

[0095] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0096] In this invention, the server includes means for collecting local event information, store operating information, and public information and storing it in an information storage device; means for searching for appropriate information corresponding to user input based on the collected information; and means for generating a response to present appropriate information to the user using the searched information. This enables users to quickly obtain the information they need and enjoy a fulfilling local life and shopping experience.

[0097] "Residents and visitors" refers to people who regularly visit a specific area or commercial facility, and is a general term for users to whom local and commercial information is provided.

[0098] "Local event information" refers to information about events, festivals, gatherings, etc., held in a specific region.

[0099] "Store operating information" refers to information regarding the operating hours, special sales, campaigns, and other business-related information of commercial facilities and stores.

[0100] "Public information" refers to information related to public affairs, such as traffic directions, emergency evacuation routes, and notices from local government.

[0101] An "information storage device" refers to a hardware or software system for electronically holding and storing data, and functions as a database.

[0102] "User information terminal" refers to a smartphone, tablet, or other electronic device used by residents and customers, and is used for receiving and displaying information.

[0103] "Electronic computer equipment" refers to a computer system used for data processing, and includes servers and related peripheral devices.

[0104] To implement this invention, a server is required for efficiently collecting and managing local event information, store operating information, and public information, as well as user terminals for providing this information. The server collects various information about local communities and commercial facilities and stores it in an information storage device. The collected information is used to search for and generate responses with optimal information in response to user input, utilizing a generative AI model equipped with natural language processing technology.

[0105] The server is programmed using the Python language, and its API interface is built using the Flask framework. Database management uses RDBMS such as MySQL® or PostgreSQL. Natural language processing is handled using Python's NLTK and spaCy libraries.

[0106] On the other hand, the user's device is a smartphone or tablet, running an application developed with React Native. This application retrieves data from the server via a RESTful API and displays it in the user interface. Users can input questions in natural language and use that information to plan their daily lives.

[0107] As a concrete example, when a user enters "What events are happening near me this weekend?" into their smartphone app, the server searches for event information in that area and sends the appropriate event information back to the user's device. This information provides the user with the necessary information to make informed decisions. An example of a prompt to the generating AI model is "Please tell me about local events this weekend."

[0108] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0109] Step 1:

[0110] The server collects local event information, store operating information, and public information from the internet. The server retrieves this data via an API and stores it in a database. The input is information retrieved from the Web API, and the output is structured data stored in the database.

[0111] Step 2:

[0112] The user opens an application on their device and enters a natural language question related to the information they want to know. An example of this input is "Please tell me about events happening nearby this weekend." The input is text data from the user, and the output is that same text data.

[0113] Step 3:

[0114] The terminal retrieves the user's question and sends it to the server. The terminal sends this question to the server as an API request. The input is the user's question text, and the output is structured data as an API request.

[0115] Step 4:

[0116] The server analyzes the received question using natural language processing techniques. It extracts the meaning of the question using a generative AI model and generates a search query for relevant information. The input is the user's question text, and the output is the search query.

[0117] Step 5:

[0118] The server searches the database using the generated search query and extracts the relevant information. It retrieves related event and sales information and generates a response based on it. The input is the search query, and the output is a dataset of the information found.

[0119] Step 6:

[0120] The server constructs a response to the user based on the extracted information and generates the response using an appropriate representation based on a generative AI model. The input is a dataset, and the output is the response text.

[0121] Step 7:

[0122] The server sends the generated response to the terminal. The terminal displays the received response in its user interface. The input is the response text from the server, and the output is the display information that can be visually confirmed by the user.

[0123] Step 8:

[0124] Based on the information displayed on the device, users can decide on actions such as participating in local events or visiting stores. The input is the information the user receives, and the output is the user's action plan.

[0125] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0126] This invention provides an information management device that not only allows residents to efficiently acquire local rule information and public information, but also understands the user's emotions and generates and presents responses based on those emotions. The system includes a server, a user terminal, and an emotion engine for analyzing emotions.

[0127] server:

[0128] The server collects local rules and public information, stores it in a database, and retrieves appropriate information and generates responses based on questions from the user's terminal. The server also works with an emotion engine to analyze the emotions contained in the user's input. For example, if a user expresses a strong desire to know more, the server will provide detailed information accordingly.

[0129] Terminal:

[0130] The terminal runs a dedicated application and provides an interface that allows users to easily input questions. When a user requests information, the entered text is sent to the server, and the received response is displayed. Furthermore, the terminal adjusts the tone and content of the information presentation according to the user's emotions, which are analyzed by an emotion engine. For example, if the user is feeling anxious, the information can be displayed using more relaxing language.

[0131] User:

[0132] Users input questions in natural language using their devices and receive answers from the server. If the user's input includes emotions, the emotion engine analyzes those emotions and provides information in the most appropriate format for the user. For example, if a user provides input suggesting urgency, the emotion engine recognizes that emotion and helps provide urgent information quickly and clearly.

[0133] This system allows residents to quickly obtain necessary information and receive information in a sensitive and emotionally resonant manner, enabling them to adapt to their local community with greater confidence.

[0134] The following describes the processing flow.

[0135] Step 1:

[0136] The server collects shared rules and public information from local government agencies and relevant data sources and stores it in a database. This information includes things like garbage collection schedules and local event information.

[0137] Step 2:

[0138] When the terminal is powered on, it automatically runs a dedicated application and displays a user-friendly interface for entering questions.

[0139] Step 3:

[0140] The user uses the terminal's interface to input a question and a sentence expressing their feelings at that moment, and then sends it. For example, they might input, "What's tomorrow's trash collection day? I'm a little worried."

[0141] Step 4:

[0142] The terminal sends a message to the server containing questions and emotions from the user. This message includes text data as user input.

[0143] Step 5:

[0144] The server analyzes the received question using natural language processing to interpret the information the user is seeking. Furthermore, it uses an emotion engine to analyze the user's emotions from the input text.

[0145] Step 6:

[0146] The server searches the database for appropriate information based on the analysis results. During this process, the presentation and content of the information are adjusted based on the emotional analysis results. For example, if anxiety is detected, the information is rearranged to provide a sense of reassurance.

[0147] Step 7:

[0148] The server generates a response to the user based on the searched information and sentiment analysis results. For example, it might create a response such as, "Tomorrow is trash day. Don't worry."

[0149] Step 8:

[0150] The server sends the generated response to the terminal. This response contains information that is easy for the user to understand and that resonates with their emotions.

[0151] Step 9:

[0152] The terminal displays the response received from the server on its screen, providing the user with visual information.

[0153] Step 10:

[0154] Users check the information displayed on their device screen and plan and execute actions according to their emotions and circumstances. For example, taking out the trash on the right day can alleviate anxiety.

[0155] (Example 2)

[0156] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0157] Modern residents are expected to quickly grasp and appropriately utilize a wide variety of information and regulations concerning their community. However, if the methods of information collection and provision are inadequate, residents may not be able to obtain the necessary information quickly and may experience difficulties in adapting to their community. Furthermore, if information is provided without considering the feelings of the residents, it may cause anxiety and stress. Therefore, a system is needed that enables residents to efficiently obtain local regulations and public information and receive it in a way that takes their feelings into consideration.

[0158] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0159] In this invention, the server includes means for collecting local regulations and public information and storing it in a data set; means for analyzing emotions using an emotion analysis mechanism for detecting emotions contained in user input; and means for retrieving appropriate information corresponding to user input based on the collected information and emotion analysis. This enables residents to quickly obtain necessary local information in an emotion-sensitive manner.

[0160] "Local rules" refer to official or informal policies or practices that residents of a particular area are expected to follow.

[0161] "Public information" refers to important data and information related to a region that is made public to local residents and the general public.

[0162] An "information processing system" refers to a device or system equipped with a set of functions and equipment for processing, storing, and analyzing collected data and using it according to a specific purpose.

[0163] A "data collection" refers to a computer-based storage system where diverse information and data are accumulated and stored in an organized manner.

[0164] An "emotion analysis mechanism" refers to analytical tools and algorithms used to extract and classify emotions from input natural language data.

[0165] A "user terminal" refers to a device that communicates with an information processing system and is directly operated by the user, such as a smartphone or computer.

[0166] A "user interface" refers to the part of a system that provides screens and operating mechanisms for interaction between a user and a machine.

[0167] A "computer device" refers to a platform that has the capability to process digital information and run various applications.

[0168] This invention is an information processing system that effectively provides local and public information and enables information presentation that takes user emotions into consideration. The system mainly consists of a server, user terminals, and emotion analysis functions.

[0169] The server collects local regulations and public information and stores it in a database for centralized management. Data collection could utilize web scraping techniques or APIs to update the information in real time. The server also runs algorithms, including sentiment analysis capabilities, to analyze the emotions associated with natural language input data submitted by users.

[0170] The user terminal runs a dedicated application and provides an interface that allows the user to input questions using natural language. This application sends the user's input to a server and receives and displays the response from the server. Based on sentiment analysis results, the user interface adjusts the way information is presented and its tone to ensure that information is delivered in a way that is most appropriate for the user.

[0171] Users obtain the necessary information by entering questions in natural language through their devices. Because this system takes emotions into consideration, the information provided adapts to the user's feelings, resulting in a more satisfying information retrieval experience. For example, if a user asks, "I want to know more about the garbage disposal rules in my neighborhood," and also expresses the emotion of "I'm a little anxious because I'm living in a new place for the first time," the server will provide detailed information while displaying it in a relaxing tone.

[0172] Examples of prompt messages include the following:

[0173] "I've moved to a new area. I'd like to know more about things like how to dispose of garbage and the rules for getting along with neighbors. I'm a little worried."

[0174] In this way, this information processing system achieves efficient information delivery and an emotionally sensitive user experience.

[0175] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0176] Step 1:

[0177] Users input questions in natural language through an interface on their user terminal. The input may sometimes request specific information about local regulations. This input includes the user's question and their feelings at the time. For example, they might input, "I want to know about a local event; I'm nervous because it's my first time."

[0178] Step 2:

[0179] The terminal converts user input into digital data and transmits it to the server via the internet. The user's questions and their sentiment data become the basis for processing on the server. Specific operations involved in data transmission include secure data transfer using SSL communication.

[0180] Step 3:

[0181] The server passes the received digital data to the emotion analysis mechanism for emotion analysis. The analysis results in the quantification or classification of emotions contained in the user's questions. For example, the emotion analysis algorithm might detect the emotion "tension," and its intensity would be expressed numerically.

[0182] Step 4:

[0183] The server searches the database for relevant information based on sentiment analysis results and user questions. It extracts collected local event information, rule information, etc., and filters and sorts them as needed. As output, a set of important information tailored to the user's interests is generated.

[0184] Step 5:

[0185] The server generates user-optimized responses based on analyzed sentiment data and search results. Generative AI models are used to construct response sentences with appropriate tone and content. Specific operations include template-based response generation and the use of natural language generation technologies.

[0186] Step 6:

[0187] The server sends the generated response to the terminal. The transmitted data is converted into a format viewable on the user's terminal. The transmission process again uses SSL communication to ensure data security.

[0188] Step 7:

[0189] The terminal displays the response received from the server to the user. The user interface presents information in an emotionally sensitive manner, reassuring the user by including phrases such as "Please relax and enjoy." The displayed information is designed to be visually easy to understand and easy to operate.

[0190] (Application Example 2)

[0191] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0192] In local communities, there is a challenge in that residents have difficulty quickly obtaining the local rules and public information they need. Furthermore, because information is not provided with consideration for the feelings of individual users, understanding and use of the information is hindered. Therefore, it is necessary to provide information while conducting sentiment analysis to create information services that are valuable to users.

[0193] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0194] In this invention, the server includes a device for collecting local rule data and public data and storing it in a data storage unit, a device for searching for appropriate data in response to user input, and a device for identifying emotions included in user input using an emotion analysis function. This makes it possible to provide information to users in local communities that takes individual emotions into consideration.

[0195] "Resident" refers to a person who lives in a specific area or community.

[0196] "Regional regulations data" refers to a collection of data that aggregates information about rules and guidelines in a specific region.

[0197] "Public data" refers to a collection of publicly available information provided by public institutions and local communities.

[0198] A "data management system" is a system designed to centralize various types of data and manage and provide them efficiently.

[0199] A "data storage unit" is a storage device or storage medium that stores collected data and allows access to it as needed.

[0200] "Users" refers to ordinary people who use this system to obtain information.

[0201] The "emotion analysis function" is a function that captures and understands human emotions based on input such as text and voice.

[0202] "Information provision" refers to conveying information to users in an appropriate format based on searched data and analysis results.

[0203] This invention is a data management system for efficiently managing various regional rule data and public data, and for providing useful information tailored to the user's needs. The server can collect specific regional rule data and public data and store it in a data storage unit. Users can input information in natural language through smart devices or in-store interfaces.

[0204] The server is equipped with sentiment analysis capabilities to identify the user's emotions as reflected in their input. This sentiment analysis utilizes software libraries capable of natural language processing, such as BERT or APIs specifically designed for sentiment analysis. Based on the identified emotions and the user's input, the server efficiently searches for useful information and generates a response to provide that information to the user's terminal in the most optimal format.

[0205] The terminal displays the response received from the server on the user interface. If the user expresses an emotion seeking relaxation, the terminal presents information in a calm tone; if the emotion suggests urgency, it highlights important information in a quick and clear format. For example, if a user looking for the latest promotional information at a supermarket shows impatience, the terminal makes it easier to obtain information and reduces stress by concisely presenting the target products and discount rates.

[0206] This allows residents in local communities to receive more efficient and emotionally sensitive information, thereby improving their quality of life.

[0207] Examples of prompts to input into a generative AI model:

[0208] "Consider the following customer question, identify their emotion, and generate a response that provides appropriate information. Customer Question: 'I want to know about the latest promotions.' Customer Emotion: 'Excited'"

[0209] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0210] Step 1:

[0211] The user inputs the information they want to retrieve using natural language via their smart device. The input is sent to the device as text data.

[0212] Step 2:

[0213] The terminal sends the input text to the server and requests sentiment analysis. The input includes the user's current question, and the output generates preparation data for sentiment analysis.

[0214] Step 3:

[0215] The server uses sentiment analysis capabilities based on the received text data to determine the user's emotions. For example, it uses BERT as a natural language processing tool to analyze whether the user's input indicates emotions such as "surprise" or "anxiety."

[0216] Step 4:

[0217] The server searches for appropriate information from local rule data and public databases based on sentiment analysis results and input content, and generates the optimal response. Database searches and generation AI models are used to process the information using specific prompt sentences.

[0218] Step 5:

[0219] The server sends the generated response data to the terminal. This data includes the information to be presented to the user and how it should be presented.

[0220] Step 6:

[0221] The terminal displays response data received from the server on the user interface. It provides information in a tone that matches the user's emotions, aiding in information comprehension.

[0222] Step 7:

[0223] The user can cyclically deepen their understanding of the information by reviewing the displayed responses and, if necessary, entering further questions. After re-entering information, the process returns to step 1, and information is provided through natural conversation, as shown in the example prompt.

[0224] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0225] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0226] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0227] [Second Embodiment]

[0228] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0229] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0230] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0231] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0232] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0233] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0234] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0235] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0236] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0237] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0238] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0239] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0240] As an embodiment of this invention, an electronic information management device that provides residents with local rules and public information is described. The device includes a user terminal, a server, and a communication infrastructure. Users access information via the terminal, and the server manages the information and generates responses.

[0241] server

[0242] The server collects local rules and public information and stores it in a database. This information includes garbage collection schedules, local events, and evacuation routes in case of disaster. The server periodically updates the information via the internet, reviewing the database whenever new information is added. Furthermore, the server uses natural language processing techniques to analyze user questions and retrieve the most relevant information from the database. For example, if a user asks, "What are the local events this weekend?", the server searches the event information in the database and generates an appropriate response.

[0243] terminal

[0244] The terminal is equipped with a dedicated application that provides an interface with the user. The user can use the terminal to input questions in natural language. The terminal sends the question to the server and displays the received response on the screen. For example, if a user inputs a question to check the garbage collection information for the next day, the terminal will display the response from the server, "Tomorrow is the day for combustible waste collection."

[0245] User

[0246] Users can access the server and retrieve information using a terminal or application designated for residents. Users input questions into the terminal and plan their daily lives based on the information presented. For example, after obtaining information about local events, they can decide whether or not to participate in those events.

[0247] Thus, this invention aims to support community life by providing residents with useful local information quickly through the use of electronic information management and generation AI.

[0248] The following describes the processing flow.

[0249] Step 1:

[0250] The server collects information on apartment building rules, local events, and public institutions from local government agencies and third-party data sources, and records it in a database. This ensures that the database always contains up-to-date information.

[0251] Step 2:

[0252] The terminal automatically runs a dedicated application upon startup and provides a user interface that allows users to easily input questions.

[0253] Step 3:

[0254] Users input and submit questions through the terminal's interface. For example, they can ask questions like, "What type of garbage should I put out tomorrow?"

[0255] Step 4:

[0256] The terminal sends a question message from the user to the server. This message contains the question entered by the user.

[0257] Step 5:

[0258] The server uses natural language processing to analyze the received question and understand the user's intent. In this process, it identifies the information category to search based on the question.

[0259] Step 6:

[0260] The server searches the database for relevant information based on the analysis results. For example, if it needs information about "burnable waste collection days," it will refer to data where Tuesday and Friday are specified.

[0261] Step 7:

[0262] The server generates a response to the user in the appropriate format based on the search results. For example, it might create a response such as, "Tomorrow is the day for burnable waste collection."

[0263] Step 8:

[0264] The server sends the generated response to the terminal. This response is formatted to be clear and easy for the user to understand.

[0265] Step 9:

[0266] The terminal displays the response received from the server to the user. The user confirms the response on the screen.

[0267] Step 10:

[0268] Based on the information provided, users plan and execute necessary actions. For example, they can plan to take out the trash on the appropriate day or to participate in an event.

[0269] (Example 1)

[0270] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0271] In modern society, local rules and public information are provided from numerous sources, making it difficult for residents to quickly and accurately obtain the information they need. Therefore, there is a need for means that enable real-time information updates and information utilization. In particular, providing the most relevant answers to user questions from a vast amount of information is a challenge.

[0272] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0273] In this invention, the server includes means for collecting local regulations and public information and storing it in a data storage device, means for analyzing user input using natural language processing technology and searching for relevant information, and means for generating responses to present appropriate information to the user using generative AI technology. This enables information retrieval and information provision that responds immediately to the user's needs.

[0274] A "resident" refers to an individual who lives within a specific area and is involved with the rules and public information of that area.

[0275] "Local regulations information" refers to information that outlines the specific rules and guidelines that residents must follow in their area.

[0276] "Public information" refers to information such as events, services, and emergency response procedures that should be shared within the local community.

[0277] An "information processing system" refers to an electronic device or group of devices for centrally managing information that is collected, stored, analyzed, and presented.

[0278] A "data storage device" refers to a hardware or software configuration that maintains information over a long period and makes it accessible as needed.

[0279] "Natural language processing technology" refers to technology that enables computers to understand and analyze human language.

[0280] "Generative AI technology" refers to technology that uses artificial intelligence to generate responses in natural language to human instructions and questions.

[0281] "User terminal" refers to a computer or personal information terminal used by a user to access information and input data.

[0282] "Response" refers to a formalized reply of information provided in response to a user's question or request.

[0283] The server plays a central role in the information processing system, collects regional regulation information and public information, and stores them in the data storage device. The server periodically obtains data publicly released from local governments and public institutions via the Internet. This collection work is automated so that the latest information is always reflected in the database. The collected information is analyzed by the natural language processing technology and generative AI technology used in the present invention and is used to prepare an appropriate response to questions from users.

[0284] The terminal functions as an interface for the user to access the system. It provides a platform for the user to input natural language questions and sends this input to the server. The terminal is equipped with a dedicated application, which receives the user's question as text data through the user interface and quickly sends it to the server.

[0285] Users can obtain daily regional information through their terminals. For example, when trying to obtain the schedule of garbage collection or regional event information, the user can input a question such as "When is the next day for burnable garbage?" into the terminal. This question is compared with the corresponding information in the database, and an optimal response is created by the generative AI model.

[0286] By using the generative AI model, the system constructs a natural and easy-to-understand response to the user's question. An example of a specific prompt sentence is "Please generate a natural response using appropriate regional event information for the user's question." With this prompt sentence, the AI model can appropriately set the content and tone of the answer.

[0287] As described above, according to the specific embodiment of this invention, users can easily obtain important regional information and utilize it in their daily lives.

[0288] The flow of the specific process in Example 1 will be described using FIG. 11.

[0289] Step 1:

[0290] The server periodically collects local regulations and public information via the internet. Data sources include municipal open data portals and public institution websites. It uses URLs and API endpoints as input, converts the obtained data format, and stores it in data storage. This ensures that the database always contains the most up-to-date information.

[0291] Step 2:

[0292] The user enters a question through an application on their device. For example, a question like "When is the next day for combustible waste collection?" might be entered in text format. The device sends this input to the server. The output is text data sent to the server via the device.

[0293] Step 3:

[0294] The server analyzes the received text-based questions using natural language processing techniques. It receives text data as input and extracts keywords and intent. Based on this, it searches the database and identifies relevant information. For example, it might extract the next garbage collection date from the keyword "burnable waste." The output is the query result related to the user's request.

[0295] Step 4:

[0296] The server uses an AI model to generate natural language responses from the extracted information. The prompt is "Please provide appropriate information in natural language to answer the user's question." The input consists of database query results and the prompt, and the output is a response in a user-friendly format.

[0297] Step 5:

[0298] The terminal receives responses sent from the server and presents them to the user. The input is response data from the server, and the output is a natural language response displayed on the terminal's screen. For example, it might display "The next day for combustible waste collection is Wednesday," and the user can confirm this information.

[0299] (Application Example 1)

[0300] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0301] In modern society, the information users need in local communities and commercial facilities is diverse. There is a need to efficiently obtain information on local events and store operations to improve the quality of users' daily lives. However, there is a challenge in the lack of means to provide this information in a timely and accurate manner.

[0302] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0303] In this invention, the server includes means for collecting local event information, store operating information, and public information and storing it in an information storage device; means for searching for appropriate information corresponding to user input based on the collected information; and means for generating a response to present appropriate information to the user using the searched information. This enables users to quickly obtain the information they need and enjoy a fulfilling local life and shopping experience.

[0304] "Residents and visitors" refers to people who regularly visit a specific area or commercial facility, and is a general term for users to whom local and commercial information is provided.

[0305] "Local event information" refers to information about events, festivals, gatherings, etc., held in a specific region.

[0306] "Store business information" refers to information related to business hours, special sales, campaigns, and other operations of commercial facilities and stores.

[0307] "Public information" refers to information related to the public, such as traffic guides, emergency evacuation routes, and notifications from local administrations.

[0308] "Information storage device" refers to a hardware or software system for electronically holding and storing data, which functions as a database.

[0309] "User information terminal" refers to smartphones, tablets, or other electronic devices used by residents and visitors, which are used for receiving and displaying information.

[0310] "Computer device" refers to a computer system for data processing, including servers and related peripheral devices.

[0311] To implement this invention, a server for efficiently collecting and managing regional event information, store business information, and public information, and a user terminal for providing information are required. The server collects various information related to the local community and commercial facilities and stores this in an information storage device. The collected information is utilized to search for and generate optimal information in response to user input by using a generative AI model equipped with natural language processing technology.

[0312] The server is programmed using the Python language, and an API interface is constructed by the Flask framework. For database management, RDBMS such as MySQL and PostgreSQL are used. For natural language processing, Python's NLTK and spaCy libraries are used.

[0313] On the other hand, the user's device is a smartphone or tablet, running an application developed with React Native. This application retrieves data from the server via a RESTful API and displays it in the user interface. Users can input questions in natural language and use that information to plan their daily lives.

[0314] As a concrete example, when a user enters "What events are happening near me this weekend?" into their smartphone app, the server searches for event information in that area and sends the appropriate event information back to the user's device. This information provides the user with the necessary information to make informed decisions. An example of a prompt to the generating AI model is "Please tell me about local events this weekend."

[0315] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0316] Step 1:

[0317] The server collects local event information, store operating information, and public information from the internet. The server retrieves this data via an API and stores it in a database. The input is information retrieved from the Web API, and the output is structured data stored in the database.

[0318] Step 2:

[0319] The user opens an application on their device and enters a natural language question related to the information they want to know. An example of this input is "Please tell me about events happening nearby this weekend." The input is text data from the user, and the output is that same text data.

[0320] Step 3:

[0321] The terminal retrieves the user's question and sends it to the server. The terminal sends this question to the server as an API request. The input is the user's question text, and the output is structured data as an API request.

[0322] Step 4:

[0323] The server analyzes the received question using natural language processing techniques. It extracts the meaning of the question using a generative AI model and generates a search query for relevant information. The input is the user's question text, and the output is the search query.

[0324] Step 5:

[0325] The server searches the database using the generated search query and extracts the relevant information. It retrieves related event and sales information and generates a response based on it. The input is the search query, and the output is a dataset of the information found.

[0326] Step 6:

[0327] The server constructs a response to the user based on the extracted information and generates the response using an appropriate representation based on a generative AI model. The input is a dataset, and the output is the response text.

[0328] Step 7:

[0329] The server sends the generated response to the terminal. The terminal displays the received response in its user interface. The input is the response text from the server, and the output is the display information that can be visually confirmed by the user.

[0330] Step 8:

[0331] Based on the information displayed on the device, users can decide on actions such as participating in local events or visiting stores. The input is the information the user receives, and the output is the user's action plan.

[0332] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0333] This invention provides an information management device that not only allows residents to efficiently acquire local rule information and public information, but also understands the user's emotions and generates and presents responses based on those emotions. The system includes a server, a user terminal, and an emotion engine for analyzing emotions.

[0334] server:

[0335] The server collects local rules and public information, stores it in a database, and retrieves appropriate information and generates responses based on questions from the user's terminal. The server also works with an emotion engine to analyze the emotions contained in the user's input. For example, if a user expresses a strong desire to know more, the server will provide detailed information accordingly.

[0336] Terminal:

[0337] The terminal runs a dedicated application and provides an interface that allows users to easily input questions. When a user requests information, the entered text is sent to the server, and the received response is displayed. Furthermore, the terminal adjusts the tone and content of the information presentation according to the user's emotions, which are analyzed by an emotion engine. For example, if the user is feeling anxious, the information can be displayed using more relaxing language.

[0338] User:

[0339] Users input questions in natural language using their devices and receive answers from the server. If the user's input includes emotions, the emotion engine analyzes those emotions and provides information in the most appropriate format for the user. For example, if a user provides input suggesting urgency, the emotion engine recognizes that emotion and helps provide urgent information quickly and clearly.

[0340] This system allows residents to quickly obtain necessary information and receive information in a sensitive and emotionally resonant manner, enabling them to adapt to their local community with greater confidence.

[0341] The following describes the processing flow.

[0342] Step 1:

[0343] The server collects shared rules and public information from local government agencies and relevant data sources and stores it in a database. This information includes things like garbage collection schedules and local event information.

[0344] Step 2:

[0345] When the terminal is powered on, it automatically runs a dedicated application and displays a user-friendly interface for entering questions.

[0346] Step 3:

[0347] The user uses the terminal's interface to input a question and a sentence expressing their feelings at that moment, and then sends it. For example, they might input, "What's tomorrow's trash collection day? I'm a little worried."

[0348] Step 4:

[0349] The terminal sends a message to the server containing questions and emotions from the user. This message includes text data as user input.

[0350] Step 5:

[0351] The server analyzes the received question using natural language processing to interpret the information the user is seeking. Furthermore, it uses an emotion engine to analyze the user's emotions from the input text.

[0352] Step 6:

[0353] The server searches the database for appropriate information based on the analysis results. During this process, the presentation and content of the information are adjusted based on the emotional analysis results. For example, if anxiety is detected, the information is rearranged to provide a sense of reassurance.

[0354] Step 7:

[0355] The server generates a response to the user based on the searched information and sentiment analysis results. For example, it might create a response such as, "Tomorrow is trash day. Don't worry."

[0356] Step 8:

[0357] The server sends the generated response to the terminal. This response contains information that is easy for the user to understand and that resonates with their emotions.

[0358] Step 9:

[0359] The terminal displays the response received from the server on its screen, providing the user with visual information.

[0360] Step 10:

[0361] Users check the information displayed on their device screen and plan and execute actions according to their emotions and circumstances. For example, taking out the trash on the right day can alleviate anxiety.

[0362] (Example 2)

[0363] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0364] Modern residents are expected to quickly grasp and appropriately utilize a wide variety of information and regulations concerning their community. However, if the methods of information collection and provision are inadequate, residents may not be able to obtain the necessary information quickly and may experience difficulties in adapting to their community. Furthermore, if information is provided without considering the feelings of the residents, it may cause anxiety and stress. Therefore, a system is needed that enables residents to efficiently obtain local regulations and public information and receive it in a way that takes their feelings into consideration.

[0365] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0366] In this invention, the server includes means for collecting local regulations and public information and storing it in a data set; means for analyzing emotions using an emotion analysis mechanism for detecting emotions contained in user input; and means for retrieving appropriate information corresponding to user input based on the collected information and emotion analysis. This enables residents to quickly obtain necessary local information in an emotion-sensitive manner.

[0367] "Local rules" refer to official or informal policies or practices that residents of a particular area are expected to follow.

[0368] "Public information" refers to important data and information related to a region that is made public to local residents and the general public.

[0369] An "information processing system" refers to a device or system equipped with a set of functions and equipment for processing, storing, and analyzing collected data and using it according to a specific purpose.

[0370] A "data collection" refers to a computer-based storage system where diverse information and data are accumulated and stored in an organized manner.

[0371] An "emotion analysis mechanism" refers to analytical tools and algorithms used to extract and classify emotions from input natural language data.

[0372] A "user terminal" refers to a device that communicates with an information processing system and is directly operated by the user, such as a smartphone or computer.

[0373] A "user interface" refers to the part of a system that provides screens and operating mechanisms for interaction between a user and a machine.

[0374] A "computer device" refers to a platform that has the capability to process digital information and run various applications.

[0375] This invention is an information processing system that effectively provides local and public information and enables information presentation that takes user emotions into consideration. The system mainly consists of a server, user terminals, and emotion analysis functions.

[0376] The server collects local regulations and public information and stores it in a database for centralized management. Data collection could utilize web scraping techniques or APIs to update the information in real time. The server also runs algorithms, including sentiment analysis capabilities, to analyze the emotions associated with natural language input data submitted by users.

[0377] The user terminal runs a dedicated application and provides an interface that allows the user to input questions using natural language. This application sends the user's input to a server and receives and displays the response from the server. Based on sentiment analysis results, the user interface adjusts the way information is presented and its tone to ensure that information is delivered in a way that is most appropriate for the user.

[0378] Users obtain the necessary information by entering questions in natural language through their devices. Because this system takes emotions into consideration, the information provided adapts to the user's feelings, resulting in a more satisfying information retrieval experience. For example, if a user asks, "I want to know more about the garbage disposal rules in my neighborhood," and also expresses the emotion of "I'm a little anxious because I'm living in a new place for the first time," the server will provide detailed information while displaying it in a relaxing tone.

[0379] Examples of prompt messages include the following:

[0380] "I've moved to a new area. I'd like to know more about things like how to dispose of garbage and the rules for getting along with neighbors. I'm a little worried."

[0381] In this way, this information processing system achieves efficient information delivery and an emotionally sensitive user experience.

[0382] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0383] Step 1:

[0384] Users input questions in natural language through an interface on their user terminal. The input may sometimes request specific information about local regulations. This input includes the user's question and their feelings at the time. For example, they might input, "I want to know about a local event; I'm nervous because it's my first time."

[0385] Step 2:

[0386] The terminal converts user input into digital data and transmits it to the server via the internet. The user's questions and their sentiment data become the basis for processing on the server. Specific operations involved in data transmission include secure data transfer using SSL communication.

[0387] Step 3:

[0388] The server passes the received digital data to the emotion analysis mechanism for emotion analysis. The analysis results in the quantification or classification of emotions contained in the user's questions. For example, the emotion analysis algorithm might detect the emotion "tension," and its intensity would be expressed numerically.

[0389] Step 4:

[0390] The server searches the database for relevant information based on sentiment analysis results and user questions. It extracts collected local event information, rule information, etc., and filters and sorts them as needed. As output, a set of important information tailored to the user's interests is generated.

[0391] Step 5:

[0392] The server generates user-optimized responses based on analyzed sentiment data and search results. Generative AI models are used to construct response sentences with appropriate tone and content. Specific operations include template-based response generation and the use of natural language generation technologies.

[0393] Step 6:

[0394] The server sends the generated response to the terminal. The transmitted data is converted into a format viewable on the user's terminal. The transmission process again uses SSL communication to ensure data security.

[0395] Step 7:

[0396] The terminal displays the response received from the server to the user. The user interface presents information in an emotionally sensitive manner, reassuring the user by including phrases such as "Please relax and enjoy." The displayed information is designed to be visually easy to understand and easy to operate.

[0397] (Application Example 2)

[0398] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0399] In local communities, there is a challenge in that residents have difficulty quickly obtaining the local rules and public information they need. Furthermore, because information is not provided with consideration for the feelings of individual users, understanding and use of the information is hindered. Therefore, it is necessary to provide information while conducting sentiment analysis to create information services that are valuable to users.

[0400] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0401] In this invention, the server includes a device for collecting local rule data and public data and storing it in a data storage unit, a device for searching for appropriate data in response to user input, and a device for identifying emotions included in user input using an emotion analysis function. This makes it possible to provide information to users in local communities that takes individual emotions into consideration.

[0402] "Resident" refers to a person who lives in a specific area or community.

[0403] "Regional regulations data" refers to a collection of data that aggregates information about rules and guidelines in a specific region.

[0404] "Public data" refers to a collection of publicly available information provided by public institutions and local communities.

[0405] A "data management system" is a system designed to centralize various types of data and manage and provide them efficiently.

[0406] A "data storage unit" is a storage device or storage medium that stores collected data and allows access to it as needed.

[0407] "Users" refers to ordinary people who use this system to obtain information.

[0408] The "emotion analysis function" is a function that captures and understands human emotions based on input such as text and voice.

[0409] "Information provision" refers to conveying information to users in an appropriate format based on searched data and analysis results.

[0410] This invention is a data management system for efficiently managing various regional rule data and public data, and for providing useful information tailored to the user's needs. The server can collect specific regional rule data and public data and store it in a data storage unit. Users can input information in natural language through smart devices or in-store interfaces.

[0411] The server is equipped with sentiment analysis capabilities to identify the user's emotions as reflected in their input. This sentiment analysis utilizes software libraries capable of natural language processing, such as BERT or APIs specifically designed for sentiment analysis. Based on the identified emotions and the user's input, the server efficiently searches for useful information and generates a response to provide that information to the user's terminal in the most optimal format.

[0412] The terminal displays the response received from the server on the user interface. If the user expresses an emotion seeking relaxation, the terminal presents information in a calm tone; if the emotion suggests urgency, it highlights important information in a quick and clear format. For example, if a user looking for the latest promotional information at a supermarket shows impatience, the terminal makes it easier to obtain information and reduces stress by concisely presenting the target products and discount rates.

[0413] This allows residents in local communities to receive more efficient and emotionally sensitive information, thereby improving their quality of life.

[0414] Examples of prompts to input into a generative AI model:

[0415] "Consider the following customer question, identify their emotion, and generate a response that provides appropriate information. Customer Question: 'I want to know about the latest promotions.' Customer Emotion: 'Excited'"

[0416] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0417] Step 1:

[0418] The user inputs the information they want to retrieve using natural language via their smart device. The input is sent to the device as text data.

[0419] Step 2:

[0420] The terminal sends the input text to the server and requests sentiment analysis. The input includes the user's current question, and the output generates preparation data for sentiment analysis.

[0421] Step 3:

[0422] The server uses sentiment analysis capabilities based on the received text data to determine the user's emotions. For example, it uses BERT as a natural language processing tool to analyze whether the user's input indicates emotions such as "surprise" or "anxiety."

[0423] Step 4:

[0424] The server searches for appropriate information from local rule data and public databases based on sentiment analysis results and input content, and generates the optimal response. Database searches and generation AI models are used to process the information using specific prompt sentences.

[0425] Step 5:

[0426] The server sends the generated response data to the terminal. This data includes the information to be presented to the user and how it should be presented.

[0427] Step 6:

[0428] The terminal displays response data received from the server on the user interface. It provides information in a tone that matches the user's emotions, aiding in information comprehension.

[0429] Step 7:

[0430] The user can cyclically deepen their understanding of the information by reviewing the displayed responses and, if necessary, entering further questions. After re-entering information, the process returns to step 1, and information is provided through natural conversation, as shown in the example prompt.

[0431] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0432] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0433] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0434] [Third Embodiment]

[0435] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0436] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0437] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0438] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0439] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0440] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0441] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0442] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0443] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0444] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0445] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0446] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0447] As an embodiment of this invention, an electronic information management device that provides residents with local rules and public information is described. The device includes a user terminal, a server, and a communication infrastructure. Users access information via the terminal, and the server manages the information and generates responses.

[0448] server

[0449] The server collects local rules and public information and stores it in a database. This information includes garbage collection schedules, local events, and evacuation routes in case of disaster. The server periodically updates the information via the internet, reviewing the database whenever new information is added. Furthermore, the server uses natural language processing techniques to analyze user questions and retrieve the most relevant information from the database. For example, if a user asks, "What are the local events this weekend?", the server searches the event information in the database and generates an appropriate response.

[0450] terminal

[0451] The terminal is equipped with a dedicated application that provides an interface with the user. The user can use the terminal to input questions in natural language. The terminal sends the question to the server and displays the received response on the screen. For example, if a user inputs a question to check the garbage collection information for the next day, the terminal will display the response from the server, "Tomorrow is the day for combustible waste collection."

[0452] User

[0453] Users can access the server and retrieve information using a terminal or application designated for residents. Users input questions into the terminal and plan their daily lives based on the information presented. For example, after obtaining information about local events, they can decide whether or not to participate in those events.

[0454] Thus, this invention aims to support community life by providing residents with useful local information quickly through the use of electronic information management and generation AI.

[0455] The following describes the processing flow.

[0456] Step 1:

[0457] The server collects information on apartment building rules, local events, and public institutions from local government agencies and third-party data sources, and records it in a database. This ensures that the database always contains up-to-date information.

[0458] Step 2:

[0459] The terminal automatically runs a dedicated application upon startup and provides a user interface that allows users to easily input questions.

[0460] Step 3:

[0461] Users input and submit questions through the terminal's interface. For example, they can ask questions like, "What type of garbage should I put out tomorrow?"

[0462] Step 4:

[0463] The terminal sends a question message from the user to the server. This message contains the question entered by the user.

[0464] Step 5:

[0465] The server uses natural language processing to analyze the received question and understand the user's intent. In this process, it identifies the information category to search based on the question.

[0466] Step 6:

[0467] The server searches the database for relevant information based on the analysis results. For example, if it needs information about "burnable waste collection days," it will refer to data where Tuesday and Friday are specified.

[0468] Step 7:

[0469] The server generates a response to the user in the appropriate format based on the search results. For example, it might create a response such as, "Tomorrow is the day for burnable waste collection."

[0470] Step 8:

[0471] The server sends the generated response to the terminal. This response is formatted to be clear and easy for the user to understand.

[0472] Step 9:

[0473] The terminal displays the response received from the server to the user. The user confirms the response on the screen.

[0474] Step 10:

[0475] Based on the information provided, users plan and execute necessary actions. For example, they can plan to take out the trash on the appropriate day or to participate in an event.

[0476] (Example 1)

[0477] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0478] In modern society, local rules and public information are provided from numerous sources, making it difficult for residents to quickly and accurately obtain the information they need. Therefore, there is a need for means that enable real-time information updates and information utilization. In particular, providing the most relevant answers to user questions from a vast amount of information is a challenge.

[0479] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0480] In this invention, the server includes means for collecting local regulations and public information and storing it in a data storage device, means for analyzing user input using natural language processing technology and searching for relevant information, and means for generating responses to present appropriate information to the user using generative AI technology. This enables information retrieval and information provision that responds immediately to the user's needs.

[0481] A "resident" refers to an individual who lives within a specific area and is involved with the rules and public information of that area.

[0482] "Local regulations information" refers to information that outlines the specific rules and guidelines that residents must follow in their area.

[0483] "Public information" refers to information such as events, services, and emergency response procedures that should be shared within the local community.

[0484] An "information processing system" refers to an electronic device or group of devices for centrally managing information that is collected, stored, analyzed, and presented.

[0485] A "data storage device" refers to a hardware or software configuration that maintains information over a long period and makes it accessible as needed.

[0486] "Natural language processing technology" refers to technology that enables computers to understand and analyze human language.

[0487] "Generative AI technology" refers to technology that uses artificial intelligence to generate responses in natural language to human instructions and questions.

[0488] "User terminal" refers to a computer or personal information terminal used by a user to access information and input data.

[0489] "Response" refers to a formalized reply of information provided in response to a user's question or request.

[0490] The server plays a central role in the information processing system, collecting local regulations and public information and storing it in a data storage device. The server periodically retrieves data released by local governments and public institutions via the internet. This collection process is automated, ensuring that the latest information is always reflected in the database. The collected information is analyzed using natural language processing and generative AI technologies employed in this invention and used to prepare appropriate responses to user inquiries.

[0491] The terminal functions as an interface for users to access the system. It provides a platform for users to input natural language questions and sends this input to the server. The terminal is equipped with a dedicated application that receives the user's questions as text data through the user interface and quickly sends it to the server.

[0492] Users can obtain everyday local information through their devices. For example, to find out about garbage collection schedules or local events, users can input questions such as "When is the next day for combustible waste collection?" into their devices. This question is then compared with relevant information in the database, and the optimal response is generated by an AI model.

[0493] By using a generative AI model, the system constructs natural and easy-to-understand responses to user questions. A concrete example of a prompt would be, "Generate a natural response to the user's question using appropriate local event information." This prompt allows the AI ​​model to appropriately set the content and tone of the response.

[0494] As described above, specific embodiments of this invention enable users to easily obtain important local information and utilize it in their daily lives.

[0495] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0496] Step 1:

[0497] The server periodically collects local regulations and public information via the internet. Data sources include municipal open data portals and public institution websites. It uses URLs and API endpoints as input, converts the obtained data format, and stores it in data storage. This ensures that the database always contains the most up-to-date information.

[0498] Step 2:

[0499] The user enters a question through an application on their device. For example, a question like "When is the next day for combustible waste collection?" might be entered in text format. The device sends this input to the server. The output is text data sent to the server via the device.

[0500] Step 3:

[0501] The server analyzes the received text-based questions using natural language processing techniques. It receives text data as input and extracts keywords and intent. Based on this, it searches the database and identifies relevant information. For example, it might extract the next garbage collection date from the keyword "burnable waste." The output is the query result related to the user's request.

[0502] Step 4:

[0503] The server uses an AI model to generate natural language responses from the extracted information. The prompt is "Please provide appropriate information in natural language to answer the user's question." The input consists of database query results and the prompt, and the output is a response in a user-friendly format.

[0504] Step 5:

[0505] The terminal receives responses sent from the server and presents them to the user. The input is response data from the server, and the output is a natural language response displayed on the terminal's screen. For example, it might display "The next day for combustible waste collection is Wednesday," and the user can confirm this information.

[0506] (Application Example 1)

[0507] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0508] In modern society, the information users need in local communities and commercial facilities is diverse. There is a need to efficiently obtain information on local events and store operations to improve the quality of users' daily lives. However, there is a challenge in the lack of means to provide this information in a timely and accurate manner.

[0509] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0510] In this invention, the server includes means for collecting local event information, store operating information, and public information and storing it in an information storage device; means for searching for appropriate information corresponding to user input based on the collected information; and means for generating a response to present appropriate information to the user using the searched information. This enables users to quickly obtain the information they need and enjoy a fulfilling local life and shopping experience.

[0511] "Residents and visitors" refers to people who regularly visit a specific area or commercial facility, and is a general term for users to whom local and commercial information is provided.

[0512] "Local event information" refers to information about events, festivals, gatherings, etc., held in a specific region.

[0513] "Store operating information" refers to information regarding the operating hours, special sales, campaigns, and other business-related information of commercial facilities and stores.

[0514] "Public information" refers to information related to public affairs, such as traffic directions, emergency evacuation routes, and notices from local government.

[0515] An "information storage device" refers to a hardware or software system for electronically holding and storing data, and functions as a database.

[0516] "User information terminal" refers to a smartphone, tablet, or other electronic device used by residents and customers, and is used for receiving and displaying information.

[0517] "Electronic computer equipment" refers to a computer system used for data processing, and includes servers and related peripheral devices.

[0518] To implement this invention, a server is required for efficiently collecting and managing local event information, store operating information, and public information, as well as user terminals for providing this information. The server collects various information about local communities and commercial facilities and stores it in an information storage device. The collected information is used to search for and generate responses with optimal information in response to user input, utilizing a generative AI model equipped with natural language processing technology.

[0519] The server is programmed using the Python language, and its API interface is built using the Flask framework. RDBMS such as MySQL or PostgreSQL are used for database management. Natural language processing is handled using Python's NLTK and spaCy libraries.

[0520] On the other hand, the user's device is a smartphone or tablet, running an application developed with React Native. This application retrieves data from the server via a RESTful API and displays it in the user interface. Users can input questions in natural language and use that information to plan their daily lives.

[0521] As a concrete example, when a user enters "What events are happening near me this weekend?" into their smartphone app, the server searches for event information in that area and sends the appropriate event information back to the user's device. This information provides the user with the necessary information to make informed decisions. An example of a prompt to the generating AI model is "Please tell me about local events this weekend."

[0522] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0523] Step 1:

[0524] The server collects local event information, store operating information, and public information from the internet. The server retrieves this data via an API and stores it in a database. The input is information retrieved from the Web API, and the output is structured data stored in the database.

[0525] Step 2:

[0526] The user opens an application on their device and enters a natural language question related to the information they want to know. An example of this input is "Please tell me about events happening nearby this weekend." The input is text data from the user, and the output is that same text data.

[0527] Step 3:

[0528] The terminal retrieves the user's question and sends it to the server. The terminal sends this question to the server as an API request. The input is the user's question text, and the output is structured data as an API request.

[0529] Step 4:

[0530] The server analyzes the received question using natural language processing techniques. It extracts the meaning of the question using a generative AI model and generates a search query for relevant information. The input is the user's question text, and the output is the search query.

[0531] Step 5:

[0532] The server searches the database using the generated search query and extracts the relevant information. It retrieves related event and sales information and generates a response based on it. The input is the search query, and the output is a dataset of the information found.

[0533] Step 6:

[0534] The server constructs a response to the user based on the extracted information and generates the response using an appropriate representation based on a generative AI model. The input is a dataset, and the output is the response text.

[0535] Step 7:

[0536] The server sends the generated response to the terminal. The terminal displays the received response in its user interface. The input is the response text from the server, and the output is the display information that can be visually confirmed by the user.

[0537] Step 8:

[0538] Based on the information displayed on the device, users can decide on actions such as participating in local events or visiting stores. The input is the information the user receives, and the output is the user's action plan.

[0539] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0540] This invention provides an information management device that not only allows residents to efficiently acquire local rule information and public information, but also understands the user's emotions and generates and presents responses based on those emotions. The system includes a server, a user terminal, and an emotion engine for analyzing emotions.

[0541] server:

[0542] The server collects local rules and public information, stores it in a database, and retrieves appropriate information and generates responses based on questions from the user's terminal. The server also works with an emotion engine to analyze the emotions contained in the user's input. For example, if a user expresses a strong desire to know more, the server will provide detailed information accordingly.

[0543] Terminal:

[0544] The terminal runs a dedicated application and provides an interface that allows users to easily input questions. When a user requests information, the entered text is sent to the server, and the received response is displayed. Furthermore, the terminal adjusts the tone and content of the information presentation according to the user's emotions, which are analyzed by an emotion engine. For example, if the user is feeling anxious, the information can be displayed using more relaxing language.

[0545] User:

[0546] Users input questions in natural language using their devices and receive answers from the server. If the user's input includes emotions, the emotion engine analyzes those emotions and provides information in the most appropriate format for the user. For example, if a user provides input suggesting urgency, the emotion engine recognizes that emotion and helps provide urgent information quickly and clearly.

[0547] This system allows residents to quickly obtain necessary information and receive information in a sensitive and emotionally resonant manner, enabling them to adapt to their local community with greater confidence.

[0548] The following describes the processing flow.

[0549] Step 1:

[0550] The server collects shared rules and public information from local government agencies and relevant data sources and stores it in a database. This information includes things like garbage collection schedules and local event information.

[0551] Step 2:

[0552] When the terminal is powered on, it automatically runs a dedicated application and displays a user-friendly interface for entering questions.

[0553] Step 3:

[0554] The user uses the terminal's interface to input a question and a sentence expressing their feelings at that moment, and then sends it. For example, they might input, "What's tomorrow's trash collection day? I'm a little worried."

[0555] Step 4:

[0556] The terminal sends a message to the server containing questions and emotions from the user. This message includes text data as user input.

[0557] Step 5:

[0558] The server analyzes the received question using natural language processing to interpret the information the user is seeking. Furthermore, it uses an emotion engine to analyze the user's emotions from the input text.

[0559] Step 6:

[0560] The server searches the database for appropriate information based on the analysis results. During this process, the presentation and content of the information are adjusted based on the emotional analysis results. For example, if anxiety is detected, the information is rearranged to provide a sense of reassurance.

[0561] Step 7:

[0562] The server generates a response to the user based on the searched information and sentiment analysis results. For example, it might create a response such as, "Tomorrow is trash day. Don't worry."

[0563] Step 8:

[0564] The server sends the generated response to the terminal. This response contains information that is easy for the user to understand and that resonates with their emotions.

[0565] Step 9:

[0566] The terminal displays the response received from the server on its screen, providing the user with visual information.

[0567] Step 10:

[0568] Users check the information displayed on their device screen and plan and execute actions according to their emotions and circumstances. For example, taking out the trash on the right day can alleviate anxiety.

[0569] (Example 2)

[0570] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0571] Modern residents are expected to quickly grasp and appropriately utilize a wide variety of information and regulations concerning their community. However, if the methods of information collection and provision are inadequate, residents may not be able to obtain the necessary information quickly and may experience difficulties in adapting to their community. Furthermore, if information is provided without considering the feelings of the residents, it may cause anxiety and stress. Therefore, a system is needed that enables residents to efficiently obtain local regulations and public information and receive it in a way that takes their feelings into consideration.

[0572] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0573] In this invention, the server includes means for collecting local regulations and public information and storing it in a data set; means for analyzing emotions using an emotion analysis mechanism for detecting emotions contained in user input; and means for retrieving appropriate information corresponding to user input based on the collected information and emotion analysis. This enables residents to quickly obtain necessary local information in an emotion-sensitive manner.

[0574] "Local rules" refer to official or informal policies or practices that residents of a particular area are expected to follow.

[0575] "Public information" refers to important data and information related to a region that is made public to local residents and the general public.

[0576] An "information processing system" refers to a device or system equipped with a set of functions and equipment for processing, storing, and analyzing collected data and using it according to a specific purpose.

[0577] A "data collection" refers to a computer-based storage system where diverse information and data are accumulated and stored in an organized manner.

[0578] An "emotion analysis mechanism" refers to analytical tools and algorithms used to extract and classify emotions from input natural language data.

[0579] A "user terminal" refers to a device that communicates with an information processing system and is directly operated by the user, such as a smartphone or computer.

[0580] A "user interface" refers to the part of a system that provides screens and operating mechanisms for interaction between a user and a machine.

[0581] A "computer device" refers to a platform that has the capability to process digital information and run various applications.

[0582] This invention is an information processing system that effectively provides local and public information and enables information presentation that takes user emotions into consideration. The system mainly consists of a server, user terminals, and emotion analysis functions.

[0583] The server collects local regulations and public information and stores it in a database for centralized management. Data collection could utilize web scraping techniques or APIs to update the information in real time. The server also runs algorithms, including sentiment analysis capabilities, to analyze the emotions associated with natural language input data submitted by users.

[0584] The user terminal runs a dedicated application and provides an interface that allows the user to input questions using natural language. This application sends the user's input to a server and receives and displays the response from the server. Based on sentiment analysis results, the user interface adjusts the way information is presented and its tone to ensure that information is delivered in a way that is most appropriate for the user.

[0585] Users obtain the necessary information by entering questions in natural language through their devices. Because this system takes emotions into consideration, the information provided adapts to the user's feelings, resulting in a more satisfying information retrieval experience. For example, if a user asks, "I want to know more about the garbage disposal rules in my neighborhood," and also expresses the emotion of "I'm a little anxious because I'm living in a new place for the first time," the server will provide detailed information while displaying it in a relaxing tone.

[0586] Examples of prompt messages include the following:

[0587] "I've moved to a new area. I'd like to know more about things like how to dispose of garbage and the rules for getting along with neighbors. I'm a little worried."

[0588] In this way, this information processing system achieves efficient information delivery and an emotionally sensitive user experience.

[0589] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0590] Step 1:

[0591] Users input questions in natural language through an interface on their user terminal. The input may sometimes request specific information about local regulations. This input includes the user's question and their feelings at the time. For example, they might input, "I want to know about a local event; I'm nervous because it's my first time."

[0592] Step 2:

[0593] The terminal converts user input into digital data and transmits it to the server via the internet. The user's questions and their sentiment data become the basis for processing on the server. Specific operations involved in data transmission include secure data transfer using SSL communication.

[0594] Step 3:

[0595] The server passes the received digital data to the emotion analysis mechanism for emotion analysis. The analysis results in the quantification or classification of emotions contained in the user's questions. For example, the emotion analysis algorithm might detect the emotion "tension," and its intensity would be expressed numerically.

[0596] Step 4:

[0597] The server searches the database for relevant information based on sentiment analysis results and user questions. It extracts collected local event information, rule information, etc., and filters and sorts them as needed. As output, a set of important information tailored to the user's interests is generated.

[0598] Step 5:

[0599] The server generates user-optimized responses based on analyzed sentiment data and search results. Generative AI models are used to construct response sentences with appropriate tone and content. Specific operations include template-based response generation and the use of natural language generation technologies.

[0600] Step 6:

[0601] The server sends the generated response to the terminal. The transmitted data is converted into a format viewable on the user's terminal. The transmission process again uses SSL communication to ensure data security.

[0602] Step 7:

[0603] The terminal displays the response received from the server to the user. The user interface presents information in an emotionally sensitive manner, reassuring the user by including phrases such as "Please relax and enjoy." The displayed information is designed to be visually easy to understand and easy to operate.

[0604] (Application Example 2)

[0605] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0606] In local communities, there is a challenge in that residents have difficulty quickly obtaining the local rules and public information they need. Furthermore, because information is not provided with consideration for the feelings of individual users, understanding and use of the information is hindered. Therefore, it is necessary to provide information while conducting sentiment analysis to create information services that are valuable to users.

[0607] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0608] In this invention, the server includes a device for collecting local rule data and public data and storing it in a data storage unit, a device for searching for appropriate data in response to user input, and a device for identifying emotions included in user input using an emotion analysis function. This makes it possible to provide information to users in local communities that takes individual emotions into consideration.

[0609] "Resident" refers to a person who lives in a specific area or community.

[0610] "Regional regulations data" refers to a collection of data that aggregates information about rules and guidelines in a specific region.

[0611] "Public data" refers to a collection of publicly available information provided by public institutions and local communities.

[0612] A "data management system" is a system designed to centralize various types of data and manage and provide them efficiently.

[0613] A "data storage unit" is a storage device or storage medium that stores collected data and allows access to it as needed.

[0614] "Users" refers to ordinary people who use this system to obtain information.

[0615] The "emotion analysis function" is a function that captures and understands human emotions based on input such as text and voice.

[0616] "Information provision" refers to conveying information to users in an appropriate format based on searched data and analysis results.

[0617] This invention is a data management system for efficiently managing various regional rule data and public data, and for providing useful information tailored to the user's needs. The server can collect specific regional rule data and public data and store it in a data storage unit. Users can input information in natural language through smart devices or in-store interfaces.

[0618] The server is equipped with sentiment analysis capabilities to identify the user's emotions as reflected in their input. This sentiment analysis utilizes software libraries capable of natural language processing, such as BERT or APIs specifically designed for sentiment analysis. Based on the identified emotions and the user's input, the server efficiently searches for useful information and generates a response to provide that information to the user's terminal in the most optimal format.

[0619] The terminal displays the response received from the server on the user interface. If the user expresses an emotion seeking relaxation, the terminal presents information in a calm tone; if the emotion suggests urgency, it highlights important information in a quick and clear format. For example, if a user looking for the latest promotional information at a supermarket shows impatience, the terminal makes it easier to obtain information and reduces stress by concisely presenting the target products and discount rates.

[0620] This allows residents in local communities to receive more efficient and emotionally sensitive information, thereby improving their quality of life.

[0621] Examples of prompts to input into a generative AI model:

[0622] "Consider the following customer question, identify their emotion, and generate a response that provides appropriate information. Customer Question: 'I want to know about the latest promotions.' Customer Emotion: 'Excited'"

[0623] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0624] Step 1:

[0625] The user inputs the information they want to retrieve using natural language via their smart device. The input is sent to the device as text data.

[0626] Step 2:

[0627] The terminal sends the input text to the server and requests sentiment analysis. The input includes the user's current question, and the output generates preparation data for sentiment analysis.

[0628] Step 3:

[0629] The server uses sentiment analysis capabilities based on the received text data to determine the user's emotions. For example, it uses BERT as a natural language processing tool to analyze whether the user's input indicates emotions such as "surprise" or "anxiety."

[0630] Step 4:

[0631] The server searches for appropriate information from local rule data and public databases based on sentiment analysis results and input content, and generates the optimal response. Database searches and generation AI models are used to process the information using specific prompt sentences.

[0632] Step 5:

[0633] The server sends the generated response data to the terminal. This data includes the information to be presented to the user and how it should be presented.

[0634] Step 6:

[0635] The terminal displays response data received from the server on the user interface. It provides information in a tone that matches the user's emotions, aiding in information comprehension.

[0636] Step 7:

[0637] The user can cyclically deepen their understanding of the information by reviewing the displayed responses and, if necessary, entering further questions. After re-entering information, the process returns to step 1, and information is provided through natural conversation, as shown in the example prompt.

[0638] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0639] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0640] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0641] [Fourth Embodiment]

[0642] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0643] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0644] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0645] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0646] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0647] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0648] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0649] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0650] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0651] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0652] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0653] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0654] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0655] As an embodiment of this invention, an electronic information management device that provides residents with local rules and public information is described. The device includes a user terminal, a server, and a communication infrastructure. Users access information via the terminal, and the server manages the information and generates responses.

[0656] server

[0657] The server collects local rules and public information and stores it in a database. This information includes garbage collection schedules, local events, and evacuation routes in case of disaster. The server periodically updates the information via the internet, reviewing the database whenever new information is added. Furthermore, the server uses natural language processing techniques to analyze user questions and retrieve the most relevant information from the database. For example, if a user asks, "What are the local events this weekend?", the server searches the event information in the database and generates an appropriate response.

[0658] terminal

[0659] The terminal is equipped with a dedicated application that provides an interface with the user. The user can use the terminal to input questions in natural language. The terminal sends the question to the server and displays the received response on the screen. For example, if a user inputs a question to check the garbage collection information for the next day, the terminal will display the response from the server, "Tomorrow is the day for combustible waste collection."

[0660] User

[0661] Users can access the server and retrieve information using a terminal or application designated for residents. Users input questions into the terminal and plan their daily lives based on the information presented. For example, after obtaining information about local events, they can decide whether or not to participate in those events.

[0662] Thus, this invention aims to support community life by providing residents with useful local information quickly through the use of electronic information management and generation AI.

[0663] The following describes the processing flow.

[0664] Step 1:

[0665] The server collects information on apartment building rules, local events, and public institutions from local government agencies and third-party data sources, and records it in a database. This ensures that the database always contains up-to-date information.

[0666] Step 2:

[0667] The terminal automatically runs a dedicated application upon startup and provides a user interface that allows users to easily input questions.

[0668] Step 3:

[0669] Users input and submit questions through the terminal's interface. For example, they can ask questions like, "What type of garbage should I put out tomorrow?"

[0670] Step 4:

[0671] The terminal sends a question message from the user to the server. This message contains the question entered by the user.

[0672] Step 5:

[0673] The server uses natural language processing to analyze the received question and understand the user's intent. In this process, it identifies the information category to search based on the question.

[0674] Step 6:

[0675] The server searches the database for relevant information based on the analysis results. For example, if it needs information about "burnable waste collection days," it will refer to data where Tuesday and Friday are specified.

[0676] Step 7:

[0677] The server generates a response to the user in the appropriate format based on the search results. For example, it might create a response such as, "Tomorrow is the day for burnable waste collection."

[0678] Step 8:

[0679] The server sends the generated response to the terminal. This response is formatted to be clear and easy for the user to understand.

[0680] Step 9:

[0681] The terminal displays the response received from the server to the user. The user confirms the response on the screen.

[0682] Step 10:

[0683] Based on the information provided, users plan and execute necessary actions. For example, they can plan to take out the trash on the appropriate day or to participate in an event.

[0684] (Example 1)

[0685] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0686] In modern society, local rules and public information are provided from numerous sources, making it difficult for residents to quickly and accurately obtain the information they need. Therefore, there is a need for means that enable real-time information updates and information utilization. In particular, providing the most relevant answers to user questions from a vast amount of information is a challenge.

[0687] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0688] In this invention, the server includes means for collecting local regulations and public information and storing it in a data storage device, means for analyzing user input using natural language processing technology and searching for relevant information, and means for generating responses to present appropriate information to the user using generative AI technology. This enables information retrieval and information provision that responds immediately to the user's needs.

[0689] A "resident" refers to an individual who lives within a specific area and is involved with the rules and public information of that area.

[0690] "Local regulations information" refers to information that outlines the specific rules and guidelines that residents must follow in their area.

[0691] "Public information" refers to information such as events, services, and emergency response procedures that should be shared within the local community.

[0692] An "information processing system" refers to an electronic device or group of devices for centrally managing information that is collected, stored, analyzed, and presented.

[0693] A "data storage device" refers to a hardware or software configuration that maintains information over a long period and makes it accessible as needed.

[0694] "Natural language processing technology" refers to technology that enables computers to understand and analyze human language.

[0695] "Generative AI technology" refers to technology that uses artificial intelligence to generate responses in natural language to human instructions and questions.

[0696] "User terminal" refers to a computer or personal information terminal used by a user to access information and input data.

[0697] "Response" refers to a formalized reply of information provided in response to a user's question or request.

[0698] The server plays a central role in the information processing system, collecting local regulations and public information and storing it in a data storage device. The server periodically retrieves data released by local governments and public institutions via the internet. This collection process is automated, ensuring that the latest information is always reflected in the database. The collected information is analyzed using natural language processing and generative AI technologies employed in this invention and used to prepare appropriate responses to user inquiries.

[0699] The terminal functions as an interface for users to access the system. It provides a platform for users to input natural language questions and sends this input to the server. The terminal is equipped with a dedicated application that receives the user's questions as text data through the user interface and quickly sends it to the server.

[0700] Users can obtain everyday local information through their devices. For example, to find out about garbage collection schedules or local events, users can input questions such as "When is the next day for combustible waste collection?" into their devices. This question is then compared with relevant information in the database, and the optimal response is generated by an AI model.

[0701] By using a generative AI model, the system constructs natural and easy-to-understand responses to user questions. A concrete example of a prompt would be, "Generate a natural response to the user's question using appropriate local event information." This prompt allows the AI ​​model to appropriately set the content and tone of the response.

[0702] As described above, specific embodiments of this invention enable users to easily obtain important local information and utilize it in their daily lives.

[0703] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0704] Step 1:

[0705] The server periodically collects local regulations and public information via the internet. Data sources include municipal open data portals and public institution websites. It uses URLs and API endpoints as input, converts the obtained data format, and stores it in data storage. This ensures that the database always contains the most up-to-date information.

[0706] Step 2:

[0707] The user enters a question through an application on their device. For example, a question like "When is the next day for combustible waste collection?" might be entered in text format. The device sends this input to the server. The output is text data sent to the server via the device.

[0708] Step 3:

[0709] The server analyzes the received text-based questions using natural language processing techniques. It receives text data as input and extracts keywords and intent. Based on this, it searches the database and identifies relevant information. For example, it might extract the next garbage collection date from the keyword "burnable waste." The output is the query result related to the user's request.

[0710] Step 4:

[0711] The server uses an AI model to generate natural language responses from the extracted information. The prompt is "Please provide appropriate information in natural language to answer the user's question." The input consists of database query results and the prompt, and the output is a response in a user-friendly format.

[0712] Step 5:

[0713] The terminal receives responses sent from the server and presents them to the user. The input is response data from the server, and the output is a natural language response displayed on the terminal's screen. For example, it might display "The next day for combustible waste collection is Wednesday," and the user can confirm this information.

[0714] (Application Example 1)

[0715] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0716] In modern society, the information users need in local communities and commercial facilities is diverse. There is a need to efficiently obtain information on local events and store operations to improve the quality of users' daily lives. However, there is a challenge in the lack of means to provide this information in a timely and accurate manner.

[0717] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0718] In this invention, the server includes means for collecting local event information, store operating information, and public information and storing it in an information storage device; means for searching for appropriate information corresponding to user input based on the collected information; and means for generating a response to present appropriate information to the user using the searched information. This enables users to quickly obtain the information they need and enjoy a fulfilling local life and shopping experience.

[0719] "Residents and visitors" refers to people who regularly visit a specific area or commercial facility, and is a general term for users to whom local and commercial information is provided.

[0720] "Local event information" refers to information about events, festivals, gatherings, etc., held in a specific region.

[0721] "Store operating information" refers to information regarding the operating hours, special sales, campaigns, and other business-related information of commercial facilities and stores.

[0722] "Public information" refers to information related to public affairs, such as traffic directions, emergency evacuation routes, and notices from local government.

[0723] An "information storage device" refers to a hardware or software system for electronically holding and storing data, and functions as a database.

[0724] "User information terminal" refers to a smartphone, tablet, or other electronic device used by residents and customers, and is used for receiving and displaying information.

[0725] "Electronic computer equipment" refers to a computer system used for data processing, and includes servers and related peripheral devices.

[0726] To implement this invention, a server is required for efficiently collecting and managing local event information, store operating information, and public information, as well as user terminals for providing this information. The server collects various information about local communities and commercial facilities and stores it in an information storage device. The collected information is used to search for and generate responses with optimal information in response to user input, utilizing a generative AI model equipped with natural language processing technology.

[0727] The server is programmed using the Python language, and its API interface is built using the Flask framework. RDBMS such as MySQL or PostgreSQL are used for database management. Natural language processing is handled using Python's NLTK and spaCy libraries.

[0728] On the other hand, the user's device is a smartphone or tablet, running an application developed with React Native. This application retrieves data from the server via a RESTful API and displays it in the user interface. Users can input questions in natural language and use that information to plan their daily lives.

[0729] As a concrete example, when a user enters "What events are happening near me this weekend?" into their smartphone app, the server searches for event information in that area and sends the appropriate event information back to the user's device. This information provides the user with the necessary information to make informed decisions. An example of a prompt to the generating AI model is "Please tell me about local events this weekend."

[0730] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0731] Step 1:

[0732] The server collects local event information, store operating information, and public information from the internet. The server retrieves this data via an API and stores it in a database. The input is information retrieved from the Web API, and the output is structured data stored in the database.

[0733] Step 2:

[0734] The user opens an application on their device and enters a natural language question related to the information they want to know. An example of this input is "Please tell me about events happening nearby this weekend." The input is text data from the user, and the output is that same text data.

[0735] Step 3:

[0736] The terminal retrieves the user's question and sends it to the server. The terminal sends this question to the server as an API request. The input is the user's question text, and the output is structured data as an API request.

[0737] Step 4:

[0738] The server analyzes the received question using natural language processing techniques. It extracts the meaning of the question using a generative AI model and generates a search query for relevant information. The input is the user's question text, and the output is the search query.

[0739] Step 5:

[0740] The server searches the database using the generated search query and extracts the relevant information. It retrieves related event and sales information and generates a response based on it. The input is the search query, and the output is a dataset of the information found.

[0741] Step 6:

[0742] The server constructs a response to the user based on the extracted information and generates the response using an appropriate representation based on a generative AI model. The input is a dataset, and the output is the response text.

[0743] Step 7:

[0744] The server sends the generated response to the terminal. The terminal displays the received response in its user interface. The input is the response text from the server, and the output is the display information that can be visually confirmed by the user.

[0745] Step 8:

[0746] Based on the information displayed on the device, users can decide on actions such as participating in local events or visiting stores. The input is the information the user receives, and the output is the user's action plan.

[0747] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0748] This invention provides an information management device that not only allows residents to efficiently acquire local rule information and public information, but also understands the user's emotions and generates and presents responses based on those emotions. The system includes a server, a user terminal, and an emotion engine for analyzing emotions.

[0749] server:

[0750] The server collects local rules and public information, stores it in a database, and retrieves appropriate information and generates responses based on questions from the user's terminal. The server also works with an emotion engine to analyze the emotions contained in the user's input. For example, if a user expresses a strong desire to know more, the server will provide detailed information accordingly.

[0751] Terminal:

[0752] The terminal runs a dedicated application and provides an interface that allows users to easily input questions. When a user requests information, the entered text is sent to the server, and the received response is displayed. Furthermore, the terminal adjusts the tone and content of the information presentation according to the user's emotions, which are analyzed by an emotion engine. For example, if the user is feeling anxious, the information can be displayed using more relaxing language.

[0753] User:

[0754] Users input questions in natural language using their devices and receive answers from the server. If the user's input includes emotions, the emotion engine analyzes those emotions and provides information in the most appropriate format for the user. For example, if a user provides input suggesting urgency, the emotion engine recognizes that emotion and helps provide urgent information quickly and clearly.

[0755] This system allows residents to quickly obtain necessary information and receive information in a sensitive and emotionally resonant manner, enabling them to adapt to their local community with greater confidence.

[0756] The following describes the processing flow.

[0757] Step 1:

[0758] The server collects shared rules and public information from local government agencies and relevant data sources and stores it in a database. This information includes things like garbage collection schedules and local event information.

[0759] Step 2:

[0760] When the terminal is powered on, it automatically runs a dedicated application and displays a user-friendly interface for entering questions.

[0761] Step 3:

[0762] The user uses the terminal's interface to input a question and a sentence expressing their feelings at that moment, and then sends it. For example, they might input, "What's tomorrow's trash collection day? I'm a little worried."

[0763] Step 4:

[0764] The terminal sends a message to the server containing questions and emotions from the user. This message includes text data as user input.

[0765] Step 5:

[0766] The server analyzes the received question using natural language processing to interpret the information the user is seeking. Furthermore, it uses an emotion engine to analyze the user's emotions from the input text.

[0767] Step 6:

[0768] The server searches the database for appropriate information based on the analysis results. During this process, the presentation and content of the information are adjusted based on the emotional analysis results. For example, if anxiety is detected, the information is rearranged to provide a sense of reassurance.

[0769] Step 7:

[0770] The server generates a response to the user based on the searched information and sentiment analysis results. For example, it might create a response such as, "Tomorrow is trash day. Don't worry."

[0771] Step 8:

[0772] The server sends the generated response to the terminal. This response contains information that is easy for the user to understand and that resonates with their emotions.

[0773] Step 9:

[0774] The terminal displays the response received from the server on its screen, providing the user with visual information.

[0775] Step 10:

[0776] Users check the information displayed on their device screen and plan and execute actions according to their emotions and circumstances. For example, taking out the trash on the right day can alleviate anxiety.

[0777] (Example 2)

[0778] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0779] Modern residents are expected to quickly grasp and appropriately utilize a wide variety of information and regulations concerning their community. However, if the methods of information collection and provision are inadequate, residents may not be able to obtain the necessary information quickly and may experience difficulties in adapting to their community. Furthermore, if information is provided without considering the feelings of the residents, it may cause anxiety and stress. Therefore, a system is needed that enables residents to efficiently obtain local regulations and public information and receive it in a way that takes their feelings into consideration.

[0780] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0781] In this invention, the server includes means for collecting local regulations and public information and storing it in a data set; means for analyzing emotions using an emotion analysis mechanism for detecting emotions contained in user input; and means for retrieving appropriate information corresponding to user input based on the collected information and emotion analysis. This enables residents to quickly obtain necessary local information in an emotion-sensitive manner.

[0782] "Local rules" refer to official or informal policies or practices that residents of a particular area are expected to follow.

[0783] "Public information" refers to important data and information related to a region that is made public to local residents and the general public.

[0784] An "information processing system" refers to a device or system equipped with a set of functions and equipment for processing, storing, and analyzing collected data and using it according to a specific purpose.

[0785] A "data collection" refers to a computer-based storage system where diverse information and data are accumulated and stored in an organized manner.

[0786] An "emotion analysis mechanism" refers to analytical tools and algorithms used to extract and classify emotions from input natural language data.

[0787] A "user terminal" refers to a device that communicates with an information processing system and is directly operated by the user, such as a smartphone or computer.

[0788] A "user interface" refers to the part of a system that provides screens and operating mechanisms for interaction between a user and a machine.

[0789] A "computer device" refers to a platform that has the capability to process digital information and run various applications.

[0790] This invention is an information processing system that effectively provides local and public information and enables information presentation that takes user emotions into consideration. The system mainly consists of a server, user terminals, and emotion analysis functions.

[0791] The server collects local regulations and public information and stores it in a database for centralized management. Data collection could utilize web scraping techniques or APIs to update the information in real time. The server also runs algorithms, including sentiment analysis capabilities, to analyze the emotions associated with natural language input data submitted by users.

[0792] The user terminal runs a dedicated application and provides an interface that allows the user to input questions using natural language. This application sends the user's input to a server and receives and displays the response from the server. Based on sentiment analysis results, the user interface adjusts the way information is presented and its tone to ensure that information is delivered in a way that is most appropriate for the user.

[0793] Users obtain the necessary information by entering questions in natural language through their devices. Because this system takes emotions into consideration, the information provided adapts to the user's feelings, resulting in a more satisfying information retrieval experience. For example, if a user asks, "I want to know more about the garbage disposal rules in my neighborhood," and also expresses the emotion of "I'm a little anxious because I'm living in a new place for the first time," the server will provide detailed information while displaying it in a relaxing tone.

[0794] Examples of prompt messages include the following:

[0795] "I've moved to a new area. I'd like to know more about things like how to dispose of garbage and the rules for getting along with neighbors. I'm a little worried."

[0796] In this way, this information processing system achieves efficient information delivery and an emotionally sensitive user experience.

[0797] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0798] Step 1:

[0799] Users input questions in natural language through an interface on their user terminal. The input may sometimes request specific information about local regulations. This input includes the user's question and their feelings at the time. For example, they might input, "I want to know about a local event; I'm nervous because it's my first time."

[0800] Step 2:

[0801] The terminal converts user input into digital data and transmits it to the server via the internet. The user's questions and their sentiment data become the basis for processing on the server. Specific operations involved in data transmission include secure data transfer using SSL communication.

[0802] Step 3:

[0803] The server passes the received digital data to the emotion analysis mechanism for emotion analysis. The analysis results in the quantification or classification of emotions contained in the user's questions. For example, the emotion analysis algorithm might detect the emotion "tension," and its intensity would be expressed numerically.

[0804] Step 4:

[0805] The server searches the database for relevant information based on sentiment analysis results and user questions. It extracts collected local event information, rule information, etc., and filters and sorts them as needed. As output, a set of important information tailored to the user's interests is generated.

[0806] Step 5:

[0807] The server generates user-optimized responses based on analyzed sentiment data and search results. Generative AI models are used to construct response sentences with appropriate tone and content. Specific operations include template-based response generation and the use of natural language generation technologies.

[0808] Step 6:

[0809] The server sends the generated response to the terminal. The transmitted data is converted into a format viewable on the user's terminal. The transmission process again uses SSL communication to ensure data security.

[0810] Step 7:

[0811] The terminal displays the response received from the server to the user. The user interface presents information in an emotionally sensitive manner, reassuring the user by including phrases such as "Please relax and enjoy." The displayed information is designed to be visually easy to understand and easy to operate.

[0812] (Application Example 2)

[0813] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0814] In local communities, there is a challenge in that residents have difficulty quickly obtaining the local rules and public information they need. Furthermore, because information is not provided with consideration for the feelings of individual users, understanding and use of the information is hindered. Therefore, it is necessary to provide information while conducting sentiment analysis to create information services that are valuable to users.

[0815] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0816] In this invention, the server includes a device for collecting local rule data and public data and storing it in a data storage unit, a device for searching for appropriate data in response to user input, and a device for identifying emotions included in user input using an emotion analysis function. This makes it possible to provide information to users in local communities that takes individual emotions into consideration.

[0817] "Resident" refers to a person who lives in a specific area or community.

[0818] "Regional regulations data" refers to a collection of data that aggregates information about rules and guidelines in a specific region.

[0819] "Public data" refers to a collection of publicly available information provided by public institutions and local communities.

[0820] A "data management system" is a system designed to centralize various types of data and manage and provide them efficiently.

[0821] A "data storage unit" is a storage device or storage medium that stores collected data and allows access to it as needed.

[0822] "Users" refers to ordinary people who use this system to obtain information.

[0823] The "emotion analysis function" is a function that captures and understands human emotions based on input such as text and voice.

[0824] "Information provision" refers to conveying information to users in an appropriate format based on searched data and analysis results.

[0825] This invention is a data management system for efficiently managing various regional rule data and public data, and for providing useful information tailored to the user's needs. The server can collect specific regional rule data and public data and store it in a data storage unit. Users can input information in natural language through smart devices or in-store interfaces.

[0826] The server is equipped with sentiment analysis capabilities to identify the user's emotions as reflected in their input. This sentiment analysis utilizes software libraries capable of natural language processing, such as BERT or APIs specifically designed for sentiment analysis. Based on the identified emotions and the user's input, the server efficiently searches for useful information and generates a response to provide that information to the user's terminal in the most optimal format.

[0827] The terminal displays the response received from the server on the user interface. If the user expresses an emotion seeking relaxation, the terminal presents information in a calm tone; if the emotion suggests urgency, it highlights important information in a quick and clear format. For example, if a user looking for the latest promotional information at a supermarket shows impatience, the terminal makes it easier to obtain information and reduces stress by concisely presenting the target products and discount rates.

[0828] This allows residents in local communities to receive more efficient and emotionally sensitive information, thereby improving their quality of life.

[0829] Examples of prompts to input into a generative AI model:

[0830] "Consider the following customer question, identify their emotion, and generate a response that provides appropriate information. Customer Question: 'I want to know about the latest promotions.' Customer Emotion: 'Excited'"

[0831] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0832] Step 1:

[0833] The user inputs the information they want to retrieve using natural language via their smart device. The input is sent to the device as text data.

[0834] Step 2:

[0835] The terminal sends the input text to the server and requests sentiment analysis. The input includes the user's current question, and the output generates preparation data for sentiment analysis.

[0836] Step 3:

[0837] The server uses sentiment analysis capabilities based on the received text data to determine the user's emotions. For example, it uses BERT as a natural language processing tool to analyze whether the user's input indicates emotions such as "surprise" or "anxiety."

[0838] Step 4:

[0839] The server searches for appropriate information from local rule data and public databases based on sentiment analysis results and input content, and generates the optimal response. Database searches and generation AI models are used to process the information using specific prompt sentences.

[0840] Step 5:

[0841] The server sends the generated response data to the terminal. This data includes the information to be presented to the user and how it should be presented.

[0842] Step 6:

[0843] The terminal displays response data received from the server on the user interface. It provides information in a tone that matches the user's emotions, aiding in information comprehension.

[0844] Step 7:

[0845] The user can cyclically deepen their understanding of the information by reviewing the displayed responses and, if necessary, entering further questions. After re-entering information, the process returns to step 1, and information is provided through natural conversation, as shown in the example prompt.

[0846] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0847] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0848] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0849] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0850] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0851] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0852] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0853] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0854] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0855] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0856] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0857] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0858] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0859] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0860] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0861] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0862] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0863] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0864] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0865] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0866] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[0867] The following is further disclosed regarding the embodiments described above.

[0868] (Claim 1)

[0869] An information management device that centrally manages and electronically provides local rule information and public information for residents,

[0870] Means for collecting local rule information and public information and storing it in a database,

[0871] Based on the information collected above, a means for searching for appropriate information corresponding to user input,

[0872] A means for generating a response to present appropriate information to the user using the information retrieved above,

[0873] A means for sending the above-generated response to the user terminal,

[0874] A system that includes this.

[0875] (Claim 2)

[0876] The system according to claim 1, further comprising means for providing a user interface capable of displaying the above response on a user terminal.

[0877] (Claim 3)

[0878] The system according to claim 1, further comprising means for querying a server device based on input from a user terminal.

[0879] "Example 1"

[0880] (Claim 1)

[0881] An information processing system that centrally manages and electronically provides local regulations and public information for residents,

[0882] Means for collecting local regulations and public information and storing it in a data storage device,

[0883] Based on the information collected above, a means for analyzing user input using natural language processing technology and searching for relevant information,

[0884] A means for generating a response to present appropriate information to the user using the above-searched information and generation AI technology,

[0885] A means for sending the above-generated response to the user terminal,

[0886] A system that includes this.

[0887] (Claim 2)

[0888] The system according to claim 1, further comprising means for providing a user interface capable of displaying the above response on a user terminal.

[0889] (Claim 3)

[0890] The system according to claim 1, further comprising means for querying an information processing device based on input from a user terminal.

[0891] "Application Example 1"

[0892] (Claim 1)

[0893] An information management device that centrally manages and electronically provides local event information, store operating information, and public information for residents and visitors,

[0894] A means for collecting local event information, store operating information, and public information, and storing it in an information storage device,

[0895] Based on the information collected above, a means for searching for appropriate information corresponding to the user's input,

[0896] A means for generating a response to present appropriate information to the user using the information retrieved above,

[0897] A means for transmitting the above-generated response to a user information terminal,

[0898] A system that includes this.

[0899] (Claim 2)

[0900] The system according to claim 1, further comprising means for providing a user interface for a user capable of displaying the above response.

[0901] (Claim 3)

[0902] The system according to claim 1, further comprising means for querying a computer device based on input from a user information terminal.

[0903] "Example 2 of combining an emotion engine"

[0904] (Claim 1)

[0905] An information processing system that centrally manages and electronically provides local regulations and public information,

[0906] Means for collecting local regulations and public information and storing it in a data set,

[0907] A means for analyzing emotions using an emotion analysis mechanism to detect emotions contained in user input,

[0908] Based on the information collected above and sentiment analysis, a means for searching for appropriate information corresponding to user input,

[0909] A means for generating a user-optimized response using the above-searched information and sentiment analysis results,

[0910] A means for sending the above-generated response to the user's terminal,

[0911] A system that includes this.

[0912] (Claim 2)

[0913] The system according to claim 1, further comprising means for providing a user interface capable of displaying the above response on a user terminal.

[0914] (Claim 3)

[0915] The system according to claim 1, further comprising means for querying a computer device based on input from a user terminal.

[0916] "Application example 2 when combining with an emotional engine"

[0917] (Claim 1)

[0918] A data management system that centralizes and electronically provides local regulations data and public data for residents,

[0919] A device for collecting local regulations data and public data and storing them in a data storage unit,

[0920] A device that searches for appropriate data for user input based on the data collected above,

[0921] A device that uses emotion analysis functionality to identify emotions contained in user input,

[0922] A device that generates a response to present appropriate information to the user based on the information retrieved and the sentiment analysis results described above,

[0923] A device that transmits the above-generated response to the user device,

[0924] A system that includes this.

[0925] (Claim 2)

[0926] The system according to claim 1, comprising a device that provides a user display interface capable of displaying the above response on a user device.

[0927] (Claim 3)

[0928] The system according to claim 1, further comprising a device that queries a server device for data based on input from a user device. [Explanation of Symbols]

[0929] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. An information management device that centrally manages and electronically provides local rule information and public information for residents, Means for collecting local rule information and public information and storing it in a database, Based on the information collected above, a means for searching for appropriate information corresponding to user input, A means for generating a response to present appropriate information to the user using the information retrieved above, A means for sending the above-generated response to the user terminal, A system that includes this.

2. The system according to claim 1, further comprising means for providing a user interface capable of displaying the above response on a user terminal.

3. The system according to claim 1, further comprising means for querying a server device based on input from a user terminal.

Images