system

Abstract

We provide the system. [Solution] A means of collecting and integrating information related to childcare facilities, educational institutions, and medical institutions, A means for processing user search queries based on the aforementioned information and extracting relevant information, A means of sending the extracted information to the user's terminal and displaying it to the user, A means of receiving user feedback and reflecting it in the database, A system that includes means to customize future search results based on the user's search history and feedback information.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a character of the chatbot, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance as a response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Modern parents spend a lot of time and effort collecting information about childcare facilities, educational institutions, and medical institutions. It is a major problem that they need to search a wide variety of information sources such as official websites, word-of-mouth, summary websites, and personal blogs, which takes a long time for research and as a result reduces the time spent with their children. The present invention aims to reduce the burden on parents and increase the time spent interacting with their children by centrally managing this information and providing the necessary information quickly and efficiently.

Means for Solving the Problems

[0005] This invention provides a system for collecting and integrating information related to childcare facilities, educational institutions, and medical institutions. The system includes means for processing user search queries based on the aforementioned information and extracting relevant information; means for transmitting the extracted information to the user's terminal and displaying it to the user; means for receiving user feedback and reflecting it in a database; and means for customizing future search results based on the user's search history and feedback information. This allows users to easily and quickly obtain relevant information through a single application, significantly reducing research time.

[0006] A "childcare facility" is a facility that temporarily or long-term cares for children and provides upbringing and education.

[0007] An "educational institution" is an organization or infrastructure established to provide learning and education.

[0008] A "medical institution" refers to facilities such as hospitals, clinics, and medical offices established to provide medical treatment and medical care.

[0009] "Means of collecting and integrating information" refers to the process and technology of gathering information from multiple different sources, formatting it, and integrating it into a single database.

[0010] A "search query" is a keyword or phrase that a user enters to obtain specific information.

[0011] "Extraction methods" refer to algorithms and processes used to extract information that meets specific criteria from a large amount of data.

[0012] A "user terminal" is a device (such as a smartphone, tablet, or PC) that a user uses to input and view information.

[0013] "Means of receiving feedback" refers to the technologies and processes for receiving and processing ratings and comments provided by users.

[0014] A "database" is a system for efficiently storing and retrieving structured information.

[0015] "Search history" is a record of searches a user has performed in the past.

[0016] "Means of customization" refers to the process of adjusting the information and functions provided based on the user's individual preferences and history. [Brief explanation of the drawing]

[0017] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Embodiment 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Embodiment 2 when the emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when the emotion engine is combined.

Mode for Carrying Out the Invention

[0018] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0019] First, the terms used in the following description will be explained.

[0020] In the following embodiments, the numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0021] In the following embodiments, the numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0022] In the following embodiments, the signed storage is one or more non-volatile storage devices that store various programs and various parameters. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes.

[0023] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0025] [First Embodiment]

[0026] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0027] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0028] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0029] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0030] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0032] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0033] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0034] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0035] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0036] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0037] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0038] This invention relates to a system for collecting and centrally managing information related to childcare facilities, educational institutions, and medical institutions. The system includes means for collecting and integrating information, means for processing search queries, means for displaying information on a user terminal, means for receiving feedback, and means for customizing based on search history.

[0039] Server Processing

[0040] Database Management

[0041] The server collects information from official websites, reviews, summary sites, and personal blogs related to childcare facilities, educational institutions, and medical institutions, and stores it in a database. This database serves to eliminate duplication and inconsistencies through centralized information management.

[0042] Processing search queries

[0043] The server receives search queries submitted by users and extracts relevant information from the database. For example, if a user searches for "nearby daycare centers," the server extracts information on the most suitable daycare centers based on the user's current location (GPS data) and the keywords.

[0044] Feedback Management

[0045] The server receives feedback from users and adds it to the database. This provides accurate and reliable information that can be helpful to other users.

[0046] Profile update

[0047] The server updates user profiles based on the user's search history and feedback, customizing future search results. This customization provides more accurate information.

[0048] Terminal processing

[0049] Display of the user interface

[0050] The device provides an intuitive user interface. It features a search bar, filtering options, reviews, and other elements, designed to make it easy for users to find the information they need.

[0051] Submit a search query

[0052] When a user enters keywords into the search bar and presses the search button, the device sends that search query to the server. This allows the server to retrieve information that is in line with the user's intent.

[0053] Displaying search results

[0054] The system receives search results sent from the server and displays them to the user. This includes information such as the name, rating, distance, and fees of childcare facilities, educational institutions, and medical facilities.

[0055] Provide feedback

[0056] Users can provide feedback about the facilities and institutions they have used. The device sends this feedback to the server.

[0057] User actions

[0058] Execute search

[0059] The user uses the application to search for things like "nearby daycare centers." The search query and location information are sent to the server.

[0060] View results

[0061] Users view the search results returned from the server and check detailed information about facilities and organizations that interest them.

[0062] Provide feedback

[0063] This system provides feedback on facilities and institutions that users have actually visited. This feedback includes ratings and comments, which are sent from the user's device to the server.

[0064] Specific example

[0065] Example 1: Searching for and booking a daycare center

[0066] 1. The user searches for "nearby daycare centers" on their device.

[0067] 2. The terminal sends the search query to the server.

[0068] 3. The server accesses the database and retrieves information about the appropriate daycare center.

[0069] 4. The server sends the results back to the terminal.

[0070] 5. The device displays the results to the user, who can view detailed information, reviews, pricing, etc.

[0071] 6. The user sends a reservation request from their device to book a daycare center they like.

[0072] 7. The server contacts the daycare center to confirm the reservation and sends the result to the terminal.

[0073] Example 2: Recommended extracurricular activities for children

[0074] 1. The user searches for "children's English classes" on their device.

[0075] 2. The device requests classrooms that it might be interested in from the server, based on its past search history and user profile.

[0076] 3. The server extracts information on the most suitable English language school for the user from the database.

[0077] 4. The results are sent back to the device and displayed on the device.

[0078] 5. Users can view detailed information about the classroom and make reservations or inquiries.

[0079] This system allows users to easily and quickly obtain relevant information within a single application, significantly reducing research time. Furthermore, information is updated based on user feedback, ensuring that the information is always up-to-date and reliable.

[0080] The following describes the processing flow.

[0081] Processing steps for searching for and providing feedback on daycare centers

[0082] Step 1: User search request

[0083] The user enters "nearby daycare" into the device's search screen and taps the search button.

[0084] Step 2: Submit your search query

[0085] The terminal sends the entered search query to the server as an HTTP request.

[0086] Step 3: Receiving the Request

[0087] The server receives a search request from the terminal.

[0088] Step 4: Database Reference

[0089] The server accesses a database containing data about daycare centers and extracts information on the most suitable daycare center based on the user's current location (GPS data) and keywords.

[0090] Step 5: Filtering and scoring data

[0091] The server filters relevant daycare centers based on location information and keywords, and calculates a score for each daycare center based on the user's past search history and reputation data.

[0092] Step 6: Generating Results

[0093] The server generates the filtering and scoring results in JSON format and prepares to send them back to the terminal.

[0094] Step 7: Receiving the Results

[0095] The terminal receives search results from the server.

[0096] Step 8: Perspective of the results

[0097] The terminal parses the received JSON data and converts it into a structured list or card view.

[0098] Step 9: Displaying search results

[0099] The device displays search results to the user in a viewable format, including information such as the name, rating, distance, and fees of each daycare center.

[0100] Step 10: View detailed information

[0101] Users select a daycare center they are interested in from the displayed search results and tap it to go to the detailed information page.

[0102] Step 11: Entering Feedback

[0103] Users can use the app to provide feedback (such as star ratings and comments) after actually visiting or using the daycare center.

[0104] Step 12: Submitting Feedback

[0105] The device sends the user's input to the server.

[0106] Step 13: Receiving Feedback

[0107] The server receives feedback sent from the terminal.

[0108] Step 14: Update the database

[0109] The server saves the received feedback to the database and updates the relevant nursery school information, reflecting the ratings and comments.

[0110] Step 15: Update your profile

[0111] The server also updates the user's profile information, incorporating feedback into future search results.

[0112] These steps allow users to quickly and efficiently obtain the necessary information about daycare centers, and the feedback they provide will be used to improve the search function in the future.

[0113] (Example 1)

[0114] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0115] Conventional information gathering and management systems have resulted in scattered information related to childcare facilities, educational institutions, and medical facilities, making it difficult for users to efficiently obtain the necessary information. Furthermore, there was a lack of effective ways to utilize user feedback, leading to problems with the accuracy and reliability of search results. Additionally, the ability to provide optimal facility information based on user location information was insufficient. To address these challenges, a system is needed that centrally integrates information gathering, searching, display, feedback management, and customization functions.

[0116] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0117] In this invention, the server includes means for collecting and integrating information related to childcare facilities, educational institutions, and medical institutions; means for processing search queries from users based on the information and extracting relevant information; means for transmitting the extracted information to a user terminal and displaying it to the user; means for receiving feedback from the user and reflecting it in a database; means for customizing future search results based on the user's search history and feedback information; means for displaying a user interface; means for transmitting search queries from the terminal to the server; means for displaying search results on the terminal; means for transmitting feedback from the terminal to the server; means for cleaning and deduplication of collected information; means for analyzing search queries; and means for extracting and formatting optimal information from the database. As a result, users can efficiently obtain information on a centralized platform and always obtain the latest and most reliable information by utilizing feedback.

[0118] "Means of collecting and integrating information" refers to the function of collecting data from various sources related to childcare facilities, educational institutions, and medical institutions, and organizing it to eliminate duplication and inconsistencies for centralized management.

[0119] "Means for processing search queries" refers to functions that analyze search queries submitted by users and extract relevant information from the database.

[0120] "Means of sending information to a user terminal and displaying it to the user" refers to a function that formats information obtained from a server and displays it on the terminal through a user interface.

[0121] "Means of receiving feedback and reflecting it in the database" refers to a function that analyzes feedback submitted by users and adds or updates it to the database.

[0122] "Means of customizing future search results based on search history and feedback information" refers to a function that uses past search history and feedback to update the user profile and provide next search results in a way that is more tailored to the user.

[0123] "Means of displaying a user interface" refers to a function that displays a graphical interface on the terminal that allows the user to operate it intuitively.

[0124] "Means of sending search queries from a terminal to a server" refers to a function that sends search queries entered by the user to a server via the network.

[0125] "Means of displaying search results on a device" refers to a function that displays search results sent from the server on the user's device and provides them visually.

[0126] "Means of sending feedback from the terminal to the server" refers to a function that sends user-entered feedback to the server.

[0127] "Means for cleaning and deduplication of collected information" refers to a function that analyzes collected data using cleansing tools and removes duplicate or inaccurate data.

[0128] "Means for analyzing search queries" refers to a function that analyzes the search queries received from users, extracts keywords, and understands their meaning.

[0129] "Means for extracting and formatting optimal information from a database" refers to a function that retrieves relevant information from the database based on extracted keywords and organizes it in a format that is easy for the user to understand.

[0130] This invention relates to a system for collecting and centrally managing information related to childcare facilities, educational institutions, and medical institutions. The system includes means for collecting and integrating information, processing search queries, displaying information on user terminals, receiving feedback, and customizing information based on search history. This allows users to effectively obtain necessary information and update it based on feedback to provide the most up-to-date information.

[0131] Specific hardware and software to be used

[0132] server

[0133] The server is responsible for database management, information gathering, processing search queries, managing feedback, and updating profiles. The main software tools used are as follows:

[0134] Database management: MySQL (registered trademark)

[0135] Data collection: Web scraping tools, APIs

[0136] Data cleansing: Apache® Spark

[0137] Natural Language Processing: NLTK

[0138] Server-side framework: Django

[0139] terminal

[0140] The terminal is responsible for displaying the user interface, sending search queries, displaying search results, and providing feedback. The main software technologies used are as follows:

[0141] Frontend framework: React

[0142] Data transmission and reception: HTTP protocol

[0143] User

[0144] Users operate the device, perform searches, view results, and provide feedback.

[0145] Specific example

[0146] Example 1: Searching for and booking a daycare center

[0147] 1. The user searches for "nearby daycare centers" on their device.

[0148] 2. The terminal sends the search query to the server.

[0149] 3. The server refers to the database and retrieves information about the appropriate daycare center.

[0150] 4. The server sends the results back to the terminal.

[0151] 5. The device displays the results to the user, who can then view detailed information, reviews, pricing, etc.

[0152] 6. The user sends a reservation request from their device to reserve a daycare center they like.

[0153] 7. The server coordinates with the daycare center to confirm the reservation and sends the result to the terminal.

[0154] Example of a prompt:

[0155] "I'm looking for a daycare center in my neighborhood. Could you recommend any good ones?"

[0156] Example 2: Recommended extracurricular activities for children

[0157] 1. The user searches for "children's English classes" on their device.

[0158] 2. The device requests classrooms that it might be interested in from the server, based on its past search history and user profile.

[0159] 3. The server extracts information on the most suitable English language school for the user from the database.

[0160] 4. The results are sent back to the device and displayed on the device.

[0161] 5. Users can view detailed information about the classroom and make reservations or inquiries.

[0162] Example of a prompt:

[0163] "I'm looking for an English class for my child. Could you recommend one?"

[0164] Specific examples of actions

[0165] Information gathering and integration

[0166] The server automatically collects information related to childcare facilities, educational institutions, and medical institutions using web scraping tools and APIs. The collected information is cleansed using Apache Spark to remove duplicates and inconsistencies, and then stored in a MySQL database.

[0167] Processing search queries

[0168] When a user enters and submits a search query on their device, the query is sent to the server via the HTTP protocol. The server uses NLTK to parse the query and extract keywords. Based on the extracted keywords, the server retrieves relevant information from the database and formats it in JSON format.

[0169] Displaying search results

[0170] The formatted search results are sent to the device via the HTTP protocol. The device then displays the search results to the user using React. The user interface is intuitive and easy to use, allowing users to visually check facility ratings, distance, prices, and more.

[0171] Provide feedback

[0172] After a user uses a facility, they enter feedback. This feedback is sent from the terminal to the server, which analyzes it and adds it to the database. This improves the accuracy of future search results.

[0173] This system allows users to easily and quickly obtain relevant information within a single application, significantly reducing research time. Furthermore, information is updated based on user feedback, ensuring that the information is always up-to-date and reliable.

[0174] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0175] Step 1: Information gathering and cleaning

[0176] The server collects information related to childcare facilities, educational institutions, and medical institutions from official websites, review sites, summary sites, personal blogs, and other sources. This information is obtained using web scraping tools and APIs.

[0177] Input: Website URL or API endpoint

[0178] Data processing: Collected information is analyzed using Apache Spark to remove duplicate and inaccurate data.

[0179] Output: Clean and unified dataset

[0180] Specifically, the server analyzes the HTML structure of the web page and extracts the necessary information (such as the facility's name, address, rating, and price). It then removes duplicate and inaccurate data and stores the final dataset in a MySQL database.

[0181] Step 2: Receiving User Queries

[0182] The terminal receives search queries through the user interface. When the user enters keywords into the search bar and presses the search button, the search query is sent from the terminal to the server.

[0183] Input: Keywords entered by the user (e.g., "neighborhood nursery school")

[0184] Output: Search query sent to the server as an HTTP request

[0185] Specifically, the device captures a click event of the search button, and based on that event, converts the user input into an HTTP request format and sends it to the server.

[0186] Step 3: Analyze the search query

[0187] The server analyzes the received search query. Using NLP (Natural Language Processing) tools, it breaks down the query into tokens and extracts the main keywords.

[0188] Input: Search query sent to the server (e.g., "nearby daycare")

[0189] Data processing: Use NLTK to break down queries and extract key keywords (e.g., "neighborhood," "nursery school").

[0190] Output: Extracted keyword set

[0191] Specifically, the server retrieves the query text, tokenizes it using the NLTK library, and identifies the main keywords.

[0192] Step 4: Extracting relevant information

[0193] The server searches the database based on the extracted keywords and retrieves relevant information. It also takes the user's current location (GPS data) into consideration to extract the most suitable results.

[0194] Input: Extracted keyword set, user's current location (e.g., GPS coordinates)

[0195] Data processing: Create database queries and retrieve relevant information from the MySQL database.

[0196] Output: A set of related information (e.g., a list of daycare centers)

[0197] Specifically, the server creates an SQL query based on keywords and location information, and extracts a list of the most suitable daycare centers from the database.

[0198] Step 5: Formatting the search results

[0199] The server formats the acquired information into a user-friendly format. It uses data formats such as JSON to organize information such as facility names, ratings, addresses, and prices.

[0200] Input: Set of related information

[0201] Data processing: Convert the information into JSON format and organize it as an object containing the attributes of each facility (name, rating, address, price).

[0202] Output: Formatted search results

[0203] Specifically, the server converts the information retrieved from the database into a JSON object and structures it in a visually easy-to-understand format.

[0204] Step 6: Submit search results

[0205] The server sends the formatted search results to the terminal. This is typically sent as an HTTP response.

[0206] Input: Formatted search results

[0207] Output: Search results sent to the terminal as an HTTP response

[0208] Specifically, the server includes the search results in JSON format in the HTTP response body and sends it to the terminal.

[0209] Step 7: Displaying search results

[0210] The terminal receives search results sent from the server and displays them to the user. The list of facilities is visually displayed through the user interface.

[0211] Input: Search results received from the server

[0212] Output: Visual list of facilities displayed in the user interface

[0213] Specifically, the device parses the HTTP response and uses React to display the search results in a card format representing the facilities.

[0214] Step 8: Provide feedback

[0215] Users enter feedback about the facilities they used. The entered feedback is sent from the terminal to the server.

[0216] Input: User-entered feedback

[0217] Output: Feedback sent to the server as an HTTP request

[0218] Specifically, when a user enters their rating or comments into the feedback input form and presses the submit button, the feedback data is sent from the device to the server.

[0219] Step 9: Save Feedback

[0220] The server receives the feedback and stores it in the database. The analyzed feedback is used to improve search results in the future.

[0221] Input: Feedback sent from the device

[0222] Data processing: Analyze feedback and add it to the database.

[0223] Output: Feedback entries saved in the database

[0224] Specifically, the server analyzes the feedback it receives and then inserts it into the appropriate table in the MySQL database.

[0225] Step 10: Update your profile

[0226] The server updates the user profile based on the user's search history and feedback.

[0227] Input: User's search history, feedback

[0228] Data processing: Update user profiles and implement customizations based on the next search results.

[0229] Output: Updated user profile

[0230] Specifically, the server updates the user's profile information based on their past search history and feedback, creating a foundation for providing more accurate results in future search queries.

[0231] (Application Example 1)

[0232] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0233] Information regarding childcare facilities, educational institutions, and medical facilities presents a problem: users cannot quickly obtain the information they need and must gather it from multiple sources. Furthermore, search results are uniform and not customized based on the user's location or past search history, resulting in low user convenience. In addition, it is difficult for parents to find appropriate facilities and navigate accordingly when dropping off or picking up their children. As a result, it becomes a time-consuming and laborious process.

[0234] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0235] In this invention, the server includes means for collecting and integrating information related to childcare facilities, educational institutions, and medical institutions; means for processing search queries from users based on the information and extracting relevant information; means for transmitting the extracted information to a user terminal and displaying it to the user; means for receiving feedback from users and reflecting it in a database; means for customizing future search results based on the user's search history and feedback information; means for calculating the optimal route to childcare facilities, educational institutions, and medical institutions based on the user's location information and destination and providing navigation; and, as an example of application, means for providing information on childcare facilities, educational institutions, and medical institutions through an application integrated into the infotainment system of an autonomous vehicle. As a result, users can obtain necessary information quickly and centrally, customize it based on the user's location information and past search history, and enable parents to efficiently search for appropriate facilities when dropping off or picking up their children and reach their destination via the optimal route.

[0236] A "childcare facility" is a facility that takes in infants and young children during the day and provides them with education and childcare.

[0237] An "educational institution" refers to any institution that provides education, such as schools, cram schools, or extracurricular activity classes.

[0238] A "medical institution" is a facility that provides medical services, such as a hospital, clinic, or medical office.

[0239] "Means of collecting and integrating information" refers to a system that gathers data from various sources, centralizes it, and stores it in a database.

[0240] "Means for processing search queries" refers to a system that analyzes user search input and extracts relevant information from a database.

[0241] "Means of transmitting and displaying information" refers to a system that transmits extracted information to the user's terminal and presents it visually.

[0242] "A means of receiving feedback and reflecting it in the database" refers to a system that adds user feedback information, such as ratings and comments, to a database and updates the information.

[0243] "Means for customizing search results based on search history and feedback information" refers to a system that analyzes a user's past search history and provided feedback to deliver personalized search results.

[0244] "A means of calculating the optimal route based on location information and destination and providing navigation" refers to a system that calculates and guides the user to the optimal travel route based on their current location and set destination.

[0245] An "infotainment system for autonomous vehicles" is an information system installed in autonomous vehicles that includes navigation and entertainment functions.

[0246] A "user terminal" refers to a smartphone, tablet, or other electronic device used by a user to receive and interact with information.

[0247] This invention relates to a system for collecting and centrally managing information related to childcare facilities, educational institutions, and medical institutions. The system includes means for collecting and integrating information, processing search queries, displaying information on a user terminal, receiving feedback, and customizing based on search history. Furthermore, it is designed to be efficiently utilized through an application that integrates with the infotainment system of an autonomous vehicle and provides navigation functionality.

[0248] Server Processing

[0249] The server collects information from official websites, reviews, summary sites, and personal blogs related to childcare facilities, educational institutions, and medical institutions, and stores it in a database. This database serves to eliminate duplication and inconsistencies through centralized information management. Data scraping tools and APIs are used to collect information. Next, the server receives search queries submitted by users and extracts relevant information from the database. For example, if a user searches for "nearby daycare centers," the server extracts information on the most suitable daycare centers based on the user's current location (GPS data) and keywords. The server also receives feedback from users and adds it to the database. This provides accurate and reliable information that can be helpful to other users. Furthermore, the user profile is updated based on the user's search history and provided feedback to customize future search results. This customization provides even more accurate information.

[0250] Terminal processing

[0251] The device provides an intuitive user interface. It displays a search bar, filtering options, reviews, and other features, designed to help users easily find the information they need. When a user enters keywords into the search bar and presses the search button, the device sends the search query to the server. This retrieves information from the server based on the user's intent. The device receives the search results from the server and displays them to the user. This includes information such as the name, rating, distance, and fees of childcare facilities, educational institutions, and medical facilities. Users can also provide feedback about the facilities and institutions they have used, and the device sends this feedback to the server.

[0252] Navigation function of autonomous vehicles

[0253] Furthermore, these functions will also be applied to the infotainment systems of autonomous vehicles. When parents are dropping off or picking up their children, the autonomous vehicle's screen can immediately search for the most suitable educational or medical facilities and provide route guidance. For example, a parent can search for "nearby daycare centers," and the app will use the current location information to find and display a list of the most suitable daycare centers. Then, the autonomous vehicle will start navigation with the daycare center selected by the parent as the destination. This function allows users to travel along the most optimal route to their destination.

[0254] Hardware and software

[0255] The hardware used includes infotainment systems for autonomous vehicles, smartphones, tablets, and communication modules. The software includes data scraping tools, APIs, GPS functionality, and internet connectivity (including the requests library). Data acquisition and processing utilize RESTful APIs to retrieve necessary information from servers. An algorithm has also been developed to calculate the optimal route based on the user's location.

[0256] Examples of specific cases and prompt statements

[0257] As a concrete example, if a parent searches for a "nearby daycare center" using an autonomous vehicle, the following prompt message will be used.

[0258] "Please search for the nearest highly-rated daycare center from your current location."

[0259] "Please calculate the shortest route to the daycare center selected by the user."

[0260] This allows users to easily and quickly obtain relevant information within a single application, significantly reducing the time spent on research. Furthermore, information is updated based on user feedback, ensuring that the information is always up-to-date and reliable.

[0261] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0262] Step 1:

[0263] The user launches the application on their device and searches for information on childcare facilities, educational institutions, and medical facilities.

[0264] Specific action: The user enters keywords into the search bar displayed on the device screen and presses the search button.

[0265] Input: Keyword (e.g., "nearby daycare"), user's current location data (GPS information).

[0266] Output: A search query is generated and sent to the server.

[0267] Step 2:

[0268] The server receives search queries sent by users and extracts relevant information from the database.

[0269] Specific operation: The server executes a search query against the database and retrieves information on relevant childcare facilities, educational institutions, and medical institutions.

[0270] Input: Search query, facility information in the database.

[0271] Output: A list of extracted information.

[0272] Step 3:

[0273] The server extracts the information and sends it to the terminal, which then displays it to the user.

[0274] Specific operation: The server sends the acquired information to the user's terminal, which then displays it on the screen. This information includes facility name, rating, distance, etc.

[0275] Input: List of extracted information.

[0276] Output: List of facility information displayed on the user terminal.

[0277] Step 4:

[0278] The user checks the facility information and selects the desired facility.

[0279] Specific operation: The user selects the facility for which they want to view detailed information from the displayed list.

[0280] Input: Display list of facility information.

[0281] Output: Detailed information of the selected facility.

[0282] Step 5:

[0283] Based on the detailed information of the facility selected by the user, a request to start navigation is sent from the terminal.

[0284] Specific operation: When the user presses the navigation button, the terminal sends a navigation start request to the server based on the location information of the selected facility.

[0285] Input: Location information of the selected facility.

[0286] Output: Navigation start request.

[0287] Step 6:

[0288] The server calculates the optimal route based on the user's current location and the location information of the destination, and sends the navigation data to the terminal.

[0289] Specific operation: The server executes an algorithm for route calculation based on the GPS data and the location information of the selected facility. The calculated route information is sent to the terminal.

[0290] Input: User's current location data, location information of the selected facility.

[0291] Output: Calculated optimal route information.

[0292] Step 7:

[0293] The device receives navigation data and displays and guides the user along the optimal route.

[0294] Specific operation: The terminal displays the received route information on a map and guides the user with voice and visual instructions.

[0295] Input: Calculated optimal route information.

[0296] Output: Navigation display and voice guidance.

[0297] Step 8:

[0298] After the user reaches their destination, they provide feedback.

[0299] Specific operation: Users enter ratings and comments about the facilities they visit and send feedback to the server via their device.

[0300] Input: User review comments.

[0301] Output: Feedback information sent to the server.

[0302] Step 9:

[0303] The server receives feedback and updates the database accordingly.

[0304] Specific operation: The server analyzes the received feedback information and updates the corresponding entry in the database.

[0305] Input: Feedback information sent from the user.

[0306] Output: Updated database information.

[0307] Furthermore, an emotion engine for estimating the user's emotion may be combined. That is, the specific processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform specific processing using the user's emotion.

[0308] The present invention is a system that collects and centrally manages information related to nursery facilities, educational institutions, and medical institutions, and further combines an emotion engine that recognizes the user's emotion. This system includes means for collecting and integrating information, means for processing search queries, means for displaying information on the user terminal, means for receiving feedback, means for customizing based on the search history, and an emotion engine.

[0309] Server processing <​​​​​​​​​​​​​​​​​​​​​​The server receives feedback from users and adds it to the database. This provides accurate and reliable information that can be helpful to other users.

[0316] Profile update

[0317] The server updates user profiles based on the user's search history and feedback, customizing future search results. This customization provides more accurate information.

[0318] Emotional Engine Processing

[0319] Recognition of emotions

[0320] The server recognizes the user's emotions through analysis of their facial expressions, voice, and text. This uses facial recognition technology and natural language processing technology.

[0321] Emotion-based filtering

[0322] The sentiment engine filters or ranks search results based on the recognized user's emotions. For example, if a user is feeling stressed, it prioritizes displaying activities that can help reduce stress.

[0323] Dynamic adjustment

[0324] The emotion engine dynamically changes the information and recommendations displayed in response to changes in the user's emotions. This can increase user satisfaction.

[0325] Terminal processing

[0326] Display of the user interface

[0327] The device provides an intuitive user interface. It features a search bar, filtering options, reviews, and other elements, designed to make it easy for users to find the information they need.

[0328] Submit a search query

[0329] When a user enters keywords into the search bar and presses the search button, the device sends that search query to the server. This allows the server to retrieve information that is in line with the user's intent.

[0330] Displaying search results

[0331] The system receives search results sent from the server and displays them to the user. This includes information such as the name, rating, distance, and fees of childcare facilities, educational institutions, and medical facilities.

[0332] Provide feedback

[0333] Users can provide feedback about the facilities and institutions they have used. The device sends this feedback to the server.

[0334] User actions

[0335] Execute search

[0336] The user uses the application to search for things like "nearby daycare centers." The search query and location information are sent to the server.

[0337] View results

[0338] Users view the search results returned from the server and check detailed information about facilities and organizations that interest them.

[0339] Provide feedback

[0340] This system provides feedback on facilities and institutions that users have actually visited. This feedback includes ratings and comments, which are sent from the user's device to the server.

[0341] Specific example

[0342] Example 1: Searching for daycare centers and displaying recommendations based on sentiment.

[0343] 1. The user searches for "nearby daycare centers" on their device.

[0344] 2. The emotion engine recognizes the user's stress level as high.

[0345] 3. The server prioritizes displaying daycare centers that can reduce stress (for example, daycare centers with a rich natural environment).

[0346] 4. Search results are sent to and displayed on the device.

[0347] 5. The user reviews the details and makes a reservation at the daycare center.

[0348] Thus, by providing information that takes user emotions into consideration, the present invention can improve the user experience and provide more personalized services.

[0349] The following describes the processing flow.

[0350] Processing steps for searching for daycare centers and displaying sentiment-based recommendations

[0351] Step 1: Display the search screen

[0352] The device displays a search screen to the user. It provides an interface that includes a search bar and filtering options.

[0353] Step 2: Enter your search query

[0354] The user enters "nearby daycare" into the search bar and taps the search button.

[0355] Step 3: Submit your search query

[0356] The terminal sends the entered search query to the server as an HTTP request.

[0357] Step 4: Receiving the Request

[0358] The server receives a search request from the terminal.

[0359] Step 5: Receiving emotional data

[0360] The server's emotion engine receives voice, text, and facial expression data transmitted from the terminal to recognize the user's emotions. For example, it measures the user's stress level using voice tone and expression, as well as facial recognition technology.

[0361] Step 6: Database Reference

[0362] The server accesses a database containing data about daycare centers and extracts information on the most suitable daycare center based on the user's current location (GPS data) and keywords.

[0363] Step 7: Filtering and scoring data

[0364] The server's sentiment engine filters and ranks search results based on the recognized user's emotions. For example, if a user is feeling stressed, it prioritizes displaying daycare centers that offer a relaxing environment.

[0365] Step 8: Generating Results

[0366] The server generates the filtering and scoring results in JSON format and prepares to send them back to the terminal.

[0367] Step 9: Receiving Results

[0368] The terminal receives search results from the server.

[0369] Step 10: Perspective of the results

[0370] The terminal parses the received JSON data and converts it into a structured list or card view.

[0371] Step 11: Displaying search results

[0372] The device displays search results to the user in a viewable format, including information such as the name, rating, distance, and fees of each daycare center.

[0373] Step 12: View detailed information

[0374] Users select a daycare center they are interested in from the displayed search results and tap it to go to the detailed information page.

[0375] Step 13: Entering Feedback

[0376] Users can use the app to provide feedback (for example, star ratings, comments, and changes in their feelings) after actually visiting or using the daycare center.

[0377] Step 14: Submitting Feedback

[0378] The device sends the user's input to the server.

[0379] Step 15: Receiving Feedback

[0380] The server receives feedback sent from the terminal.

[0381] Step 16: Update the database

[0382] The server saves the received feedback to the database and updates the relevant nursery school information, reflecting the ratings and comments.

[0383] Step 17: Update your profile

[0384] The server also updates the user's profile information, incorporating feedback into future search results.

[0385] This allows users to quickly and efficiently obtain the necessary information about daycare centers, and the feedback they provide will be used to improve the search function for future use. In addition, by using an emotion engine, it becomes possible to provide personalized information based on the user's emotions.

[0386] (Example 2)

[0387] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0388] Information related to childcare facilities, educational institutions, and medical institutions is diverse, making it difficult to efficiently collect and centrally manage it. Furthermore, providing users with the most relevant information requires personalized information that considers their emotions and circumstances, rather than simply relying on search queries. However, current systems do not adequately consider these factors in their information provision, highlighting the need for improved user experience. Additionally, there is a lack of effective means to utilize user feedback to improve future search results.

[0389] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0390] In this invention, the server includes means for collecting and integrating information related to childcare facilities, educational institutions, and medical institutions; means for processing search queries from users based on the information and extracting relevant information; means for transmitting the extracted information to a user terminal and displaying it to the user; means for receiving feedback from users and reflecting it in a database; means for customizing future search results based on the user's search history and feedback information; means for recognizing the user's emotions through analysis of the user's facial expressions, voice, and text; means for filtering or ranking search results based on the recognized user emotions; and means for dynamically changing the displayed information and recommendations in accordance with changes in the user's emotions. This enables the provision of personalized information that takes into account the user's emotions and circumstances. Furthermore, it allows for the effective use of user feedback to improve future search results.

[0391] A "childcare facility" refers to a facility that provides temporary or long-term care for infants and children.

[0392] An "educational institution" refers to an organization or facility that teaches academic subjects or skills, and includes schools, cram schools, and vocational schools.

[0393] A "medical institution" refers to a facility that provides medical services such as treatment, diagnosis, and prevention, and includes hospitals and clinics.

[0394] "Means of collecting and integrating information" refers to methods or devices for obtaining necessary data from the internet or other sources, organizing it, and storing it in a database.

[0395] "Means for processing search queries" refers to a method or device that understands the search criteria entered by the user and extracts appropriate data from a database based on those criteria.

[0396] "Means for transmitting information to a user's terminal and displaying it to the user" refers to a method or device for transmitting search results to a user's device and displaying them.

[0397] "Means of receiving feedback and reflecting it in the database" refers to a method or device for receiving ratings and comments from users and adding that information to a database.

[0398] "Means for customizing future search results based on search history and feedback information" refers to methods or devices that analyze past search history and feedback and individually adjust future search results based on that information.

[0399] "Means of recognizing user emotions through analysis of user facial expressions, voice, and text" refers to methods or devices that detect a user's emotional state using facial recognition technology, voice analysis, and natural language processing.

[0400] "Means of filtering or ranking search results based on emotion" refers to methods or devices that change the priority of search results according to the perceived emotions of the user.

[0401] "Means of dynamically changing displayed information and recommendations in response to changes in the user's emotions" refers to a method or device that updates displayed content and recommendations in real time when the user's emotions change.

[0402] The present invention is a system for collecting and integrating information related to childcare facilities, educational institutions, and medical institutions, and for providing personalized information that takes into account the user's emotions. This system includes means for collecting and integrating information, means for processing search queries, means for displaying information on a user terminal, means for receiving feedback, means for customizing based on search history, and an emotion engine.

[0403] Server Processing

[0404] Database Management

[0405] The server uses web scraping techniques to collect information about childcare facilities, educational institutions, and medical institutions from official websites, review sites, summary sites, personal blogs, etc., and stores it in a database. Python's BeautifulSoup library is used for data collection. MySQL or similar databases are used, and pre-processing algorithms are implemented to eliminate duplication and inconsistencies.

[0406] Processing search queries

[0407] The server receives search queries submitted by users and extracts relevant information from the database. It generates SQL queries based on the search queries and the user's location information (GPS data) and executes them against the database. The extracted information is temporarily held in memory.

[0408] Feedback Management

[0409] The server receives user feedback and adds it to the database. The feedback is analyzed using text processing techniques and stored in the database as ratings and comment information. This provides accurate and reliable information that can be helpful to other users.

[0410] Profile update

[0411] The server updates the user profile based on the user's search history and feedback provided, customizing future search results. This updated profile information is used for subsequent searches, resulting in more personalized results.

[0412] Emotional Engine Processing

[0413] Recognition of emotions

[0414] The server recognizes the user's emotions through analysis of their facial expressions, voice, and text. This analysis utilizes OpenCV, Google® Cloud Speech-to-Text API, and natural language processing technologies. The emotion engine filters or ranks search results based on the recognized emotions.

[0415] Emotion-based filtering

[0416] The emotion engine dynamically changes the priority of search results, for example, by prioritizing activities that can reduce stress when a user is feeling stressed.

[0417] Dynamic adjustment

[0418] The emotion engine updates the displayed information and recommendations in real time in response to changes in the user's emotions. This can increase user satisfaction.

[0419] Terminal processing

[0420] Display of the user interface

[0421] The device provides an intuitive user interface, displaying a search bar, filtering options, reviews, and more. It also includes a list of search results and a map display.

[0422] Submit a search query

[0423] When a user enters keywords into the search bar and presses the search button, the device sends that search query and location information to the server.

[0424] Displaying search results

[0425] The terminal displays search results sent from the server to the user. Information such as the name, rating, distance, and fees of childcare facilities, educational institutions, and medical facilities are displayed.

[0426] Provide feedback

[0427] Users can provide feedback about the facilities and institutions they have used, and the device sends this feedback to the server.

[0428] User actions

[0429] Execute search

[0430] The user uses the application to search for things like "nearby daycare centers." The search query and location information are sent to the server via the device.

[0431] View results

[0432] Users view the search results returned from the server and check detailed information about facilities and organizations that interest them.

[0433] Provide feedback

[0434] This system provides feedback on facilities and institutions that users have actually visited. This feedback includes ratings and comments, which are sent from the user's device to the server.

[0435] Specific example

[0436] Search for daycare centers and display recommendations based on sentiment.

[0437] 1. The user searches for "nearby daycare centers" on their device.

[0438] 2. The emotion engine recognizes the user's stress level as high.

[0439] 3. The server prioritizes displaying daycare centers that can reduce stress (e.g., daycare centers with a rich natural environment).

[0440] 4. Search results are sent to and displayed on the device.

[0441] 5. The user reviews the details and makes a reservation at the daycare center.

[0442] Example of a prompt

[0443] "I'm looking for a local daycare center. Please recommend one that takes into account the feelings and status of the parents."

[0444] Thus, each processing step of the system consists of multiple substeps, each involving a specific action, and extends in detail from user input to data collection and feedback processing. The coordination of these various elements enables the provision of personalized information that takes into account the user's emotions and circumstances.

[0445] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0446] Step 1: Data collection and database management

[0447] Server operation

[0448] The server uses web scraping techniques to collect information about childcare facilities, educational institutions, and medical institutions from various websites. Specifically, it uses the Python BeautifulSoup library to extract data from official websites, review sites, summary sites, personal blogs, and other sources.

[0449] Input: Website URL

[0450] Data processing: Web page analysis and extraction of necessary information.

[0451] Output: Database where the extracted information is stored (e.g., MySQL)

[0452] The server removes duplicate data, verifies inconsistencies in the information, and centrally manages it in the database.

[0453] Step 2: Receiving and processing search queries

[0454] User and device behavior

[0455] The user enters a keyword (e.g., "nearby daycare") into the device's search bar and presses the search button. The device sends this search query and the user's location information (GPS data) to the server.

[0456] Input: Search query and location information

[0457] Data processing: Receive search queries and location information as parameters.

[0458] Output: Request to send to the server

[0459] Server operation

[0460] The server generates an SQL query based on the received search query and location information to extract relevant information from the database.

[0461] Input: Search query and location information

[0462] Data processing: Generation and execution of SQL queries

[0463] Output: The extracted data (information on childcare facilities, educational institutions, and medical institutions) is temporarily stored in memory.

[0464] Step 3: Emotion Recognition and Filtering

[0465] Server operation

[0466] The server analyzes the user's facial expressions, voice, and text to recognize their emotions. This analysis utilizes OpenCV, the Google Cloud Speech-to-Text API, and natural language processing technologies.

[0467] Input: User facial expression data, voice data, text data

[0468] Data processing: Analysis using sentiment analysis algorithms

[0469] Output: Emotion recognition results (e.g., stress level, emotion type)

[0470] The emotion engine filters search results based on recognized emotions, prioritizing and ranking highly relevant information.

[0471] Input: Sentiment recognition results and temporarily stored search results

[0472] Data processing: filtering and ranking

[0473] Output: Filtered and ranked search results

[0474] Step 4: Providing search results

[0475] Server operation

[0476] The server sends the filtered search results to the terminal.

[0477] Input: Filtered and ranked search results

[0478] Data processing: Convert to data format and send.

[0479] Output: Search results sent to the terminal

[0480] Terminal operation

[0481] The terminal displays search results received from the server to the user. This display can include list formats, map displays, and other formats.

[0482] Input: Search results sent from the server

[0483] Output: Search results displayed in the user interface

[0484] Step 5: Managing Feedback

[0485] User and device behavior

[0486] Users input feedback about the facilities and institutions they have used and send it to the server via their device.

[0487] Input: Feedback information such as ratings and comments.

[0488] Output: Feedback request from terminal to server

[0489] Server operation

[0490] The server analyzes the received feedback and updates the database.

[0491] Input: Feedback Information

[0492] Data processing: Text analysis of feedback and addition to database.

[0493] Output: Updated database

[0494] Step 6: Update Profile

[0495] Server operation

[0496] The server updates the user profile based on the user's search history and feedback provided, thereby customizing future search results.

[0497] Input: Search history and feedback information

[0498] Data processing: Profile analysis and updating

[0499] Output: Updated user profile

[0500] (Application Example 2)

[0501] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0502] In today's internet environment, users find it difficult to find useful information from the vast amount of data available. In particular, there is a lack of systems that collect and appropriately present information directly related to daily life, such as that found in childcare facilities, educational institutions, and medical facilities. Furthermore, current search systems fail to provide information that takes into account the user's emotions and circumstances, thus failing to adequately enhance user satisfaction. Additionally, advertising displays lack sufficient customization to address user emotions and individual needs, resulting in reduced advertising effectiveness.

[0503] In Application Example 2, the specific processing performed by the specific processing unit 290 of the data processing device 12 is realized by the following means. In this invention, the server includes means for collecting and integrating information related to childcare facilities, educational institutions and medical institutions; means for processing search queries from users based on the information and extracting relevant information; means for transmitting the extracted information to a user terminal and displaying it to the user; means for receiving feedback from the user and reflecting it in a database; means for customizing future search results based on the user's search history and feedback information; means for recognizing the user's emotions and filtering or ranking search results based on those emotions; means for dynamically adjusting the information and recommendations displayed in accordance with changes in the user's emotions; and means for recommending individually customized advertisements based on the user's emotions and past search history. This makes it possible to provide information that is suitable for the user's emotions and individual needs, thereby improving user satisfaction. Furthermore, by customizing the display of advertisements, an improvement in advertising effectiveness can also be expected.

[0504] A "childcare facility" is a facility that takes in infants and young children during the day and provides education and care.

[0505] An "educational institution" is an organization established to provide education, such as a school or a cram school.

[0506] A "medical institution" is an organization that provides medical services, such as a hospital, clinic, or medical office.

[0507] "Means for collecting and integrating information" refers to methods and technologies for collecting and centrally managing information related to childcare facilities, educational institutions, and medical institutions from sources such as the internet.

[0508] "Means for processing search queries and extracting relevant information" refers to methods and technologies for finding relevant information from a database based on search queries submitted by users.

[0509] "Means for sending extracted information to a user's terminal and displaying it to the user" refers to methods and technologies for sending information extracted based on a search query to a user's terminal so that the user can view it.

[0510] "Means of receiving user feedback and reflecting it in the database" refers to methods and technologies for receiving opinions and evaluations provided by users and adding that information to a database.

[0511] "Means of customizing future search results based on user search history and feedback information" refers to methods and technologies that utilize a user's past search history and feedback to individually optimize future search results.

[0512] "Means for recognizing user sentiment and filtering or ranking search results based on that sentiment" refers to methods or technologies for analyzing user sentiment and selecting or ranking search results based on the results of that analysis.

[0513] "Means for dynamically adjusting the information and recommendations displayed in response to changes in the user's emotions" refers to methods and technologies that detect changes in the user's emotions in real time and change the information and recommendations displayed accordingly.

[0514] "Means of recommending individually customized ads based on user sentiment and past search history" refers to methods and technologies that consider a user's emotional state and past behavior to display individually optimized ads.

[0515] This invention improves user satisfaction and advertising effectiveness by adding a new function to a system that collects and centrally manages information on childcare facilities, educational institutions, and medical institutions: the ability to recognize user emotions and perform individual customization based on those emotions.

[0516] The server first collects information on childcare facilities, educational institutions, and medical institutions from official websites, review sites, summary sites, and personal blogs on the internet, and stores it in a database. This database plays a role in providing accurate and reliable information by eliminating duplication and inconsistencies through centralized information management.

[0517] When a user submits a search query, the server extracts information related to that query from its database. For example, if a user searches for "nearby daycare centers," the server extracts information on the most suitable daycare centers based on the user's current location (GPS data) and the keywords.

[0518] Next, the server receives feedback from users and adds it to the database, providing accurate information that can be helpful to other users. In addition, the server updates user profiles based on the user's search history and the feedback provided, customizing future search results for each individual user.

[0519] Furthermore, this system incorporates an emotion engine. The emotion engine recognizes the user's emotions by analyzing their facial expressions, voice, and text. This utilizes facial recognition and natural language processing technologies. Based on the recognized user emotions, the server filters or ranks search results, prioritizing the information the user is most likely to be interested in. The emotion engine can also dynamically change the displayed information and recommendations in response to changes in the user's emotions.

[0520] For example, when a user searches for "nearby daycare centers" on their device, if the emotion engine detects that the user's stress level is high, the server will prioritize displaying daycare centers with rich natural environments that can reduce stress. The search results are sent to the device, and the user can view them and check detailed information. In addition, when a user visits a specific daycare center and provides feedback such as ratings and comments, other users can also refer to that information.

[0521] Furthermore, it includes a feature that recommends personalized ads based on the user's emotions and past search history. For example, if a user is feeling stressed, ads for relaxation products and services can be displayed.

[0522] To realize this invention, the server uses an emotion engine that combines facial recognition and natural language processing technologies to analyze the user's emotions in detail. Furthermore, a high-performance server and appropriate database management software are used for database management. The user's terminal is provided with an intuitive user interface, enabling smooth searching and result display.

[0523] Example of a prompt:

[0524] "When a user is using an emotion-driven ad recommendation system, generate ads for relaxation products if their current emotion is stress."

[0525] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0526] Step 1:

[0527] The user enters a search query and presses the search button. The user's device retrieves the entered search query and the user's location information and sends this data to the server. The input data includes search keywords (e.g., "nearby daycare") and GPS data. The output is a search request that is sent to the server.

[0528] Step 2:

[0529] The server extracts relevant information from the database based on the received search query and location data. Specifically, it collects information on childcare facilities, educational institutions, and medical institutions, and selects those that match the search criteria. This process executes database queries and generates a list of matching facilities. The input is the search keyword and GPS data, and the output is a list of search results.

[0530] Step 3:

[0531] The server acquires a user's facial image and performs emotion recognition to filter search results using an emotion engine. The user's device captures a facial image using its camera and sends the image data to the server. The server analyzes the user's emotions using facial recognition and natural language processing technologies. The input is facial image data, and the output is the analyzed emotion data (e.g., "stressed").

[0532] Step 4:

[0533] The server filters or ranks search results based on the recognized user's emotions. For example, if the user is feeling stressed, it prioritizes childcare facilities with rich natural environments. This process takes emotion data and a list of search results as input, and outputs a list of filtered search results.

[0534] Step 5:

[0535] The server sends filtered search results to the user's device. The user's device receives the sent search results and displays them in the user interface. In this step, the data sent from the server is the input, and the information displayed on the device is the output. Specifically, detailed information such as the facility name, rating, distance, and price is displayed.

[0536] Step 6:

[0537] Users review the displayed search results and click on the details of facilities they are interested in to view more information. If a user selects a facility, that information is saved on their device. The input is the user's selection, and the output is the display of facility details.

[0538] Step 7:

[0539] Users visit a facility and provide feedback on their experience. The user terminal sends the text and evaluation data entered as feedback to the server. The input is the user's feedback data, and the output is the feedback request sent to the server.

[0540] Step 8:

[0541] The server reflects the received feedback data in the database, improving the reliability of the information. In this step, the feedback data is added to the database, and an updated database is generated. The input is the feedback data, and the output is the updated database.

[0542] Step 9:

[0543] The server generates and sends individually customized advertisements to the user's device based on the user's emotions and past search history. A generative AI model is used for ad generation. Using emotion data and past search history as input, a customized advertisement is output. This advertisement will be relevant to the user's current situation, such as offering relaxation products or services.

[0544] Example of a prompt:

[0545] "When a user is using an emotion-driven ad recommendation system, generate ads for relaxation products if their current emotion is stress."

[0546] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0547] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0548] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0549] [Second Embodiment]

[0550] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0551] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0552] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0553] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0554] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0555] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0556] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0557] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0558] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0559] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0560] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0561] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0562] This invention relates to a system for collecting and centrally managing information related to childcare facilities, educational institutions, and medical institutions. The system includes means for collecting and integrating information, means for processing search queries, means for displaying information on a user terminal, means for receiving feedback, and means for customizing based on search history.

[0563] Server Processing

[0564] Database Management

[0565] The server collects information from official websites, reviews, summary sites, and personal blogs related to childcare facilities, educational institutions, and medical institutions, and stores it in a database. This database serves to eliminate duplication and inconsistencies through centralized information management.

[0566] Processing search queries

[0567] The server receives search queries submitted by users and extracts relevant information from the database. For example, if a user searches for "nearby daycare centers," the server extracts information on the most suitable daycare centers based on the user's current location (GPS data) and the keywords.

[0568] Feedback Management

[0569] The server receives feedback from users and adds it to the database. This provides accurate and reliable information that can be helpful to other users.

[0570] Profile update

[0571] The server updates user profiles based on the user's search history and feedback, customizing future search results. This customization provides more accurate information.

[0572] Terminal processing

[0573] Display of the user interface

[0574] The device provides an intuitive user interface. It features a search bar, filtering options, reviews, and other elements, designed to make it easy for users to find the information they need.

[0575] Submit a search query

[0576] When a user enters keywords into the search bar and presses the search button, the device sends that search query to the server. This allows the server to retrieve information that is in line with the user's intent.

[0577] Displaying search results

[0578] The system receives search results sent from the server and displays them to the user. This includes information such as the name, rating, distance, and fees of childcare facilities, educational institutions, and medical facilities.

[0579] Provide feedback

[0580] Users can provide feedback about the facilities and institutions they have used. The device sends this feedback to the server.

[0581] User actions

[0582] Execute search

[0583] The user uses the application to search for things like "nearby daycare centers." The search query and location information are sent to the server.

[0584] View results

[0585] Users view the search results returned from the server and check detailed information about facilities and organizations that interest them.

[0586] Provide feedback

[0587] This system provides feedback on facilities and institutions that users have actually visited. This feedback includes ratings and comments, which are sent from the user's device to the server.

[0588] Specific example

[0589] Example 1: Searching for and booking a daycare center

[0590] 1. The user searches for "nearby daycare centers" on their device.

[0591] 2. The terminal sends the search query to the server.

[0592] 3. The server accesses the database and retrieves information about the appropriate daycare center.

[0593] 4. The server sends the results back to the terminal.

[0594] 5. The device displays the results to the user, who can view detailed information, reviews, pricing, etc.

[0595] 6. The user sends a reservation request from their device to book a daycare center they like.

[0596] 7. The server contacts the daycare center to confirm the reservation and sends the result to the terminal.

[0597] Example 2: Recommended extracurricular activities for children

[0598] 1. The user searches for "children's English classes" on their device.

[0599] 2. The device requests classrooms that it might be interested in from the server, based on its past search history and user profile.

[0600] 3. The server extracts information on the most suitable English language school for the user from the database.

[0601] 4. The results are sent back to the device and displayed on the device.

[0602] 5. Users can view detailed information about the classroom and make reservations or inquiries.

[0603] This system allows users to easily and quickly obtain relevant information within a single application, significantly reducing research time. Furthermore, information is updated based on user feedback, ensuring that the information is always up-to-date and reliable.

[0604] The following describes the processing flow.

[0605] Processing steps for searching for and providing feedback on daycare centers

[0606] Step 1: User search request

[0607] The user enters "nearby daycare" into the device's search screen and taps the search button.

[0608] Step 2: Submit your search query

[0609] The terminal sends the entered search query to the server as an HTTP request.

[0610] Step 3: Receiving the Request

[0611] The server receives a search request from the terminal.

[0612] Step 4: Database Reference

[0613] The server accesses a database containing data about daycare centers and extracts information on the most suitable daycare center based on the user's current location (GPS data) and keywords.

[0614] Step 5: Filtering and scoring data

[0615] The server filters relevant daycare centers based on location information and keywords, and calculates a score for each daycare center based on the user's past search history and reputation data.

[0616] Step 6: Generating Results

[0617] The server generates the filtering and scoring results in JSON format and prepares to send them back to the terminal.

[0618] Step 7: Receiving the Results

[0619] The terminal receives search results from the server.

[0620] Step 8: Perspective of the results

[0621] The terminal parses the received JSON data and converts it into a structured list or card view.

[0622] Step 9: Displaying search results

[0623] The device displays search results to the user in a viewable format, including information such as the name, rating, distance, and fees of each daycare center.

[0624] Step 10: View detailed information

[0625] Users select a daycare center they are interested in from the displayed search results and tap it to go to the detailed information page.

[0626] Step 11: Entering Feedback

[0627] Users can use the app to provide feedback (such as star ratings and comments) after actually visiting or using the daycare center.

[0628] Step 12: Submitting Feedback

[0629] The device sends the user's input to the server.

[0630] Step 13: Receiving Feedback

[0631] The server receives feedback sent from the terminal.

[0632] Step 14: Update the database

[0633] The server saves the received feedback to the database and updates the relevant nursery school information, reflecting the ratings and comments.

[0634] Step 15: Update your profile

[0635] The server also updates the user's profile information, incorporating feedback into future search results.

[0636] These steps allow users to quickly and efficiently obtain the necessary information about daycare centers, and the feedback they provide will be used to improve the search function in the future.

[0637] (Example 1)

[0638] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0639] Conventional information gathering and management systems have resulted in scattered information related to childcare facilities, educational institutions, and medical facilities, making it difficult for users to efficiently obtain the necessary information. Furthermore, there was a lack of effective ways to utilize user feedback, leading to problems with the accuracy and reliability of search results. Additionally, the ability to provide optimal facility information based on user location information was insufficient. To address these challenges, a system is needed that centrally integrates information gathering, searching, display, feedback management, and customization functions.

[0640] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0641] In this invention, the server includes means for collecting and integrating information related to childcare facilities, educational institutions, and medical institutions; means for processing search queries from users based on the information and extracting relevant information; means for transmitting the extracted information to a user terminal and displaying it to the user; means for receiving feedback from the user and reflecting it in a database; means for customizing future search results based on the user's search history and feedback information; means for displaying a user interface; means for transmitting search queries from the terminal to the server; means for displaying search results on the terminal; means for transmitting feedback from the terminal to the server; means for cleaning and deduplication of collected information; means for analyzing search queries; and means for extracting and formatting optimal information from the database. As a result, users can efficiently obtain information on a centralized platform and always obtain the latest and most reliable information by utilizing feedback.

[0642] "Means of collecting and integrating information" refers to the function of collecting data from various sources related to childcare facilities, educational institutions, and medical institutions, and organizing it to eliminate duplication and inconsistencies for centralized management.

[0643] "Means for processing search queries" refers to functions that analyze search queries submitted by users and extract relevant information from the database.

[0644] "Means of sending information to a user terminal and displaying it to the user" refers to a function that formats information obtained from a server and displays it on the terminal through a user interface.

[0645] "Means of receiving feedback and reflecting it in the database" refers to a function that analyzes feedback submitted by users and adds or updates it to the database.

[0646] "Means of customizing future search results based on search history and feedback information" refers to a function that uses past search history and feedback to update the user profile and provide next search results in a way that is more tailored to the user.

[0647] "Means of displaying a user interface" refers to a function that displays a graphical interface on the terminal that allows the user to operate it intuitively.

[0648] "Means of sending search queries from a terminal to a server" refers to a function that sends search queries entered by the user to a server via the network.

[0649] "Means of displaying search results on a device" refers to a function that displays search results sent from the server on the user's device and provides them visually.

[0650] "Means of sending feedback from the terminal to the server" refers to a function that sends user-entered feedback to the server.

[0651] "Means for cleaning and deduplication of collected information" refers to a function that analyzes collected data using cleansing tools and removes duplicate or inaccurate data.

[0652] "Means for analyzing search queries" refers to a function that analyzes the search queries received from users, extracts keywords, and understands their meaning.

[0653] "Means for extracting and formatting optimal information from a database" refers to a function that retrieves relevant information from the database based on extracted keywords and organizes it in a format that is easy for the user to understand.

[0654] This invention relates to a system for collecting and centrally managing information related to childcare facilities, educational institutions, and medical institutions. The system includes means for collecting and integrating information, processing search queries, displaying information on user terminals, receiving feedback, and customizing information based on search history. This allows users to effectively obtain necessary information and update it based on feedback to provide the most up-to-date information.

[0655] Specific hardware and software to be used

[0656] server

[0657] The server is responsible for database management, information gathering, processing search queries, managing feedback, and updating profiles. The main software tools used are as follows:

[0658] Database Administration: MySQL

[0659] Data collection: Web scraping tools, APIs

[0660] Data cleansing: Apache Spark

[0661] Natural Language Processing: NLTK

[0662] Server-side framework: Django

[0663] terminal

[0664] The terminal is responsible for displaying the user interface, sending search queries, displaying search results, and providing feedback. The main software technologies used are as follows:

[0665] Frontend framework: React

[0666] Data transmission and reception: HTTP protocol

[0667] User

[0668] Users operate the device, perform searches, view results, and provide feedback.

[0669] Specific example

[0670] Example 1: Searching for and booking a daycare center

[0671] 1. The user searches for "nearby daycare centers" on their device.

[0672] 2. The terminal sends the search query to the server.

[0673] 3. The server refers to the database and retrieves information about the appropriate daycare center.

[0674] 4. The server sends the results back to the terminal.

[0675] 5. The device displays the results to the user, who can then view detailed information, reviews, pricing, etc.

[0676] 6. The user sends a reservation request from their device to reserve a daycare center they like.

[0677] 7. The server coordinates with the daycare center to confirm the reservation and sends the result to the terminal.

[0678] Example of a prompt:

[0679] "I'm looking for a daycare center in my neighborhood. Could you recommend any good ones?"

[0680] Example 2: Recommended extracurricular activities for children

[0681] 1. The user searches for "children's English classes" on their device.

[0682] 2. The device requests classrooms that it might be interested in from the server, based on its past search history and user profile.

[0683] 3. The server extracts information on the most suitable English language school for the user from the database.

[0684] 4. The results are sent back to the device and displayed on the device.

[0685] 5. Users can view detailed information about the classroom and make reservations or inquiries.

[0686] Example of a prompt:

[0687] "I'm looking for an English class for my child. Could you recommend one?"

[0688] Specific examples of actions

[0689] Information gathering and integration

[0690] The server automatically collects information related to childcare facilities, educational institutions, and medical institutions using web scraping tools and APIs. The collected information is cleansed using Apache Spark to remove duplicates and inconsistencies, and then stored in a MySQL database.

[0691] Processing search queries

[0692] When a user enters and submits a search query on their device, the query is sent to the server via the HTTP protocol. The server uses NLTK to parse the query and extract keywords. Based on the extracted keywords, the server retrieves relevant information from the database and formats it in JSON format.

[0693] Displaying search results

[0694] The formatted search results are sent to the device via the HTTP protocol. The device then displays the search results to the user using React. The user interface is intuitive and easy to use, allowing users to visually check facility ratings, distance, prices, and more.

[0695] Provide feedback

[0696] After a user uses a facility, they enter feedback. This feedback is sent from the terminal to the server, which analyzes it and adds it to the database. This improves the accuracy of future search results.

[0697] This system allows users to easily and quickly obtain relevant information within a single application, significantly reducing research time. Furthermore, information is updated based on user feedback, ensuring that the information is always up-to-date and reliable.

[0698] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0699] Step 1: Information gathering and cleaning

[0700] The server collects information related to childcare facilities, educational institutions, and medical institutions from official websites, review sites, summary sites, personal blogs, and other sources. This information is obtained using web scraping tools and APIs.

[0701] Input: Website URL or API endpoint

[0702] Data processing: Collected information is analyzed using Apache Spark to remove duplicate and inaccurate data.

[0703] Output: Clean and unified dataset

[0704] Specifically, the server analyzes the HTML structure of the web page and extracts the necessary information (such as the facility's name, address, rating, and price). It then removes duplicate and inaccurate data and stores the final dataset in a MySQL database.

[0705] Step 2: Receiving User Queries

[0706] The terminal receives search queries through the user interface. When the user enters keywords into the search bar and presses the search button, the search query is sent from the terminal to the server.

[0707] Input: Keywords entered by the user (e.g., "neighborhood nursery school")

[0708] Output: Search query sent to the server as an HTTP request

[0709] Specifically, the device captures a click event of the search button, and based on that event, converts the user input into an HTTP request format and sends it to the server.

[0710] Step 3: Analyze the search query

[0711] The server analyzes the received search query. Using NLP (Natural Language Processing) tools, it breaks down the query into tokens and extracts the main keywords.

[0712] Input: Search query sent to the server (e.g., "nearby daycare")

[0713] Data processing: Use NLTK to break down queries and extract key keywords (e.g., "neighborhood," "nursery school").

[0714] Output: Extracted keyword set

[0715] Specifically, the server retrieves the query text, tokenizes it using the NLTK library, and identifies the main keywords.

[0716] Step 4: Extracting relevant information

[0717] The server searches the database based on the extracted keywords and retrieves relevant information. It also takes the user's current location (GPS data) into consideration to extract the most suitable results.

[0718] Input: Extracted keyword set, user's current location (e.g., GPS coordinates)

[0719] Data processing: Create database queries and retrieve relevant information from the MySQL database.

[0720] Output: A set of related information (e.g., a list of daycare centers)

[0721] Specifically, the server creates an SQL query based on keywords and location information, and extracts a list of the most suitable daycare centers from the database.

[0722] Step 5: Formatting the search results

[0723] The server formats the acquired information into a user-friendly format. It uses data formats such as JSON to organize information such as facility names, ratings, addresses, and prices.

[0724] Input: Set of related information

[0725] Data processing: Convert the information into JSON format and organize it as an object containing the attributes of each facility (name, rating, address, price).

[0726] Output: Formatted search results

[0727] Specifically, the server converts the information retrieved from the database into a JSON object and structures it in a visually easy-to-understand format.

[0728] Step 6: Submit search results

[0729] The server sends the formatted search results to the terminal. This is typically sent as an HTTP response.

[0730] Input: Formatted search results

[0731] Output: Search results sent to the terminal as an HTTP response

[0732] Specifically, the server includes the search results in JSON format in the HTTP response body and sends it to the terminal.

[0733] Step 7: Displaying search results

[0734] The terminal receives search results sent from the server and displays them to the user. The list of facilities is visually displayed through the user interface.

[0735] Input: Search results received from the server

[0736] Output: Visual list of facilities displayed in the user interface

[0737] Specifically, the device parses the HTTP response and uses React to display the search results in a card format representing the facilities.

[0738] Step 8: Provide feedback

[0739] Users enter feedback about the facilities they used. The entered feedback is sent from the terminal to the server.

[0740] Input: User-entered feedback

[0741] Output: Feedback sent to the server as an HTTP request

[0742] Specifically, when a user enters their rating or comments into the feedback input form and presses the submit button, the feedback data is sent from the device to the server.

[0743] Step 9: Save Feedback

[0744] The server receives the feedback and stores it in the database. The analyzed feedback is used to improve search results in the future.

[0745] Input: Feedback sent from the device

[0746] Data processing: Analyze feedback and add it to the database.

[0747] Output: Feedback entries saved in the database

[0748] Specifically, the server analyzes the feedback it receives and then inserts it into the appropriate table in the MySQL database.

[0749] Step 10: Update your profile

[0750] The server updates the user profile based on the user's search history and feedback.

[0751] Input: User's search history, feedback

[0752] Data processing: Update user profiles and implement customizations based on the next search results.

[0753] Output: Updated user profile

[0754] Specifically, the server updates the user's profile information based on their past search history and feedback, creating a foundation for providing more accurate results in future search queries.

[0755] (Application Example 1)

[0756] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0757] Information regarding childcare facilities, educational institutions, and medical facilities presents a problem: users cannot quickly obtain the information they need and must gather it from multiple sources. Furthermore, search results are uniform and not customized based on the user's location or past search history, resulting in low user convenience. In addition, it is difficult for parents to find appropriate facilities and navigate accordingly when dropping off or picking up their children. As a result, it becomes a time-consuming and laborious process.

[0758] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0759] In this invention, the server includes means for collecting and integrating information related to childcare facilities, educational institutions, and medical institutions; means for processing search queries from users based on the information and extracting relevant information; means for transmitting the extracted information to a user terminal and displaying it to the user; means for receiving feedback from users and reflecting it in a database; means for customizing future search results based on the user's search history and feedback information; means for calculating the optimal route to childcare facilities, educational institutions, and medical institutions based on the user's location information and destination and providing navigation; and, as an example of application, means for providing information on childcare facilities, educational institutions, and medical institutions through an application integrated into the infotainment system of an autonomous vehicle. As a result, users can obtain necessary information quickly and centrally, customize it based on the user's location information and past search history, and enable parents to efficiently search for appropriate facilities when dropping off or picking up their children and reach their destination via the optimal route.

[0760] A "childcare facility" is a facility that takes in infants and young children during the day and provides them with education and childcare.

[0761] An "educational institution" refers to any institution that provides education, such as schools, cram schools, or extracurricular activity classes.

[0762] A "medical institution" is a facility that provides medical services, such as a hospital, clinic, or medical office.

[0763] "Means of collecting and integrating information" refers to a system that gathers data from various sources, centralizes it, and stores it in a database.

[0764] "Means for processing search queries" refers to a system that analyzes user search input and extracts relevant information from a database.

[0765] "Means of transmitting and displaying information" refers to a system that transmits extracted information to the user's terminal and presents it visually.

[0766] "A means of receiving feedback and reflecting it in the database" refers to a system that adds user feedback information, such as ratings and comments, to a database and updates the information.

[0767] "Means for customizing search results based on search history and feedback information" refers to a system that analyzes a user's past search history and provided feedback to deliver personalized search results.

[0768] "A means of calculating the optimal route based on location information and destination and providing navigation" refers to a system that calculates and guides the user to the optimal travel route based on their current location and set destination.

[0769] An "infotainment system for autonomous vehicles" is an information system installed in autonomous vehicles that includes navigation and entertainment functions.

[0770] A "user terminal" refers to a smartphone, tablet, or other electronic device used by a user to receive and interact with information.

[0771] This invention relates to a system for collecting and centrally managing information related to childcare facilities, educational institutions, and medical institutions. The system includes means for collecting and integrating information, processing search queries, displaying information on a user terminal, receiving feedback, and customizing based on search history. Furthermore, it is designed to be efficiently utilized through an application that integrates with the infotainment system of an autonomous vehicle and provides navigation functionality.

[0772] Server Processing

[0773] The server collects information from official websites, reviews, summary sites, and personal blogs related to childcare facilities, educational institutions, and medical institutions, and stores it in a database. This database serves to eliminate duplication and inconsistencies through centralized information management. Data scraping tools and APIs are used to collect information. Next, the server receives search queries submitted by users and extracts relevant information from the database. For example, if a user searches for "nearby daycare centers," the server extracts information on the most suitable daycare centers based on the user's current location (GPS data) and keywords. The server also receives feedback from users and adds it to the database. This provides accurate and reliable information that can be helpful to other users. Furthermore, the user profile is updated based on the user's search history and provided feedback to customize future search results. This customization provides even more accurate information.

[0774] Terminal processing

[0775] The device provides an intuitive user interface. It displays a search bar, filtering options, reviews, and other features, designed to help users easily find the information they need. When a user enters keywords into the search bar and presses the search button, the device sends the search query to the server. This retrieves information from the server based on the user's intent. The device receives the search results from the server and displays them to the user. This includes information such as the name, rating, distance, and fees of childcare facilities, educational institutions, and medical facilities. Users can also provide feedback about the facilities and institutions they have used, and the device sends this feedback to the server.

[0776] Navigation function of autonomous vehicles

[0777] Furthermore, these functions will also be applied to the infotainment systems of autonomous vehicles. When parents are dropping off or picking up their children, the autonomous vehicle's screen can immediately search for the most suitable educational or medical facilities and provide route guidance. For example, a parent can search for "nearby daycare centers," and the app will use the current location information to find and display a list of the most suitable daycare centers. Then, the autonomous vehicle will start navigation with the daycare center selected by the parent as the destination. This function allows users to travel along the most optimal route to their destination.

[0778] Hardware and software

[0779] The hardware used includes infotainment systems for autonomous vehicles, smartphones, tablets, and communication modules. The software includes data scraping tools, APIs, GPS functionality, and internet connectivity (including the requests library). Data acquisition and processing utilize RESTful APIs to retrieve necessary information from servers. An algorithm has also been developed to calculate the optimal route based on the user's location.

[0780] Examples of specific cases and prompt statements

[0781] As a concrete example, if a parent searches for a "nearby daycare center" using an autonomous vehicle, the following prompt message will be used.

[0782] "Please search for the nearest highly-rated daycare center from your current location."

[0783] "Please calculate the shortest route to the daycare center selected by the user."

[0784] This allows users to easily and quickly obtain relevant information within a single application, significantly reducing the time spent on research. Furthermore, information is updated based on user feedback, ensuring that the information is always up-to-date and reliable.

[0785] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0786] Step 1:

[0787] The user launches the application on their device and searches for information on childcare facilities, educational institutions, and medical facilities.

[0788] Specific action: The user enters keywords into the search bar displayed on the device screen and presses the search button.

[0789] Input: Keyword (e.g., "nearby daycare"), user's current location data (GPS information).

[0790] Output: A search query is generated and sent to the server.

[0791] Step 2:

[0792] The server receives search queries sent by users and extracts relevant information from the database.

[0793] Specific operation: The server executes a search query against the database and retrieves information on relevant childcare facilities, educational institutions, and medical institutions.

[0794] Input: Search query, facility information in the database.

[0795] Output: A list of extracted information.

[0796] Step 3:

[0797] The server extracts the information and sends it to the terminal, which then displays it to the user.

[0798] Specific operation: The server sends the acquired information to the user's terminal, which then displays it on the screen. This information includes facility name, rating, distance, etc.

[0799] Input: A list of extracted information.

[0800] Output: A list of facility information displayed on the user's terminal.

[0801] Step 4:

[0802] The user reviews the facility information and selects the facility they wish to use.

[0803] Specific action: The user selects a facility from the displayed list for which they want to view detailed information.

[0804] Input: Display list of facility information.

[0805] Output: Detailed information about the selected facility.

[0806] Step 5:

[0807] Based on the detailed information of the facility selected by the user, the device sends a request to begin navigation.

[0808] Specific operation: When the user presses the navigation button, the device sends a navigation start request to the server based on the location information of the selected facility.

[0809] Input: Location information of the selected facility.

[0810] Output: Navigation start request.

[0811] Step 6:

[0812] The server calculates the optimal route based on the user's current location and destination location information, and sends the navigation data to the terminal.

[0813] Specific operation: The server executes an algorithm to calculate the route based on GPS data and the location information of the selected facility. The calculated route information is then sent to the terminal.

[0814] Input: User's current location data, location information of the selected facility.

[0815] Output: Calculated optimal route information.

[0816] Step 7:

[0817] The device receives navigation data and displays and guides the user along the optimal route.

[0818] Specific operation: The terminal displays the received route information on a map and guides the user with voice and visual instructions.

[0819] Input: Calculated optimal route information.

[0820] Output: Navigation display and voice guidance.

[0821] Step 8:

[0822] After the user reaches their destination, they provide feedback.

[0823] Specific operation: Users enter ratings and comments about the facilities they visit and send feedback to the server via their device.

[0824] Input: User review comments.

[0825] Output: Feedback information sent to the server.

[0826] Step 9:

[0827] The server receives feedback and updates the database accordingly.

[0828] Specific operation: The server analyzes the received feedback information and updates the corresponding entry in the database.

[0829] Input: Feedback information submitted by the user.

[0830] Output: Updated database information.

[0831] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0832] The present invention is a system that collects and centrally manages information related to childcare facilities, educational institutions, and medical institutions, and further combines it with an emotion engine that recognizes user emotions. This system includes means for collecting and integrating information, means for processing search queries, means for displaying information on a user terminal, means for receiving feedback, means for customizing based on search history, and an emotion engine.

[0833] Server Processing

[0834] Database Management

[0835] The server collects information from official websites, reviews, summary sites, and personal blogs related to childcare facilities, educational institutions, and medical institutions, and stores it in a database. This database serves to eliminate duplication and inconsistencies through centralized information management.

[0836] Processing search queries

[0837] The server receives search queries submitted by users and extracts relevant information from the database. For example, if a user searches for "nearby daycare centers," the server extracts information on the most suitable daycare centers based on the user's current location (GPS data) and the keywords.

[0838] Feedback Management

[0839] The server receives feedback from users and adds it to the database. This provides accurate and reliable information that can be helpful to other users.

[0840] Profile update

[0841] The server updates user profiles based on the user's search history and feedback, customizing future search results. This customization provides more accurate information.

[0842] Emotional Engine Processing

[0843] Recognition of emotions

[0844] The server recognizes the user's emotions through analysis of their facial expressions, voice, and text. This uses facial recognition technology and natural language processing technology.

[0845] Emotion-based filtering

[0846] The sentiment engine filters or ranks search results based on the recognized user's emotions. For example, if a user is feeling stressed, it prioritizes displaying activities that can help reduce stress.

[0847] Dynamic adjustment

[0848] The emotion engine dynamically changes the information and recommendations displayed in response to changes in the user's emotions. This can increase user satisfaction.

[0849] Terminal processing

[0850] Display of the user interface

[0851] The device provides an intuitive user interface. It features a search bar, filtering options, reviews, and other elements, designed to make it easy for users to find the information they need.

[0852] Submit a search query

[0853] When a user enters keywords into the search bar and presses the search button, the device sends that search query to the server. This allows the server to retrieve information that is in line with the user's intent.

[0854] Displaying search results

[0855] The system receives search results sent from the server and displays them to the user. This includes information such as the name, rating, distance, and fees of childcare facilities, educational institutions, and medical facilities.

[0856] Provide feedback

[0857] Users can provide feedback about the facilities and institutions they have used. The device sends this feedback to the server.

[0858] User actions

[0859] Execute search

[0860] The user uses the application to search for things like "nearby daycare centers." The search query and location information are sent to the server.

[0861] View results

[0862] Users view the search results returned from the server and check detailed information about facilities and organizations that interest them.

[0863] Provide feedback

[0864] This system provides feedback on facilities and institutions that users have actually visited. This feedback includes ratings and comments, which are sent from the user's device to the server.

[0865] Specific example

[0866] Example 1: Searching for daycare centers and displaying recommendations based on sentiment.

[0867] 1. The user searches for "nearby daycare centers" on their device.

[0868] 2. The emotion engine recognizes the user's stress level as high.

[0869] 3. The server prioritizes displaying daycare centers that can reduce stress (for example, daycare centers with a rich natural environment).

[0870] 4. Search results are sent to and displayed on the device.

[0871] 5. The user reviews the details and makes a reservation at the daycare center.

[0872] Thus, by providing information that takes user emotions into consideration, the present invention can improve the user experience and provide more personalized services.

[0873] The following describes the processing flow.

[0874] Processing steps for searching for daycare centers and displaying sentiment-based recommendations

[0875] Step 1: Display the search screen

[0876] The device displays a search screen to the user. It provides an interface that includes a search bar and filtering options.

[0877] Step 2: Enter your search query

[0878] The user enters "nearby daycare" into the search bar and taps the search button.

[0879] Step 3: Submit your search query

[0880] The terminal sends the entered search query to the server as an HTTP request.

[0881] Step 4: Receiving the Request

[0882] The server receives a search request from the terminal.

[0883] Step 5: Receiving emotional data

[0884] The server's emotion engine receives voice, text, and facial expression data transmitted from the terminal to recognize the user's emotions. For example, it measures the user's stress level using voice tone and expression, as well as facial recognition technology.

[0885] Step 6: Database Reference

[0886] The server accesses a database containing data about daycare centers and extracts information on the most suitable daycare center based on the user's current location (GPS data) and keywords.

[0887] Step 7: Filtering and scoring data

[0888] The server's sentiment engine filters and ranks search results based on the recognized user's emotions. For example, if a user is feeling stressed, it prioritizes displaying daycare centers that offer a relaxing environment.

[0889] Step 8: Generating Results

[0890] The server generates the filtering and scoring results in JSON format and prepares to send them back to the terminal.

[0891] Step 9: Receiving Results

[0892] The terminal receives search results from the server.

[0893] Step 10: Perspective of the results

[0894] The terminal parses the received JSON data and converts it into a structured list or card view.

[0895] Step 11: Displaying search results

[0896] The device displays search results to the user in a viewable format, including information such as the name, rating, distance, and fees of each daycare center.

[0897] Step 12: View detailed information

[0898] Users select a daycare center they are interested in from the displayed search results and tap it to go to the detailed information page.

[0899] Step 13: Entering Feedback

[0900] Users can use the app to provide feedback (for example, star ratings, comments, and changes in their feelings) after actually visiting or using the daycare center.

[0901] Step 14: Submitting Feedback

[0902] The device sends the user's input to the server.

[0903] Step 15: Receiving Feedback

[0904] The server receives feedback sent from the terminal.

[0905] Step 16: Update the database

[0906] The server saves the received feedback to the database and updates the relevant nursery school information, reflecting the ratings and comments.

[0907] Step 17: Update your profile

[0908] The server also updates the user's profile information, incorporating feedback into future search results.

[0909] This allows users to quickly and efficiently obtain the necessary information about daycare centers, and the feedback they provide will be used to improve the search function for future use. In addition, by using an emotion engine, it becomes possible to provide personalized information based on the user's emotions.

[0910] (Example 2)

[0911] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0912] Information related to childcare facilities, educational institutions, and medical institutions is diverse, making it difficult to efficiently collect and centrally manage it. Furthermore, providing users with the most relevant information requires personalized information that considers their emotions and circumstances, rather than simply relying on search queries. However, current systems do not adequately consider these factors in their information provision, highlighting the need for improved user experience. Additionally, there is a lack of effective means to utilize user feedback to improve future search results.

[0913] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0914] In this invention, the server includes means for collecting and integrating information related to childcare facilities, educational institutions, and medical institutions; means for processing search queries from users based on the information and extracting relevant information; means for transmitting the extracted information to a user terminal and displaying it to the user; means for receiving feedback from users and reflecting it in a database; means for customizing future search results based on the user's search history and feedback information; means for recognizing the user's emotions through analysis of the user's facial expressions, voice, and text; means for filtering or ranking search results based on the recognized user emotions; and means for dynamically changing the displayed information and recommendations in accordance with changes in the user's emotions. This enables the provision of personalized information that takes into account the user's emotions and circumstances. Furthermore, it allows for the effective use of user feedback to improve future search results.

[0915] A "childcare facility" refers to a facility that provides temporary or long-term care for infants and children.

[0916] An "educational institution" refers to an organization or facility that teaches academic subjects or skills, and includes schools, cram schools, and vocational schools.

[0917] A "medical institution" refers to a facility that provides medical services such as treatment, diagnosis, and prevention, and includes hospitals and clinics.

[0918] "Means of collecting and integrating information" refers to methods or devices for obtaining necessary data from the internet or other sources, organizing it, and storing it in a database.

[0919] "Means for processing search queries" refers to a method or device that understands the search criteria entered by the user and extracts appropriate data from a database based on those criteria.

[0920] "Means for transmitting information to a user's terminal and displaying it to the user" refers to a method or device for transmitting search results to a user's device and displaying them.

[0921] "Means of receiving feedback and reflecting it in the database" refers to a method or device for receiving ratings and comments from users and adding that information to a database.

[0922] "Means for customizing future search results based on search history and feedback information" refers to methods or devices that analyze past search history and feedback and individually adjust future search results based on that information.

[0923] "Means of recognizing user emotions through analysis of user facial expressions, voice, and text" refers to methods or devices that detect a user's emotional state using facial recognition technology, voice analysis, and natural language processing.

[0924] "Means of filtering or ranking search results based on emotion" refers to methods or devices that change the priority of search results according to the perceived emotions of the user.

[0925] "Means of dynamically changing displayed information and recommendations in response to changes in the user's emotions" refers to a method or device that updates displayed content and recommendations in real time when the user's emotions change.

[0926] The present invention is a system for collecting and integrating information related to childcare facilities, educational institutions, and medical institutions, and for providing personalized information that takes into account the user's emotions. This system includes means for collecting and integrating information, means for processing search queries, means for displaying information on a user terminal, means for receiving feedback, means for customizing based on search history, and an emotion engine.

[0927] Server Processing

[0928] Database Management

[0929] The server uses web scraping techniques to collect information about childcare facilities, educational institutions, and medical institutions from official websites, review sites, summary sites, personal blogs, etc., and stores it in a database. Python's BeautifulSoup library is used for data collection. MySQL or similar databases are used, and pre-processing algorithms are implemented to eliminate duplication and inconsistencies.

[0930] Processing search queries

[0931] The server receives search queries submitted by users and extracts relevant information from the database. It generates SQL queries based on the search queries and the user's location information (GPS data) and executes them against the database. The extracted information is temporarily held in memory.

[0932] Feedback Management

[0933] The server receives user feedback and adds it to the database. The feedback is analyzed using text processing techniques and stored in the database as ratings and comment information. This provides accurate and reliable information that can be helpful to other users.

[0934] Profile update

[0935] The server updates the user profile based on the user's search history and feedback provided, customizing future search results. This updated profile information is used for subsequent searches, resulting in more personalized results.

[0936] Emotional Engine Processing

[0937] Recognition of emotions

[0938] The server recognizes the user's emotions through analysis of their facial expressions, voice, and text. This analysis utilizes OpenCV, the Google Cloud Speech-to-Text API, and natural language processing techniques. The emotion engine filters or ranks search results based on the recognized emotions.

[0939] Emotion-based filtering

[0940] The emotion engine dynamically changes the priority of search results, for example, by prioritizing activities that can reduce stress when a user is feeling stressed.

[0941] Dynamic adjustment

[0942] The emotion engine updates the displayed information and recommendations in real time in response to changes in the user's emotions. This can increase user satisfaction.

[0943] Terminal processing

[0944] Display of the user interface

[0945] The device provides an intuitive user interface, displaying a search bar, filtering options, reviews, and more. It also includes a list of search results and a map display.

[0946] Submit a search query

[0947] When a user enters keywords into the search bar and presses the search button, the device sends that search query and location information to the server.

[0948] Displaying search results

[0949] The terminal displays search results sent from the server to the user. Information such as the name, rating, distance, and fees of childcare facilities, educational institutions, and medical facilities are displayed.

[0950] Provide feedback

[0951] Users can provide feedback about the facilities and institutions they have used, and the device sends this feedback to the server.

[0952] User actions

[0953] Execute search

[0954] The user uses the application to search for things like "nearby daycare centers." The search query and location information are sent to the server via the device.

[0955] View results

[0956] Users view the search results returned from the server and check detailed information about facilities and organizations that interest them.

[0957] Provide feedback

[0958] This system provides feedback on facilities and institutions that users have actually visited. This feedback includes ratings and comments, which are sent from the user's device to the server.

[0959] Specific example

[0960] Search for daycare centers and display recommendations based on sentiment.

[0961] 1. The user searches for "nearby daycare centers" on their device.

[0962] 2. The emotion engine recognizes the user's stress level as high.

[0963] 3. The server prioritizes displaying daycare centers that can reduce stress (e.g., daycare centers with a rich natural environment).

[0964] 4. Search results are sent to and displayed on the device.

[0965] 5. The user reviews the details and makes a reservation at the daycare center.

[0966] Example of a prompt

[0967] "I'm looking for a local daycare center. Please recommend one that takes into account the feelings and status of the parents."

[0968] Thus, each processing step of the system consists of multiple substeps, each involving a specific action, and extends in detail from user input to data collection and feedback processing. The coordination of these various elements enables the provision of personalized information that takes into account the user's emotions and circumstances.

[0969] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0970] Step 1: Data collection and database management

[0971] Server operation

[0972] The server uses web scraping techniques to collect information about childcare facilities, educational institutions, and medical institutions from various websites. Specifically, it uses the Python BeautifulSoup library to extract data from official websites, review sites, summary sites, personal blogs, and other sources.

[0973] Input: Website URL

[0974] Data processing: Web page analysis and extraction of necessary information.

[0975] Output: Database where the extracted information is stored (e.g., MySQL)

[0976] The server removes duplicate data, verifies inconsistencies in the information, and centrally manages it in the database.

[0977] Step 2: Receiving and processing search queries

[0978] User and device behavior

[0979] The user enters a keyword (e.g., "nearby daycare") into the device's search bar and presses the search button. The device sends this search query and the user's location information (GPS data) to the server.

[0980] Input: Search query and location information

[0981] Data processing: Receive search queries and location information as parameters.

[0982] Output: Request to send to the server

[0983] Server operation

[0984] The server generates an SQL query based on the received search query and location information to extract relevant information from the database.

[0985] Input: Search query and location information

[0986] Data processing: Generation and execution of SQL queries

[0987] Output: The extracted data (information on childcare facilities, educational institutions, and medical institutions) is temporarily stored in memory.

[0988] Step 3: Emotion Recognition and Filtering

[0989] Server operation

[0990] The server analyzes the user's facial expressions, voice, and text to recognize their emotions. This analysis utilizes OpenCV, the Google Cloud Speech-to-Text API, and natural language processing technologies.

[0991] Input: User facial expression data, voice data, text data

[0992] Data processing: Analysis using sentiment analysis algorithms

[0993] Output: Emotion recognition results (e.g., stress level, emotion type)

[0994] The emotion engine filters search results based on recognized emotions, prioritizing and ranking highly relevant information.

[0995] Input: Sentiment recognition results and temporarily stored search results

[0996] Data processing: filtering and ranking

[0997] Output: Filtered and ranked search results

[0998] Step 4: Providing search results

[0999] Server operation

[1000] The server sends the filtered search results to the terminal.

[1001] Input: Filtered and ranked search results

[1002] Data processing: Convert to data format and send.

[1003] Output: Search results sent to the terminal

[1004] Terminal operation

[1005] The terminal displays search results received from the server to the user. This display can include list formats, map displays, and other formats.

[1006] Input: Search results sent from the server

[1007] Output: Search results displayed in the user interface

[1008] Step 5: Managing Feedback

[1009] User and device behavior

[1010] Users input feedback about the facilities and institutions they have used and send it to the server via their device.

[1011] Input: Feedback information such as ratings and comments.

[1012] Output: Feedback request from terminal to server

[1013] Server operation

[1014] The server analyzes the received feedback and updates the database.

[1015] Input: Feedback Information

[1016] Data processing: Text analysis of feedback and addition to database.

[1017] Output: Updated database

[1018] Step 6: Update Profile

[1019] Server operation

[1020] The server updates the user profile based on the user's search history and feedback provided, thereby customizing future search results.

[1021] Input: Search history and feedback information

[1022] Data processing: Profile analysis and updating

[1023] Output: Updated user profile

[1024] (Application Example 2)

[1025] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[1026] In today's internet environment, users find it difficult to find useful information from the vast amount of data available. In particular, there is a lack of systems that collect and appropriately present information directly related to daily life, such as that found in childcare facilities, educational institutions, and medical facilities. Furthermore, current search systems fail to provide information that takes into account the user's emotions and circumstances, thus failing to adequately enhance user satisfaction. Additionally, advertising displays lack sufficient customization to address user emotions and individual needs, resulting in reduced advertising effectiveness.

[1027] In Application Example 2, the specific processing performed by the specific processing unit 290 of the data processing device 12 is realized by the following means. In this invention, the server includes means for collecting and integrating information related to childcare facilities, educational institutions and medical institutions; means for processing search queries from users based on the information and extracting relevant information; means for transmitting the extracted information to a user terminal and displaying it to the user; means for receiving feedback from the user and reflecting it in a database; means for customizing future search results based on the user's search history and feedback information; means for recognizing the user's emotions and filtering or ranking search results based on those emotions; means for dynamically adjusting the information and recommendations displayed in accordance with changes in the user's emotions; and means for recommending individually customized advertisements based on the user's emotions and past search history. This makes it possible to provide information that is suitable for the user's emotions and individual needs, thereby improving user satisfaction. Furthermore, by customizing the display of advertisements, an improvement in advertising effectiveness can also be expected.

[1028] A "childcare facility" is a facility that takes in infants and young children during the day and provides education and care.

[1029] An "educational institution" is an organization established to provide education, such as a school or a cram school.

[1030] A "medical institution" is an organization that provides medical services, such as a hospital, clinic, or medical office.

[1031] "Means for collecting and integrating information" refers to methods and technologies for collecting and centrally managing information related to childcare facilities, educational institutions, and medical institutions from sources such as the internet.

[1032] "Means for processing search queries and extracting relevant information" refers to methods and technologies for finding relevant information from a database based on search queries submitted by users.

[1033] "Means for sending extracted information to a user's terminal and displaying it to the user" refers to methods and technologies for sending information extracted based on a search query to a user's terminal so that the user can view it.

[1034] "Means of receiving user feedback and reflecting it in the database" refers to methods and technologies for receiving opinions and evaluations provided by users and adding that information to a database.

[1035] "Means of customizing future search results based on user search history and feedback information" refers to methods and technologies that utilize a user's past search history and feedback to individually optimize future search results.

[1036] "Means for recognizing user sentiment and filtering or ranking search results based on that sentiment" refers to methods or technologies for analyzing user sentiment and selecting or ranking search results based on the results of that analysis.

[1037] "Means for dynamically adjusting the information and recommendations displayed in response to changes in the user's emotions" refers to methods and technologies that detect changes in the user's emotions in real time and change the information and recommendations displayed accordingly.

[1038] "Means of recommending individually customized ads based on user sentiment and past search history" refers to methods and technologies that consider a user's emotional state and past behavior to display individually optimized ads.

[1039] This invention improves user satisfaction and advertising effectiveness by adding a new function to a system that collects and centrally manages information on childcare facilities, educational institutions, and medical institutions: the ability to recognize user emotions and perform individual customization based on those emotions.

[1040] The server first collects information on childcare facilities, educational institutions, and medical institutions from official websites, review sites, summary sites, and personal blogs on the internet, and stores it in a database. This database plays a role in providing accurate and reliable information by eliminating duplication and inconsistencies through centralized information management.

[1041] When a user submits a search query, the server extracts information related to that query from its database. For example, if a user searches for "nearby daycare centers," the server extracts information on the most suitable daycare centers based on the user's current location (GPS data) and the keywords.

[1042] Next, the server receives feedback from users and adds it to the database, providing accurate information that can be helpful to other users. In addition, the server updates user profiles based on the user's search history and the feedback provided, customizing future search results for each individual user.

[1043] Furthermore, this system incorporates an emotion engine. The emotion engine recognizes the user's emotions by analyzing their facial expressions, voice, and text. This utilizes facial recognition and natural language processing technologies. Based on the recognized user emotions, the server filters or ranks search results, prioritizing the information the user is most likely to be interested in. The emotion engine can also dynamically change the displayed information and recommendations in response to changes in the user's emotions.

[1044] For example, when a user searches for "nearby daycare centers" on their device, if the emotion engine detects that the user's stress level is high, the server will prioritize displaying daycare centers with rich natural environments that can reduce stress. The search results are sent to the device, and the user can view them and check detailed information. In addition, when a user visits a specific daycare center and provides feedback such as ratings and comments, other users can also refer to that information.

[1045] Furthermore, it includes a feature that recommends personalized ads based on the user's emotions and past search history. For example, if a user is feeling stressed, ads for relaxation products and services can be displayed.

[1046] To realize this invention, the server uses an emotion engine that combines facial recognition and natural language processing technologies to analyze the user's emotions in detail. Furthermore, a high-performance server and appropriate database management software are used for database management. The user's terminal is provided with an intuitive user interface, enabling smooth searching and result display.

[1047] Example of a prompt:

[1048] "When a user is using an emotion-driven ad recommendation system, generate ads for relaxation products if their current emotion is stress."

[1049] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1050] Step 1:

[1051] The user enters a search query and presses the search button. The user's device retrieves the entered search query and the user's location information and sends this data to the server. The input data includes search keywords (e.g., "nearby daycare") and GPS data. The output is a search request that is sent to the server.

[1052] Step 2:

[1053] The server extracts relevant information from the database based on the received search query and location data. Specifically, it collects information on childcare facilities, educational institutions, and medical institutions, and selects those that match the search criteria. This process executes database queries and generates a list of matching facilities. The input is the search keyword and GPS data, and the output is a list of search results.

[1054] Step 3:

[1055] The server acquires a user's facial image and performs emotion recognition to filter search results using an emotion engine. The user's device captures a facial image using its camera and sends the image data to the server. The server analyzes the user's emotions using facial recognition and natural language processing technologies. The input is facial image data, and the output is the analyzed emotion data (e.g., "stressed").

[1056] Step 4:

[1057] The server filters or ranks search results based on the recognized user's emotions. For example, if the user is feeling stressed, it prioritizes childcare facilities with rich natural environments. This process takes emotion data and a list of search results as input, and outputs a list of filtered search results.

[1058] Step 5:

[1059] The server sends filtered search results to the user's device. The user's device receives the sent search results and displays them in the user interface. In this step, the data sent from the server is the input, and the information displayed on the device is the output. Specifically, detailed information such as the facility name, rating, distance, and price is displayed.

[1060] Step 6:

[1061] Users review the displayed search results and click on the details of facilities they are interested in to view more information. If a user selects a facility, that information is saved on their device. The input is the user's selection, and the output is the display of facility details.

[1062] Step 7:

[1063] Users visit a facility and provide feedback on their experience. The user terminal sends the text and evaluation data entered as feedback to the server. The input is the user's feedback data, and the output is the feedback request sent to the server.

[1064] Step 8:

[1065] The server reflects the received feedback data in the database, improving the reliability of the information. In this step, the feedback data is added to the database, and an updated database is generated. The input is the feedback data, and the output is the updated database.

[1066] Step 9:

[1067] The server generates and sends individually customized advertisements to the user's device based on the user's emotions and past search history. A generative AI model is used for ad generation. Using emotion data and past search history as input, a customized advertisement is output. This advertisement will be relevant to the user's current situation, such as offering relaxation products or services.

[1068] Example of a prompt:

[1069] "When a user is using an emotion-driven ad recommendation system, generate ads for relaxation products if their current emotion is stress."

[1070] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1071] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet Search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1072] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[1073] [Third Embodiment]

[1074] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[1075] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1076] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1077] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[1078] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1079] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1080] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1081] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1082] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1083] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1084] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1085] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[1086] This invention relates to a system for collecting and centrally managing information related to childcare facilities, educational institutions, and medical institutions. The system includes means for collecting and integrating information, means for processing search queries, means for displaying information on a user terminal, means for receiving feedback, and means for customizing based on search history.

[1087] Server Processing

[1088] Database Management

[1089] The server collects information from official websites, reviews, summary sites, and personal blogs related to childcare facilities, educational institutions, and medical institutions, and stores it in a database. This database serves to eliminate duplication and inconsistencies through centralized information management.

[1090] Processing search queries

[1091] The server receives search queries submitted by users and extracts relevant information from the database. For example, if a user searches for "nearby daycare centers," the server extracts information on the most suitable daycare centers based on the user's current location (GPS data) and the keywords.

[1092] Feedback Management

[1093] The server receives feedback from users and adds it to the database. This provides accurate and reliable information that can be helpful to other users.

[1094] Profile update

[1095] The server updates user profiles based on the user's search history and feedback, customizing future search results. This customization provides more accurate information.

[1096] Terminal processing

[1097] Display of the user interface

[1098] The device provides an intuitive user interface. It features a search bar, filtering options, reviews, and other elements, designed to make it easy for users to find the information they need.

[1099] Submit a search query

[1100] When a user enters keywords into the search bar and presses the search button, the device sends that search query to the server. This allows the server to retrieve information that is in line with the user's intent.

[1101] Displaying search results

[1102] The system receives search results sent from the server and displays them to the user. This includes information such as the name, rating, distance, and fees of childcare facilities, educational institutions, and medical facilities.

[1103] Provide feedback

[1104] Users can provide feedback about the facilities and institutions they have used. The device sends this feedback to the server.

[1105] User actions

[1106] Execute search

[1107] The user uses the application to search for things like "nearby daycare centers." The search query and location information are sent to the server.

[1108] View results

[1109] Users view the search results returned from the server and check detailed information about facilities and organizations that interest them.

[1110] Provide feedback

[1111] This system provides feedback on facilities and institutions that users have actually visited. This feedback includes ratings and comments, which are sent from the user's device to the server.

[1112] Specific example

[1113] Example 1: Searching for and booking a daycare center

[1114] 1. The user searches for "nearby daycare centers" on their device.

[1115] 2. The terminal sends the search query to the server.

[1116] 3. The server accesses the database and retrieves information about the appropriate daycare center.

[1117] 4. The server sends the results back to the terminal.

[1118] 5. The device displays the results to the user, who can view detailed information, reviews, pricing, etc.

[1119] 6. The user sends a reservation request from their device to book a daycare center they like.

[1120] 7. The server contacts the daycare center to confirm the reservation and sends the result to the terminal.

[1121] Example 2: Recommended extracurricular activities for children

[1122] 1. The user searches for "children's English classes" on their device.

[1123] 2. The device requests classrooms that it might be interested in from the server, based on its past search history and user profile.

[1124] 3. The server extracts information on the most suitable English language school for the user from the database.

[1125] 4. The results are sent back to the device and displayed on the device.

[1126] 5. Users can view detailed information about the classroom and make reservations or inquiries.

[1127] This system allows users to easily and quickly obtain relevant information within a single application, significantly reducing research time. Furthermore, information is updated based on user feedback, ensuring that the information is always up-to-date and reliable.

[1128] The following describes the processing flow.

[1129] Processing steps for searching for and providing feedback on daycare centers

[1130] Step 1: User search request

[1131] The user enters "nearby daycare" into the device's search screen and taps the search button.

[1132] Step 2: Submit your search query

[1133] The terminal sends the entered search query to the server as an HTTP request.

[1134] Step 3: Receiving the Request

[1135] The server receives a search request from the terminal.

[1136] Step 4: Database Reference

[1137] The server accesses a database containing data about daycare centers and extracts information on the most suitable daycare center based on the user's current location (GPS data) and keywords.

[1138] Step 5: Filtering and scoring data

[1139] The server filters relevant daycare centers based on location information and keywords, and calculates a score for each daycare center based on the user's past search history and reputation data.

[1140] Step 6: Generating Results

[1141] The server generates the filtering and scoring results in JSON format and prepares to send them back to the terminal.

[1142] Step 7: Receiving the Results

[1143] The terminal receives search results from the server.

[1144] Step 8: Perspective of the results

[1145] The terminal parses the received JSON data and converts it into a structured list or card view.

[1146] Step 9: Displaying search results

[1147] The device displays search results to the user in a viewable format, including information such as the name, rating, distance, and fees of each daycare center.

[1148] Step 10: View detailed information

[1149] Users select a daycare center they are interested in from the displayed search results and tap it to go to the detailed information page.

[1150] Step 11: Entering Feedback

[1151] Users can use the app to provide feedback (such as star ratings and comments) after actually visiting or using the daycare center.

[1152] Step 12: Submitting Feedback

[1153] The device sends the user's input to the server.

[1154] Step 13: Receiving Feedback

[1155] The server receives feedback sent from the terminal.

[1156] Step 14: Update the database

[1157] The server saves the received feedback to the database and updates the relevant nursery school information, reflecting the ratings and comments.

[1158] Step 15: Update your profile

[1159] The server also updates the user's profile information, incorporating feedback into future search results.

[1160] These steps allow users to quickly and efficiently obtain the necessary information about daycare centers, and the feedback they provide will be used to improve the search function in the future.

[1161] (Example 1)

[1162] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1163] Conventional information gathering and management systems have resulted in scattered information related to childcare facilities, educational institutions, and medical facilities, making it difficult for users to efficiently obtain the necessary information. Furthermore, there was a lack of effective ways to utilize user feedback, leading to problems with the accuracy and reliability of search results. Additionally, the ability to provide optimal facility information based on user location information was insufficient. To address these challenges, a system is needed that centrally integrates information gathering, searching, display, feedback management, and customization functions.

[1164] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1165] In this invention, the server includes means for collecting and integrating information related to childcare facilities, educational institutions, and medical institutions; means for processing search queries from users based on the information and extracting relevant information; means for transmitting the extracted information to a user terminal and displaying it to the user; means for receiving feedback from the user and reflecting it in a database; means for customizing future search results based on the user's search history and feedback information; means for displaying a user interface; means for transmitting search queries from the terminal to the server; means for displaying search results on the terminal; means for transmitting feedback from the terminal to the server; means for cleaning and deduplication of collected information; means for analyzing search queries; and means for extracting and formatting optimal information from the database. As a result, users can efficiently obtain information on a centralized platform and always obtain the latest and most reliable information by utilizing feedback.

[1166] "Means of collecting and integrating information" refers to the function of collecting data from various sources related to childcare facilities, educational institutions, and medical institutions, and organizing it to eliminate duplication and inconsistencies for centralized management.

[1167] "Means for processing search queries" refers to functions that analyze search queries submitted by users and extract relevant information from the database.

[1168] "Means of sending information to a user terminal and displaying it to the user" refers to a function that formats information obtained from a server and displays it on the terminal through a user interface.

[1169] "Means of receiving feedback and reflecting it in the database" refers to a function that analyzes feedback submitted by users and adds or updates it to the database.

[1170] "Means of customizing future search results based on search history and feedback information" refers to a function that uses past search history and feedback to update the user profile and provide next search results in a way that is more tailored to the user.

[1171] "Means of displaying a user interface" refers to a function that displays a graphical interface on the terminal that allows the user to operate it intuitively.

[1172] "Means of sending search queries from a terminal to a server" refers to a function that sends search queries entered by the user to a server via the network.

[1173] "Means of displaying search results on a device" refers to a function that displays search results sent from the server on the user's device and provides them visually.

[1174] "Means of sending feedback from the terminal to the server" refers to a function that sends user-entered feedback to the server.

[1175] "Means for cleaning and deduplication of collected information" refers to a function that analyzes collected data using cleansing tools and removes duplicate or inaccurate data.

[1176] "Means for analyzing search queries" refers to a function that analyzes the search queries received from users, extracts keywords, and understands their meaning.

[1177] "Means for extracting and formatting optimal information from a database" refers to a function that retrieves relevant information from the database based on extracted keywords and organizes it in a format that is easy for the user to understand.

[1178] This invention relates to a system for collecting and centrally managing information related to childcare facilities, educational institutions, and medical institutions. The system includes means for collecting and integrating information, processing search queries, displaying information on user terminals, receiving feedback, and customizing information based on search history. This allows users to effectively obtain necessary information and update it based on feedback to provide the most up-to-date information.

[1179] Specific hardware and software to be used

[1180] server

[1181] The server is responsible for database management, information gathering, processing search queries, managing feedback, and updating profiles. The main software tools used are as follows:

[1182] Database Administration: MySQL

[1183] Data collection: Web scraping tools, APIs

[1184] Data cleansing: Apache Spark

[1185] Natural Language Processing: NLTK

[1186] Server-side framework: Django

[1187] terminal

[1188] The terminal is responsible for displaying the user interface, sending search queries, displaying search results, and providing feedback. The main software technologies used are as follows:

[1189] Frontend framework: React

[1190] Data transmission and reception: HTTP protocol

[1191] User

[1192] Users operate the device, perform searches, view results, and provide feedback.

[1193] Specific example

[1194] Example 1: Searching for and booking a daycare center

[1195] 1. The user searches for "nearby daycare centers" on their device.

[1196] 2. The terminal sends the search query to the server.

[1197] 3. The server refers to the database and retrieves information about the appropriate daycare center.

[1198] 4. The server sends the results back to the terminal.

[1199] 5. The device displays the results to the user, who can then view detailed information, reviews, pricing, etc.

[1200] 6. The user sends a reservation request from their device to reserve a daycare center they like.

[1201] 7. The server coordinates with the daycare center to confirm the reservation and sends the result to the terminal.

[1202] Example of a prompt:

[1203] "I'm looking for a daycare center in my neighborhood. Could you recommend any good ones?"

[1204] Example 2: Recommended extracurricular activities for children

[1205] 1. The user searches for "children's English classes" on their device.

[1206] 2. The device requests classrooms that it might be interested in from the server, based on its past search history and user profile.

[1207] 3. The server extracts information on the most suitable English language school for the user from the database.

[1208] 4. The results are sent back to the device and displayed on the device.

[1209] 5. Users can view detailed information about the classroom and make reservations or inquiries.

[1210] Example of a prompt:

[1211] "I'm looking for an English class for my child. Could you recommend one?"

[1212] Specific examples of actions

[1213] Information gathering and integration

[1214] The server automatically collects information related to childcare facilities, educational institutions, and medical institutions using web scraping tools and APIs. The collected information is cleansed using Apache Spark to remove duplicates and inconsistencies, and then stored in a MySQL database.

[1215] Processing search queries

[1216] When a user enters and submits a search query on their device, the query is sent to the server via the HTTP protocol. The server uses NLTK to parse the query and extract keywords. Based on the extracted keywords, the server retrieves relevant information from the database and formats it in JSON format.

[1217] Displaying search results

[1218] The formatted search results are sent to the device via the HTTP protocol. The device then displays the search results to the user using React. The user interface is intuitive and easy to use, allowing users to visually check facility ratings, distance, prices, and more.

[1219] Provide feedback

[1220] After a user uses a facility, they enter feedback. This feedback is sent from the terminal to the server, which analyzes it and adds it to the database. This improves the accuracy of future search results.

[1221] This system allows users to easily and quickly obtain relevant information within a single application, significantly reducing research time. Furthermore, information is updated based on user feedback, ensuring that the information is always up-to-date and reliable.

[1222] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1223] Step 1: Information gathering and cleaning

[1224] The server collects information related to childcare facilities, educational institutions, and medical institutions from official websites, review sites, summary sites, personal blogs, and other sources. This information is obtained using web scraping tools and APIs.

[1225] Input: Website URL or API endpoint

[1226] Data processing: Collected information is analyzed using Apache Spark to remove duplicate and inaccurate data.

[1227] Output: Clean and unified dataset

[1228] Specifically, the server analyzes the HTML structure of the web page and extracts the necessary information (such as the facility's name, address, rating, and price). It then removes duplicate and inaccurate data and stores the final dataset in a MySQL database.

[1229] Step 2: Receiving User Queries

[1230] The terminal receives search queries through the user interface. When the user enters keywords into the search bar and presses the search button, the search query is sent from the terminal to the server.

[1231] Input: Keywords entered by the user (e.g., "neighborhood nursery school")

[1232] Output: Search query sent to the server as an HTTP request

[1233] Specifically, the device captures a click event of the search button, and based on that event, converts the user input into an HTTP request format and sends it to the server.

[1234] Step 3: Analyze the search query

[1235] The server analyzes the received search query. Using NLP (Natural Language Processing) tools, it breaks down the query into tokens and extracts the main keywords.

[1236] Input: Search query sent to the server (e.g., "nearby daycare")

[1237] Data processing: Use NLTK to break down queries and extract key keywords (e.g., "neighborhood," "nursery school").

[1238] Output: Extracted keyword set

[1239] Specifically, the server retrieves the query text, tokenizes it using the NLTK library, and identifies the main keywords.

[1240] Step 4: Extracting relevant information

[1241] The server searches the database based on the extracted keywords and retrieves relevant information. It also takes the user's current location (GPS data) into consideration to extract the most suitable results.

[1242] Input: Extracted keyword set, user's current location (e.g., GPS coordinates)

[1243] Data processing: Create database queries and retrieve relevant information from the MySQL database.

[1244] Output: A set of related information (e.g., a list of daycare centers)

[1245] Specifically, the server creates an SQL query based on keywords and location information, and extracts a list of the most suitable daycare centers from the database.

[1246] Step 5: Formatting the search results

[1247] The server formats the acquired information into a user-friendly format. It uses data formats such as JSON to organize information such as facility names, ratings, addresses, and prices.

[1248] Input: Set of related information

[1249] Data processing: Convert the information into JSON format and organize it as an object containing the attributes of each facility (name, rating, address, price).

[1250] Output: Formatted search results

[1251] Specifically, the server converts the information retrieved from the database into a JSON object and structures it in a visually easy-to-understand format.

[1252] Step 6: Submit search results

[1253] The server sends the formatted search results to the terminal. This is typically sent as an HTTP response.

[1254] Input: Formatted search results

[1255] Output: Search results sent to the terminal as an HTTP response

[1256] Specifically, the server includes the search results in JSON format in the HTTP response body and sends it to the terminal.

[1257] Step 7: Displaying search results

[1258] The terminal receives search results sent from the server and displays them to the user. The list of facilities is visually displayed through the user interface.

[1259] Input: Search results received from the server

[1260] Output: Visual list of facilities displayed in the user interface

[1261] Specifically, the device parses the HTTP response and uses React to display the search results in a card format representing the facilities.

[1262] Step 8: Provide feedback

[1263] Users enter feedback about the facilities they used. The entered feedback is sent from the terminal to the server.

[1264] Input: User-entered feedback

[1265] Output: Feedback sent to the server as an HTTP request

[1266] Specifically, when a user enters their rating or comments into the feedback input form and presses the submit button, the feedback data is sent from the device to the server.

[1267] Step 9: Save Feedback

[1268] The server receives the feedback and stores it in the database. The analyzed feedback is used to improve search results in the future.

[1269] Input: Feedback sent from the device

[1270] Data processing: Analyze feedback and add it to the database.

[1271] Output: Feedback entries saved in the database

[1272] Specifically, the server analyzes the feedback it receives and then inserts it into the appropriate table in the MySQL database.

[1273] Step 10: Update your profile

[1274] The server updates the user profile based on the user's search history and feedback.

[1275] Input: User's search history, feedback

[1276] Data processing: Update user profiles and implement customizations based on the next search results.

[1277] Output: Updated user profile

[1278] Specifically, the server updates the user's profile information based on their past search history and feedback, creating a foundation for providing more accurate results in future search queries.

[1279] (Application Example 1)

[1280] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1281] Information regarding childcare facilities, educational institutions, and medical facilities presents a problem: users cannot quickly obtain the information they need and must gather it from multiple sources. Furthermore, search results are uniform and not customized based on the user's location or past search history, resulting in low user convenience. In addition, it is difficult for parents to find appropriate facilities and navigate accordingly when dropping off or picking up their children. As a result, it becomes a time-consuming and laborious process.

[1282] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1283] In this invention, the server includes means for collecting and integrating information related to childcare facilities, educational institutions, and medical institutions; means for processing search queries from users based on the information and extracting relevant information; means for transmitting the extracted information to a user terminal and displaying it to the user; means for receiving feedback from users and reflecting it in a database; means for customizing future search results based on the user's search history and feedback information; means for calculating the optimal route to childcare facilities, educational institutions, and medical institutions based on the user's location information and destination and providing navigation; and, as an example of application, means for providing information on childcare facilities, educational institutions, and medical institutions through an application integrated into the infotainment system of an autonomous vehicle. As a result, users can obtain necessary information quickly and centrally, customize it based on the user's location information and past search history, and enable parents to efficiently search for appropriate facilities when dropping off or picking up their children and reach their destination via the optimal route.

[1284] A "childcare facility" is a facility that takes in infants and young children during the day and provides them with education and childcare.

[1285] An "educational institution" refers to any institution that provides education, such as schools, cram schools, or extracurricular activity classes.

[1286] A "medical institution" is a facility that provides medical services, such as a hospital, clinic, or medical office.

[1287] "Means of collecting and integrating information" refers to a system that gathers data from various sources, centralizes it, and stores it in a database.

[1288] "Means for processing search queries" refers to a system that analyzes user search input and extracts relevant information from a database.

[1289] "Means of transmitting and displaying information" refers to a system that transmits extracted information to the user's terminal and presents it visually.

[1290] "A means of receiving feedback and reflecting it in the database" refers to a system that adds user feedback information, such as ratings and comments, to a database and updates the information.

[1291] "Means for customizing search results based on search history and feedback information" refers to a system that analyzes a user's past search history and provided feedback to deliver personalized search results.

[1292] "A means of calculating the optimal route based on location information and destination and providing navigation" refers to a system that calculates and guides the user to the optimal travel route based on their current location and set destination.

[1293] An "infotainment system for autonomous vehicles" is an information system installed in autonomous vehicles that includes navigation and entertainment functions.

[1294] A "user terminal" refers to a smartphone, tablet, or other electronic device used by a user to receive and interact with information.

[1295] This invention relates to a system for collecting and centrally managing information related to childcare facilities, educational institutions, and medical institutions. The system includes means for collecting and integrating information, processing search queries, displaying information on a user terminal, receiving feedback, and customizing based on search history. Furthermore, it is designed to be efficiently utilized through an application that integrates with the infotainment system of an autonomous vehicle and provides navigation functionality.

[1296] Server Processing

[1297] The server collects information from official websites, reviews, summary sites, and personal blogs related to childcare facilities, educational institutions, and medical institutions, and stores it in a database. This database serves to eliminate duplication and inconsistencies through centralized information management. Data scraping tools and APIs are used to collect information. Next, the server receives search queries submitted by users and extracts relevant information from the database. For example, if a user searches for "nearby daycare centers," the server extracts information on the most suitable daycare centers based on the user's current location (GPS data) and keywords. The server also receives feedback from users and adds it to the database. This provides accurate and reliable information that can be helpful to other users. Furthermore, the user profile is updated based on the user's search history and provided feedback to customize future search results. This customization provides even more accurate information.

[1298] Terminal processing

[1299] The device provides an intuitive user interface. It displays a search bar, filtering options, reviews, and other features, designed to help users easily find the information they need. When a user enters keywords into the search bar and presses the search button, the device sends the search query to the server. This retrieves information from the server based on the user's intent. The device receives the search results from the server and displays them to the user. This includes information such as the name, rating, distance, and fees of childcare facilities, educational institutions, and medical facilities. Users can also provide feedback about the facilities and institutions they have used, and the device sends this feedback to the server.

[1300] Navigation function of autonomous vehicles

[1301] Furthermore, these functions will also be applied to the infotainment systems of autonomous vehicles. When parents are dropping off or picking up their children, the autonomous vehicle's screen can immediately search for the most suitable educational or medical facilities and provide route guidance. For example, a parent can search for "nearby daycare centers," and the app will use the current location information to find and display a list of the most suitable daycare centers. Then, the autonomous vehicle will start navigation with the daycare center selected by the parent as the destination. This function allows users to travel along the most optimal route to their destination.

[1302] Hardware and software

[1303] The hardware used includes infotainment systems for autonomous vehicles, smartphones, tablets, and communication modules. The software includes data scraping tools, APIs, GPS functionality, and internet connectivity (including the requests library). Data acquisition and processing utilize RESTful APIs to retrieve necessary information from servers. An algorithm has also been developed to calculate the optimal route based on the user's location.

[1304] Examples of specific cases and prompt statements

[1305] As a concrete example, if a parent searches for a "nearby daycare center" using an autonomous vehicle, the following prompt message will be used.

[1306] "Please search for the nearest highly-rated daycare center from your current location."

[1307] "Please calculate the shortest route to the daycare center selected by the user."

[1308] This allows users to easily and quickly obtain relevant information within a single application, significantly reducing the time spent on research. Furthermore, information is updated based on user feedback, ensuring that the information is always up-to-date and reliable.

[1309] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1310] Step 1:

[1311] The user launches the application on their device and searches for information on childcare facilities, educational institutions, and medical facilities.

[1312] Specific action: The user enters keywords into the search bar displayed on the device screen and presses the search button.

[1313] Input: Keyword (e.g., "nearby daycare"), user's current location data (GPS information).

[1314] Output: A search query is generated and sent to the server.

[1315] Step 2:

[1316] The server receives search queries sent by users and extracts relevant information from the database.

[1317] Specific operation: The server executes a search query against the database and retrieves information on relevant childcare facilities, educational institutions, and medical institutions.

[1318] Input: Search query, facility information in the database.

[1319] Output: A list of extracted information.

[1320] Step 3:

[1321] The server extracts the information and sends it to the terminal, which then displays it to the user.

[1322] Specific operation: The server sends the acquired information to the user's terminal, which then displays it on the screen. This information includes facility name, rating, distance, etc.

[1323] Input: A list of extracted information.

[1324] Output: A list of facility information displayed on the user's terminal.

[1325] Step 4:

[1326] The user reviews the facility information and selects the facility they wish to use.

[1327] Specific action: The user selects a facility from the displayed list for which they want to view detailed information.

[1328] Input: Display list of facility information.

[1329] Output: Detailed information about the selected facility.

[1330] Step 5:

[1331] Based on the detailed information of the facility selected by the user, the device sends a request to begin navigation.

[1332] Specific operation: When the user presses the navigation button, the device sends a navigation start request to the server based on the location information of the selected facility.

[1333] Input: Location information of the selected facility.

[1334] Output: Navigation start request.

[1335] Step 6:

[1336] The server calculates the optimal route based on the user's current location and destination location information, and sends the navigation data to the terminal.

[1337] Specific operation: The server executes an algorithm to calculate the route based on GPS data and the location information of the selected facility. The calculated route information is then sent to the terminal.

[1338] Input: User's current location data, location information of the selected facility.

[1339] Output: Calculated optimal route information.

[1340] Step 7:

[1341] The device receives navigation data and displays and guides the user along the optimal route.

[1342] Specific operation: The terminal displays the received route information on a map and guides the user with voice and visual instructions.

[1343] Input: Calculated optimal route information.

[1344] Output: Navigation display and voice guidance.

[1345] Step 8:

[1346] After the user reaches their destination, they provide feedback.

[1347] Specific operation: Users enter ratings and comments about the facilities they visit and send feedback to the server via their device.

[1348] Input: User review comments.

[1349] Output: Feedback information sent to the server.

[1350] Step 9:

[1351] The server receives feedback and updates the database accordingly.

[1352] Specific operation: The server analyzes the received feedback information and updates the corresponding entry in the database.

[1353] Input: Feedback information submitted by the user.

[1354] Output: Updated database information.

[1355] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1356] The present invention is a system that collects and centrally manages information related to childcare facilities, educational institutions, and medical institutions, and further combines it with an emotion engine that recognizes user emotions. This system includes means for collecting and integrating information, means for processing search queries, means for displaying information on a user terminal, means for receiving feedback, means for customizing based on search history, and an emotion engine.

[1357] Server Processing

[1358] Database Management

[1359] The server collects information from official websites, reviews, summary sites, and personal blogs related to childcare facilities, educational institutions, and medical institutions, and stores it in a database. This database serves to eliminate duplication and inconsistencies through centralized information management.

[1360] Processing search queries

[1361] The server receives search queries submitted by users and extracts relevant information from the database. For example, if a user searches for "nearby daycare centers," the server extracts information on the most suitable daycare centers based on the user's current location (GPS data) and the keywords.

[1362] Feedback Management

[1363] The server receives feedback from users and adds it to the database. This provides accurate and reliable information that can be helpful to other users.

[1364] Profile update

[1365] The server updates user profiles based on the user's search history and feedback, customizing future search results. This customization provides more accurate information.

[1366] Emotional Engine Processing

[1367] Recognition of emotions

[1368] The server recognizes the user's emotions through analysis of their facial expressions, voice, and text. This uses facial recognition technology and natural language processing technology.

[1369] Emotion-based filtering

[1370] The sentiment engine filters or ranks search results based on the recognized user's emotions. For example, if a user is feeling stressed, it prioritizes displaying activities that can help reduce stress.

[1371] Dynamic adjustment

[1372] The emotion engine dynamically changes the information and recommendations displayed in response to changes in the user's emotions. This can increase user satisfaction.

[1373] Terminal processing

[1374] Display of the user interface

[1375] The device provides an intuitive user interface. It features a search bar, filtering options, reviews, and other elements, designed to make it easy for users to find the information they need.

[1376] Submit a search query

[1377] When a user enters keywords into the search bar and presses the search button, the device sends that search query to the server. This allows the server to retrieve information that is in line with the user's intent.

[1378] Displaying search results

[1379] The system receives search results sent from the server and displays them to the user. This includes information such as the name, rating, distance, and fees of childcare facilities, educational institutions, and medical facilities.

[1380] Provide feedback

[1381] Users can provide feedback about the facilities and institutions they have used. The device sends this feedback to the server.

[1382] User actions

[1383] Execute search

[1384] The user uses the application to search for things like "nearby daycare centers." The search query and location information are sent to the server.

[1385] View results

[1386] Users view the search results returned from the server and check detailed information about facilities and organizations that interest them.

[1387] Provide feedback

[1388] This system provides feedback on facilities and institutions that users have actually visited. This feedback includes ratings and comments, which are sent from the user's device to the server.

[1389] Specific example

[1390] Example 1: Searching for daycare centers and displaying recommendations based on sentiment.

[1391] 1. The user searches for "nearby daycare centers" on their device.

[1392] 2. The emotion engine recognizes the user's stress level as high.

[1393] 3. The server prioritizes displaying daycare centers that can reduce stress (for example, daycare centers with a rich natural environment).

[1394] 4. Search results are sent to and displayed on the device.

[1395] 5. The user reviews the details and makes a reservation at the daycare center.

[1396] Thus, by providing information that takes user emotions into consideration, the present invention can improve the user experience and provide more personalized services.

[1397] The following describes the processing flow.

[1398] Processing steps for searching for daycare centers and displaying sentiment-based recommendations

[1399] Step 1: Display the search screen

[1400] The device displays a search screen to the user. It provides an interface that includes a search bar and filtering options.

[1401] Step 2: Enter your search query

[1402] The user enters "nearby daycare" into the search bar and taps the search button.

[1403] Step 3: Submit your search query

[1404] The terminal sends the entered search query to the server as an HTTP request.

[1405] Step 4: Receiving the Request

[1406] The server receives a search request from the terminal.

[1407] Step 5: Receiving emotional data

[1408] The server's emotion engine receives voice, text, and facial expression data transmitted from the terminal to recognize the user's emotions. For example, it measures the user's stress level using voice tone and expression, as well as facial recognition technology.

[1409] Step 6: Database Reference

[1410] The server accesses a database containing data about daycare centers and extracts information on the most suitable daycare center based on the user's current location (GPS data) and keywords.

[1411] Step 7: Filtering and scoring data

[1412] The server's sentiment engine filters and ranks search results based on the recognized user's emotions. For example, if a user is feeling stressed, it prioritizes displaying daycare centers that offer a relaxing environment.

[1413] Step 8: Generating Results

[1414] The server generates the filtering and scoring results in JSON format and prepares to send them back to the terminal.

[1415] Step 9: Receiving Results

[1416] The terminal receives search results from the server.

[1417] Step 10: Perspective of the results

[1418] The terminal parses the received JSON data and converts it into a structured list or card view.

[1419] Step 11: Displaying search results

[1420] The device displays search results to the user in a viewable format, including information such as the name, rating, distance, and fees of each daycare center.

[1421] Step 12: View detailed information

[1422] Users select a daycare center they are interested in from the displayed search results and tap it to go to the detailed information page.

[1423] Step 13: Entering Feedback

[1424] Users can use the app to provide feedback (for example, star ratings, comments, and changes in their feelings) after actually visiting or using the daycare center.

[1425] Step 14: Submitting Feedback

[1426] The device sends the user's input to the server.

[1427] Step 15: Receiving Feedback

[1428] The server receives feedback sent from the terminal.

[1429] Step 16: Update the database

[1430] The server saves the received feedback to the database and updates the relevant nursery school information, reflecting the ratings and comments.

[1431] Step 17: Update your profile

[1432] The server also updates the user's profile information, incorporating feedback into future search results.

[1433] This allows users to quickly and efficiently obtain the necessary information about daycare centers, and the feedback they provide will be used to improve the search function for future use. In addition, by using an emotion engine, it becomes possible to provide personalized information based on the user's emotions.

[1434] (Example 2)

[1435] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1436] Information related to childcare facilities, educational institutions, and medical institutions is diverse, making it difficult to efficiently collect and centrally manage it. Furthermore, providing users with the most relevant information requires personalized information that considers their emotions and circumstances, rather than simply relying on search queries. However, current systems do not adequately consider these factors in their information provision, highlighting the need for improved user experience. Additionally, there is a lack of effective means to utilize user feedback to improve future search results.

[1437] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[1438] In this invention, the server includes means for collecting and integrating information related to childcare facilities, educational institutions, and medical institutions; means for processing search queries from users based on the information and extracting relevant information; means for transmitting the extracted information to a user terminal and displaying it to the user; means for receiving feedback from users and reflecting it in a database; means for customizing future search results based on the user's search history and feedback information; means for recognizing the user's emotions through analysis of the user's facial expressions, voice, and text; means for filtering or ranking search results based on the recognized user emotions; and means for dynamically changing the displayed information and recommendations in accordance with changes in the user's emotions. This enables the provision of personalized information that takes into account the user's emotions and circumstances. Furthermore, it allows for the effective use of user feedback to improve future search results.

[1439] A "childcare facility" refers to a facility that provides temporary or long-term care for infants and children.

[1440] An "educational institution" refers to an organization or facility that teaches academic subjects or skills, and includes schools, cram schools, and vocational schools.

[1441] A "medical institution" refers to a facility that provides medical services such as treatment, diagnosis, and prevention, and includes hospitals and clinics.

[1442] "Means of collecting and integrating information" refers to methods or devices for obtaining necessary data from the internet or other sources, organizing it, and storing it in a database.

[1443] "Means for processing search queries" refers to a method or device that understands the search criteria entered by the user and extracts appropriate data from a database based on those criteria.

[1444] "Means for transmitting information to a user's terminal and displaying it to the user" refers to a method or device for transmitting search results to a user's device and displaying them.

[1445] "Means of receiving feedback and reflecting it in the database" refers to a method or device for receiving ratings and comments from users and adding that information to a database.

[1446] "Means for customizing future search results based on search history and feedback information" refers to methods or devices that analyze past search history and feedback and individually adjust future search results based on that information.

[1447] "Means of recognizing user emotions through analysis of user facial expressions, voice, and text" refers to methods or devices that detect a user's emotional state using facial recognition technology, voice analysis, and natural language processing.

[1448] "Means of filtering or ranking search results based on emotion" refers to methods or devices that change the priority of search results according to the perceived emotions of the user.

[1449] "Means of dynamically changing displayed information and recommendations in response to changes in the user's emotions" refers to a method or device that updates displayed content and recommendations in real time when the user's emotions change.

[1450] The present invention is a system for collecting and integrating information related to childcare facilities, educational institutions, and medical institutions, and for providing personalized information that takes into account the user's emotions. This system includes means for collecting and integrating information, means for processing search queries, means for displaying information on a user terminal, means for receiving feedback, means for customizing based on search history, and an emotion engine.

[1451] Server Processing

[1452] Database Management

[1453] The server uses web scraping techniques to collect information about childcare facilities, educational institutions, and medical institutions from official websites, review sites, summary sites, personal blogs, etc., and stores it in a database. Python's BeautifulSoup library is used for data collection. MySQL or similar databases are used, and pre-processing algorithms are implemented to eliminate duplication and inconsistencies.

[1454] Processing search queries

[1455] The server receives search queries submitted by users and extracts relevant information from the database. It generates SQL queries based on the search queries and the user's location information (GPS data) and executes them against the database. The extracted information is temporarily held in memory.

[1456] Feedback Management

[1457] The server receives user feedback and adds it to the database. The feedback is analyzed using text processing techniques and stored in the database as ratings and comment information. This provides accurate and reliable information that can be helpful to other users.

[1458] Profile update

[1459] The server updates the user profile based on the user's search history and feedback provided, customizing future search results. This updated profile information is used for subsequent searches, resulting in more personalized results.

[1460] Emotional Engine Processing

[1461] Recognition of emotions

[1462] The server recognizes the user's emotions through analysis of their facial expressions, voice, and text. This analysis utilizes OpenCV, the Google Cloud Speech-to-Text API, and natural language processing techniques. The emotion engine filters or ranks search results based on the recognized emotions.

[1463] Emotion-based filtering

[1464] The emotion engine dynamically changes the priority of search results, for example, by prioritizing activities that can reduce stress when a user is feeling stressed.

[1465] Dynamic adjustment

[1466] The emotion engine updates the displayed information and recommendations in real time in response to changes in the user's emotions. This can increase user satisfaction.

[1467] Terminal processing

[1468] Display of the user interface

[1469] The device provides an intuitive user interface, displaying a search bar, filtering options, reviews, and more. It also includes a list of search results and a map display.

[1470] Submit a search query

[1471] When a user enters keywords into the search bar and presses the search button, the device sends that search query and location information to the server.

[1472] Displaying search results

[1473] The terminal displays search results sent from the server to the user. Information such as the name, rating, distance, and fees of childcare facilities, educational institutions, and medical facilities are displayed.

[1474] Provide feedback

[1475] Users can provide feedback about the facilities and institutions they have used, and the device sends this feedback to the server.

[1476] User actions

[1477] Execute search

[1478] The user uses the application to search for things like "nearby daycare centers." The search query and location information are sent to the server via the device.

[1479] View results

[1480] Users view the search results returned from the server and check detailed information about facilities and organizations that interest them.

[1481] Provide feedback

[1482] This system provides feedback on facilities and institutions that users have actually visited. This feedback includes ratings and comments, which are sent from the user's device to the server.

[1483] Specific example

[1484] Search for daycare centers and display recommendations based on sentiment.

[1485] 1. The user searches for "nearby daycare centers" on their device.

[1486] 2. The emotion engine recognizes the user's stress level as high.

[1487] 3. The server prioritizes displaying daycare centers that can reduce stress (e.g., daycare centers with a rich natural environment).

[1488] 4. Search results are sent to and displayed on the device.

[1489] 5. The user reviews the details and makes a reservation at the daycare center.

[1490] Example of a prompt

[1491] "I'm looking for a local daycare center. Please recommend one that takes into account the feelings and status of the parents."

[1492] Thus, each processing step of the system consists of multiple substeps, each involving a specific action, and extends in detail from user input to data collection and feedback processing. The coordination of these various elements enables the provision of personalized information that takes into account the user's emotions and circumstances.

[1493] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1494] Step 1: Data collection and database management

[1495] Server operation

[1496] The server uses web scraping techniques to collect information about childcare facilities, educational institutions, and medical institutions from various websites. Specifically, it uses the Python BeautifulSoup library to extract data from official websites, review sites, summary sites, personal blogs, and other sources.

[1497] Input: Website URL

[1498] Data processing: Web page analysis and extraction of necessary information.

[1499] Output: Database where the extracted information is stored (e.g., MySQL)

[1500] The server removes duplicate data, verifies inconsistencies in the information, and centrally manages it in the database.

[1501] Step 2: Receiving and processing search queries

[1502] User and device behavior

[1503] The user enters a keyword (e.g., "nearby daycare") into the device's search bar and presses the search button. The device sends this search query and the user's location information (GPS data) to the server.

[1504] Input: Search query and location information

[1505] Data processing: Receive search queries and location information as parameters.

[1506] Output: Request to send to the server

[1507] Server operation

[1508] The server generates an SQL query based on the received search query and location information to extract relevant information from the database.

[1509] Input: Search query and location information

[1510] Data processing: Generation and execution of SQL queries

[1511] Output: The extracted data (information on childcare facilities, educational institutions, and medical institutions) is temporarily stored in memory.

[1512] Step 3: Emotion Recognition and Filtering

[1513] Server operation

[1514] The server analyzes the user's facial expressions, voice, and text to recognize their emotions. This analysis utilizes OpenCV, the Google Cloud Speech-to-Text API, and natural language processing technologies.

[1515] Input: User facial expression data, voice data, text data

[1516] Data processing: Analysis using sentiment analysis algorithms

[1517] Output: Emotion recognition results (e.g., stress level, emotion type)

[1518] The emotion engine filters search results based on recognized emotions, prioritizing and ranking highly relevant information.

[1519] Input: Sentiment recognition results and temporarily stored search results

[1520] Data processing: filtering and ranking

[1521] Output: Filtered and ranked search results

[1522] Step 4: Providing search results

[1523] Server operation

[1524] The server sends the filtered search results to the terminal.

[1525] Input: Filtered and ranked search results

[1526] Data processing: Convert to data format and send.

[1527] Output: Search results sent to the terminal

[1528] Terminal operation

[1529] The terminal displays search results received from the server to the user. This display can include list formats, map displays, and other formats.

[1530] Input: Search results sent from the server

[1531] Output: Search results displayed in the user interface

[1532] Step 5: Managing Feedback

[1533] User and device behavior

[1534] Users input feedback about the facilities and institutions they have used and send it to the server via their device.

[1535] Input: Feedback information such as ratings and comments.

[1536] Output: Feedback request from terminal to server

[1537] Server operation

[1538] The server analyzes the received feedback and updates the database.

[1539] Input: Feedback Information

[1540] Data processing: Text analysis of feedback and addition to database.

[1541] Output: Updated database

[1542] Step 6: Update Profile

[1543] Server operation

[1544] The server updates the user profile based on the user's search history and feedback provided, thereby customizing future search results.

[1545] Input: Search history and feedback information

[1546] Data processing: Profile analysis and updating

[1547] Output: Updated user profile

[1548] (Application Example 2)

[1549] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1550] In today's internet environment, users find it difficult to find useful information from the vast amount of data available. In particular, there is a lack of systems that collect and appropriately present information directly related to daily life, such as that found in childcare facilities, educational institutions, and medical facilities. Furthermore, current search systems fail to provide information that takes into account the user's emotions and circumstances, thus failing to adequately enhance user satisfaction. Additionally, advertising displays lack sufficient customization to address user emotions and individual needs, resulting in reduced advertising effectiveness.

[1551] In Application Example 2, the specific processing performed by the specific processing unit 290 of the data processing device 12 is realized by the following means. In this invention, the server includes means for collecting and integrating information related to childcare facilities, educational institutions and medical institutions; means for processing search queries from users based on the information and extracting relevant information; means for transmitting the extracted information to a user terminal and displaying it to the user; means for receiving feedback from the user and reflecting it in a database; means for customizing future search results based on the user's search history and feedback information; means for recognizing the user's emotions and filtering or ranking search results based on those emotions; means for dynamically adjusting the information and recommendations displayed in accordance with changes in the user's emotions; and means for recommending individually customized advertisements based on the user's emotions and past search history. This makes it possible to provide information that is suitable for the user's emotions and individual needs, thereby improving user satisfaction. Furthermore, by customizing the display of advertisements, an improvement in advertising effectiveness can also be expected.

[1552] A "childcare facility" is a facility that takes in infants and young children during the day and provides education and care.

[1553] An "educational institution" is an organization established to provide education, such as a school or a cram school.

[1554] A "medical institution" is an organization that provides medical services, such as a hospital, clinic, or medical office.

[1555] "Means for collecting and integrating information" refers to methods and technologies for collecting and centrally managing information related to childcare facilities, educational institutions, and medical institutions from sources such as the internet.

[1556] "Means for processing search queries and extracting relevant information" refers to methods and technologies for finding relevant information from a database based on search queries submitted by users.

[1557] "Means for sending extracted information to a user's terminal and displaying it to the user" refers to methods and technologies for sending information extracted based on a search query to a user's terminal so that the user can view it.

[1558] "Means of receiving user feedback and reflecting it in the database" refers to methods and technologies for receiving opinions and evaluations provided by users and adding that information to a database.

[1559] "Means of customizing future search results based on user search history and feedback information" refers to methods and technologies that utilize a user's past search history and feedback to individually optimize future search results.

[1560] "Means for recognizing user sentiment and filtering or ranking search results based on that sentiment" refers to methods or technologies for analyzing user sentiment and selecting or ranking search results based on the results of that analysis.

[1561] "Means for dynamically adjusting the information and recommendations displayed in response to changes in the user's emotions" refers to methods and technologies that detect changes in the user's emotions in real time and change the information and recommendations displayed accordingly.

[1562] "Means of recommending individually customized ads based on user sentiment and past search history" refers to methods and technologies that consider a user's emotional state and past behavior to display individually optimized ads.

[1563] This invention improves user satisfaction and advertising effectiveness by adding a new function to a system that collects and centrally manages information on childcare facilities, educational institutions, and medical institutions: the ability to recognize user emotions and perform individual customization based on those emotions.

[1564] The server first collects information on childcare facilities, educational institutions, and medical institutions from official websites, review sites, summary sites, and personal blogs on the internet, and stores it in a database. This database plays a role in providing accurate and reliable information by eliminating duplication and inconsistencies through centralized information management.

[1565] When a user submits a search query, the server extracts information related to that query from its database. For example, if a user searches for "nearby daycare centers," the server extracts information on the most suitable daycare centers based on the user's current location (GPS data) and the keywords.

[1566] Next, the server receives feedback from users and adds it to the database, providing accurate information that can be helpful to other users. In addition, the server updates user profiles based on the user's search history and the feedback provided, customizing future search results for each individual user.

[1567] Furthermore, this system incorporates an emotion engine. The emotion engine recognizes the user's emotions by analyzing their facial expressions, voice, and text. This utilizes facial recognition and natural language processing technologies. Based on the recognized user emotions, the server filters or ranks search results, prioritizing the information the user is most likely to be interested in. The emotion engine can also dynamically change the displayed information and recommendations in response to changes in the user's emotions.

[1568] For example, when a user searches for "nearby daycare centers" on their device, if the emotion engine detects that the user's stress level is high, the server will prioritize displaying daycare centers with rich natural environments that can reduce stress. The search results are sent to the device, and the user can view them and check detailed information. In addition, when a user visits a specific daycare center and provides feedback such as ratings and comments, other users can also refer to that information.

[1569] Furthermore, it includes a feature that recommends personalized ads based on the user's emotions and past search history. For example, if a user is feeling stressed, ads for relaxation products and services can be displayed.

[1570] To realize this invention, the server uses an emotion engine that combines facial recognition and natural language processing technologies to analyze the user's emotions in detail. Furthermore, a high-performance server and appropriate database management software are used for database management. The user's terminal is provided with an intuitive user interface, enabling smooth searching and result display.

[1571] Example of a prompt:

[1572] "When a user is using an emotion-driven ad recommendation system, generate ads for relaxation products if their current emotion is stress."

[1573] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1574] Step 1:

[1575] The user enters a search query and presses the search button. The user's device retrieves the entered search query and the user's location information and sends this data to the server. The input data includes search keywords (e.g., "nearby daycare") and GPS data. The output is a search request that is sent to the server.

[1576] Step 2:

[1577] The server extracts relevant information from the database based on the received search query and location data. Specifically, it collects information on childcare facilities, educational institutions, and medical institutions, and selects those that match the search criteria. This process executes database queries and generates a list of matching facilities. The input is the search keyword and GPS data, and the output is a list of search results.

[1578] Step 3:

[1579] The server acquires a user's facial image and performs emotion recognition to filter search results using an emotion engine. The user's device captures a facial image using its camera and sends the image data to the server. The server analyzes the user's emotions using facial recognition and natural language processing technologies. The input is facial image data, and the output is the analyzed emotion data (e.g., "stressed").

[1580] Step 4:

[1581] The server filters or ranks search results based on the recognized user's emotions. For example, if the user is feeling stressed, it prioritizes childcare facilities with rich natural environments. This process takes emotion data and a list of search results as input, and outputs a list of filtered search results.

[1582] Step 5:

[1583] The server sends filtered search results to the user's device. The user's device receives the sent search results and displays them in the user interface. In this step, the data sent from the server is the input, and the information displayed on the device is the output. Specifically, detailed information such as the facility name, rating, distance, and price is displayed.

[1584] Step 6:

[1585] Users review the displayed search results and click on the details of facilities they are interested in to view more information. If a user selects a facility, that information is saved on their device. The input is the user's selection, and the output is the display of facility details.

[1586] Step 7:

[1587] Users visit a facility and provide feedback on their experience. The user terminal sends the text and evaluation data entered as feedback to the server. The input is the user's feedback data, and the output is the feedback request sent to the server.

[1588] Step 8:

[1589] The server reflects the received feedback data in the database, improving the reliability of the information. In this step, the feedback data is added to the database, and an updated database is generated. The input is the feedback data, and the output is the updated database.

[1590] Step 9:

[1591] The server generates and sends individually customized advertisements to the user's device based on the user's emotions and past search history. A generative AI model is used for ad generation. Using emotion data and past search history as input, a customized advertisement is output. This advertisement will be relevant to the user's current situation, such as offering relaxation products or services.

[1592] Example of a prompt:

[1593] "When a user is using an emotion-driven ad recommendation system, generate ads for relaxation products if their current emotion is stress."

[1594] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1595] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet Search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1596] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[1597] [Fourth Embodiment]

[1598] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[1599] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1600] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1601] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[1602] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1603] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1604] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1605] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[1606] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1607] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1608] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1609] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1610] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1611] This invention relates to a system for collecting and centrally managing information related to childcare facilities, educational institutions, and medical institutions. The system includes means for collecting and integrating information, means for processing search queries, means for displaying information on a user terminal, means for receiving feedback, and means for customizing based on search history.

[1612] Server Processing

[1613] Database Management

[1614] The server collects information from official websites, reviews, summary sites, and personal blogs related to childcare facilities, educational institutions, and medical institutions, and stores it in a database. This database serves to eliminate duplication and inconsistencies through centralized information management.

[1615] Processing search queries

[1616] The server receives search queries submitted by users and extracts relevant information from the database. For example, if a user searches for "nearby daycare centers," the server extracts information on the most suitable daycare centers based on the user's current location (GPS data) and the keywords.

[1617] Feedback Management

[1618] The server receives feedback from users and adds it to the database. This provides accurate and reliable information that can be helpful to other users.

[1619] Profile update

[1620] The server updates user profiles based on the user's search history and feedback, customizing future search results. This customization provides more accurate information.

[1621] Terminal processing

[1622] Display of the user interface

[1623] The device provides an intuitive user interface. It features a search bar, filtering options, reviews, and other elements, designed to make it easy for users to find the information they need.

[1624] Submit a search query

[1625] When a user enters keywords into the search bar and presses the search button, the device sends that search query to the server. This allows the server to retrieve information that is in line with the user's intent.

[1626] Displaying search results

[1627] The system receives search results sent from the server and displays them to the user. This includes information such as the name, rating, distance, and fees of childcare facilities, educational institutions, and medical facilities.

[1628] Provide feedback

[1629] Users can provide feedback about the facilities and institutions they have used. The device sends this feedback to the server.

[1630] User actions

[1631] Execute search

[1632] The user uses the application to search for things like "nearby daycare centers." The search query and location information are sent to the server.

[1633] View results

[1634] Users view the search results returned from the server and check detailed information about facilities and organizations that interest them.

[1635] Provide feedback

[1636] This system provides feedback on facilities and institutions that users have actually visited. This feedback includes ratings and comments, which are sent from the user's device to the server.

[1637] Specific example

[1638] Example 1: Searching for and booking a daycare center

[1639] 1. The user searches for "nearby daycare centers" on their device.

[1640] 2. The terminal sends the search query to the server.

[1641] 3. The server accesses the database and retrieves information about the appropriate daycare center.

[1642] 4. The server sends the results back to the terminal.

[1643] 5. The device displays the results to the user, who can view detailed information, reviews, pricing, etc.

[1644] 6. The user sends a reservation request from their device to book a daycare center they like.

[1645] 7. The server contacts the daycare center to confirm the reservation and sends the result to the terminal.

[1646] Example 2: Recommended extracurricular activities for children

[1647] 1. The user searches for "children's English classes" on their device.

[1648] 2. The device requests classrooms that it might be interested in from the server, based on its past search history and user profile.

[1649] 3. The server extracts information on the most suitable English language school for the user from the database.

[1650] 4. The results are sent back to the device and displayed on the device.

[1651] 5. Users can view detailed information about the classroom and make reservations or inquiries.

[1652] This system allows users to easily and quickly obtain relevant information within a single application, significantly reducing research time. Furthermore, information is updated based on user feedback, ensuring that the information is always up-to-date and reliable.

[1653] The following describes the processing flow.

[1654] Processing steps for searching for and providing feedback on daycare centers

[1655] Step 1: User search request

[1656] The user enters "nearby daycare" into the device's search screen and taps the search button.

[1657] Step 2: Submit your search query

[1658] The terminal sends the entered search query to the server as an HTTP request.

[1659] Step 3: Receiving the Request

[1660] The server receives a search request from the terminal.

[1661] Step 4: Database Reference

[1662] The server accesses a database containing data about daycare centers and extracts information on the most suitable daycare center based on the user's current location (GPS data) and keywords.

[1663] Step 5: Filtering and scoring data

[1664] The server filters relevant daycare centers based on location information and keywords, and calculates a score for each daycare center based on the user's past search history and reputation data.

[1665] Step 6: Generating Results

[1666] The server generates the filtering and scoring results in JSON format and prepares to send them back to the terminal.

[1667] Step 7: Receiving the Results

[1668] The terminal receives search results from the server.

[1669] Step 8: Perspective of the results

[1670] The terminal parses the received JSON data and converts it into a structured list or card view.

[1671] Step 9: Displaying search results

[1672] The device displays search results to the user in a viewable format, including information such as the name, rating, distance, and fees of each daycare center.

[1673] Step 10: View detailed information

[1674] Users select a daycare center they are interested in from the displayed search results and tap it to go to the detailed information page.

[1675] Step 11: Entering Feedback

[1676] Users can use the app to provide feedback (such as star ratings and comments) after actually visiting or using the daycare center.

[1677] Step 12: Submitting Feedback

[1678] The device sends the user's input to the server.

[1679] Step 13: Receiving Feedback

[1680] The server receives feedback sent from the terminal.

[1681] Step 14: Update the database

[1682] The server saves the received feedback to the database and updates the relevant nursery school information, reflecting the ratings and comments.

[1683] Step 15: Update your profile

[1684] The server also updates the user's profile information, incorporating feedback into future search results.

[1685] These steps allow users to quickly and efficiently obtain the necessary information about daycare centers, and the feedback they provide will be used to improve the search function in the future.

[1686] (Example 1)

[1687] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1688] Conventional information gathering and management systems have resulted in scattered information related to childcare facilities, educational institutions, and medical facilities, making it difficult for users to efficiently obtain the necessary information. Furthermore, there was a lack of effective ways to utilize user feedback, leading to problems with the accuracy and reliability of search results. Additionally, the ability to provide optimal facility information based on user location information was insufficient. To address these challenges, a system is needed that centrally integrates information gathering, searching, display, feedback management, and customization functions.

[1689] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1690] In this invention, the server includes means for collecting and integrating information related to childcare facilities, educational institutions, and medical institutions; means for processing search queries from users based on the information and extracting relevant information; means for transmitting the extracted information to a user terminal and displaying it to the user; means for receiving feedback from the user and reflecting it in a database; means for customizing future search results based on the user's search history and feedback information; means for displaying a user interface; means for transmitting search queries from the terminal to the server; means for displaying search results on the terminal; means for transmitting feedback from the terminal to the server; means for cleaning and deduplication of collected information; means for analyzing search queries; and means for extracting and formatting optimal information from the database. As a result, users can efficiently obtain information on a centralized platform and always obtain the latest and most reliable information by utilizing feedback.

[1691] "Means of collecting and integrating information" refers to the function of collecting data from various sources related to childcare facilities, educational institutions, and medical institutions, and organizing it to eliminate duplication and inconsistencies for centralized management.

[1692] "Means for processing search queries" refers to functions that analyze search queries submitted by users and extract relevant information from the database.

[1693] "Means of sending information to a user terminal and displaying it to the user" refers to a function that formats information obtained from a server and displays it on the terminal through a user interface.

[1694] "Means of receiving feedback and reflecting it in the database" refers to a function that analyzes feedback submitted by users and adds or updates it to the database.

[1695] "Means of customizing future search results based on search history and feedback information" refers to a function that uses past search history and feedback to update the user profile and provide next search results in a way that is more tailored to the user.

[1696] "Means of displaying a user interface" refers to a function that displays a graphical interface on the terminal that allows the user to operate it intuitively.

[1697] "Means of sending search queries from a terminal to a server" refers to a function that sends search queries entered by the user to a server via the network.

[1698] "Means of displaying search results on a device" refers to a function that displays search results sent from the server on the user's device and provides them visually.

[1699] "Means of sending feedback from the terminal to the server" refers to a function that sends user-entered feedback to the server.

[1700] "Means for cleaning and deduplication of collected information" refers to a function that analyzes collected data using cleansing tools and removes duplicate or inaccurate data.

[1701] "Means for analyzing search queries" refers to a function that analyzes the search queries received from users, extracts keywords, and understands their meaning.

[1702] "Means for extracting and formatting optimal information from a database" refers to a function that retrieves relevant information from the database based on extracted keywords and organizes it in a format that is easy for the user to understand.

[1703] This invention relates to a system for collecting and centrally managing information related to childcare facilities, educational institutions, and medical institutions. The system includes means for collecting and integrating information, processing search queries, displaying information on user terminals, receiving feedback, and customizing information based on search history. This allows users to effectively obtain necessary information and update it based on feedback to provide the most up-to-date information.

[1704] Specific hardware and software to be used

[1705] server

[1706] The server is responsible for database management, information gathering, processing search queries, managing feedback, and updating profiles. The main software tools used are as follows:

[1707] Database Administration: MySQL

[1708] Data collection: Web scraping tools, APIs

[1709] Data cleansing: Apache Spark

[1710] Natural Language Processing: NLTK

[1711] Server-side framework: Django

[1712] terminal

[1713] The terminal is responsible for displaying the user interface, sending search queries, displaying search results, and providing feedback. The main software technologies used are as follows:

[1714] Frontend framework: React

[1715] Data transmission and reception: HTTP protocol

[1716] User

[1717] Users operate the device, perform searches, view results, and provide feedback.

[1718] Specific example

[1719] Example 1: Searching for and booking a daycare center

[1720] 1. The user searches for "nearby daycare centers" on their device.

[1721] 2. The terminal sends the search query to the server.

[1722] 3. The server refers to the database and retrieves information about the appropriate daycare center.

[1723] 4. The server sends the results back to the terminal.

[1724] 5. The device displays the results to the user, who can then view detailed information, reviews, pricing, etc.

[1725] 6. The user sends a reservation request from their device to reserve a daycare center they like.

[1726] 7. The server coordinates with the daycare center to confirm the reservation and sends the result to the terminal.

[1727] Example of a prompt:

[1728] "I'm looking for a daycare center in my neighborhood. Could you recommend any good ones?"

[1729] Example 2: Recommended extracurricular activities for children

[1730] 1. The user searches for "children's English classes" on their device.

[1731] 2. The device requests classrooms that it might be interested in from the server, based on its past search history and user profile.

[1732] 3. The server extracts information on the most suitable English language school for the user from the database.

[1733] 4. The results are sent back to the device and displayed on the device.

[1734] 5. Users can view detailed information about the classroom and make reservations or inquiries.

[1735] Example of a prompt:

[1736] "I'm looking for an English class for my child. Could you recommend one?"

[1737] Specific examples of actions

[1738] Information gathering and integration

[1739] The server automatically collects information related to childcare facilities, educational institutions, and medical institutions using web scraping tools and APIs. The collected information is cleansed using Apache Spark to remove duplicates and inconsistencies, and then stored in a MySQL database.

[1740] Processing search queries

[1741] When a user enters and submits a search query on their device, the query is sent to the server via the HTTP protocol. The server uses NLTK to parse the query and extract keywords. Based on the extracted keywords, the server retrieves relevant information from the database and formats it in JSON format.

[1742] Displaying search results

[1743] The formatted search results are sent to the device via the HTTP protocol. The device then displays the search results to the user using React. The user interface is intuitive and easy to use, allowing users to visually check facility ratings, distance, prices, and more.

[1744] Provide feedback

[1745] After a user uses a facility, they enter feedback. This feedback is sent from the terminal to the server, which analyzes it and adds it to the database. This improves the accuracy of future search results.

[1746] This system allows users to easily and quickly obtain relevant information within a single application, significantly reducing research time. Furthermore, information is updated based on user feedback, ensuring that the information is always up-to-date and reliable.

[1747] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1748] Step 1: Information gathering and cleaning

[1749] The server collects information related to childcare facilities, educational institutions, and medical institutions from official websites, review sites, summary sites, personal blogs, and other sources. This information is obtained using web scraping tools and APIs.

[1750] Input: Website URL or API endpoint

[1751] Data processing: Collected information is analyzed using Apache Spark to remove duplicate and inaccurate data.

[1752] Output: Clean and unified dataset

[1753] Specifically, the server analyzes the HTML structure of the web page and extracts the necessary information (such as the facility's name, address, rating, and price). It then removes duplicate and inaccurate data and stores the final dataset in a MySQL database.

[1754] Step 2: Receiving User Queries

[1755] The terminal receives search queries through the user interface. When the user enters keywords into the search bar and presses the search button, the search query is sent from the terminal to the server.

[1756] Input: Keywords entered by the user (e.g., "neighborhood nursery school")

[1757] Output: Search query sent to the server as an HTTP request

[1758] Specifically, the device captures a click event of the search button, and based on that event, converts the user input into an HTTP request format and sends it to the server.

[1759] Step 3: Analyze the search query

[1760] The server analyzes the received search query. Using NLP (Natural Language Processing) tools, it breaks down the query into tokens and extracts the main keywords.

[1761] Input: Search query sent to the server (e.g., "nearby daycare")

[1762] Data processing: Use NLTK to break down queries and extract key keywords (e.g., "neighborhood," "nursery school").

[1763] Output: Extracted keyword set

[1764] Specifically, the server retrieves the query text, tokenizes it using the NLTK library, and identifies the main keywords.

[1765] Step 4: Extracting relevant information

[1766] The server searches the database based on the extracted keywords and retrieves relevant information. It also takes the user's current location (GPS data) into consideration to extract the most suitable results.

[1767] Input: Extracted keyword set, user's current location (e.g., GPS coordinates)

[1768] Data processing: Create database queries and retrieve relevant information from the MySQL database.

[1769] Output: A set of related information (e.g., a list of daycare centers)

[1770] Specifically, the server creates an SQL query based on keywords and location information, and extracts a list of the most suitable daycare centers from the database.

[1771] Step 5: Formatting the search results

[1772] The server formats the acquired information into a user-friendly format. It uses data formats such as JSON to organize information such as facility names, ratings, addresses, and prices.

[1773] Input: Set of related information

[1774] Data processing: Convert the information into JSON format and organize it as an object containing the attributes of each facility (name, rating, address, price).

[1775] Output: Formatted search results

[1776] Specifically, the server converts the information retrieved from the database into a JSON object and structures it in a visually easy-to-understand format.

[1777] Step 6: Submit search results

[1778] The server sends the formatted search results to the terminal. This is typically sent as an HTTP response.

[1779] Input: Formatted search results

[1780] Output: Search results sent to the terminal as an HTTP response

[1781] Specifically, the server includes the search results in JSON format in the HTTP response body and sends it to the terminal.

[1782] Step 7: Displaying search results

[1783] The terminal receives search results sent from the server and displays them to the user. The list of facilities is visually displayed through the user interface.

[1784] Input: Search results received from the server

[1785] Output: Visual list of facilities displayed in the user interface

[1786] Specifically, the device parses the HTTP response and uses React to display the search results in a card format representing the facilities.

[1787] Step 8: Provide feedback

[1788] Users enter feedback about the facilities they used. The entered feedback is sent from the terminal to the server.

[1789] Input: User-entered feedback

[1790] Output: Feedback sent to the server as an HTTP request

[1791] Specifically, when a user enters their rating or comments into the feedback input form and presses the submit button, the feedback data is sent from the device to the server.

[1792] Step 9: Save Feedback

[1793] The server receives the feedback and stores it in the database. The analyzed feedback is used to improve search results in the future.

[1794] Input: Feedback sent from the device

[1795] Data processing: Analyze feedback and add it to the database.

[1796] Output: Feedback entries saved in the database

[1797] Specifically, the server analyzes the feedback it receives and then inserts it into the appropriate table in the MySQL database.

[1798] Step 10: Update your profile

[1799] The server updates the user profile based on the user's search history and feedback.

[1800] Input: User's search history, feedback

[1801] Data processing: Update user profiles and implement customizations based on the next search results.

[1802] Output: Updated user profile

[1803] Specifically, the server updates the user's profile information based on their past search history and feedback, creating a foundation for providing more accurate results in future search queries.

[1804] (Application Example 1)

[1805] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1806] Information regarding childcare facilities, educational institutions, and medical facilities presents a problem: users cannot quickly obtain the information they need and must gather it from multiple sources. Furthermore, search results are uniform and not customized based on the user's location or past search history, resulting in low user convenience. In addition, it is difficult for parents to find appropriate facilities and navigate accordingly when dropping off or picking up their children. As a result, it becomes a time-consuming and laborious process.

[1807] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1808] In this invention, the server includes means for collecting and integrating information related to childcare facilities, educational institutions, and medical institutions; means for processing search queries from users based on the information and extracting relevant information; means for transmitting the extracted information to a user terminal and displaying it to the user; means for receiving feedback from users and reflecting it in a database; means for customizing future search results based on the user's search history and feedback information; means for calculating the optimal route to childcare facilities, educational institutions, and medical institutions based on the user's location information and destination and providing navigation; and, as an example of application, means for providing information on childcare facilities, educational institutions, and medical institutions through an application integrated into the infotainment system of an autonomous vehicle. As a result, users can obtain necessary information quickly and centrally, customize it based on the user's location information and past search history, and enable parents to efficiently search for appropriate facilities when dropping off or picking up their children and reach their destination via the optimal route.

[1809] A "childcare facility" is a facility that takes in infants and young children during the day and provides them with education and childcare.

[1810] An "educational institution" refers to any institution that provides education, such as schools, cram schools, or extracurricular activity classes.

[1811] A "medical institution" is a facility that provides medical services, such as a hospital, clinic, or medical office.

[1812] "Means of collecting and integrating information" refers to a system that gathers data from various sources, centralizes it, and stores it in a database.

[1813] "Means for processing search queries" refers to a system that analyzes user search input and extracts relevant information from a database.

[1814] "Means of transmitting and displaying information" refers to a system that transmits extracted information to the user's terminal and presents it visually.

[1815] "A means of receiving feedback and reflecting it in the database" refers to a system that adds user feedback information, such as ratings and comments, to a database and updates the information.

[1816] "Means for customizing search results based on search history and feedback information" refers to a system that analyzes a user's past search history and provided feedback to deliver personalized search results.

[1817] "A means of calculating the optimal route based on location information and destination and providing navigation" refers to a system that calculates and guides the user to the optimal travel route based on their current location and set destination.

[1818] An "infotainment system for autonomous vehicles" is an information system installed in autonomous vehicles that includes navigation and entertainment functions.

[1819] A "user terminal" refers to a smartphone, tablet, or other electronic device used by a user to receive and interact with information.

[1820] This invention relates to a system for collecting and centrally managing information related to childcare facilities, educational institutions, and medical institutions. The system includes means for collecting and integrating information, processing search queries, displaying information on a user terminal, receiving feedback, and customizing based on search history. Furthermore, it is designed to be efficiently utilized through an application that integrates with the infotainment system of an autonomous vehicle and provides navigation functionality.

[1821] Server Processing

[1822] The server collects information from official websites, reviews, summary sites, and personal blogs related to childcare facilities, educational institutions, and medical institutions, and stores it in a database. This database serves to eliminate duplication and inconsistencies through centralized information management. Data scraping tools and APIs are used to collect information. Next, the server receives search queries submitted by users and extracts relevant information from the database. For example, if a user searches for "nearby daycare centers," the server extracts information on the most suitable daycare centers based on the user's current location (GPS data) and keywords. The server also receives feedback from users and adds it to the database. This provides accurate and reliable information that can be helpful to other users. Furthermore, the user profile is updated based on the user's search history and provided feedback to customize future search results. This customization provides even more accurate information.

[1823] Terminal processing

[1824] The device provides an intuitive user interface. It displays a search bar, filtering options, reviews, and other features, designed to help users easily find the information they need. When a user enters keywords into the search bar and presses the search button, the device sends the search query to the server. This retrieves information from the server based on the user's intent. The device receives the search results from the server and displays them to the user. This includes information such as the name, rating, distance, and fees of childcare facilities, educational institutions, and medical facilities. Users can also provide feedback about the facilities and institutions they have used, and the device sends this feedback to the server.

[1825] Navigation function of autonomous vehicles

[1826] Furthermore, these functions will also be applied to the infotainment systems of autonomous vehicles. When parents are dropping off or picking up their children, the autonomous vehicle's screen can immediately search for the most suitable educational or medical facilities and provide route guidance. For example, a parent can search for "nearby daycare centers," and the app will use the current location information to find and display a list of the most suitable daycare centers. Then, the autonomous vehicle will start navigation with the daycare center selected by the parent as the destination. This function allows users to travel along the most optimal route to their destination.

[1827] Hardware and software

[1828] The hardware used includes infotainment systems for autonomous vehicles, smartphones, tablets, and communication modules. The software includes data scraping tools, APIs, GPS functionality, and internet connectivity (including the requests library). Data acquisition and processing utilize RESTful APIs to retrieve necessary information from servers. An algorithm has also been developed to calculate the optimal route based on the user's location.

[1829] Examples of specific cases and prompt statements

[1830] As a concrete example, if a parent searches for a "nearby daycare center" using an autonomous vehicle, the following prompt message will be used.

[1831] "Please search for the nearest highly-rated daycare center from your current location."

[1832] "Please calculate the shortest route to the daycare center selected by the user."

[1833] This allows users to easily and quickly obtain relevant information within a single application, significantly reducing the time spent on research. Furthermore, information is updated based on user feedback, ensuring that the information is always up-to-date and reliable.

[1834] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1835] Step 1:

[1836] The user launches the application on their device and searches for information on childcare facilities, educational institutions, and medical facilities.

[1837] Specific action: The user enters keywords into the search bar displayed on the device screen and presses the search button.

[1838] Input: Keyword (e.g., "nearby daycare"), user's current location data (GPS information).

[1839] Output: A search query is generated and sent to the server.

[1840] Step 2:

[1841] The server receives search queries sent by users and extracts relevant information from the database.

[1842] Specific operation: The server executes a search query against the database and retrieves information on relevant childcare facilities, educational institutions, and medical institutions.

[1843] Input: Search query, facility information in the database.

[1844] Output: A list of extracted information.

[1845] Step 3:

[1846] The server extracts the information and sends it to the terminal, which then displays it to the user.

[1847] Specific operation: The server sends the acquired information to the user's terminal, which then displays it on the screen. This information includes facility name, rating, distance, etc.

[1848] Input: A list of extracted information.

[1849] Output: A list of facility information displayed on the user's terminal.

[1850] Step 4:

[1851] The user reviews the facility information and selects the facility they wish to use.

[1852] Specific action: The user selects a facility from the displayed list for which they want to view detailed information.

[1853] Input: Display list of facility information.

[1854] Output: Detailed information about the selected facility.

[1855] Step 5:

[1856] Based on the detailed information of the facility selected by the user, the device sends a request to begin navigation.

[1857] Specific operation: When the user presses the navigation button, the device sends a navigation start request to the server based on the location information of the selected facility.

[1858] Input: Location information of the selected facility.

[1859] Output: Navigation start request.

[1860] Step 6:

[1861] The server calculates the optimal route based on the user's current location and destination location information, and sends the navigation data to the terminal.

[1862] Specific operation: The server executes an algorithm to calculate the route based on GPS data and the location information of the selected facility. The calculated route information is then sent to the terminal.

[1863] Input: User's current location data, location information of the selected facility.

[1864] Output: Calculated optimal route information.

[1865] Step 7:

[1866] The device receives navigation data and displays and guides the user along the optimal route.

[1867] Specific operation: The terminal displays the received route information on a map and guides the user with voice and visual instructions.

[1868] Input: Calculated optimal route information.

[1869] Output: Navigation display and voice guidance.

[1870] Step 8:

[1871] After the user reaches their destination, they provide feedback.

[1872] Specific operation: Users enter ratings and comments about the facilities they visit and send feedback to the server via their device.

[1873] Input: User review comments.

[1874] Output: Feedback information sent to the server.

[1875] Step 9:

[1876] The server receives feedback and updates the database accordingly.

[1877] Specific operation: The server analyzes the received feedback information and updates the corresponding entry in the database.

[1878] Input: Feedback information submitted by the user.

[1879] Output: Updated database information.

[1880] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1881] The present invention is a system that collects and centrally manages information related to childcare facilities, educational institutions, and medical institutions, and further combines it with an emotion engine that recognizes user emotions. This system includes means for collecting and integrating information, means for processing search queries, means for displaying information on a user terminal, means for receiving feedback, means for customizing based on search history, and an emotion engine.

[1882] Server Processing

[1883] Database Management

[1884] The server collects information from official websites, reviews, summary sites, and personal blogs related to childcare facilities, educational institutions, and medical institutions, and stores it in a database. This database serves to eliminate duplication and inconsistencies through centralized information management.

[1885] Processing search queries

[1886] The server receives search queries submitted by users and extracts relevant information from the database. For example, if a user searches for "nearby daycare centers," the server extracts information on the most suitable daycare centers based on the user's current location (GPS data) and the keywords.

[1887] Feedback Management

[1888] The server receives feedback from users and adds it to the database. This provides accurate and reliable information that can be helpful to other users.

[1889] Profile update

[1890] The server updates user profiles based on the user's search history and feedback, customizing future search results. This customization provides more accurate information.

[1891] Emotional Engine Processing

[1892] Recognition of emotions

[1893] The server recognizes the user's emotions through analysis of their facial expressions, voice, and text. This uses facial recognition technology and natural language processing technology.

[1894] Emotion-based filtering

[1895] The sentiment engine filters or ranks search results based on the recognized user's emotions. For example, if a user is feeling stressed, it prioritizes displaying activities that can help reduce stress.

[1896] Dynamic adjustment

[1897] The emotion engine dynamically changes the information and recommendations displayed in response to changes in the user's emotions. This can increase user satisfaction.

[1898] Terminal processing

[1899] Display of the user interface

[1900] The device provides an intuitive user interface. It features a search bar, filtering options, reviews, and other elements, designed to make it easy for users to find the information they need.

[1901] Submit a search query

[1902] When a user enters keywords into the search bar and presses the search button, the device sends that search query to the server. This allows the server to retrieve information that is in line with the user's intent.

[1903] Displaying search results

[1904] The system receives search results sent from the server and displays them to the user. This includes information such as the name, rating, distance, and fees of childcare facilities, educational institutions, and medical facilities.

[1905] Provide feedback

[1906] Users can provide feedback about the facilities and institutions they have used. The device sends this feedback to the server.

[1907] User actions

[1908] Execute search

[1909] The user uses the application to search for things like "nearby daycare centers." The search query and location information are sent to the server.

[1910] View results

[1911] Users view the search results returned from the server and check detailed information about facilities and organizations that interest them.

[1912] Provide feedback

[1913] This system provides feedback on facilities and institutions that users have actually visited. This feedback includes ratings and comments, which are sent from the user's device to the server.

[1914] Specific example

[1915] Example 1: Searching for daycare centers and displaying recommendations based on sentiment.

[1916] 1. The user searches for "nearby daycare centers" on their device.

[1917] 2. The emotion engine recognizes the user's stress level as high.

[1918] 3. The server prioritizes displaying daycare centers that can reduce stress (for example, daycare centers with a rich natural environment).

[1919] 4. Search results are sent to and displayed on the device.

[1920] 5. The user reviews the details and makes a reservation at the daycare center.

[1921] Thus, by providing information that takes user emotions into consideration, the present invention can improve the user experience and provide more personalized services.

[1922] The following describes the processing flow.

[1923] Processing steps for searching for daycare centers and displaying sentiment-based recommendations

[1924] Step 1: Display the search screen

[1925] The device displays a search screen to the user. It provides an interface that includes a search bar and filtering options.

[1926] Step 2: Enter your search query

[1927] The user enters "nearby daycare" into the search bar and taps the search button.

[1928] Step 3: Submit your search query

[1929] The terminal sends the entered search query to the server as an HTTP request.

[1930] Step 4: Receiving the Request

[1931] The server receives a search request from the terminal.

[1932] Step 5: Receiving emotional data

[1933] The server's emotion engine receives voice, text, and facial expression data transmitted from the terminal to recognize the user's emotions. For example, it measures the user's stress level using voice tone and expression, as well as facial recognition technology.

[1934] Step 6: Database Reference

[1935] The server accesses a database containing data about daycare centers and extracts information on the most suitable daycare center based on the user's current location (GPS data) and keywords.

[1936] Step 7: Filtering and scoring data

[1937] The server's sentiment engine filters and ranks search results based on the recognized user's emotions. For example, if a user is feeling stressed, it prioritizes displaying daycare centers that offer a relaxing environment.

[1938] Step 8: Generating Results

[1939] The server generates the filtering and scoring results in JSON format and prepares to send them back to the terminal.

[1940] Step 9: Receiving Results

[1941] The terminal receives search results from the server.

[1942] Step 10: Perspective of the results

[1943] The terminal parses the received JSON data and converts it into a structured list or card view.

[1944] Step 11: Displaying search results

[1945] The device displays search results to the user in a viewable format, including information such as the name, rating, distance, and fees of each daycare center.

[1946] Step 12: View detailed information

[1947] Users select a daycare center they are interested in from the displayed search results and tap it to go to the detailed information page.

[1948] Step 13: Entering Feedback

[1949] Users can use the app to provide feedback (for example, star ratings, comments, and changes in their feelings) after actually visiting or using the daycare center.

[1950] Step 14: Submitting Feedback

[1951] The device sends the user's input to the server.

[1952] Step 15: Receiving Feedback

[1953] The server receives feedback sent from the terminal.

[1954] Step 16: Update the database

[1955] The server saves the received feedback to the database and updates the relevant nursery school information, reflecting the ratings and comments.

[1956] Step 17: Update your profile

[1957] The server also updates the user's profile information, incorporating feedback into future search results.

[1958] This allows users to quickly and efficiently obtain the necessary information about daycare centers, and the feedback they provide will be used to improve the search function for future use. In addition, by using an emotion engine, it becomes possible to provide personalized information based on the user's emotions.

[1959] (Example 2)

[1960] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1961] Information related to childcare facilities, educational institutions, and medical institutions is diverse, making it difficult to efficiently collect and centrally manage it. Furthermore, providing users with the most relevant information requires personalized information that considers their emotions and circumstances, rather than simply relying on search queries. However, current systems do not adequately consider these factors in their information provision, highlighting the need for improved user experience. Additionally, there is a lack of effective means to utilize user feedback to improve future search results.

[1962] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[1963] In this invention, the server includes means for collecting and integrating information related to childcare facilities, educational institutions, and medical institutions; means for processing search queries from users based on the information and extracting relevant information; means for transmitting the extracted information to a user terminal and displaying it to the user; means for receiving feedback from users and reflecting it in a database; means for customizing future search results based on the user's search history and feedback information; means for recognizing the user's emotions through analysis of the user's facial expressions, voice, and text; means for filtering or ranking search results based on the recognized user emotions; and means for dynamically changing the displayed information and recommendations in accordance with changes in the user's emotions. This enables the provision of personalized information that takes into account the user's emotions and circumstances. Furthermore, it allows for the effective use of user feedback to improve future search results.

[1964] A "childcare facility" refers to a facility that provides temporary or long-term care for infants and children.

[1965] An "educational institution" refers to an organization or facility that teaches academic subjects or skills, and includes schools, cram schools, and vocational schools.

[1966] A "medical institution" refers to a facility that provides medical services such as treatment, diagnosis, and prevention, and includes hospitals and clinics.

[1967] "Means of collecting and integrating information" refers to methods or devices for obtaining necessary data from the internet or other sources, organizing it, and storing it in a database.

[1968] "Means for processing search queries" refers to a method or device that understands the search criteria entered by the user and extracts appropriate data from a database based on those criteria.

[1969] "Means for transmitting information to a user's terminal and displaying it to the user" refers to a method or device for transmitting search results to a user's device and displaying them.

[1970] "Means of receiving feedback and reflecting it in the database" refers to a method or device for receiving ratings and comments from users and adding that information to a database.

[1971] "Means for customizing future search results based on search history and feedback information" refers to methods or devices that analyze past search history and feedback and individually adjust future search results based on that information.

[1972] "Means of recognizing user emotions through analysis of user facial expressions, voice, and text" refers to methods or devices that detect a user's emotional state using facial recognition technology, voice analysis, and natural language processing.

[1973] "Means of filtering or ranking search results based on emotion" refers to methods or devices that change the priority of search results according to the perceived emotions of the user.

[1974] "Means of dynamically changing displayed information and recommendations in response to changes in the user's emotions" refers to a method or device that updates displayed content and recommendations in real time when the user's emotions change.

[1975] The present invention is a system for collecting and integrating information related to childcare facilities, educational institutions, and medical institutions, and for providing personalized information that takes into account the user's emotions. This system includes means for collecting and integrating information, means for processing search queries, means for displaying information on a user terminal, means for receiving feedback, means for customizing based on search history, and an emotion engine.

[1976] Server Processing

[1977] Database Management

[1978] The server uses web scraping techniques to collect information about childcare facilities, educational institutions, and medical institutions from official websites, review sites, summary sites, personal blogs, etc., and stores it in a database. Python's BeautifulSoup library is used for data collection. MySQL or similar databases are used, and pre-processing algorithms are implemented to eliminate duplication and inconsistencies.

[1979] Processing search queries

[1980] The server receives search queries submitted by users and extracts relevant information from the database. It generates SQL queries based on the search queries and the user's location information (GPS data) and executes them against the database. The extracted information is temporarily held in memory.

[1981] Feedback Management

[1982] The server receives user feedback and adds it to the database. The feedback is analyzed using text processing techniques and stored in the database as ratings and comment information. This provides accurate and reliable information that can be helpful to other users.

[1983] Profile update

[1984] The server updates the user profile based on the user's search history and feedback provided, customizing future search results. This updated profile information is used for subsequent searches, resulting in more personalized results.

[1985] Emotional Engine Processing

[1986] Recognition of emotions

[1987] The server recognizes the user's emotions through analysis of their facial expressions, voice, and text. This analysis utilizes OpenCV, the Google Cloud Speech-to-Text API, and natural language processing techniques. The emotion engine filters or ranks search results based on the recognized emotions.

[1988] Emotion-based filtering

[1989] The emotion engine dynamically changes the priority of search results, for example, by prioritizing activities that can reduce stress when a user is feeling stressed.

[1990] Dynamic adjustment

[1991] The emotion engine updates the displayed information and recommendations in real time in response to changes in the user's emotions. This can increase user satisfaction.

[1992] Terminal processing

[1993] Display of the user interface

[1994] The device provides an intuitive user interface, displaying a search bar, filtering options, reviews, and more. It also includes a list of search results and a map display.

[1995] Submit a search query

[1996] When a user enters keywords into the search bar and presses the search button, the device sends that search query and location information to the server.

[1997] Displaying search results

[1998] The terminal displays search results sent from the server to the user. Information such as the name, rating, distance, and fees of childcare facilities, educational institutions, and medical facilities are displayed.

[1999] Provide feedback

[2000] Users can provide feedback about the facilities and institutions they have used, and the device sends this feedback to the server.

[2001] User actions

[2002] Execute search

[2003] The user uses the application to search for things like "nearby daycare centers." The search query and location information are sent to the server via the device.

[2004] View results

[2005] Users view the search results returned from the server and check detailed information about facilities and organizations that interest them.

[2006] Provide feedback

[2007] This system provides feedback on facilities and institutions that users have actually visited. This feedback includes ratings and comments, which are sent from the user's device to the server.

[2008] Specific example

[2009] Search for daycare centers and display recommendations based on sentiment.

[2010] 1. The user searches for "nearby daycare centers" on their device.

[2011] 2. The emotion engine recognizes the user's stress level as high.

[2012] 3. The server prioritizes displaying daycare centers that can reduce stress (e.g., daycare centers with a rich natural environment).

[2013] 4. Search results are sent to and displayed on the device.

[2014] 5. The user reviews the details and makes a reservation at the daycare center.

[2015] Example of a prompt

[2016] "I'm looking for a local daycare center. Please recommend one that takes into account the feelings and status of the parents."

[2017] Thus, each processing step of the system consists of multiple substeps, each involving a specific action, and extends in detail from user input to data collection and feedback processing. The coordination of these various elements enables the provision of personalized information that takes into account the user's emotions and circumstances.

[2018] The flow of the specific processing in Example 2 will be explained using Figure 13.

[2019] Step 1: Data collection and database management

[2020] Server operation

[2021] The server uses web scraping techniques to collect information about childcare facilities, educational institutions, and medical institutions from various websites. Specifically, it uses the Python BeautifulSoup library to extract data from official websites, review sites, summary sites, personal blogs, and other sources.

[2022] Input: Website URL

[2023] Data processing: Web page analysis and extraction of necessary information.

[2024] Output: Database where the extracted information is stored (e.g., MySQL)

[2025] The server removes duplicate data, verifies inconsistencies in the informatio...

Claims

1. A means of collecting and integrating information related to childcare facilities, educational institutions, and medical institutions, A means for processing user search queries based on the aforementioned information and extracting relevant information, A means of sending the extracted information to the user's terminal and displaying it to the user, A means of receiving user feedback and reflecting it in the database, A system that includes means to customize future search results based on the user's search history and feedback information.

2. The system according to claim 1 for collecting word-of-mouth information and personal blog information regarding childcare facilities, educational institutions, and medical institutions.

3. The system according to claim 1, which identifies nearby childcare facilities, educational institutions, and medical institutions based on the user's location information.

Images