system
The system addresses the challenge of efficiently collecting and managing childcare facility information by automating data collection, inquiries, and reservations, providing a unified interface for seamless user experience.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- SOFTBANK GROUP CORP
- Filing Date
- 2024-12-09
- Publication Date
- 2026-06-19
AI Technical Summary
Information about childcare facilities is dispersed and difficult to collect efficiently, requiring manual reservation processes that burden users with time and effort.
A system that automatically collects information from childcare facilities, makes inquiries based on user needs, books visits, and manages availability, providing a unified interface for efficient management and reservation.
Streamlines the process of acquiring and managing childcare facility information, enabling user-friendly operation and reducing the burden on users by automating information collection and reservation processes.
Smart Images

Figure 2026100587000001_ABST
Abstract
Description
Technical Field
[0001] The technology of the present disclosure relates to a system.
Background Art
[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] Information regarding nursery facilities is dispersed for each facility, and the process of collecting this information requires a great deal of time. Furthermore, it is necessary to separately make reservations for facility tours and check the availability status, which places a heavy burden on users. Therefore, there is a need for a system that can efficiently and centrally collect necessary information and manage tour reservations and availability status.
Means for Solving the Problems
[0005] This invention provides a system that includes means for automatically collecting information on childcare facilities, means for automatically making inquiries based on the collected information, means for booking visits to childcare facilities, and means for managing the availability of childcare facilities. This system allows users to efficiently perform all tasks related to childcare facilities through a unified interface.
[0006] A "childcare facility" is a facility that provides childcare and education to children during the daytime.
[0007] "Means of automatically collecting information" refers to technologies or methods that automatically acquire necessary information from websites or public databases using programs.
[0008] "Means of inquiry" refers to a technology or method for automatically sending questions and obtaining answers in order to acquire information specified by the user.
[0009] "Method for booking a visit" refers to a technology or method that allows users to register their desired date and time for visiting a childcare facility in advance and automatically makes a reservation based on the user's preferred date and time.
[0010] "Means for managing availability" refers to technologies or methods for collecting, analyzing, and presenting up-to-date information regarding the capacity of childcare facilities to users. [Brief explanation of the drawing]
[0011] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5]This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] This is a sequence diagram showing the processing flow of the data processing system in Example 2, which incorporates an emotion engine. [Figure 14] This is a sequence diagram showing the processing flow of the data processing system in Application Example 2, which combines an emotion engine. [Modes for carrying out the invention]
[0012] Hereinafter, an example of an embodiment of the system relating to the technology of this disclosure will be described with reference to the attached drawings.
[0013] First, let's explain the terminology used in the following explanation.
[0014] In the following embodiments, the numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.
[0015] In the following embodiments, the numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.
[0016] In the following embodiments, the numbered storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, and the like.
[0017] In the following embodiments, the numbered communication I / F (Interface) is an interface including a communication processor and an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark), and the like.
[0018] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."
[0019] [First Embodiment]
[0020] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.
[0021] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0022] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0023] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.
[0024] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0025] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0026] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.
[0027] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0028] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.
[0029] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0030] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0031] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".
[0032] As an embodiment for carrying out the present invention, we propose a method based on the following system configuration. This system aims to efficiently exchange information between a server, terminals, and users, and to centralize everything from information gathering to reservations and management related to childcare facilities.
[0033] First, the server automatically crawls pre-configured official websites of municipalities and childcare facilities to collect publicly available information about these facilities. The server then uses programs to efficiently extract the necessary information, parsing the data in HTML and JSON formats and storing it in a database. This database is updated at regular intervals to ensure it is always up-to-date.
[0034] Next, users can search for specific information about childcare facilities through an interface provided on their device. If a user wants to obtain detailed information about a facility they are interested in, the system will perform an automated query for that information via the server. This query might, for example, retrieve information about allergy accommodations or special programs.
[0035] The terminal displays sequentially processed responses to the user and updates the information according to the user's interests. If the user wishes to visit, they enter their desired date and time into the terminal, and the server automatically makes a reservation for the visit to the childcare facility. Once the reservation is confirmed, a confirmation notice is sent to the user, and the reservation information is also recorded on the server.
[0036] Furthermore, the server collects and analyzes the latest data on the availability of childcare facilities from municipal databases. Based on this analysis, the terminal visually displays information to the user about which facilities have availability, supporting the management of enrollment schedules.
[0037] As a concrete example, consider a scenario where a user wants to check the latest availability at "Childcare Facility A" and inquire about allergy accommodations. In this case, the user selects the facility from their terminal and enters their inquiry. The server automatically queries "Childcare Facility A," analyzes the response, and displays it on the terminal. Based on the displayed information, the user reserves a date for their visit and immediately receives a confirmation notification.
[0038] In this way, the system according to the present invention streamlines the process of acquiring and managing childcare facility information, enabling user-friendly operation.
[0039] The following describes the processing flow.
[0040] Step 1:
[0041] The server loads a list of URLs for the official websites of municipalities and childcare facilities. It then launches a web scraping program to automatically crawl these sites and collect information.
[0042] Step 2:
[0043] The server analyzes the acquired HTML and JSON data to extract information such as the location of the childcare facility, opening hours, and childcare fees. The analyzed information is then stored in a database.
[0044] Step 3:
[0045] Users search for information about specific childcare facilities through an interface on their device. They select facilities of interest and request further details.
[0046] Step 4:
[0047] The server automatically creates an inquiry format in response to the user's request and sends an information retrieval request to the specific childcare facility via email or API.
[0048] Step 5:
[0049] After the server receives a response from a childcare facility, it analyzes the content, extracts the necessary information, and adds or updates it to the database.
[0050] Step 6:
[0051] The user checks the updated inquiry information on the interface on their device. A notification is sent from the device when the information becomes available.
[0052] Step 7:
[0053] If a user wishes to visit a childcare facility, they select the date and time from the calendar displayed on their device.
[0054] Step 8:
[0055] The server registers the selected date and time in the reservation system and sends a request for a visit reservation to the childcare facility.
[0056] Step 9:
[0057] The server receives the reservation confirmation and sends a confirmation notice to the user via email or their device. The reservation information is also recorded in the database.
[0058] Step 10:
[0059] The server periodically collects and analyzes information on the availability of childcare facilities from municipal websites.
[0060] Step 11:
[0061] The analyzed availability data is visually displayed to the user on their device, assisting them in managing their child's admission schedule. Based on this information, the user can find a suitable facility.
[0062] (Example 1)
[0063] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."
[0064] Managing and utilizing information about modern childcare facilities requires a great deal of manual work and complex procedures, making it difficult for users to efficiently gather facility information and manage reservations. Furthermore, it is necessary to constantly monitor and appropriately present fluctuating availability, but doing so manually is laborious and inefficient. There is a need to solve these problems and provide a system that is highly convenient for users.
[0065] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0066] In this invention, the server includes means for automatically collecting facility information by crawling websites, means for analyzing the collected information and organizing and storing it in a database, and means for analyzing availability using municipal data and presenting it visually. As a result, users can efficiently collect the latest childcare facility information and centrally manage everything from booking facility tours to checking availability without having to do any manual work themselves.
[0067] "Website crawling" refers to the process where a server automatically visits multiple web pages on the internet to collect necessary information.
[0068] "Facility information" refers to all relevant data about the childcare facility, including details such as name, address, contact information, availability, and programs offered.
[0069] "Automatic data collection methods" refer to systems where a server uses a program to collect data without human intervention.
[0070] "Organizing and storing information in a database" is the process of systematically arranging collected information according to a specific structure and saving it in a way that allows for later access.
[0071] "Analyzing and visually presenting" means analyzing collected data, converting it into an easily understandable form, and showing it to the user in a graphical format.
[0072] "Using data from municipalities" means using information provided by specific local governments to perform more accurate analysis.
[0073] As an embodiment of the present invention, the following system is constructed. It is possible to centralize the collection, reservation, and management of childcare facility information while coordinating between the server, terminal, and user.
[0074] The server uses a program to automatically crawl websites and collect facility information. This collection utilizes libraries such as Beautiful Soup and Selenium in the Python language. The server parses HTML files and JSON responses to extract information such as the name, address, contact information, availability, and special program details of childcare facilities. The extracted data is stored in a MySQL® database, where it is centrally managed. This information is regularly updated to ensure it is always up-to-date.
[0075] As a concrete example, the server executes a scheduled task at 9:00 AM every day, crawling all target websites to retrieve new information.
[0076] Users can log in via their device and search for information on any childcare facility. The device interface is built with the latest front-end technologies such as React, providing an intuitive user experience. Users can enter the facility name in the search bar and make detailed inquiries as needed. When making an inquiry, it is possible to obtain information such as the content of special programs or allergy accommodations, and to review the results.
[0077] For example, if a user wants to check the availability of "Childcare Facility A," they can simply type "Childcare Facility A" into the terminal and press the Enter key, and the information will be displayed instantly.
[0078] The terminal visually organizes the collected information and presents it to the user. The visual display utilizes charts and color-coded infographics to ensure user comprehension. The terminal also receives requests for tour dates and automatically processes facility tour reservations through the server.
[0079] As an example of a prompt message, entering "Please tell me the latest availability and allergy information for childcare facility A" will allow the system to quickly provide specific information.
[0080] This system facilitates smooth data exchange between servers, terminals, and users, enabling efficient collection and management of information related to childcare facilities.
[0081] The flow of the specific processing in Example 1 will be explained using Figure 11.
[0082] Step 1:
[0083] The server crawls websites to collect information on childcare facilities. The input is a list of URLs for target municipalities and facilities. Beautiful Soup and Selenium are used to parse the HTML and JSON data of the web pages and extract the necessary information (e.g., facility name, location, availability). The extracted information is stored in a structured format in temporary storage.
[0084] Step 2:
[0085] The server analyzes the collected data and stores it in a database. The input is raw data stored in temporary storage. The data is converted to a specific format (e.g., CSV format), and duplicate checking and data cleansing are performed. The clean data is stored in a MySQL database, and indexes are added to allow for efficient searching of the information.
[0086] Step 3:
[0087] The user searches for and displays childcare facility information using their device. Input consists of the facility name and criteria (e.g., whether or not they accommodate allergies) entered by the user in the device's search bar. The server executes a database query to retrieve the relevant facility information and returns it to the device. Output is the facility information displayed on the device in a format viewable by the user.
[0088] Step 4:
[0089] If the user wishes to confirm further details, they can make additional inquiries through the terminal. The input is a specific information item selected by the user (e.g., the contents of a special program). The server retrieves the relevant information from the database and, if necessary, uses external APIs to obtain the latest information. The output is the detailed information displayed on the terminal.
[0090] Step 5:
[0091] When a user wishes to make a reservation for a tour, they enter their desired date and time on a terminal. The input is a calendar-style interface specifying the desired date and time. The terminal sends a reservation request to the server, which then confirms the reservation in cooperation with the facility management system. The output is a reservation confirmation notice sent to the user.
[0092] Step 6:
[0093] The terminal visually displays availability. The input is the latest availability data retrieved from the server. The data is converted into a color-coded chart using a graphics library, presenting the facility's congestion status to the user at a glance. The output is a visually represented availability information.
[0094] (Application Example 1)
[0095] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."
[0096] Traditionally, gathering information and managing reservations for childcare facilities has been a complex and time-consuming task, making it particularly difficult for parents and guardians to efficiently obtain necessary information and appropriately book visits. Furthermore, there has been insufficient support for providing information and scheduling childcare facilities using voice recognition technology and automated devices, highlighting the need for easy-to-use services at home.
[0097] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0098] In this invention, the server includes means for automatically collecting information on childcare facilities, means for receiving and responding to user voice instructions using a voice recognition function, and means for analyzing natural language using a generative AI model to assist in selecting the optimal childcare facility. As a result, users can obtain the latest information on childcare facilities and quickly make reservations for visits through simple operation using voice instructions.
[0099] A "childcare facility" is a facility that provides temporary or continuous childcare services to infants and preschool children.
[0100] "Methods of automatic collection" refer to methods of obtaining information related to childcare facilities from designated websites or databases using a program without requiring manual operation.
[0101] The "inquiry method" is a system that automatically requests necessary information from childcare facilities based on conditions specified by the user.
[0102] "Method for booking a visit" refers to a method for automatically registering and coordinating visits to childcare facilities specified by the user.
[0103] "Means for analyzing and managing availability" refers to a system for examining the number of children a childcare facility can accommodate and its availability, and for providing appropriate information to users.
[0104] "Voice recognition functionality" is a technology that converts a user's voice commands into digital data, understands it appropriately, and processes it.
[0105] A "home automation device" is a device installed in the home that provides information through voice and displays and works in conjunction with home appliances to enhance user convenience.
[0106] A "generative AI model" is an artificial intelligence technology that automatically learns from vast amounts of data and understands and analyzes natural language.
[0107] "Means of analyzing natural language" refers to software technologies that analyze user utterances and text, understand their intent, and apply that understanding.
[0108] To implement this invention, a home automation device and a server with internet connectivity are required. The server automatically collects information on a designated childcare facility and stores it in an SQLite database. The Python BeautifulSoup library is used for web scraping, and Celery is used for scheduling information updates.
[0109] The user gives voice commands through an automated device in the home. This device uses the Google® Cloud Speech-to-Text API to convert the voice into text data, and then uses a generative AI model (TENSORFLOW® library) for natural language processing to understand the user's requests.
[0110] Based on the information received from the user, the server automatically makes reservations for visits to designated childcare facilities and requests detailed information. The reservation system uses the Google Calendar API to automatically adjust schedules.
[0111] This system provides real-time information on the availability of childcare facilities based on user voice commands and suggests the optimal visit date and time. The information is displayed via voice, and in some cases, as visual information on the display of a home automation device.
[0112] For example, if a user says, "Please book a visit to childcare facility A next Monday," the server retrieves the latest information from the internet and automatically completes the visit reservation. It then immediately reports the result by voice and, in some cases, displays a confirmation message on the screen. An example of a prompt to the generating AI model is, "Please tell me the latest availability at the childcare facility. I would like to check on allergy policies and book a visit." This system simplifies cumbersome procedures.
[0113] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0114] Step 1:
[0115] The server periodically accesses pre-specified websites related to childcare facilities to collect information. The input is the URL of the webpage. Using the Python BeautifulSoup library, the HTML data is parsed to extract information such as the availability of childcare facilities and other facility details. The extracted data is stored in an SQLite database. The output is a database containing the latest childcare facility information.
[0116] Step 2:
[0117] The user gives voice commands to a home automation device. This input is voice data. The device uses the Google Cloud Speech-to-Text API to convert this voice data into text data. The output is text data corresponding to the voice commands. This text data is then subjected to natural language processing via a generative AI model.
[0118] Step 3:
[0119] The server receives text instructions from the user and determines which childcare facilities to contact. The input is the text data provided by the user. Based on the parsed text data, the server determines the content of the inquiry and contacts the necessary childcare facilities. The output is detailed information about the childcare facilities. The information is based on the user's preferences.
[0120] Step 4:
[0121] The server analyzes the reservation status of childcare facilities and identifies available dates and times for visits. The input is reservation information obtained from the childcare facilities. Using the Google Calendar API, the visit reservation is automatically registered in the user's calendar. The output is a reservation completion notification. This notification is sent to the user's home automation device.
[0122] Step 5:
[0123] The home automation device notifies the user via voice and visual display that a reservation has been completed. The input is a reservation completion notification from the server. The device displays a confirmation message on its screen and provides an audio notification. The output is the final notification to the user.
[0124] Throughout this entire process, the server, users, and home automation devices work together to enable smooth information provision and reservations for childcare facilities.
[0125] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0126] As an embodiment of the present invention, we propose a system that optimizes the provision of childcare facility information based on the user's emotional state. This system integrates a server, a terminal, and an emotion engine that analyzes the user's emotional state, thereby improving the user experience in addition to collecting, inquiring about, making reservations for, and managing availability of childcare facilities.
[0127] First, the user searches for information about childcare facilities via their device and, if necessary, enters specific questions into the system. This information is then sent to the sentiment engine, which extracts and analyzes emotions from the user's text. This sentiment analysis is performed in real time using natural language processing (NLP).
[0128] Next, the server adjusts the information on childcare facilities and changes the priority of suggesting specific facilities based on the analyzed emotional data. This adjustment allows, for example, to provide an intuitively understandable interface if the user is feeling stressed, or to suggest new childcare facility options if a positive emotional state is indicated.
[0129] The terminal presents users with customized information and also provides support when users make tour reservations. In this process, the emotion engine can suggest tour dates, times, and facilities that are deemed high priority based on the user's emotional state. Furthermore, availability analysis information is presented in a way that adapts to the emotional state, allowing users to receive more personalized information.
[0130] For example, if a user searches for information on "Childcare Facility B" and the device indicates that they are experiencing stress, the emotion engine will highlight information about stress reduction programs offered by Childcare Facility B (e.g., activities for relaxation). Furthermore, to simplify the booking process, the device will automatically suggest the nearest available date and time.
[0131] Thus, by integrating an emotion engine, the system of the present invention provides information adapted to the user's emotional state, making the process of finding childcare facilities more personalized and efficient.
[0132] The following describes the processing flow.
[0133] Step 1:
[0134] Users log in to the interface using their device to search for information on childcare facilities. They enter search criteria and specific questions and request information collection.
[0135] Step 2:
[0136] The device receives user input data and sends it to the emotion engine. The emotion engine uses natural language processing techniques to analyze the user's text data and identify their emotional state.
[0137] Step 3:
[0138] The server extracts relevant information from the childcare facility database based on the user's emotional state. If the emotion is stress, it prioritizes extracting information about the facility's stress reduction programs.
[0139] Step 4:
[0140] The server adjusts the style of information provided to the user based on their emotional state. For example, if the user is relaxed, it will increase the frequency of presenting new childcare options.
[0141] Step 5:
[0142] The terminal presents the user with adjusted information. The user can view information about childcare facilities and, if necessary, decide to schedule a visit.
[0143] Step 6:
[0144] When a user wishes to schedule a tour, the device automatically suggests a suitable date and time based on their emotional state. The user then reviews the suggested date and time and enters their preferred tour date and time.
[0145] Step 7:
[0146] The server registers the user's request for a visit in the reservation system and coordinates with the childcare facility. Once the reservation is confirmed, a reservation confirmation message is sent to the user via their device.
[0147] Step 8:
[0148] The server periodically updates the availability status of childcare facilities using web data from municipalities. It then delivers the results of analysis using an emotion engine to the user's device, providing them with high-priority availability information.
[0149] In this way, the system, which incorporates an emotion engine, provides personalized services based on the user's emotional state, making the process of finding childcare facilities smoother.
[0150] (Example 2)
[0151] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".
[0152] In the collection, booking, and management of information regarding childcare facilities, there is a lack of personalized information provision that takes into account the emotional state of users. Traditional systems only provide uniform information, which is problematic because it fails to alleviate the emotional burden and anxiety experienced by users.
[0153] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0154] In this invention, the server includes means for automatically aggregating information on childcare facilities, means for analyzing the emotional state of users and dynamically adjusting the information based on the analysis results, and means for presenting the adjusted information to users and supporting them in making reservations for visits. This enables personalized information provision and reservation support tailored to the emotional state of users.
[0155] "Childcare facilities" is a general term for facilities that provide educational and childcare services to children.
[0156] "Means for automatically aggregating information" refers to a function that automatically collects data related to childcare facilities and consolidates it in one place.
[0157] "Means of inquiry" refers to a function that automatically generates questions based on aggregated information in response to user requests and retrieves the necessary information.
[0158] "Method for booking a visit" refers to a support function that allows users to book a visit to a childcare facility on a date specified by the user.
[0159] "Means for analyzing and managing availability" refers to a function that analyzes the availability status of childcare facilities and manages it as information.
[0160] "Means for analyzing emotional states" refers to technologies that extract and analyze emotions from user input information.
[0161] "Means of dynamically adjusting information" refers to a function that changes the content and order of the information provided based on analyzed sentiment data.
[0162] "Means of presenting adjusted information and supporting tour reservations" refers to a function that presents adjusted information to users and supports the smooth progress of tour reservations.
[0163] This invention utilizes a system integrating a server, terminal, text analysis, and emotion engine to provide childcare facility information adapted to the user's emotional state. When a user searches for information related to childcare facilities through the terminal, the text data is sent to the emotion engine. The emotion engine uses natural language processing (NLP) technology to analyze the user's emotions in real time. Based on this analysis, the server dynamically adjusts the priority of the childcare facility information provided. This makes it possible to provide information tailored to the user's emotions.
[0164] The server adjusts and delivers information to the terminal, suggesting the optimal date, time, and facility for the visit. This allows users to have a less stressful experience and quickly book a visit. For example, if the analysis indicates that a user is experiencing stress while searching for information about childcare facility B, the terminal will automatically suggest stress reduction programs offered by childcare facility B and the most easily available visit time.
[0165] While sentiment analysis using generative AI models forms the core of this system, the system is designed to maintain sophisticated security protocols and ensure the privacy of user data. An example of a prompt would be: "A user is searching for information about childcare facilities and has given input indicating stress. Explain how the sentiment engine should handle the user's input and what information should be prioritized."
[0166] This system enables personalized information delivery based on emotional states, allowing users to search for childcare facilities more efficiently and comfortably.
[0167] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0168] Step 1:
[0169] A user uses a terminal to search for information about childcare facilities. The user enters the name and location of the childcare facility as keywords into the terminal. Based on this input data (e.g., text), the search is initiated. The entered keywords are sent to a database for subsequent processing.
[0170] Step 2:
[0171] The terminal receives user input data and sends it to the emotion engine. The terminal accurately captures the input and creates a data packet to transfer to the server. This packet contains the information entered by the user. After transmission, the data awaits emotion analysis on the server.
[0172] Step 3:
[0173] The server passes the received user input data to the emotion engine for analysis. The emotion engine uses a generative AI model to extract emotions from the text. This data processing process executes an emotion analysis algorithm and outputs the user's emotional state (e.g., stress, relief, etc.). This allows for information adjustment in the next step.
[0174] Step 4:
[0175] The server dynamically adjusts childcare facility information using the emotion data output by the emotion engine. Based on the emotion data, it changes the priority of facilities and organizes related information. This data calculation sorts the information in the most appropriate way. The adjusted information is then ready to be presented to the user in the most optimal format.
[0176] Step 5:
[0177] The terminal receives information processed from the server and presents it to the user. The terminal displays facility information along with recommendations based on sentiment analysis results. This output includes suggested visit dates and times, as well as facility details. The terminal also features a user interface designed to simplify the visit reservation process.
[0178] Step 6:
[0179] Based on the information provided by the user, the system sets up a reservation for a visit to a childcare facility. The user makes selections and makes the reservation based on the optimized information. The user's selections are sent back to the server, and the entire system enters the process of completing the reservation.
[0180] Through this process, the system provides users with a personalized experience that adapts to their emotional state.
[0181] (Application Example 2)
[0182] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".
[0183] In today's world, many parents experience emotional burdens when choosing childcare facilities. Therefore, there is a need to provide information that is tailored to the emotional state of parents. Furthermore, there is a need for smoother access to facility information, availability checks, and scheduling visits. The challenge lies in reducing the psychological burden on parents and supporting efficient childcare facility selection.
[0184] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.
[0185] In this invention, the server includes means for automatically collecting information on childcare facilities, means for automatically querying information specified by the user, means for booking visits, means for analyzing the user's emotional state to optimize information provision, and means for presenting information via a home-use device. This makes it possible to efficiently and individually provide appropriate childcare facility information according to the user's emotional state.
[0186] A "childcare facility" is a facility that takes care of infants and children for a set period of time and supports their growth through education, play, and other activities.
[0187] "Means for automatically collecting information" refers to a process of setting specific conditions or filters and automatically collecting data accordingly.
[0188] "A means of automatically querying information specified by the user" refers to a mechanism that automatically queries an external system or database for relevant data based on the conditions entered by the user.
[0189] "Means for booking a tour" refers to the function of making a reservation to visit a specific facility or on a designated date and time.
[0190] "Methods for analyzing users' emotional states and optimizing information provision" refers to the process of analyzing users' emotions and customizing the information provided based on the results.
[0191] "Means of presenting information via household machinery and devices" refers to a function that provides users with necessary information visually or audibly through devices used within the home.
[0192] One embodiment of this invention involves using a home-use device connected to a terminal owned by a user within their home. The terminal has a dedicated application installed for automatically collecting and providing data related to childcare facilities to the user.
[0193] The server continuously collects information on childcare facilities via the internet and stores it in a database. The collected data includes basic facility information, programs offered, and availability. This allows for a rapid response to information requests from terminals.
[0194] When a user inputs information about a childcare facility through their device, the device sends this data to an emotion analysis engine. This analysis uses an emotion engine based on natural language processing technology (e.g., IBM Watson® Tone Analyzer) to extract the user's emotional state in real time from their input.
[0195] Based on the results of the emotion analysis, the server uses the analysis data to construct information optimized for the user. In this process, facility information that is particularly suited to the user's emotional state is selected and sent to the terminal. Prioritization is also adjusted, and recommended facilities and programs are customized as needed.
[0196] Home-use devices present information received from a server in a user-friendly interface. This information presentation utilizes visual and auditory elements to allow users to easily and intuitively access the information. For example, if the device analyzes that the user is experiencing stress, it will highlight programs that provide relaxation.
[0197] For example, if a user enters "Please tell me about childcare facilities with low stress levels," the terminal sends the input to the server, where an analysis engine performs sentiment analysis. Based on this analysis, the system then customizes and provides information on relevant facilities according to the user's criteria.
[0198] Example of a prompt:
[0199] "If a user expresses strong anxiety about childcare facilities, please suggest ways to offer stress-reducing activities."
[0200] "Please develop an algorithm that customizes childcare facility reservation information based on the parents' emotional state."
[0201] This system allows users to obtain personalized information about childcare facilities, enabling them to efficiently make reservations for visits and acquire information.
[0202] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0203] Step 1:
[0204] The user enters information about the childcare facility from their device.
[0205] The entered data includes search criteria, desired facility name, and emotional feedback (e.g., stress level).
[0206] This information is sent to the emotion analysis engine.
[0207] Step 2:
[0208] The device transmits input data to the emotion analysis engine in real time.
[0209] A sentiment analysis engine (e.g., IBM Watson Tone Analyzer) analyzes the input text and extracts the user's emotional state.
[0210] The analysis results in the generation of data indicating the user's emotional state (e.g., stress level, positive / negative emotion score).
[0211] Step 3:
[0212] The server receives the results of the emotion analysis, refers to a database of childcare facilities, and selects facility information that is appropriate for the user's emotional state.
[0213] In this selection process, the priority of facilities is adjusted using the results of sentiment analysis.
[0214] An algorithm is applied that prioritizes information that aligns with the user's emotions, resulting in a list of optimal facility data.
[0215] Step 4:
[0216] The server sends selected childcare facility information to the terminal. The information sent includes basic facility data, suggested programs, and availability.
[0217] This data is organized to reflect the user's emotional state.
[0218] Step 5:
[0219] The terminal displays the information it receives to the user through a home appliance.
[0220] The machine or device presents information optimized for the user through a visual or audio interface.
[0221] Users will be able to use this information to make reservations for tours.
[0222] Additionally, the system may offer extra recommendations tailored to the user's emotional state (e.g., recommendations for stress-relieving facilities).
[0223] In this way, the entire system enables users to receive information about childcare facilities that is tailored to their emotional state.
[0224] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0225] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0226] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.
[0227] [Second Embodiment]
[0228] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.
[0229] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0230] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0231] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.
[0232] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.
[0233] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).
[0234] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.
[0235] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.
[0236] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0237] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0238] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0239] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".
[0240] As an embodiment for carrying out the present invention, we propose a method based on the following system configuration. This system aims to efficiently exchange information between a server, terminals, and users, and to centralize everything from information gathering to reservations and management related to childcare facilities.
[0241] First, the server automatically crawls pre-configured official websites of municipalities and childcare facilities to collect publicly available information about these facilities. The server then uses programs to efficiently extract the necessary information, parsing the data in HTML and JSON formats and storing it in a database. This database is updated at regular intervals to ensure it is always up-to-date.
[0242] Next, users can search for specific information about childcare facilities through an interface provided on their device. If a user wants to obtain detailed information about a facility they are interested in, the system will perform an automated query for that information via the server. This query might, for example, retrieve information about allergy accommodations or special programs.
[0243] The terminal displays sequentially processed responses to the user and updates the information according to the user's interests. If the user wishes to visit, they enter their desired date and time into the terminal, and the server automatically makes a reservation for the visit to the childcare facility. Once the reservation is confirmed, a confirmation notice is sent to the user, and the reservation information is also recorded on the server.
[0244] Furthermore, the server collects and analyzes the latest data on the availability of childcare facilities from municipal databases. Based on this analysis, the terminal visually displays information to the user about which facilities have availability, supporting the management of enrollment schedules.
[0245] As a concrete example, consider a scenario where a user wants to check the latest availability at "Childcare Facility A" and inquire about allergy accommodations. In this case, the user selects the facility from their terminal and enters their inquiry. The server automatically queries "Childcare Facility A," analyzes the response, and displays it on the terminal. Based on the displayed information, the user reserves a date for their visit and immediately receives a confirmation notification.
[0246] In this way, the system according to the present invention streamlines the process of acquiring and managing childcare facility information, enabling user-friendly operation.
[0247] The following describes the processing flow.
[0248] Step 1:
[0249] The server loads a list of URLs for the official websites of municipalities and childcare facilities. It then launches a web scraping program to automatically crawl these sites and collect information.
[0250] Step 2:
[0251] The server analyzes the acquired HTML and JSON data to extract information such as the location of the childcare facility, opening hours, and childcare fees. The analyzed information is then stored in a database.
[0252] Step 3:
[0253] Users search for information about specific childcare facilities through an interface on their device. They select facilities of interest and request further details.
[0254] Step 4:
[0255] The server automatically creates an inquiry format in response to the user's request and sends an information retrieval request to the specific childcare facility via email or API.
[0256] Step 5:
[0257] After the server receives a response from a childcare facility, it analyzes the content, extracts the necessary information, and adds or updates it to the database.
[0258] Step 6:
[0259] The user checks the updated inquiry information on the interface on their device. A notification is sent from the device when the information becomes available.
[0260] Step 7:
[0261] If a user wishes to visit a childcare facility, they select the date and time from the calendar displayed on their device.
[0262] Step 8:
[0263] The server registers the selected date and time in the reservation system and sends a request for a visit reservation to the childcare facility.
[0264] Step 9:
[0265] The server receives the reservation confirmation and sends a confirmation notice to the user via email or their device. The reservation information is also recorded in the database.
[0266] Step 10:
[0267] The server periodically collects and analyzes information on the availability of childcare facilities from municipal websites.
[0268] Step 11:
[0269] The analyzed availability data is visually displayed to the user on their device, assisting them in managing their child's admission schedule. Based on this information, the user can find a suitable facility.
[0270] (Example 1)
[0271] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."
[0272] Managing and utilizing information about modern childcare facilities requires a great deal of manual work and complex procedures, making it difficult for users to efficiently gather facility information and manage reservations. Furthermore, it is necessary to constantly monitor and appropriately present fluctuating availability, but doing so manually is laborious and inefficient. There is a need to solve these problems and provide a system that is highly convenient for users.
[0273] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0274] In this invention, the server includes means for automatically collecting facility information by crawling websites, means for analyzing the collected information and organizing and storing it in a database, and means for analyzing availability using municipal data and presenting it visually. As a result, users can efficiently collect the latest childcare facility information and centrally manage everything from booking facility tours to checking availability without having to do any manual work themselves.
[0275] "Website crawling" refers to the process where a server automatically visits multiple web pages on the internet to collect necessary information.
[0276] "Facility information" refers to all relevant data about the childcare facility, including details such as name, address, contact information, availability, and programs offered.
[0277] "Automatic data collection methods" refer to systems where a server uses a program to collect data without human intervention.
[0278] "Organizing and storing information in a database" is the process of systematically arranging collected information according to a specific structure and saving it in a way that allows for later access.
[0279] "Analyzing and visually presenting" means analyzing collected data, converting it into an easily understandable form, and showing it to the user in a graphical format.
[0280] "Using data from municipalities" means conducting more accurate analysis by utilizing information provided by specific local governments.
[0281] As an embodiment of the present invention, a system is constructed as follows. It is possible to unify the collection, reservation, and management of childcare facility information while collaborating among the server, terminal, and user.
[0282] The server uses a program to automatically collect facility information by traversing websites. For this collection, libraries such as Beautiful Soup and Selenium in the Python language are used. The server analyzes HTML files and JSON-formatted responses and extracts information such as the name, location, contact details, availability, and special program information of childcare facilities. The extracted data is stored in a MySQL database, and the data is managed centrally. This information is updated regularly to always maintain the latest state.
[0283] As a specific example, the server executes tasks scheduled at 9:00 am every day, traverses all target websites, and acquires new information.
[0284] The user can log in through the terminal and search for any childcare facility information. The interface of the terminal is constructed using the latest front-end technologies such as React, providing an intuitive operation feeling. The user can enter the name of the facility in the search bar and make detailed inquiries as needed. When making an inquiry, it is possible to obtain information about the content of special programs and allergy responses, for example, and view the results.
[0285] As a specific example, when the user wants to check the availability of "Childcare Facility A", the user enters "Childcare Facility A" into the terminal and presses the Enter key, and the information is immediately displayed.
[0286] The terminal visually organizes the collected information and presents it to the user. Visual displays such as charts and color-coded infographics are used, taking into consideration the user's ease of understanding. The terminal also plays a role in accepting the schedule for the visit and automatically processing the reservation for the facility tour through the server.
[0287] As an example of the prompt sentence, by entering "Please tell me the latest availability and allergy response information of Nursery Facility A", the system quickly provides specific information.
[0288] With this system, data exchange among the server, terminal, and user is smoothly conducted, and information collection and management regarding nursery facilities are efficiently realized.
[0289] The flow of the specific process in Example 1 will be described using FIG. 11.
[0290] Step 1:
[0291] The server traverses the website to collect nursery facility information. The input is the URL list of the target municipalities and facilities. Using Beautiful Soup and Selenium, the HTML and JSON data of the web page are analyzed, and the necessary information (e.g., facility name, location, availability) is extracted. The extracted information is saved in a structured format in temporary storage.
[0292] Step 2:
[0293] The server analyzes the collected data and saves it in the database. The input is the raw data saved in temporary storage. The data is converted into a specific format (e.g., CSV format), and duplicate checks and data cleansing are performed. The clean data is stored in a MySQL database, and indexes are added so that the information can be efficiently searched.
[0294] Step 3:
[0295] The user searches for and displays childcare facility information using their device. Input consists of the facility name and criteria (e.g., whether or not they accommodate allergies) entered by the user in the device's search bar. The server executes a database query to retrieve the relevant facility information and returns it to the device. Output is the facility information displayed on the device in a format viewable by the user.
[0296] Step 4:
[0297] If the user wishes to confirm further details, they can make additional inquiries through the terminal. The input is a specific information item selected by the user (e.g., the contents of a special program). The server retrieves the relevant information from the database and, if necessary, uses external APIs to obtain the latest information. The output is the detailed information displayed on the terminal.
[0298] Step 5:
[0299] When a user wishes to make a reservation for a tour, they enter their desired date and time on a terminal. The input is a calendar-style interface specifying the desired date and time. The terminal sends a reservation request to the server, which then confirms the reservation in cooperation with the facility management system. The output is a reservation confirmation notice sent to the user.
[0300] Step 6:
[0301] The terminal visually displays availability. The input is the latest availability data retrieved from the server. The data is converted into a color-coded chart using a graphics library, presenting the facility's congestion status to the user at a glance. The output is a visually represented availability information.
[0302] (Application Example 1)
[0303] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."
[0304] Conventionally, information collection and reservation management in childcare facilities have been complex and time-consuming tasks. In particular, it has been difficult for parents and guardians to efficiently obtain the necessary information and appropriately reserve a visit. In addition, the support for information provision and scheduling in childcare facilities using voice recognition technology and automated devices has not been sufficient, and convenient use at home has been demanded.
[0305] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0306] In this invention, the server includes means for automatically collecting information on childcare facilities, means for receiving and responding to a user's voice instruction using a voice recognition function, and means for analyzing natural language using a generated AI model and assisting in the selection of an optimal childcare facility. As a result, the user can obtain the latest information on childcare facilities through simple operations by voice instruction and can quickly make a reservation for a visit.
[0307] A "childcare facility" is a facility that provides temporary or continuous childcare services for infants and preschoolers.
[0308] The "means for automatically collecting" is a method for obtaining information related to childcare facilities from a designated website or database by a program without requiring manual operation.
[0309] The "means for inquiring" is a system for automatically asking a childcare facility for necessary information based on conditions specified by the user.
[0310] The "means for reserving a visit" is a method for automatically registering and adjusting the scheduled visit to a childcare facility designated by the user.
[0311] The "means for analyzing and managing the availability status" is a system for considering the number of people that a childcare facility can accept and the availability status and providing appropriate information to the user.
[0312] "Voice recognition functionality" is a technology that converts a user's voice commands into digital data, understands it appropriately, and processes it.
[0313] A "home automation device" is a device installed in the home that provides information through voice and displays and works in conjunction with home appliances to enhance user convenience.
[0314] A "generative AI model" is an artificial intelligence technology that automatically learns from vast amounts of data and understands and analyzes natural language.
[0315] "Means of analyzing natural language" refers to software technologies that analyze user utterances and text, understand their intent, and apply that understanding.
[0316] To implement this invention, a home automation device and a server with internet connectivity are required. The server automatically collects information on a designated childcare facility and stores it in an SQLite database. The Python BeautifulSoup library is used for web scraping, and Celery is used for scheduling information updates.
[0317] The user gives voice commands through an automated device in their home. This device uses the Google Cloud Speech-to-Text API to convert the speech into text data, and then uses a generative AI model (TensorFlow library) for natural language processing to understand the user's requests.
[0318] Based on the information received from the user, the server automatically makes reservations for visits to designated childcare facilities and requests detailed information. The reservation system uses the Google Calendar API to automatically adjust schedules.
[0319] This system provides real-time information on the availability of childcare facilities based on user voice commands and suggests the optimal visit date and time. The information is displayed via voice, and in some cases, as visual information on the display of a home automation device.
[0320] For example, if a user says, "Please book a visit to childcare facility A next Monday," the server retrieves the latest information from the internet and automatically completes the visit reservation. It then immediately reports the result by voice and, in some cases, displays a confirmation message on the screen. An example of a prompt to the generating AI model is, "Please tell me the latest availability at the childcare facility. I would like to check on allergy policies and book a visit." This system simplifies cumbersome procedures.
[0321] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0322] Step 1:
[0323] The server periodically accesses pre-specified websites related to childcare facilities to collect information. The input is the URL of the webpage. Using the Python BeautifulSoup library, the HTML data is parsed to extract information such as the availability of childcare facilities and other facility details. The extracted data is stored in an SQLite database. The output is a database containing the latest childcare facility information.
[0324] Step 2:
[0325] The user gives voice commands to a home automation device. This input is voice data. The device uses the Google Cloud Speech-to-Text API to convert this voice data into text data. The output is text data corresponding to the voice commands. This text data is then subjected to natural language processing via a generative AI model.
[0326] Step 3:
[0327] The server receives text instructions from the user and determines which childcare facilities to contact. The input is the text data provided by the user. Based on the parsed text data, the server determines the content of the inquiry and contacts the necessary childcare facilities. The output is detailed information about the childcare facilities. The information is based on the user's preferences.
[0328] Step 4:
[0329] The server analyzes the reservation status of childcare facilities and identifies available dates and times for visits. The input is reservation information obtained from the childcare facilities. Using the Google Calendar API, the visit reservation is automatically registered in the user's calendar. The output is a reservation completion notification. This notification is sent to the user's home automation device.
[0330] Step 5:
[0331] The home automation device notifies the user via voice and visual display that a reservation has been completed. The input is a reservation completion notification from the server. The device displays a confirmation message on its screen and provides an audio notification. The output is the final notification to the user.
[0332] Throughout this entire process, the server, users, and home automation devices work together to enable smooth information provision and reservations for childcare facilities.
[0333] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0334] As an embodiment of the present invention, we propose a system that optimizes the provision of childcare facility information based on the user's emotional state. This system integrates a server, a terminal, and an emotion engine that analyzes the user's emotional state, thereby improving the user experience in addition to collecting, inquiring about, making reservations for, and managing availability of childcare facilities.
[0335] First, the user searches for information about childcare facilities via their device and, if necessary, enters specific questions into the system. This information is then sent to the sentiment engine, which extracts and analyzes emotions from the user's text. This sentiment analysis is performed in real time using natural language processing (NLP).
[0336] Next, the server adjusts the information on childcare facilities and changes the priority of suggesting specific facilities based on the analyzed emotional data. This adjustment allows, for example, to provide an intuitively understandable interface if the user is feeling stressed, or to suggest new childcare facility options if a positive emotional state is indicated.
[0337] The terminal presents users with customized information and also provides support when users make tour reservations. In this process, the emotion engine can suggest tour dates, times, and facilities that are deemed high priority based on the user's emotional state. Furthermore, availability analysis information is presented in a way that adapts to the emotional state, allowing users to receive more personalized information.
[0338] For example, if a user searches for information on "Childcare Facility B" and the device indicates that they are experiencing stress, the emotion engine will highlight information about stress reduction programs offered by Childcare Facility B (e.g., activities for relaxation). Furthermore, to simplify the booking process, the device will automatically suggest the nearest available date and time.
[0339] Thus, by integrating an emotion engine, the system of the present invention provides information adapted to the user's emotional state, making the process of finding childcare facilities more personalized and efficient.
[0340] The following describes the processing flow.
[0341] Step 1:
[0342] Users log in to the interface using their device to search for information on childcare facilities. They enter search criteria and specific questions and request information collection.
[0343] Step 2:
[0344] The device receives user input data and sends it to the emotion engine. The emotion engine uses natural language processing techniques to analyze the user's text data and identify their emotional state.
[0345] Step 3:
[0346] The server extracts relevant information from the childcare facility database based on the user's emotional state. If the emotion is stress, it prioritizes extracting information about the facility's stress reduction programs.
[0347] Step 4:
[0348] The server adjusts the style of information provided to the user based on their emotional state. For example, if the user is relaxed, it will increase the frequency of presenting new childcare options.
[0349] Step 5:
[0350] The terminal presents the user with adjusted information. The user can view information about childcare facilities and, if necessary, decide to schedule a visit.
[0351] Step 6:
[0352] When a user wishes to schedule a tour, the device automatically suggests a suitable date and time based on their emotional state. The user then reviews the suggested date and time and enters their preferred tour date and time.
[0353] Step 7:
[0354] The server registers the user's request for a visit in the reservation system and coordinates with the childcare facility. Once the reservation is confirmed, a reservation confirmation message is sent to the user via their device.
[0355] Step 8:
[0356] The server periodically updates the availability status of childcare facilities using web data from municipalities. It then delivers the results of analysis using an emotion engine to the user's device, providing them with high-priority availability information.
[0357] In this way, the system, which incorporates an emotion engine, provides personalized services based on the user's emotional state, making the process of finding childcare facilities smoother.
[0358] (Example 2)
[0359] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".
[0360] In the collection, booking, and management of information regarding childcare facilities, there is a lack of personalized information provision that takes into account the emotional state of users. Traditional systems only provide uniform information, which is problematic because it fails to alleviate the emotional burden and anxiety experienced by users.
[0361] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0362] In this invention, the server includes means for automatically aggregating information on childcare facilities, means for analyzing the emotional state of users and dynamically adjusting the information based on the analysis results, and means for presenting the adjusted information to users and supporting them in making reservations for visits. This enables personalized information provision and reservation support tailored to the emotional state of users.
[0363] "Childcare facilities" is a general term for facilities that provide educational and childcare services to children.
[0364] "Means for automatically aggregating information" refers to a function that automatically collects data related to childcare facilities and consolidates it in one place.
[0365] "Means of inquiry" refers to a function that automatically generates questions based on aggregated information in response to user requests and retrieves the necessary information.
[0366] "Method for booking a visit" refers to a support function that allows users to book a visit to a childcare facility on a date specified by the user.
[0367] "Means for analyzing and managing availability" refers to a function that analyzes the availability status of childcare facilities and manages it as information.
[0368] "Means for analyzing emotional states" refers to technologies that extract and analyze emotions from user input information.
[0369] "Means of dynamically adjusting information" refers to a function that changes the content and order of the information provided based on analyzed sentiment data.
[0370] "Means of presenting adjusted information and supporting tour reservations" refers to a function that presents adjusted information to users and supports the smooth progress of tour reservations.
[0371] This invention utilizes a system integrating a server, terminal, text analysis, and emotion engine to provide childcare facility information adapted to the user's emotional state. When a user searches for information related to childcare facilities through the terminal, the text data is sent to the emotion engine. The emotion engine uses natural language processing (NLP) technology to analyze the user's emotions in real time. Based on this analysis, the server dynamically adjusts the priority of the childcare facility information provided. This makes it possible to provide information tailored to the user's emotions.
[0372] The server adjusts and delivers information to the terminal, suggesting the optimal date, time, and facility for the visit. This allows users to have a less stressful experience and quickly book a visit. For example, if the analysis indicates that a user is experiencing stress while searching for information about childcare facility B, the terminal will automatically suggest stress reduction programs offered by childcare facility B and the most easily available visit time.
[0373] While sentiment analysis using generative AI models forms the core of this system, the system is designed to maintain sophisticated security protocols and ensure the privacy of user data. An example of a prompt would be: "A user is searching for information about childcare facilities and has given input indicating stress. Explain how the sentiment engine should handle the user's input and what information should be prioritized."
[0374] This system enables personalized information delivery based on emotional states, allowing users to search for childcare facilities more efficiently and comfortably.
[0375] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0376] Step 1:
[0377] A user uses a terminal to search for information about childcare facilities. The user enters the name and location of the childcare facility as keywords into the terminal. Based on this input data (e.g., text), the search is initiated. The entered keywords are sent to a database for subsequent processing.
[0378] Step 2:
[0379] The terminal receives user input data and sends it to the emotion engine. The terminal accurately captures the input and creates a data packet to transfer to the server. This packet contains the information entered by the user. After transmission, the data awaits emotion analysis on the server.
[0380] Step 3:
[0381] The server passes the received user input data to the emotion engine for analysis. The emotion engine uses a generative AI model to extract emotions from the text. This data processing process executes an emotion analysis algorithm and outputs the user's emotional state (e.g., stress, relief, etc.). This allows for information adjustment in the next step.
[0382] Step 4:
[0383] The server dynamically adjusts childcare facility information using the emotion data output by the emotion engine. Based on the emotion data, it changes the priority of facilities and organizes related information. This data calculation sorts the information in the most appropriate way. The adjusted information is then ready to be presented to the user in the most optimal format.
[0384] Step 5:
[0385] The terminal receives information processed from the server and presents it to the user. The terminal displays facility information along with recommendations based on sentiment analysis results. This output includes suggested visit dates and times, as well as facility details. The terminal also features a user interface designed to simplify the visit reservation process.
[0386] Step 6:
[0387] Based on the information provided by the user, the system sets up a reservation for a visit to a childcare facility. The user makes selections and makes the reservation based on the optimized information. The user's selections are sent back to the server, and the entire system enters the process of completing the reservation.
[0388] Through this process, the system provides users with a personalized experience that adapts to their emotional state.
[0389] (Application Example 2)
[0390] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."
[0391] In today's world, many parents experience emotional burdens when choosing childcare facilities. Therefore, there is a need to provide information that is tailored to the emotional state of parents. Furthermore, there is a need for smoother access to facility information, availability checks, and scheduling visits. The challenge lies in reducing the psychological burden on parents and supporting efficient childcare facility selection.
[0392] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.
[0393] In this invention, the server includes means for automatically collecting information on childcare facilities, means for automatically querying information specified by the user, means for booking visits, means for analyzing the user's emotional state to optimize information provision, and means for presenting information via a home-use device. This makes it possible to efficiently and individually provide appropriate childcare facility information according to the user's emotional state.
[0394] A "childcare facility" is a facility that takes care of infants and children for a set period of time and supports their growth through education, play, and other activities.
[0395] "Means for automatically collecting information" refers to a process of setting specific conditions or filters and automatically collecting data accordingly.
[0396] "A means of automatically querying information specified by the user" refers to a mechanism that automatically queries an external system or database for relevant data based on the conditions entered by the user.
[0397] "Means for booking a tour" refers to the function of making a reservation to visit a specific facility or on a designated date and time.
[0398] "Methods for analyzing users' emotional states and optimizing information provision" refers to the process of analyzing users' emotions and customizing the information provided based on the results.
[0399] "Means of presenting information via household machinery and devices" refers to a function that provides users with necessary information visually or audibly through devices used within the home.
[0400] One embodiment of this invention involves using a home-use device connected to a terminal owned by a user within their home. The terminal has a dedicated application installed for automatically collecting and providing data related to childcare facilities to the user.
[0401] The server continuously collects information on childcare facilities via the internet and stores it in a database. The collected data includes basic facility information, programs offered, and availability. This allows for a rapid response to information requests from terminals.
[0402] When a user inputs information about a childcare facility through their device, the device sends this data to an emotion analysis engine. This analysis uses an emotion engine based on natural language processing technology (e.g., IBM Watson Tone Analyzer) to extract the user's emotional state in real time from their input.
[0403] Based on the results of the emotion analysis, the server uses the analysis data to construct information optimized for the user. In this process, facility information that is particularly suited to the user's emotional state is selected and sent to the terminal. Prioritization is also adjusted, and recommended facilities and programs are customized as needed.
[0404] Home-use devices present information received from a server in a user-friendly interface. This information presentation utilizes visual and auditory elements to allow users to easily and intuitively access the information. For example, if the device analyzes that the user is experiencing stress, it will highlight programs that provide relaxation.
[0405] For example, if a user enters "Please tell me about childcare facilities with low stress levels," the terminal sends the input to the server, where an analysis engine performs sentiment analysis. Based on this analysis, the system then customizes and provides information on relevant facilities according to the user's criteria.
[0406] Example of a prompt:
[0407] "If a user expresses strong anxiety about childcare facilities, please suggest ways to offer stress-reducing activities."
[0408] "Please develop an algorithm that customizes childcare facility reservation information based on the parents' emotional state."
[0409] This system allows users to obtain personalized information about childcare facilities, enabling them to efficiently make reservations for visits and acquire information.
[0410] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0411] Step 1:
[0412] The user enters information about the childcare facility from their device.
[0413] The entered data includes search criteria, desired facility name, and emotional feedback (e.g., stress level).
[0414] This information is sent to the emotion analysis engine.
[0415] Step 2:
[0416] The device transmits input data to the emotion analysis engine in real time.
[0417] A sentiment analysis engine (e.g., IBM Watson Tone Analyzer) analyzes the input text and extracts the user's emotional state.
[0418] The analysis results in the generation of data indicating the user's emotional state (e.g., stress level, positive / negative emotion score).
[0419] Step 3:
[0420] The server receives the results of the emotion analysis, refers to a database of childcare facilities, and selects facility information that is appropriate for the user's emotional state.
[0421] In this selection process, the priority of facilities is adjusted using the results of sentiment analysis.
[0422] An algorithm is applied that prioritizes information that aligns with the user's emotions, resulting in a list of optimal facility data.
[0423] Step 4:
[0424] The server sends selected childcare facility information to the terminal. The information sent includes basic facility data, suggested programs, and availability.
[0425] This data is organized to reflect the user's emotional state.
[0426] Step 5:
[0427] The terminal displays the information it receives to the user through a home appliance.
[0428] The machine or device presents information optimized for the user through a visual or audio interface.
[0429] Users will be able to use this information to make reservations for tours.
[0430] Additionally, the system may offer extra recommendations tailored to the user's emotional state (e.g., recommendations for stress-relieving facilities).
[0431] In this way, the entire system enables users to receive information about childcare facilities that is tailored to their emotional state.
[0432] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.
[0433] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0434] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.
[0435] [Third Embodiment]
[0436] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.
[0437] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.
[0438] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0439] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.
[0440] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.
[0441] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).
[0442] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.
[0443] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.
[0444] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0445] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0446] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0447] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".
[0448] As an embodiment for carrying out the present invention, we propose a method based on the following system configuration. This system aims to efficiently exchange information between a server, terminals, and users, and to centralize everything from information gathering to reservations and management related to childcare facilities.
[0449] First, the server automatically crawls pre-configured official websites of municipalities and childcare facilities to collect publicly available information about these facilities. The server then uses programs to efficiently extract the necessary information, parsing the data in HTML and JSON formats and storing it in a database. This database is updated at regular intervals to ensure it is always up-to-date.
[0450] Next, users can search for specific information about childcare facilities through an interface provided on their device. If a user wants to obtain detailed information about a facility they are interested in, the system will perform an automated query for that information via the server. This query might, for example, retrieve information about allergy accommodations or special programs.
[0451] The terminal displays sequentially processed responses to the user and updates the information according to the user's interests. If the user wishes to visit, they enter their desired date and time into the terminal, and the server automatically makes a reservation for the visit to the childcare facility. Once the reservation is confirmed, a confirmation notice is sent to the user, and the reservation information is also recorded on the server.
[0452] Furthermore, the server collects and analyzes the latest data on the availability of childcare facilities from municipal databases. Based on this analysis, the terminal visually displays information to the user about which facilities have availability, supporting the management of enrollment schedules.
[0453] As a concrete example, consider a scenario where a user wants to check the latest availability at "Childcare Facility A" and inquire about allergy accommodations. In this case, the user selects the facility from their terminal and enters their inquiry. The server automatically queries "Childcare Facility A," analyzes the response, and displays it on the terminal. Based on the displayed information, the user reserves a date for their visit and immediately receives a confirmation notification.
[0454] In this way, the system according to the present invention streamlines the process of acquiring and managing childcare facility information, enabling user-friendly operation.
[0455] The following describes the processing flow.
[0456] Step 1:
[0457] The server loads a list of URLs for the official websites of municipalities and childcare facilities. It then launches a web scraping program to automatically crawl these sites and collect information.
[0458] Step 2:
[0459] The server analyzes the acquired HTML and JSON data to extract information such as the location of the childcare facility, opening hours, and childcare fees. The analyzed information is then stored in a database.
[0460] Step 3:
[0461] Users search for information about specific childcare facilities through an interface on their device. They select facilities of interest and request further details.
[0462] Step 4:
[0463] The server automatically creates an inquiry format in response to the user's request and sends an information retrieval request to the specific childcare facility via email or API.
[0464] Step 5:
[0465] After the server receives a response from a childcare facility, it analyzes the content, extracts the necessary information, and adds or updates it to the database.
[0466] Step 6:
[0467] The user checks the updated inquiry information on the interface on their device. A notification is sent from the device when the information becomes available.
[0468] Step 7:
[0469] If a user wishes to visit a childcare facility, they select the date and time from the calendar displayed on their device.
[0470] Step 8:
[0471] The server registers the selected date and time in the reservation system and sends a request for a visit reservation to the childcare facility.
[0472] Step 9:
[0473] The server receives the reservation confirmation and sends a confirmation notice to the user via email or their device. The reservation information is also recorded in the database.
[0474] Step 10:
[0475] The server periodically collects and analyzes information on the availability of childcare facilities from municipal websites.
[0476] Step 11:
[0477] The analyzed availability data is visually displayed to the user on their device, assisting them in managing their child's admission schedule. Based on this information, the user can find a suitable facility.
[0478] (Example 1)
[0479] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0480] Managing and utilizing information about modern childcare facilities requires a great deal of manual work and complex procedures, making it difficult for users to efficiently gather facility information and manage reservations. Furthermore, it is necessary to constantly monitor and appropriately present fluctuating availability, but doing so manually is laborious and inefficient. There is a need to solve these problems and provide a system that is highly convenient for users.
[0481] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0482] In this invention, the server includes means for automatically collecting facility information by crawling websites, means for analyzing the collected information and organizing and storing it in a database, and means for analyzing availability using municipal data and presenting it visually. As a result, users can efficiently collect the latest childcare facility information and centrally manage everything from booking facility tours to checking availability without having to do any manual work themselves.
[0483] "Website crawling" refers to the process where a server automatically visits multiple web pages on the internet to collect necessary information.
[0484] "Facility information" refers to all relevant data about the childcare facility, including details such as name, address, contact information, availability, and programs offered.
[0485] "Automatic data collection methods" refer to systems where a server uses a program to collect data without human intervention.
[0486] "Organizing and storing information in a database" is the process of systematically arranging collected information according to a specific structure and saving it in a way that allows for later access.
[0487] "Analyzing and visually presenting" means analyzing collected data, converting it into an easily understandable form, and showing it to the user in a graphical format.
[0488] "Using data from municipalities" means using information provided by specific local governments to perform more accurate analysis.
[0489] As an embodiment of the present invention, the following system is constructed. It is possible to centralize the collection, reservation, and management of childcare facility information while coordinating between the server, terminal, and user.
[0490] The server uses a program to automatically crawl websites and collect facility information. This collection utilizes libraries such as Beautiful Soup and Selenium in the Python language. The server parses HTML files and JSON responses to extract information such as the name, address, contact information, availability, and special program details of childcare facilities. The extracted data is stored in a MySQL database, where it is centrally managed. This information is regularly updated to ensure it is always up-to-date.
[0491] As a concrete example, the server executes a scheduled task at 9:00 AM every day, crawling all target websites to retrieve new information.
[0492] Users can log in via their device and search for information on any childcare facility. The device interface is built with the latest front-end technologies such as React, providing an intuitive user experience. Users can enter the facility name in the search bar and make detailed inquiries as needed. When making an inquiry, it is possible to obtain information such as the content of special programs or allergy accommodations, and to review the results.
[0493] For example, if a user wants to check the availability of "Childcare Facility A," they can simply type "Childcare Facility A" into the terminal and press the Enter key, and the information will be displayed instantly.
[0494] The terminal visually organizes the collected information and presents it to the user. The visual display utilizes charts and color-coded infographics to ensure user comprehension. The terminal also receives requests for tour dates and automatically processes facility tour reservations through the server.
[0495] As an example of a prompt message, entering "Please tell me the latest availability and allergy information for childcare facility A" will allow the system to quickly provide specific information.
[0496] This system facilitates smooth data exchange between servers, terminals, and users, enabling efficient collection and management of information related to childcare facilities.
[0497] The flow of the specific processing in Example 1 will be explained using Figure 11.
[0498] Step 1:
[0499] The server crawls websites to collect information on childcare facilities. The input is a list of URLs for target municipalities and facilities. Beautiful Soup and Selenium are used to parse the HTML and JSON data of the web pages and extract the necessary information (e.g., facility name, location, availability). The extracted information is stored in a structured format in temporary storage.
[0500] Step 2:
[0501] The server analyzes the collected data and stores it in a database. The input is raw data stored in temporary storage. The data is converted to a specific format (e.g., CSV format), and duplicate checking and data cleansing are performed. The clean data is stored in a MySQL database, and indexes are added to allow for efficient searching of the information.
[0502] Step 3:
[0503] The user searches for and displays childcare facility information using their device. Input consists of the facility name and criteria (e.g., whether or not they accommodate allergies) entered by the user in the device's search bar. The server executes a database query to retrieve the relevant facility information and returns it to the device. Output is the facility information displayed on the device in a format viewable by the user.
[0504] Step 4:
[0505] If the user wishes to confirm further details, they can make additional inquiries through the terminal. The input is a specific information item selected by the user (e.g., the contents of a special program). The server retrieves the relevant information from the database and, if necessary, uses external APIs to obtain the latest information. The output is the detailed information displayed on the terminal.
[0506] Step 5:
[0507] When a user wishes to make a reservation for a tour, they enter their desired date and time on a terminal. The input is a calendar-style interface specifying the desired date and time. The terminal sends a reservation request to the server, which then confirms the reservation in cooperation with the facility management system. The output is a reservation confirmation notice sent to the user.
[0508] Step 6:
[0509] The terminal visually displays availability. The input is the latest availability data retrieved from the server. The data is converted into a color-coded chart using a graphics library, presenting the facility's congestion status to the user at a glance. The output is a visually represented availability information.
[0510] (Application Example 1)
[0511] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0512] Traditionally, gathering information and managing reservations for childcare facilities has been a complex and time-consuming task, making it particularly difficult for parents and guardians to efficiently obtain necessary information and appropriately book visits. Furthermore, there has been insufficient support for providing information and scheduling childcare facilities using voice recognition technology and automated devices, highlighting the need for easy-to-use services at home.
[0513] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0514] In this invention, the server includes means for automatically collecting information on childcare facilities, means for receiving and responding to user voice instructions using a voice recognition function, and means for analyzing natural language using a generative AI model to assist in selecting the optimal childcare facility. As a result, users can obtain the latest information on childcare facilities and quickly make reservations for visits through simple operation using voice instructions.
[0515] A "childcare facility" is a facility that provides temporary or continuous childcare services to infants and preschool children.
[0516] "Methods of automatic collection" refer to methods of obtaining information related to childcare facilities from designated websites or databases using a program without requiring manual operation.
[0517] The "inquiry method" is a system that automatically requests necessary information from childcare facilities based on conditions specified by the user.
[0518] "Method for booking a visit" refers to a method for automatically registering and coordinating visits to childcare facilities specified by the user.
[0519] "Means for analyzing and managing availability" refers to a system for examining the number of children a childcare facility can accommodate and its availability, and for providing appropriate information to users.
[0520] "Voice recognition functionality" is a technology that converts a user's voice commands into digital data, understands it appropriately, and processes it.
[0521] A "home automation device" is a device installed in the home that provides information through voice and displays and works in conjunction with home appliances to enhance user convenience.
[0522] A "generative AI model" is an artificial intelligence technology that automatically learns from vast amounts of data and understands and analyzes natural language.
[0523] "Means of analyzing natural language" refers to software technologies that analyze user utterances and text, understand their intent, and apply that understanding.
[0524] To implement this invention, a home automation device and a server with internet connectivity are required. The server automatically collects information on a designated childcare facility and stores it in an SQLite database. The Python BeautifulSoup library is used for web scraping, and Celery is used for scheduling information updates.
[0525] The user gives voice commands through an automated device in their home. This device uses the Google Cloud Speech-to-Text API to convert the speech into text data, and then uses a generative AI model (TensorFlow library) for natural language processing to understand the user's requests.
[0526] Based on the information received from the user, the server automatically makes reservations for visits to designated childcare facilities and requests detailed information. The reservation system uses the Google Calendar API to automatically adjust schedules.
[0527] This system provides real-time information on the availability of childcare facilities based on user voice commands and suggests the optimal visit date and time. The information is displayed via voice, and in some cases, as visual information on the display of a home automation device.
[0528] For example, if a user says, "Please book a visit to childcare facility A next Monday," the server retrieves the latest information from the internet and automatically completes the visit reservation. It then immediately reports the result by voice and, in some cases, displays a confirmation message on the screen. An example of a prompt to the generating AI model is, "Please tell me the latest availability at the childcare facility. I would like to check on allergy policies and book a visit." This system simplifies cumbersome procedures.
[0529] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0530] Step 1:
[0531] The server periodically accesses pre-specified websites related to childcare facilities to collect information. The input is the URL of the webpage. Using the Python BeautifulSoup library, the HTML data is parsed to extract information such as the availability of childcare facilities and other facility details. The extracted data is stored in an SQLite database. The output is a database containing the latest childcare facility information.
[0532] Step 2:
[0533] The user gives voice commands to a home automation device. This input is voice data. The device uses the Google Cloud Speech-to-Text API to convert this voice data into text data. The output is text data corresponding to the voice commands. This text data is then subjected to natural language processing via a generative AI model.
[0534] Step 3:
[0535] The server receives text instructions from the user and determines which childcare facilities to contact. The input is the text data provided by the user. Based on the parsed text data, the server determines the content of the inquiry and contacts the necessary childcare facilities. The output is detailed information about the childcare facilities. The information is based on the user's preferences.
[0536] Step 4:
[0537] The server analyzes the reservation status of childcare facilities and identifies available dates and times for visits. The input is reservation information obtained from the childcare facilities. Using the Google Calendar API, the visit reservation is automatically registered in the user's calendar. The output is a reservation completion notification. This notification is sent to the user's home automation device.
[0538] Step 5:
[0539] The home automation device notifies the user via voice and visual display that a reservation has been completed. The input is a reservation completion notification from the server. The device displays a confirmation message on its screen and provides an audio notification. The output is the final notification to the user.
[0540] Throughout this entire process, the server, user, and home automation device work together to enable smooth information provision and booking of childcare facilities.
[0541] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0542] As an embodiment of the present invention, we propose a system that optimizes the provision of childcare facility information based on the user's emotional state. This system integrates a server, a terminal, and an emotion engine that analyzes the user's emotional state, thereby improving the user experience in addition to collecting, inquiring about, making reservations for, and managing availability of childcare facilities.
[0543] First, the user searches for information about childcare facilities via their device and, if necessary, enters specific questions into the system. This information is then sent to the sentiment engine, which extracts and analyzes emotions from the user's text. This sentiment analysis is performed in real time using natural language processing (NLP).
[0544] Next, the server adjusts the information on childcare facilities and changes the priority of suggesting specific facilities based on the analyzed emotional data. This adjustment allows, for example, to provide an intuitively understandable interface if the user is feeling stressed, or to suggest new childcare facility options if a positive emotional state is indicated.
[0545] The terminal presents users with customized information and also provides support when users make tour reservations. In this process, the emotion engine can suggest tour dates, times, and facilities that are deemed high priority based on the user's emotional state. Furthermore, availability analysis information is presented in a way that adapts to the emotional state, allowing users to receive more personalized information.
[0546] For example, if a user searches for information on "Childcare Facility B" and the device indicates that they are experiencing stress, the emotion engine will highlight information about stress reduction programs offered by Childcare Facility B (e.g., activities for relaxation). Furthermore, to simplify the booking process, the device will automatically suggest the nearest available date and time.
[0547] Thus, by integrating an emotion engine, the system of the present invention provides information adapted to the user's emotional state, making the process of finding childcare facilities more personalized and efficient.
[0548] The following describes the processing flow.
[0549] Step 1:
[0550] Users log in to the interface using their device to search for information on childcare facilities. They enter search criteria and specific questions and request information collection.
[0551] Step 2:
[0552] The device receives user input data and sends it to the emotion engine. The emotion engine uses natural language processing techniques to analyze the user's text data and identify their emotional state.
[0553] Step 3:
[0554] The server extracts relevant information from the childcare facility database based on the user's emotional state. If the emotion is stress, it prioritizes extracting information about the facility's stress reduction programs.
[0555] Step 4:
[0556] The server adjusts the style of information provided to the user based on their emotional state. For example, if the user is relaxed, it will increase the frequency of presenting new childcare options.
[0557] Step 5:
[0558] The terminal presents the user with adjusted information. The user can view information about childcare facilities and, if necessary, decide to schedule a visit.
[0559] Step 6:
[0560] When a user wishes to schedule a tour, the device automatically suggests a suitable date and time based on their emotional state. The user then confirms the suggested date and time and enters their preferred tour date and time.
[0561] Step 7:
[0562] The server registers the user's request for a visit in the reservation system and coordinates with the childcare facility. Once the reservation is confirmed, a reservation confirmation message is sent to the user via their device.
[0563] Step 8:
[0564] The server periodically updates the availability status of childcare facilities using web data from municipalities. It then delivers the results of analysis using an emotion engine to the user's device, providing them with high-priority availability information.
[0565] In this way, the system, which incorporates an emotion engine, provides personalized services based on the user's emotional state, making the process of finding childcare facilities smoother.
[0566] (Example 2)
[0567] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0568] In the collection, booking, and management of information regarding childcare facilities, there is a lack of personalized information provision that takes into account the emotional state of users. Traditional systems only provide uniform information, which is problematic because it fails to alleviate the emotional burden and anxiety experienced by users.
[0569] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0570] In this invention, the server includes means for automatically aggregating information on childcare facilities, means for analyzing the emotional state of users and dynamically adjusting the information based on the analysis results, and means for presenting the adjusted information to users and supporting them in making reservations for visits. This makes it possible to provide personalized information and reservation support tailored to the emotional state of users.
[0571] "Childcare facilities" is a general term for facilities that provide educational and childcare services to children.
[0572] "Means for automatically aggregating information" refers to a function that automatically collects data related to childcare facilities and consolidates it in one place.
[0573] "Means of inquiry" refers to a function that automatically generates questions based on aggregated information in response to user requests and retrieves the necessary information.
[0574] "Method for booking a visit" refers to a support function that allows users to book a visit to a childcare facility on a date specified by the user.
[0575] "Means for analyzing and managing availability" refers to a function that analyzes the availability status of childcare facilities and manages it as information.
[0576] "Means for analyzing emotional states" refers to technologies that extract and analyze emotions from user input information.
[0577] "Means of dynamically adjusting information" refers to a function that changes the content and order of the information provided based on analyzed sentiment data.
[0578] "Means of presenting adjusted information and supporting tour reservations" refers to a function that presents adjusted information to users and supports them in smoothly proceeding with tour reservations.
[0579] This invention utilizes a system integrating a server, terminal, text analysis, and emotion engine to provide childcare facility information adapted to the user's emotional state. When a user searches for information related to childcare facilities through the terminal, the text data is sent to the emotion engine. The emotion engine uses natural language processing (NLP) technology to analyze the user's emotions in real time. Based on this analysis, the server dynamically adjusts the priority of the childcare facility information provided. This makes it possible to provide information tailored to the user's emotions.
[0580] The server adjusts and delivers information to the terminal, suggesting the optimal date, time, and facility for the visit. This allows users to have a less stressful experience and quickly book a visit. For example, if the analysis indicates that a user is experiencing stress while searching for information about childcare facility B, the terminal will automatically suggest stress reduction programs offered by childcare facility B and the most easily available visit time.
[0581] While sentiment analysis using generative AI models forms the core of this system, the system is designed to maintain sophisticated security protocols and ensure the privacy of user data. An example of a prompt would be: "A user is searching for information about childcare facilities and has given input indicating stress. Explain how the sentiment engine should handle the user's input and what information should be prioritized."
[0582] This system enables personalized information delivery based on emotional states, allowing users to search for childcare facilities more efficiently and comfortably.
[0583] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0584] Step 1:
[0585] A user uses a terminal to search for information about childcare facilities. The user enters the name and location of the childcare facility as keywords into the terminal. Based on this input data (e.g., text), the search is initiated. The entered keywords are sent to a database for subsequent processing.
[0586] Step 2:
[0587] The terminal receives user input data and sends it to the emotion engine. The terminal accurately captures the input and creates a data packet to transfer to the server. This packet contains the information entered by the user. After transmission, the data awaits emotion analysis on the server.
[0588] Step 3:
[0589] The server passes the received user input data to the emotion engine for analysis. The emotion engine uses a generative AI model to extract emotions from the text. This data processing process executes an emotion analysis algorithm and outputs the user's emotional state (e.g., stress, relief, etc.). This allows for information adjustment in the next step.
[0590] Step 4:
[0591] The server dynamically adjusts childcare facility information using the emotion data output by the emotion engine. Based on the emotion data, it changes the priority of facilities and organizes related information. This data calculation sorts the information in the most appropriate way. The adjusted information is then ready to be presented to the user in the most optimal format.
[0592] Step 5:
[0593] The terminal receives information processed from the server and presents it to the user. The terminal displays facility information along with recommendations based on sentiment analysis results. This output includes suggested visit dates and times, as well as facility details. The terminal also features a user interface designed to simplify the visit reservation process.
[0594] Step 6:
[0595] Based on the information provided by the user, the system sets up a reservation for a visit to a childcare facility. The user makes selections and makes the reservation based on the optimized information. The user's selections are sent back to the server, and the entire system enters the process of completing the reservation.
[0596] Through this process, the system provides users with a personalized experience that adapts to their emotional state.
[0597] (Application Example 2)
[0598] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0599] In today's world, many parents experience emotional burdens when choosing childcare facilities. Therefore, there is a need to provide information that is tailored to the emotional state of parents. Furthermore, there is a need for smoother access to facility information, availability checks, and scheduling visits. The challenge lies in reducing the psychological burden on parents and supporting efficient childcare facility selection.
[0600] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.
[0601] In this invention, the server includes means for automatically collecting information on childcare facilities, means for automatically querying information specified by the user, means for booking visits, means for analyzing the user's emotional state to optimize information provision, and means for presenting information via a home-use device. This makes it possible to efficiently and individually provide appropriate childcare facility information according to the user's emotional state.
[0602] A "childcare facility" is a facility that takes care of infants and children for a set period of time and supports their growth through education, play, and other activities.
[0603] "Means for automatically collecting information" refers to a process of setting specific conditions or filters and automatically collecting data accordingly.
[0604] "A means of automatically querying information specified by the user" refers to a mechanism that automatically queries an external system or database for relevant data based on the conditions entered by the user.
[0605] "Means for booking a tour" refers to the function of making a reservation to visit a specific facility or on a designated date and time.
[0606] "Methods for analyzing users' emotional states and optimizing information provision" refers to the process of analyzing users' emotions and customizing the information provided based on the results.
[0607] "Means of presenting information via household machinery and devices" refers to a function that provides users with necessary information visually or audibly through devices used within the home.
[0608] One embodiment of this invention involves using a home-use device connected to a terminal owned by a user within their home. The terminal has a dedicated application installed for automatically collecting and providing data related to childcare facilities to the user.
[0609] The server continuously collects information on childcare facilities via the internet and stores it in a database. The collected data includes basic facility information, programs offered, and availability. This allows for a rapid response to information requests from terminals.
[0610] When a user inputs information about a childcare facility through their device, the device sends this data to an emotion analysis engine. This analysis uses an emotion engine based on natural language processing technology (e.g., IBM Watson Tone Analyzer) to extract the user's emotional state in real time from their input.
[0611] Based on the results of the emotion analysis, the server uses the analysis data to construct information optimized for the user. In this process, facility information that is particularly suited to the user's emotional state is selected and sent to the terminal. Prioritization is also adjusted, and recommended facilities and programs are customized as needed.
[0612] Home-use devices present information received from a server in a user-friendly interface. This information presentation utilizes visual and auditory elements to allow users to easily and intuitively access the information. For example, if the device analyzes that the user is experiencing stress, it will highlight programs that provide relaxation.
[0613] For example, if a user enters "Please tell me about childcare facilities with low stress levels," the terminal sends the input to the server, where an analysis engine performs sentiment analysis. Based on this analysis, the system then customizes and provides information on relevant facilities according to the user's criteria.
[0614] Example of a prompt:
[0615] "If a user expresses strong anxiety about childcare facilities, please suggest ways to offer stress-reducing activities."
[0616] "Please develop an algorithm that customizes childcare facility reservation information based on the parents' emotional state."
[0617] This system allows users to obtain personalized information about childcare facilities, enabling them to efficiently make reservations for visits and acquire information.
[0618] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0619] Step 1:
[0620] The user enters information about the childcare facility from their device.
[0621] The entered data includes search criteria, desired facility name, and emotional feedback (e.g., stress level).
[0622] This information is sent to the emotion analysis engine.
[0623] Step 2:
[0624] The device transmits input data to the emotion analysis engine in real time.
[0625] A sentiment analysis engine (e.g., IBM Watson Tone Analyzer) analyzes the input text and extracts the user's emotional state.
[0626] The analysis results in the generation of data indicating the user's emotional state (e.g., stress level, positive / negative emotion score).
[0627] Step 3:
[0628] The server receives the results of the emotion analysis, refers to a database of childcare facilities, and selects facility information that is appropriate for the user's emotional state.
[0629] In this selection process, the priority of facilities is adjusted using the results of sentiment analysis.
[0630] An algorithm is applied that prioritizes information that aligns with the user's emotions, resulting in a list of optimal facility data.
[0631] Step 4:
[0632] The server sends selected childcare facility information to the terminal. The information sent includes basic facility data, suggested programs, and availability.
[0633] This data is organized to reflect the user's emotional state.
[0634] Step 5:
[0635] The terminal displays the information it receives to the user through a home appliance.
[0636] The machine or device presents information optimized for the user through a visual or audio interface.
[0637] Users will be able to use this information to make reservations for tours.
[0638] Additionally, the system may offer extra recommendations tailored to the user's emotional state (e.g., recommendations for stress-relieving facilities).
[0639] In this way, the entire system enables users to receive information about childcare facilities that is tailored to their emotional state.
[0640] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.
[0641] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0642] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.
[0643] [Fourth Embodiment]
[0644] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.
[0645] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[0646] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0647] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.
[0648] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.
[0649] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).
[0650] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.
[0651] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.
[0652] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.
[0653] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0654] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0655] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0656] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0657] As an embodiment for carrying out the present invention, we propose a method based on the following system configuration. This system aims to efficiently exchange information between a server, terminals, and users, and to centralize everything from information gathering to reservations and management related to childcare facilities.
[0658] First, the server automatically crawls pre-configured official websites of municipalities and childcare facilities to collect publicly available information about these facilities. The server then uses programs to efficiently extract the necessary information, parsing the data in HTML and JSON formats and storing it in a database. This database is updated at regular intervals to ensure it is always up-to-date.
[0659] Next, users can search for specific information about childcare facilities through an interface provided on their device. If a user wants to obtain detailed information about a facility they are interested in, the system will perform an automated query for that information via the server. This query might, for example, retrieve information about allergy accommodations or special programs.
[0660] The terminal displays sequentially processed responses to the user and updates the information according to the user's interests. If the user wishes to visit, they enter their desired date and time into the terminal, and the server automatically makes a reservation for the visit to the childcare facility. Once the reservation is confirmed, a confirmation notice is sent to the user, and the reservation information is also recorded on the server.
[0661] Furthermore, the server collects and analyzes the latest data on the availability of childcare facilities from municipal databases. Based on this analysis, the terminal visually displays information to the user about which facilities have availability, supporting the management of enrollment schedules.
[0662] As a concrete example, consider a scenario where a user wants to check the latest availability at "Childcare Facility A" and inquire about allergy accommodations. In this case, the user selects the facility from their terminal and enters their inquiry. The server automatically queries "Childcare Facility A," analyzes the response, and displays it on the terminal. Based on the displayed information, the user reserves a date for their visit and immediately receives a confirmation notification.
[0663] In this way, the system according to the present invention streamlines the process of acquiring and managing childcare facility information, enabling user-friendly operation.
[0664] The following describes the processing flow.
[0665] Step 1:
[0666] The server loads a list of URLs for the official websites of municipalities and childcare facilities. It then launches a web scraping program to automatically crawl these sites and collect information.
[0667] Step 2:
[0668] The server analyzes the acquired HTML and JSON data to extract information such as the location of the childcare facility, opening hours, and childcare fees. The analyzed information is then stored in a database.
[0669] Step 3:
[0670] Users search for information about specific childcare facilities through an interface on their device. They select facilities of interest and request further details.
[0671] Step 4:
[0672] The server automatically creates an inquiry format in response to the user's request and sends an information retrieval request to the specific childcare facility via email or API.
[0673] Step 5:
[0674] After the server receives a response from a childcare facility, it analyzes the content, extracts the necessary information, and adds or updates it to the database.
[0675] Step 6:
[0676] The user checks the updated inquiry information on the interface on their device. A notification is sent from the device when the information becomes available.
[0677] Step 7:
[0678] If a user wishes to visit a childcare facility, they select the date and time from the calendar displayed on their device.
[0679] Step 8:
[0680] The server registers the selected date and time in the reservation system and sends a request for a visit reservation to the childcare facility.
[0681] Step 9:
[0682] The server receives the reservation confirmation and sends a confirmation notice to the user via email or their device. The reservation information is also recorded in the database.
[0683] Step 10:
[0684] The server periodically collects and analyzes information on the availability of childcare facilities from municipal websites.
[0685] Step 11:
[0686] The analyzed availability data is visually displayed to the user on their device, assisting them in managing their child's admission schedule. Based on this information, the user can find a suitable facility.
[0687] (Example 1)
[0688] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0689] Managing and utilizing information about modern childcare facilities requires a great deal of manual work and complex procedures, making it difficult for users to efficiently gather facility information and manage reservations. Furthermore, it is necessary to constantly monitor and appropriately present fluctuating availability, but doing so manually is laborious and inefficient. There is a need to solve these problems and provide a system that is highly convenient for users.
[0690] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0691] In this invention, the server includes means for automatically collecting facility information by crawling websites, means for analyzing the collected information and organizing and storing it in a database, and means for analyzing availability using municipal data and presenting it visually. As a result, users can efficiently collect the latest childcare facility information and centrally manage everything from booking facility tours to checking availability without having to do any manual work themselves.
[0692] "Website crawling" refers to the process where a server automatically visits multiple web pages on the internet to collect necessary information.
[0693] "Facility information" refers to all relevant data about the childcare facility, including details such as name, address, contact information, availability, and programs offered.
[0694] "Automatic data collection methods" refer to systems where a server uses a program to collect data without human intervention.
[0695] "Organizing and storing information in a database" is the process of systematically arranging collected information according to a specific structure and saving it in a way that allows for later access.
[0696] "Analyzing and visually presenting" means analyzing collected data, converting it into an easily understandable form, and showing it to the user in a graphical format.
[0697] "Using data from municipalities" means using information provided by specific local governments to perform more accurate analysis.
[0698] As an embodiment of the present invention, the following system is constructed. It is possible to centralize the collection, reservation, and management of childcare facility information while coordinating between the server, terminal, and user.
[0699] The server uses a program to automatically crawl websites and collect facility information. This collection utilizes libraries such as Beautiful Soup and Selenium in the Python language. The server parses HTML files and JSON responses to extract information such as the name, address, contact information, availability, and special program details of childcare facilities. The extracted data is stored in a MySQL database, where it is centrally managed. This information is regularly updated to ensure it is always up-to-date.
[0700] As a concrete example, the server executes a scheduled task at 9:00 AM every day, crawling all target websites to retrieve new information.
[0701] Users can log in via their device and search for information on any childcare facility. The device interface is built with the latest front-end technologies such as React, providing an intuitive user experience. Users can enter the facility name in the search bar and make detailed inquiries as needed. When making an inquiry, it is possible to obtain information such as the content of special programs or allergy accommodations, and to review the results.
[0702] For example, if a user wants to check the availability of "Childcare Facility A," they can simply type "Childcare Facility A" into the terminal and press the Enter key, and the information will be displayed instantly.
[0703] The terminal visually organizes the collected information and presents it to the user. The visual display utilizes charts and color-coded infographics to ensure user comprehension. The terminal also receives requests for tour dates and automatically processes facility tour reservations through the server.
[0704] As an example of a prompt message, entering "Please tell me the latest availability and allergy information for childcare facility A" will allow the system to quickly provide specific information.
[0705] This system facilitates smooth data exchange between servers, terminals, and users, enabling efficient collection and management of information related to childcare facilities.
[0706] The flow of the specific processing in Example 1 will be explained using Figure 11.
[0707] Step 1:
[0708] The server crawls websites to collect information on childcare facilities. The input is a list of URLs for target municipalities and facilities. Beautiful Soup and Selenium are used to parse the HTML and JSON data of the web pages and extract the necessary information (e.g., facility name, location, availability). The extracted information is stored in a structured format in temporary storage.
[0709] Step 2:
[0710] The server analyzes the collected data and stores it in a database. The input is raw data stored in temporary storage. The data is converted to a specific format (e.g., CSV format), and duplicate checking and data cleansing are performed. The clean data is stored in a MySQL database, and indexes are added to allow for efficient searching of the information.
[0711] Step 3:
[0712] The user searches for and displays childcare facility information using their device. Input consists of the facility name and criteria (e.g., whether or not they accommodate allergies) entered by the user in the device's search bar. The server executes a database query to retrieve the relevant facility information and returns it to the device. Output is the facility information displayed on the device in a format viewable by the user.
[0713] Step 4:
[0714] If the user wishes to confirm further details, they can make additional inquiries through the terminal. The input is a specific information item selected by the user (e.g., the contents of a special program). The server retrieves the relevant information from the database and, if necessary, uses external APIs to obtain the latest information. The output is the detailed information displayed on the terminal.
[0715] Step 5:
[0716] When a user wishes to make a reservation for a tour, they enter their desired date and time on a terminal. The input is a calendar-style interface specifying the desired date and time. The terminal sends a reservation request to the server, which then confirms the reservation in cooperation with the facility management system. The output is a reservation confirmation notice sent to the user.
[0717] Step 6:
[0718] The terminal visually displays availability. The input is the latest availability data retrieved from the server. The data is converted into a color-coded chart using a graphics library, presenting the facility's congestion status to the user at a glance. The output is a visually represented availability information.
[0719] (Application Example 1)
[0720] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0721] Traditionally, gathering information and managing reservations for childcare facilities has been a complex and time-consuming task, making it particularly difficult for parents and guardians to efficiently obtain necessary information and appropriately book visits. Furthermore, there has been insufficient support for providing information and scheduling childcare facilities using voice recognition technology and automated devices, highlighting the need for easy-to-use services at home.
[0722] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0723] In this invention, the server includes means for automatically collecting information on childcare facilities, means for receiving and responding to user voice instructions using a voice recognition function, and means for analyzing natural language using a generative AI model to assist in selecting the optimal childcare facility. As a result, users can obtain the latest information on childcare facilities and quickly make reservations for visits through simple operation using voice instructions.
[0724] A "childcare facility" is a facility that provides temporary or continuous childcare services to infants and preschool children.
[0725] "Methods of automatic collection" refer to methods of obtaining information related to childcare facilities from designated websites or databases using a program without requiring manual operation.
[0726] The "inquiry method" is a system that automatically requests necessary information from childcare facilities based on conditions specified by the user.
[0727] "Method for booking a visit" refers to a method for automatically registering and coordinating visits to childcare facilities specified by the user.
[0728] "Means for analyzing and managing availability" refers to a system for examining the number of children a childcare facility can accommodate and its availability, and for providing appropriate information to users.
[0729] "Voice recognition functionality" is a technology that converts a user's voice commands into digital data, understands it appropriately, and processes it.
[0730] A "home automation device" is a device installed in the home that provides information through voice and displays and works in conjunction with home appliances to enhance user convenience.
[0731] A "generative AI model" is an artificial intelligence technology that automatically learns from vast amounts of data and understands and analyzes natural language.
[0732] "Means of analyzing natural language" refers to software technologies that analyze user utterances and text, understand their intent, and apply that understanding.
[0733] To implement this invention, a home automation device and a server with internet connectivity are required. The server automatically collects information on a designated childcare facility and stores it in an SQLite database. The Python BeautifulSoup library is used for web scraping, and Celery is used for scheduling information updates.
[0734] The user gives voice commands through an automated device in their home. This device uses the Google Cloud Speech-to-Text API to convert the speech into text data, and then uses a generative AI model (TensorFlow library) for natural language processing to understand the user's requests.
[0735] Based on the information received from the user, the server automatically makes reservations for visits to designated childcare facilities and requests detailed information. The reservation system uses the Google Calendar API to automatically adjust schedules.
[0736] This system provides real-time information on the availability of childcare facilities based on user voice commands and suggests the optimal visit date and time. The information is displayed via voice, and in some cases, as visual information on the display of a home automation device.
[0737] For example, if a user says, "Please book a visit to childcare facility A next Monday," the server retrieves the latest information from the internet and automatically completes the visit reservation. It then immediately reports the result by voice and, in some cases, displays a confirmation message on the screen. An example of a prompt to the generating AI model is, "Please tell me the latest availability at the childcare facility. I would like to check on allergy policies and book a visit." This system simplifies cumbersome procedures.
[0738] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0739] Step 1:
[0740] The server periodically accesses pre-specified websites related to childcare facilities to collect information. The input is the URL of the webpage. Using the Python BeautifulSoup library, the HTML data is parsed to extract information such as the availability of childcare facilities and other facility details. The extracted data is stored in an SQLite database. The output is a database containing the latest childcare facility information.
[0741] Step 2:
[0742] The user gives voice commands to a home automation device. This input is voice data. The device uses the Google Cloud Speech-to-Text API to convert this voice data into text data. The output is text data corresponding to the voice commands. This text data is then subjected to natural language processing via a generative AI model.
[0743] Step 3:
[0744] The server receives text instructions from the user and determines which childcare facilities to contact. The input is the text data provided by the user. Based on the parsed text data, the server determines the content of the inquiry and contacts the necessary childcare facilities. The output is detailed information about the childcare facilities. The information is based on the user's preferences.
[0745] Step 4:
[0746] The server analyzes the reservation status of childcare facilities and identifies available dates and times for visits. The input is reservation information obtained from the childcare facilities. Using the Google Calendar API, the visit reservation is automatically registered in the user's calendar. The output is a reservation completion notification. This notification is sent to the user's home automation device.
[0747] Step 5:
[0748] The home automation device notifies the user via voice and visual display that a reservation has been completed. The input is a reservation completion notification from the server. The device displays a confirmation message on its screen and provides an audio notification. The output is the final notification to the user.
[0749] Throughout this entire process, the server, user, and home automation device work together to enable smooth information provision and booking of childcare facilities.
[0750] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0751] As an embodiment of the present invention, we propose a system that optimizes the provision of childcare facility information based on the user's emotional state. This system integrates a server, a terminal, and an emotion engine that analyzes the user's emotional state, thereby improving the user experience in addition to collecting, inquiring about, making reservations for, and managing availability of childcare facilities.
[0752] First, the user searches for information about childcare facilities via their device and, if necessary, enters specific questions into the system. This information is then sent to the sentiment engine, which extracts and analyzes emotions from the user's text. This sentiment analysis is performed in real time using natural language processing (NLP).
[0753] Next, the server adjusts the information on childcare facilities and changes the priority of suggesting specific facilities based on the analyzed emotional data. This adjustment allows, for example, to provide an intuitively understandable interface if the user is feeling stressed, or to suggest new childcare facility options if a positive emotional state is indicated.
[0754] The terminal presents users with customized information and also provides support when users make tour reservations. In this process, the emotion engine can suggest tour dates, times, and facilities that are deemed high priority based on the user's emotional state. Furthermore, availability analysis information is presented in a way that adapts to the emotional state, allowing users to receive more personalized information.
[0755] For example, if a user searches for information on "Childcare Facility B" and the device indicates that they are experiencing stress, the emotion engine will highlight information about stress reduction programs offered by Childcare Facility B (e.g., activities for relaxation). Furthermore, to simplify the booking process, the device will automatically suggest the nearest available date and time.
[0756] Thus, by integrating an emotion engine, the system of the present invention provides information adapted to the user's emotional state, making the process of finding childcare facilities more personalized and efficient.
[0757] The following describes the processing flow.
[0758] Step 1:
[0759] Users log in to the interface using their device to search for information on childcare facilities. They enter search criteria and specific questions and request information collection.
[0760] Step 2:
[0761] The device receives user input data and sends it to the emotion engine. The emotion engine uses natural language processing techniques to analyze the user's text data and identify their emotional state.
[0762] Step 3:
[0763] The server extracts relevant information from the childcare facility database based on the user's emotional state. If the emotion is stress, it prioritizes extracting information about the facility's stress reduction programs.
[0764] Step 4:
[0765] The server adjusts the style of information provided to the user based on their emotional state. For example, if the user is relaxed, it will increase the frequency of presenting new childcare options.
[0766] Step 5:
[0767] The terminal presents the user with adjusted information. The user can view information about childcare facilities and, if necessary, decide to schedule a visit.
[0768] Step 6:
[0769] When a user wishes to schedule a tour, the device automatically suggests a suitable date and time based on their emotional state. The user then confirms the suggested date and time and enters their preferred tour date and time.
[0770] Step 7:
[0771] The server registers the user's request for a visit in the reservation system and coordinates with the childcare facility. Once the reservation is confirmed, a reservation confirmation message is sent to the user via their device.
[0772] Step 8:
[0773] The server periodically updates the availability status of childcare facilities using web data from municipalities. It then delivers the results of analysis using an emotion engine to the user's device, providing them with high-priority availability information.
[0774] In this way, the system, which incorporates an emotion engine, provides personalized services based on the user's emotional state, making the process of finding childcare facilities smoother.
[0775] (Example 2)
[0776] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0777] In the collection, booking, and management of information regarding childcare facilities, there is a lack of personalized information provision that takes into account the emotional state of users. Traditional systems only provide uniform information, which is problematic because it fails to alleviate the emotional burden and anxiety experienced by users.
[0778] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0779] In this invention, the server includes means for automatically aggregating information on childcare facilities, means for analyzing the emotional state of users and dynamically adjusting the information based on the analysis results, and means for presenting the adjusted information to users and supporting them in making reservations for visits. This makes it possible to provide personalized information and reservation support tailored to the emotional state of users.
[0780] "Childcare facilities" is a general term for facilities that provide educational and childcare services to children.
[0781] "Means for automatically aggregating information" refers to a function that automatically collects data related to childcare facilities and consolidates it in one place.
[0782] "Means of inquiry" refers to a function that automatically generates questions based on aggregated information in response to user requests and retrieves the necessary information.
[0783] "Method for booking a visit" refers to a support function that allows users to book a visit to a childcare facility on a date specified by the user.
[0784] "Means for analyzing and managing availability" refers to a function that analyzes the availability status of childcare facilities and manages it as information.
[0785] "Means for analyzing emotional states" refers to technologies that extract and analyze emotions from user input information.
[0786] "Means of dynamically adjusting information" refers to a function that changes the content and order of the information provided based on analyzed sentiment data.
[0787] "Means of presenting adjusted information and supporting tour reservations" refers to a function that presents adjusted information to users and supports them in smoothly proceeding with tour reservations.
[0788] This invention utilizes a system integrating a server, terminal, text analysis, and emotion engine to provide childcare facility information adapted to the user's emotional state. When a user searches for information related to childcare facilities through the terminal, the text data is sent to the emotion engine. The emotion engine uses natural language processing (NLP) technology to analyze the user's emotions in real time. Based on this analysis, the server dynamically adjusts the priority of the childcare facility information provided. This makes it possible to provide information tailored to the user's emotions.
[0789] The server adjusts and delivers information to the terminal, suggesting the optimal date, time, and facility for the visit. This allows users to have a less stressful experience and quickly book a visit. For example, if the analysis indicates that a user is experiencing stress while searching for information about childcare facility B, the terminal will automatically suggest stress reduction programs offered by childcare facility B and the most easily available visit time.
[0790] While sentiment analysis using generative AI models forms the core of this system, the system is designed to maintain sophisticated security protocols and ensure the privacy of user data. An example of a prompt would be: "A user is searching for information about childcare facilities and has given input indicating stress. Explain how the sentiment engine should handle the user's input and what information should be prioritized."
[0791] This system enables personalized information delivery based on emotional states, allowing users to search for childcare facilities more efficiently and comfortably.
[0792] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0793] Step 1:
[0794] A user uses a terminal to search for information about childcare facilities. The user enters the name and location of the childcare facility as keywords into the terminal. Based on this input data (e.g., text), the search is initiated. The entered keywords are sent to a database for subsequent processing.
[0795] Step 2:
[0796] The terminal receives user input data and sends it to the emotion engine. The terminal accurately captures the input and creates a data packet to transfer to the server. This packet contains the information entered by the user. After transmission, the data awaits emotion analysis on the server.
[0797] Step 3:
[0798] The server passes the received user input data to the emotion engine for analysis. The emotion engine uses a generative AI model to extract emotions from the text. This data processing process executes an emotion analysis algorithm and outputs the user's emotional state (e.g., stress, relief, etc.). This allows for information adjustment in the next step.
[0799] Step 4:
[0800] The server dynamically adjusts childcare facility information using the emotion data output by the emotion engine. Based on the emotion data, it changes the priority of facilities and organizes related information. This data calculation sorts the information in the most appropriate way. The adjusted information is then ready to be presented to the user in the most optimal format.
[0801] Step 5:
[0802] The terminal receives information processed from the server and presents it to the user. The terminal displays facility information along with recommendations based on sentiment analysis results. This output includes suggested visit dates and times, as well as facility details. The terminal also features a user interface designed to simplify the visit reservation process.
[0803] Step 6:
[0804] Based on the information provided by the user, the system sets up a reservation for a visit to a childcare facility. The user makes selections and makes the reservation based on the optimized information. The user's selections are sent back to the server, and the entire system enters the process of completing the reservation.
[0805] Through this process, the system provides users with a personalized experience that adapts to their emotional state.
[0806] (Application Example 2)
[0807] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0808] In today's world, many parents experience emotional burdens when choosing childcare facilities. Therefore, there is a need to provide information that is tailored to the emotional state of parents. Furthermore, there is a need for smoother access to facility information, availability checks, and scheduling visits. The challenge lies in reducing the psychological burden on parents and supporting efficient childcare facility selection.
[0809] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.
[0810] In this invention, the server includes means for automatically collecting information on childcare facilities, means for automatically querying information specified by the user, means for booking visits, means for analyzing the user's emotional state to optimize information provision, and means for presenting information via a home-use device. This makes it possible to efficiently and individually provide appropriate childcare facility information according to the user's emotional state.
[0811] A "childcare facility" is a facility that takes care of infants and children for a set period of time and supports their growth through education, play, and other activities.
[0812] "Means for automatically collecting information" refers to a process of setting specific conditions or filters and automatically collecting data accordingly.
[0813] "A means of automatically querying information specified by the user" refers to a mechanism that automatically queries an external system or database for relevant data based on the conditions entered by the user.
[0814] "Means for booking a tour" refers to the function of making a reservation to visit a specific facility or on a designated date and time.
[0815] "Methods for analyzing users' emotional states and optimizing information provision" refers to the process of analyzing users' emotions and customizing the information provided based on the results.
[0816] "Means of presenting information via household machinery and devices" refers to a function that provides users with necessary information visually or audibly through devices used within the home.
[0817] One embodiment of this invention involves using a home-use device connected to a terminal owned by a user within their home. The terminal has a dedicated application installed for automatically collecting and providing data related to childcare facilities to the user.
[0818] The server continuously collects information on childcare facilities via the internet and stores it in a database. The collected data includes basic facility information, programs offered, and availability. This allows for a rapid response to information requests from terminals.
[0819] When a user inputs information about a childcare facility through their device, the device sends this data to an emotion analysis engine. This analysis uses an emotion engine based on natural language processing technology (e.g., IBM Watson Tone Analyzer) to extract the user's emotional state in real time from their input.
[0820] Based on the results of the emotion analysis, the server uses the analysis data to construct information optimized for the user. In this process, facility information that is particularly suited to the user's emotional state is selected and sent to the terminal. Prioritization is also adjusted, and recommended facilities and programs are customized as needed.
[0821] Home-use devices present information received from a server in a user-friendly interface. This information presentation utilizes visual and auditory elements to allow users to easily and intuitively access the information. For example, if the device analyzes that the user is experiencing stress, it will highlight programs that provide relaxation.
[0822] For example, if a user enters "Please tell me about childcare facilities with low stress levels," the terminal sends the input to the server, where an analysis engine performs sentiment analysis. Based on this analysis, the system then customizes and provides information on relevant facilities according to the user's criteria.
[0823] Example of a prompt:
[0824] "If a user expresses strong anxiety about childcare facilities, please suggest ways to offer stress-reducing activities."
[0825] "Please develop an algorithm that customizes childcare facility reservation information based on the parents' emotional state."
[0826] This system allows users to obtain personalized information about childcare facilities, enabling them to efficiently make reservations for visits and acquire information.
[0827] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0828] Step 1:
[0829] The user enters information about the childcare facility from their device.
[0830] The entered data includes search criteria, desired facility name, and emotional feedback (e.g., stress level).
[0831] This information is sent to the emotion analysis engine.
[0832] Step 2:
[0833] The device transmits input data to the emotion analysis engine in real time.
[0834] A sentiment analysis engine (e.g., IBM Watson Tone Analyzer) analyzes the input text and extracts the user's emotional state.
[0835] The analysis results in the generation of data indicating the user's emotional state (e.g., stress level, positive / negative emotion score).
[0836] Step 3:
[0837] The server receives the results of the emotion analysis, refers to a database of childcare facilities, and selects facility information that is appropriate for the user's emotional state.
[0838] In this selection process, the priority of facilities is adjusted using the results of sentiment analysis.
[0839] An algorithm is applied that prioritizes information that aligns with the user's emotions, resulting in a list of optimal facility data.
[0840] Step 4:
[0841] The server sends selected childcare facility information to the terminal. The information sent includes basic facility data, suggested programs, and availability.
[0842] This data is organized to reflect the user's emotional state.
[0843] Step 5:
[0844] The terminal displays the information it receives to the user through a home appliance.
[0845] The machine or device presents information optimized for the user through a visual or audio interface.
[0846] Users will be able to use this information to make reservations for tours.
[0847] Additionally, the system may offer extra recommendations tailored to the user's emotional state (e.g., recommendations for stress-relieving facilities).
[0848] In this way, the entire system enables users to receive information about childcare facilities that is tailored to their emotional state.
[0849] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.
[0850] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0851] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.
[0852] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.
[0853] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.
[0854] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.
[0855] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.
[0856] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.
[0857] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."
[0858] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.
[0859] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.
[0860] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.
[0861] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.
[0862] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.
[0863] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.
[0864] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.
[0865] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.
[0866] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.
[0867] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.
[0868] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.
[0869] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.
[0870] The following is further disclosed regarding the embodiments described above.
[0871] (Claim 1)
[0872] A means for automatically collecting information on childcare facilities,
[0873] A means of automatically querying the information specified by the user based on the above information,
[0874] How to book a tour of a childcare facility,
[0875] A system that includes means for analyzing and managing the availability of childcare facilities.
[0876] (Claim 2)
[0877] The system according to claim 1, which includes means for a user to input specific information about a childcare facility, for which an inquiry is automatically made based on that information, and for obtaining a response.
[0878] (Claim 3)
[0879] The system according to claim 1, comprising means for periodically updating the availability status of childcare facilities and presenting the analyzed availability data to users.
[0880] "Example 1"
[0881] (Claim 1)
[0882] A method for automatically collecting facility information by crawling websites,
[0883] A means of analyzing the collected information and organizing and storing it in a database,
[0884] A means for users to search for and inquire about facility information via their devices,
[0885] A means of automatically processing facility tour reservations based on user requests for tours,
[0886] A system that includes means for analyzing and visually presenting vacancy status using data from municipalities.
[0887] (Claim 2)
[0888] The system according to claim 1, comprising means for performing a process to allow a user to select specific facility information and automatically obtain detailed information.
[0889] (Claim 3)
[0890] The system according to claim 1, comprising means for periodically analyzing the availability of facilities and presenting the analysis results using color coding or visual elements.
[0891] "Application Example 1"
[0892] (Claim 1)
[0893] A means for automatically collecting information on childcare facilities,
[0894] A means of automatically querying the information specified by the user based on the above information,
[0895] How to book a tour of a childcare facility,
[0896] A means of analyzing and managing the availability of childcare facilities,
[0897] A means of receiving and responding to user voice commands using voice recognition functionality,
[0898] A means of providing information on childcare facilities and scheduling through a home automation device,
[0899] A means of supporting users in selecting the most suitable childcare facility by analyzing natural language using a generative AI model,
[0900] A system that includes this.
[0901] (Claim 2)
[0902] The system according to claim 1, comprising means for a user to input specific information regarding a childcare facility, for which an inquiry is automatically made based on that information, and for obtaining a response.
[0903] (Claim 3)
[0904] The system according to claim 1, comprising means for periodically updating the availability status of childcare facilities, presenting the analyzed availability data to users, and providing information visually or audibly via a home automation device.
[0905] "Example 2 of combining an emotion engine"
[0906] (Claim 1)
[0907] A means of automatically aggregating information on childcare facilities,
[0908] A means of automatically querying information specified by the user based on aggregated information,
[0909] How to book a tour of a childcare facility,
[0910] A means of analyzing and managing the availability of childcare facilities,
[0911] A means for analyzing the emotional state of users and dynamically adjusting information based on the analysis results,
[0912] A means of presenting adjusted information to users and supporting them in making tour reservations,
[0913] A system that includes this.
[0914] (Claim 2)
[0915] The system according to claim 1, which includes means for a user to input specific information about a childcare facility, for the system to automatically make inquiries based on that information and obtain responses, and which further provides information adapted to the user's emotional state through sentiment analysis.
[0916] (Claim 3)
[0917] The system according to claim 1, comprising means for periodically updating the availability status of childcare facilities and presenting the analyzed availability data in accordance with the emotional state of the users.
[0918] "Application example 2 when combining with an emotional engine"
[0919] (Claim 1)
[0920] A means for automatically collecting information on childcare facilities,
[0921] A means of automatically querying the information specified by the user based on the above information,
[0922] How to book a tour of a childcare facility,
[0923] A means to analyze and manage the availability of childcare facilities,
[0924] A means to analyze the emotional state of users and optimize information provision,
[0925] Based on the sentiment analysis described above, a means of adjusting the content and priorities of the proposals can be obtained.
[0926] Means for presenting information via household machinery and devices,
[0927] A system that includes this.
[0928] (Claim 2)
[0929] A means by which users input specific information about childcare facilities, and based on that information, inquiries are automatically made and responses are obtained.
[0930] The system according to claim 1, comprising means for presenting facility information in accordance with the emotional state of the user.
[0931] (Claim 3)
[0932] A means of regularly updating the availability status of childcare facilities and presenting the analyzed availability data to users,
[0933] The system according to claim 1, comprising means for providing information adapted to the user's emotional state. [Explanation of Symbols]
[0934] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>
Claims
1. A means for automatically collecting information on childcare facilities, A means of automatically querying the information specified by the user based on the above information, How to book a tour of a childcare facility, A system that includes means for analyzing and managing the availability of childcare facilities.
2. The system according to claim 1, which includes means for a user to input specific information about a childcare facility, for which an inquiry is automatically made based on that information, and for obtaining a response.
3. The system according to claim 1, comprising means for periodically updating the availability status of childcare facilities and presenting the analyzed availability data to users.