system
The system addresses caregiver shortages and inefficiencies by dynamically generating care plans and automating administrative tasks, enhancing productivity and personalizing care through emotional state analysis.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- SOFTBANK GROUP CORP
- Filing Date
- 2024-12-09
- Publication Date
- 2026-06-19
AI Technical Summary
The aging society faces challenges such as a shortage of caregiver staff, low attractiveness of the profession, harsh working conditions, and inefficient administrative processes, leading to a decline in business efficiency and increased workload for care managers.
A system utilizing an information processing device to dynamically generate documents, visualize data, and automate administrative tasks, including the creation of care plans and selection of service providers, by using AI to streamline operations and reduce workload.
The system improves productivity and efficiency by automating administrative tasks, reducing the workload of care managers, and providing personalized care plans based on user data and emotional state analysis.
Smart Images

Figure 2026100631000001_ABST
Abstract
Description
Technical Field
[0001] The technology of the present disclosure relates to a system.
Background Art
[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a character of the chatbot, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] With the progress of an aging society, caregivers face various problems. Specifically, there is a shortage of caregiver staff as the number of care recipients increases, a decline in the attractiveness of the profession due to low wages and a harsh working environment, and furthermore, a huge administrative procedure and workload of paperwork when becoming independent as a care manager. In addition, due to the delay in digitalization, the current situation is that business efficiency has deteriorated, so it is necessary to solve these problems.
Means for Solving the Problems
[0005] This invention provides a system that uses an information processing device to dynamically generate documents based on input user data and visualize them. Furthermore, by accumulating user data in a database, generating optimization information through data analysis, and automating business procedures using that information, it streamlines administrative tasks associated with independent care managers. Moreover, by enabling the rapid and automated generation of administrative documents using templates, it provides a means to reduce workload and improve productivity by dynamically creating care plans and selecting service providers.
[0006] An "information processing device" is a device, such as a computer or server, that processes and analyzes input data and outputs the results.
[0007] "User data" refers to information about individual users of long-term care services that is necessary for creating care plans and providing services.
[0008] "Document generation" is the process of automatically creating a document in a specific format based on the input data.
[0009] "Visualization" refers to making data and information easier to understand by displaying them visually in the form of graphs, tables, and other similar formats.
[0010] A "database" is a system that centrally manages large amounts of data in a format that can be accessed by computers.
[0011] "Optimization information" refers to guidelines and instructions generated as a result of data analysis, with the aim of improving operational efficiency and optimizing resource allocation.
[0012] "Automation of business procedures" refers to the process of automating business tasks and processes that were traditionally performed by humans, using machines or software.
[0013] A "template" is a predefined format or template used for document generation and other similar tasks. [Brief explanation of the drawing]
[0014] [Figure 1] It is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] It is a conceptual diagram showing an example of the main functions of a data processing device and a smart device according to the first embodiment. [Figure 3] It is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] It is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] It is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] It is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] It is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] It is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] It shows an emotion map to which a plurality of emotions are mapped. [Figure 10] It shows an emotion map to which a plurality of emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Example 2 when an emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when an emotion engine is combined.
Embodiments for Carrying Out the Invention
[0015] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.
[0016] First, the terms used in the following description will be explained.
[0017] In the following embodiments, a labeled processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.
[0018] In the following embodiments, a labeled RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.
[0019] In the following embodiments, a labeled storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, and the like.
[0020] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).
[0021] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."
[0022] [First Embodiment]
[0023] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.
[0024] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0025] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0026] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.
[0027] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0029] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.
[0030] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0031] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.
[0032] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0033] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0034] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".
[0035] This invention is a care support system that utilizes a computer network, and primarily operates through the coordinated operation of a server, terminals, and users.
[0036] server
[0037] The server plays a central role in this system, processing user input data. First, when user data is sent to the server, it stores it in a database. Then, artificial intelligence (AI) is used to analyze the data as needed to generate an optimal care plan. The generated care plan is automatically created as a document in a format suitable for submission to the government, based on a specified template.
[0038] Furthermore, the server aggregates data from multiple users and cross-references it with a service provider database to automatically select the most suitable service provider for each user. This makes it possible to propose the optimal care plan for each user and the service providers that can provide it.
[0039] terminal
[0040] The terminal is a device for users to interface with the system. On the terminal, users input their information, and this data is sent to the server. The results processed by the server are sent back to the terminal and displayed in a format that the user can review. This includes generated care plans and service provider selection results. The terminal also visualizes information necessary for schedule management and work procedures, supporting the user's work.
[0041] User
[0042] Users are those who directly operate the system and perform care support tasks. They use terminals to input user information and utilize the system to support the creation of optimal care plans and the generation of necessary administrative documents. Users also receive improvement suggestions and reports from the server and work to improve the quality of their work.
[0043] Specific example
[0044] For example, suppose a user enters information about a new care service recipient, user A, into the terminal. Based on the user's health condition and required care, the server uses AI to generate an optimal care plan. In this process, multiple service provider databases are consulted, and the most suitable provider for user A is selected. Finally, the generated care plan and matching results are displayed on the terminal, allowing the user to review them and arrange the necessary services for user A.
[0045] Through this system, users can improve the efficiency and quality of their work, and effectively support their independence as care managers.
[0046] The following describes the processing flow.
[0047] Step 1:
[0048] The user uses a terminal to input basic information about the person requesting care services (name, address, health condition, desired care content, etc.).
[0049] Step 2:
[0050] The terminal receives user input data and sends it to the server.
[0051] Step 3:
[0052] The server saves the user information it receives to the database.
[0053] Step 4:
[0054] The server uses AI functionality to generate an optimal care plan based on the user's information. Here, it analyzes the user's health condition and desired services to formulate an appropriate care plan.
[0055] Step 5:
[0056] The server references a database of care service providers and automatically selects the most suitable provider for the user. This matching process is based on location information and the services that can be provided.
[0057] Step 6:
[0058] The server sends the generated care plan and information about the selected service provider to the terminal.
[0059] Step 7:
[0060] The terminal receives results from the server and displays the care plan and service provider information to the user.
[0061] Step 8:
[0062] The user reviews the displayed information, modifies the care plan and service provider information if necessary, and makes the final decision to arrange everything.
[0063] (Example 1)
[0064] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."
[0065] Modern elderly care support requires complex information management and the selection of diverse service providers, necessitating systems to handle these tasks efficiently. However, conventional technologies have presented challenges such as inefficient manual entry of user information, creation of individual documents, and selection of appropriate service providers, resulting in a heavy workload.
[0066] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0067] In this invention, the server includes means for dynamically generating information based on input personal data, means for storing personal data in an information storage device and analyzing that information to generate optimized information, and means for searching for information on multiple providers and selecting the most suitable provider. This enables efficient information management and automatic selection of the optimal care plan and provider.
[0068] "Personal data" refers to all information about a user, including basic information, health status, and service preferences.
[0069] An "information storage device" refers to a storage device, such as a database, used to store and manage personal data.
[0070] "Optimized information" refers to information that proposes the most effective care plans and services for the user, generated based on personal data.
[0071] "Provider information" refers to all information about companies and organizations that provide care services, including their geographical location and the services they can offer.
[0072] A "template" is a model used when creating a document, providing a standard for structuring information in a specific format.
[0073] "Official procedural documents" refer to official documents that are required to be submitted to administrative agencies and are generated in a prescribed format.
[0074] A "care plan" refers to a series of support plans created based on the user's health condition and care needs, and includes specific measures to be implemented.
[0075] "Dynamically generating information" refers to the process of generating information in real time based on input data, and is operated using predefined rules and algorithms.
[0076] This system is designed to streamline care support, with servers, terminals, and users working together in coordination.
[0077] The server plays a central role in the system. It receives personal data transmitted from terminals and stores it in an information storage device. The server analyzes this data using high-performance database software and generative AI models. As a result of this analysis, an optimal care plan and optimization information are generated for the user. Furthermore, the server searches for information from multiple providers and selects the most suitable provider. This process involves complex data calculations and compares and evaluates multiple information sources to achieve optimal matching.
[0078] The terminal functions as a device for inputting information and displaying results from the server. The terminal provides an interface for users to input personal data. Users can input basic information and health status of care recipients into the terminal, enabling data transmission to the server. Care plans and provider selection results, analyzed by a generative AI model, are visualized on the terminal and presented to the user.
[0079] Users directly operate this system and utilize it in their care support work. Based on the analysis results from the generated AI model, users can confirm the optimal care plan and arrange the necessary services. Furthermore, they can quickly complete relevant administrative procedures using the generated official procedural documents. Therefore, users can significantly improve the efficiency of their care work.
[0080] As a concrete example, when a user enters information about a new care service recipient, user A, into the terminal, that data is analyzed on the server, and an optimal care plan is generated. The selection of service providers is also performed automatically, and the user can review the generated plan and the selection results. This allows the user to coordinate services quickly and effectively. By operating according to an example prompt message such as, "Generate a care plan for user A and select the most suitable service provider," the system supports the smooth execution of tasks.
[0081] The flow of the specific processing in Example 1 will be explained using Figure 11.
[0082] Step 1:
[0083] The terminal receives the user's personal data entered by the user. This information includes basic personal information, health status, and care needs. The terminal formats this data into a specified format and prepares it for transmission to the server. The user reviews the entered information, and if there are no problems, clicks the submit button to send the data to the server.
[0084] Step 2:
[0085] The server receives personal data transmitted from the terminal and stores it in the information storage device. The received data undergoes an integrity check, and if there are no problems, it is stored in the database. If an integrity problem is found, the server notifies the terminal and prompts the user to reconfirm.
[0086] Step 3:
[0087] The server uses stored personal data as input and performs data analysis using a generating AI model. The AI model generates an optimal care plan based on the user's health status and needs. In doing so, it suggests the most effective care methods while referring to past data and patterns. The server formats the generated care plan into a document and converts it into the necessary documents for administrative procedures using templates.
[0088] Step 4:
[0089] The server searches multiple provider information databases based on the generated care plan. Provider information includes geographical location and the types of services offered. The server compares this information with the entered personal data and selects the most suitable service provider for the user. The selected information is compiled into a suggestion list for the user.
[0090] Step 5:
[0091] The server sends the generated care plan and provider selection results to the terminal. The terminal receives this and presents it visually to the user. The user reviews the displayed information, re-enters or corrects any unclear points or corrections, and resends it to the server as needed. Specifically, the user manipulates the received data based on the prompt example, "Generate a care plan for user A and select the most suitable service provider."
[0092] (Application Example 1)
[0093] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."
[0094] In traditional care support, managing user information and creating care plans relied on manual processes, posing challenges in improving efficiency and quality. Furthermore, real-time monitoring of health conditions and prompt responses were difficult, making it challenging to provide optimal care services.
[0095] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0096] In this invention, the server includes means for dynamically generating information based on input user data, display means for visualizing the generated information, and means for accumulating user information in an information collection and analyzing that information to generate an optimized plan. This enables real-time information management, immediate feedback of analysis results, and automation of operations.
[0097] "Entered user data" refers to personal information and health status information of users that is collected through the terminal and transmitted to the server.
[0098] "Methods for dynamically generating information" refer to methods that use AI and algorithms to quickly generate optimal information tailored to the situation based on input data.
[0099] "Visualization display means" refers to procedures and methods for displaying generated information on a screen in a way that is easy for the user to understand.
[0100] "Storing user information in an information collection" means saving and managing collected user data in a database or cloud storage.
[0101] An "optimized plan" refers to the most appropriate care plan and service delivery procedure tailored to individual needs, based on analyzed user information.
[0102] An "information terminal" refers to a device used by a user to operate a system, specifically a portable electronic device such as a smartphone or tablet.
[0103] "A means of immediately feeding back and notifying users of analysis results to their devices" refers to a system that transmits the results of AI analysis to the user's information device in real time, enabling them to take necessary actions quickly.
[0104] "Means of automating business processes" refer to technologies and methods that reduce manual work performed by humans and enable efficient business operations through systematized processes.
[0105] To implement this invention, it is necessary to build a system in which a server, terminal, and user work together. The server performs AI analysis using Python, Tensorflow®, etc., and processes user information entered from terminals such as smartphones and tablets. MySQL® or Firebase is used as the database to efficiently store and manage user information. The server immediately feeds back the results of the AI analysis to the terminal and notifies the user.
[0106] The device provides a user interface using React Native and other front-end technologies. This allows users to intuitively input and confirm user information and visually understand the generated care plan and service provider selection results.
[0107] Users directly interact with the system to input and manage their health status in real time. This data is then sent to a server, where AI analysis generates an optimized care plan. Finally, the system provides appropriate care services through an automated workflow.
[0108] The key features of this system are real-time feedback and automated business processes. For example, in elderly care facilities, caregivers record residents' medication adherence using a smartphone app, and an alert is immediately displayed if an abnormality is detected. Based on the resident's health status, AI dynamically adjusts the care plan, and the user is notified of any necessary changes.
[0109] An example of a prompt message for the generating AI model is: "Please record the amount of medication taken daily by elderly user A and issue an alert if there is an abnormality." Through such a system, it becomes possible to improve the quality and efficiency of care and provide the best possible service to users.
[0110] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0111] Step 1:
[0112] Users input their health status and personal information using their device. The entered data is initially processed on the device, converted to JSON format, and sent to the server. This prepares the data for consistent and easy handling.
[0113] Step 2:
[0114] The server stores the received user data in JSON format in a database. During this process, it verifies data integrity and checks for any missing information. The database also stores historical data, allowing for comparison with new data.
[0115] Step 3:
[0116] The server inputs the accumulated data into an AI model for analysis. The generated AI model performs trend analysis with past data and anomaly detection to create an optimal care plan for the user. TensorFlow is used as the AI technology here.
[0117] Step 4:
[0118] The results analyzed by AI are generated as a dynamically optimized care plan by the server. This plan identifies the most efficient way to deliver services based on the data. The output care plan is automatically formatted according to a template.
[0119] Step 5:
[0120] The server sends back the generated care plan and alert information in case of anomalies to the terminal. Upon receiving this data, the terminal visualizes and displays it on the user interface. A user-friendly UI enables immediate response.
[0121] Step 6:
[0122] The user reviews the care plan and alert information displayed on the device and takes the necessary actions. Based on the input, the device sends additional necessary data to the server and proceeds to generate prompt messages.
[0123] Step 7:
[0124] The server generates prompt messages based on user feedback via an AI model. Specific instructions such as, "Please record the amount of medication taken daily by elderly user A and issue an alert if there are any abnormalities," are provided to improve the overall efficiency of the operation.
[0125] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0126] This invention is a care support system that combines an information processing device with an emotion engine, aiming to improve the efficiency and quality of caregiving work through the interaction of a server, terminal, and user.
[0127] server
[0128] The server is the core of the system, responsible for processing data across the entire system. It receives user data entered by users, stores it in a database, and analyzes it. When generating care plans using AI, an emotion engine is also used. The emotion engine analyzes voice and image data transmitted from the terminal to recognize the user's emotions. In the care plan creation process, it takes the user's emotional state into consideration to output appropriate suggestions. In this way, data analysis is realized to improve the quality of care services.
[0129] terminal
[0130] The terminal is a device for users to interact with the system. It not only provides an interface for inputting various information related to care support tasks, but also monitors the user's emotional state in real time through an emotion engine. Based on the user's stress level and emotional state while performing care tasks, feedback is sent to the server. This feedback allows the server to suggest optimized work procedures to reduce the user's workload.
[0131] User
[0132] Users directly operate the system and take on the role of managing care services. They input user information through a terminal and review and utilize care plans and automation suggestions provided by the server. With the introduction of an emotion engine, the user's emotional state is reflected in the care plan generation, resulting in a more personalized service that is optimal for both the user and the individual.
[0133] Specific example
[0134] For example, when a user creates a care plan, the system captures the user's facial expressions and voice tone through the camera and microphone on the device. If the user is experiencing stress, the server uses this information to generate a corresponding care plan. The server also uses feedback from the emotion engine to simplify work processes and suggest ways for users to perform their tasks more efficiently. In this way, using the emotion engine makes it possible to reduce the user's emotional and mental burden and improve the quality of caregiving work.
[0135] This system will improve the work efficiency of care workers while enabling the provision of high-quality care services, and in particular, by utilizing the emotion engine, it will allow for a more human-centered approach.
[0136] The following describes the processing flow.
[0137] Step 1:
[0138] The user logs into the terminal and enters information about the care recipient (health status, necessary care, etc.).
[0139] Step 2:
[0140] The terminal sends the user information entered by the user to the server.
[0141] Step 3:
[0142] The server stores the received user information in a database and prepares to generate the optimal care plan using AI.
[0143] Step 4:
[0144] The device sends the user's facial expressions and voice to an emotion engine, which analyzes the user's emotional state in real time.
[0145] Step 5:
[0146] The server adjusts the parameters to be considered when generating a care plan based on the user's emotional information obtained from the emotion engine.
[0147] Step 6:
[0148] Based on parameters adjusted by the server, AI is used to generate the optimal care plan for the user.
[0149] Step 7:
[0150] The server sends the generated care plan to the terminal and displays it to the user.
[0151] Step 8:
[0152] The user reviews the care plan displayed on their device and makes modifications or approvals as needed.
[0153] Step 9:
[0154] The server stores the final approved care plan and, if necessary, shares the information with relevant service providers.
[0155] Step 10:
[0156] The terminal requests final feedback from the user regarding work procedures and care plans, and sends the necessary information back to the server.
[0157] (Example 2)
[0158] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".
[0159] Conventional care support systems often fail to adequately consider the user's condition and emotions, resulting in difficulties in improving the efficiency and quality of caregiving. In particular, the insufficient generation of appropriate care plans that address the user's emotional state and the lack of automation in work procedures contribute to increasing the burden on care workers.
[0160] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0161] In this invention, the server includes means for receiving and recording user data, means for analyzing voice and image information to recognize the user's emotional state, and means for generating an optimized plan considering the analyzed emotional state. This enables improved efficiency and quality in caregiving operations through the dynamic generation of care plans tailored to the user's emotional state and the automation of work procedures.
[0162] "User data" refers to information about individual users, including their name, health status, and special care needs.
[0163] "Voice and image information" refers to data on the user's voice tone and facial expressions, which forms the basis for analyzing their emotional state.
[0164] "Emotional state" refers to the user's psychological and emotional state, which is inferred from audio and image data.
[0165] An "optimized plan" refers to a set of guidelines for efficient and effective care that are dynamically generated based on the user's emotional state and data analysis.
[0166] "Visualizing information in real time" means instantly displaying data and analysis results on the screen so that users can immediately check the content.
[0167] "Dynamically automating business procedures" refers to automatically optimizing and efficiently executing various caregiving procedures and activities based on the generated plan.
[0168] This invention is a care support system that takes into account the emotional state of the user. Through the interaction of the server, terminal, and user, this system aims to improve the efficiency and quality of caregiving tasks.
[0169] The server plays a central role in information processing, receiving and recording user data. Specifically, it uses speech recognition and image analysis software to analyze audio and image information transmitted from terminals and recognize the user's emotional state. Based on this, it utilizes a generative AI model to generate an optimized care plan that takes the emotional state into account. The AI model is built using programming languages and frameworks such as Python and TensorFlow.
[0170] The terminal is a device through which the user interacts with the system, providing an interface for inputting user information. It also utilizes a camera and microphone to collect the user's facial expressions and voice in real time, feeding back their emotional state to the server. For example, when a user performs a procedure, they can use a prompt such as, "Please suggest recommended caregiving procedures if the user is tired," to request processing from the server.
[0171] Users are responsible for inputting their information while operating the system and for reviewing and implementing the care plan provided by the server. The emotion engine allows the user's real-time emotional state to be reflected in the plan, enabling the creation of a more optimized plan.
[0172] As a concrete example, if a user inputs the results of an elderly person's health checkup and their care history through a terminal, the server generates a care plan to alleviate their burden based on this information and the user's emotional state. In this way, by implementing the invention, high-quality care that reflects the user's emotions and condition can be provided.
[0173] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0174] Step 1:
[0175] The server receives user data from the terminal. This data includes basic user information and details about the user's health status. The server records the received data in a database and prepares it for searching and analysis as needed.
[0176] Step 2:
[0177] The device uses a camera and microphone to collect user voice and image information in real time. This information is used to capture the user's facial expressions and tone of voice. The collected data is immediately sent to a server and input as a dataset for analysis.
[0178] Step 3:
[0179] The server analyzes the received audio and image information. Emotion recognition software is used to identify the user's emotional state. Specifically, it extracts tone and pitch from audio data and analyzes facial expressions from image data to determine stress and fatigue levels. The analysis results are used in subsequent processing.
[0180] Step 4:
[0181] The server uses the results of the emotional state analysis and user data recorded in the database to activate the generating AI model. Based on the prompt, the AI model generates an optimized care plan according to the emotional state. For example, a prompt such as "desirable care procedure when the user is tired" will output a care plan aimed at stress reduction.
[0182] Step 5:
[0183] The server sends the generated care plan to the terminal and provides it to the user. The terminal displays this care plan on its screen, making it available for the user to review. The user can implement the proposed plan and provide feedback on the results to the server via the terminal. This feedback information is analyzed by the server as data to further refine the plan.
[0184] Step 6:
[0185] The server receives user feedback and records it as data for generating the next plan. This feedback data is used to train the model and serves as a reference for generating more accurate plans. This continuous data update improves the overall system performance.
[0186] (Application Example 2)
[0187] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".
[0188] In recent years, there has been a growing demand in the field of elderly care support for care plans that take into account the emotional state of the users. However, conventional systems make it difficult to collect and analyze users' biometric data in real time and to quickly provide optimal care plans based on their emotions. This leads to increased burden on caregivers and a decline in the quality of services provided.
[0189] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.
[0190] In this invention, the server includes means for dynamically generating documents based on user data input in an information processing device, means configured to visualize the generated documents, means for storing user data in a database and analyzing the data to generate optimization information, means for automating business procedures using the optimized information, means for analyzing biometric data acquired by a terminal device to identify the user's emotional state, and means for providing an optimized support plan using the user's emotional state. This makes it possible to provide a quick and appropriate care plan based on emotion recognition, reducing the burden on caregivers and improving the quality of service.
[0191] An "information processing device" is a device used to collect, process, and analyze data.
[0192] "Means of generating documents" refers to functions that combine information based on input data to create new documents.
[0193] "Means configured to visualize documents" refers to a function that displays generated documents on a screen and presents information in a way that is easy for the user to understand.
[0194] "Means of storing information in a database" refers to a system structure that organizes and stores information so that it can be quickly retrieved as needed.
[0195] "Means of analyzing data and generating optimization information" refers to a function that analyzes collected data and provides suggestions and improvement plans to enhance performance and efficiency.
[0196] "Methods for automating business procedures" refer to functions that allow administrative tasks to be performed by machines without human intervention, thereby reducing time and costs.
[0197] "Biometric data acquired by terminal devices" refers to data collected using mobile devices or similar devices to understand the user's physical characteristics and health status.
[0198] "Means for identifying emotional states" refers to functions that understand a user's mental state and emotions by analyzing collected biometric data.
[0199] "Means of providing optimized support plans" refers to the function of promptly supplying individualized care plans and advice based on identified emotional states.
[0200] This invention relates to the configuration of an information processing system for improving the quality and efficiency of care support. The system comprises an information processing device, a data analysis server, a terminal for identifying emotional states, and functions to support the optimization of caregiving tasks.
[0201] The server functions as an information processing device, first storing biometric data collected from terminals in a database. A standard computing server is used as hardware, and the software incorporates a database management system and an AI model. The biometric data is then analyzed using an emotion analysis API to identify and determine the user's current emotional state. This utilizes voice data analysis and image recognition technology.
[0202] Based on the analysis results, a generative AI model is used to automatically generate care plans. The AI model proposes flexible plans tailored to the emotional state, providing the most suitable suggestions for the user. This process is carried out in real time using cloud technology. This reduces the burden on caregivers and maintains the quality of care services.
[0203] For example, if a caregiver experiences stress while assisting an elderly person with a meal, the system quickly analyzes that stress data and provides real-time advice such as "suggest a short break to relax." In this way, the system is designed to make caregivers' care tasks more human-centered.
[0204] For generative AI models, the following example prompts are used:
[0205] "Based on this data, please analyze the emotional state of caregivers and propose a care plan that is effective in reducing stress."
[0206] This system allows emotional states to be immediately reflected in care plans, leading to more effective care.
[0207] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0208] Step 1:
[0209] The device acquires biometric data from caregivers in real time. It uses facial images captured by a camera and audio data collected by a microphone as input. This data is initially processed on the device and converted into a format suitable for the emotion analysis API. The output is a dataset prepared for analysis.
[0210] Step 2:
[0211] The device sends the prepared dataset to the server. The server stores the received data in a database. Simultaneously, it inputs the data into an emotion analysis API and uses AI to identify the user's emotional state. Processed biometric data is used as input, and the output is a result indicating the emotional state. Specifically, emotion labels such as "stress" and "sense of security" are generated.
[0212] Step 3:
[0213] The server inputs prompt sentences into the generating AI model based on the emotion analysis results. Based on these prompt sentences, the AI model generates an appropriate care plan. Using emotion labels and prompt sentences as input, an individualized care support plan is obtained as output. The generated plan includes specific instructions such as "short break" or "play relaxation music."
[0214] Step 4:
[0215] The server sends the generated care plan to the terminal. The terminal displays the plan to the caregiver and supports its implementation. This includes visual instructions using the display and voice guidance from a voice assistant. It uses the plan from the generating AI model as input and provides guidelines as appropriate output to the caregiver.
[0216] Step 5:
[0217] Users perform tasks based on the provided support plan. Caregivers act according to instructions from the terminal and, if necessary, operate the terminal to send additional information to the server. This allows the system to continuously receive caregiver feedback, which can then be incorporated into future plan generation. This cycle optimizes the service.
[0218] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0219] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0220] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.
[0221] [Second Embodiment]
[0222] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.
[0223] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0224] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0225] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.
[0226] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.
[0227] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).
[0228] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.
[0229] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.
[0230] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0231] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0232] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0233] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".
[0234] This invention is a care support system that utilizes a computer network, and primarily operates through the coordinated operation of a server, terminals, and users.
[0235] server
[0236] The server plays a central role in this system, processing user input data. First, when user data is sent to the server, it stores it in a database. Then, artificial intelligence (AI) is used to analyze the data as needed to generate an optimal care plan. The generated care plan is automatically created as a document in a format suitable for submission to the government, based on a specified template.
[0237] Furthermore, the server aggregates data from multiple users and cross-references it with a service provider database to automatically select the most suitable service provider for each user. This makes it possible to propose the optimal care plan for each user and the service providers that can provide it.
[0238] terminal
[0239] The terminal is a device for users to interface with the system. On the terminal, users input their information, and this data is sent to the server. The results processed by the server are sent back to the terminal and displayed in a format that the user can review. This includes generated care plans and service provider selection results. The terminal also visualizes information necessary for schedule management and work procedures, supporting the user's work.
[0240] User
[0241] Users are those who directly operate the system and perform care support tasks. They use terminals to input user information and utilize the system to support the creation of optimal care plans and the generation of necessary administrative documents. Users also receive improvement suggestions and reports from the server and work to improve the quality of their work.
[0242] Specific example
[0243] For example, suppose a user enters information about a new care service recipient, user A, into the terminal. Based on the user's health condition and required care, the server uses AI to generate an optimal care plan. In this process, multiple service provider databases are consulted, and the most suitable provider for user A is selected. Finally, the generated care plan and matching results are displayed on the terminal, allowing the user to review them and arrange the necessary services for user A.
[0244] Through this system, users can improve the efficiency and quality of their work, and effectively support their independence as care managers.
[0245] The following describes the processing flow.
[0246] Step 1:
[0247] The user uses a terminal to input basic information about the person requesting care services (name, address, health condition, desired care content, etc.).
[0248] Step 2:
[0249] The terminal receives user input data and sends it to the server.
[0250] Step 3:
[0251] The server saves the user information it receives to the database.
[0252] Step 4:
[0253] The server uses AI functionality to generate an optimal care plan based on the user's information. Here, it analyzes the user's health condition and desired services to formulate an appropriate care plan.
[0254] Step 5:
[0255] The server references a database of care service providers and automatically selects the most suitable provider for the user. This matching process is based on location information and the services that can be provided.
[0256] Step 6:
[0257] The server sends the generated care plan and information about the selected service provider to the terminal.
[0258] Step 7:
[0259] The terminal receives results from the server and displays the care plan and service provider information to the user.
[0260] Step 8:
[0261] The user reviews the displayed information, modifies the care plan and service provider information if necessary, and makes the final decision to arrange everything.
[0262] (Example 1)
[0263] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."
[0264] Modern elderly care support requires complex information management and the selection of diverse service providers, necessitating systems to handle these tasks efficiently. However, conventional technologies have presented challenges such as inefficient manual entry of user information, creation of individual documents, and selection of appropriate service providers, resulting in a heavy workload.
[0265] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0266] In this invention, the server includes means for dynamically generating information based on input personal data, means for storing personal data in an information storage device and analyzing that information to generate optimized information, and means for searching for information on multiple providers and selecting the most suitable provider. This enables efficient information management and automatic selection of the optimal care plan and provider.
[0267] "Personal data" refers to all information about a user, including basic information, health status, and service preferences.
[0268] An "information storage device" refers to a storage device, such as a database, used to store and manage personal data.
[0269] "Optimized information" refers to information that proposes the most effective care plans and services for the user, generated based on personal data.
[0270] "Provider information" refers to all information about companies and organizations that provide care services, including their geographical location and the services they can offer.
[0271] A "template" is a model used when creating a document, providing a standard for structuring information in a specific format.
[0272] "Official procedural documents" refer to official documents that are required to be submitted to administrative agencies and are generated in a prescribed format.
[0273] A "care plan" refers to a series of support plans created based on the user's health condition and care needs, and includes specific measures to be implemented.
[0274] "Dynamically generating information" refers to the process of generating information in real time based on input data, and is operated using predefined rules and algorithms.
[0275] This system is designed to streamline care support, with servers, terminals, and users working together in coordination.
[0276] The server plays a central role in the system. It receives personal data transmitted from terminals and stores it in an information storage device. The server analyzes this data using high-performance database software and generative AI models. As a result of this analysis, an optimal care plan and optimization information are generated for the user. Furthermore, the server searches for information from multiple providers and selects the most suitable provider. This process involves complex data calculations and compares and evaluates multiple information sources to achieve optimal matching.
[0277] The terminal functions as a device for inputting information and displaying results from the server. The terminal provides an interface for users to input personal data. Users can input basic information and health status of care recipients into the terminal, enabling data transmission to the server. Care plans and provider selection results, analyzed by a generative AI model, are visualized on the terminal and presented to the user.
[0278] Users directly operate this system and utilize it in their care support work. Based on the analysis results from the generated AI model, users can confirm the optimal care plan and arrange the necessary services. Furthermore, they can quickly complete relevant administrative procedures using the generated official procedural documents. Therefore, users can significantly improve the efficiency of their care work.
[0279] As a specific example, when a user inputs information about user A who newly receives care services into a terminal, the data is analyzed by a server, and an optimal care plan is generated. The selection of a provider is also automatically performed, and the user can confirm the generated plan and the selection result. As a result, the user can quickly and effectively adjust the services. By operating according to an example of a prompt sentence "Generate a care plan for user A and select an optimal service provider", the system supports the smooth execution of operations.
[0280] The flow of the specific process in Example 1 will be described using FIG. 11.
[0281] Step 1:
[0282] The terminal receives the personal data of the user input by the user. This input information includes basic personal information, health status, care needs, etc. The terminal formats this data into a specified format and prepares to send it to the server. The user checks the input content and, if there is no problem, clicks the send button, and the data is sent to the server.
[0283] Step 2:
[0284] The server receives the personal data sent from the terminal and stores it in the information storage device. The received data undergoes a consistency check and is stored in the database as it is if there is no problem. If a problem is found in the consistency, the server notifies the terminal to that effect and prompts the user for reconfirmation.
[0285] Step 3:
[0286] The server uses the stored personal data as input and performs data analysis using a generative AI model. The AI model generates an optimal care plan based on the user's health status and needs. At this time, while referring to past data and patterns, it proposes the care method that is considered to be the most effective. The server formats the generated care plan into a document format and converts it into the documents required for administrative procedures using a template.
[0287] Step 4:
[0288] Based on the generated care plan, the server searches multiple provider information databases. The provider information includes geographical location, types of services available, etc. The server matches it with the input personal data and selects the most suitable service provider for the user. The selected information is compiled as a proposal list for the user.
[0289] Step 5:
[0290] The server sends the generated care plan and the provider selection result to the terminal. The terminal receives this and visually presents it to the user. The user checks the displayed information, makes input or corrections again if there are any unclear points or corrections, and resends it to the server if necessary. As a specific operation, the user operates the received data based on the prompt example sentence "Please generate a care plan for User A and select the optimal service provider".
[0291] (Application Example 1)
[0292] Next, Application Example 1 will be described. In the following description, the data processing device 12 is referred to as the "server", and the smart glasses 214 are referred to as the "terminal".
[0293] In conventional care support, the management of user information and the creation of care plans rely on manual work, and there have been challenges in improving the efficiency and quality of operations. Also, it has been difficult to grasp the health status in real time and respond quickly, and it has been difficult to provide optimal care services.
[0294] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0295] In this invention, the server includes means for dynamically generating information based on input user data, display means for visualizing the generated information, and means for accumulating user information in an information collection and analyzing that information to generate an optimized plan. This enables real-time information management, immediate feedback of analysis results, and automation of operations.
[0296] "Entered user data" refers to personal information and health status information of users that is collected through the terminal and transmitted to the server.
[0297] "Methods for dynamically generating information" refer to methods that use AI and algorithms to quickly generate optimal information tailored to the situation based on input data.
[0298] "Visualization display means" refers to procedures and methods for displaying generated information on a screen in a way that is easy for the user to understand.
[0299] "Storing user information in an information collection" means saving and managing collected user data in a database or cloud storage.
[0300] An "optimized plan" refers to the most appropriate care plan and service delivery procedure tailored to individual needs, based on analyzed user information.
[0301] An "information terminal" refers to a device used by a user to operate a system, specifically a portable electronic device such as a smartphone or tablet.
[0302] "A means of immediately feeding back and notifying users of analysis results to their devices" refers to a system that transmits the results of AI analysis to the user's information device in real time, enabling them to take necessary actions quickly.
[0303] The "means for automating operations" refers to technologies and methods for reducing manual work by humans and efficiently advancing operations through a systematized process.
[0304] In order to implement this invention, it is necessary to construct a system in which a server, a terminal, and a user cooperate. The server performs AI analysis using Python, TensorFlow, etc., and processes the information of users input from terminals such as smartphones and tablets. In addition, MySQL or Firebase is used for the database to efficiently store and manage user information. The server immediately feeds back the results analyzed by AI to the terminal and notifies the user.
[0305] The terminal provides a user interface using React Native and other front-end technologies. As a result, users can intuitively input and confirm user information, and visually grasp the generated care plan and the selection results of service providers.
[0306] The user inputs and manages the health status of the user in real time by directly operating on the system. As a result, the input data is sent to the server, and a care plan optimized by AI analysis is generated. Finally, the system provides appropriate care services through an automated business process.
[0307] The features of this system lie in real-time feedback and an automated business process. As a specific example, in a facility for the elderly, a caregiver records the medication status of a user with a smartphone app, and an alert is immediately displayed if an abnormality is detected. Based on the health status of the user, AI dynamically adjusts the care plan, and the necessary changes are notified to the user.
[0308] An example of a prompt message for the generating AI model is: "Please record the amount of medication taken daily by elderly user A and issue an alert if there is an abnormality." Through such a system, it becomes possible to improve the quality and efficiency of care and provide the best possible service to users.
[0309] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0310] Step 1:
[0311] Users input their health status and personal information using their device. The entered data is initially processed on the device, converted to JSON format, and sent to the server. This prepares the data for consistent and easy handling.
[0312] Step 2:
[0313] The server stores the received user data in JSON format in a database. During this process, it verifies data integrity and checks for any missing information. The database also stores historical data, allowing for comparison with new data.
[0314] Step 3:
[0315] The server inputs the accumulated data into an AI model for analysis. The generated AI model performs trend analysis with past data and anomaly detection to create an optimal care plan for the user. TensorFlow is used as the AI technology here.
[0316] Step 4:
[0317] The results analyzed by AI are generated as a dynamically optimized care plan by the server. This plan identifies the most efficient way to deliver services based on the data. The output care plan is automatically formatted according to a template.
[0318] Step 5:
[0319] The server sends back the generated care plan and alert information in case of anomalies to the terminal. Upon receiving this data, the terminal visualizes and displays it on the user interface. A user-friendly UI enables immediate response.
[0320] Step 6:
[0321] The user reviews the care plan and alert information displayed on the device and takes the necessary actions. Based on the input, the device sends additional necessary data to the server and proceeds to generate prompt messages.
[0322] Step 7:
[0323] The server generates prompt messages based on user feedback via an AI model. Specific instructions such as, "Please record the amount of medication taken daily by elderly user A and issue an alert if there are any abnormalities," are provided to improve the overall efficiency of the operation.
[0324] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0325] This invention is a care support system that combines an information processing device with an emotion engine, aiming to improve the efficiency and quality of caregiving work through the interaction of a server, terminal, and user.
[0326] server
[0327] The server is the core of the system, responsible for processing data across the entire system. It receives user data entered by users, stores it in a database, and analyzes it. When generating care plans using AI, an emotion engine is also used. The emotion engine analyzes voice and image data transmitted from the terminal to recognize the user's emotions. In the care plan creation process, it takes the user's emotional state into consideration to output appropriate suggestions. In this way, data analysis is realized to improve the quality of care services.
[0328] terminal
[0329] The terminal is a device for users to interact with the system. It not only provides an interface for inputting various information related to care support tasks, but also monitors the user's emotional state in real time through an emotion engine. Based on the user's stress level and emotional state while performing care tasks, feedback is sent to the server. This feedback allows the server to suggest optimized work procedures to reduce the user's workload.
[0330] User
[0331] Users directly operate the system and take on the role of managing care services. They input user information through a terminal and review and utilize care plans and automation suggestions provided by the server. With the introduction of an emotion engine, the user's emotional state is reflected in the care plan generation, resulting in a more personalized service that is optimal for both the user and the individual.
[0332] Specific example
[0333] For example, when a user creates a care plan, the system captures the user's facial expressions and voice tone through the camera and microphone on the device. If the user is experiencing stress, the server uses this information to generate a corresponding care plan. The server also uses feedback from the emotion engine to simplify work processes and suggest ways for users to perform their tasks more efficiently. In this way, using the emotion engine makes it possible to reduce the user's emotional and mental burden and improve the quality of caregiving work.
[0334] This system will improve the work efficiency of care workers while enabling the provision of high-quality care services, and in particular, by utilizing the emotion engine, it will allow for a more human-centered approach.
[0335] The following describes the processing flow.
[0336] Step 1:
[0337] The user logs into the terminal and enters information about the care recipient (health status, necessary care, etc.).
[0338] Step 2:
[0339] The terminal sends the user information entered by the user to the server.
[0340] Step 3:
[0341] The server stores the received user information in a database and prepares to generate the optimal care plan using AI.
[0342] Step 4:
[0343] The device sends the user's facial expressions and voice to an emotion engine, which analyzes the user's emotional state in real time.
[0344] Step 5:
[0345] The server adjusts the parameters to be considered when generating a care plan based on the user's emotional information obtained from the emotion engine.
[0346] Step 6:
[0347] Based on parameters adjusted by the server, AI is used to generate the optimal care plan for the user.
[0348] Step 7:
[0349] The server sends the generated care plan to the terminal and displays it to the user.
[0350] Step 8:
[0351] The user reviews the care plan displayed on their device and makes modifications or approvals as needed.
[0352] Step 9:
[0353] The server stores the final approved care plan and, if necessary, shares the information with relevant service providers.
[0354] Step 10:
[0355] The terminal requests final feedback from the user regarding work procedures and care plans, and sends the necessary information back to the server.
[0356] (Example 2)
[0357] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".
[0358] Conventional care support systems often fail to adequately consider the user's condition and emotions, resulting in difficulties in improving the efficiency and quality of caregiving. In particular, the insufficient generation of appropriate care plans that address the user's emotional state and the lack of automation in work procedures contribute to increasing the burden on care workers.
[0359] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0360] In this invention, the server includes means for receiving and recording user data, means for analyzing voice and image information to recognize the user's emotional state, and means for generating an optimized plan considering the analyzed emotional state. This enables improved efficiency and quality in caregiving operations through the dynamic generation of care plans tailored to the user's emotional state and the automation of work procedures.
[0361] "User data" refers to information about individual users, including their name, health status, and special care needs.
[0362] "Voice and image information" refers to data on the user's voice tone and facial expressions, which forms the basis for analyzing their emotional state.
[0363] "Emotional state" refers to the user's psychological and emotional state, which is inferred from audio and image data.
[0364] An "optimized plan" refers to a set of guidelines for efficient and effective care that are dynamically generated based on the user's emotional state and data analysis.
[0365] "Visualizing information in real time" means instantly displaying data and analysis results on the screen so that users can immediately check the content.
[0366] "Dynamically automating business procedures" refers to automatically optimizing and efficiently executing various caregiving procedures and activities based on the generated plan.
[0367] This invention is a care support system that takes into account the emotional state of the user. Through the interaction of the server, terminal, and user, this system aims to improve the efficiency and quality of caregiving tasks.
[0368] The server plays a central role in information processing, receiving and recording user data. Specifically, it uses speech recognition and image analysis software to analyze audio and image information transmitted from terminals and recognize the user's emotional state. Based on this, it utilizes a generative AI model to generate an optimized care plan that takes the emotional state into account. The AI model is built using programming languages and frameworks such as Python and TensorFlow.
[0369] The terminal is a device through which the user interacts with the system, providing an interface for inputting user information. It also utilizes a camera and microphone to collect the user's facial expressions and voice in real time, feeding back their emotional state to the server. For example, when a user performs a procedure, they can use a prompt such as, "Please suggest recommended caregiving procedures if the user is tired," to request processing from the server.
[0370] Users are responsible for inputting their information while operating the system and for reviewing and implementing the care plan provided by the server. The emotion engine allows the user's real-time emotional state to be reflected in the plan, enabling the creation of a more optimized plan.
[0371] As a concrete example, if a user inputs the results of an elderly person's health checkup and their care history through a terminal, the server generates a care plan to alleviate their burden based on this information and the user's emotional state. In this way, by implementing the invention, high-quality care that reflects the user's emotions and condition can be provided.
[0372] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0373] Step 1:
[0374] The server receives user data from the terminal. This data includes basic user information and details about the user's health status. The server records the received data in a database and prepares it for searching and analysis as needed.
[0375] Step 2:
[0376] The device uses a camera and microphone to collect user voice and image information in real time. This information is used to capture the user's facial expressions and tone of voice. The collected data is immediately sent to a server and input as a dataset for analysis.
[0377] Step 3:
[0378] The server analyzes the received audio and image information. Emotion recognition software is used to identify the user's emotional state. Specifically, it extracts tone and pitch from audio data and analyzes facial expressions from image data to determine stress and fatigue levels. The analysis results are used in subsequent processing.
[0379] Step 4:
[0380] The server uses the results of the emotional state analysis and user data recorded in the database to activate the generating AI model. Based on the prompt, the AI model generates an optimized care plan according to the emotional state. For example, a prompt such as "desirable care procedure when the user is tired" will output a care plan aimed at stress reduction.
[0381] Step 5:
[0382] The server sends the generated care plan to the terminal and provides it to the user. The terminal displays this care plan on its screen, making it available for the user to review. The user can implement the proposed plan and provide feedback on the results to the server via the terminal. This feedback information is analyzed by the server as data to further refine the plan.
[0383] Step 6:
[0384] The server receives user feedback and records it as data for generating the next plan. This feedback data is used to train the model and serves as a reference for generating more accurate plans. This continuous data update improves the overall system performance.
[0385] (Application Example 2)
[0386] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."
[0387] In recent years, there has been a growing demand in the field of elderly care support for care plans that take into account the emotional state of the users. However, conventional systems make it difficult to collect and analyze users' biometric data in real time and to quickly provide optimal care plans based on their emotions. This leads to increased burden on caregivers and a decline in the quality of services provided.
[0388] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.
[0389] In this invention, the server includes means for dynamically generating documents based on user data input in an information processing device, means configured to visualize the generated documents, means for storing user data in a database and analyzing the data to generate optimization information, means for automating business procedures using the optimized information, means for analyzing biometric data acquired by a terminal device to identify the user's emotional state, and means for providing an optimized support plan using the user's emotional state. This makes it possible to provide a quick and appropriate care plan based on emotion recognition, reducing the burden on caregivers and improving the quality of service.
[0390] An "information processing device" is a device used to collect, process, and analyze data.
[0391] "Means of generating documents" refers to functions that combine information based on input data to create new documents.
[0392] "Means configured to visualize documents" refers to a function that displays generated documents on a screen and presents information in a way that is easy for the user to understand.
[0393] "Means of storing information in a database" refers to a system structure that organizes and stores information so that it can be quickly retrieved as needed.
[0394] "Means of analyzing data and generating optimization information" refers to a function that analyzes collected data and provides suggestions and improvement plans to enhance performance and efficiency.
[0395] "Methods for automating business procedures" refer to functions that allow administrative tasks to be performed by machines without human intervention, thereby reducing time and costs.
[0396] "Biometric data acquired by terminal devices" refers to data collected using mobile devices or similar devices to understand the user's physical characteristics and health status.
[0397] "Means for identifying emotional states" refers to functions that understand a user's mental state and emotions by analyzing collected biometric data.
[0398] "Means of providing optimized support plans" refers to the function of promptly supplying individualized care plans and advice based on identified emotional states.
[0399] This invention relates to the configuration of an information processing system for improving the quality and efficiency of care support. The system comprises an information processing device, a data analysis server, a terminal for identifying emotional states, and functions to support the optimization of caregiving tasks.
[0400] The server functions as an information processing device, first storing biometric data collected from terminals in a database. A standard computing server is used as hardware, and the software incorporates a database management system and an AI model. The biometric data is then analyzed using an emotion analysis API to identify and determine the user's current emotional state. This utilizes voice data analysis and image recognition technology.
[0401] Based on the analysis results, a generative AI model is used to automatically generate care plans. The AI model proposes flexible plans tailored to the emotional state, providing the most suitable suggestions for the user. This process is carried out in real time using cloud technology. This reduces the burden on caregivers and maintains the quality of care services.
[0402] For example, if a caregiver experiences stress while assisting an elderly person with a meal, the system quickly analyzes that stress data and provides real-time advice such as "suggest a short break to relax." In this way, the system is designed to make caregivers' care tasks more human-centered.
[0403] For generative AI models, the following example prompts are used:
[0404] "Based on this data, please analyze the emotional state of caregivers and propose a care plan that is effective in reducing stress."
[0405] This system allows emotional states to be immediately reflected in care plans, leading to more effective care.
[0406] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0407] Step 1:
[0408] The device acquires biometric data from caregivers in real time. It uses facial images captured by a camera and audio data collected by a microphone as input. This data is initially processed on the device and converted into a format suitable for the emotion analysis API. The output is a dataset prepared for analysis.
[0409] Step 2:
[0410] The device sends the prepared dataset to the server. The server stores the received data in a database. Simultaneously, it inputs the data into an emotion analysis API and uses AI to identify the user's emotional state. Processed biometric data is used as input, and the output is a result indicating the emotional state. Specifically, emotion labels such as "stress" and "sense of security" are generated.
[0411] Step 3:
[0412] The server inputs prompt sentences into the generating AI model based on the emotion analysis results. Based on these prompt sentences, the AI model generates an appropriate care plan. Using emotion labels and prompt sentences as input, an individualized care support plan is obtained as output. The generated plan includes specific instructions such as "short break" or "play relaxation music."
[0413] Step 4:
[0414] The server sends the generated care plan to the terminal. The terminal displays the plan to the caregiver and supports its implementation. This includes visual instructions using the display and voice guidance from a voice assistant. It uses the plan from the generating AI model as input and provides guidelines as appropriate output to the caregiver.
[0415] Step 5:
[0416] Users perform tasks based on the provided support plan. Caregivers act according to instructions from the terminal and, if necessary, operate the terminal to send additional information to the server. This allows the system to continuously receive caregiver feedback, which can then be incorporated into future plan generation. This cycle optimizes the service.
[0417] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.
[0418] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0419] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.
[0420] [Third Embodiment]
[0421] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.
[0422] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.
[0423] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0424] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.
[0425] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.
[0426] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).
[0427] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.
[0428] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.
[0429] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0430] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0431] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0432] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".
[0433] This invention is a care support system that utilizes a computer network, and primarily operates through the coordinated operation of a server, terminals, and users.
[0434] server
[0435] The server plays a central role in this system, processing user input data. First, when user data is sent to the server, it stores it in a database. Then, artificial intelligence (AI) is used to analyze the data as needed to generate an optimal care plan. The generated care plan is automatically created as a document in a format suitable for submission to the government, based on a specified template.
[0436] Furthermore, the server aggregates data from multiple users and cross-references it with a service provider database to automatically select the most suitable service provider for each user. This makes it possible to propose the optimal care plan for each user and the service providers that can provide it.
[0437] terminal
[0438] The terminal is a device for users to interface with the system. On the terminal, users input their information, and this data is sent to the server. The results processed by the server are sent back to the terminal and displayed in a format that the user can review. This includes generated care plans and service provider selection results. The terminal also visualizes information necessary for schedule management and work procedures, supporting the user's work.
[0439] User
[0440] Users are those who directly operate the system and perform care support tasks. They use terminals to input user information and utilize the system to support the creation of optimal care plans and the generation of necessary administrative documents. Users also receive improvement suggestions and reports from the server and work to improve the quality of their work.
[0441] Specific example
[0442] For example, suppose a user enters information about a new care service recipient, user A, into the terminal. Based on the user's health condition and required care, the server uses AI to generate an optimal care plan. In this process, multiple service provider databases are consulted, and the most suitable provider for user A is selected. Finally, the generated care plan and matching results are displayed on the terminal, allowing the user to review them and arrange the necessary services for user A.
[0443] Through this system, users can improve the efficiency and quality of their work, and effectively support their independence as care managers.
[0444] The following describes the processing flow.
[0445] Step 1:
[0446] The user uses a terminal to input basic information about the person requesting care services (name, address, health condition, desired care content, etc.).
[0447] Step 2:
[0448] The terminal receives user input data and sends it to the server.
[0449] Step 3:
[0450] The server saves the user information it receives to the database.
[0451] Step 4:
[0452] The server uses AI functionality to generate an optimal care plan based on the user's information. Here, it analyzes the user's health condition and desired services to formulate an appropriate care plan.
[0453] Step 5:
[0454] The server references a database of care service providers and automatically selects the most suitable provider for the user. This matching process is based on location information and the services that can be provided.
[0455] Step 6:
[0456] The server sends the generated care plan and information about the selected service provider to the terminal.
[0457] Step 7:
[0458] The terminal receives results from the server and displays the care plan and service provider information to the user.
[0459] Step 8:
[0460] The user reviews the displayed information, modifies the care plan and service provider information if necessary, and makes the final decision to arrange everything.
[0461] (Example 1)
[0462] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0463] Modern elderly care support requires complex information management and the selection of diverse service providers, necessitating systems to handle these tasks efficiently. However, conventional technologies have presented challenges such as inefficient manual entry of user information, creation of individual documents, and selection of appropriate service providers, resulting in a heavy workload.
[0464] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0465] In this invention, the server includes means for dynamically generating information based on input personal data, means for storing personal data in an information storage device and analyzing that information to generate optimized information, and means for searching for information on multiple providers and selecting the most suitable provider. This enables efficient information management and automatic selection of the optimal care plan and provider.
[0466] "Personal data" refers to all information about a user, including basic information, health status, and service preferences.
[0467] An "information storage device" refers to a storage device, such as a database, used to store and manage personal data.
[0468] "Optimized information" refers to information that proposes the most effective care plans and services for the user, generated based on personal data.
[0469] "Provider information" refers to all information about companies and organizations that provide care services, including their geographical location and the services they can offer.
[0470] A "template" is a model used when creating a document, providing a standard for structuring information in a specific format.
[0471] "Official procedural documents" refer to official documents that are required to be submitted to administrative agencies and are generated in a prescribed format.
[0472] A "care plan" refers to a series of support plans created based on the user's health condition and care needs, and includes specific measures to be implemented.
[0473] "Dynamically generating information" refers to the process of generating information in real time based on input data, and is operated using predefined rules and algorithms.
[0474] This system is designed to streamline care support, with servers, terminals, and users working together in coordination.
[0475] The server plays a central role in the system. It receives personal data transmitted from terminals and stores it in an information storage device. The server analyzes this data using high-performance database software and generative AI models. As a result of this analysis, an optimal care plan and optimization information are generated for the user. Furthermore, the server searches for information from multiple providers and selects the most suitable provider. This process involves complex data calculations and compares and evaluates multiple information sources to achieve optimal matching.
[0476] The terminal functions as a device for inputting information and displaying results from the server. The terminal provides an interface for users to input personal data. Users can input basic information and health status of care recipients into the terminal, enabling data transmission to the server. Care plans and provider selection results, analyzed by a generative AI model, are visualized on the terminal and presented to the user.
[0477] Users directly operate this system and utilize it in their care support work. Based on the analysis results from the generated AI model, users can confirm the optimal care plan and arrange the necessary services. Furthermore, they can quickly complete relevant administrative procedures using the generated official procedural documents. Therefore, users can significantly improve the efficiency of their care work.
[0478] As a concrete example, when a user enters information about a new care service recipient, user A, into the terminal, that data is analyzed on the server, and an optimal care plan is generated. The selection of service providers is also performed automatically, and the user can review the generated plan and the selection results. This allows the user to coordinate services quickly and effectively. By operating according to an example prompt message such as, "Generate a care plan for user A and select the most suitable service provider," the system supports the smooth execution of tasks.
[0479] The flow of the specific processing in Example 1 will be explained using Figure 11.
[0480] Step 1:
[0481] The terminal receives the user's personal data entered by the user. This information includes basic personal information, health status, and care needs. The terminal formats this data into a specified format and prepares it for transmission to the server. The user reviews the entered information, and if there are no problems, clicks the submit button to send the data to the server.
[0482] Step 2:
[0483] The server receives personal data transmitted from the terminal and stores it in the information storage device. The received data undergoes an integrity check, and if there are no problems, it is stored in the database. If an integrity problem is found, the server notifies the terminal and prompts the user to reconfirm.
[0484] Step 3:
[0485] The server uses stored personal data as input and performs data analysis using a generating AI model. The AI model generates an optimal care plan based on the user's health status and needs. In doing so, it suggests the most effective care methods while referring to past data and patterns. The server formats the generated care plan into a document and converts it into the necessary documents for administrative procedures using templates.
[0486] Step 4:
[0487] The server searches multiple provider information databases based on the generated care plan. Provider information includes geographical location and the types of services offered. The server compares this information with the entered personal data and selects the most suitable service provider for the user. The selected information is compiled into a suggestion list for the user.
[0488] Step 5:
[0489] The server sends the generated care plan and provider selection results to the terminal. The terminal receives this and presents it visually to the user. The user reviews the displayed information, re-enters or corrects any unclear points or corrections, and resends it to the server as needed. Specifically, the user manipulates the received data based on the prompt example, "Generate a care plan for user A and select the most suitable service provider."
[0490] (Application Example 1)
[0491] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0492] In traditional care support, managing user information and creating care plans relied on manual processes, posing challenges in improving efficiency and quality. Furthermore, real-time monitoring of health conditions and prompt responses were difficult, making it challenging to provide optimal care services.
[0493] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0494] In this invention, the server includes means for dynamically generating information based on input user data, display means for visualizing the generated information, and means for accumulating user information in an information collection and analyzing that information to generate an optimized plan. This enables real-time information management, immediate feedback of analysis results, and automation of operations.
[0495] "Entered user data" refers to personal information and health status information of users that is collected through the terminal and transmitted to the server.
[0496] "Methods for dynamically generating information" refer to methods that use AI and algorithms to quickly generate optimal information tailored to the situation based on input data.
[0497] "Visualization display means" refers to procedures and methods for displaying generated information on a screen in a way that is easy for the user to understand.
[0498] "Storing user information in an information collection" means saving and managing collected user data in a database or cloud storage.
[0499] An "optimized plan" refers to the most appropriate care plan and service delivery procedure tailored to individual needs, based on analyzed user information.
[0500] An "information terminal" refers to a device used by a user to operate a system, specifically a portable electronic device such as a smartphone or tablet.
[0501] "A means of immediately feeding back and notifying users of analysis results to their devices" refers to a system that transmits the results of AI analysis to the user's information device in real time, enabling them to take necessary actions quickly.
[0502] "Means of automating business processes" refer to technologies and methods that reduce manual work performed by humans and enable efficient business operations through systematized processes.
[0503] To implement this invention, it is necessary to build a system in which a server, terminal, and user work in conjunction. The server performs AI analysis using Python, TensorFlow, etc., and processes user information entered from terminals such as smartphones and tablets. MySQL or Firebase is used as the database to efficiently store and manage user information. The server immediately feeds back the results of the AI analysis to the terminal and notifies the user.
[0504] The device provides a user interface using React Native and other front-end technologies. This allows users to intuitively input and confirm user information and visually understand the generated care plan and service provider selection results.
[0505] Users directly interact with the system to input and manage their health status in real time. This data is then sent to a server, where AI analysis generates an optimized care plan. Finally, the system provides appropriate care services through an automated workflow.
[0506] The key features of this system are real-time feedback and automated business processes. For example, in elderly care facilities, caregivers record residents' medication adherence using a smartphone app, and an alert is immediately displayed if an abnormality is detected. Based on the resident's health status, AI dynamically adjusts the care plan, and the user is notified of any necessary changes.
[0507] An example of a prompt message for the generating AI model is: "Please record the amount of medication taken daily by elderly user A and issue an alert if there is an abnormality." Through such a system, it becomes possible to improve the quality and efficiency of care and provide the best possible service to users.
[0508] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0509] Step 1:
[0510] Users input their health status and personal information using their device. The entered data is initially processed on the device, converted to JSON format, and sent to the server. This prepares the data for consistent and easy handling.
[0511] Step 2:
[0512] The server stores the received user data in JSON format in a database. During this process, it verifies data integrity and checks for any missing information. The database also stores historical data, allowing for comparison with new data.
[0513] Step 3:
[0514] The server inputs the accumulated data into an AI model for analysis. The generated AI model performs trend analysis with past data and anomaly detection to create an optimal care plan for the user. TensorFlow is used as the AI technology here.
[0515] Step 4:
[0516] The results analyzed by AI are generated as a dynamically optimized care plan by the server. This plan identifies the most efficient way to deliver services based on the data. The output care plan is automatically formatted according to a template.
[0517] Step 5:
[0518] The server sends back the generated care plan and alert information in case of anomalies to the terminal. Upon receiving this data, the terminal visualizes and displays it on the user interface. A user-friendly UI enables immediate response.
[0519] Step 6:
[0520] The user reviews the care plan and alert information displayed on the device and takes the necessary actions. Based on the input, the device sends additional necessary data to the server and proceeds to generate prompt messages.
[0521] Step 7:
[0522] The server generates prompt messages based on user feedback via an AI model. Specific instructions such as, "Please record the amount of medication taken daily by elderly user A and issue an alert if there are any abnormalities," are provided to improve the overall efficiency of the operation.
[0523] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0524] This invention is a care support system that combines an information processing device with an emotion engine, aiming to improve the efficiency and quality of caregiving work through the interaction of a server, terminal, and user.
[0525] server
[0526] The server is the core of the system, responsible for processing data across the entire system. It receives user data entered by users, stores it in a database, and analyzes it. When generating care plans using AI, an emotion engine is also used. The emotion engine analyzes voice and image data transmitted from the terminal to recognize the user's emotions. In the care plan creation process, it takes the user's emotional state into consideration to output appropriate suggestions. In this way, data analysis is realized to improve the quality of care services.
[0527] terminal
[0528] The terminal is a device for users to interact with the system. It not only provides an interface for inputting various information related to care support tasks, but also monitors the user's emotional state in real time through an emotion engine. Based on the user's stress level and emotional state while performing care tasks, feedback is sent to the server. This feedback allows the server to suggest optimized work procedures to reduce the user's workload.
[0529] User
[0530] Users directly operate the system and take on the role of managing care services. They input user information through a terminal and review and utilize care plans and automation suggestions provided by the server. With the introduction of an emotion engine, the user's emotional state is reflected in the care plan generation, resulting in a more personalized service that is optimal for both the user and the individual.
[0531] Specific example
[0532] For example, when a user creates a care plan, the system captures the user's facial expressions and voice tone through the camera and microphone on the device. If the user is experiencing stress, the server uses this information to generate a corresponding care plan. The server also uses feedback from the emotion engine to simplify work processes and suggest ways for users to perform their tasks more efficiently. In this way, using the emotion engine makes it possible to reduce the user's emotional and mental burden and improve the quality of caregiving work.
[0533] This system will improve the work efficiency of care workers while enabling the provision of high-quality care services, and in particular, by utilizing the emotion engine, it will allow for a more human-centered approach.
[0534] The following describes the processing flow.
[0535] Step 1:
[0536] The user logs into the terminal and enters information about the care recipient (health status, necessary care, etc.).
[0537] Step 2:
[0538] The terminal sends the user information entered by the user to the server.
[0539] Step 3:
[0540] The server stores the received user information in a database and prepares to generate the optimal care plan using AI.
[0541] Step 4:
[0542] The device sends the user's facial expressions and voice to an emotion engine, which analyzes the user's emotional state in real time.
[0543] Step 5:
[0544] The server adjusts the parameters to be considered when generating a care plan based on the user's emotional information obtained from the emotion engine.
[0545] Step 6:
[0546] Based on parameters adjusted by the server, AI is used to generate the optimal care plan for the user.
[0547] Step 7:
[0548] The server sends the generated care plan to the terminal and displays it to the user.
[0549] Step 8:
[0550] The user reviews the care plan displayed on their device and makes modifications or approvals as needed.
[0551] Step 9:
[0552] The server stores the final approved care plan and, if necessary, shares the information with relevant service providers.
[0553] Step 10:
[0554] The terminal requests final feedback from the user regarding work procedures and care plans, and sends the necessary information back to the server.
[0555] (Example 2)
[0556] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0557] Conventional care support systems often fail to adequately consider the user's condition and emotions, resulting in difficulties in improving the efficiency and quality of caregiving. In particular, the insufficient generation of appropriate care plans that address the user's emotional state and the lack of automation in work procedures contribute to increasing the burden on care workers.
[0558] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0559] In this invention, the server includes means for receiving and recording user data, means for analyzing voice and image information to recognize the user's emotional state, and means for generating an optimized plan considering the analyzed emotional state. This enables improved efficiency and quality in caregiving operations through the dynamic generation of care plans tailored to the user's emotional state and the automation of work procedures.
[0560] "User data" refers to information about individual users, including their name, health status, and special care needs.
[0561] "Voice and image information" refers to data on the user's voice tone and facial expressions, which forms the basis for analyzing their emotional state.
[0562] "Emotional state" refers to the user's psychological and emotional state, which is inferred from audio and image data.
[0563] An "optimized plan" refers to a set of guidelines for efficient and effective care that are dynamically generated based on the user's emotional state and data analysis.
[0564] "Visualizing information in real time" means instantly displaying data and analysis results on the screen so that users can immediately check the content.
[0565] "Dynamically automating business procedures" refers to automatically optimizing and efficiently executing various caregiving procedures and activities based on the generated plan.
[0566] This invention is a care support system that takes into account the emotional state of the user. Through the interaction of the server, terminal, and user, this system aims to improve the efficiency and quality of caregiving tasks.
[0567] The server plays a central role in information processing, receiving and recording user data. Specifically, it uses speech recognition and image analysis software to analyze audio and image information transmitted from terminals and recognize the user's emotional state. Based on this, it utilizes a generative AI model to generate an optimized care plan that takes the emotional state into account. The AI model is built using programming languages and frameworks such as Python and TensorFlow.
[0568] The terminal is a device through which the user interacts with the system, providing an interface for inputting user information. It also utilizes a camera and microphone to collect the user's facial expressions and voice in real time, feeding back their emotional state to the server. For example, when a user performs a procedure, they can use a prompt such as, "Please suggest recommended caregiving procedures if the user is tired," to request processing from the server.
[0569] Users are responsible for inputting their information while operating the system and for reviewing and implementing the care plan provided by the server. The emotion engine allows the user's real-time emotional state to be reflected in the plan, enabling the creation of a more optimized plan.
[0570] As a concrete example, if a user inputs the results of an elderly person's health checkup and their care history through a terminal, the server generates a care plan to alleviate their burden based on this information and the user's emotional state. In this way, by implementing the invention, high-quality care that reflects the user's emotions and condition can be provided.
[0571] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0572] Step 1:
[0573] The server receives user data from the terminal. This data includes basic user information and details about the user's health status. The server records the received data in a database and prepares it for searching and analysis as needed.
[0574] Step 2:
[0575] The device uses a camera and microphone to collect user voice and image information in real time. This information is used to capture the user's facial expressions and tone of voice. The collected data is immediately sent to a server and input as a dataset for analysis.
[0576] Step 3:
[0577] The server analyzes the received audio and image information. Emotion recognition software is used to identify the user's emotional state. Specifically, it extracts tone and pitch from audio data and analyzes facial expressions from image data to determine stress and fatigue levels. The analysis results are used in subsequent processing.
[0578] Step 4:
[0579] The server uses the results of the emotional state analysis and user data recorded in the database to activate the generating AI model. Based on the prompt, the AI model generates an optimized care plan according to the emotional state. For example, a prompt such as "desirable care procedure when the user is tired" will output a care plan aimed at stress reduction.
[0580] Step 5:
[0581] The server sends the generated care plan to the terminal and provides it to the user. The terminal displays this care plan on its screen, making it available for the user to review. The user can implement the proposed plan and provide feedback on the results to the server via the terminal. This feedback information is analyzed by the server as data to further refine the plan.
[0582] Step 6:
[0583] The server receives user feedback and records it as data for generating the next plan. This feedback data is used to train the model and serves as a reference for generating more accurate plans. This continuous data update improves the overall system performance.
[0584] (Application Example 2)
[0585] Next, we will explain Application Example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0586] In recent years, there has been a growing demand in the field of elderly care support for care plans that take into account the emotional state of the users. However, conventional systems make it difficult to collect and analyze users' biometric data in real time and to quickly provide optimal care plans based on their emotions. This leads to increased burden on caregivers and a decline in the quality of services provided.
[0587] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.
[0588] In this invention, the server includes means for dynamically generating documents based on user data input in an information processing device, means configured to visualize the generated documents, means for storing user data in a database and analyzing the data to generate optimization information, means for automating business procedures using the optimized information, means for analyzing biometric data acquired by a terminal device to identify the user's emotional state, and means for providing an optimized support plan using the user's emotional state. This makes it possible to provide a quick and appropriate care plan based on emotion recognition, reducing the burden on caregivers and improving the quality of service.
[0589] An "information processing device" is a device used to collect, process, and analyze data.
[0590] "Means of generating documents" refers to functions that combine information based on input data to create new documents.
[0591] "Means configured to visualize documents" refers to a function that displays generated documents on a screen and presents information in a way that is easy for the user to understand.
[0592] "Means of storing information in a database" refers to a system structure that organizes and stores information so that it can be quickly retrieved as needed.
[0593] "Means of analyzing data and generating optimization information" refers to a function that analyzes collected data and provides suggestions and improvement plans to enhance performance and efficiency.
[0594] "Methods for automating business procedures" refer to functions that allow administrative tasks to be performed by machines without human intervention, thereby reducing time and costs.
[0595] "Biometric data acquired by terminal devices" refers to data collected using mobile devices or similar devices to understand the user's physical characteristics and health status.
[0596] "Means for identifying emotional states" refers to functions that understand a user's mental state and emotions by analyzing collected biometric data.
[0597] "Means of providing optimized support plans" refers to the function of promptly supplying individualized care plans and advice based on identified emotional states.
[0598] This invention relates to the configuration of an information processing system for improving the quality and efficiency of care support. The system comprises an information processing device, a data analysis server, a terminal for identifying emotional states, and functions to support the optimization of caregiving tasks.
[0599] The server functions as an information processing device, first storing biometric data collected from terminals in a database. A standard computing server is used as hardware, and the software incorporates a database management system and an AI model. The biometric data is then analyzed using an emotion analysis API to identify and determine the user's current emotional state. This utilizes voice data analysis and image recognition technology.
[0600] Based on the analysis results, a generative AI model is used to automatically generate care plans. The AI model proposes flexible plans tailored to the emotional state, providing the most suitable suggestions for the user. This process is carried out in real time using cloud technology. This reduces the burden on caregivers and maintains the quality of care services.
[0601] For example, if a caregiver experiences stress while assisting an elderly person with a meal, the system quickly analyzes that stress data and provides real-time advice such as "suggest a short break to relax." In this way, the system is designed to make caregivers' care tasks more human-centered.
[0602] For generative AI models, the following example prompts are used:
[0603] "Based on this data, please analyze the emotional state of caregivers and propose a care plan that is effective in reducing stress."
[0604] This system allows emotional states to be immediately reflected in care plans, leading to more effective care.
[0605] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0606] Step 1:
[0607] The device acquires biometric data from caregivers in real time. It uses facial images captured by a camera and audio data collected by a microphone as input. This data is initially processed on the device and converted into a format suitable for the emotion analysis API. The output is a dataset prepared for analysis.
[0608] Step 2:
[0609] The device sends the prepared dataset to the server. The server stores the received data in a database. Simultaneously, it inputs the data into an emotion analysis API and uses AI to identify the user's emotional state. Processed biometric data is used as input, and the output is a result indicating the emotional state. Specifically, emotion labels such as "stress" and "sense of security" are generated.
[0610] Step 3:
[0611] The server inputs prompt sentences into the generating AI model based on the emotion analysis results. Based on these prompt sentences, the AI model generates an appropriate care plan. Using emotion labels and prompt sentences as input, an individualized care support plan is obtained as output. The generated plan includes specific instructions such as "short break" or "play relaxation music."
[0612] Step 4:
[0613] The server sends the generated care plan to the terminal. The terminal displays the plan to the caregiver and supports its implementation. This includes visual instructions using the display and voice guidance from a voice assistant. It uses the plan from the generating AI model as input and provides guidelines as appropriate output to the caregiver.
[0614] Step 5:
[0615] Users perform tasks based on the provided support plan. Caregivers act according to instructions from the terminal and, if necessary, operate the terminal to send additional information to the server. This allows the system to continuously receive caregiver feedback, which can then be incorporated into future plan generation. This cycle optimizes the service.
[0616] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.
[0617] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0618] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.
[0619] [Fourth Embodiment]
[0620] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.
[0621] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[0622] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0623] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.
[0624] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.
[0625] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).
[0626] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.
[0627] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.
[0628] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.
[0629] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0630] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0631] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0632] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0633] This invention is a care support system that utilizes a computer network, and primarily operates through the coordinated operation of a server, terminals, and users.
[0634] server
[0635] The server plays a central role in this system, processing user input data. First, when user data is sent to the server, it stores it in a database. Then, artificial intelligence (AI) is used to analyze the data as needed to generate an optimal care plan. The generated care plan is automatically created as a document in a format suitable for submission to the government, based on a specified template.
[0636] Furthermore, the server aggregates data from multiple users and cross-references it with a service provider database to automatically select the most suitable service provider for each user. This makes it possible to propose the optimal care plan for each user and the service providers that can provide it.
[0637] terminal
[0638] The terminal is a device for users to interface with the system. On the terminal, users input their information, and this data is sent to the server. The results processed by the server are sent back to the terminal and displayed in a format that the user can review. This includes generated care plans and service provider selection results. The terminal also visualizes information necessary for schedule management and work procedures, supporting the user's work.
[0639] User
[0640] Users are those who directly operate the system and perform care support tasks. They use terminals to input user information and utilize the system to support the creation of optimal care plans and the generation of necessary administrative documents. Users also receive improvement suggestions and reports from the server and work to improve the quality of their work.
[0641] Specific example
[0642] For example, suppose a user enters information about a new care service recipient, user A, into the terminal. Based on the user's health condition and required care, the server uses AI to generate an optimal care plan. In this process, multiple service provider databases are consulted, and the most suitable provider for user A is selected. Finally, the generated care plan and matching results are displayed on the terminal, allowing the user to review them and arrange the necessary services for user A.
[0643] Through this system, users can improve the efficiency and quality of their work, and effectively support their independence as care managers.
[0644] The following describes the processing flow.
[0645] Step 1:
[0646] The user uses a terminal to input basic information about the person requesting care services (name, address, health condition, desired care content, etc.).
[0647] Step 2:
[0648] The terminal receives user input data and sends it to the server.
[0649] Step 3:
[0650] The server saves the user information it receives to the database.
[0651] Step 4:
[0652] The server uses AI functionality to generate an optimal care plan based on the user's information. Here, it analyzes the user's health condition and desired services to formulate an appropriate care plan.
[0653] Step 5:
[0654] The server references a database of care service providers and automatically selects the most suitable provider for the user. This matching process is based on location information and the services that can be provided.
[0655] Step 6:
[0656] The server sends the generated care plan and information about the selected service provider to the terminal.
[0657] Step 7:
[0658] The terminal receives results from the server and displays the care plan and service provider information to the user.
[0659] Step 8:
[0660] The user reviews the displayed information, modifies the care plan and service provider information if necessary, and makes the final decision to arrange everything.
[0661] (Example 1)
[0662] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0663] Modern elderly care support requires complex information management and the selection of diverse service providers, necessitating systems to handle these tasks efficiently. However, conventional technologies have presented challenges such as inefficient manual entry of user information, creation of individual documents, and selection of appropriate service providers, resulting in a heavy workload.
[0664] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0665] In this invention, the server includes means for dynamically generating information based on input personal data, means for storing personal data in an information storage device and analyzing that information to generate optimized information, and means for searching for information on multiple providers and selecting the most suitable provider. This enables efficient information management and automatic selection of the optimal care plan and provider.
[0666] "Personal data" refers to all information about a user, including basic information, health status, and service preferences.
[0667] An "information storage device" refers to a storage device, such as a database, used to store and manage personal data.
[0668] "Optimized information" refers to information that proposes the most effective care plans and services for the user, generated based on personal data.
[0669] "Provider information" refers to all information about companies and organizations that provide care services, including their geographical location and the services they can offer.
[0670] A "template" is a model used when creating a document, providing a standard for structuring information in a specific format.
[0671] "Official procedural documents" refer to official documents that are required to be submitted to administrative agencies and are generated in a prescribed format.
[0672] A "care plan" refers to a series of support plans created based on the user's health condition and care needs, and includes specific measures to be implemented.
[0673] "Dynamically generating information" refers to the process of generating information in real time based on input data, and is operated using predefined rules and algorithms.
[0674] This system is designed to streamline care support, with servers, terminals, and users working together in coordination.
[0675] The server plays a central role in the system. It receives personal data transmitted from terminals and stores it in an information storage device. The server analyzes this data using high-performance database software and generative AI models. As a result of this analysis, an optimal care plan and optimization information are generated for the user. Furthermore, the server searches for information from multiple providers and selects the most suitable provider. This process involves complex data calculations and compares and evaluates multiple information sources to achieve optimal matching.
[0676] The terminal functions as a device for inputting information and displaying results from the server. The terminal provides an interface for users to input personal data. Users can input basic information and health status of care recipients into the terminal, enabling data transmission to the server. Care plans and provider selection results, analyzed by a generative AI model, are visualized on the terminal and presented to the user.
[0677] Users directly operate this system and utilize it in their care support work. Based on the analysis results from the generated AI model, users can confirm the optimal care plan and arrange the necessary services. Furthermore, they can quickly complete relevant administrative procedures using the generated official procedural documents. Therefore, users can significantly improve the efficiency of their care work.
[0678] As a concrete example, when a user enters information about a new care service recipient, user A, into the terminal, that data is analyzed on the server, and an optimal care plan is generated. The selection of service providers is also performed automatically, and the user can review the generated plan and the selection results. This allows the user to coordinate services quickly and effectively. By operating according to an example prompt message such as, "Generate a care plan for user A and select the most suitable service provider," the system supports the smooth execution of tasks.
[0679] The flow of the specific processing in Example 1 will be explained using Figure 11.
[0680] Step 1:
[0681] The terminal receives the user's personal data entered by the user. This information includes basic personal information, health status, and care needs. The terminal formats this data into a specified format and prepares it for transmission to the server. The user reviews the entered information, and if there are no problems, clicks the submit button to send the data to the server.
[0682] Step 2:
[0683] The server receives personal data transmitted from the terminal and stores it in the information storage device. The received data undergoes an integrity check, and if there are no problems, it is stored in the database. If an integrity problem is found, the server notifies the terminal and prompts the user to reconfirm.
[0684] Step 3:
[0685] The server uses stored personal data as input and performs data analysis using a generating AI model. The AI model generates an optimal care plan based on the user's health status and needs. In doing so, it suggests the most effective care methods while referring to past data and patterns. The server formats the generated care plan into a document and converts it into the necessary documents for administrative procedures using templates.
[0686] Step 4:
[0687] The server searches multiple provider information databases based on the generated care plan. Provider information includes geographical location and the types of services offered. The server compares this information with the entered personal data and selects the most suitable service provider for the user. The selected information is compiled into a suggestion list for the user.
[0688] Step 5:
[0689] The server sends the generated care plan and provider selection results to the terminal. The terminal receives this and presents it visually to the user. The user reviews the displayed information, re-enters or corrects any unclear points or corrections, and resends it to the server as needed. Specifically, the user manipulates the received data based on the prompt example, "Generate a care plan for user A and select the most suitable service provider."
[0690] (Application Example 1)
[0691] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0692] In traditional care support, managing user information and creating care plans relied on manual processes, posing challenges in improving efficiency and quality. Furthermore, real-time monitoring of health conditions and prompt responses were difficult, making it challenging to provide optimal care services.
[0693] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0694] In this invention, the server includes means for dynamically generating information based on input user data, display means for visualizing the generated information, and means for accumulating user information in an information collection and analyzing that information to generate an optimized plan. This enables real-time information management, immediate feedback of analysis results, and automation of operations.
[0695] "Entered user data" refers to personal information and health status information of users that is collected through the terminal and transmitted to the server.
[0696] "Methods for dynamically generating information" refer to methods that use AI and algorithms to quickly generate optimal information tailored to the situation based on input data.
[0697] "Visualization display means" refers to procedures and methods for displaying generated information on a screen in a way that is easy for the user to understand.
[0698] "Storing user information in an information collection" means saving and managing collected user data in a database or cloud storage.
[0699] An "optimized plan" refers to the most appropriate care plan and service delivery procedure tailored to individual needs, based on analyzed user information.
[0700] An "information terminal" refers to a device used by a user to operate a system, specifically a portable electronic device such as a smartphone or tablet.
[0701] "A means of immediately feeding back and notifying users of analysis results to their devices" refers to a system that transmits the results of AI analysis to the user's information device in real time, enabling them to take necessary actions quickly.
[0702] "Means of automating business processes" refer to technologies and methods that reduce manual work performed by humans and enable efficient business operations through systematized processes.
[0703] To implement this invention, it is necessary to build a system in which a server, terminal, and user work in conjunction. The server performs AI analysis using Python, TensorFlow, etc., and processes user information entered from terminals such as smartphones and tablets. MySQL or Firebase is used as the database to efficiently store and manage user information. The server immediately feeds back the results of the AI analysis to the terminal and notifies the user.
[0704] The device provides a user interface using React Native and other front-end technologies. This allows users to intuitively input and confirm user information and visually understand the generated care plan and service provider selection results.
[0705] Users directly interact with the system to input and manage their health status in real time. This data is then sent to a server, where AI analysis generates an optimized care plan. Finally, the system provides appropriate care services through an automated workflow.
[0706] The key features of this system are real-time feedback and automated business processes. For example, in elderly care facilities, caregivers record residents' medication adherence using a smartphone app, and an alert is immediately displayed if an abnormality is detected. Based on the resident's health status, AI dynamically adjusts the care plan, and the user is notified of any necessary changes.
[0707] An example of a prompt message for the generating AI model is: "Please record the amount of medication taken daily by elderly user A and issue an alert if there is an abnormality." Through such a system, it becomes possible to improve the quality and efficiency of care and provide the best possible service to users.
[0708] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0709] Step 1:
[0710] Users input their health status and personal information using their device. The entered data is initially processed on the device, converted to JSON format, and sent to the server. This prepares the data for consistent and easy handling.
[0711] Step 2:
[0712] The server stores the received user data in JSON format in a database. During this process, it verifies data integrity and checks for any missing information. The database also stores historical data, allowing for comparison with new data.
[0713] Step 3:
[0714] The server inputs the accumulated data into an AI model for analysis. The generated AI model performs trend analysis with past data and anomaly detection to create an optimal care plan for the user. TensorFlow is used as the AI technology here.
[0715] Step 4:
[0716] The results analyzed by AI are generated as a dynamically optimized care plan by the server. This plan identifies the most efficient way to deliver services based on the data. The output care plan is automatically formatted according to a template.
[0717] Step 5:
[0718] The server sends back the generated care plan and alert information in case of anomalies to the terminal. Upon receiving this data, the terminal visualizes and displays it on the user interface. A user-friendly UI enables immediate response.
[0719] Step 6:
[0720] The user reviews the care plan and alert information displayed on the device and takes the necessary actions. Based on the input, the device sends additional necessary data to the server and proceeds to generate prompt messages.
[0721] Step 7:
[0722] The server generates prompt messages based on user feedback via an AI model. Specific instructions such as, "Please record the amount of medication taken daily by elderly user A and issue an alert if there are any abnormalities," are provided to improve the overall efficiency of the operation.
[0723] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0724] This invention is a care support system that combines an information processing device with an emotion engine, aiming to improve the efficiency and quality of caregiving work through the interaction of a server, terminal, and user.
[0725] server
[0726] The server is the core of the system, responsible for processing data across the entire system. It receives user data entered by users, stores it in a database, and analyzes it. When generating care plans using AI, an emotion engine is also used. The emotion engine analyzes voice and image data transmitted from the terminal to recognize the user's emotions. In the care plan creation process, it takes the user's emotional state into consideration to output appropriate suggestions. In this way, data analysis is realized to improve the quality of care services.
[0727] terminal
[0728] The terminal is a device for users to interact with the system. It not only provides an interface for inputting various information related to care support tasks, but also monitors the user's emotional state in real time through an emotion engine. Based on the user's stress level and emotional state while performing care tasks, feedback is sent to the server. This feedback allows the server to suggest optimized work procedures to reduce the user's workload.
[0729] User
[0730] Users directly operate the system and take on the role of managing care services. They input user information through a terminal and review and utilize care plans and automation suggestions provided by the server. With the introduction of an emotion engine, the user's emotional state is reflected in the care plan generation, resulting in a more personalized service that is optimal for both the user and the individual.
[0731] Specific example
[0732] For example, when a user creates a care plan, the system captures the user's facial expressions and voice tone through the camera and microphone on the device. If the user is experiencing stress, the server uses this information to generate a corresponding care plan. The server also uses feedback from the emotion engine to simplify work processes and suggest ways for users to perform their tasks more efficiently. In this way, using the emotion engine makes it possible to reduce the user's emotional and mental burden and improve the quality of caregiving work.
[0733] This system will improve the work efficiency of care workers while enabling the provision of high-quality care services, and in particular, by utilizing the emotion engine, it will allow for a more human-centered approach.
[0734] The following describes the processing flow.
[0735] Step 1:
[0736] The user logs into the terminal and enters information about the care recipient (health status, necessary care, etc.).
[0737] Step 2:
[0738] The terminal sends the user information entered by the user to the server.
[0739] Step 3:
[0740] The server stores the received user information in a database and prepares to generate the optimal care plan using AI.
[0741] Step 4:
[0742] The device sends the user's facial expressions and voice to an emotion engine, which analyzes the user's emotional state in real time.
[0743] Step 5:
[0744] The server adjusts the parameters to be considered when generating a care plan based on the user's emotional information obtained from the emotion engine.
[0745] Step 6:
[0746] Based on parameters adjusted by the server, AI is used to generate the optimal care plan for the user.
[0747] Step 7:
[0748] The server sends the generated care plan to the terminal and displays it to the user.
[0749] Step 8:
[0750] The user reviews the care plan displayed on their device and makes modifications or approvals as needed.
[0751] Step 9:
[0752] The server stores the final approved care plan and, if necessary, shares the information with relevant service providers.
[0753] Step 10:
[0754] The terminal requests final feedback from the user regarding work procedures and care plans, and sends the necessary information back to the server.
[0755] (Example 2)
[0756] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0757] Conventional care support systems often fail to adequately consider the user's condition and emotions, resulting in difficulties in improving the efficiency and quality of caregiving. In particular, the insufficient generation of appropriate care plans that address the user's emotional state and the lack of automation in work procedures contribute to increasing the burden on care workers.
[0758] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0759] In this invention, the server includes means for receiving and recording user data, means for analyzing voice and image information to recognize the user's emotional state, and means for generating an optimized plan considering the analyzed emotional state. This enables improved efficiency and quality in caregiving operations through the dynamic generation of care plans tailored to the user's emotional state and the automation of work procedures.
[0760] "User data" refers to information about individual users, including their name, health status, and special care needs.
[0761] "Voice and image information" refers to data on the user's voice tone and facial expressions, which forms the basis for analyzing their emotional state.
[0762] "Emotional state" refers to the user's psychological and emotional state, which is inferred from audio and image data.
[0763] An "optimized plan" refers to a set of guidelines for efficient and effective care that are dynamically generated based on the user's emotional state and data analysis.
[0764] "Visualizing information in real time" means instantly displaying data and analysis results on the screen so that users can immediately check the content.
[0765] "Dynamically automating business procedures" refers to automatically optimizing and efficiently executing various caregiving procedures and activities based on the generated plan.
[0766] This invention is a care support system that takes into account the emotional state of the user. Through the interaction of the server, terminal, and user, this system aims to improve the efficiency and quality of caregiving tasks.
[0767] The server plays a central role in information processing, receiving and recording user data. Specifically, it uses speech recognition and image analysis software to analyze audio and image information transmitted from terminals and recognize the user's emotional state. Based on this, it utilizes a generative AI model to generate an optimized care plan that takes the emotional state into account. The AI model is built using programming languages and frameworks such as Python and TensorFlow.
[0768] The terminal is a device through which the user interacts with the system, providing an interface for inputting user information. It also utilizes a camera and microphone to collect the user's facial expressions and voice in real time, feeding back their emotional state to the server. For example, when a user performs a procedure, they can use a prompt such as, "Please suggest recommended caregiving procedures if the user is tired," to request processing from the server.
[0769] Users are responsible for inputting their information while operating the system and for reviewing and implementing the care plan provided by the server. The emotion engine allows the user's real-time emotional state to be reflected in the plan, enabling the creation of a more optimized plan.
[0770] As a concrete example, if a user inputs the results of an elderly person's health checkup and their care history through a terminal, the server generates a care plan to alleviate their burden based on this information and the user's emotional state. In this way, by implementing the invention, high-quality care that reflects the user's emotions and condition can be provided.
[0771] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0772] Step 1:
[0773] The server receives user data from the terminal. This data includes basic user information and details about the user's health status. The server records the received data in a database and prepares it for searching and analysis as needed.
[0774] Step 2:
[0775] The device uses a camera and microphone to collect user voice and image information in real time. This information is used to capture the user's facial expressions and tone of voice. The collected data is immediately sent to a server and input as a dataset for analysis.
[0776] Step 3:
[0777] The server analyzes the received audio and image information. Emotion recognition software is used to identify the user's emotional state. Specifically, it extracts tone and pitch from audio data and analyzes facial expressions from image data to determine stress and fatigue levels. The analysis results are used in subsequent processing.
[0778] Step 4:
[0779] The server uses the results of the emotional state analysis and user data recorded in the database to activate the generating AI model. Based on the prompt, the AI model generates an optimized care plan according to the emotional state. For example, a prompt such as "desirable care procedure when the user is tired" will output a care plan aimed at stress reduction.
[0780] Step 5:
[0781] The server sends the generated care plan to the terminal and provides it to the user. The terminal displays this care plan on its screen, making it available for the user to review. The user can implement the proposed plan and provide feedback on the results to the server via the terminal. This feedback information is analyzed by the server as data to further refine the plan.
[0782] Step 6:
[0783] The server receives user feedback and records it as data for generating the next plan. This feedback data is used to train the model and serves as a reference for generating more accurate plans. This continuous data update improves the overall system performance.
[0784] (Application Example 2)
[0785] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0786] In recent years, there has been a growing demand in the field of elderly care support for care plans that take into account the emotional state of the users. However, conventional systems make it difficult to collect and analyze users' biometric data in real time and to quickly provide optimal care plans based on their emotions. This leads to increased burden on caregivers and a decline in the quality of services provided.
[0787] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.
[0788] In this invention, the server includes means for dynamically generating documents based on user data input in an information processing device, means configured to visualize the generated documents, means for storing user data in a database and analyzing the data to generate optimization information, means for automating business procedures using the optimized information, means for analyzing biometric data acquired by a terminal device to identify the user's emotional state, and means for providing an optimized support plan using the user's emotional state. This makes it possible to provide a quick and appropriate care plan based on emotion recognition, reducing the burden on caregivers and improving the quality of service.
[0789] An "information processing device" is a device used to collect, process, and analyze data.
[0790] "Means of generating documents" refers to functions that combine information based on input data to create new documents.
[0791] "Means configured to visualize documents" refers to a function that displays generated documents on a screen and presents information in a way that is easy for the user to understand.
[0792] "Means of storing information in a database" refers to a system structure that organizes and stores information so that it can be quickly retrieved as needed.
[0793] "Means of analyzing data and generating optimization information" refers to a function that analyzes collected data and provides suggestions and improvement plans to enhance performance and efficiency.
[0794] "Methods for automating business procedures" refer to functions that allow administrative tasks to be performed by machines without human intervention, thereby reducing time and costs.
[0795] "Biometric data acquired by terminal devices" refers to data collected using mobile devices or similar devices to understand the user's physical characteristics and health status.
[0796] "Means for identifying emotional states" refers to functions that understand a user's mental state and emotions by analyzing collected biometric data.
[0797] "Means of providing optimized support plans" refers to the function of promptly supplying individualized care plans and advice based on identified emotional states.
[0798] This invention relates to the configuration of an information processing system for improving the quality and efficiency of care support. The system comprises an information processing device, a data analysis server, a terminal for identifying emotional states, and functions to support the optimization of caregiving tasks.
[0799] The server functions as an information processing device, first storing biometric data collected from terminals in a database. A standard computing server is used as hardware, and the software incorporates a database management system and an AI model. The biometric data is then analyzed using an emotion analysis API to identify and determine the user's current emotional state. This utilizes voice data analysis and image recognition technology.
[0800] Based on the analysis results, a generative AI model is used to automatically generate care plans. The AI model proposes flexible plans tailored to the emotional state, providing the most suitable suggestions for the user. This process is carried out in real time using cloud technology. This reduces the burden on caregivers and maintains the quality of care services.
[0801] For example, if a caregiver experiences stress while assisting an elderly person with a meal, the system quickly analyzes that stress data and provides real-time advice such as "suggest a short break to relax." In this way, the system is designed to make caregivers' care tasks more human-centered.
[0802] For generative AI models, the following example prompts are used:
[0803] "Based on this data, please analyze the emotional state of caregivers and propose a care plan that is effective in reducing stress."
[0804] This system allows emotional states to be immediately reflected in care plans, leading to more effective care.
[0805] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0806] Step 1:
[0807] The device acquires biometric data from caregivers in real time. It uses facial images captured by a camera and audio data collected by a microphone as input. This data is initially processed on the device and converted into a format suitable for the emotion analysis API. The output is a dataset prepared for analysis.
[0808] Step 2:
[0809] The device sends the prepared dataset to the server. The server stores the received data in a database. Simultaneously, it inputs the data into an emotion analysis API and uses AI to identify the user's emotional state. Processed biometric data is used as input, and the output is a result indicating the emotional state. Specifically, emotion labels such as "stress" and "sense of security" are generated.
[0810] Step 3:
[0811] The server inputs prompt sentences into the generating AI model based on the emotion analysis results. Based on these prompt sentences, the AI model generates an appropriate care plan. Using emotion labels and prompt sentences as input, an individualized care support plan is obtained as output. The generated plan includes specific instructions such as "short break" or "play relaxation music."
[0812] Step 4:
[0813] The server sends the generated care plan to the terminal. The terminal displays the plan to the caregiver and supports its implementation. This includes visual instructions using the display and voice guidance from a voice assistant. It uses the plan from the generating AI model as input and provides guidelines as appropriate output to the caregiver.
[0814] Step 5:
[0815] Users perform tasks based on the provided support plan. Caregivers act according to instructions from the terminal and, if necessary, operate the terminal to send additional information to the server. This allows the system to continuously receive caregiver feedback, which can then be incorporated into future plan generation. This cycle optimizes the service.
[0816] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.
[0817] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0818] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.
[0819] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.
[0820] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.
[0821] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.
[0822] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.
[0823] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.
[0824] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."
[0825] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.
[0826] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.
[0827] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.
[0828] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.
[0829] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.
[0830] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.
[0831] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.
[0832] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.
[0833] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.
[0834] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.
[0835] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.
[0836] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.
[0837] The following is further disclosed regarding the embodiments described above.
[0838] (Claim 1)
[0839] An information processing device provides a means for dynamically generating documents based on input user data,
[0840] A means configured to visualize the generated document,
[0841] A means of storing user data in a database and analyzing that data to generate optimization information,
[0842] A means of automating business procedures using optimized information,
[0843] A system that includes this.
[0844] (Claim 2)
[0845] The system according to claim 1, wherein the document generation means automatically generates administrative procedure documents using a template.
[0846] (Claim 3)
[0847] The system according to claim 1, which dynamically performs the creation of care plans and the selection of service providers as a means of automating business procedures.
[0848] "Example 1"
[0849] (Claim 1)
[0850] A means of dynamically generating information based on the entered personal data,
[0851] A means configured to visualize the generated information,
[0852] A means for storing personal data in an information storage device, analyzing that information, and generating optimized information,
[0853] A means of automating business procedures using optimized information,
[0854] A means of searching for information from multiple providers and selecting the most suitable provider,
[0855] A system that includes this.
[0856] (Claim 2)
[0857] The system according to claim 1 for automatically generating official procedural documents using templates.
[0858] (Claim 3)
[0859] The system according to claim 1, which dynamically creates care plans and selects care providers.
[0860] "Application Example 1"
[0861] (Claim 1)
[0862] A means of dynamically generating information based on input user data,
[0863] A display means for visualizing the generated information,
[0864] A means for accumulating user information in an information collection, analyzing that information, and generating an optimized plan,
[0865] Means of automating tasks using optimized plans,
[0866] A means of inputting and managing the user's health status in real time on an information terminal,
[0867] A means of immediately feeding back the analysis results to the terminal and notifying it,
[0868] A system that includes this.
[0869] (Claim 2)
[0870] The system according to claim 1 for automatically generating administrative procedure documents using templates.
[0871] (Claim 3)
[0872] The system according to claim 1, which dynamically creates care plans and selects providers as a means of automating operations, and notifies an information processing device in real time.
[0873] "Example 2 of combining an emotion engine"
[0874] (Claim 1)
[0875] A means for receiving user data and recording the data,
[0876] A means of analyzing audio and image information to recognize the user's emotional state,
[0877] A means for generating an optimized plan that takes into account the analyzed emotional state,
[0878] A means of visualizing information in real time and receiving feedback,
[0879] A means of dynamically automating business procedures based on the generated plan,
[0880] A system that includes this.
[0881] (Claim 2)
[0882] The system according to claim 1, which dynamically adjusts the plan based on the analyzed emotional state.
[0883] (Claim 3)
[0884] The system according to claim 1, which provides a means for generating a plan while taking into account user emotional data, and outputs information that improves the efficiency of the plan.
[0885] "Application example 2 of combining emotional engines"
[0886] (Claim 1)
[0887] An information processing device provides a means for dynamically generating documents based on input user data,
[0888] A means configured to visualize the generated document,
[0889] A means of storing user data in a database and analyzing that data to generate optimization information,
[0890] A means of automating business procedures using optimized information,
[0891] A means of analyzing biometric data acquired by a terminal device to identify the user's emotional state,
[0892] A means of providing an optimized support plan using the user's emotional state,
[0893] A system that includes this.
[0894] (Claim 2)
[0895] The system according to claim 1, wherein the document generation means automatically generates administrative procedure documents using a template.
[0896] (Claim 3)
[0897] The system according to claim 1, which dynamically performs the creation of care plans and the selection of service providers as a means of automating business procedures. [Explanation of Symbols]
[0898] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>
Claims
1. An information processing device provides a means for dynamically generating documents based on input user data, A means configured to visualize the generated document, A means of storing user data in a database and analyzing that data to generate optimization information, A means of automating business procedures using optimized information, A system that includes this.
2. The system according to claim 1, wherein the document generation means automatically generates administrative procedure documents using a template.
3. The system according to claim 1, which dynamically performs the creation of care plans and the selection of service providers as a means of automating business procedures.